A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_12
Author: Baseline Licence: Academic PaperMessiness: 0.6554
Ambiguity (Chamfer): 0.15302
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Poly Vector → Stroke Aggregator | Poly Vector | Delaunay Triangulation | Topology Driven | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00112 |  distance: 0.00126 |  distance: 0.00133 |  distance: 0.00142 |  distance: 0.00149 |  distance: 0.00155 |  distance: 0.00163 |  distance: 0.0021 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.0014892558826642708 | distance: 0.00149variant: thresholded | 92.0 |
| Fidelity Simplicity | 0.0020971376518747337 | distance: 0.0021variant: thresholded 1000pxalg. parameter: 0.5 | 323.0 |
| Mastering Sketching | 0.001120730653631115 | distance: 0.00112variant: thresholded 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.0013347862039295682 | distance: 0.00133variant: thresholded 1000px | 102.0 |
| Poly Vector | 0.0014217559535498068 | distance: 0.00142variant: thresholded 1000pxalg. parameter: noisy | 462.0 |
| Real-Time Inking | 0.0012557691717372324 | distance: 0.00126variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.0016344275829384652 | distance: 0.00163variant: original | 658.0 |
| Topology Driven | 0.0015515363030608304 | distance: 0.00155variant: original | 105.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.6017949382927584 | distance: 0.60179variant: original | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5471045109362556 |  distance: 0.5471variant: thresholded 500px | 159.0 |
| Delaunay Triangulation | 0.4541096049821597 |  distance: 0.45411variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.5674782402962457 |  distance: 0.56748variant: thresholded 500pxalg. parameter: 0.75 | 185.0 |
| Mastering Sketching | 0.6906403641379976 |  distance: 0.69064variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6138953979289224 |  distance: 0.6139variant: thresholded 1000pxalg. parameter: noisy | 102.0 |
| Poly Vector | 0.6181089135276133 |  distance: 0.61811variant: vectorized (all layers) 1000pxalg. parameter: noisy | 335.0 |
| Topology Driven | 0.5518608151357279 |  distance: 0.55186variant: thresholded 1000px | 60.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.6797855286106319 | distance: 0.67979variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.7551221753728397 |  distance: 0.75512variant: thresholded 500pxalg. parameter: 0.6 | 173.0 |
| Mastering Sketching | 0.850827554465385 | distance: 0.85083variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8039154437432608 |  distance: 0.80392variant: vectorized (all layers) 1000px | 167.0 |
| Poly Vector | 0.8224563597245815 | distance: 0.82246variant: thresholded 1000pxalg. parameter: noisy | 462.0 |
| Real-Time Inking | 0.8282067023389308 | distance: 0.82821variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.7368459996463044 | distance: 0.73685variant: thresholded 500px | 159.0 |
| Topology Driven | 0.7576423798775136 | distance: 0.75764variant: thresholded 1000px | 60.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.8014191938238767 | distance: 0.80142variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.8773855619398242 | distance: 0.87739variant: thresholded 500pxalg. parameter: 0.6 | 173.0 |
| Mastering Sketching | 0.9275574219229616 | distance: 0.92756variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.912462381806332 | distance: 0.91246variant: thresholded 1000pxalg. parameter: noisy | 102.0 |
| Poly Vector | 0.8964780748615371 |  distance: 0.89648variant: vectorized (all layers) 500px | 83.0 |
| Real-Time Inking | 0.908343033249122 |  distance: 0.90834variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.8354328580207326 | distance: 0.83543variant: thresholded 500px | 159.0 |
| Topology Driven | 0.8568295310129053 | distance: 0.85683variant: thresholded 1000px | 60.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.8772971616577174 | distance: 0.8773variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.9146982921057556 |  distance: 0.9147variant: thresholded 500pxalg. parameter: 0.25 | 187.0 |
| Mastering Sketching | 0.959243359403757 | distance: 0.95924variant: thresholded 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.9606581915605616 | distance: 0.96066variant: thresholded 1000pxalg. parameter: noisy | 102.0 |
| Poly Vector | 0.94312035863829 | distance: 0.94312variant: vectorized (all layers) 500px | 83.0 |
| Real-Time Inking | 0.9485442243288704 |  distance: 0.94854variant: vectorized (all layers) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9049944024757538 | distance: 0.90499variant: thresholded 500px | 159.0 |
| Topology Driven | 0.9099142787111888 | distance: 0.90991variant: thresholded 1000px | 60.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.9203816585483948 |  distance: 0.92038variant: original | 22.0 |
| Fidelity Simplicity | 0.9319201491326532 |  distance: 0.93192variant: thresholded 500pxalg. parameter: 0.5 | 178.0 |
| Mastering Sketching | 0.973329247827298 | distance: 0.97333variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9689354346676856 | distance: 0.96894variant: vectorized (all layers) 1000px | 167.0 |
| Poly Vector | 0.9654593128919562 | distance: 0.96546variant: vectorized (all layers) 500px | 83.0 |
| Real-Time Inking | 0.9685748849812332 |  distance: 0.96857variant: thresholded 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9440462303905792 | distance: 0.94405variant: thresholded 500px | 159.0 |
| Topology Driven | 0.9462804655632474 | distance: 0.94628variant: thresholded 1000px | 60.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.19143667602539066 | distance: 0.19144variant: thresholded 500px | 7.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.08683317565917968 |  distance: 0.08683variant: thresholded 500pxalg. parameter: 0.3 | 196.0 |
| Poly Vector → Stroke Aggregator | 0.01824828720092773 | distance: 0.01825variant: thresholded 1000pxalg. parameter: noisy | 102.0 |
| Delaunay Triangulation | 0.060133186340332025 | distance: 0.06013variant: vectorized (all layers) 500px | 3.0 |
| Poly Vector | 0.014476226166691409 |  distance: 0.01448variant: originalalg. parameter: noisy | 1636.0 |
| Real-Time Inking | 0.015199754997443403 | distance: 0.0152variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.019105347549618464 | distance: 0.01911variant: original | 658.0 |
| Topology Driven | 0.019105347549618464 | distance: 0.01911variant: original | 105.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
 |
 |
 |
 |
|
|
 |
|
||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
|
||||||
| thresholded 1000px |  |
 |
 |
|
 |
 |
|
|
 |
 |
|
|
|||
| thresholded 500px | |
|
|
|
|
|
|
|
 |
 |
 |
 |
|||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
|
|||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
 |
 |
|
|