A Benchmark for Rough Sketch Cleanup
Ind_fashion_ML_10
Author: Myriam Lasserre Licence: CC-BY-SA-4.0Messiness: 0.04202
Ambiguity (Chamfer): 0.06991
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector | Poly Vector → Stroke Aggregator | Real-Time Inking | Topology Driven | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00041 |  distance: 0.00058 |  distance: 0.0006 |  distance: 0.00065 |  distance: 0.00068 |  distance: 0.00075 |  distance: 0.00086 |  distance: 0.0009 |  distance: 0.00849 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | | |||||
| Liliya Larsen |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.00849438386275047 | distance: 0.00849variant: originalalg. parameter: 0.6 | 400.0 |
| Delaunay Triangulation | 0.0008606807029562862 | distance: 0.00086variant: thresholded | 36.0 |
| Mastering Sketching | 0.0004138001024282625 | distance: 0.00041variant: thresholded 1000px | 6.0 |
| Topology Driven → Stroke Aggregator | 0.0007461155330765674 | distance: 0.00075variant: thresholded | 1763.0 |
| Topology Driven | 0.0006839606593242344 | distance: 0.00068variant: thresholded 1000px | 17.0 |
| Poly Vector → Stroke Aggregator | 0.0005994673232209754 | distance: 0.0006variant: thresholded 1000px | 47.0 |
| Poly Vector | 0.0005834241365870197 | distance: 0.00058variant: thresholded 1000px | 195.0 |
| Real-Time Inking | 0.0006501965611377018 | distance: 0.00065variant: thresholded 500px | 2.0 |
| Stroke Aggregator | 0.0009012048592841473 | distance: 0.0009variant: vectorized (all layers) | 56.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.30349435192231183 |  distance: 0.30349variant: vectorized (all layers) 500px | 0.0 |
| Fidelity Simplicity | 0.5867362886286149 |  distance: 0.58674variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 150.0 |
| Mastering Sketching | 0.8895103955079462 |  distance: 0.88951variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.904984868291302 |  distance: 0.90498variant: vectorized (all layers) 1000pxalg. parameter: noisy | 69.0 |
| Poly Vector | 0.5758061322586251 |  distance: 0.57581variant: vectorized (all layers) 500pxalg. parameter: noisy | 34.0 |
| Real-Time Inking | 0.8494984875295439 |  distance: 0.8495variant: thresholded | 3.0 |
| Stroke Aggregator | 0.7969103984603514 | distance: 0.79691variant: vectorized (all layers) | 56.0 |
| Topology Driven → Stroke Aggregator | 0.8558711945199589 | distance: 0.85587variant: thresholded | 1763.0 |
| Topology Driven | 0.6332839709682261 |  distance: 0.63328variant: original | 40.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4889763264214576 | distance: 0.48898variant: vectorized (all layers) 500px | 0.0 |
| Mastering Sketching | 0.94075617743376 | distance: 0.94076variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9474169661371984 | distance: 0.94742variant: vectorized (all layers) 1000pxalg. parameter: noisy | 69.0 |
| Poly Vector | 0.6295312245707698 | distance: 0.62953variant: vectorized (all layers) 500pxalg. parameter: noisy | 34.0 |
| Real-Time Inking | 0.9186887693925548 |  distance: 0.91869variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9174181676725892 | distance: 0.91742variant: vectorized (all layers) | 56.0 |
| Topology Driven → Stroke Aggregator | 0.9431999812628524 | distance: 0.9432variant: thresholded | 1763.0 |
| Fidelity Simplicity | 0.7054700187495593 |  distance: 0.70547variant: thresholded 500pxalg. parameter: 0.75 | 181.0 |
| Topology Driven | 0.7094144681359206 | distance: 0.70941variant: original | 40.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9480939048029292 | distance: 0.94809variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9652823963873044 | distance: 0.96528variant: vectorized (all layers) 1000pxalg. parameter: noisy | 69.0 |
| Poly Vector | 0.6679070378751323 | distance: 0.66791variant: vectorized (all layers) 500pxalg. parameter: noisy | 34.0 |
| Real-Time Inking | 0.9378145510876171 | distance: 0.93781variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9536058262094788 | distance: 0.95361variant: vectorized (all layers) | 56.0 |
| Topology Driven → Stroke Aggregator | 0.9610254117296372 |  distance: 0.96103variant: vectorized (all layers) 1000px | 155.0 |
| Delaunay Triangulation | 0.568405949516294 | distance: 0.56841variant: vectorized (all layers) 500px | 0.0 |
| Fidelity Simplicity | 0.7428883178395738 |  distance: 0.74289variant: thresholded 500pxalg. parameter: 0.25 | 166.0 |
| Topology Driven | 0.7457911526745095 | distance: 0.74579variant: original | 40.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9502041986100164 | distance: 0.9502variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9707337180544108 | distance: 0.97073variant: vectorized (all layers) 1000pxalg. parameter: noisy | 69.0 |
| Poly Vector | 0.6953623486766414 | distance: 0.69536variant: vectorized (all layers) 500pxalg. parameter: noisy | 34.0 |
| Real-Time Inking | 0.9466983400943696 | distance: 0.9467variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.969541045680666 | distance: 0.96954variant: vectorized (all layers) | 56.0 |
| Topology Driven → Stroke Aggregator | 0.9659571312022548 | distance: 0.96596variant: vectorized (all layers) 1000px | 155.0 |
| Delaunay Triangulation | 0.6066415048708438 | distance: 0.60664variant: vectorized (all layers) 500px | 0.0 |
| Fidelity Simplicity | 0.7659019681480138 | distance: 0.7659variant: thresholded 500pxalg. parameter: 0.25 | 166.0 |
| Topology Driven | 0.7732824444593249 | distance: 0.77328variant: original | 40.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9524558518624436 | distance: 0.95246variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9723751221770668 | distance: 0.97238variant: vectorized (all layers) 1000pxalg. parameter: noisy | 69.0 |
| Poly Vector | 0.7257302067624714 |  distance: 0.72573variant: vectorized (all layers) 500px | 35.0 |
| Real-Time Inking | 0.9532054310730742 | distance: 0.95321variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9719201197110094 | distance: 0.97192variant: vectorized (all layers) | 56.0 |
| Topology Driven → Stroke Aggregator | 0.96787089132366 | distance: 0.96787variant: vectorized (all layers) 1000px | 155.0 |
| Delaunay Triangulation | 0.6483700484701739 | distance: 0.64837variant: vectorized (all layers) 500px | 0.0 |
| Fidelity Simplicity | 0.7849380565596257 |  distance: 0.78494variant: thresholded 500pxalg. parameter: 0.6 | 192.0 |
| Topology Driven | 0.7959690143873749 | distance: 0.79597variant: original | 40.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.04308131790161133 |  distance: 0.04308variant: thresholded 500px | 1.0 |
| Fidelity Simplicity | 0.119364990234375 | distance: 0.11936variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 150.0 |
| Poly Vector | 0.019 |  distance: 0.019variant: vectorized (all layers) 1000pxalg. parameter: noisy | 100.0 |
| Topology Driven → Stroke Aggregator | 0.014919354838709676 | distance: 0.01492variant: thresholded | 1763.0 |
| Topology Driven | 0.014919354838709676 |  distance: 0.01492variant: thresholded | 203.0 |
| Mastering Sketching | 0.20366639709472656 |  distance: 0.20367variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.02 | distance: 0.02variant: vectorized (all layers) 1000pxalg. parameter: noisy | 69.0 |
| Real-Time Inking | 0.021023796081542968 |  distance: 0.02102variant: thresholded 1000px | 2.0 |
| Stroke Aggregator | 0.01995051137862667 | distance: 0.01995variant: vectorized (all layers) | 56.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
|
|
 |
 |
 |
|||||
| thresholded | |
|
 |
 |
 |
 |
 |
|
|
||||||
| thresholded 1000px |  |
|
|
 |
 |
 |
 |
 |
|
 |
|
 |
 |
|
|
| thresholded 500px |  |
|
|
 |
|
 |
|
|
 |
 |
 |
|
|||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
|
||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
|
 |
|
|
|
||||
| vectorized (all layers) | |