A Benchmark for Rough Sketch Cleanup
Ind_fashion_ML_11
Author: Myriam Lasserre Licence: CC-BY-SA-4.0Messiness: 0.19912
Ambiguity (Chamfer): 0.0847
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector | Real-Time Inking | Topology Driven | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Poly Vector → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00093 |  distance: 0.00131 |  distance: 0.00131 |  distance: 0.00144 |  distance: 0.00157 |  distance: 0.00201 |  distance: 0.00207 |  distance: 0.00218 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  | ||||
| Liliya Larsen |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.0021764135395773753 | distance: 0.00218variant: thresholded 500pxalg. parameter: 0.25 | 134.0 |
| Delaunay Triangulation | 0.0020060192593161857 | distance: 0.00201variant: original | 45.0 |
| Mastering Sketching | 0.0009330297217735119 | distance: 0.00093variant: thresholded 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.002069425291114202 | distance: 0.00207variant: vectorized (all layers) 1000px | 188.0 |
| Poly Vector | 0.0013061423984193313 | distance: 0.00131variant: thresholded 1000px | 362.0 |
| Real-Time Inking | 0.0013095156332976294 | distance: 0.00131variant: thresholded 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.0015686581917775733 | distance: 0.00157variant: thresholded 1000px | 608.0 |
| Topology Driven | 0.0014373173725602574 | distance: 0.00144variant: thresholded | 582.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.520384984545441 |  distance: 0.52038variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.7761576293794119 |  distance: 0.77616variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.7387950120132578 |  distance: 0.7388variant: thresholded | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6925232118926454 |  distance: 0.69252variant: vectorized (all layers) 1000px | 1758.0 |
| Topology Driven | 0.6666903570293023 | distance: 0.66669variant: thresholded | 582.0 |
| Fidelity Simplicity | 0.6324625176172877 |  distance: 0.63246variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 155.0 |
| Poly Vector → Stroke Aggregator | 0.6603764796509095 |  distance: 0.66038variant: vectorized (all layers) 500px | 18.0 |
| Poly Vector | 0.6742919107047778 |  distance: 0.67429variant: vectorized (all layers) 500pxalg. parameter: noisy | 67.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6883212213833988 | distance: 0.68832variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.8691720356162904 | distance: 0.86917variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.8883907498427552 |  distance: 0.88839variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8209278416815623 | distance: 0.82093variant: vectorized (all layers) 1000px | 1758.0 |
| Topology Driven | 0.82096816078287 | distance: 0.82097variant: thresholded | 582.0 |
| Fidelity Simplicity | 0.8036093801600375 |  distance: 0.80361variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 211.0 |
| Poly Vector → Stroke Aggregator | 0.7705710731719637 |  distance: 0.77057variant: vectorized (all layers) 500pxalg. parameter: noisy | 18.0 |
| Poly Vector | 0.7786946175919734 |  distance: 0.77869variant: vectorized (all layers) 500px | 71.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7538171253419219 | distance: 0.75382variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.9058913542463656 | distance: 0.90589variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.9163556694766278 | distance: 0.91636variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8682175821728836 |  distance: 0.86822variant: original | 782.0 |
| Topology Driven | 0.8685628759618238 |  distance: 0.86856variant: original | 127.0 |
| Fidelity Simplicity | 0.8442553839245921 | distance: 0.84426variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 211.0 |
| Poly Vector → Stroke Aggregator | 0.8339422191820155 | distance: 0.83394variant: vectorized (all layers) 500px | 18.0 |
| Poly Vector | 0.8350550549083885 | distance: 0.83506variant: vectorized (all layers) 500px | 71.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.794994306591784 | distance: 0.79499variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.9229007863577476 | distance: 0.9229variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.9294499350433534 | distance: 0.92945variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8955845201676623 | distance: 0.89558variant: original | 782.0 |
| Topology Driven | 0.8967401931291645 | distance: 0.89674variant: original | 127.0 |
| Fidelity Simplicity | 0.8561054566588281 | distance: 0.85611variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 211.0 |
| Poly Vector → Stroke Aggregator | 0.8684044883251959 | distance: 0.8684variant: vectorized (all layers) 500px | 18.0 |
| Poly Vector | 0.8713139911143282 | distance: 0.87131variant: vectorized (all layers) 500px | 71.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8302243067223588 | distance: 0.83022variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.9376244390954206 | distance: 0.93762variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8986943874444719 | distance: 0.89869variant: vectorized (all layers) 500px | 18.0 |
| Poly Vector | 0.9030552304721721 | distance: 0.90306variant: vectorized (all layers) 500px | 71.0 |
| Real-Time Inking | 0.9392683098393084 | distance: 0.93927variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9142189217263764 | distance: 0.91422variant: original | 782.0 |
| Topology Driven | 0.9161620346403258 | distance: 0.91616variant: original | 127.0 |
| Fidelity Simplicity | 0.8665507294475038 | distance: 0.86655variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 211.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.22454397583007807 |  distance: 0.22454variant: vectorized (all layers) 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.024331050872802733 |  distance: 0.02433variant: thresholded 500pxalg. parameter: 0.75 | 160.0 |
| Delaunay Triangulation | 0.0733928800077929 | distance: 0.07339variant: original | 45.0 |
| Poly Vector → Stroke Aggregator | 0.024 |  distance: 0.024variant: thresholded 500px | 27.0 |
| Poly Vector | 0.023409399032592773 |  distance: 0.02341variant: thresholded 500pxalg. parameter: noisy | 61.0 |
| Real-Time Inking | 0.01897366523742676 |  distance: 0.01897variant: thresholded 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.023409399032592773 |  distance: 0.02341variant: thresholded 500px | 112.0 |
| Topology Driven | 0.021540658950805664 |  distance: 0.02154variant: thresholded 500px | 7.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
 |
|
|
||||||
| thresholded | |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded 1000px | |
|
|
 |
 |
 |
 |
 |
 |
 |
|
 |
|||
| thresholded 500px | |
|
 |
 |
|
 |
|
 |
|
|
 |
 |
|
||
| vectorized (all layers) 1000px | |
 |
|
 |
 |
 |
|
 |
 |
 |
 |
 |
 |
|
|
| vectorized (all layers) 500px | |
|
 |
 |
 |
|
 |
 |
|
|
|
|
|