A Benchmark for Rough Sketch Cleanup
Ind_fashion_HF_01
Author: Hugo Fonseca Author Homepage: www.thestyleconfessions.com/ Licence: CC-BY-NC-SA-3.0Messiness: 0.05338
Ambiguity (Chamfer): 0.05292
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Stroke Aggregator | Real-Time Inking | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00043 |  distance: 0.00047 |  distance: 0.0005 |  distance: 0.0005 |  distance: 0.00063 |  distance: 0.00066 |  distance: 0.00067 |  distance: 0.00151 |  distance: 0.00199 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0019882420867605734 | distance: 0.00199variant: original | 33.0 |
| Fidelity Simplicity | 0.0015119142130397387 | distance: 0.00151variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 180.0 |
| Mastering Sketching | 0.0004305784512085966 | distance: 0.00043variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0006715579561438263 | distance: 0.00067variant: vectorized (shape strokes) 1000px | 171.0 |
| Poly Vector | 0.0004967279125109094 | distance: 0.0005variant: vectorized (shape strokes) 1000px | 186.0 |
| Real-Time Inking | 0.0006280639850528343 | distance: 0.00063variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.0005045956975597918 | distance: 0.0005variant: vectorized (shape strokes) | 488.0 |
| Topology Driven → Stroke Aggregator | 0.0006564768518352375 | distance: 0.00066variant: vectorized (shape strokes) 1000px | 634.0 |
| Topology Driven | 0.00047319164826429834 | distance: 0.00047variant: vectorized (shape strokes) 1000px | 14.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4035067036960512 |  distance: 0.40351variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.5417268448133886 |  distance: 0.54173variant: thresholded 500pxalg. parameter: 0.75 | 160.0 |
| Mastering Sketching | 0.8925786125851645 |  distance: 0.89258variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8622646315640211 |  distance: 0.86226variant: thresholded 1000px | 2.0 |
| Stroke Aggregator | 0.9047197215428138 | distance: 0.90472variant: vectorized (shape strokes) | 488.0 |
| Topology Driven → Stroke Aggregator | 0.7205532008529266 |  distance: 0.72055variant: vectorized (all layers) 500px | 361.0 |
| Topology Driven | 0.8597695955865683 |  distance: 0.85977variant: thresholded 1000px | 32.0 |
| Poly Vector → Stroke Aggregator | 0.5136784218290356 |  distance: 0.51368variant: vectorized (all layers) 500pxalg. parameter: noisy | 23.0 |
| Poly Vector | 0.5468221830606382 |  distance: 0.54682variant: vectorized (all layers) 500pxalg. parameter: noisy | 89.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5766701313035125 | distance: 0.57667variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.6856334884382718 | distance: 0.68563variant: thresholded 500pxalg. parameter: 0.75 | 160.0 |
| Real-Time Inking | 0.9249346187828392 |  distance: 0.92493variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.951198454870554 | distance: 0.9512variant: vectorized (shape strokes) | 488.0 |
| Mastering Sketching | 0.937357973980674 |  distance: 0.93736variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.602210885335813 | distance: 0.60221variant: vectorized (all layers) 500pxalg. parameter: noisy | 23.0 |
| Poly Vector | 0.6353153762171398 | distance: 0.63532variant: vectorized (all layers) 500pxalg. parameter: noisy | 89.0 |
| Topology Driven → Stroke Aggregator | 0.8560163324046139 | distance: 0.85602variant: vectorized (all layers) 500px | 361.0 |
| Topology Driven | 0.917787788014876 | distance: 0.91779variant: thresholded 1000px | 32.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6724318796722306 | distance: 0.67243variant: vectorized (all layers) 500px | 1.0 |
| Real-Time Inking | 0.9412007141286672 | distance: 0.9412variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.7830015423138609 | distance: 0.783variant: thresholded 500pxalg. parameter: 0.75 | 160.0 |
| Stroke Aggregator | 0.9645137224886202 | distance: 0.96451variant: vectorized (shape strokes) | 488.0 |
| Mastering Sketching | 0.9549159293826092 | distance: 0.95492variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.678147682271219 | distance: 0.67815variant: vectorized (all layers) 500pxalg. parameter: noisy | 23.0 |
| Poly Vector | 0.7079445896451156 |  distance: 0.70794variant: vectorized (all layers) 500px | 85.0 |
| Topology Driven → Stroke Aggregator | 0.920660810915062 | distance: 0.92066variant: vectorized (all layers) 500px | 361.0 |
| Topology Driven | 0.9412357583430336 | distance: 0.94124variant: thresholded 1000px | 32.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7371986960878218 | distance: 0.7372variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.832771153478789 | distance: 0.83277variant: thresholded 500pxalg. parameter: 0.75 | 160.0 |
| Real-Time Inking | 0.9513680748317336 | distance: 0.95137variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9698683778849884 | distance: 0.96987variant: vectorized (shape strokes) | 488.0 |
| Mastering Sketching | 0.966351574376714 | distance: 0.96635variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.729294547110139 |  distance: 0.72929variant: vectorized (all layers) 500px | 23.0 |
| Poly Vector | 0.7545903521135816 | distance: 0.75459variant: vectorized (all layers) 500pxalg. parameter: noisy | 89.0 |
| Topology Driven → Stroke Aggregator | 0.9513104857057356 | distance: 0.95131variant: vectorized (all layers) 500px | 361.0 |
| Topology Driven | 0.957199923362258 | distance: 0.9572variant: thresholded 1000px | 32.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7985098106149356 | distance: 0.79851variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.973611238637407 | distance: 0.97361variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.9625181208339952 | distance: 0.96252variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9628260258811084 |  distance: 0.96283variant: thresholded 1000px | 905.0 |
| Topology Driven | 0.9670077600348106 | distance: 0.96701variant: thresholded 1000px | 32.0 |
| Fidelity Simplicity | 0.8744671377099466 | distance: 0.87447variant: thresholded 500pxalg. parameter: 0.75 | 160.0 |
| Poly Vector | 0.7970350134005189 |  distance: 0.79704variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 59.0 |
| Stroke Aggregator | 0.973753242294384 | distance: 0.97375variant: vectorized (shape strokes) | 488.0 |
| Poly Vector → Stroke Aggregator | 0.7758949883240381 | distance: 0.77589variant: vectorized (all layers) 500px | 23.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.0304138126373291 |  distance: 0.03041variant: vectorized (all layers) 1000pxalg. parameter: 0.5 | 193.0 |
| Stroke Aggregator | 0.012784870138468523 | distance: 0.01278variant: vectorized (shape strokes) | 488.0 |
| Real-Time Inking | 0.013645523108235285 |  distance: 0.01365variant: thresholded | 3.0 |
| Delaunay Triangulation | 0.035227828979492185 |  distance: 0.03523variant: vectorized (shape strokes) 1000px | 3.0 |
| Mastering Sketching | 0.2582789306640625 |  distance: 0.25828variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.011661903381347656 | distance: 0.01166variant: vectorized (shape strokes) 1000px | 171.0 |
| Poly Vector | 0.010198039054870605 |  distance: 0.0102variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 179.0 |
| Topology Driven → Stroke Aggregator | 0.01 | distance: 0.01variant: vectorized (shape strokes) 1000px | 634.0 |
| Topology Driven | 0.010198039054870605 | distance: 0.0102variant: vectorized (shape strokes) 1000px | 14.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
 |
 |
|
|||||||
| thresholded | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| thresholded 1000px | |
|
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
|
| thresholded 500px |  |
|
 |
 |
 |
|
 |
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 1000px |  |
|
 |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
 |
 |
 |
|
|
|
|
|
|
| vectorized (shape strokes) 1000px | |
|
|
 |
|
 |
 |
 |
|
|
|
|
 |
|
|
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
||
| vectorized (shape strokes) | |