A Benchmark for Rough Sketch Cleanup
Ind_fashion_LB_01
Author: Lamara Bergamasco Author Homepage: https://www.flickr.com/photos/fattoconsumado/ Licence: CC-BY-2.0Messiness: 0.0765
Ambiguity (Chamfer): 0.02347
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Real-Time Inking | Topology Driven → Stroke Aggregator | Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0005 |  distance: 0.00062 |  distance: 0.00089 |  distance: 0.00098 |  distance: 0.00101 |  distance: 0.00106 |  distance: 0.00183 |  distance: 0.00305 |  distance: 0.00437 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Diego Barrionuevo |  | |  |  | |||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.003050304205266434 | distance: 0.00305variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 160.0 |
| Delaunay Triangulation | 0.0018306682009516801 | distance: 0.00183variant: thresholded | 19.0 |
| Mastering Sketching | 0.0005000622969214453 | distance: 0.0005variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0043711977449546035 | distance: 0.00437variant: vectorized (all layers) 500px | 22.0 |
| Poly Vector | 0.0008927909899695693 | distance: 0.00089variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 206.0 |
| Real-Time Inking | 0.000979045711984562 | distance: 0.00098variant: thresholded 1000px | 2.0 |
| Topology Driven | 0.0006223515413742382 | distance: 0.00062variant: thresholded | 110.0 |
| Stroke Aggregator | 0.0010598949380759618 | distance: 0.00106variant: vectorized (shape strokes) | 373.0 |
| Topology Driven → Stroke Aggregator | 0.0010068184726645538 | distance: 0.00101variant: vectorized (shape strokes) 1000px | 485.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3647333204606711 |  distance: 0.36473variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.9158342928877004 |  distance: 0.91583variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8407990601850581 |  distance: 0.8408variant: thresholded | 3.0 |
| Stroke Aggregator | 0.8922216838233249 |  distance: 0.89222variant: vectorized (all layers) | 392.0 |
| Fidelity Simplicity | 0.4996755506774465 |  distance: 0.49968variant: originalalg. parameter: 0.75 | 302.0 |
| Poly Vector → Stroke Aggregator | 0.5180916527114087 |  distance: 0.51809variant: originalalg. parameter: noisy | 83.0 |
| Poly Vector | 0.5213079175703013 |  distance: 0.52131variant: originalalg. parameter: noisy | 1065.0 |
| Topology Driven → Stroke Aggregator | 0.6713971869438796 |  distance: 0.6714variant: original | 532.0 |
| Topology Driven | 0.7215359893514351 |  distance: 0.72154variant: original | 26.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9594468414797136 |  distance: 0.95945variant: vectorized (all layers) 1000px | 6.0 |
| Stroke Aggregator | 0.9450977270115072 | distance: 0.9451variant: vectorized (all layers) | 392.0 |
| Real-Time Inking | 0.8998737103709545 |  distance: 0.89987variant: original | 3.0 |
| Delaunay Triangulation | 0.6177650279306743 | distance: 0.61777variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.5348001052866842 |  distance: 0.5348variant: originalalg. parameter: 0.25 | 268.0 |
| Poly Vector → Stroke Aggregator | 0.5873631097314439 | distance: 0.58736variant: originalalg. parameter: noisy | 83.0 |
| Poly Vector | 0.5905446869381235 |  distance: 0.59054variant: original | 976.0 |
| Topology Driven → Stroke Aggregator | 0.7489269069948313 | distance: 0.74893variant: original | 532.0 |
| Topology Driven | 0.8017266891034734 | distance: 0.80173variant: original | 26.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7442240850541813 | distance: 0.74422variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.9740260095390548 | distance: 0.97403variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.9179131554187928 | distance: 0.91791variant: original | 3.0 |
| Stroke Aggregator | 0.9712445601318758 | distance: 0.97124variant: vectorized (all layers) | 392.0 |
| Topology Driven | 0.8406943441233181 | distance: 0.84069variant: original | 26.0 |
| Fidelity Simplicity | 0.5503368877501974 | distance: 0.55034variant: originalalg. parameter: 0.75 | 302.0 |
| Poly Vector → Stroke Aggregator | 0.6305842300025359 | distance: 0.63058variant: originalalg. parameter: noisy | 83.0 |
| Poly Vector | 0.6337249839497525 | distance: 0.63372variant: original | 976.0 |
| Topology Driven → Stroke Aggregator | 0.7938848046171643 | distance: 0.79388variant: original | 532.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9783284029012512 | distance: 0.97833variant: vectorized (all layers) 500px | 5.0 |
| Stroke Aggregator | 0.9829781391862192 | distance: 0.98298variant: vectorized (all layers) | 392.0 |
| Delaunay Triangulation | 0.8023743467549632 |  distance: 0.80237variant: thresholded 500px | 1.0 |
| Real-Time Inking | 0.93322938026227 | distance: 0.93323variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.8211084794622056 | distance: 0.82111variant: original | 532.0 |
| Topology Driven | 0.8643808600714117 | distance: 0.86438variant: original | 26.0 |
| Fidelity Simplicity | 0.5633100695553566 | distance: 0.56331variant: originalalg. parameter: 0.75 | 302.0 |
| Poly Vector → Stroke Aggregator | 0.6707391852409332 | distance: 0.67074variant: originalalg. parameter: noisy | 83.0 |
| Poly Vector | 0.6731988315156284 | distance: 0.6732variant: originalalg. parameter: noisy | 1065.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9817372520782875 | distance: 0.98174variant: vectorized (all layers) 500px | 5.0 |
| Stroke Aggregator | 0.9870379056488808 | distance: 0.98704variant: vectorized (all layers) | 392.0 |
| Delaunay Triangulation | 0.8445447705041386 | distance: 0.84454variant: thresholded 500px | 1.0 |
| Real-Time Inking | 0.944655235708968 | distance: 0.94466variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.844517244420313 | distance: 0.84452variant: original | 532.0 |
| Topology Driven | 0.8861388336117249 | distance: 0.88614variant: original | 26.0 |
| Fidelity Simplicity | 0.572800376461597 |  distance: 0.5728variant: originalalg. parameter: 0.5 | 256.0 |
| Poly Vector → Stroke Aggregator | 0.7061851935592883 | distance: 0.70619variant: originalalg. parameter: noisy | 83.0 |
| Poly Vector | 0.7068313110406702 | distance: 0.70683variant: originalalg. parameter: noisy | 1065.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.04741307830810547 |  distance: 0.04741variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.08588364410400391 |  distance: 0.08588variant: thresholded 500pxalg. parameter: 0.6 | 184.0 |
| Mastering Sketching | 0.3018078918457031 |  distance: 0.30181variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.06907966613769531 |  distance: 0.06908variant: vectorized (shape strokes) 500px | 22.0 |
| Stroke Aggregator | 0.18231912364130434 | distance: 0.18232variant: vectorized (shape strokes) | 373.0 |
| Topology Driven → Stroke Aggregator | 0.07912016296386719 |  distance: 0.07912variant: thresholded 500px | 1685.0 |
| Poly Vector | 0.026832815170288085 |  distance: 0.02683variant: thresholded 1000px | 332.0 |
| Real-Time Inking | 0.026000000000000002 |  distance: 0.026variant: thresholded 500px | 2.0 |
| Topology Driven | 0.022825424194335937 |  distance: 0.02283variant: thresholded 1000px | 16.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
|
|
|
 |
|
|
|
 |
|
|||
| thresholded | |
 |
 |
|
|
||||||||||
| thresholded 1000px | |
|
 |
 |
 |
 |
 |
|
 |
|
 |
||||
| thresholded 500px | |
|
|
 |
 |
 |
|
 |
 |
 |
|
||||
| vectorized (all layers) 1000px |  |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 500px |  |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
 |
|
|
| vectorized (shape strokes) 1000px | |
 |
 |
 |
|
 |
 |
 |
 |
|
 |
 |
|||
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
||
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |