A Benchmark for Rough Sketch Cleanup
Ind_product_AS_14
Author: Akshay Sharma Licence: CC-BY-SAMessiness: 1.0
Ambiguity (Chamfer): 0.26461
Shading: No
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Stroke Aggregator | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Real-Time Inking | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Mastering Sketching | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00275 |  distance: 0.00287 |  distance: 0.00297 |  distance: 0.00324 |  distance: 0.00326 |  distance: 0.00345 |  distance: 0.00362 |  distance: 0.0037 |  distance: 0.00482 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Liliya Larsen |  | |  | ||||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.003695884275417664 | distance: 0.0037variant: vectorized (shape strokes) 1000px | 3.0 |
| Fidelity Simplicity | 0.00326449582703868 | distance: 0.00326variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 290.0 |
| Mastering Sketching | 0.0048175783745797686 | distance: 0.00482variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.003623200257632883 | distance: 0.00362variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 85.0 |
| Poly Vector | 0.002865301364888502 | distance: 0.00287variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 77.0 |
| Real-Time Inking | 0.003451028036532384 | distance: 0.00345variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.0029681305239446345 | distance: 0.00297variant: vectorized (shape strokes) | 1212.0 |
| Topology Driven → Stroke Aggregator | 0.0032440916822691016 | distance: 0.00324variant: vectorized (shape strokes) 1000px | 603.0 |
| Topology Driven | 0.002754822127073063 | distance: 0.00275variant: vectorized (shape strokes) 1000px | 10.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.07395426596838324 |  distance: 0.07395variant: originalalg. parameter: 0.3 | 1690.0 |
| Stroke Aggregator | 0.5325908688601818 | distance: 0.53259variant: vectorized (shape strokes) | 1212.0 |
| Mastering Sketching | 0.2567655126314077 |  distance: 0.25677variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.32687861354962844 |  distance: 0.32688variant: thresholded 500pxalg. parameter: noisy | 79.0 |
| Delaunay Triangulation | 0.13706618444996813 |  distance: 0.13707variant: thresholded | 444.0 |
| Poly Vector | 0.25711481738895514 |  distance: 0.25711variant: vectorized (all layers) 1000px | 353.0 |
| Real-Time Inking | 0.25073457661044984 |  distance: 0.25073variant: thresholded 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.2440225164424577 |  distance: 0.24402variant: vectorized (all layers) 500px | 627.0 |
| Topology Driven | 0.2481930530088141 |  distance: 0.24819variant: thresholded | 1190.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.1226422353073113 | distance: 0.12264variant: originalalg. parameter: 0.3 | 1690.0 |
| Mastering Sketching | 0.32630331753554503 |  distance: 0.3263variant: thresholded 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.3928666555992105 |  distance: 0.39287variant: thresholded 500px | 79.0 |
| Poly Vector | 0.3295463095327665 |  distance: 0.32955variant: thresholded 1000px | 737.0 |
| Real-Time Inking | 0.3124658803084013 | distance: 0.31247variant: thresholded 500px | 2.0 |
| Stroke Aggregator | 0.6852496015216458 | distance: 0.68525variant: vectorized (shape strokes) | 1212.0 |
| Topology Driven → Stroke Aggregator | 0.3264190777559701 |  distance: 0.32642variant: thresholded 500px | 803.0 |
| Topology Driven | 0.3369184427802225 |  distance: 0.33692variant: vectorized (all layers) 500px | 10.0 |
| Delaunay Triangulation | 0.22069374007836529 | distance: 0.22069variant: thresholded | 444.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.27992276383573844 |  distance: 0.27992variant: thresholded 1000px | 14.0 |
| Mastering Sketching | 0.3617597031080872 | distance: 0.36176variant: thresholded 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.431443049040818 | distance: 0.43144variant: thresholded 500px | 79.0 |
| Poly Vector | 0.3791005548525261 | distance: 0.3791variant: thresholded 1000px | 737.0 |
| Real-Time Inking | 0.3480889645907184 | distance: 0.34809variant: thresholded 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.36356321431246624 | distance: 0.36356variant: thresholded 500px | 803.0 |
| Topology Driven | 0.3855558254392357 |  distance: 0.38556variant: thresholded 500px | 12.0 |
| Fidelity Simplicity | 0.16131043662652206 | distance: 0.16131variant: originalalg. parameter: 0.3 | 1690.0 |
| Stroke Aggregator | 0.7381738168268853 | distance: 0.73817variant: vectorized (shape strokes) | 1212.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3181281939706336 | distance: 0.31813variant: thresholded 1000px | 14.0 |
| Fidelity Simplicity | 0.19961192927087895 |  distance: 0.19961variant: originalalg. parameter: 0.5 | 1681.0 |
| Mastering Sketching | 0.39044399711344907 | distance: 0.39044variant: thresholded 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.4544964899126296 | distance: 0.4545variant: thresholded 500pxalg. parameter: noisy | 79.0 |
| Real-Time Inking | 0.3805772192149029 | distance: 0.38058variant: thresholded 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.3933855543019831 | distance: 0.39339variant: thresholded 500px | 803.0 |
| Topology Driven | 0.4208442226973945 | distance: 0.42084variant: thresholded 500px | 12.0 |
| Poly Vector | 0.418585877771974 | distance: 0.41859variant: thresholded 1000px | 737.0 |
| Stroke Aggregator | 0.8021697948081157 | distance: 0.80217variant: vectorized (shape strokes) | 1212.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.35180494908548154 | distance: 0.3518variant: thresholded 1000px | 14.0 |
| Fidelity Simplicity | 0.2318974325472539 | distance: 0.2319variant: originalalg. parameter: 0.5 | 1681.0 |
| Mastering Sketching | 0.4229681452813337 | distance: 0.42297variant: thresholded 500px | 7.0 |
| Real-Time Inking | 0.41215419908333467 | distance: 0.41215variant: thresholded 500px | 2.0 |
| Stroke Aggregator | 0.8220138815212717 | distance: 0.82201variant: vectorized (shape strokes) | 1212.0 |
| Poly Vector → Stroke Aggregator | 0.4864817723127765 | distance: 0.48648variant: thresholded 500px | 79.0 |
| Poly Vector | 0.4504827265325114 |  distance: 0.45048variant: thresholded 1000pxalg. parameter: noisy | 764.0 |
| Topology Driven → Stroke Aggregator | 0.4318644564985419 | distance: 0.43186variant: thresholded 500px | 803.0 |
| Topology Driven | 0.4593989028818666 | distance: 0.4594variant: thresholded 500px | 12.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.035128337860107425 | distance: 0.03513variant: vectorized (shape strokes) 1000px | 3.0 |
| Fidelity Simplicity | 0.030528675079345705 |  distance: 0.03053variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 239.0 |
| Poly Vector → Stroke Aggregator | 0.032202484130859375 | distance: 0.0322variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 85.0 |
| Poly Vector | 0.03269556427001953 | distance: 0.0327variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 77.0 |
| Real-Time Inking | 0.03231098937988281 | distance: 0.03231variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.0329256717975323 | distance: 0.03293variant: vectorized (shape strokes) | 1212.0 |
| Topology Driven → Stroke Aggregator | 0.03231098937988281 | distance: 0.03231variant: vectorized (shape strokes) 1000px | 603.0 |
| Topology Driven | 0.03275667953491211 | distance: 0.03276variant: vectorized (shape strokes) 1000px | 10.0 |
| Mastering Sketching | 0.20223748779296874 | distance: 0.20224variant: vectorized (shape strokes) 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
|
|
 |
 |
||||||||||
| thresholded |  |
|
|
||||||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
|
|
|
|||||
| thresholded 500px | |
|
|
 |
 |
 |
 |
 |
|
 |
 |
 |
|
|
|
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|
 |
|||||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
|||
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
|
 |
|
|
|||
| vectorized (shape strokes) 500px |  |
 |
|
 |
 |
 |
|
 |
 |
 |
 |
 |
 |
||
| vectorized (shape strokes) | |