A Benchmark for Rough Sketch Cleanup
Art_logo_VFS_05
Author: VFS Digital Design Author Homepage: https://www.flickr.com/photos/vfsdigitaldesign/ Licence: CC-BY-2.0Messiness: 0.08877
Ambiguity (Chamfer): 0.07152
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Mastering Sketching | Topology Driven | Poly Vector | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00136 |  distance: 0.00142 |  distance: 0.00145 |  distance: 0.00158 |  distance: 0.0016 |  distance: 0.00176 |  distance: 0.00233 |  distance: 0.00501 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  |  | |||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.005007573788712234 | distance: 0.00501variant: vectorized (all layers) 1000px | 7.0 |
| Fidelity Simplicity | 0.0023258936473812496 | distance: 0.00233variant: thresholded 1000pxalg. parameter: 0.25 | 212.0 |
| Mastering Sketching | 0.0014216531507699444 | distance: 0.00142variant: thresholded | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0016010030243383741 | distance: 0.0016variant: thresholded 1000px | 232.0 |
| Poly Vector | 0.00158088021997919 | distance: 0.00158variant: thresholdedalg. parameter: noisy | 264.0 |
| Real-Time Inking | 0.0013562851576864622 | distance: 0.00136variant: vectorized (all layers) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.0017647244952762407 | distance: 0.00176variant: thresholded | 236.0 |
| Topology Driven | 0.001449076831450917 | distance: 0.00145variant: thresholded 1000px | 207.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6171069933760875 |  distance: 0.61711variant: thresholdedalg. parameter: 0.75 | 249.0 |
| Mastering Sketching | 0.7099082915689965 |  distance: 0.70991variant: original | 5.0 |
| Real-Time Inking | 0.7259110096801281 |  distance: 0.72591variant: original | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6692467519839613 | distance: 0.66925variant: thresholded | 236.0 |
| Topology Driven | 0.6267804865944012 |  distance: 0.62678variant: vectorized (all layers) 500px | 10.0 |
| Delaunay Triangulation | 0.2524064385712351 |  distance: 0.25241variant: vectorized (all layers) 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.20047485443133786 |  distance: 0.20047variant: vectorized (all layers) 500pxalg. parameter: noisy | 31.0 |
| Poly Vector | 0.2194114778084864 |  distance: 0.21941variant: vectorized (all layers) 500px | 498.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7565534891310076 |  distance: 0.75655variant: thresholded 500pxalg. parameter: 0.75 | 234.0 |
| Mastering Sketching | 0.8555157366363529 |  distance: 0.85552variant: vectorized (all layers) 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8404100090907445 | distance: 0.84041variant: thresholded | 236.0 |
| Topology Driven | 0.7766639840019121 | distance: 0.77666variant: vectorized (all layers) 500px | 10.0 |
| Delaunay Triangulation | 0.4470988459722983 | distance: 0.4471variant: vectorized (all layers) 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.26520640856643457 | distance: 0.26521variant: vectorized (all layers) 500pxalg. parameter: noisy | 31.0 |
| Poly Vector | 0.2732333668240097 |  distance: 0.27323variant: vectorized (all layers) 500pxalg. parameter: noisy | 443.0 |
| Real-Time Inking | 0.8425285531846344 |  distance: 0.84253variant: vectorized (all layers) 500px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8155277210569418 |  distance: 0.81553variant: thresholdedalg. parameter: 0.6 | 204.0 |
| Mastering Sketching | 0.9029435962445984 | distance: 0.90294variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8771208702327978 | distance: 0.87712variant: original | 2.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.5883916957710704 | distance: 0.58839variant: vectorized (all layers) 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.3151809730054201 | distance: 0.31518variant: vectorized (all layers) 500pxalg. parameter: noisy | 31.0 |
| Poly Vector | 0.3244886245288692 | distance: 0.32449variant: vectorized (all layers) 500pxalg. parameter: noisy | 443.0 |
| Topology Driven → Stroke Aggregator | 0.887632217397108 | distance: 0.88763variant: thresholded | 236.0 |
| Topology Driven | 0.8479073368403147 | distance: 0.84791variant: vectorized (all layers) 500px | 10.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8522656623804605 | distance: 0.85227variant: thresholdedalg. parameter: 0.75 | 249.0 |
| Real-Time Inking | 0.8997777282787071 | distance: 0.89978variant: original | 2.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.6583790682620991 | distance: 0.65838variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.929159374152456 | distance: 0.92916variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.3602544987806932 | distance: 0.36025variant: vectorized (all layers) 500pxalg. parameter: noisy | 31.0 |
| Poly Vector | 0.3694630320553329 | distance: 0.36946variant: vectorized (all layers) 500pxalg. parameter: noisy | 443.0 |
| Topology Driven → Stroke Aggregator | 0.9337587870801601 | distance: 0.93376variant: thresholded | 236.0 |
| Topology Driven | 0.8959086248618308 | distance: 0.89591variant: vectorized (all layers) 500px | 10.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8808688840851281 | distance: 0.88087variant: thresholdedalg. parameter: 0.75 | 249.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.7179721246002335 | distance: 0.71797variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.9517915283616972 | distance: 0.95179variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.41363304572423215 | distance: 0.41363variant: vectorized (all layers) 500pxalg. parameter: noisy | 31.0 |
| Poly Vector | 0.4230064020486556 | distance: 0.42301variant: vectorized (all layers) 500px | 498.0 |
| Real-Time Inking | 0.9173393674528928 | distance: 0.91734variant: original | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9656473507447608 | distance: 0.96565variant: thresholded | 236.0 |
| Topology Driven | 0.9288180513094044 | distance: 0.92882variant: vectorized (all layers) 500px | 10.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.08856636047363281 |  distance: 0.08857variant: thresholded 500px | 3.0 |
| Poly Vector → Stroke Aggregator | 0.024403054096977118 |  distance: 0.0244variant: thresholdedalg. parameter: noisy | 54.0 |
| Poly Vector | 0.02404162979125976 |  distance: 0.02404variant: thresholded 1000pxalg. parameter: noisy | 1316.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.023014333244104276 | distance: 0.02301variant: thresholded | 236.0 |
| Mastering Sketching | 0.17601136779785154 |  distance: 0.17601variant: thresholded 500px | 5.0 |
| Real-Time Inking | 0.026000000000000002 | distance: 0.026variant: vectorized (all layers) 1000px | 2.0 |
| Topology Driven | 0.022360679626464843 | distance: 0.02236variant: vectorized (all layers) 500px | 10.0 |
| Fidelity Simplicity | 0.028861740112304687 |  distance: 0.02886variant: thresholded 1000pxalg. parameter: 0.3 | 202.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| thresholded | |
 |
|
 |
 |
 |
|
|
 |
|
 |
 |
|
||
| thresholded 1000px |  |
|
|
 |
 |
 |
|
|
 |
 |
 |
|
|||
| thresholded 500px |  |
|
 |
 |
 |
|
 |
 |
 |
 |
|
||||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
|
|||||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
|
|
|
|
|