A Benchmark for Rough Sketch Cleanup
Art_logo_CA_01
Author: Cesarrcs Author Homepage: https://flickr.com/photos/cesarrcs/ Licence: CC-BY-NC 2.0Messiness: 0.41612
Ambiguity (Chamfer): 0.14967
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Mastering Sketching | Topology Driven | Topology Driven → Stroke Aggregator | Stroke Aggregator | Poly Vector | Delaunay Triangulation | Fidelity Simplicity | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00213 |  distance: 0.00214 |  distance: 0.00217 |  distance: 0.00228 |  distance: 0.00243 |  distance: 0.00585 |  distance: 0.00839 |  distance: 0.01387 |  distance: 0.01485 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Diego Barrionuevo |  | |  |  | |||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.005853562398225517 | distance: 0.00585variant: vectorized (shape strokes) 1000px | 110.0 |
| Real-Time Inking | 0.0021304631318087228 | distance: 0.00213variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.002425510386905393 | distance: 0.00243variant: vectorized (shape strokes) | 10.0 |
| Topology Driven → Stroke Aggregator | 0.002282680673693481 | distance: 0.00228variant: vectorized (shape strokes) 1000px | 30.0 |
| Topology Driven | 0.0021732088694913047 | distance: 0.00217variant: vectorized (shape strokes) 1000px | 5.0 |
| Delaunay Triangulation | 0.008390607178959598 | distance: 0.00839variant: vectorized (shape strokes) 500px | 0.0 |
| Fidelity Simplicity | 0.013871748881897756 | distance: 0.01387variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 409.0 |
| Mastering Sketching | 0.002138540850245885 | distance: 0.00214variant: vectorized (shape strokes) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.014846640529190429 | distance: 0.01485variant: vectorized (all layers) 1000px | 179.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.024255958110345355 |  distance: 0.02426variant: original | 411.0 |
| Poly Vector → Stroke Aggregator | 0.0 |  distance: 0.0variant: vectorized (shape strokes) 500px | 5.0 |
| Real-Time Inking | 0.05769981101827176 |  distance: 0.0577variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.3358170492999424 |  distance: 0.33582variant: thresholded 500px | 651.0 |
| Fidelity Simplicity | 0.009170779310486729 |  distance: 0.00917variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 138.0 |
| Mastering Sketching | 0.06107454413243218 |  distance: 0.06107variant: original | 5.0 |
| Stroke Aggregator | 0.4959342375732057 | distance: 0.49593variant: vectorized (shape strokes) | 10.0 |
| Poly Vector | 0.0 |  distance: 0.0variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 29.0 |
| Topology Driven | 0.1668411722348977 |  distance: 0.16684variant: thresholded | 101.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.12262671147395204 | distance: 0.12263variant: original | 3.0 |
| Delaunay Triangulation | 0.036024432110629084 | distance: 0.03602variant: original | 411.0 |
| Mastering Sketching | 0.11246308134034276 | distance: 0.11246variant: original | 5.0 |
| Topology Driven → Stroke Aggregator | 0.482027654375278 | distance: 0.48203variant: thresholded 500px | 651.0 |
| Topology Driven | 0.288356005499213 | distance: 0.28836variant: thresholded | 101.0 |
| Fidelity Simplicity | 0.04238100517127822 |  distance: 0.04238variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 143.0 |
| Poly Vector → Stroke Aggregator | 0.0017706949977866313 | distance: 0.00177variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.0017706949977866313 |  distance: 0.00177variant: vectorized (shape strokes) 500px | 29.0 |
| Stroke Aggregator | 0.8062058314701757 | distance: 0.80621variant: vectorized (shape strokes) | 10.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.04981819222950725 | distance: 0.04982variant: original | 411.0 |
| Mastering Sketching | 0.15750567166576326 | distance: 0.15751variant: original | 5.0 |
| Real-Time Inking | 0.17532124403229926 | distance: 0.17532variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.6067592415823477 | distance: 0.60676variant: thresholded 500px | 651.0 |
| Fidelity Simplicity | 0.055787563494013134 |  distance: 0.05579variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 112.0 |
| Poly Vector → Stroke Aggregator | 0.007973068745570517 |  distance: 0.00797variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 5.0 |
| Poly Vector | 0.007973068745570517 | distance: 0.00797variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 29.0 |
| Stroke Aggregator | 0.9233120394876206 | distance: 0.92331variant: vectorized (shape strokes) | 10.0 |
| Topology Driven | 0.3849193445226284 | distance: 0.38492variant: thresholded | 101.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.06416377038536455 | distance: 0.06416variant: original | 411.0 |
| Mastering Sketching | 0.1834722194730904 | distance: 0.18347variant: original | 5.0 |
| Real-Time Inking | 0.21768518331901252 | distance: 0.21769variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.6818487722599399 | distance: 0.68185variant: thresholded 500px | 651.0 |
| Fidelity Simplicity | 0.06321203393878683 | distance: 0.06321variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 112.0 |
| Poly Vector → Stroke Aggregator | 0.01239486498450642 | distance: 0.01239variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.01239486498450642 | distance: 0.01239variant: vectorized (shape strokes) 500px | 29.0 |
| Stroke Aggregator | 0.9485431463269438 | distance: 0.94854variant: vectorized (shape strokes) | 10.0 |
| Topology Driven | 0.4399137160399521 | distance: 0.43991variant: thresholded | 101.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.08414100830455808 | distance: 0.08414variant: original | 411.0 |
| Real-Time Inking | 0.2749437875177842 | distance: 0.27494variant: original | 3.0 |
| Mastering Sketching | 0.21875097046675568 | distance: 0.21875variant: original | 5.0 |
| Fidelity Simplicity | 0.06929916317991633 | distance: 0.0693variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 112.0 |
| Poly Vector → Stroke Aggregator | 0.015030946065428825 | distance: 0.01503variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.015030946065428825 | distance: 0.01503variant: vectorized (shape strokes) 500px | 29.0 |
| Stroke Aggregator | 0.9647103081809671 | distance: 0.96471variant: vectorized (shape strokes) | 10.0 |
| Topology Driven → Stroke Aggregator | 0.7350113273441581 | distance: 0.73501variant: thresholded 500px | 651.0 |
| Topology Driven | 0.5227243977206605 | distance: 0.52272variant: thresholded | 101.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.14567086791992187 |  distance: 0.14567variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 234.0 |
| Poly Vector | 0.08910667419433592 |  distance: 0.08911variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 110.0 |
| Delaunay Triangulation | 0.10890362548828124 | distance: 0.1089variant: vectorized (shape strokes) 500px | 0.0 |
| Mastering Sketching | 0.3139554138183594 | distance: 0.31396variant: vectorized (shape strokes) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.14524806213378907 | distance: 0.14525variant: vectorized (all layers) 1000px | 179.0 |
| Real-Time Inking | 0.022360679626464843 | distance: 0.02236variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.02021130237704009 | distance: 0.02021variant: vectorized (shape strokes) | 10.0 |
| Topology Driven → Stroke Aggregator | 0.01897366523742676 | distance: 0.01897variant: vectorized (shape strokes) 1000px | 30.0 |
| Topology Driven | 0.01910497283935547 | distance: 0.0191variant: vectorized (shape strokes) 1000px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
| vectorized (all layers) 1000px |  |
 |
 |
 |
|
 |
 |
 |
 |
 |
 |
|
|||
| vectorized (all layers) 500px |  |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
||||
| vectorized (shape strokes) 1000px | |
|
|
|
 |
 |
|
|
|
|
 |
||||
| vectorized (shape strokes) 500px |  |
|
 |
 |
 |
 |
 |
 |
|
|
|
|
|
||
| vectorized (shape strokes) | |