A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_06
Author: Enrique Rosales Licence: Academic PaperMessiness: 0.18457
Ambiguity (Chamfer): 0.08806
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Stroke Aggregator | Mastering Sketching | Poly Vector → Stroke Aggregator | Real-Time Inking | Topology Driven | Poly Vector | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00119 |  distance: 0.00119 |  distance: 0.00133 |  distance: 0.00139 |  distance: 0.00145 |  distance: 0.00151 |  distance: 0.00213 |  distance: 0.03127 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.03126984290308279 | distance: 0.03127variant: originalalg. parameter: 0.6 | 230.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.00144917818754845 | distance: 0.00145variant: original | 48.0 |
| Delaunay Triangulation | 0.002126565528195438 | distance: 0.00213variant: original | 14.0 |
| Mastering Sketching | 0.001193382465624317 | distance: 0.00119variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0013286270285540673 | distance: 0.00133variant: original | 280.0 |
| Poly Vector | 0.0015108726981153404 | distance: 0.00151variant: original | 255.0 |
| Real-Time Inking | 0.0013940179832333634 | distance: 0.00139variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.0011895536236968516 | distance: 0.00119variant: vectorized (all layers) | 598.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.29978909619155125 |  distance: 0.29979variant: original 500pxalg. parameter: 0.3 | 118.0 |
| Poly Vector → Stroke Aggregator | 0.6457807032447719 |  distance: 0.64578variant: original 500pxalg. parameter: noisy | 19.0 |
| Poly Vector | 0.6582541798144178 |  distance: 0.65825variant: original 500pxalg. parameter: noisy | 102.0 |
| Real-Time Inking | 0.7068011590689729 |  distance: 0.7068variant: original | 3.0 |
| Stroke Aggregator | 0.7409825195567782 | distance: 0.74098variant: vectorized (all layers) | 598.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.41516225028367204 |  distance: 0.41516variant: original 500px | 1.0 |
| Mastering Sketching | 0.7819276328086702 | distance: 0.78193variant: original 1000px | 6.0 |
| Topology Driven | 0.7046135032692591 | distance: 0.70461variant: original | 48.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.3576266717702529 | distance: 0.35763variant: original 500pxalg. parameter: 0.3 | 118.0 |
| Mastering Sketching | 0.9308364519554492 | distance: 0.93084variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.7918544623234252 | distance: 0.79185variant: original 500pxalg. parameter: noisy | 19.0 |
| Poly Vector | 0.7927407730712129 |  distance: 0.79274variant: original 500px | 106.0 |
| Real-Time Inking | 0.8944587249504407 | distance: 0.89446variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.8719641482094871 |  distance: 0.87196variant: original 500px | 7.0 |
| Delaunay Triangulation | 0.6603544523389538 | distance: 0.66035variant: original 500px | 1.0 |
| Stroke Aggregator | 0.9434002133326179 | distance: 0.9434variant: vectorized (all layers) | 598.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8264998252310809 | distance: 0.8265variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.3858327053504145 |  distance: 0.38583variant: original 500pxalg. parameter: 0.25 | 112.0 |
| Mastering Sketching | 0.9758588119585708 | distance: 0.97586variant: original 1000px | 6.0 |
| Poly Vector | 0.8786499243765684 | distance: 0.87865variant: original 500px | 106.0 |
| Real-Time Inking | 0.957915114604358 | distance: 0.95792variant: original | 3.0 |
| Stroke Aggregator | 0.9819940648353828 | distance: 0.98199variant: vectorized (all layers) | 598.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.9498152508542616 | distance: 0.94982variant: original 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.881433944331744 | distance: 0.88143variant: original 500pxalg. parameter: noisy | 19.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.9071881625874548 | distance: 0.90719variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.3961063272182703 | distance: 0.39611variant: original 500pxalg. parameter: 0.25 | 112.0 |
| Mastering Sketching | 0.9889411244640268 | distance: 0.98894variant: original 1000px | 6.0 |
| Real-Time Inking | 0.9798224920488484 | distance: 0.97982variant: original | 3.0 |
| Stroke Aggregator | 0.9913954261527984 | distance: 0.9914variant: vectorized (all layers) | 598.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Poly Vector → Stroke Aggregator | 0.9064559425438198 | distance: 0.90646variant: original 500pxalg. parameter: noisy | 19.0 |
| Poly Vector | 0.9088509843348564 | distance: 0.90885variant: original 500px | 106.0 |
| Topology Driven | 0.9775093186888482 |  distance: 0.97751variant: original 1000px | 24.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4053601340033501 |  distance: 0.40536variant: original 500pxalg. parameter: 0.75 | 122.0 |
| Mastering Sketching | 0.995587794940374 | distance: 0.99559variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9277109333324484 | distance: 0.92771variant: original 500pxalg. parameter: noisy | 19.0 |
| Poly Vector | 0.9263883169539541 | distance: 0.92639variant: original 500pxalg. parameter: noisy | 102.0 |
| Real-Time Inking | 0.9891641754738572 | distance: 0.98916variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.9899653530423738 | distance: 0.98997variant: original 500px | 7.0 |
| Delaunay Triangulation | 0.9373001395515644 | distance: 0.9373variant: original 500px | 1.0 |
| Stroke Aggregator | 0.9962479734332405 | distance: 0.99625variant: vectorized (all layers) | 598.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.09130169677734376 |  distance: 0.0913variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.014866068840026857 |  distance: 0.01487variant: original 1000pxalg. parameter: noisy | 175.0 |
| Real-Time Inking | 0.014560219764709472 |  distance: 0.01456variant: original 500px | 2.0 |
| Stroke Aggregator | 0.014249441910595394 | distance: 0.01425variant: vectorized (all layers) | 598.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.05955566578059025 | distance: 0.05956variant: original | 14.0 |
| Poly Vector | 0.015498039841568025 |  distance: 0.0155variant: originalalg. parameter: noisy | 315.0 |
| Topology Driven | 0.01554589805092969 | distance: 0.01555variant: original | 48.0 |
| Fidelity Simplicity | 0.378715155411572 | distance: 0.37872variant: originalalg. parameter: 0.6 | 230.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
|
|
|
|
|
 |
|
|||
| original 1000px | |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
|
 |
||
| original 500px | |
|
|
|
 |
|
 |
|
|
|
|
|
|||
| vectorized (all layers) | |