A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_09
Author: Baseline Licence: Academic PaperMessiness: 0.28087
Ambiguity (Chamfer): 0.11827
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Stroke Aggregator | Real-Time Inking | Topology Driven | Poly Vector | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00128 |  distance: 0.00132 |  distance: 0.00167 |  distance: 0.00185 |  distance: 0.00194 |  distance: 0.00202 |  distance: 0.00237 |  distance: 0.00266 |  distance: 0.00312 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0031162917866676657 | distance: 0.00312variant: original 1000px | 11.0 |
| Fidelity Simplicity | 0.0020238314949876427 | distance: 0.00202variant: original 1000pxalg. parameter: 0.25 | 204.0 |
| Mastering Sketching | 0.0012802654894713671 | distance: 0.00128variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0023745832409589416 | distance: 0.00237variant: original 500pxalg. parameter: noisy | 41.0 |
| Poly Vector | 0.0019393185457596731 | distance: 0.00194variant: originalalg. parameter: noisy | 650.0 |
| Real-Time Inking | 0.0016697124538022365 | distance: 0.00167variant: original 1000px | 3.0 |
| Stroke Aggregator | 0.0013185620269940885 | distance: 0.00132variant: vectorized (all layers) | 1099.0 |
| Topology Driven → Stroke Aggregator | 0.002661176300002732 | distance: 0.00266variant: original 500px | 370.0 |
| Topology Driven | 0.0018468246336943398 | distance: 0.00185variant: original | 95.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4929068170290421 |  distance: 0.49291variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.5714045684977912 |  distance: 0.5714variant: originalalg. parameter: 0.75 | 354.0 |
| Mastering Sketching | 0.6933068091811186 | distance: 0.69331variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5674755479344415 | distance: 0.56748variant: original 500pxalg. parameter: noisy | 41.0 |
| Poly Vector | 0.5757326097366099 |  distance: 0.57573variant: original | 547.0 |
| Real-Time Inking | 0.5769636300325346 |  distance: 0.57696variant: original | 12.0 |
| Stroke Aggregator | 0.6232137402043512 | distance: 0.62321variant: vectorized (all layers) | 1099.0 |
| Topology Driven → Stroke Aggregator | 0.5350635527549382 | distance: 0.53506variant: original 500px | 370.0 |
| Topology Driven | 0.5630664335625699 |  distance: 0.56307variant: original 1000px | 40.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7955141936859588 | distance: 0.79551variant: originalalg. parameter: 0.75 | 354.0 |
| Mastering Sketching | 0.8597620070518617 | distance: 0.85976variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7726975279325781 | distance: 0.7727variant: original 500pxalg. parameter: noisy | 41.0 |
| Poly Vector | 0.7751249943010338 |  distance: 0.77512variant: original 500px | 82.0 |
| Real-Time Inking | 0.7832550085925966 | distance: 0.78326variant: original | 12.0 |
| Stroke Aggregator | 0.8342999273122726 | distance: 0.8343variant: vectorized (all layers) | 1099.0 |
| Topology Driven → Stroke Aggregator | 0.7512861231980053 | distance: 0.75129variant: original 500px | 370.0 |
| Topology Driven | 0.7616382607054978 | distance: 0.76164variant: original 1000px | 40.0 |
| Delaunay Triangulation | 0.7022341234505677 | distance: 0.70223variant: original 500px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.9015409012598736 |  distance: 0.90154variant: originalalg. parameter: 0.6 | 292.0 |
| Mastering Sketching | 0.9479581702630452 | distance: 0.94796variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8904414328944754 | distance: 0.89044variant: original 500pxalg. parameter: noisy | 41.0 |
| Poly Vector | 0.8825854560556039 | distance: 0.88259variant: original 500px | 82.0 |
| Real-Time Inking | 0.8821720636294835 | distance: 0.88217variant: original | 12.0 |
| Stroke Aggregator | 0.9309666402952552 | distance: 0.93097variant: vectorized (all layers) | 1099.0 |
| Topology Driven | 0.8703909226628352 | distance: 0.87039variant: original 1000px | 40.0 |
| Delaunay Triangulation | 0.8321711832112731 | distance: 0.83217variant: original 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.8802294832852426 | distance: 0.88023variant: original 500px | 370.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9766519201616244 | distance: 0.97665variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9321148731539756 | distance: 0.93211variant: original 500pxalg. parameter: noisy | 41.0 |
| Real-Time Inking | 0.9378113289397834 | distance: 0.93781variant: original | 12.0 |
| Stroke Aggregator | 0.9666373863417922 | distance: 0.96664variant: vectorized (all layers) | 1099.0 |
| Delaunay Triangulation | 0.8920219891297415 | distance: 0.89202variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.9392096840822476 | distance: 0.93921variant: originalalg. parameter: 0.75 | 354.0 |
| Poly Vector | 0.9307656040329308 |  distance: 0.93077variant: original 1000px | 234.0 |
| Topology Driven → Stroke Aggregator | 0.9321141921002352 | distance: 0.93211variant: original 500px | 370.0 |
| Topology Driven | 0.9194655833381016 | distance: 0.91947variant: original 1000px | 40.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.99026923727616 | distance: 0.99027variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9666541908776296 | distance: 0.96665variant: original 500pxalg. parameter: noisy | 41.0 |
| Stroke Aggregator | 0.9816626695542344 | distance: 0.98166variant: vectorized (all layers) | 1099.0 |
| Fidelity Simplicity | 0.9592609470893568 | distance: 0.95926variant: originalalg. parameter: 0.75 | 354.0 |
| Poly Vector | 0.95885863615496 | distance: 0.95886variant: original 1000px | 234.0 |
| Real-Time Inking | 0.9600916011635824 | distance: 0.96009variant: original | 12.0 |
| Topology Driven → Stroke Aggregator | 0.9616457138826248 | distance: 0.96165variant: original 500px | 370.0 |
| Topology Driven | 0.951050504769972 | distance: 0.95105variant: original 1000px | 40.0 |
| Delaunay Triangulation | 0.9251679414640906 |  distance: 0.92517variant: original | 27.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0600333251953125 | distance: 0.06003variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.07602631378173827 |  distance: 0.07603variant: original 500pxalg. parameter: 0.25 | 134.0 |
| Real-Time Inking | 0.026683328628540042 |  distance: 0.02668variant: original 500px | 3.0 |
| Stroke Aggregator | 0.029054431642296163 | distance: 0.02905variant: vectorized (all layers) | 1099.0 |
| Mastering Sketching | 0.3608489990234375 | distance: 0.36085variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.041761226654052734 | distance: 0.04176variant: original 500pxalg. parameter: noisy | 41.0 |
| Poly Vector | 0.029274562835693362 |  distance: 0.02927variant: original 1000pxalg. parameter: noisy | 278.0 |
| Topology Driven → Stroke Aggregator | 0.028071336746215817 | distance: 0.02807variant: original 500px | 370.0 |
| Topology Driven | 0.028071336746215817 |  distance: 0.02807variant: original 500px | 11.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
|
|
|
|
|
|
|||||
| original 1000px | |
 |
|
 |
 |
 |
|
|
|
|
|||||
| original 500px | |
|
|
 |
|
 |
 |
 |
|
 |
|
|
|
||
| vectorized (all layers) | |