A Benchmark for Rough Sketch Cleanup
Art_freeform_DR_02
Author: David Revoy Author Homepage: https://www.davidrevoy.com/ Licence: CC-BY-4.0Messiness: 0.19469
Ambiguity (Chamfer): 0.14755
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Mastering Sketching | Poly Vector | Real-Time Inking | Fidelity Simplicity | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00232 |  distance: 0.0024 |  distance: 0.00247 |  distance: 0.00278 |  distance: 0.00336 |  distance: 0.00412 |  distance: 0.00525 |  distance: 0.01105 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.011048972047307164 | distance: 0.01105variant: originalalg. parameter: noisy | 52.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.0052540547309573955 | distance: 0.00525variant: vectorized (shape strokes) 1000px | 16.0 |
| Fidelity Simplicity | 0.0033628485355025137 | distance: 0.00336variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 180.0 |
| Mastering Sketching | 0.0023976070096953907 | distance: 0.0024variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.0024714876454887107 | distance: 0.00247variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 685.0 |
| Real-Time Inking | 0.002781526733276973 | distance: 0.00278variant: vectorized (shape strokes) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.004119293372656499 | distance: 0.00412variant: vectorized (shape strokes) 500px | 447.0 |
| Topology Driven | 0.002323820593902293 | distance: 0.00232variant: vectorized (shape strokes) 1000px | 54.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.18877038569619048 |  distance: 0.18877variant: vectorized (all layers) 1000px | 27.0 |
| Fidelity Simplicity | 0.19381822034252405 |  distance: 0.19382variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 169.0 |
| Real-Time Inking | 0.4954728860770867 |  distance: 0.49547variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.4201394368112569 |  distance: 0.42014variant: vectorized (all layers) 500px | 1138.0 |
| Mastering Sketching | 0.5390007775391735 |  distance: 0.539variant: original | 7.0 |
| Poly Vector → Stroke Aggregator | 0.3295325065710251 | distance: 0.32953variant: originalalg. parameter: noisy | 52.0 |
| Poly Vector | 0.33728086472877866 |  distance: 0.33728variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 130.0 |
| Topology Driven | 0.4865857271938626 |  distance: 0.48659variant: original | 18.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3274553478808488 | distance: 0.32746variant: vectorized (all layers) 1000px | 27.0 |
| Fidelity Simplicity | 0.2878836114098604 |  distance: 0.28788variant: thresholded 500pxalg. parameter: 0.75 | 185.0 |
| Mastering Sketching | 0.6896950511788019 |  distance: 0.6897variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.6486995393977161 | distance: 0.6487variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Poly Vector → Stroke Aggregator | 0.4627964197458382 | distance: 0.4628variant: originalalg. parameter: noisy | 52.0 |
| Poly Vector | 0.4580558495150008 | distance: 0.45806variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 130.0 |
| Topology Driven → Stroke Aggregator | 0.5914174365384036 | distance: 0.59142variant: vectorized (all layers) 500px | 1138.0 |
| Topology Driven | 0.6435768871215336 | distance: 0.64358variant: original | 18.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.449109526726584 | distance: 0.44911variant: vectorized (all layers) 1000px | 27.0 |
| Fidelity Simplicity | 0.3905708679299129 |  distance: 0.39057variant: thresholded 500pxalg. parameter: 0.6 | 181.0 |
| Mastering Sketching | 0.7714577708839323 | distance: 0.77146variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.7390259717960109 |  distance: 0.73903variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Poly Vector → Stroke Aggregator | 0.5535519946470223 | distance: 0.55355variant: originalalg. parameter: noisy | 52.0 |
| Poly Vector | 0.57750586324005 | distance: 0.57751variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 130.0 |
| Topology Driven → Stroke Aggregator | 0.7259652968622947 | distance: 0.72597variant: vectorized (all layers) 500px | 1138.0 |
| Topology Driven | 0.7425731589229118 | distance: 0.74257variant: original | 18.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5367599766782651 | distance: 0.53676variant: vectorized (all layers) 1000px | 27.0 |
| Fidelity Simplicity | 0.4626098366084891 |  distance: 0.46261variant: thresholded 500pxalg. parameter: 0.25 | 167.0 |
| Mastering Sketching | 0.8179709334621021 | distance: 0.81797variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.7841700625227737 | distance: 0.78417variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7981533896471482 | distance: 0.79815variant: vectorized (all layers) 500px | 1138.0 |
| Poly Vector → Stroke Aggregator | 0.6224768565836286 | distance: 0.62248variant: originalalg. parameter: noisy | 52.0 |
| Poly Vector | 0.6546366587319727 |  distance: 0.65464variant: vectorized (shape strokes) 500px | 138.0 |
| Topology Driven | 0.7955587761809968 | distance: 0.79556variant: original | 18.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6037584703808259 | distance: 0.60376variant: vectorized (all layers) 1000px | 27.0 |
| Fidelity Simplicity | 0.545346748557179 | distance: 0.54535variant: thresholded 500pxalg. parameter: 0.75 | 185.0 |
| Mastering Sketching | 0.8584745698872985 | distance: 0.85847variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8276076412420799 | distance: 0.82761variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Poly Vector → Stroke Aggregator | 0.6769983343632113 | distance: 0.677variant: originalalg. parameter: noisy | 52.0 |
| Poly Vector | 0.7068304365267023 |  distance: 0.70683variant: originalalg. parameter: noisy | 316.0 |
| Topology Driven → Stroke Aggregator | 0.848842718846218 | distance: 0.84884variant: vectorized (all layers) 500px | 1138.0 |
| Topology Driven | 0.8339523281415664 | distance: 0.83395variant: original | 18.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.11659073899160667 | distance: 0.11659variant: original | 7.0 |
| Poly Vector → Stroke Aggregator | 0.13709600465290747 | distance: 0.1371variant: originalalg. parameter: noisy | 52.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.1193314743041992 | distance: 0.11933variant: vectorized (all layers) 500px | 1138.0 |
| Topology Driven | 0.03883297729492188 |  distance: 0.03883variant: vectorized (shape strokes) 500px | 11.0 |
| Delaunay Triangulation | 0.04767599105834961 | distance: 0.04768variant: vectorized (shape strokes) 1000px | 16.0 |
| Fidelity Simplicity | 0.0404474983215332 | distance: 0.04045variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 180.0 |
| Poly Vector | 0.04060787963867187 | distance: 0.04061variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 685.0 |
| Real-Time Inking | 0.0394461669921875 |  distance: 0.03945variant: vectorized (shape strokes) 500px | 2.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
|
 |
 |
 |
 |
 |
|
|
 |
 |
|
|||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 500px |  |
 |
 |
|
 |
|
|
 |
 |
 |
 |
||||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||||
| vectorized (all layers) 500px | |
|
|
 |
|
 |
 |
 |
 |
 |
 |
 |
|||
| vectorized (shape strokes) 1000px | |
 |
|
 |
 |
 |
|
|
 |
|
|||||
| vectorized (shape strokes) 500px | |
|
|
 |
 |
 |
 |
 |
|
|
|
 |