A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_02
Author: Baseline Licence: Academic PaperMessiness: 0.29977
Ambiguity (Chamfer): 0.18379
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Stroke Aggregator | Topology Driven | Mastering Sketching | Poly Vector | Real-Time Inking | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00245 |  distance: 0.00264 |  distance: 0.00268 |  distance: 0.00272 |  distance: 0.00273 |  distance: 0.00377 |  distance: 0.00404 |  distance: 0.00419 |  distance: 0.00429 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.004193669295045679 | distance: 0.00419variant: original 1000px | 15.0 |
| Fidelity Simplicity | 0.004292455125624193 | distance: 0.00429variant: originalalg. parameter: 0.25 | 284.0 |
| Mastering Sketching | 0.002679153013840336 | distance: 0.00268variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.004038883857099431 | distance: 0.00404variant: original 1000px | 782.0 |
| Poly Vector | 0.0027236799270854307 | distance: 0.00272variant: original | 625.0 |
| Real-Time Inking | 0.002728424890829613 | distance: 0.00273variant: original | 3.0 |
| Stroke Aggregator | 0.0024527850655371537 | distance: 0.00245variant: vectorized (all layers) | 1692.0 |
| Topology Driven → Stroke Aggregator | 0.0037709301660902423 | distance: 0.00377variant: original 500px | 440.0 |
| Topology Driven | 0.0026416475789815645 | distance: 0.00264variant: original | 108.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4253887930621553 |  distance: 0.42539variant: originalalg. parameter: 0.75 | 350.0 |
| Poly Vector → Stroke Aggregator | 0.4819997385634841 |  distance: 0.482variant: original 500px | 42.0 |
| Poly Vector | 0.4994770382133788 |  distance: 0.49948variant: original 500px | 136.0 |
| Real-Time Inking | 0.5083898673860476 | distance: 0.50839variant: original | 3.0 |
| Topology Driven | 0.5131761764258187 | distance: 0.51318variant: original | 108.0 |
| Delaunay Triangulation | 0.3330468948840289 |  distance: 0.33305variant: original 500px | 3.0 |
| Mastering Sketching | 0.5953603650925305 | distance: 0.59536variant: original 500px | 6.0 |
| Stroke Aggregator | 0.5071053192755083 | distance: 0.50711variant: vectorized (all layers) | 1692.0 |
| Topology Driven → Stroke Aggregator | 0.4714362810856879 | distance: 0.47144variant: original 500px | 440.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.632908762138885 |  distance: 0.63291variant: original 500pxalg. parameter: 0.5 | 189.0 |
| Real-Time Inking | 0.708711978498098 | distance: 0.70871variant: original | 3.0 |
| Topology Driven | 0.7072986809701313 |  distance: 0.7073variant: original 500px | 13.0 |
| Delaunay Triangulation | 0.5173662005263089 | distance: 0.51737variant: original 500px | 3.0 |
| Mastering Sketching | 0.7879432200904148 | distance: 0.78794variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6520044419787873 | distance: 0.652variant: original 500px | 42.0 |
| Poly Vector | 0.6640750641466633 |  distance: 0.66408variant: original 500pxalg. parameter: noisy | 140.0 |
| Stroke Aggregator | 0.7568628460773613 | distance: 0.75686variant: vectorized (all layers) | 1692.0 |
| Topology Driven → Stroke Aggregator | 0.6716401772953797 | distance: 0.67164variant: original 500px | 440.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7660529941516089 |  distance: 0.76605variant: originalalg. parameter: 0.6 | 326.0 |
| Mastering Sketching | 0.8751549902217652 | distance: 0.87515variant: original 500px | 6.0 |
| Real-Time Inking | 0.8212228212556381 | distance: 0.82122variant: original | 3.0 |
| Stroke Aggregator | 0.8547185227184829 | distance: 0.85472variant: vectorized (all layers) | 1692.0 |
| Topology Driven → Stroke Aggregator | 0.7941806437268122 | distance: 0.79418variant: original 500px | 440.0 |
| Topology Driven | 0.8129615938087463 | distance: 0.81296variant: original 500px | 13.0 |
| Delaunay Triangulation | 0.7137617577333395 | distance: 0.71376variant: original 500px | 3.0 |
| Poly Vector → Stroke Aggregator | 0.7762050585134834 |  distance: 0.77621variant: original 500pxalg. parameter: noisy | 42.0 |
| Poly Vector | 0.7847327971793425 | distance: 0.78473variant: original 500pxalg. parameter: noisy | 140.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8112906947363575 | distance: 0.81129variant: original 500px | 3.0 |
| Fidelity Simplicity | 0.8345720731303209 | distance: 0.83457variant: originalalg. parameter: 0.75 | 350.0 |
| Mastering Sketching | 0.917101834628986 | distance: 0.9171variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.847492052926652 | distance: 0.84749variant: original 500px | 42.0 |
| Poly Vector | 0.8521293037035099 | distance: 0.85213variant: original 500px | 136.0 |
| Real-Time Inking | 0.882541856891 |  distance: 0.88254variant: original 500px | 2.0 |
| Stroke Aggregator | 0.91747252678097 | distance: 0.91747variant: vectorized (all layers) | 1692.0 |
| Topology Driven → Stroke Aggregator | 0.8678037582641092 | distance: 0.8678variant: original 500px | 440.0 |
| Topology Driven | 0.8770361323295054 | distance: 0.87704variant: original 500px | 13.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8801309857700232 | distance: 0.88013variant: original 1000px | 15.0 |
| Fidelity Simplicity | 0.884213796416019 |  distance: 0.88421variant: originalalg. parameter: 0.5 | 332.0 |
| Mastering Sketching | 0.9485509946193178 | distance: 0.94855variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8929816259751536 | distance: 0.89298variant: original 500pxalg. parameter: noisy | 42.0 |
| Poly Vector | 0.8991350166677053 | distance: 0.89914variant: original 500pxalg. parameter: noisy | 140.0 |
| Real-Time Inking | 0.9234533692859332 | distance: 0.92345variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9387140924647231 | distance: 0.93871variant: vectorized (all layers) | 1692.0 |
| Topology Driven → Stroke Aggregator | 0.9156580260086152 | distance: 0.91566variant: original 500px | 440.0 |
| Topology Driven | 0.9224792712505654 | distance: 0.92248variant: original 500px | 13.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.20460693359375 | distance: 0.20461variant: original 500px | 6.0 |
| Topology Driven → Stroke Aggregator | 0.042047592163085935 | distance: 0.04205variant: original 500px | 440.0 |
| Delaunay Triangulation | 0.052000000000000005 | distance: 0.052variant: original 500px | 3.0 |
| Fidelity Simplicity | 0.07683752000946359 | distance: 0.07684variant: originalalg. parameter: 0.75 | 350.0 |
| Poly Vector → Stroke Aggregator | 0.07400000000000001 | distance: 0.074variant: original 500px | 42.0 |
| Poly Vector | 0.045221675872802736 |  distance: 0.04522variant: original 1000pxalg. parameter: noisy | 385.0 |
| Real-Time Inking | 0.03773592376708984 |  distance: 0.03774variant: original 1000px | 3.0 |
| Stroke Aggregator | 0.04629320950852227 | distance: 0.04629variant: vectorized (all layers) | 1692.0 |
| Topology Driven | 0.042047592163085935 | distance: 0.04205variant: original 500px | 13.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
|
|
|
|
 |
|
 |
|||||
| original 1000px | |
 |
 |
 |
 |
 |
 |
|
 |
|
 |
|
|||
| original 500px | |
|
|
 |
 |
|
 |
 |
|
|
|
|
|
|
|
| vectorized (all layers) | |