A Benchmark for Rough Sketch Cleanup
Ind_product_PM_04
Author: Patrick Murphy Author Homepage: https://www.flickr.com/photos/pmurf/ Licence: CC-BY-2.0Messiness: 0.49259
Ambiguity (Chamfer): 0.29836
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Mastering Sketching | Real-Time Inking | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00344 |  distance: 0.00361 |  distance: 0.00379 |  distance: 0.00396 |  distance: 0.00425 |  distance: 0.00603 |  distance: 0.00603 |  distance: 0.01044 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.01043675683366449 | distance: 0.01044variant: vectorized (all layers) 1000pxalg. parameter: 0.25 | 120.0 |
| Topology Driven → Stroke Aggregator | 0.006030716128415734 | distance: 0.00603variant: vectorized (all layers) 500px | 1636.0 |
| Delaunay Triangulation | 0.006026621599839356 | distance: 0.00603variant: vectorized (shape strokes) 1000px | 12.0 |
| Mastering Sketching | 0.0037879442239423422 | distance: 0.00379variant: vectorized (shape strokes) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.004248980754066408 | distance: 0.00425variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 859.0 |
| Poly Vector | 0.003612347866557058 | distance: 0.00361variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 283.0 |
| Real-Time Inking | 0.003964196234982444 | distance: 0.00396variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven | 0.0034419723754590013 | distance: 0.00344variant: vectorized (shape strokes) 1000px | 36.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.05591646951476044 |  distance: 0.05592variant: original | 506.0 |
| Mastering Sketching | 0.2732425840161889 |  distance: 0.27324variant: original | 9.0 |
| Poly Vector → Stroke Aggregator | 0.31418372345969064 |  distance: 0.31418variant: vectorized (all layers) 500pxalg. parameter: noisy | 73.0 |
| Poly Vector | 0.3374329264801069 |  distance: 0.33743variant: vectorized (all layers) 1000px | 706.0 |
| Real-Time Inking | 0.29462482767075154 |  distance: 0.29462variant: thresholded | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.3099597912262295 | distance: 0.30996variant: vectorized (all layers) 500px | 1636.0 |
| Topology Driven | 0.2082811457381518 |  distance: 0.20828variant: thresholded | 1447.0 |
| Fidelity Simplicity | 0.07939366761988076 |  distance: 0.07939variant: thresholded 500pxalg. parameter: 0.3 | 119.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.10462015255763846 | distance: 0.10462variant: original | 506.0 |
| Fidelity Simplicity | 0.13941009681099828 |  distance: 0.13941variant: thresholded 500pxalg. parameter: 0.75 | 134.0 |
| Mastering Sketching | 0.4239370782508678 |  distance: 0.42394variant: thresholded 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4775822718100701 | distance: 0.47758variant: vectorized (all layers) 500pxalg. parameter: noisy | 73.0 |
| Poly Vector | 0.4738991337174343 | distance: 0.4739variant: vectorized (all layers) 1000px | 706.0 |
| Real-Time Inking | 0.4412817085802933 |  distance: 0.44128variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.47332874781816997 | distance: 0.47333variant: vectorized (all layers) 500px | 1636.0 |
| Topology Driven | 0.3649517441852931 | distance: 0.36495variant: thresholded | 1447.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.1362079701120797 | distance: 0.13621variant: original | 506.0 |
| Fidelity Simplicity | 0.1922919703804456 | distance: 0.19229variant: thresholded 500pxalg. parameter: 0.75 | 134.0 |
| Mastering Sketching | 0.5166692873045441 | distance: 0.51667variant: thresholded 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5979329033584272 | distance: 0.59793variant: vectorized (all layers) 500pxalg. parameter: noisy | 73.0 |
| Poly Vector | 0.5757285270612439 |  distance: 0.57573variant: vectorized (all layers) 1000pxalg. parameter: noisy | 712.0 |
| Real-Time Inking | 0.5351291794314865 | distance: 0.53513variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5915530746344713 | distance: 0.59155variant: vectorized (all layers) 500px | 1636.0 |
| Topology Driven | 0.4356034010996483 | distance: 0.4356variant: thresholded | 1447.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.1797788123440784 | distance: 0.17978variant: original | 506.0 |
| Fidelity Simplicity | 0.23364238276862184 | distance: 0.23364variant: thresholded 500pxalg. parameter: 0.75 | 134.0 |
| Mastering Sketching | 0.5757131511861376 | distance: 0.57571variant: thresholded 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6745502087486505 | distance: 0.67455variant: vectorized (all layers) 500pxalg. parameter: noisy | 73.0 |
| Poly Vector | 0.6410644710433645 | distance: 0.64106variant: vectorized (all layers) 1000pxalg. parameter: noisy | 712.0 |
| Real-Time Inking | 0.5915130955057503 | distance: 0.59151variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6561049130104025 | distance: 0.6561variant: vectorized (all layers) 500px | 1636.0 |
| Topology Driven | 0.526636227377994 | distance: 0.52664variant: thresholded | 1447.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2137118440282996 | distance: 0.21371variant: original | 506.0 |
| Fidelity Simplicity | 0.2748721483901207 | distance: 0.27487variant: thresholded 500pxalg. parameter: 0.75 | 134.0 |
| Mastering Sketching | 0.6267055203356606 | distance: 0.62671variant: thresholded 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.7307796839474408 | distance: 0.73078variant: vectorized (all layers) 500pxalg. parameter: noisy | 73.0 |
| Poly Vector | 0.7005430782194273 | distance: 0.70054variant: vectorized (all layers) 1000pxalg. parameter: noisy | 712.0 |
| Real-Time Inking | 0.633128424235223 | distance: 0.63313variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7190848000030261 | distance: 0.71908variant: vectorized (all layers) 500px | 1636.0 |
| Topology Driven | 0.5732565787058556 | distance: 0.57326variant: thresholded | 1447.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.10175471275857408 |  distance: 0.10175variant: thresholded | 42.0 |
| Mastering Sketching | 0.11052016732077928 | distance: 0.11052variant: original | 9.0 |
| Topology Driven → Stroke Aggregator | 0.11173181915283203 | distance: 0.11173variant: vectorized (all layers) 500px | 1636.0 |
| Fidelity Simplicity | 0.12101652526855468 |  distance: 0.12102variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 161.0 |
| Poly Vector → Stroke Aggregator | 0.06449806213378906 | distance: 0.0645variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 859.0 |
| Poly Vector | 0.0640078125 |  distance: 0.06401variant: vectorized (shape strokes) 1000px | 283.0 |
| Real-Time Inking | 0.06352952194213868 |  distance: 0.06353variant: vectorized (shape strokes) 500px | 2.0 |
| Topology Driven | 0.05727128601074219 |  distance: 0.05727variant: vectorized (shape strokes) 500px | 9.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
|
|
||||||||||||
| thresholded | |
 |
 |
 |
 |
 |
 |
|
|
||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 500px | |
|
|
 |
 |
|
 |
 |
 |
||||||
| vectorized (all layers) 1000px |  |
 |
|
 |
|
 |
|
|
 |
||||||
| vectorized (all layers) 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
 |
|
| vectorized (shape strokes) 1000px | |
 |
 |
 |
 |
 |
|
|
|
|
|
||||
| vectorized (shape strokes) 500px | |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
 |