A Benchmark for Rough Sketch Cleanup
Ind_product_PM_07
Author: Patrick Murphy Author Homepage: https://www.flickr.com/photos/pmurf/ Licence: CC-BY-2.0Messiness: 0.89349
Ambiguity (Chamfer): 1.00425
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Mastering Sketching | Real-Time Inking | Stroke Aggregator | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.004 |  distance: 0.00423 |  distance: 0.00427 |  distance: 0.00455 |  distance: 0.00506 |  distance: 0.00513 |  distance: 0.00629 |  distance: 0.01041 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.00628587921955161 | distance: 0.00629variant: vectorized (shape strokes) 1000px | 10.0 |
| Fidelity Simplicity | 0.010411094239016773 | distance: 0.01041variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 173.0 |
| Mastering Sketching | 0.004272868355023615 | distance: 0.00427variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0051274410141320245 | distance: 0.00513variant: vectorized (shape strokes) 1000px | 811.0 |
| Poly Vector | 0.004227017438435632 | distance: 0.00423variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 503.0 |
| Real-Time Inking | 0.0045468789001160605 | distance: 0.00455variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.0050643906412322715 | distance: 0.00506variant: vectorized (shape strokes) | 844.0 |
| Topology Driven | 0.004001962878274446 | distance: 0.004variant: vectorized (shape strokes) 1000px | 30.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.09715660427369276 |  distance: 0.09716variant: thresholded 500px | 14.0 |
| Mastering Sketching | 0.2154180337484721 |  distance: 0.21542variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.19970242923686266 |  distance: 0.1997variant: vectorized (all layers) 1000px | 1034.0 |
| Real-Time Inking | 0.21246356987343726 |  distance: 0.21246variant: original | 5.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.16812181212976113 |  distance: 0.16812variant: thresholded 500px | 861.0 |
| Fidelity Simplicity | 0.04588624408475115 |  distance: 0.04589variant: originalalg. parameter: 0.6 | 319.0 |
| Poly Vector → Stroke Aggregator | 0.2560523694642775 |  distance: 0.25605variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 813.0 |
| Stroke Aggregator | 0.24349049673828535 | distance: 0.24349variant: vectorized (shape strokes) | 844.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.17242409015863902 | distance: 0.17242variant: thresholded 500px | 14.0 |
| Mastering Sketching | 0.3127623488087223 | distance: 0.31276variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.3025001814443176 |  distance: 0.3025variant: vectorized (all layers) 1000pxalg. parameter: noisy | 1014.0 |
| Real-Time Inking | 0.3571774026226268 |  distance: 0.35718variant: thresholded 500px | 2.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.2556010353687384 | distance: 0.2556variant: thresholded 500px | 861.0 |
| Fidelity Simplicity | 0.10344214392840624 |  distance: 0.10344variant: originalalg. parameter: 0.25 | 224.0 |
| Poly Vector → Stroke Aggregator | 0.380531829575158 | distance: 0.38053variant: vectorized (shape strokes) 1000px | 811.0 |
| Stroke Aggregator | 0.3846440193778972 | distance: 0.38464variant: vectorized (shape strokes) | 844.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2535376368808135 | distance: 0.25354variant: thresholded 500px | 14.0 |
| Mastering Sketching | 0.3880436487485716 | distance: 0.38804variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.3910724014232133 | distance: 0.39107variant: vectorized (all layers) 1000px | 1034.0 |
| Real-Time Inking | 0.425603060333166 |  distance: 0.4256variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.3441316170524941 | distance: 0.34413variant: thresholded 500px | 861.0 |
| Fidelity Simplicity | 0.14656824444206398 |  distance: 0.14657variant: originalalg. parameter: 0.75 | 312.0 |
| Poly Vector → Stroke Aggregator | 0.4868311506942437 | distance: 0.48683variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 813.0 |
| Stroke Aggregator | 0.4873078550882417 | distance: 0.48731variant: vectorized (shape strokes) | 844.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.30349181932416297 |  distance: 0.30349variant: thresholded | 579.0 |
| Mastering Sketching | 0.4450784593437946 | distance: 0.44508variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.4560223394353087 | distance: 0.45602variant: vectorized (all layers) 1000px | 1034.0 |
| Real-Time Inking | 0.4737570666272444 | distance: 0.47376variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.4131705834276155 | distance: 0.41317variant: thresholded 500px | 861.0 |
| Fidelity Simplicity | 0.18252075667067635 | distance: 0.18252variant: originalalg. parameter: 0.25 | 224.0 |
| Poly Vector → Stroke Aggregator | 0.5629523767043532 | distance: 0.56295variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 813.0 |
| Stroke Aggregator | 0.5667182439380626 | distance: 0.56672variant: vectorized (shape strokes) | 844.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3421029024939329 | distance: 0.3421variant: thresholded | 579.0 |
| Mastering Sketching | 0.5067873303167422 | distance: 0.50679variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.5147857645977341 | distance: 0.51479variant: vectorized (all layers) 1000px | 1034.0 |
| Real-Time Inking | 0.5199605590565789 | distance: 0.51996variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.4853760241478829 | distance: 0.48538variant: thresholded 500px | 861.0 |
| Fidelity Simplicity | 0.21105489977576086 | distance: 0.21105variant: originalalg. parameter: 0.25 | 224.0 |
| Poly Vector → Stroke Aggregator | 0.6119438642272708 | distance: 0.61194variant: vectorized (shape strokes) 1000px | 811.0 |
| Stroke Aggregator | 0.6292965580374277 | distance: 0.6293variant: vectorized (shape strokes) | 844.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.12698412698412698 | distance: 0.12698variant: originalalg. parameter: 0.75 | 312.0 |
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.067 | distance: 0.067variant: vectorized (shape strokes) 1000px | 10.0 |
| Mastering Sketching | 0.20935137939453125 |  distance: 0.20935variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.067 | distance: 0.067variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 813.0 |
| Poly Vector | 0.067 | distance: 0.067variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 503.0 |
| Real-Time Inking | 0.067 | distance: 0.067variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.0671957671957672 | distance: 0.0672variant: vectorized (shape strokes) | 844.0 |
| Topology Driven | 0.067 | distance: 0.067variant: vectorized (shape strokes) 1000px | 30.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
|
|
||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
|
||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 500px | |
|
 |
 |
 |
 |
 |
|
|
||||||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
|
|
 |
|||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (shape strokes) 1000px | |
 |
 |
 |
 |
|
|
|
 |
|
|
|
|||
| vectorized (shape strokes) 500px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||
| vectorized (shape strokes) | |