A Benchmark for Rough Sketch Cleanup
Art_logo_VFS_15
Author: VFS Digital Design Author Homepage: https://www.flickr.com/photos/vfsdigitaldesign/ Licence: CC-BY-2.0Messiness: 0.04381
Ambiguity (Chamfer): 0.16004
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Poly Vector | Topology Driven | Mastering Sketching | Real-Time Inking | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00093 |  distance: 0.00094 |  distance: 0.00098 |  distance: 0.0012 |  distance: 0.00168 |  distance: 0.002 |  distance: 0.00215 |  distance: 0.00219 |  distance: 0.00307 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.003070039946954219 | distance: 0.00307variant: vectorized (shape strokes) 1000px | 1.0 |
| Fidelity Simplicity | 0.0021461515132609986 | distance: 0.00215variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 225.0 |
| Mastering Sketching | 0.0009835017822462514 | distance: 0.00098variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.001679299474686722 | distance: 0.00168variant: originalalg. parameter: noisy | 18.0 |
| Poly Vector | 0.0009291618061621934 | distance: 0.00093variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 55.0 |
| Real-Time Inking | 0.0011973375235564256 | distance: 0.0012variant: thresholded 1000px | 2.0 |
| Stroke Aggregator | 0.002189997993045936 | distance: 0.00219variant: vectorized (shape strokes) | 15.0 |
| Topology Driven → Stroke Aggregator | 0.00199886843048968 | distance: 0.002variant: thresholded | 56.0 |
| Topology Driven | 0.0009404125721384019 | distance: 0.00094variant: vectorized (shape strokes) 1000px | 4.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2537360890302067 |  distance: 0.25374variant: thresholded 500px | 1.0 |
| Fidelity Simplicity | 0.4209181686476719 |  distance: 0.42092variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 221.0 |
| Mastering Sketching | 0.5490450109486561 |  distance: 0.54905variant: thresholded | 6.0 |
| Poly Vector → Stroke Aggregator | 0.036006846802787616 |  distance: 0.03601variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 5.0 |
| Poly Vector | 0.03774920372773387 |  distance: 0.03775variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 37.0 |
| Real-Time Inking | 0.4372559656725125 |  distance: 0.43726variant: original | 2.0 |
| Stroke Aggregator | 0.4657630591098678 |  distance: 0.46576variant: vectorized (all layers) | 81.0 |
| Topology Driven → Stroke Aggregator | 0.5156822211763173 |  distance: 0.51568variant: vectorized (all layers) 1000px | 73.0 |
| Topology Driven | 0.4809630722147576 |  distance: 0.48096variant: vectorized (all layers) 500px | 2.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3800836672119272 | distance: 0.38008variant: thresholded 500px | 1.0 |
| Fidelity Simplicity | 0.5136517655062339 |  distance: 0.51365variant: thresholded 500pxalg. parameter: 0.75 | 189.0 |
| Mastering Sketching | 0.6781199054305016 |  distance: 0.67812variant: vectorized (all layers) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.06305882352941176 |  distance: 0.06306variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.0618785975928833 |  distance: 0.06188variant: vectorized (shape strokes) 500px | 36.0 |
| Real-Time Inking | 0.5734017464556926 | distance: 0.5734variant: original | 2.0 |
| Stroke Aggregator | 0.6155042408080049 | distance: 0.6155variant: vectorized (all layers) | 81.0 |
| Topology Driven → Stroke Aggregator | 0.6775276959676562 | distance: 0.67753variant: vectorized (all layers) 1000px | 73.0 |
| Topology Driven | 0.6403666721230971 | distance: 0.64037variant: vectorized (all layers) 500px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5358281442744233 | distance: 0.53583variant: thresholded 500px | 1.0 |
| Fidelity Simplicity | 0.5875352558803453 | distance: 0.58754variant: thresholded 500pxalg. parameter: 0.75 | 189.0 |
| Mastering Sketching | 0.7533473282169756 | distance: 0.75335variant: thresholded | 6.0 |
| Poly Vector | 0.07808340727595385 | distance: 0.07808variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 37.0 |
| Real-Time Inking | 0.6293839671121058 | distance: 0.62938variant: original | 2.0 |
| Stroke Aggregator | 0.7113062746791425 | distance: 0.71131variant: vectorized (all layers) | 81.0 |
| Topology Driven → Stroke Aggregator | 0.7503596617796546 | distance: 0.75036variant: vectorized (all layers) 1000px | 73.0 |
| Topology Driven | 0.7413489288323785 | distance: 0.74135variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.07657247037374659 | distance: 0.07657variant: vectorized (shape strokes) 500px | 5.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6030415951686307 | distance: 0.60304variant: thresholded 500px | 1.0 |
| Fidelity Simplicity | 0.6265439322760139 |  distance: 0.62654variant: thresholded 500pxalg. parameter: 0.3 | 161.0 |
| Mastering Sketching | 0.7913296713336171 | distance: 0.79133variant: thresholded | 6.0 |
| Poly Vector | 0.09044193216855087 | distance: 0.09044variant: vectorized (shape strokes) 500px | 36.0 |
| Real-Time Inking | 0.6770769331264639 | distance: 0.67708variant: original | 2.0 |
| Stroke Aggregator | 0.7711726107817032 | distance: 0.77117variant: vectorized (all layers) | 81.0 |
| Topology Driven → Stroke Aggregator | 0.8002940898622307 | distance: 0.80029variant: vectorized (all layers) 1000px | 73.0 |
| Topology Driven | 0.794036587484073 | distance: 0.79404variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.08703535811423391 | distance: 0.08704variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 5.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6749466344904957 | distance: 0.67495variant: thresholded 500px | 1.0 |
| Fidelity Simplicity | 0.6660427039020315 |  distance: 0.66604variant: thresholded 500pxalg. parameter: 0.6 | 189.0 |
| Mastering Sketching | 0.8208183992036542 | distance: 0.82082variant: thresholded | 6.0 |
| Poly Vector | 0.10089429030038982 | distance: 0.10089variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 37.0 |
| Real-Time Inking | 0.7127834193990372 | distance: 0.71278variant: original | 2.0 |
| Stroke Aggregator | 0.8213502209857231 | distance: 0.82135variant: vectorized (all layers) | 81.0 |
| Topology Driven → Stroke Aggregator | 0.8329010919180612 | distance: 0.8329variant: vectorized (all layers) 1000px | 73.0 |
| Topology Driven | 0.8297474335015106 |  distance: 0.82975variant: original | 20.0 |
| Poly Vector → Stroke Aggregator | 0.09738503155996392 | distance: 0.09739variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 5.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.040792154947916666 |  distance: 0.04079variant: original | 3.0 |
| Mastering Sketching | 0.4101219482421875 | distance: 0.41012variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.04 |  distance: 0.04variant: thresholded 500pxalg. parameter: noisy | 20.0 |
| Topology Driven → Stroke Aggregator | 0.04304003397623698 | distance: 0.04304variant: thresholded | 56.0 |
| Poly Vector | 0.00806225776672363 |  distance: 0.00806variant: vectorized (shape strokes) 1000px | 48.0 |
| Stroke Aggregator | 0.021374959309895837 | distance: 0.02137variant: vectorized (shape strokes) | 15.0 |
| Topology Driven | 0.006999999999999999 | distance: 0.007variant: vectorized (shape strokes) 1000px | 4.0 |
| Fidelity Simplicity | 0.04404542922973633 | distance: 0.04405variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 225.0 |
| Real-Time Inking | 0.03036445236206055 | distance: 0.03036variant: thresholded 1000px | 2.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
 |
|
 |
 |
|
|
 |
||
| thresholded | |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| thresholded 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| thresholded 500px |  |
 |
|
 |
 |
|
|
 |
 |
 |
|
|
 |
||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 500px |  |
|
 |
 |
 |
|
 |
|
 |
 |
 |
 |
|||
| vectorized (shape strokes) 1000px |  |
 |
|
 |
 |
 |
|
|
|
|
|||||
| vectorized (shape strokes) 500px |  |
|
 |
 |
 |
 |
 |
 |
|
|
 |
|
|
||
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |