A Benchmark for Rough Sketch Cleanup
Art_logo_VFS_12
Author: VFS Digital Design Author Homepage: https://www.flickr.com/photos/vfsdigitaldesign/ Licence: CC-BY-2.0Messiness: 0.1067
Ambiguity (Chamfer): 0.22811
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Poly Vector → Stroke Aggregator | Mastering Sketching | Poly Vector | Topology Driven | Real-Time Inking | Stroke Aggregator | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00136 |  distance: 0.00138 |  distance: 0.00139 |  distance: 0.00139 |  distance: 0.00201 |  distance: 0.00229 |  distance: 0.00298 |  distance: 0.0041 |  distance: 0.02161 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  | ||||
| Liliya Larsen |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.021609405209688938 | distance: 0.02161variant: vectorized (shape strokes) 500pxalg. parameter: 0.5 | 147.0 |
| Delaunay Triangulation | 0.0029796680323225322 | distance: 0.00298variant: vectorized (all layers) 1000px | 6.0 |
| Stroke Aggregator | 0.002288893969865941 | distance: 0.00229variant: vectorized (all layers) | 389.0 |
| Topology Driven → Stroke Aggregator | 0.004098178222641214 | distance: 0.0041variant: vectorized (all layers) 500px | 224.0 |
| Mastering Sketching | 0.001381419027101226 | distance: 0.00138variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0013617011743521175 | distance: 0.00136variant: vectorized (shape strokes) 1000px | 45.0 |
| Poly Vector | 0.001386804678794217 | distance: 0.00139variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 86.0 |
| Real-Time Inking | 0.0020120080909301207 | distance: 0.00201variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven | 0.0013887105134176964 | distance: 0.00139variant: vectorized (shape strokes) 1000px | 6.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2848212981141455 |  distance: 0.28482variant: thresholded 500px | 2.0 |
| Mastering Sketching | 0.5481978082021254 |  distance: 0.5482variant: vectorized (all layers) 500px | 6.0 |
| Stroke Aggregator | 0.4947187059060853 | distance: 0.49472variant: vectorized (all layers) | 389.0 |
| Fidelity Simplicity | 0.11539026494234406 |  distance: 0.11539variant: thresholded 500pxalg. parameter: 0.3 | 126.0 |
| Poly Vector → Stroke Aggregator | 0.039891245006837724 |  distance: 0.03989variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 5.0 |
| Poly Vector | 0.04497121895908943 |  distance: 0.04497variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 37.0 |
| Real-Time Inking | 0.5435563992834811 |  distance: 0.54356variant: original | 3.0 |
| Topology Driven | 0.4489876673481501 |  distance: 0.44899variant: original | 20.0 |
| Topology Driven → Stroke Aggregator | 0.4516657212127992 | distance: 0.45167variant: vectorized (all layers) 500px | 224.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4201799505440661 |  distance: 0.42018variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.6501188247071736 | distance: 0.65012variant: vectorized (all layers) 500px | 6.0 |
| Stroke Aggregator | 0.6205408250334816 | distance: 0.62054variant: vectorized (all layers) | 389.0 |
| Topology Driven → Stroke Aggregator | 0.5873907784324863 | distance: 0.58739variant: vectorized (all layers) 500px | 224.0 |
| Fidelity Simplicity | 0.14622894168466524 |  distance: 0.14623variant: thresholded 500pxalg. parameter: 0.6 | 163.0 |
| Poly Vector → Stroke Aggregator | 0.051388553334943986 |  distance: 0.05139variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.05799436165928312 | distance: 0.05799variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 37.0 |
| Real-Time Inking | 0.6755692411349222 | distance: 0.67557variant: original | 3.0 |
| Topology Driven | 0.5558369198254554 | distance: 0.55584variant: original | 20.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5367370012524127 | distance: 0.53674variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.7205759238182322 | distance: 0.72058variant: vectorized (all layers) 500px | 6.0 |
| Stroke Aggregator | 0.6915506332165084 | distance: 0.69155variant: vectorized (all layers) | 389.0 |
| Topology Driven → Stroke Aggregator | 0.6889996081016834 | distance: 0.689variant: vectorized (all layers) 500px | 224.0 |
| Fidelity Simplicity | 0.17847287563353442 |  distance: 0.17847variant: thresholded 500pxalg. parameter: 0.75 | 187.0 |
| Poly Vector → Stroke Aggregator | 0.05957172758009983 | distance: 0.05957variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.0679705033664636 |  distance: 0.06797variant: vectorized (shape strokes) 500px | 35.0 |
| Real-Time Inking | 0.7204155853466071 | distance: 0.72042variant: original | 3.0 |
| Topology Driven | 0.6101830813447254 | distance: 0.61018variant: original | 20.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6038747714539926 | distance: 0.60387variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7486294845323502 | distance: 0.74863variant: vectorized (all layers) | 389.0 |
| Fidelity Simplicity | 0.19742713193657804 | distance: 0.19743variant: thresholded 500pxalg. parameter: 0.75 | 187.0 |
| Poly Vector → Stroke Aggregator | 0.06858974358974357 | distance: 0.06859variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 5.0 |
| Poly Vector | 0.07997451011629758 | distance: 0.07997variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 37.0 |
| Real-Time Inking | 0.7698628642072853 | distance: 0.76986variant: original | 3.0 |
| Topology Driven | 0.6631190898648233 | distance: 0.66312variant: original | 20.0 |
| Mastering Sketching | 0.7617519873149091 |  distance: 0.76175variant: thresholded 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.7503975921902793 | distance: 0.7504variant: vectorized (all layers) 500px | 224.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6869803063457329 | distance: 0.68698variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7924079142053502 | distance: 0.79241variant: vectorized (all layers) | 389.0 |
| Fidelity Simplicity | 0.22200285752988544 | distance: 0.222variant: thresholded 500pxalg. parameter: 0.75 | 187.0 |
| Poly Vector → Stroke Aggregator | 0.08850118953211736 | distance: 0.0885variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 5.0 |
| Poly Vector | 0.09875374664773624 | distance: 0.09875variant: vectorized (shape strokes) 500px | 35.0 |
| Real-Time Inking | 0.8097118747645994 | distance: 0.80971variant: original | 3.0 |
| Topology Driven | 0.7134388509472755 | distance: 0.71344variant: original | 20.0 |
| Mastering Sketching | 0.7952392295882399 | distance: 0.79524variant: thresholded 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.8097466677242987 | distance: 0.80975variant: vectorized (all layers) 500px | 224.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.18243183905474614 |  distance: 0.18243variant: originalalg. parameter: 0.75 | 181.0 |
| Topology Driven → Stroke Aggregator | 0.07602631378173827 |  distance: 0.07603variant: thresholded 500px | 136.0 |
| Delaunay Triangulation | 0.03736308288574219 | distance: 0.03736variant: vectorized (all layers) 1000px | 6.0 |
| Mastering Sketching | 0.21577463436536007 |  distance: 0.21577variant: thresholded | 6.0 |
| Stroke Aggregator | 0.03644911721028995 | distance: 0.03645variant: vectorized (all layers) | 389.0 |
| Topology Driven | 0.0325576400756836 |  distance: 0.03256variant: vectorized (all layers) 500px | 4.0 |
| Poly Vector → Stroke Aggregator | 0.03201562118530273 | distance: 0.03202variant: vectorized (shape strokes) 1000px | 45.0 |
| Poly Vector | 0.033526107788085936 |  distance: 0.03353variant: vectorized (shape strokes) 1000px | 80.0 |
| Real-Time Inking | 0.034655445098876955 |  distance: 0.03466variant: vectorized (all layers) 1000px | 2.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
|
 |
|
 |
 |
 |
||||
| thresholded |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| thresholded 500px | |
 |
|
|
 |
 |
|
|
 |
 |
 |
|
 |
||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
 |
 |
|
 |
 |
|
|||
| vectorized (shape strokes) 1000px | |
 |
 |
 |
 |
|
|
|
 |
|
|||||
| vectorized (shape strokes) 500px |  |
|
 |
 |
|
 |
 |
 |
|
|
 |
|
|
||
| vectorized (all layers) | |