A Benchmark for Rough Sketch Cleanup
Ind_product_GW_09
Author: Graham Wilson Licence: CC-BY-4.0Messiness: 0.05801
Ambiguity (Chamfer): 0.13458
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Poly Vector | Topology Driven | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00137 |  distance: 0.0014 |  distance: 0.00148 |  distance: 0.00159 |  distance: 0.00163 |  distance: 0.00178 |  distance: 0.0019 |  distance: 0.00198 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Liliya Larsen |  | |  | ||||
| Maria Hegedus |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.001978573005053323 | distance: 0.00198variant: vectorized (shape strokes) 1000px | 5.0 |
| Mastering Sketching | 0.0016287545620261544 | distance: 0.00163variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.001901186007351252 | distance: 0.0019variant: vectorized (all layers) 1000pxalg. parameter: noisy | 165.0 |
| Poly Vector | 0.001370174076475568 | distance: 0.00137variant: vectorized (shape strokes) 1000px | 88.0 |
| Real-Time Inking | 0.0015947466359893748 | distance: 0.00159variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.0014827733611298074 | distance: 0.00148variant: vectorized (shape strokes) 1000px | 605.0 |
| Topology Driven | 0.0013990341365571351 | distance: 0.0014variant: vectorized (shape strokes) 1000px | 14.0 |
| Fidelity Simplicity | 0.00178194575722258 | distance: 0.00178variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 232.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3745342406141498 |  distance: 0.37453variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.22256514105457426 |  distance: 0.22257variant: originalalg. parameter: 0.75 | 372.0 |
| Mastering Sketching | 0.6892548386180204 |  distance: 0.68925variant: thresholded 500px | 12.0 |
| Poly Vector → Stroke Aggregator | 0.4659837195833048 |  distance: 0.46598variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 13.0 |
| Poly Vector | 0.4731019747865342 |  distance: 0.4731variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 57.0 |
| Real-Time Inking | 0.5963853674882584 |  distance: 0.59639variant: thresholded | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5188054594596866 |  distance: 0.51881variant: thresholded 500px | 133.0 |
| Topology Driven | 0.666424052816406 |  distance: 0.66642variant: thresholded | 65.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5693731895135797 | distance: 0.56937variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.3568753361507915 |  distance: 0.35688variant: originalalg. parameter: 0.3 | 295.0 |
| Mastering Sketching | 0.8536642105414348 |  distance: 0.85366variant: vectorized (all layers) 500px | 6.0 |
| Real-Time Inking | 0.7983318925075381 | distance: 0.79833variant: thresholded | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7277695978210702 | distance: 0.72777variant: thresholded 500px | 133.0 |
| Topology Driven | 0.8432907470719899 |  distance: 0.84329variant: thresholded 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.532396191131325 | distance: 0.5324variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 13.0 |
| Poly Vector | 0.5407724527451143 | distance: 0.54077variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 57.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6935870139034273 | distance: 0.69359variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.5082541435355611 | distance: 0.50825variant: originalalg. parameter: 0.75 | 372.0 |
| Mastering Sketching | 0.9158456390252896 | distance: 0.91585variant: thresholded 500px | 12.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8666572856957009 | distance: 0.86666variant: thresholded 500px | 133.0 |
| Topology Driven | 0.9198310316046072 | distance: 0.91983variant: thresholded 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.5850127222438405 | distance: 0.58501variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 13.0 |
| Poly Vector | 0.5919161371436338 | distance: 0.59192variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 57.0 |
| Real-Time Inking | 0.8474290731509961 |  distance: 0.84743variant: vectorized (all layers) 500px | 2.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7596019730853667 | distance: 0.7596variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.6048525423276029 | distance: 0.60485variant: originalalg. parameter: 0.75 | 372.0 |
| Mastering Sketching | 0.9337000880514262 | distance: 0.9337variant: thresholded 500px | 12.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9176210613395082 | distance: 0.91762variant: thresholded 500px | 133.0 |
| Topology Driven | 0.9387927447081148 | distance: 0.93879variant: thresholded 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.6215941050169853 | distance: 0.62159variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 13.0 |
| Poly Vector | 0.6285646462422941 |  distance: 0.62856variant: vectorized (shape strokes) 500px | 50.0 |
| Real-Time Inking | 0.8622780622315348 | distance: 0.86228variant: vectorized (all layers) 500px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8092819508328849 | distance: 0.80928variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.6529045459482222 | distance: 0.6529variant: originalalg. parameter: 0.75 | 372.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.947359017853874 | distance: 0.94736variant: thresholded 500px | 133.0 |
| Topology Driven | 0.9561527116334836 | distance: 0.95615variant: thresholded 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.6650923850312093 | distance: 0.66509variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 13.0 |
| Poly Vector | 0.6710755907629412 | distance: 0.67108variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 57.0 |
| Mastering Sketching | 0.9549071618037136 | distance: 0.95491variant: thresholded 500px | 12.0 |
| Real-Time Inking | 0.8753647709782281 | distance: 0.87536variant: vectorized (all layers) 500px | 2.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.034574468085106384 |  distance: 0.03457variant: thresholded | 32.0 |
| Mastering Sketching | 0.2887213134765625 | distance: 0.28872variant: vectorized (shape strokes) 500px | 5.0 |
| Real-Time Inking | 0.032 |  distance: 0.032variant: thresholded 500px | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.027138737922019148 | distance: 0.02714variant: thresholded | 65.0 |
| Poly Vector → Stroke Aggregator | 0.02353720474243164 | distance: 0.02354variant: vectorized (all layers) 1000pxalg. parameter: noisy | 165.0 |
| Poly Vector | 0.02353720474243164 | distance: 0.02354variant: vectorized (shape strokes) 1000px | 88.0 |
| Topology Driven → Stroke Aggregator | 0.029732137680053713 |  distance: 0.02973variant: vectorized (shape strokes) 500px | 87.0 |
| Fidelity Simplicity | 0.01897366523742676 |  distance: 0.01897variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 209.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
|
|
 |
 |
|
 |
 |
 |
 |
 |
||||
| thresholded | |
 |
 |
 |
 |
 |
|
 |
 |
|
 |
||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| thresholded 500px | |
|
|
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
||||
| vectorized (all layers) 500px |  |
|
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| vectorized (shape strokes) 1000px | |
 |
 |
|
 |
 |
 |
|
 |
|
|
||||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
|
 |
 |
|
|
|
|