A Benchmark for Rough Sketch Cleanup
Ind_product_AS_03
Author: Akshay Sharma Licence: CC-BY-SAMessiness: 0.19035
Ambiguity (Chamfer): 0.09083
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Mastering Sketching | Poly Vector | Topology Driven | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00173 |  distance: 0.00188 |  distance: 0.00196 |  distance: 0.00198 |  distance: 0.00279 |  distance: 0.00283 |  distance: 0.00302 |  distance: 0.00372 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Liliya Larsen |  | |  | ||||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.003718154707766771 | distance: 0.00372variant: vectorized (shape strokes) 1000px | 11.0 |
| Fidelity Simplicity | 0.0027850381544979523 | distance: 0.00279variant: vectorized (shape strokes) 1000pxalg. parameter: 0.75 | 254.0 |
| Mastering Sketching | 0.001881830095738533 | distance: 0.00188variant: vectorized (shape strokes) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0028321092858858057 | distance: 0.00283variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 508.0 |
| Poly Vector | 0.001963049176793693 | distance: 0.00196variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 184.0 |
| Real-Time Inking | 0.0017325188596155074 | distance: 0.00173variant: thresholded 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.0030179736866224305 | distance: 0.00302variant: vectorized (shape strokes) 500px | 303.0 |
| Topology Driven | 0.001982217595626448 | distance: 0.00198variant: vectorized (shape strokes) 1000px | 18.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.2869591268549941 |  distance: 0.28696variant: vectorized (shape strokes) 500px | 3.0 |
| Fidelity Simplicity | 0.3603271838815906 |  distance: 0.36033variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 149.0 |
| Mastering Sketching | 0.6230071634396009 |  distance: 0.62301variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.4515601475288831 |  distance: 0.45156variant: vectorized (all layers) 500pxalg. parameter: noisy | 42.0 |
| Poly Vector | 0.4620855981602828 |  distance: 0.46209variant: vectorized (all layers) 500px | 106.0 |
| Real-Time Inking | 0.6643807708559302 |  distance: 0.66438variant: original | 4.0 |
| Topology Driven → Stroke Aggregator | 0.5242346561100548 |  distance: 0.52423variant: vectorized (all layers) 500px | 632.0 |
| Topology Driven | 0.5871393822551491 |  distance: 0.58714variant: thresholded | 706.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.5360992881206919 |  distance: 0.5361variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 219.0 |
| Real-Time Inking | 0.7882999082480092 |  distance: 0.7883variant: vectorized (all layers) 500px | 2.0 |
| Delaunay Triangulation | 0.4662605770832233 | distance: 0.46626variant: vectorized (shape strokes) 500px | 3.0 |
| Mastering Sketching | 0.7411864420663407 | distance: 0.74119variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.566621921168141 |  distance: 0.56662variant: vectorized (all layers) 500px | 42.0 |
| Poly Vector | 0.5749964241515911 |  distance: 0.575variant: vectorized (shape strokes) 500px | 55.0 |
| Topology Driven → Stroke Aggregator | 0.6821200812152237 | distance: 0.68212variant: vectorized (all layers) 500px | 632.0 |
| Topology Driven | 0.7303011926643509 | distance: 0.7303variant: thresholded | 706.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.6630141065157227 |  distance: 0.66301variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 164.0 |
| Real-Time Inking | 0.8476253784925855 | distance: 0.84763variant: vectorized (all layers) 500px | 2.0 |
| Delaunay Triangulation | 0.6108104204974371 | distance: 0.61081variant: vectorized (shape strokes) 500px | 3.0 |
| Mastering Sketching | 0.8079200736027783 | distance: 0.80792variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.6410747281627996 |  distance: 0.64107variant: vectorized (shape strokes) 500px | 26.0 |
| Poly Vector | 0.6523856324352539 | distance: 0.65239variant: vectorized (shape strokes) 500px | 55.0 |
| Topology Driven → Stroke Aggregator | 0.7822219389337446 | distance: 0.78222variant: vectorized (all layers) 500px | 632.0 |
| Topology Driven | 0.8082476889849818 |  distance: 0.80825variant: thresholded 500px | 23.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.7005680968250867 | distance: 0.70057variant: vectorized (shape strokes) 500px | 3.0 |
| Fidelity Simplicity | 0.7524201737125992 | distance: 0.75242variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 164.0 |
| Mastering Sketching | 0.8476839441841822 | distance: 0.84768variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.6879061629650788 | distance: 0.68791variant: vectorized (shape strokes) 500px | 26.0 |
| Poly Vector | 0.7003101383701456 | distance: 0.70031variant: vectorized (shape strokes) 500px | 55.0 |
| Real-Time Inking | 0.8861318188548373 | distance: 0.88613variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.8315388412011563 | distance: 0.83154variant: vectorized (all layers) 500px | 632.0 |
| Topology Driven | 0.8460838885755729 |  distance: 0.84608variant: vectorized (all layers) 500px | 12.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.815860129683589 |  distance: 0.81586variant: vectorized (all layers) 500pxalg. parameter: 0.3 | 153.0 |
| Delaunay Triangulation | 0.7854723574141408 | distance: 0.78547variant: vectorized (shape strokes) 500px | 3.0 |
| Mastering Sketching | 0.8823064866900749 | distance: 0.88231variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.7387056453350871 | distance: 0.73871variant: vectorized (shape strokes) 500px | 26.0 |
| Poly Vector | 0.7526403024061483 | distance: 0.75264variant: vectorized (shape strokes) 500px | 55.0 |
| Real-Time Inking | 0.911432754543576 | distance: 0.91143variant: original | 4.0 |
| Topology Driven → Stroke Aggregator | 0.8743563299399805 | distance: 0.87436variant: vectorized (all layers) 500px | 632.0 |
| Topology Driven | 0.8820792470070545 | distance: 0.88208variant: vectorized (all layers) 500px | 12.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.2080865173339844 |  distance: 0.20809variant: thresholded 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.028844409942626957 |  distance: 0.02884variant: vectorized (shape strokes) 1000px | 503.0 |
| Poly Vector | 0.028178005218505855 |  distance: 0.02818variant: thresholded 1000px | 1188.0 |
| Real-Time Inking | 0.024596748352050786 | distance: 0.0246variant: thresholded 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.027658634185791016 | distance: 0.02766variant: vectorized (shape strokes) 1000px | 18.0 |
| Delaunay Triangulation | 0.03275667953491211 | distance: 0.03276variant: vectorized (shape strokes) 1000px | 11.0 |
| Topology Driven → Stroke Aggregator | 0.027999999999999997 | distance: 0.028variant: vectorized (shape strokes) 500px | 303.0 |
| Fidelity Simplicity | 0.11866339111328125 |  distance: 0.11866variant: thresholded 1000pxalg. parameter: 0.3 | 185.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
||||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded 1000px | |
 |
|
 |
 |
 |
 |
 |
 |
|
 |
||||
| thresholded 500px |  |
 |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||
| vectorized (all layers) 500px | |
|
 |
|
|
 |
|
|
|
 |
|
 |
|
|
|
| vectorized (shape strokes) 1000px |  |
|
 |
 |
 |
|
 |
|
|
 |
|
|
|
||
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
 |
|