A Benchmark for Rough Sketch Cleanup
Ind_fashion_RB_18
Author: Rachel Bake Author Homepage: https://www.flickr.com/photos/rachel_bake/ Licence: CC-BY-NC-2.0Messiness: 0.08233
Ambiguity (Chamfer): 0.22606
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Fidelity Simplicity | Topology Driven | Poly Vector | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00184 |  distance: 0.00197 |  distance: 0.00204 |  distance: 0.00216 |  distance: 0.00232 |  distance: 0.00244 |  distance: 0.00318 |  distance: 0.00337 |  distance: 0.00418 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  |  | |||
| Liliya Larsen |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0031800743660670657 | distance: 0.00318variant: vectorized (shape strokes) 1000px | 3.0 |
| Mastering Sketching | 0.0018424458381980113 | distance: 0.00184variant: vectorized (shape strokes) 500px | 6.0 |
| Real-Time Inking | 0.0019704620154097387 | distance: 0.00197variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.0041783738931379395 | distance: 0.00418variant: vectorized (shape strokes) | 64.0 |
| Fidelity Simplicity | 0.002040779738799092 | distance: 0.00204variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 191.0 |
| Poly Vector → Stroke Aggregator | 0.002444905580755963 | distance: 0.00244variant: thresholded 500px | 74.0 |
| Poly Vector | 0.002316546831870713 | distance: 0.00232variant: thresholded 500pxalg. parameter: noisy | 256.0 |
| Topology Driven → Stroke Aggregator | 0.003373214718000627 | distance: 0.00337variant: thresholded 500px | 339.0 |
| Topology Driven | 0.0021625436685531532 | distance: 0.00216variant: thresholded | 24.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.01850709438618137 |  distance: 0.01851variant: original | 33.0 |
| Fidelity Simplicity | 0.03526300323244196 |  distance: 0.03526variant: thresholdedalg. parameter: 0.25 | 160.0 |
| Mastering Sketching | 0.3519633618861843 |  distance: 0.35196variant: thresholded | 5.0 |
| Poly Vector → Stroke Aggregator | 0.24123965486881496 |  distance: 0.24124variant: originalalg. parameter: noisy | 70.0 |
| Topology Driven | 0.2955903271692745 | distance: 0.29559variant: thresholded | 24.0 |
| Poly Vector | 0.15811315241648205 |  distance: 0.15811variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 38.0 |
| Real-Time Inking | 0.20958279009126465 |  distance: 0.20958variant: original | 2.0 |
| Stroke Aggregator | 0.16868896123113347 |  distance: 0.16869variant: vectorized (all layers) | 632.0 |
| Topology Driven → Stroke Aggregator | 0.08009478672985781 |  distance: 0.08009variant: thresholded | 431.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.07340944143858208 | distance: 0.07341variant: original | 33.0 |
| Mastering Sketching | 0.7275663996490774 |  distance: 0.72757variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6588081260653877 | distance: 0.65881variant: originalalg. parameter: noisy | 70.0 |
| Fidelity Simplicity | 0.15811603535950736 |  distance: 0.15812variant: thresholdedalg. parameter: 0.6 | 187.0 |
| Poly Vector | 0.20925176855501573 | distance: 0.20925variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 38.0 |
| Real-Time Inking | 0.5817536728832692 | distance: 0.58175variant: original | 2.0 |
| Stroke Aggregator | 0.5809943610049338 | distance: 0.58099variant: vectorized (all layers) | 632.0 |
| Topology Driven → Stroke Aggregator | 0.3115969650860256 | distance: 0.3116variant: thresholded | 431.0 |
| Topology Driven | 0.4884438690686263 |  distance: 0.48844variant: vectorized (shape strokes) 500px | 3.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.11506184023452735 | distance: 0.11506variant: original | 33.0 |
| Fidelity Simplicity | 0.2442716682239386 |  distance: 0.24427variant: thresholdedalg. parameter: 0.75 | 219.0 |
| Mastering Sketching | 0.7782326243659339 | distance: 0.77823variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.7695649237125866 | distance: 0.76956variant: originalalg. parameter: noisy | 70.0 |
| Poly Vector | 0.2591316156090476 |  distance: 0.25913variant: vectorized (shape strokes) 500px | 41.0 |
| Real-Time Inking | 0.7178614990334111 | distance: 0.71786variant: original | 2.0 |
| Stroke Aggregator | 0.7203542659329393 | distance: 0.72035variant: vectorized (shape strokes) | 64.0 |
| Topology Driven → Stroke Aggregator | 0.4524690557561104 | distance: 0.45247variant: thresholded | 431.0 |
| Topology Driven | 0.5694798897107646 | distance: 0.56948variant: vectorized (shape strokes) 500px | 3.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.1531731105616954 | distance: 0.15317variant: original | 33.0 |
| Fidelity Simplicity | 0.2849819933797033 |  distance: 0.28498variant: thresholded 500pxalg. parameter: 0.5 | 1410.0 |
| Mastering Sketching | 0.8021115085943635 | distance: 0.80211variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8279414961942344 | distance: 0.82794variant: originalalg. parameter: noisy | 70.0 |
| Poly Vector | 0.29908106511583404 | distance: 0.29908variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 38.0 |
| Real-Time Inking | 0.7942213596368966 | distance: 0.79422variant: original | 2.0 |
| Stroke Aggregator | 0.7728503344601579 | distance: 0.77285variant: vectorized (shape strokes) | 64.0 |
| Topology Driven → Stroke Aggregator | 0.540087271122541 | distance: 0.54009variant: thresholded | 431.0 |
| Topology Driven | 0.6213122786816383 | distance: 0.62131variant: vectorized (shape strokes) 500px | 3.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.8569970309860413 | distance: 0.857variant: originalalg. parameter: noisy | 70.0 |
| Delaunay Triangulation | 0.1967785376003422 | distance: 0.19678variant: original | 33.0 |
| Fidelity Simplicity | 0.3597902251994182 | distance: 0.35979variant: thresholdedalg. parameter: 0.75 | 219.0 |
| Mastering Sketching | 0.8285336405136738 | distance: 0.82853variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector | 0.3379175122641101 | distance: 0.33792variant: vectorized (shape strokes) 500px | 41.0 |
| Real-Time Inking | 0.8304519466376259 |  distance: 0.83045variant: thresholded | 2.0 |
| Stroke Aggregator | 0.8084522160786934 | distance: 0.80845variant: vectorized (shape strokes) | 64.0 |
| Topology Driven → Stroke Aggregator | 0.6033349316969936 | distance: 0.60333variant: thresholded | 431.0 |
| Topology Driven | 0.6722950058002929 | distance: 0.6723variant: vectorized (shape strokes) 500px | 3.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.06551335906982422 |  distance: 0.06551variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.04341658782958984 |  distance: 0.04342variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 193.0 |
| Real-Time Inking | 0.02948443325245438 | distance: 0.02948variant: thresholded | 2.0 |
| Stroke Aggregator | 0.04956107208694237 | distance: 0.04956variant: vectorized (shape strokes) | 64.0 |
| Mastering Sketching | 0.03819175849214268 |  distance: 0.03819variant: original | 5.0 |
| Poly Vector → Stroke Aggregator | 0.028985507246376805 | distance: 0.02899variant: originalalg. parameter: noisy | 70.0 |
| Poly Vector | 0.028985507246376805 |  distance: 0.02899variant: original | 231.0 |
| Topology Driven → Stroke Aggregator | 0.03 | distance: 0.03variant: thresholded 500px | 339.0 |
| Topology Driven | 0.03 |  distance: 0.03variant: thresholded 500px | 44.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
|
|
|
|||||||||
| thresholded | |
|
|
 |
|
 |
|
|
|
 |
 |
 |
 |
 |
|
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 500px | |
 |
 |
 |
 |
|
 |
 |
|
|
 |
 |
 |
|
|
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| vectorized (all layers) 500px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
||||
| vectorized (shape strokes) 1000px | |
|
|
 |
 |
 |
 |
 |
 |
|
|||||
| vectorized (shape strokes) 500px |  |
|
 |
 |
 |
 |
 |
|
|
|
 |
||||
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |