A Benchmark for Rough Sketch Cleanup
Ind_fashion_RB_05
Author: Rachel Bake Author Homepage: https://www.flickr.com/photos/rachel_bake/ Licence: CC-BY-NC-2.0Messiness: 0.30471
Ambiguity (Chamfer): 0.16219
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Real-Time Inking | Stroke Aggregator | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0024 |  distance: 0.00249 |  distance: 0.00251 |  distance: 0.00285 |  distance: 0.0029 |  distance: 0.00309 |  distance: 0.00336 |  distance: 0.00512 |  distance: 0.00513 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.005126450177082315 | distance: 0.00513variant: vectorized (shape strokes) 500pxalg. parameter: 0.25 | 151.0 |
| Delaunay Triangulation | 0.003361095567098167 | distance: 0.00336variant: vectorized (shape strokes) 1000px | 4.0 |
| Mastering Sketching | 0.002403661404679589 | distance: 0.0024variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0030905550420198733 | distance: 0.00309variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 414.0 |
| Poly Vector | 0.0025118006314148052 | distance: 0.00251variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 145.0 |
| Real-Time Inking | 0.002853202820123245 | distance: 0.00285variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.0028963018346392392 | distance: 0.0029variant: vectorized (shape strokes) | 333.0 |
| Topology Driven → Stroke Aggregator | 0.005123564359644025 | distance: 0.00512variant: thresholded 500px | 1154.0 |
| Topology Driven | 0.0024933523391338203 | distance: 0.00249variant: vectorized (shape strokes) 1000px | 18.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.22476957991755825 |  distance: 0.22477variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.12718265412947222 |  distance: 0.12718variant: originalalg. parameter: 0.75 | 1560.0 |
| Mastering Sketching | 0.4683965082746884 |  distance: 0.4684variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4306934346931926 |  distance: 0.43069variant: vectorized (all layers) 1000pxalg. parameter: noisy | 1287.0 |
| Poly Vector | 0.4620531576669128 |  distance: 0.46205variant: vectorized (all layers) 500px | 104.0 |
| Real-Time Inking | 0.5096024989688199 |  distance: 0.5096variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.5509764151384786 | distance: 0.55098variant: vectorized (shape strokes) | 333.0 |
| Topology Driven → Stroke Aggregator | 0.4905022645846008 | distance: 0.4905variant: thresholded 500px | 1154.0 |
| Topology Driven | 0.3615986766336095 |  distance: 0.3616variant: original | 414.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.581000312123318 | distance: 0.581variant: vectorized (all layers) 500px | 104.0 |
| Delaunay Triangulation | 0.3643335675315851 | distance: 0.36433variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.2160195596920786 |  distance: 0.21602variant: originalalg. parameter: 0.6 | 1411.0 |
| Mastering Sketching | 0.5830867043359689 |  distance: 0.58309variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.5485561444267363 | distance: 0.54856variant: vectorized (all layers) 1000pxalg. parameter: noisy | 1287.0 |
| Real-Time Inking | 0.6272424543783239 | distance: 0.62724variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7182791555491806 | distance: 0.71828variant: vectorized (shape strokes) | 333.0 |
| Topology Driven → Stroke Aggregator | 0.6370139519277149 | distance: 0.63701variant: thresholded 500px | 1154.0 |
| Topology Driven | 0.4678775572746334 | distance: 0.46788variant: original | 414.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.6486180386660619 | distance: 0.64862variant: vectorized (all layers) 500px | 104.0 |
| Delaunay Triangulation | 0.4970766303407715 | distance: 0.49708variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.2954223259621285 | distance: 0.29542variant: originalalg. parameter: 0.75 | 1560.0 |
| Mastering Sketching | 0.6496607706095332 | distance: 0.64966variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.6159425973664623 |  distance: 0.61594variant: vectorized (all layers) 1000px | 1290.0 |
| Real-Time Inking | 0.6961541478417809 | distance: 0.69615variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7956849155440501 | distance: 0.79568variant: vectorized (shape strokes) | 333.0 |
| Topology Driven → Stroke Aggregator | 0.7294485711196987 | distance: 0.72945variant: thresholded 500px | 1154.0 |
| Topology Driven | 0.548118996710234 | distance: 0.54812variant: original | 414.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5764059451548926 | distance: 0.57641variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.3617382332646221 |  distance: 0.36174variant: originalalg. parameter: 0.5 | 1417.0 |
| Mastering Sketching | 0.6999222684105579 | distance: 0.69992variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.6680177512070148 | distance: 0.66802variant: vectorized (all layers) 1000pxalg. parameter: noisy | 1287.0 |
| Real-Time Inking | 0.7442722474789157 | distance: 0.74427variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8403812929873793 | distance: 0.84038variant: vectorized (shape strokes) | 333.0 |
| Topology Driven → Stroke Aggregator | 0.779412098929256 | distance: 0.77941variant: thresholded 500px | 1154.0 |
| Poly Vector | 0.693612827367125 |  distance: 0.69361variant: vectorized (shape strokes) 500px | 61.0 |
| Topology Driven | 0.6127562255521601 | distance: 0.61276variant: original | 414.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Topology Driven → Stroke Aggregator | 0.8263675699268266 | distance: 0.82637variant: thresholded 500px | 1154.0 |
| Fidelity Simplicity | 0.41710370349219694 | distance: 0.4171variant: originalalg. parameter: 0.5 | 1417.0 |
| Mastering Sketching | 0.7478272191660428 | distance: 0.74783variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.7241370838963272 | distance: 0.72414variant: vectorized (all layers) 1000px | 1290.0 |
| Real-Time Inking | 0.7915389061496244 | distance: 0.79154variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8755364814944718 | distance: 0.87554variant: vectorized (shape strokes) | 333.0 |
| Delaunay Triangulation | 0.6398707458720423 |  distance: 0.63987variant: vectorized (shape strokes) 500px | 1.0 |
| Poly Vector | 0.7288969049570364 | distance: 0.7289variant: vectorized (shape strokes) 500px | 61.0 |
| Topology Driven | 0.6646412544385036 | distance: 0.66464variant: original | 414.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.04494440841674805 |  distance: 0.04494variant: thresholded 500px | 3.0 |
| Fidelity Simplicity | 0.06135144805908204 |  distance: 0.06135variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 142.0 |
| Mastering Sketching | 0.16786900329589846 |  distance: 0.16787variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.045343135833740236 | distance: 0.04534variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 414.0 |
| Poly Vector | 0.04604345703125 |  distance: 0.04604variant: vectorized (shape strokes) 1000px | 151.0 |
| Real-Time Inking | 0.04604345703125 |  distance: 0.04604variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | 0.045123090468646286 | distance: 0.04512variant: vectorized (shape strokes) | 333.0 |
| Topology Driven → Stroke Aggregator | 0.054000000000000006 | distance: 0.054variant: thresholded 500px | 1154.0 |
| Topology Driven | 0.046 | distance: 0.046variant: vectorized (shape strokes) 1000px | 18.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
|
|
|
|
 |
|||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
||||||
| thresholded 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
|
|
|||||||
| vectorized (all layers) 500px | |
|
 |
 |
|
 |
 |
 |
 |
|
|
||||
| vectorized (shape strokes) 1000px | |
|
 |
 |
 |
 |
 |
|
|
|
|
|
 |
||
| vectorized (shape strokes) 500px | |
|
 |
|
 |
 |
 |
 |
 |
|
|
||||
| vectorized (shape strokes) | |