A Benchmark for Rough Sketch Cleanup
Ind_fashion_RB_10
Author: Rachel Bake Author Homepage: https://www.flickr.com/photos/rachel_bake/ Licence: CC-BY-NC-2.0Messiness: 0.08278
Ambiguity (Chamfer): 0.07572
Shading: No
Scaffold: No
Texture Strokes: Yes
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Poly Vector → Stroke Aggregator | Poly Vector | Topology Driven | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0009 |  distance: 0.00147 |  distance: 0.00149 |  distance: 0.00151 |  distance: 0.0016 |  distance: 0.00179 |  distance: 0.0019 |  distance: 0.00191 |  distance: 0.0027 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Liliya Larsen |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.001910510244848536 | distance: 0.00191variant: thresholded 1000px | 10.0 |
| Fidelity Simplicity | 0.0018990283681062613 | distance: 0.0019variant: vectorized (all layers) 1000pxalg. parameter: 0.25 | 230.0 |
| Mastering Sketching | 0.0008987340957706597 | distance: 0.0009variant: original | 8.0 |
| Poly Vector → Stroke Aggregator | 0.0014944157359354532 | distance: 0.00149variant: thresholded 1000px | 62.0 |
| Poly Vector | 0.0015099014943903534 | distance: 0.00151variant: thresholded 1000px | 468.0 |
| Real-Time Inking | 0.0014671639927195414 | distance: 0.00147variant: thresholded 1000px | 3.0 |
| Stroke Aggregator | 0.002700686988554548 | distance: 0.0027variant: vectorized (all layers) | 44.0 |
| Topology Driven → Stroke Aggregator | 0.0017924006475865853 | distance: 0.00179variant: thresholded | 107.0 |
| Topology Driven | 0.0015972711069618516 | distance: 0.0016variant: thresholded 1000px | 56.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.10455781895480756 |  distance: 0.10456variant: original | 59.0 |
| Poly Vector → Stroke Aggregator | 0.38331292848564136 |  distance: 0.38331variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector | 0.3882458549874739 |  distance: 0.38825variant: vectorized (all layers) 500px | 31.0 |
| Fidelity Simplicity | 0.3339056421843519 |  distance: 0.33391variant: thresholdedalg. parameter: 0.5 | 240.0 |
| Mastering Sketching | 0.6670815568512557 |  distance: 0.66708variant: thresholded | 8.0 |
| Real-Time Inking | 0.5556981830066269 |  distance: 0.5557variant: original | 2.0 |
| Stroke Aggregator | 0.5020288279739498 | distance: 0.50203variant: vectorized (all layers) | 44.0 |
| Topology Driven → Stroke Aggregator | 0.5680234177405331 | distance: 0.56802variant: thresholded | 107.0 |
| Topology Driven | 0.5385313865637715 |  distance: 0.53853variant: original | 169.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.25095290714545904 | distance: 0.25095variant: original | 59.0 |
| Real-Time Inking | 0.8223842907385023 | distance: 0.82238variant: original | 2.0 |
| Stroke Aggregator | 0.7987096408490741 | distance: 0.79871variant: vectorized (all layers) | 44.0 |
| Topology Driven → Stroke Aggregator | 0.772427351808462 |  distance: 0.77243variant: vectorized (all layers) 500px | 51.0 |
| Topology Driven | 0.7618288539846296 | distance: 0.76183variant: original | 169.0 |
| Fidelity Simplicity | 0.6315899643692694 | distance: 0.63159variant: thresholdedalg. parameter: 0.5 | 240.0 |
| Mastering Sketching | 0.9051104578627284 |  distance: 0.90511variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4968056852359969 | distance: 0.49681variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector | 0.4954475069474357 |  distance: 0.49545variant: vectorized (all layers) 500pxalg. parameter: noisy | 30.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7693585691897181 |  distance: 0.76936variant: thresholded 500pxalg. parameter: 0.75 | 230.0 |
| Real-Time Inking | 0.8989268597618161 | distance: 0.89893variant: original | 2.0 |
| Stroke Aggregator | 0.8841511916130821 | distance: 0.88415variant: vectorized (all layers) | 44.0 |
| Topology Driven → Stroke Aggregator | 0.8584624225287082 | distance: 0.85846variant: vectorized (all layers) 500px | 51.0 |
| Topology Driven | 0.8354123506682402 | distance: 0.83541variant: original | 169.0 |
| Delaunay Triangulation | 0.3781859904488615 | distance: 0.37819variant: original | 59.0 |
| Mastering Sketching | 0.9383349752170124 | distance: 0.93833variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5552105247264638 | distance: 0.55521variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector | 0.5560979668142189 | distance: 0.5561variant: vectorized (all layers) 500px | 31.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8294052628709363 | distance: 0.82941variant: thresholded 500pxalg. parameter: 0.75 | 230.0 |
| Stroke Aggregator | 0.9217680375264251 | distance: 0.92177variant: vectorized (all layers) | 44.0 |
| Topology Driven → Stroke Aggregator | 0.9126110542199128 | distance: 0.91261variant: vectorized (all layers) 500px | 51.0 |
| Topology Driven | 0.8727227861260519 | distance: 0.87272variant: original | 169.0 |
| Poly Vector → Stroke Aggregator | 0.5872732616092177 | distance: 0.58727variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector | 0.5876970442696279 | distance: 0.5877variant: vectorized (all layers) 500px | 31.0 |
| Delaunay Triangulation | 0.4717254791382891 | distance: 0.47173variant: original | 59.0 |
| Mastering Sketching | 0.9490714911931141 | distance: 0.94907variant: vectorized (all layers) 500px | 6.0 |
| Real-Time Inking | 0.9246476717854796 |  distance: 0.92465variant: vectorized (all layers) 500px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8741430514839724 | distance: 0.87414variant: thresholded 500pxalg. parameter: 0.75 | 230.0 |
| Real-Time Inking | 0.9400817266396212 | distance: 0.94008variant: original | 2.0 |
| Stroke Aggregator | 0.9410738248303552 | distance: 0.94107variant: vectorized (all layers) | 44.0 |
| Topology Driven → Stroke Aggregator | 0.9482098293072369 | distance: 0.94821variant: vectorized (all layers) 500px | 51.0 |
| Topology Driven | 0.9015125448454344 | distance: 0.90151variant: original | 169.0 |
| Delaunay Triangulation | 0.5505703463778132 | distance: 0.55057variant: original | 59.0 |
| Mastering Sketching | 0.9574636306135358 | distance: 0.95746variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6166200723128527 | distance: 0.61662variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector | 0.6166490750674506 | distance: 0.61665variant: vectorized (all layers) 500pxalg. parameter: noisy | 30.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.022834449332804933 | distance: 0.02283variant: original | 8.0 |
| Fidelity Simplicity | 0.034928497314453126 | distance: 0.03493variant: thresholded 500pxalg. parameter: 0.75 | 230.0 |
| Poly Vector → Stroke Aggregator | 0.01923538398742676 | distance: 0.01924variant: thresholded 1000px | 62.0 |
| Poly Vector | 0.01923538398742676 |  distance: 0.01924variant: thresholded 1000pxalg. parameter: noisy | 454.0 |
| Stroke Aggregator | 0.036088382979640406 | distance: 0.03609variant: vectorized (all layers) | 44.0 |
| Topology Driven | 0.01897366523742676 |  distance: 0.01897variant: thresholded 500px | 12.0 |
| Delaunay Triangulation | 0.023259407043457032 | distance: 0.02326variant: thresholded 1000px | 10.0 |
| Real-Time Inking | 0.01829924650161464 |  distance: 0.0183variant: thresholded | 2.0 |
| Topology Driven → Stroke Aggregator | 0.02583423035522067 | distance: 0.02583variant: thresholded | 107.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
 |
 |
|
 |
||||||||
| thresholded | |
|
|
 |
 |
|
 |
 |
 |
 |
 |
 |
 |
||
| thresholded 1000px | |
 |
 |
 |
 |
 |
|
|
|
|
|
||||
| thresholded 500px |  |
 |
 |
 |
 |
|
 |
|
 |
 |
 |
 |
 |
||
| vectorized (all layers) 1000px |  |
 |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
 |
 |
 |
|
|
 |
|
||
| vectorized (all layers) | |