A Benchmark for Rough Sketch Cleanup
Ind_product_PM_25
Author: Patrick Murphy Author Homepage: https://www.flickr.com/photos/pmurf/ Licence: CC-BY-2.0Messiness: 0.19426
Ambiguity (Chamfer): 0.09464
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Poly Vector → Stroke Aggregator | Stroke Aggregator | Topology Driven → Stroke Aggregator | Real-Time Inking | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00156 |  distance: 0.00166 |  distance: 0.00166 |  distance: 0.00193 |  distance: 0.00193 |  distance: 0.00194 |  distance: 0.00212 |  distance: 0.00241 |  distance: 0.00314 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.002406232356609443 | distance: 0.00241variant: vectorized (shape strokes) 1000px | 6.0 |
| Fidelity Simplicity | 0.003137790973956621 | distance: 0.00314variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 137.0 |
| Mastering Sketching | 0.0015609468224847315 | distance: 0.00156variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0019288990975928745 | distance: 0.00193variant: vectorized (shape strokes) 1000px | 463.0 |
| Poly Vector | 0.0016630624740241757 | distance: 0.00166variant: vectorized (shape strokes) 1000px | 179.0 |
| Real-Time Inking | 0.0021204555465030293 | distance: 0.00212variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.001932241271425452 | distance: 0.00193variant: vectorized (shape strokes) | 1273.0 |
| Topology Driven → Stroke Aggregator | 0.001936683116167281 | distance: 0.00194variant: vectorized (shape strokes) 1000px | 959.0 |
| Topology Driven | 0.0016622471305819432 | distance: 0.00166variant: vectorized (shape strokes) 1000px | 18.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.309952878776618 |  distance: 0.30995variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.3326144404921293 |  distance: 0.33261variant: thresholded 500pxalg. parameter: 0.75 | 134.0 |
| Mastering Sketching | 0.5938966348842383 |  distance: 0.5939variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4122589614942876 |  distance: 0.41226variant: vectorized (all layers) 500pxalg. parameter: noisy | 35.0 |
| Poly Vector | 0.4519810054174378 |  distance: 0.45198variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 89.0 |
| Real-Time Inking | 0.6031134906697613 |  distance: 0.60311variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.6185795839582723 | distance: 0.61858variant: vectorized (shape strokes) | 1273.0 |
| Topology Driven → Stroke Aggregator | 0.42406707074953465 |  distance: 0.42407variant: thresholded 500px | 1306.0 |
| Topology Driven | 0.525951182070724 |  distance: 0.52595variant: thresholded 500px | 48.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4748537178655428 | distance: 0.47485variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.4662983327572309 | distance: 0.4663variant: thresholded 500pxalg. parameter: 0.75 | 134.0 |
| Mastering Sketching | 0.7334138729041094 |  distance: 0.73341variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.5660715418133797 | distance: 0.56607variant: vectorized (all layers) 500pxalg. parameter: noisy | 35.0 |
| Poly Vector | 0.5952817889157461 | distance: 0.59528variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 89.0 |
| Real-Time Inking | 0.7565331210181153 |  distance: 0.75653variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7975151253014723 | distance: 0.79752variant: vectorized (shape strokes) | 1273.0 |
| Topology Driven → Stroke Aggregator | 0.5842203778454359 | distance: 0.58422variant: thresholded 500px | 1306.0 |
| Topology Driven | 0.674494124749229 | distance: 0.67449variant: thresholded 500px | 48.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6049648590230596 | distance: 0.60496variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.5779126769793524 | distance: 0.57791variant: thresholded 500pxalg. parameter: 0.75 | 134.0 |
| Mastering Sketching | 0.8176432307187013 | distance: 0.81764variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.6591388636037917 | distance: 0.65914variant: vectorized (all layers) 500pxalg. parameter: noisy | 35.0 |
| Poly Vector | 0.6766765281350204 |  distance: 0.67668variant: vectorized (shape strokes) 500px | 90.0 |
| Real-Time Inking | 0.8325624144554887 | distance: 0.83256variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8836817629832842 | distance: 0.88368variant: vectorized (shape strokes) | 1273.0 |
| Topology Driven → Stroke Aggregator | 0.7028059850894115 | distance: 0.70281variant: thresholded 500px | 1306.0 |
| Topology Driven | 0.7774454388514945 | distance: 0.77745variant: thresholded 500px | 48.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6908670566747429 | distance: 0.69087variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.6631375213094581 |  distance: 0.66314variant: thresholded 500pxalg. parameter: 0.6 | 123.0 |
| Poly Vector → Stroke Aggregator | 0.7232204070632209 | distance: 0.72322variant: vectorized (all layers) 500pxalg. parameter: noisy | 35.0 |
| Poly Vector | 0.728588923419813 | distance: 0.72859variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 89.0 |
| Stroke Aggregator | 0.929586904474946 | distance: 0.92959variant: vectorized (shape strokes) | 1273.0 |
| Topology Driven → Stroke Aggregator | 0.7773331211051157 | distance: 0.77733variant: thresholded 500px | 1306.0 |
| Topology Driven | 0.8322757044762585 | distance: 0.83228variant: thresholded 500px | 48.0 |
| Mastering Sketching | 0.8526670402008387 | distance: 0.85267variant: vectorized (all layers) 500px | 6.0 |
| Real-Time Inking | 0.8680426786283155 | distance: 0.86804variant: vectorized (all layers) 500px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7791669132590339 | distance: 0.77917variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.7761629667699205 | distance: 0.77616variant: vectorized (all layers) 500pxalg. parameter: noisy | 35.0 |
| Poly Vector | 0.7771627936078176 | distance: 0.77716variant: vectorized (shape strokes) 500px | 90.0 |
| Topology Driven → Stroke Aggregator | 0.8439333182223809 | distance: 0.84393variant: thresholded 500px | 1306.0 |
| Topology Driven | 0.8814731319077136 | distance: 0.88147variant: thresholded 500px | 48.0 |
| Fidelity Simplicity | 0.7526817621399021 | distance: 0.75268variant: thresholded 500pxalg. parameter: 0.75 | 134.0 |
| Mastering Sketching | 0.8892733017751937 | distance: 0.88927variant: vectorized (all layers) 500px | 6.0 |
| Real-Time Inking | 0.8977491403000281 | distance: 0.89775variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9494516065726016 | distance: 0.94945variant: vectorized (shape strokes) | 1273.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.13160546875 |  distance: 0.13161variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 182.0 |
| Mastering Sketching | 0.2446957244873047 |  distance: 0.2447variant: thresholded 500px | 5.0 |
| Delaunay Triangulation | 0.034655445098876955 | distance: 0.03466variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0264007568359375 |  distance: 0.0264variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 465.0 |
| Poly Vector | 0.026907247543334963 |  distance: 0.02691variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 177.0 |
| Real-Time Inking | 0.02823118782043457 | distance: 0.02823variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.034205586760194154 | distance: 0.03421variant: vectorized (shape strokes) | 1273.0 |
| Topology Driven → Stroke Aggregator | 0.0264007568359375 | distance: 0.0264variant: vectorized (shape strokes) 1000px | 959.0 |
| Topology Driven | 0.026907247543334963 |  distance: 0.02691variant: vectorized (shape strokes) 500px | 6.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| thresholded 500px | |
 |
|
 |
 |
 |
|
|
|
 |
 |
 |
 |
 |
|
| vectorized (all layers) 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 500px |  |
|
|
 |
 |
 |
 |
 |
 |
 |
 |
|
|
||
| vectorized (shape strokes) 1000px | |
|
|
 |
|
 |
 |
|
|
|
|
|
|
|
|
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
 |
|
|
|
 |
|||
| vectorized (shape strokes) | |