A Benchmark for Rough Sketch Cleanup
Ind_product_PM_12
Author: Patrick Murphy Author Homepage: https://www.flickr.com/photos/pmurf/ Licence: CC-BY-2.0Messiness: 0.15596
Ambiguity (Chamfer): 0.09518
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Mastering Sketching | Topology Driven | Topology Driven → Stroke Aggregator | Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Poly Vector | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00183 |  distance: 0.00201 |  distance: 0.00213 |  distance: 0.00225 |  distance: 0.00234 |  distance: 0.00272 |  distance: 0.00335 |  distance: 0.00369 |  distance: 0.0037 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Liliya Larsen |  | |  | ||||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.00271605846913777 | distance: 0.00272variant: vectorized (shape strokes) 1000px | 5.0 |
| Fidelity Simplicity | 0.0033528809752515552 | distance: 0.00335variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 166.0 |
| Mastering Sketching | 0.00201122228017673 | distance: 0.00201variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0036930834056608116 | distance: 0.00369variant: thresholded 500pxalg. parameter: noisy | 67.0 |
| Poly Vector | 0.003704883708280036 | distance: 0.0037variant: thresholded 500pxalg. parameter: noisy | 337.0 |
| Real-Time Inking | 0.0018340930874136468 | distance: 0.00183variant: thresholded 1000px | 2.0 |
| Stroke Aggregator | 0.002338979560095664 | distance: 0.00234variant: vectorized (shape strokes) | 99.0 |
| Topology Driven → Stroke Aggregator | 0.0022531888488293824 | distance: 0.00225variant: vectorized (shape strokes) 1000px | 197.0 |
| Topology Driven | 0.002127648244275659 | distance: 0.00213variant: vectorized (shape strokes) 1000px | 13.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.3301141564236022 |  distance: 0.33011variant: originalalg. parameter: 0.75 | 190.0 |
| Mastering Sketching | 0.5605351875720344 |  distance: 0.56054variant: thresholded | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4922204004792282 |  distance: 0.49222variant: vectorized (all layers) 1000pxalg. parameter: noisy | 137.0 |
| Poly Vector | 0.3522730532052201 |  distance: 0.35227variant: vectorized (shape strokes) 500px | 37.0 |
| Real-Time Inking | 0.5818942979381795 |  distance: 0.58189variant: thresholded | 2.0 |
| Stroke Aggregator | 0.5869836037876569 | distance: 0.58698variant: vectorized (shape strokes) | 99.0 |
| Topology Driven → Stroke Aggregator | 0.4316822102143917 |  distance: 0.43168variant: vectorized (all layers) 500px | 164.0 |
| Delaunay Triangulation | 0.3303890113401989 |  distance: 0.33039variant: original | 9.0 |
| Topology Driven | 0.5096968290391882 |  distance: 0.5097variant: original | 53.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4969063366759121 |  distance: 0.49691variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.6374186780036954 | distance: 0.63742variant: vectorized (all layers) 1000pxalg. parameter: noisy | 137.0 |
| Poly Vector | 0.4345847458073903 |  distance: 0.43458variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 38.0 |
| Stroke Aggregator | 0.8089228070247759 | distance: 0.80892variant: vectorized (shape strokes) | 99.0 |
| Fidelity Simplicity | 0.5132024006730211 | distance: 0.5132variant: originalalg. parameter: 0.75 | 190.0 |
| Mastering Sketching | 0.7141095820678642 |  distance: 0.71411variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.7363245325319139 |  distance: 0.73632variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.5990468804580482 | distance: 0.59905variant: vectorized (all layers) 500px | 164.0 |
| Topology Driven | 0.6642282312099027 | distance: 0.66423variant: original | 53.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6142240799755138 | distance: 0.61422variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector | 0.5008526187576127 | distance: 0.50085variant: vectorized (shape strokes) 500px | 37.0 |
| Fidelity Simplicity | 0.6097806676646402 |  distance: 0.60978variant: originalalg. parameter: 0.5 | 196.0 |
| Mastering Sketching | 0.7772731492817775 | distance: 0.77727variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6922331328438561 | distance: 0.69223variant: vectorized (all layers) 1000pxalg. parameter: noisy | 137.0 |
| Real-Time Inking | 0.8023750463483608 | distance: 0.80238variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9015638840454376 | distance: 0.90156variant: vectorized (shape strokes) | 99.0 |
| Topology Driven → Stroke Aggregator | 0.6952622177980127 | distance: 0.69526variant: vectorized (all layers) 500px | 164.0 |
| Topology Driven | 0.744008323974984 | distance: 0.74401variant: original | 53.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6920018917229169 | distance: 0.692variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.8114216176278847 | distance: 0.81142variant: vectorized (all layers) 500px | 5.0 |
| Stroke Aggregator | 0.9245384104355724 | distance: 0.92454variant: vectorized (shape strokes) | 99.0 |
| Fidelity Simplicity | 0.652346021152678 | distance: 0.65235variant: originalalg. parameter: 0.75 | 190.0 |
| Poly Vector → Stroke Aggregator | 0.7486624872246654 | distance: 0.74866variant: vectorized (all layers) 1000pxalg. parameter: noisy | 137.0 |
| Poly Vector | 0.5283628956763384 | distance: 0.52836variant: vectorized (shape strokes) 500px | 37.0 |
| Real-Time Inking | 0.840592328352583 | distance: 0.84059variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.7642701454046192 | distance: 0.76427variant: vectorized (all layers) 500px | 164.0 |
| Topology Driven | 0.7871883073806619 |  distance: 0.78719variant: thresholded | 42.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7476951741830024 | distance: 0.7477variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.7018970891606005 | distance: 0.7019variant: originalalg. parameter: 0.75 | 190.0 |
| Mastering Sketching | 0.848893004461655 | distance: 0.84889variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7880961857587727 | distance: 0.7881variant: vectorized (all layers) 1000pxalg. parameter: noisy | 137.0 |
| Poly Vector | 0.5498156644642551 | distance: 0.54982variant: vectorized (shape strokes) 500px | 37.0 |
| Real-Time Inking | 0.8742473689482053 | distance: 0.87425variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9588243118868542 | distance: 0.95882variant: vectorized (shape strokes) | 99.0 |
| Topology Driven → Stroke Aggregator | 0.8178976849910025 | distance: 0.8179variant: vectorized (all layers) 500px | 164.0 |
| Topology Driven | 0.8334743591710257 | distance: 0.83347variant: thresholded | 42.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.036878177642822266 |  distance: 0.03688variant: thresholded 500px | 66.0 |
| Poly Vector | 0.036878177642822266 | distance: 0.03688variant: thresholded 500pxalg. parameter: noisy | 337.0 |
| Real-Time Inking | 0.0264196891784668 |  distance: 0.02642variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.018092105263157892 | distance: 0.01809variant: vectorized (shape strokes) | 99.0 |
| Topology Driven → Stroke Aggregator | 0.0264196891784668 | distance: 0.02642variant: vectorized (shape strokes) 1000px | 197.0 |
| Topology Driven | 0.02505992889404297 |  distance: 0.02506variant: vectorized (shape strokes) 500px | 4.0 |
| Mastering Sketching | 0.15754364013671876 |  distance: 0.15754variant: thresholded 500px | 5.0 |
| Delaunay Triangulation | 0.036619667053222664 |  distance: 0.03662variant: thresholded 1000px | 38.0 |
| Fidelity Simplicity | 0.03605551147460938 |  distance: 0.03606variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 186.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
|
|
 |
|
 |
 |
|
|||
| thresholded |  |
|
|
 |
 |
 |
 |
 |
|
 |
 |
 |
|||
| thresholded 1000px |  |
|
 |
 |
 |
 |
 |
 |
|
||||||
| thresholded 500px |  |
|
 |
 |
 |
 |
 |
 |
|
 |
 |
|
|
||
| vectorized (all layers) 1000px |  |
 |
 |
 |
|
 |
 |
 |
 |
 |
|
||||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
 |
 |
 |
 |
 |
|
|||
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
 |
 |
|
 |
|||
| vectorized (shape strokes) 500px |  |
|
 |
 |
 |
 |
 |
|
|
|
 |
||||
| vectorized (shape strokes) | |