A Benchmark for Rough Sketch Cleanup
Ind_product_AS_15
Author: Akshay Sharma Licence: CC-BY-SAMessiness: 0.35446
Ambiguity (Chamfer): 0.36319
Shading: No
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Mastering Sketching | Real-Time Inking | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00221 |  distance: 0.00231 |  distance: 0.00242 |  distance: 0.00261 |  distance: 0.00295 |  distance: 0.00299 |  distance: 0.00315 |  distance: 0.00468 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.0046823918761472 | distance: 0.00468variant: vectorized (shape strokes) 1000px | 8.0 |
| Fidelity Simplicity | 0.002986488215653757 | distance: 0.00299variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 227.0 |
| Mastering Sketching | 0.0024221645682095025 | distance: 0.00242variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.003147225396165619 | distance: 0.00315variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 1639.0 |
| Poly Vector | 0.002305933659207975 | distance: 0.00231variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 252.0 |
| Real-Time Inking | 0.002605798772398903 | distance: 0.00261variant: vectorized (shape strokes) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.002949054137832703 | distance: 0.00295variant: vectorized (shape strokes) 500px | 1357.0 |
| Topology Driven | 0.0022089508140420255 | distance: 0.00221variant: vectorized (shape strokes) 1000px | 28.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.1182117412988278 |  distance: 0.11821variant: vectorized (all layers) 1000px | 14.0 |
| Fidelity Simplicity | 0.24046576208556325 |  distance: 0.24047variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 194.0 |
| Mastering Sketching | 0.39257832936492265 |  distance: 0.39258variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4842223906118201 |  distance: 0.48422variant: thresholded 1000pxalg. parameter: noisy | 646.0 |
| Poly Vector | 0.4379721327674913 |  distance: 0.43797variant: vectorized (all layers) 1000pxalg. parameter: noisy | 430.0 |
| Real-Time Inking | 0.425602568351535 |  distance: 0.4256variant: vectorized (all layers) 1000px | 4.0 |
| Topology Driven → Stroke Aggregator | 0.44615513985640814 |  distance: 0.44616variant: vectorized (all layers) 500px | 1383.0 |
| Topology Driven | 0.4439741779742897 |  distance: 0.44397variant: vectorized (all layers) 1000px | 48.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.22181484983118535 | distance: 0.22181variant: vectorized (all layers) 1000px | 14.0 |
| Fidelity Simplicity | 0.3720816000736796 | distance: 0.37208variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 194.0 |
| Mastering Sketching | 0.4977164374206113 | distance: 0.49772variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5887736850242338 |  distance: 0.58877variant: vectorized (all layers) 500pxalg. parameter: noisy | 68.0 |
| Poly Vector | 0.5422321995105959 |  distance: 0.54223variant: vectorized (all layers) 1000px | 430.0 |
| Real-Time Inking | 0.5326277507155918 | distance: 0.53263variant: vectorized (all layers) 1000px | 4.0 |
| Topology Driven → Stroke Aggregator | 0.533171905925745 | distance: 0.53317variant: vectorized (all layers) 500px | 1383.0 |
| Topology Driven | 0.529946121564981 |  distance: 0.52995variant: vectorized (all layers) 500px | 12.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.33029831967113704 | distance: 0.3303variant: vectorized (all layers) 1000px | 14.0 |
| Fidelity Simplicity | 0.4769866768809226 |  distance: 0.47699variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 163.0 |
| Mastering Sketching | 0.5471199057255585 | distance: 0.54712variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6303641694443342 | distance: 0.63036variant: vectorized (all layers) 500pxalg. parameter: noisy | 68.0 |
| Poly Vector | 0.5978930698523083 | distance: 0.59789variant: vectorized (all layers) 1000pxalg. parameter: noisy | 430.0 |
| Real-Time Inking | 0.581389390324853 | distance: 0.58139variant: vectorized (all layers) 1000px | 4.0 |
| Topology Driven → Stroke Aggregator | 0.5917909865916674 | distance: 0.59179variant: vectorized (all layers) 500px | 1383.0 |
| Topology Driven | 0.5893986817377199 | distance: 0.5894variant: vectorized (all layers) 500px | 12.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.39334264390879997 | distance: 0.39334variant: vectorized (all layers) 1000px | 14.0 |
| Fidelity Simplicity | 0.524627544387484 |  distance: 0.52463variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 188.0 |
| Mastering Sketching | 0.5730979462588345 | distance: 0.5731variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6536028938127099 |  distance: 0.6536variant: vectorized (all layers) 500px | 68.0 |
| Poly Vector | 0.6245757417132436 | distance: 0.62458variant: vectorized (all layers) 1000pxalg. parameter: noisy | 430.0 |
| Real-Time Inking | 0.6069692284507058 | distance: 0.60697variant: vectorized (all layers) 1000px | 4.0 |
| Topology Driven → Stroke Aggregator | 0.6181666982555586 | distance: 0.61817variant: vectorized (all layers) 500px | 1383.0 |
| Topology Driven | 0.6179893903347691 | distance: 0.61799variant: vectorized (all layers) 500px | 12.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.4285244399231407 | distance: 0.42852variant: vectorized (all layers) 1000px | 14.0 |
| Fidelity Simplicity | 0.566349417338789 | distance: 0.56635variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 188.0 |
| Mastering Sketching | 0.6096892878997934 | distance: 0.60969variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6874782857844616 | distance: 0.68748variant: vectorized (all layers) 500px | 68.0 |
| Poly Vector | 0.653608383748223 | distance: 0.65361variant: vectorized (all layers) 1000pxalg. parameter: noisy | 430.0 |
| Real-Time Inking | 0.635285435271935 |  distance: 0.63529variant: original | 6.0 |
| Topology Driven → Stroke Aggregator | 0.6576006245429217 | distance: 0.6576variant: vectorized (all layers) 500px | 1383.0 |
| Topology Driven | 0.6562397536111989 | distance: 0.65624variant: vectorized (all layers) 500px | 12.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.3971750183105469 |  distance: 0.39718variant: thresholded 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.04341658782958984 | distance: 0.04342variant: vectorized (shape strokes) 1000px | 8.0 |
| Fidelity Simplicity | 0.04 |  distance: 0.04variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 197.0 |
| Poly Vector → Stroke Aggregator | 0.040999999999999995 | distance: 0.041variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 1639.0 |
| Poly Vector | 0.05 | distance: 0.05variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 252.0 |
| Real-Time Inking | 0.04512205505371094 |  distance: 0.04512variant: vectorized (shape strokes) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.04638965225219727 | distance: 0.04639variant: vectorized (shape strokes) 500px | 1357.0 |
| Topology Driven | 0.048166378021240235 |  distance: 0.04817variant: vectorized (shape strokes) 500px | 8.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
||||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
||||
| thresholded 500px |  |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
|
|
|
|
|||||
| vectorized (all layers) 500px | |
 |
|
 |
|
|
|
 |
|
 |
 |
 |
|
|
|
| vectorized (shape strokes) 1000px | |
 |
|
 |
 |
 |
|
|
 |
|
|
||||
| vectorized (shape strokes) 500px | |
|
|
 |
 |
 |
|
 |
|
 |
 |
 |
 |
 |