A Benchmark for Rough Sketch Cleanup
Ind_product_AS_18
Author: Akshay Sharma Licence: CC-BY-SAMessiness: 0.36771
Ambiguity (Chamfer): 0.3895
Shading: No
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Stroke Aggregator | Poly Vector | Topology Driven | Mastering Sketching | Real-Time Inking | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00097 |  distance: 0.00115 |  distance: 0.00122 |  distance: 0.00124 |  distance: 0.00128 |  distance: 0.00135 |  distance: 0.00229 |  distance: 0.00481 |  distance: 0.00603 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Liliya Larsen |  | |  | ||||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.004808081448681101 | distance: 0.00481variant: vectorized (shape strokes) 500px | 0.0 |
| Fidelity Simplicity | 0.0022949479441630627 | distance: 0.00229variant: vectorized (shape strokes) 1000pxalg. parameter: 0.75 | 209.0 |
| Mastering Sketching | 0.0012442105970471972 | distance: 0.00124variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.006025098098443606 | distance: 0.00603variant: thresholded 1000px | 39.0 |
| Poly Vector | 0.0011537702892017725 | distance: 0.00115variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 70.0 |
| Real-Time Inking | 0.0012785668130583835 | distance: 0.00128variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | 0.0009691258247088287 | distance: 0.00097variant: vectorized (shape strokes) | 379.0 |
| Topology Driven → Stroke Aggregator | 0.001346654691201577 | distance: 0.00135variant: vectorized (shape strokes) 1000px | 102.0 |
| Topology Driven | 0.0012171923355795715 | distance: 0.00122variant: vectorized (shape strokes) 1000px | 5.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.15068670114013427 |  distance: 0.15069variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.3355046673337302 |  distance: 0.3355variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 115.0 |
| Mastering Sketching | 0.3892814391480388 |  distance: 0.38928variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.315431980555351 |  distance: 0.31543variant: vectorized (all layers) 1000px | 396.0 |
| Poly Vector | 0.3985441988435573 |  distance: 0.39854variant: vectorized (all layers) 1000pxalg. parameter: noisy | 131.0 |
| Real-Time Inking | 0.2471432138947536 |  distance: 0.24714variant: original | 4.0 |
| Stroke Aggregator | 0.6995670459409483 | distance: 0.69957variant: vectorized (shape strokes) | 379.0 |
| Topology Driven → Stroke Aggregator | 0.3708105051517345 |  distance: 0.37081variant: vectorized (all layers) 1000px | 663.0 |
| Topology Driven | 0.39080631053988985 |  distance: 0.39081variant: vectorized (all layers) 1000px | 12.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.29829411106000553 | distance: 0.29829variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.4412377352342791 | distance: 0.44124variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 115.0 |
| Mastering Sketching | 0.4635539201852233 | distance: 0.46355variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4271387530658655 | distance: 0.42714variant: vectorized (all layers) 1000px | 396.0 |
| Poly Vector | 0.4868466913764962 |  distance: 0.48685variant: vectorized (shape strokes) 500px | 30.0 |
| Real-Time Inking | 0.3820787258011101 | distance: 0.38208variant: original | 4.0 |
| Stroke Aggregator | 0.8217664743898301 | distance: 0.82177variant: vectorized (shape strokes) | 379.0 |
| Topology Driven → Stroke Aggregator | 0.4692188216776237 | distance: 0.46922variant: vectorized (all layers) 1000px | 663.0 |
| Topology Driven | 0.4966826728634597 |  distance: 0.49668variant: vectorized (all layers) 500px | 5.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.38303686409179905 | distance: 0.38304variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.4947468419667026 |  distance: 0.49475variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 116.0 |
| Mastering Sketching | 0.4993453355155482 | distance: 0.49935variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4750507724891147 | distance: 0.47505variant: vectorized (all layers) 1000px | 396.0 |
| Poly Vector | 0.5255875203399203 |  distance: 0.52559variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 30.0 |
| Real-Time Inking | 0.4588796526406276 | distance: 0.45888variant: original | 4.0 |
| Stroke Aggregator | 0.8330558877087679 | distance: 0.83306variant: vectorized (shape strokes) | 379.0 |
| Topology Driven → Stroke Aggregator | 0.5058335981650213 | distance: 0.50583variant: vectorized (all layers) 1000px | 663.0 |
| Topology Driven | 0.5319476200374142 | distance: 0.53195variant: vectorized (all layers) 1000px | 12.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4135715341064485 | distance: 0.41357variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.5300509684714038 | distance: 0.53005variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 116.0 |
| Mastering Sketching | 0.5262396528168448 | distance: 0.52624variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5052214471457466 | distance: 0.50522variant: vectorized (all layers) 1000px | 396.0 |
| Poly Vector | 0.5557870851848351 | distance: 0.55579variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 30.0 |
| Real-Time Inking | 0.4985823331461582 | distance: 0.49858variant: original | 4.0 |
| Stroke Aggregator | 0.8476012595702642 | distance: 0.8476variant: vectorized (shape strokes) | 379.0 |
| Topology Driven → Stroke Aggregator | 0.5341779611078373 | distance: 0.53418variant: vectorized (all layers) 1000px | 663.0 |
| Topology Driven | 0.5616650374714891 | distance: 0.56167variant: vectorized (all layers) 1000px | 12.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.44847964900492815 | distance: 0.44848variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.568848544272769 | distance: 0.56885variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 116.0 |
| Mastering Sketching | 0.558446662998192 | distance: 0.55845variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5331279465458644 | distance: 0.53313variant: vectorized (all layers) 1000px | 396.0 |
| Poly Vector | 0.5828672421800597 | distance: 0.58287variant: vectorized (shape strokes) 500px | 30.0 |
| Real-Time Inking | 0.5118003621089358 | distance: 0.5118variant: original | 4.0 |
| Stroke Aggregator | 0.8549715495161117 | distance: 0.85497variant: vectorized (shape strokes) | 379.0 |
| Topology Driven → Stroke Aggregator | 0.5621387283236995 | distance: 0.56214variant: vectorized (all layers) 1000px | 663.0 |
| Topology Driven | 0.5872704724566948 | distance: 0.58727variant: vectorized (all layers) 1000px | 12.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.064 | distance: 0.064variant: vectorized (shape strokes) 500px | 0.0 |
| Poly Vector → Stroke Aggregator | 0.1013903350830078 |  distance: 0.10139variant: vectorized (shape strokes) 500px | 7.0 |
| Fidelity Simplicity | 0.08709190368652342 |  distance: 0.08709variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 191.0 |
| Mastering Sketching | 0.38874154663085936 | distance: 0.38874variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.025 |  distance: 0.025variant: vectorized (shape strokes) 1000px | 71.0 |
| Real-Time Inking | 0.022000000000000002 | distance: 0.022variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | 0.025165869639470026 | distance: 0.02517variant: vectorized (shape strokes) | 379.0 |
| Topology Driven → Stroke Aggregator | 0.024 | distance: 0.024variant: vectorized (shape strokes) 1000px | 102.0 |
| Topology Driven | 0.02209072113037109 |  distance: 0.02209variant: vectorized (shape strokes) 500px | 2.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
||||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
|
|
 |
 |
|
|||
| vectorized (all layers) 500px |  |
|
 |
|
|
 |
 |
|
 |
 |
|
||||
| vectorized (shape strokes) 1000px | |
 |
|
 |
 |
|
 |
|
|
|
 |
||||
| vectorized (shape strokes) 500px | |
|
 |
 |
 |
 |
 |
|
|
|
|
|
|||
| vectorized (shape strokes) | |