A Benchmark for Rough Sketch Cleanup
Ind_product_AS_05
Author: Akshay Sharma Licence: CC-BY-SAMessiness: 0.40548
Ambiguity (Chamfer): 0.0693
Shading: No
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector | Topology Driven | Real-Time Inking | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00135 |  distance: 0.00137 |  distance: 0.00137 |  distance: 0.00152 |  distance: 0.00157 |  distance: 0.00222 |  distance: 0.00559 |  distance: 0.00579 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.005791962662754255 | distance: 0.00579variant: thresholded 1000px | 6.0 |
| Mastering Sketching | 0.001354906119050024 | distance: 0.00135variant: vectorized (shape strokes) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.0055915647245537384 | distance: 0.00559variant: thresholded 1000pxalg. parameter: noisy | 134.0 |
| Poly Vector | 0.001367760104332167 | distance: 0.00137variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 140.0 |
| Real-Time Inking | 0.0015219796435738365 | distance: 0.00152variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.0015692794527732475 | distance: 0.00157variant: vectorized (shape strokes) 1000px | 5.0 |
| Topology Driven | 0.0013682788601125351 | distance: 0.00137variant: vectorized (shape strokes) 1000px | 15.0 |
| Fidelity Simplicity | 0.0022205135807104154 | distance: 0.00222variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 318.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.3413573768233373 |  distance: 0.34136variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 227.0 |
| Mastering Sketching | 0.4581009352335359 |  distance: 0.4581variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.3790910163334904 |  distance: 0.37909variant: vectorized (all layers) 1000px | 672.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.47695843371821595 |  distance: 0.47696variant: vectorized (all layers) 500px | 213.0 |
| Topology Driven | 0.5087242785543069 |  distance: 0.50872variant: vectorized (all layers) 500px | 9.0 |
| Delaunay Triangulation | 0.2768465859010991 |  distance: 0.27685variant: vectorized (all layers) 1000px | 10.0 |
| Poly Vector | 0.4960704560186355 |  distance: 0.49607variant: vectorized (all layers) 1000pxalg. parameter: noisy | 259.0 |
| Real-Time Inking | 0.3870538651444689 |  distance: 0.38705variant: original | 4.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4567871313664259 |  distance: 0.45679variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 198.0 |
| Mastering Sketching | 0.5494224026499831 | distance: 0.54942variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4882066625890028 | distance: 0.48821variant: vectorized (all layers) 1000px | 672.0 |
| Poly Vector | 0.582243945694138 |  distance: 0.58224variant: vectorized (all layers) 1000px | 225.0 |
| Real-Time Inking | 0.5750867163603319 |  distance: 0.57509variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5861605653541403 | distance: 0.58616variant: vectorized (all layers) 500px | 213.0 |
| Topology Driven | 0.5850716433670304 | distance: 0.58507variant: vectorized (all layers) 500px | 9.0 |
| Delaunay Triangulation | 0.3932543541992623 | distance: 0.39325variant: vectorized (all layers) 1000px | 10.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5684215566627332 |  distance: 0.56842variant: vectorized (all layers) 1000pxalg. parameter: 0.6 | 291.0 |
| Mastering Sketching | 0.5892846195740538 | distance: 0.58928variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5662973829422518 | distance: 0.5663variant: vectorized (all layers) 1000px | 672.0 |
| Poly Vector | 0.653755449153148 | distance: 0.65376variant: vectorized (all layers) 1000px | 225.0 |
| Real-Time Inking | 0.6187666527212424 | distance: 0.61877variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6358667959696905 | distance: 0.63587variant: vectorized (all layers) 500px | 213.0 |
| Topology Driven | 0.6336315550978211 | distance: 0.63363variant: vectorized (all layers) 500px | 9.0 |
| Delaunay Triangulation | 0.4749202184456856 | distance: 0.47492variant: vectorized (all layers) 1000px | 10.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5236998030723519 | distance: 0.5237variant: vectorized (all layers) 1000px | 10.0 |
| Fidelity Simplicity | 0.5974236431147216 |  distance: 0.59742variant: vectorized (all layers) 1000pxalg. parameter: 0.25 | 242.0 |
| Mastering Sketching | 0.6156840322644292 | distance: 0.61568variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6082632578797383 | distance: 0.60826variant: vectorized (all layers) 1000px | 672.0 |
| Poly Vector | 0.6873998374172571 | distance: 0.6874variant: vectorized (all layers) 1000pxalg. parameter: noisy | 259.0 |
| Real-Time Inking | 0.6478651349283359 | distance: 0.64787variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.671856645360336 | distance: 0.67186variant: vectorized (all layers) 500px | 213.0 |
| Topology Driven | 0.666374966000245 | distance: 0.66637variant: vectorized (all layers) 500px | 9.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5623172315336246 | distance: 0.56232variant: vectorized (all layers) 1000px | 10.0 |
| Fidelity Simplicity | 0.6188021702193732 | distance: 0.6188variant: vectorized (all layers) 1000pxalg. parameter: 0.25 | 242.0 |
| Mastering Sketching | 0.6463382616228565 | distance: 0.64634variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6317381416784399 | distance: 0.63174variant: vectorized (all layers) 1000px | 672.0 |
| Poly Vector | 0.7118435448577681 | distance: 0.71184variant: vectorized (all layers) 1000pxalg. parameter: noisy | 259.0 |
| Real-Time Inking | 0.6713120467786154 | distance: 0.67131variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6977175352595275 | distance: 0.69772variant: vectorized (all layers) 500px | 213.0 |
| Topology Driven | 0.6940253894749138 | distance: 0.69403variant: vectorized (all layers) 500px | 9.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.08323461151123047 |  distance: 0.08323variant: thresholded 500px | 1.0 |
| Mastering Sketching | 0.3498571166992188 |  distance: 0.34986variant: thresholded 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.155077392578125 | distance: 0.15508variant: thresholded 1000pxalg. parameter: noisy | 134.0 |
| Poly Vector | 0.02256102752685547 | distance: 0.02256variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 140.0 |
| Real-Time Inking | 0.023259407043457032 | distance: 0.02326variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.02256102752685547 | distance: 0.02256variant: vectorized (shape strokes) 1000px | 5.0 |
| Topology Driven | 0.022000000000000002 |  distance: 0.022variant: vectorized (shape strokes) 500px | 4.0 |
| Fidelity Simplicity | 0.024 |  distance: 0.024variant: vectorized (shape strokes) 500pxalg. parameter: 0.6 | 237.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
||||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
||||
| thresholded 500px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
||||
| vectorized (all layers) 1000px | |
 |
|
 |
 |
|
 |
|
|
|
|
||||
| vectorized (all layers) 500px | |
 |
|
 |
 |
|
 |
|
|
 |
 |
 |
|||
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
|
 |
 |
||||
| vectorized (shape strokes) 500px |  |
|
 |
 |
 |
 |
|
|
 |
 |
 |