A Benchmark for Rough Sketch Cleanup
Art_logo_AA_01
Author: Anna A Author Homepage: https://www.flickr.com/photos/llamajing/ Licence: CC-BY-NC 2.0Messiness: 0.30373
Ambiguity (Chamfer): 0.64921
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Stroke Aggregator | Real-Time Inking | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00178 |  distance: 0.00179 |  distance: 0.00185 |  distance: 0.00228 |  distance: 0.00261 |  distance: 0.00296 |  distance: 0.0032 |  distance: 0.0044 |  distance: 0.00534 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Diego Barrionuevo |  | |  |  |  | ||
| Liliya Larsen |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.003200086936365462 | distance: 0.0032variant: vectorized (shape strokes) 1000px | 16.0 |
| Fidelity Simplicity | 0.0043977914433206 | distance: 0.0044variant: vectorized (shape strokes) 1000pxalg. parameter: 0.5 | 177.0 |
| Mastering Sketching | 0.001778453229359662 | distance: 0.00178variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.0018499420087916816 | distance: 0.00185variant: vectorized (shape strokes) 1000px | 488.0 |
| Real-Time Inking | 0.0026109302044145977 | distance: 0.00261variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | 0.002281044284571848 | distance: 0.00228variant: vectorized (shape strokes) | 717.0 |
| Topology Driven → Stroke Aggregator | 0.0029592241867344308 | distance: 0.00296variant: vectorized (shape strokes) 500px | 543.0 |
| Poly Vector → Stroke Aggregator | 0.005344324780772231 | distance: 0.00534variant: thresholded 500px | 358.0 |
| Topology Driven | 0.001788942628655116 | distance: 0.00179variant: vectorized (shape strokes) 1000px | 56.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2583812670087495 |  distance: 0.25838variant: thresholded 500px | 6.0 |
| Mastering Sketching | 0.4008125427998524 |  distance: 0.40081variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.2553661521927337 |  distance: 0.25537variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 51.0 |
| Poly Vector | 0.2433027648583393 |  distance: 0.2433variant: vectorized (all layers) 500pxalg. parameter: noisy | 714.0 |
| Real-Time Inking | 0.15676889235000224 |  distance: 0.15677variant: original | 4.0 |
| Stroke Aggregator | 0.4613455751216946 | distance: 0.46135variant: vectorized (shape strokes) | 717.0 |
| Topology Driven → Stroke Aggregator | 0.32525375928495104 |  distance: 0.32525variant: vectorized (all layers) 500px | 1157.0 |
| Topology Driven | 0.3667781012477777 |  distance: 0.36678variant: thresholded | 581.0 |
| Fidelity Simplicity | 0.21594419744463025 |  distance: 0.21594variant: thresholded 500pxalg. parameter: 0.75 | 1607.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3896036673813443 | distance: 0.3896variant: thresholded 500px | 6.0 |
| Mastering Sketching | 0.5173157290138585 | distance: 0.51732variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.3522170930965955 | distance: 0.35222variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 51.0 |
| Poly Vector | 0.3483942446603586 |  distance: 0.34839variant: vectorized (all layers) 500px | 685.0 |
| Real-Time Inking | 0.2464911468438805 | distance: 0.24649variant: original | 4.0 |
| Stroke Aggregator | 0.6312697084640688 | distance: 0.63127variant: vectorized (shape strokes) | 717.0 |
| Topology Driven → Stroke Aggregator | 0.47680795635825607 | distance: 0.47681variant: vectorized (all layers) 500px | 1157.0 |
| Topology Driven | 0.5044758409426973 |  distance: 0.50448variant: vectorized (all layers) 1000px | 511.0 |
| Fidelity Simplicity | 0.3409378324968351 |  distance: 0.34094variant: thresholded 500pxalg. parameter: 0.6 | 1528.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4854332218138757 | distance: 0.48543variant: thresholded 500px | 6.0 |
| Fidelity Simplicity | 0.4354144991794969 | distance: 0.43541variant: thresholded 500pxalg. parameter: 0.75 | 1607.0 |
| Mastering Sketching | 0.5877157359918019 | distance: 0.58772variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.43266092520451455 |  distance: 0.43266variant: vectorized (shape strokes) 500px | 51.0 |
| Poly Vector | 0.4382921387491423 | distance: 0.43829variant: vectorized (all layers) 500px | 685.0 |
| Real-Time Inking | 0.28006666031233257 | distance: 0.28007variant: original | 4.0 |
| Stroke Aggregator | 0.7074913830492449 | distance: 0.70749variant: vectorized (shape strokes) | 717.0 |
| Topology Driven → Stroke Aggregator | 0.5787815028515292 | distance: 0.57878variant: vectorized (all layers) 500px | 1157.0 |
| Topology Driven | 0.5830378868496779 | distance: 0.58304variant: vectorized (all layers) 1000px | 511.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5530543957680192 | distance: 0.55305variant: thresholded 500px | 6.0 |
| Fidelity Simplicity | 0.478556033722576 | distance: 0.47856variant: thresholded 500pxalg. parameter: 0.6 | 1528.0 |
| Mastering Sketching | 0.6301935414968679 | distance: 0.63019variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4851093204465825 | distance: 0.48511variant: vectorized (shape strokes) 500px | 51.0 |
| Poly Vector | 0.4924823584726299 | distance: 0.49248variant: vectorized (all layers) 500px | 685.0 |
| Real-Time Inking | 0.2976500232449635 | distance: 0.29765variant: original | 4.0 |
| Stroke Aggregator | 0.7622772218779138 | distance: 0.76228variant: vectorized (shape strokes) | 717.0 |
| Topology Driven → Stroke Aggregator | 0.6442032223302758 | distance: 0.6442variant: vectorized (all layers) 500px | 1157.0 |
| Topology Driven | 0.6334887831696092 | distance: 0.63349variant: vectorized (all layers) 1000px | 511.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6139380731468573 | distance: 0.61394variant: thresholded 500px | 6.0 |
| Fidelity Simplicity | 0.5149050509094103 | distance: 0.51491variant: thresholded 500pxalg. parameter: 0.6 | 1528.0 |
| Mastering Sketching | 0.6715301005062116 | distance: 0.67153variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5233535806281984 | distance: 0.52335variant: vectorized (shape strokes) 500px | 51.0 |
| Poly Vector | 0.5334004145765008 | distance: 0.5334variant: vectorized (all layers) 500px | 685.0 |
| Real-Time Inking | 0.30535772329901084 | distance: 0.30536variant: original | 4.0 |
| Stroke Aggregator | 0.7919295160389429 | distance: 0.79193variant: vectorized (shape strokes) | 717.0 |
| Topology Driven → Stroke Aggregator | 0.7053285629761381 | distance: 0.70533variant: vectorized (all layers) 500px | 1157.0 |
| Topology Driven | 0.6713744940283667 | distance: 0.67137variant: vectorized (all layers) 1000px | 511.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.3279085388183593 | distance: 0.32791variant: thresholded 500px | 5.0 |
| Delaunay Triangulation | 0.06356099319458007 |  distance: 0.06356variant: vectorized (shape strokes) 500px | 4.0 |
| Fidelity Simplicity | 0.06530696868896485 |  distance: 0.06531variant: vectorized (all layers) 1000pxalg. parameter: 0.25 | 178.0 |
| Poly Vector → Stroke Aggregator | 0.04368066024780273 |  distance: 0.04368variant: thresholded 500pxalg. parameter: noisy | 357.0 |
| Poly Vector | 0.03894868469238282 |  distance: 0.03895variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 574.0 |
| Real-Time Inking | 0.0357770881652832 |  distance: 0.03578variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.0426737704857505 | distance: 0.04267variant: vectorized (shape strokes) | 717.0 |
| Topology Driven → Stroke Aggregator | 0.03498571014404297 | distance: 0.03499variant: vectorized (shape strokes) 500px | 543.0 |
| Topology Driven | 0.03544009017944336 |  distance: 0.03544variant: thresholded 500px | 54.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
||||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 500px |  |
|
 |
 |
|
|
|
 |
 |
|
|
|
|||
| vectorized (all layers) 1000px |  |
 |
|
 |
 |
 |
|
 |
|||||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
 |
 |
|
|
 |
|||
| vectorized (shape strokes) 1000px |  |
 |
 |
|
 |
 |
|
|
|
|
|||||
| vectorized (shape strokes) 500px | |
|
|
 |
 |
 |
 |
 |
 |
 |
 |
|
|
|
|
| vectorized (shape strokes) | |