A Benchmark for Rough Sketch Cleanup
Ind_architecture_SG_01
Author: Cat S. (aka Sketch gym) Author Homepage: https://permanent3rdgrade.com Licence: CC-BYMessiness: 0.16143
Ambiguity (Chamfer): 0.13146
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Real-Time Inking | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00097 |  distance: 0.00106 |  distance: 0.0011 |  distance: 0.00156 |  distance: 0.0028 |  distance: 0.00347 |  distance: 0.00618 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.0027969219145560697 | distance: 0.0028variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 208.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Poly Vector → Stroke Aggregator | 0.0034691521310435914 | distance: 0.00347variant: vectorized (all layers) 500pxalg. parameter: noisy | 413.0 |
| Delaunay Triangulation | 0.006178886633520426 | distance: 0.00618variant: vectorized (shape strokes) 1000px | 35.0 |
| Mastering Sketching | 0.0009711630042355088 | distance: 0.00097variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector | 0.001096980766510041 | distance: 0.0011variant: vectorized (shape strokes) 1000px | 661.0 |
| Real-Time Inking | 0.0015639363689152095 | distance: 0.00156variant: vectorized (shape strokes) 1000px | 3.0 |
| Topology Driven | 0.0010617158655097502 | distance: 0.00106variant: vectorized (shape strokes) 1000px | 67.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.6887943116200086 |  distance: 0.68879variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.4649195720960208 |  distance: 0.46492variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.6731439871436492 |  distance: 0.67314variant: vectorized (all layers) 500px | 190.0 |
| Poly Vector → Stroke Aggregator | 0.4994835217896463 |  distance: 0.49948variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 183.0 |
| Poly Vector | 0.5296834222061338 |  distance: 0.52968variant: vectorized (shape strokes) 500px | 279.0 |
| Delaunay Triangulation | 0.2142060556024571 |  distance: 0.21421variant: vectorized (all layers) 500px | 21.0 |
| Fidelity Simplicity | 0.20480885832068904 |  distance: 0.20481variant: thresholded 500pxalg. parameter: 0.5 | 169.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.8076524357767925 | distance: 0.80765variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.58619556366056 | distance: 0.5862variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.8001142554163383 | distance: 0.80011variant: vectorized (all layers) 500px | 190.0 |
| Poly Vector → Stroke Aggregator | 0.6310594561847034 | distance: 0.63106variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 183.0 |
| Poly Vector | 0.6550730570753657 | distance: 0.65507variant: vectorized (shape strokes) 500px | 279.0 |
| Delaunay Triangulation | 0.3318565646251748 | distance: 0.33186variant: vectorized (all layers) 500px | 21.0 |
| Fidelity Simplicity | 0.3065315559945402 |  distance: 0.30653variant: thresholded 500pxalg. parameter: 0.25 | 162.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.8613175024066592 | distance: 0.86132variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.6718909577219242 | distance: 0.67189variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.8657959926975872 | distance: 0.8658variant: vectorized (all layers) 500px | 190.0 |
| Poly Vector → Stroke Aggregator | 0.7308698485616819 | distance: 0.73087variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 183.0 |
| Poly Vector | 0.7462675170005041 |  distance: 0.74627variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 315.0 |
| Delaunay Triangulation | 0.4529978511285432 | distance: 0.453variant: vectorized (all layers) 500px | 21.0 |
| Fidelity Simplicity | 0.4065187437582447 |  distance: 0.40652variant: thresholded 500pxalg. parameter: 0.6 | 160.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.8878649086664483 | distance: 0.88786variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.7263761539180761 | distance: 0.72638variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.8957648224682979 | distance: 0.89576variant: vectorized (all layers) 500px | 190.0 |
| Poly Vector → Stroke Aggregator | 0.7939772323361574 | distance: 0.79398variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 183.0 |
| Poly Vector | 0.8053777532089207 | distance: 0.80538variant: vectorized (shape strokes) 500px | 279.0 |
| Delaunay Triangulation | 0.5413463512610609 | distance: 0.54135variant: vectorized (all layers) 500px | 21.0 |
| Fidelity Simplicity | 0.4813118441606543 |  distance: 0.48131variant: thresholded 500pxalg. parameter: 0.75 | 190.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9089775837223892 | distance: 0.90898variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.7738951270550143 | distance: 0.7739variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.9174939817822104 | distance: 0.91749variant: vectorized (all layers) 500px | 190.0 |
| Poly Vector → Stroke Aggregator | 0.843478956960108 | distance: 0.84348variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 183.0 |
| Poly Vector | 0.8505120851629737 | distance: 0.85051variant: vectorized (shape strokes) 500px | 279.0 |
| Delaunay Triangulation | 0.6367226557984226 | distance: 0.63672variant: vectorized (all layers) 500px | 21.0 |
| Fidelity Simplicity | 0.5533888030337974 | distance: 0.55339variant: thresholded 500pxalg. parameter: 0.75 | 190.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.0633876953125 | distance: 0.06339variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 208.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Mastering Sketching | 0.026907247543334963 |  distance: 0.02691variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.05015974426269531 | distance: 0.05016variant: vectorized (all layers) 500pxalg. parameter: noisy | 413.0 |
| Real-Time Inking | 0.0305941162109375 |  distance: 0.03059variant: vectorized (all layers) 1000px | 3.0 |
| Delaunay Triangulation | 0.048 |  distance: 0.048variant: vectorized (shape strokes) 500px | 9.0 |
| Poly Vector | 0.03 |  distance: 0.03variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 824.0 |
| Topology Driven | 0.03 | distance: 0.03variant: vectorized (shape strokes) 1000px | 67.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
||||||||||||||
| thresholded |  |
||||||||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 500px |  |
|
 |
|
|
|
|
 |
 |
 |
 |
||||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
 |
|||||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
|
 |
 |
|
|
 |
||
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
|
|
|
||||
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
 |
|
|
|
|