A Benchmark for Rough Sketch Cleanup
Ind_architecture_AST_01
Author: Alexander Strugach Author Homepage: https://www.flickr.com/photos/alexander_str/ Licence: CC-BY-2.0Messiness: 0.291
Ambiguity (Chamfer): 0.20486
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Topology Driven → Stroke Aggregator | Real-Time Inking | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00235 |  distance: 0.00244 |  distance: 0.00251 |  distance: 0.00345 |  distance: 0.00356 |  distance: 0.00459 |  distance: 0.00464 |  distance: 0.00729 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  |  | ||
| Ge Jin |  | |  |  | |||
| Liliya Larsen |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.007287707138769076 | distance: 0.00729variant: thresholded 500px | 25.0 |
| Fidelity Simplicity | 0.004590716216178503 | distance: 0.00459variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 218.0 |
| Mastering Sketching | 0.002352669031676993 | distance: 0.00235variant: vectorized (shape strokes) 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.004643761730558109 | distance: 0.00464variant: vectorized (shape strokes) 500px | 139.0 |
| Poly Vector | 0.002505830274594671 | distance: 0.00251variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 733.0 |
| Real-Time Inking | 0.003564644754896661 | distance: 0.00356variant: vectorized (shape strokes) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.0034507136488078297 | distance: 0.00345variant: vectorized (shape strokes) 500px | 1272.0 |
| Topology Driven | 0.002443974989659259 | distance: 0.00244variant: vectorized (shape strokes) 1000px | 58.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.14978792210037228 |  distance: 0.14979variant: vectorized (all layers) 500px | 22.0 |
| Fidelity Simplicity | 0.19323962935284375 |  distance: 0.19324variant: thresholded 500pxalg. parameter: 0.75 | 204.0 |
| Mastering Sketching | 0.4816431480351594 |  distance: 0.48164variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4225585585749265 |  distance: 0.42256variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 140.0 |
| Poly Vector | 0.4289286080858925 |  distance: 0.42893variant: vectorized (shape strokes) 500px | 275.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.4563699533310632 | distance: 0.45637variant: vectorized (shape strokes) 500px | 1272.0 |
| Real-Time Inking | 0.28086918674770245 |  distance: 0.28087variant: original | 16.0 |
| Topology Driven | 0.004777089916746428 |  distance: 0.00478variant: original | 293.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2507483608793368 | distance: 0.25075variant: vectorized (all layers) 500px | 22.0 |
| Fidelity Simplicity | 0.30366910280414083 | distance: 0.30367variant: thresholded 500pxalg. parameter: 0.75 | 204.0 |
| Mastering Sketching | 0.640055849334947 | distance: 0.64006variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5548306221996275 | distance: 0.55483variant: vectorized (shape strokes) 500px | 139.0 |
| Poly Vector | 0.5679653548525652 | distance: 0.56797variant: vectorized (shape strokes) 500px | 275.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6228316124344232 | distance: 0.62283variant: vectorized (shape strokes) 500px | 1272.0 |
| Real-Time Inking | 0.3812176109617804 | distance: 0.38122variant: original | 16.0 |
| Topology Driven | 0.011999464549207549 | distance: 0.012variant: original | 293.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3651244114705296 | distance: 0.36512variant: vectorized (all layers) 500px | 22.0 |
| Fidelity Simplicity | 0.4079757426000245 |  distance: 0.40798variant: thresholded 500pxalg. parameter: 0.6 | 165.0 |
| Mastering Sketching | 0.7313906834031821 |  distance: 0.73139variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6374682902652071 | distance: 0.63747variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 140.0 |
| Poly Vector | 0.6503597025002302 | distance: 0.65036variant: vectorized (shape strokes) 500px | 275.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7374612860180014 | distance: 0.73746variant: vectorized (shape strokes) 500px | 1272.0 |
| Real-Time Inking | 0.4508114779592232 | distance: 0.45081variant: original | 16.0 |
| Topology Driven | 0.02119488942755891 | distance: 0.02119variant: original | 293.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4524254682057334 | distance: 0.45243variant: vectorized (all layers) 500px | 22.0 |
| Fidelity Simplicity | 0.4876454847598801 | distance: 0.48765variant: thresholded 500pxalg. parameter: 0.6 | 165.0 |
| Mastering Sketching | 0.7850271222732567 | distance: 0.78503variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6920745877083203 | distance: 0.69207variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 140.0 |
| Poly Vector | 0.7047482476074233 | distance: 0.70475variant: vectorized (shape strokes) 500px | 275.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.801436984471991 | distance: 0.80144variant: vectorized (shape strokes) 500px | 1272.0 |
| Real-Time Inking | 0.5061862432711925 | distance: 0.50619variant: original | 16.0 |
| Topology Driven | 0.030087947223404125 | distance: 0.03009variant: original | 293.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5361669540725791 | distance: 0.53617variant: vectorized (all layers) 500px | 22.0 |
| Fidelity Simplicity | 0.5635282931560412 |  distance: 0.56353variant: thresholded 500pxalg. parameter: 0.3 | 170.0 |
| Mastering Sketching | 0.8322937426333581 | distance: 0.83229variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7385150122972329 | distance: 0.73852variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 140.0 |
| Poly Vector | 0.750761004744517 |  distance: 0.75076variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 301.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.84254699728839 | distance: 0.84255variant: vectorized (shape strokes) 500px | 1272.0 |
| Topology Driven | 0.04125249325547695 | distance: 0.04125variant: original | 293.0 |
| Real-Time Inking | 0.5540335328965148 | distance: 0.55403variant: original | 16.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.06403124237060548 |  distance: 0.06403variant: thresholded 1000px | 160.0 |
| Poly Vector | 0.052611785888671866 |  distance: 0.05261variant: vectorized (all layers) 500pxalg. parameter: noisy | 1239.0 |
| Real-Time Inking | 0.047338323258086984 |  distance: 0.04734variant: thresholded | 15.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.066 | distance: 0.066variant: vectorized (shape strokes) 500px | 1272.0 |
| Topology Driven | 0.047 |  distance: 0.047variant: thresholded 1000px | 1603.0 |
| Mastering Sketching | 0.11745637512207033 | distance: 0.11746variant: vectorized (all layers) 500px | 5.0 |
| Fidelity Simplicity | 0.07256720733642577 |  distance: 0.07257variant: thresholded 1000pxalg. parameter: 0.3 | 314.0 |
| Poly Vector → Stroke Aggregator | 0.08616263580322266 | distance: 0.08616variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 140.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|||||||||||||
| thresholded | |
||||||||||||||
| thresholded 1000px |  |
 |
|
 |
 |
 |
 |
|
|
||||||
| thresholded 500px |  |
 |
|
 |
 |
|
|
 |
|
||||||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
 |
 |
||||||
| vectorized (all layers) 500px |  |
|
 |
 |
 |
 |
 |
 |
|
 |
|
||||
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
|
 |
 |
||||
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
 |
|
|