A Benchmark for Rough Sketch Cleanup
Ind_architecture_TU_01
Author: Tinyhouse University Author Homepage: https://www.facebook.com/tinyhouseuniversity/ Licence: CC-BY-SAMessiness: 0.32821
Ambiguity (Chamfer): 0.14078
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Paper (Patterned)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Mastering Sketching | Real-Time Inking | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00212 |  distance: 0.00212 |  distance: 0.00213 |  distance: 0.00316 |  distance: 0.00381 |  distance: 0.00447 |  distance: 0.00854 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  | ||||
| Liliya Larsen |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.008537714143028641 | distance: 0.00854variant: vectorized (shape strokes) 1000px | 34.0 |
| Fidelity Simplicity | 0.0038120369844590993 | distance: 0.00381variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 171.0 |
| Mastering Sketching | 0.002125813345400661 | distance: 0.00213variant: vectorized (shape strokes) 500px | 6.0 |
| Poly Vector | 0.002123731787084964 | distance: 0.00212variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 1326.0 |
| Real-Time Inking | 0.003160611075226866 | distance: 0.00316variant: vectorized (shape strokes) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.002119803222742488 | distance: 0.00212variant: vectorized (shape strokes) 1000px | 196.0 |
| Poly Vector → Stroke Aggregator | 0.004472539819868647 | distance: 0.00447variant: vectorized (all layers) 500px | 361.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.4914308438193182 |  distance: 0.49143variant: original | 6.0 |
| Poly Vector | 0.5503650896812011 |  distance: 0.55037variant: thresholded 500pxalg. parameter: noisy | 1333.0 |
| Real-Time Inking | 0.4061756498751329 |  distance: 0.40618variant: original | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Poly Vector → Stroke Aggregator | 0.53204769093409 | distance: 0.53205variant: vectorized (all layers) 500px | 361.0 |
| Delaunay Triangulation | 0.10857616527583183 |  distance: 0.10858variant: original | 582.0 |
| Fidelity Simplicity | 0.02456348801140391 |  distance: 0.02456variant: originalalg. parameter: 0.3 | 216.0 |
| Topology Driven | 0.4538817691571489 |  distance: 0.45388variant: thresholded | 519.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.21716919869490356 | distance: 0.21717variant: original | 582.0 |
| Mastering Sketching | 0.6978354633306 | distance: 0.69784variant: original | 6.0 |
| Poly Vector | 0.7201174336205869 | distance: 0.72012variant: thresholded 500pxalg. parameter: noisy | 1333.0 |
| Real-Time Inking | 0.5712372548065614 |  distance: 0.57124variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Poly Vector → Stroke Aggregator | 0.7179210929520516 |  distance: 0.71792variant: vectorized (all layers) 500pxalg. parameter: noisy | 357.0 |
| Fidelity Simplicity | 0.05325877616766656 | distance: 0.05326variant: originalalg. parameter: 0.3 | 216.0 |
| Topology Driven | 0.6966339279031021 | distance: 0.69663variant: thresholded | 519.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3065167259600897 | distance: 0.30652variant: original | 582.0 |
| Fidelity Simplicity | 0.07730041064211995 | distance: 0.0773variant: originalalg. parameter: 0.3 | 216.0 |
| Mastering Sketching | 0.7618632229702073 | distance: 0.76186variant: original | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8242482539238672 | distance: 0.82425variant: vectorized (all layers) 500pxalg. parameter: noisy | 357.0 |
| Poly Vector | 0.8188003944875979 |  distance: 0.8188variant: vectorized (all layers) 500px | 837.0 |
| Real-Time Inking | 0.6666876387767777 | distance: 0.66669variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.7952819157414078 |  distance: 0.79528variant: thresholded 1000px | 911.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3653343917808728 | distance: 0.36533variant: original | 582.0 |
| Fidelity Simplicity | 0.09866311052756456 | distance: 0.09866variant: originalalg. parameter: 0.3 | 216.0 |
| Mastering Sketching | 0.7853785705798723 | distance: 0.78538variant: original | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8687167675981604 | distance: 0.86872variant: vectorized (all layers) 500px | 361.0 |
| Poly Vector | 0.8616875401277473 |  distance: 0.86169variant: vectorized (all layers) 500pxalg. parameter: noisy | 872.0 |
| Real-Time Inking | 0.7217056335772765 | distance: 0.72171variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.8443567981585306 |  distance: 0.84436variant: vectorized (all layers) 1000px | 592.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4187570967935697 | distance: 0.41876variant: original | 582.0 |
| Fidelity Simplicity | 0.11882716904346433 | distance: 0.11883variant: originalalg. parameter: 0.3 | 216.0 |
| Mastering Sketching | 0.7987400319728729 | distance: 0.79874variant: original | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9044678991090288 | distance: 0.90447variant: vectorized (all layers) 500px | 361.0 |
| Poly Vector | 0.8949777893512347 |  distance: 0.89498variant: thresholded 500px | 1363.0 |
| Real-Time Inking | 0.7761194481822026 | distance: 0.77612variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.8784794003821095 | distance: 0.87848variant: vectorized (all layers) 1000px | 592.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.07034201812744141 |  distance: 0.07034variant: vectorized (shape strokes) 500px | 6.0 |
| Fidelity Simplicity | 0.02968164443969726 |  distance: 0.02968variant: vectorized (shape strokes) 1000pxalg. parameter: 0.75 | 242.0 |
| Poly Vector | 0.030265491485595705 |  distance: 0.03027variant: vectorized (shape strokes) 500px | 611.0 |
| Real-Time Inking | 0.045607017517089836 |  distance: 0.04561variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.0588217658996582 |  distance: 0.05882variant: vectorized (shape strokes) 500px | 38.0 |
| Mastering Sketching | 0.305941162109375 | distance: 0.30594variant: vectorized (shape strokes) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0592283706665039 | distance: 0.05923variant: vectorized (all layers) 500px | 361.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
 |
 |
 |
 |
|
|||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
|
 |
||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
 |
|
|
 |
||||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| vectorized (all layers) 500px | |
 |
 |
 |
 |
 |
 |
 |
|
|
 |
|
|
||
| vectorized (shape strokes) 1000px | |
|
 |
 |
|
 |
|
|
 |
|
|||||
| vectorized (shape strokes) 500px | |
|
 |
 |
 |
 |
 |
|
 |
|
|