A Benchmark for Rough Sketch Cleanup
Ind_architecture_TU_02
Author: Tinyhouse University Author Homepage: https://www.facebook.com/tinyhouseuniversity/ Licence: CC-BY-SAMessiness: 0.22904
Ambiguity (Chamfer): 0.16324
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Stroke Aggregator | Poly Vector | Topology Driven | Fidelity Simplicity | Real-Time Inking | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0019 |  distance: 0.002 |  distance: 0.00205 |  distance: 0.00206 |  distance: 0.0022 |  distance: 0.00229 |  distance: 0.00309 |  distance: 0.00578 |  distance: 0.00755 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.005779019153727853 | distance: 0.00578variant: vectorized (shape strokes) 1000px | 18.0 |
| Fidelity Simplicity | 0.0021992091906607087 | distance: 0.0022variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 229.0 |
| Mastering Sketching | 0.0018951254301826895 | distance: 0.0019variant: vectorized (shape strokes) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.007551941153627182 | distance: 0.00755variant: vectorized (shape strokes) 500px | 50.0 |
| Poly Vector | 0.0020488495367159696 | distance: 0.00205variant: vectorized (shape strokes) 1000px | 311.0 |
| Real-Time Inking | 0.0022858916447637727 | distance: 0.00229variant: vectorized (shape strokes) 1000px | 3.0 |
| Stroke Aggregator | 0.001997211885004859 | distance: 0.002variant: vectorized (shape strokes) | 826.0 |
| Topology Driven → Stroke Aggregator | 0.003085735757996657 | distance: 0.00309variant: vectorized (shape strokes) 500px | 556.0 |
| Topology Driven | 0.00206021007304837 | distance: 0.00206variant: vectorized (shape strokes) 1000px | 48.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.16574629637930402 |  distance: 0.16575variant: vectorized (all layers) 500px | 9.0 |
| Fidelity Simplicity | 0.220999019966806 |  distance: 0.221variant: thresholded 500pxalg. parameter: 0.5 | 184.0 |
| Mastering Sketching | 0.5114747997287928 |  distance: 0.51147variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.4005576152991244 |  distance: 0.40056variant: vectorized (shape strokes) 500px | 166.0 |
| Real-Time Inking | 0.3962829932057372 |  distance: 0.39628variant: original | 3.0 |
| Stroke Aggregator | 0.5307911253078286 | distance: 0.53079variant: vectorized (shape strokes) | 826.0 |
| Topology Driven → Stroke Aggregator | 0.4723800703299048 | distance: 0.47238variant: vectorized (shape strokes) 500px | 556.0 |
| Topology Driven | 0.3928945669150496 |  distance: 0.39289variant: thresholded 1000px | 1108.0 |
| Poly Vector → Stroke Aggregator | 0.3865223627268759 | distance: 0.38652variant: vectorized (shape strokes) 500px | 50.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2794800268748291 | distance: 0.27948variant: vectorized (all layers) 500px | 9.0 |
| Fidelity Simplicity | 0.3250356195456794 | distance: 0.32504variant: thresholded 500pxalg. parameter: 0.5 | 184.0 |
| Mastering Sketching | 0.6693674540691329 | distance: 0.66937variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.553862017297291 | distance: 0.55386variant: original | 3.0 |
| Stroke Aggregator | 0.7455890539646212 | distance: 0.74559variant: vectorized (shape strokes) | 826.0 |
| Topology Driven → Stroke Aggregator | 0.6816481884690809 | distance: 0.68165variant: vectorized (shape strokes) 500px | 556.0 |
| Poly Vector → Stroke Aggregator | 0.5225049463416093 | distance: 0.5225variant: vectorized (shape strokes) 500px | 50.0 |
| Poly Vector | 0.5336672056021714 |  distance: 0.53367variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 172.0 |
| Topology Driven | 0.5678211353207417 |  distance: 0.56782variant: thresholded 500px | 277.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3924708706510548 | distance: 0.39247variant: vectorized (all layers) 500px | 9.0 |
| Fidelity Simplicity | 0.44501861767206746 |  distance: 0.44502variant: thresholded 500pxalg. parameter: 0.3 | 159.0 |
| Mastering Sketching | 0.7762680419323063 | distance: 0.77627variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.6602026079238673 | distance: 0.6602variant: original | 3.0 |
| Stroke Aggregator | 0.8608523683293265 | distance: 0.86085variant: vectorized (shape strokes) | 826.0 |
| Topology Driven → Stroke Aggregator | 0.8093850184955146 | distance: 0.80939variant: vectorized (shape strokes) 500px | 556.0 |
| Poly Vector → Stroke Aggregator | 0.620199743544845 | distance: 0.6202variant: vectorized (shape strokes) 500px | 50.0 |
| Poly Vector | 0.6270888013192621 | distance: 0.62709variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 172.0 |
| Topology Driven | 0.6930814208506757 | distance: 0.69308variant: thresholded 500px | 277.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4747086635912893 | distance: 0.47471variant: vectorized (all layers) 500px | 9.0 |
| Fidelity Simplicity | 0.5405472919879252 | distance: 0.54055variant: thresholded 500pxalg. parameter: 0.3 | 159.0 |
| Mastering Sketching | 0.8394569802432343 | distance: 0.83946variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6742272560053588 | distance: 0.67423variant: vectorized (shape strokes) 500px | 50.0 |
| Poly Vector | 0.6809357499878509 | distance: 0.68094variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 172.0 |
| Stroke Aggregator | 0.9207646387200432 | distance: 0.92076variant: vectorized (shape strokes) | 826.0 |
| Topology Driven → Stroke Aggregator | 0.8828499987995599 | distance: 0.88285variant: vectorized (shape strokes) 500px | 556.0 |
| Real-Time Inking | 0.7042337873022864 | distance: 0.70423variant: original | 3.0 |
| Topology Driven | 0.7679705800698419 | distance: 0.76797variant: thresholded 500px | 277.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5722173668464091 | distance: 0.57222variant: vectorized (all layers) 500px | 9.0 |
| Mastering Sketching | 0.8923226590186454 | distance: 0.89232variant: vectorized (all layers) 500px | 5.0 |
| Fidelity Simplicity | 0.6211319851177189 |  distance: 0.62113variant: thresholded 500pxalg. parameter: 0.25 | 167.0 |
| Poly Vector → Stroke Aggregator | 0.7247100058486644 | distance: 0.72471variant: vectorized (shape strokes) 500px | 50.0 |
| Poly Vector | 0.728731311651684 | distance: 0.72873variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 172.0 |
| Stroke Aggregator | 0.9376906121486718 | distance: 0.93769variant: vectorized (shape strokes) | 826.0 |
| Topology Driven → Stroke Aggregator | 0.9155599165634258 | distance: 0.91556variant: vectorized (shape strokes) 500px | 556.0 |
| Real-Time Inking | 0.7366492404918183 | distance: 0.73665variant: original | 3.0 |
| Topology Driven | 0.8309272720431959 | distance: 0.83093variant: thresholded 500px | 277.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.06260990524291993 | distance: 0.06261variant: vectorized (shape strokes) 1000px | 18.0 |
| Fidelity Simplicity | 0.03140063667297363 |  distance: 0.0314variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 202.0 |
| Poly Vector → Stroke Aggregator | 0.08772685241699217 | distance: 0.08773variant: vectorized (shape strokes) 500px | 50.0 |
| Mastering Sketching | 0.4452864379882813 | distance: 0.44529variant: vectorized (shape strokes) 500px | 6.0 |
| Poly Vector | 0.03080584335327148 | distance: 0.03081variant: vectorized (shape strokes) 1000px | 311.0 |
| Real-Time Inking | 0.03413209533691406 | distance: 0.03413variant: vectorized (shape strokes) 1000px | 3.0 |
| Stroke Aggregator | 0.030416036035470256 | distance: 0.03042variant: vectorized (shape strokes) | 826.0 |
| Topology Driven → Stroke Aggregator | 0.032802440643310546 | distance: 0.0328variant: vectorized (shape strokes) 500px | 556.0 |
| Topology Driven | 0.030528675079345705 | distance: 0.03053variant: vectorized (shape strokes) 1000px | 48.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
||||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded 500px |  |
 |
|
|
|
 |
 |
|
 |
||||||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| vectorized (all layers) 500px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
||||
| vectorized (shape strokes) 1000px | |
 |
|
 |
 |
|
|
 |
|
|
|||||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
 |
|
|
 |
|
||
| vectorized (shape strokes) | |