A Benchmark for Rough Sketch Cleanup
Ind_architecture_JJ_03
Author: Jinho Jung Author Homepage: https://www.flickr.com/photos/phploveme/ Licence: CC-BY-SA-2.0Messiness: 0.1219
Ambiguity (Chamfer): 0.09212
Shading: No
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector | Topology Driven | Real-Time Inking | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0012 |  distance: 0.00129 |  distance: 0.00135 |  distance: 0.0019 |  distance: 0.00317 |  distance: 0.00388 |  distance: 0.00635 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.006350175384658806 | distance: 0.00635variant: original | 524.0 |
| Fidelity Simplicity | 0.003173246227429941 | distance: 0.00317variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 190.0 |
| Mastering Sketching | 0.0011986328087783505 | distance: 0.0012variant: vectorized (shape strokes) 1000px | 10.0 |
| Poly Vector → Stroke Aggregator | 0.00388389768574806 | distance: 0.00388variant: vectorized (all layers) 500pxalg. parameter: noisy | 166.0 |
| Poly Vector | 0.0012947755132819187 | distance: 0.00129variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 613.0 |
| Real-Time Inking | 0.0018968814220039734 | distance: 0.0019variant: vectorized (shape strokes) 1000px | 3.0 |
| Topology Driven | 0.0013521785068275891 | distance: 0.00135variant: vectorized (shape strokes) 1000px | 48.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.18777914274804766 |  distance: 0.18778variant: vectorized (all layers) 500px | 8.0 |
| Mastering Sketching | 0.6878069288846775 |  distance: 0.68781variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5335537776813423 | distance: 0.53355variant: vectorized (all layers) 500pxalg. parameter: noisy | 166.0 |
| Poly Vector | 0.5264558566703571 |  distance: 0.52646variant: vectorized (shape strokes) 500px | 256.0 |
| Real-Time Inking | 0.6316124615680101 |  distance: 0.63161variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.2705153843235905 |  distance: 0.27052variant: original | 111.0 |
| Fidelity Simplicity | 0.3964158947524287 |  distance: 0.39642variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 173.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3137370897608037 | distance: 0.31374variant: vectorized (all layers) 500px | 8.0 |
| Mastering Sketching | 0.8090823988137446 |  distance: 0.80908variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6815574338180138 | distance: 0.68156variant: vectorized (all layers) 500pxalg. parameter: noisy | 166.0 |
| Poly Vector | 0.6518249429045013 |  distance: 0.65182variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 268.0 |
| Real-Time Inking | 0.7468596084656357 | distance: 0.74686variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.38198204016069465 | distance: 0.38198variant: original | 111.0 |
| Fidelity Simplicity | 0.5513725130134779 |  distance: 0.55137variant: thresholded 500pxalg. parameter: 0.6 | 164.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4291195400291167 | distance: 0.42912variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.6537408109342651 |  distance: 0.65374variant: thresholded 500pxalg. parameter: 0.25 | 153.0 |
| Poly Vector → Stroke Aggregator | 0.7740311375944784 | distance: 0.77403variant: vectorized (all layers) 500pxalg. parameter: noisy | 166.0 |
| Poly Vector | 0.7372552748503615 | distance: 0.73726variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 268.0 |
| Real-Time Inking | 0.8080059905933735 | distance: 0.80801variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.4713101022971654 | distance: 0.47131variant: original | 111.0 |
| Mastering Sketching | 0.865416709739376 | distance: 0.86542variant: vectorized (all layers) 500px | 5.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5205735434372656 | distance: 0.52057variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.7103591574632359 |  distance: 0.71036variant: thresholded 500pxalg. parameter: 0.75 | 175.0 |
| Poly Vector → Stroke Aggregator | 0.8292640910484727 | distance: 0.82926variant: vectorized (all layers) 500pxalg. parameter: noisy | 166.0 |
| Poly Vector | 0.7889588237613157 | distance: 0.78896variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 268.0 |
| Real-Time Inking | 0.8457112155862996 | distance: 0.84571variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.5542048659917835 | distance: 0.5542variant: original | 111.0 |
| Mastering Sketching | 0.8908856515756463 | distance: 0.89089variant: vectorized (all layers) 500px | 5.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6139824284391899 | distance: 0.61398variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.7652367506910509 | distance: 0.76524variant: thresholded 500pxalg. parameter: 0.25 | 153.0 |
| Poly Vector → Stroke Aggregator | 0.8692704097492394 | distance: 0.86927variant: vectorized (all layers) 500pxalg. parameter: noisy | 166.0 |
| Poly Vector | 0.8248056674108232 | distance: 0.82481variant: vectorized (shape strokes) 500px | 256.0 |
| Real-Time Inking | 0.8750414290067771 | distance: 0.87504variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.6128416822038363 | distance: 0.61284variant: original | 111.0 |
| Mastering Sketching | 0.9118248493606348 | distance: 0.91182variant: vectorized (all layers) 500px | 5.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.08944271850585937 |  distance: 0.08944variant: thresholded 500px | 8.0 |
| Fidelity Simplicity | 0.09338094329833983 |  distance: 0.09338variant: thresholded 1000pxalg. parameter: 0.5 | 1740.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Mastering Sketching | 0.21824755859375 |  distance: 0.21825variant: vectorized (shape strokes) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.08052328491210937 | distance: 0.08052variant: vectorized (all layers) 500pxalg. parameter: noisy | 166.0 |
| Poly Vector | 0.045 | distance: 0.045variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 613.0 |
| Real-Time Inking | 0.045 | distance: 0.045variant: vectorized (shape strokes) 1000px | 3.0 |
| Topology Driven | 0.044271888732910165 |  distance: 0.04427variant: vectorized (shape strokes) 500px | 14.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
|
|
||||||||||||
| thresholded |  |
 |
 |
||||||||||||
| thresholded 1000px |  |
 |
 |
|
 |
 |
 |
 |
 |
||||||
| thresholded 500px |  |
 |
 |
|
 |
|
|
 |
 |
 |
|
||||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
|
 |
 |
 |
 |
|
|
 |
||
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
|
 |
 |
||||
| vectorized (shape strokes) 500px |  |
|
 |
 |
 |
 |
 |
|
|
|
 |