A Benchmark for Rough Sketch Cleanup
Ind_architecture_JJ_02
Author: Jinho Jung Author Homepage: https://www.flickr.com/photos/phploveme/ Licence: CC-BY-SA-2.0Messiness: 0.08445
Ambiguity (Chamfer): 0.13051
Shading: No
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Mastering Sketching | Poly Vector | Real-Time Inking | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00106 |  distance: 0.00107 |  distance: 0.00116 |  distance: 0.00127 |  distance: 0.00204 |  distance: 0.00229 |  distance: 0.00276 |  distance: 0.00484 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.0027568683074625736 | distance: 0.00276variant: vectorized (all layers) 1000pxalg. parameter: 0.25 | 197.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.004835936018686464 | distance: 0.00484variant: thresholded | 96.0 |
| Mastering Sketching | 0.0010652368549360117 | distance: 0.00107variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.00229148845275918 | distance: 0.00229variant: thresholded 500pxalg. parameter: noisy | 132.0 |
| Poly Vector | 0.001156215644861291 | distance: 0.00116variant: thresholded 1000pxalg. parameter: noisy | 685.0 |
| Real-Time Inking | 0.001272711716075546 | distance: 0.00127variant: thresholded 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.002039675078962236 | distance: 0.00204variant: thresholded 500px | 672.0 |
| Topology Driven | 0.0010569709304338068 | distance: 0.00106variant: thresholded | 181.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2080449422173036 |  distance: 0.20804variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5334233750182892 |  distance: 0.53342variant: vectorized (all layers) 500pxalg. parameter: noisy | 87.0 |
| Poly Vector | 0.04246163159917021 |  distance: 0.04246variant: original | 538.0 |
| Real-Time Inking | 0.22428237388365854 |  distance: 0.22428variant: original | 6.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6200877060288639 |  distance: 0.62009variant: vectorized (shape strokes) 500px | 517.0 |
| Topology Driven | 0.12002624438589612 |  distance: 0.12003variant: original | 15.0 |
| Fidelity Simplicity | 0.3286633863768866 |  distance: 0.32866variant: thresholded 500pxalg. parameter: 0.75 | 172.0 |
| Mastering Sketching | 0.7864371560615352 |  distance: 0.78644variant: thresholded 500px | 5.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.328036903631831 | distance: 0.32804variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6665075261649586 | distance: 0.66651variant: vectorized (all layers) 500pxalg. parameter: noisy | 87.0 |
| Poly Vector | 0.07387142771870953 |  distance: 0.07387variant: originalalg. parameter: noisy | 563.0 |
| Real-Time Inking | 0.2792696469183245 | distance: 0.27927variant: original | 6.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.1948350275551554 | distance: 0.19484variant: original | 15.0 |
| Fidelity Simplicity | 0.4469454980219309 | distance: 0.44695variant: thresholded 500pxalg. parameter: 0.75 | 172.0 |
| Mastering Sketching | 0.8531569845005932 | distance: 0.85316variant: thresholded 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.7801523270473241 | distance: 0.78015variant: vectorized (shape strokes) 500px | 517.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4452978811646122 | distance: 0.4453variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.7591100979686791 | distance: 0.75911variant: vectorized (all layers) 500pxalg. parameter: noisy | 87.0 |
| Poly Vector | 0.10175025061638084 | distance: 0.10175variant: originalalg. parameter: noisy | 563.0 |
| Real-Time Inking | 0.3339115690002227 | distance: 0.33391variant: original | 6.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.2732855609129432 | distance: 0.27329variant: original | 15.0 |
| Fidelity Simplicity | 0.5394177328743045 | distance: 0.53942variant: thresholded 500pxalg. parameter: 0.75 | 172.0 |
| Mastering Sketching | 0.8850243700521945 | distance: 0.88502variant: thresholded 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.8511026555423001 | distance: 0.8511variant: thresholded 500px | 672.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.8159997656741489 | distance: 0.816variant: vectorized (all layers) 500pxalg. parameter: noisy | 87.0 |
| Poly Vector | 0.13119323561969032 | distance: 0.13119variant: original | 538.0 |
| Real-Time Inking | 0.3782394175094576 | distance: 0.37824variant: original | 6.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.34050531732242684 | distance: 0.34051variant: original | 15.0 |
| Delaunay Triangulation | 0.5315416386955355 | distance: 0.53154variant: vectorized (all layers) 500px | 6.0 |
| Fidelity Simplicity | 0.6023872281816945 | distance: 0.60239variant: thresholded 500pxalg. parameter: 0.75 | 172.0 |
| Mastering Sketching | 0.9049474594186336 | distance: 0.90495variant: thresholded 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.8835498811089527 | distance: 0.88355variant: thresholded 500px | 672.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.8615699462887499 | distance: 0.86157variant: vectorized (all layers) 500pxalg. parameter: noisy | 87.0 |
| Poly Vector | 0.15939839747799814 | distance: 0.1594variant: original | 538.0 |
| Real-Time Inking | 0.4174411862106501 | distance: 0.41744variant: original | 6.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.4011083869174572 | distance: 0.40111variant: original | 15.0 |
| Delaunay Triangulation | 0.6276626217161524 | distance: 0.62766variant: vectorized (all layers) 500px | 6.0 |
| Fidelity Simplicity | 0.6539364995691751 |  distance: 0.65394variant: thresholded 500pxalg. parameter: 0.3 | 123.0 |
| Mastering Sketching | 0.9220744227012624 | distance: 0.92207variant: thresholded 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.9056957317218756 | distance: 0.9057variant: thresholded 500px | 672.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Mastering Sketching | 0.2688382263183593 |  distance: 0.26884variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.040496913909912106 | distance: 0.0405variant: thresholded 500pxalg. parameter: noisy | 132.0 |
| Poly Vector | 0.039849716186523436 |  distance: 0.03985variant: thresholded 500pxalg. parameter: noisy | 208.0 |
| Topology Driven → Stroke Aggregator | 0.032 | distance: 0.032variant: thresholded 500px | 672.0 |
| Topology Driven | 0.032 |  distance: 0.032variant: thresholded 500px | 12.0 |
| Delaunay Triangulation | 0.05707889175415039 |  distance: 0.05708variant: vectorized (all layers) 1000px | 23.0 |
| Fidelity Simplicity | 0.0653681869506836 |  distance: 0.06537variant: vectorized (all layers) 1000pxalg. parameter: 0.3 | 212.0 |
| Real-Time Inking | 0.043 |  distance: 0.043variant: vectorized (all layers) 1000px | 3.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
|
|||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
|
|
|||||||
| thresholded 1000px | |
|
 |
 |
 |
 |
 |
 |
|
 |
 |
||||
| thresholded 500px | |
 |
|
|
 |
 |
|
 |
|
|
 |
 |
|
 |
|
| vectorized (all layers) 1000px | |
|
|
|
 |
 |
 |
 |
 |
 |
|
||||
| vectorized (all layers) 500px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
|||
| vectorized (shape strokes) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |