A Benchmark for Rough Sketch Cleanup
Ind_architecture_GD_03
Author: Guillaume Dufour Licence: CC-BY-NC-SA-4.0Messiness: 0.0113
Ambiguity (Chamfer): 0.02051
Shading: No
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Real-Time Inking | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Poly Vector → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00037 |  distance: 0.00044 |  distance: 0.00054 |  distance: 0.00086 |  distance: 0.00177 |  distance: 0.00304 |  distance: 0.00378 |  distance: 0.00678 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Poly Vector → Stroke Aggregator | 0.0037833951178313243 | distance: 0.00378variant: thresholded 500pxalg. parameter: noisy | 171.0 |
| Delaunay Triangulation | 0.003044666755467885 | distance: 0.00304variant: thresholded | 561.0 |
| Fidelity Simplicity | 0.006784615329990314 | distance: 0.00678variant: vectorized (all layers) 1000pxalg. parameter: 0.3 | 161.0 |
| Mastering Sketching | 0.00037315363944968063 | distance: 0.00037variant: thresholded 1000px | 6.0 |
| Poly Vector | 0.0005382457924553163 | distance: 0.00054variant: vectorized (all layers) 1000px | 954.0 |
| Real-Time Inking | 0.0008590680818416863 | distance: 0.00086variant: vectorized (all layers) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.0017664320612720715 | distance: 0.00177variant: vectorized (all layers) 500px | 1761.0 |
| Topology Driven | 0.0004415462360377249 | distance: 0.00044variant: vectorized (all layers) 1000px | 67.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7122312370986872 | distance: 0.71223variant: vectorized (all layers) 500px | 1761.0 |
| Topology Driven | 0.8874267733848679 |  distance: 0.88743variant: vectorized (all layers) 500px | 19.0 |
| Delaunay Triangulation | 0.2742792870332501 |  distance: 0.27428variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.2794196973568407 |  distance: 0.27942variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 1709.0 |
| Mastering Sketching | 0.9080810806542764 |  distance: 0.90808variant: thresholded 500px | 5.0 |
| Real-Time Inking | 0.6880003448759292 |  distance: 0.688variant: thresholded | 4.0 |
| Poly Vector → Stroke Aggregator | 0.5785263797180101 |  distance: 0.57853variant: vectorized (all layers) 500px | 104.0 |
| Poly Vector | 0.6014232123192172 |  distance: 0.60142variant: vectorized (all layers) 500px | 295.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4229488483951531 | distance: 0.42295variant: vectorized (all layers) 500px | 8.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.3972407526917541 | distance: 0.39724variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 1709.0 |
| Mastering Sketching | 0.94895351590114 |  distance: 0.94895variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.7479360414011852 | distance: 0.74794variant: thresholded | 4.0 |
| Poly Vector → Stroke Aggregator | 0.6998152665075977 | distance: 0.69982variant: vectorized (all layers) 500px | 104.0 |
| Poly Vector | 0.7136587782528703 |  distance: 0.71366variant: vectorized (all layers) 500pxalg. parameter: noisy | 313.0 |
| Topology Driven → Stroke Aggregator | 0.8613960741287182 | distance: 0.8614variant: vectorized (all layers) 500px | 1761.0 |
| Topology Driven | 0.947684794030088 |  distance: 0.94768variant: thresholded 500px | 25.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4823005896733625 | distance: 0.4823variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 1709.0 |
| Poly Vector → Stroke Aggregator | 0.7772067414837668 |  distance: 0.77721variant: vectorized (all layers) 500pxalg. parameter: noisy | 105.0 |
| Poly Vector | 0.7861997927177348 | distance: 0.7862variant: vectorized (all layers) 500px | 295.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9385032924015824 | distance: 0.9385variant: vectorized (all layers) 500px | 1761.0 |
| Topology Driven | 0.9726260111470022 | distance: 0.97263variant: thresholded 500px | 25.0 |
| Delaunay Triangulation | 0.5446597688370736 | distance: 0.54466variant: vectorized (all layers) 500px | 8.0 |
| Mastering Sketching | 0.9664693355509276 | distance: 0.96647variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.7951669692747074 | distance: 0.79517variant: thresholded | 4.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5356759705671473 | distance: 0.53568variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 1709.0 |
| Poly Vector → Stroke Aggregator | 0.8207123077463975 | distance: 0.82071variant: vectorized (all layers) 500pxalg. parameter: noisy | 105.0 |
| Poly Vector | 0.8269304296759001 | distance: 0.82693variant: vectorized (all layers) 500pxalg. parameter: noisy | 313.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.967643373364958 | distance: 0.96764variant: vectorized (all layers) 500px | 1761.0 |
| Topology Driven | 0.984259586898908 | distance: 0.98426variant: thresholded 500px | 25.0 |
| Delaunay Triangulation | 0.6318713453782425 | distance: 0.63187variant: vectorized (all layers) 500px | 8.0 |
| Mastering Sketching | 0.9742956266967706 |  distance: 0.9743variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8301903089853909 | distance: 0.83019variant: thresholded | 4.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7162779293223404 | distance: 0.71628variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.5817841168272131 | distance: 0.58178variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 1709.0 |
| Poly Vector → Stroke Aggregator | 0.8589020569404714 | distance: 0.8589variant: vectorized (all layers) 500px | 104.0 |
| Poly Vector | 0.8635771651834165 | distance: 0.86358variant: vectorized (all layers) 500pxalg. parameter: noisy | 313.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9814714008847236 | distance: 0.98147variant: vectorized (all layers) 500px | 1761.0 |
| Mastering Sketching | 0.9812098040959072 | distance: 0.98121variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8582436918973941 | distance: 0.85824variant: thresholded | 4.0 |
| Topology Driven | 0.9907932779918912 | distance: 0.99079variant: thresholded 500px | 25.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.21208488464355468 | distance: 0.21208variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.08786353302001954 |  distance: 0.08786variant: thresholded 500px | 172.0 |
| Poly Vector | 0.025 |  distance: 0.025variant: vectorized (all layers) 1000pxalg. parameter: noisy | 1021.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.03224903106689453 | distance: 0.03225variant: vectorized (all layers) 500px | 1761.0 |
| Delaunay Triangulation | 0.04024922180175782 |  distance: 0.04025variant: thresholded 1000px | 32.0 |
| Fidelity Simplicity | 0.11128791809082032 | distance: 0.11129variant: vectorized (all layers) 1000pxalg. parameter: 0.3 | 161.0 |
| Real-Time Inking | 0.027730848312377928 |  distance: 0.02773variant: thresholded 1000px | 6.0 |
| Topology Driven | 0.02039607810974121 | distance: 0.0204variant: vectorized (all layers) 500px | 19.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
|||||||||||||
| thresholded | |
|
|||||||||||||
| thresholded 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
||||
| thresholded 500px |  |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
|
|
||
| vectorized (all layers) 1000px | |
|
|
 |
 |
 |
 |
|
|
|
 |
||||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
|
 |
|
|
|
|
|
|