A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_05
Author: Enrique Rosales Licence: Academic PaperMessiness: 0.20715
Ambiguity (Chamfer): 0.09657
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Poly Vector → Stroke Aggregator | Mastering Sketching | Real-Time Inking | Topology Driven | Stroke Aggregator | Poly Vector | Fidelity Simplicity | Delaunay Triangulation | Topology Driven → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00123 |  distance: 0.00143 |  distance: 0.00187 |  distance: 0.00188 |  distance: 0.00196 |  distance: 0.00196 |  distance: 0.00208 |  distance: 0.00249 |  distance: 0.00299 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.0018651367731147746 | distance: 0.00187variant: original 1000px | 3.0 |
| Delaunay Triangulation | 0.002491672298545484 | distance: 0.00249variant: original | 12.0 |
| Fidelity Simplicity | 0.0020763210994683137 | distance: 0.00208variant: original 1000pxalg. parameter: 0.25 | 210.0 |
| Mastering Sketching | 0.0014336132911409256 | distance: 0.00143variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0012323045836042225 | distance: 0.00123variant: originalalg. parameter: noisy | 1409.0 |
| Poly Vector | 0.0019579085897247976 | distance: 0.00196variant: original | 374.0 |
| Stroke Aggregator | 0.001956791973679005 | distance: 0.00196variant: vectorized (all layers) | 1520.0 |
| Topology Driven → Stroke Aggregator | 0.0029940583039148746 | distance: 0.00299variant: original 500px | 191.0 |
| Topology Driven | 0.0018803888453851716 | distance: 0.00188variant: original | 52.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2484088542625525 |  distance: 0.24841variant: originalalg. parameter: 0.3 | 258.0 |
| Stroke Aggregator | 0.6574931756170393 | distance: 0.65749variant: vectorized (all layers) | 1520.0 |
| Poly Vector → Stroke Aggregator | 0.6846592692506508 |  distance: 0.68466variant: original | 1411.0 |
| Topology Driven | 0.6129081242093929 | distance: 0.61291variant: original | 52.0 |
| Delaunay Triangulation | 0.37714707408925335 |  distance: 0.37715variant: original 500px | 2.0 |
| Mastering Sketching | 0.7231179873349731 |  distance: 0.72312variant: original 1000px | 6.0 |
| Poly Vector | 0.5876645896200274 |  distance: 0.58766variant: original 500px | 64.0 |
| Real-Time Inking | 0.6226654458734435 |  distance: 0.62267variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.5832862196673552 | distance: 0.58329variant: original 500px | 191.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5924440170483325 | distance: 0.59244variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.3941637908215218 |  distance: 0.39416variant: originalalg. parameter: 0.6 | 265.0 |
| Mastering Sketching | 0.8473859129781701 | distance: 0.84739variant: original 1000px | 6.0 |
| Stroke Aggregator | 0.8211067922674747 | distance: 0.82111variant: vectorized (all layers) | 1520.0 |
| Topology Driven → Stroke Aggregator | 0.7685223313030911 | distance: 0.76852variant: original 500px | 191.0 |
| Topology Driven | 0.8052965415815541 | distance: 0.8053variant: original | 52.0 |
| Poly Vector → Stroke Aggregator | 0.8614243405862977 |  distance: 0.86142variant: original 1000px | 370.0 |
| Real-Time Inking | 0.817630310636135 | distance: 0.81763variant: original | 3.0 |
| Poly Vector | 0.7315851341513774 |  distance: 0.73159variant: original 500pxalg. parameter: noisy | 69.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7454231890617479 | distance: 0.74542variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.4634789663229486 |  distance: 0.46348variant: originalalg. parameter: 0.25 | 252.0 |
| Mastering Sketching | 0.9035379369981944 | distance: 0.90354variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9359122905659456 | distance: 0.93591variant: original 1000px | 370.0 |
| Real-Time Inking | 0.8868297521768066 | distance: 0.88683variant: original | 3.0 |
| Stroke Aggregator | 0.8907330313416181 | distance: 0.89073variant: vectorized (all layers) | 1520.0 |
| Topology Driven → Stroke Aggregator | 0.8588591768539975 | distance: 0.85886variant: original 500px | 191.0 |
| Topology Driven | 0.8812777010940415 |  distance: 0.88128variant: original 500px | 8.0 |
| Poly Vector | 0.8125884560231876 | distance: 0.81259variant: original 500px | 64.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8139360088660336 | distance: 0.81394variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.4976293818585882 |  distance: 0.49763variant: originalalg. parameter: 0.75 | 301.0 |
| Mastering Sketching | 0.9401667397981569 | distance: 0.94017variant: original 1000px | 6.0 |
| Real-Time Inking | 0.9285616984840523 | distance: 0.92856variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.9077937262180641 | distance: 0.90779variant: original 500px | 191.0 |
| Topology Driven | 0.9219173283552152 | distance: 0.92192variant: original 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.9694991329092526 |  distance: 0.9695variant: original 1000pxalg. parameter: noisy | 368.0 |
| Poly Vector | 0.8616014383112807 | distance: 0.8616variant: original 500px | 64.0 |
| Stroke Aggregator | 0.93424950795965 | distance: 0.93425variant: vectorized (all layers) | 1520.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5237114142087155 | distance: 0.52371variant: originalalg. parameter: 0.75 | 301.0 |
| Poly Vector | 0.8930725570878456 | distance: 0.89307variant: original 500pxalg. parameter: noisy | 69.0 |
| Real-Time Inking | 0.956266231919774 | distance: 0.95627variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.9389985842511066 | distance: 0.939variant: original 500px | 191.0 |
| Topology Driven | 0.9468589083217742 | distance: 0.94686variant: original 500px | 8.0 |
| Delaunay Triangulation | 0.8518300936011352 | distance: 0.85183variant: original 500px | 2.0 |
| Mastering Sketching | 0.9645557899068882 | distance: 0.96456variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9860669938838468 | distance: 0.98607variant: original 1000pxalg. parameter: noisy | 368.0 |
| Stroke Aggregator | 0.9492458905244516 | distance: 0.94925variant: vectorized (all layers) | 1520.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.021442949040271744 | distance: 0.02144variant: original | 12.0 |
| Fidelity Simplicity | 0.0344093017578125 |  distance: 0.03441variant: original 1000pxalg. parameter: 0.5 | 221.0 |
| Mastering Sketching | 0.2377393493652344 | distance: 0.23774variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.010108303249097473 | distance: 0.01011variant: original | 1411.0 |
| Poly Vector | 0.021260292053222656 |  distance: 0.02126variant: original 1000px | 200.0 |
| Real-Time Inking | 0.02 |  distance: 0.02variant: original 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.02607680892944336 | distance: 0.02608variant: original 500px | 191.0 |
| Topology Driven | 0.021400934219360356 |  distance: 0.0214variant: original 1000px | 28.0 |
| Stroke Aggregator | 0.029611690810441113 | distance: 0.02961variant: vectorized (all layers) | 1520.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
 |
|
|
|
 |
|
|
|
|
|||
| original 1000px | |
|
 |
|
|
 |
 |
|
 |
|
 |
|
|
||
| original 500px | |
|
|
 |
 |
 |
 |
 |
|
|
|
|
|||
| vectorized (all layers) | |