A Benchmark for Rough Sketch Cleanup
Art_freeform_JD_01
Author: Janediamond2901 Author Homepage: https://www.deviantart.com/janediamond2901 Licence: CC-BY-3.0Messiness: 0.07546
Ambiguity (Chamfer): 0.0377
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Real-Time Inking | Fidelity Simplicity | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00075 |  distance: 0.00084 |  distance: 0.00087 |  distance: 0.001 |  distance: 0.00219 |  distance: 0.00226 |  distance: 0.00407 |  distance: 0.00407 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.004066285026644867 | distance: 0.00407variant: thresholded | 37.0 |
| Fidelity Simplicity | 0.0021939235641765913 | distance: 0.00219variant: originalalg. parameter: 0.3 | 238.0 |
| Mastering Sketching | 0.0007502999900397308 | distance: 0.00075variant: vectorized (shape strokes) 1000px | 7.0 |
| Poly Vector | 0.0008728194578125043 | distance: 0.00087variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 750.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.002260538808683052 | distance: 0.00226variant: vectorized (shape strokes) 500px | 1013.0 |
| Topology Driven | 0.0008408976641645768 | distance: 0.00084variant: vectorized (shape strokes) 1000px | 55.0 |
| Poly Vector → Stroke Aggregator | 0.004071419160657625 | distance: 0.00407variant: vectorized (all layers) 500pxalg. parameter: noisy | 74.0 |
| Real-Time Inking | 0.001004640947055341 | distance: 0.001variant: thresholded | 3.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.27805269666325866 |  distance: 0.27805variant: originalalg. parameter: noisy | 59.0 |
| Poly Vector | 0.2839227167709934 |  distance: 0.28392variant: original | 393.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.2440368749704412 |  distance: 0.24404variant: vectorized (shape strokes) 500px | 3.0 |
| Mastering Sketching | 0.8123099916524187 |  distance: 0.81231variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.6893855521782357 |  distance: 0.68939variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.3913517356213713 |  distance: 0.39135variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 125.0 |
| Topology Driven → Stroke Aggregator | 0.5816616781713815 |  distance: 0.58166variant: thresholded 500px | 745.0 |
| Topology Driven | 0.6618698177493915 |  distance: 0.66187variant: original | 29.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.38040076211819 | distance: 0.3804variant: originalalg. parameter: noisy | 59.0 |
| Poly Vector | 0.3839453456683895 |  distance: 0.38395variant: originalalg. parameter: noisy | 399.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7198875493567315 |  distance: 0.71989variant: original | 502.0 |
| Delaunay Triangulation | 0.39201041653777297 | distance: 0.39201variant: vectorized (shape strokes) 500px | 3.0 |
| Mastering Sketching | 0.8939944059914233 |  distance: 0.89399variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.7771658307237787 | distance: 0.77717variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.5336540222951828 | distance: 0.53365variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 125.0 |
| Topology Driven | 0.7497659782627653 | distance: 0.74977variant: original | 29.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.4548230914556339 |  distance: 0.45482variant: original | 58.0 |
| Poly Vector | 0.4615523065859918 | distance: 0.46155variant: originalalg. parameter: noisy | 399.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7766132043698191 | distance: 0.77661variant: original | 502.0 |
| Delaunay Triangulation | 0.5190363267344661 |  distance: 0.51904variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.6400789936791764 | distance: 0.64008variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 125.0 |
| Mastering Sketching | 0.9335121763279765 | distance: 0.93351variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.837403835151921 | distance: 0.8374variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.8028548746537391 | distance: 0.80285variant: original | 29.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.5098455463643832 | distance: 0.50985variant: originalalg. parameter: noisy | 59.0 |
| Poly Vector | 0.5138047775238025 | distance: 0.5138variant: originalalg. parameter: noisy | 399.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8150649658055529 | distance: 0.81506variant: original | 502.0 |
| Topology Driven | 0.8391011256592207 | distance: 0.8391variant: original | 29.0 |
| Delaunay Triangulation | 0.6023844126933907 | distance: 0.60238variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.7082793664904781 |  distance: 0.70828variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 168.0 |
| Mastering Sketching | 0.9575906931833692 | distance: 0.95759variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8804666338810184 | distance: 0.88047variant: vectorized (all layers) 500px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.5554131580984492 | distance: 0.55541variant: originalalg. parameter: noisy | 59.0 |
| Poly Vector | 0.5578081561720616 | distance: 0.55781variant: originalalg. parameter: noisy | 399.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8432921909624952 | distance: 0.84329variant: original | 502.0 |
| Topology Driven | 0.8652315213586702 | distance: 0.86523variant: original | 29.0 |
| Delaunay Triangulation | 0.6890336020293102 | distance: 0.68903variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.7613138911934838 | distance: 0.76131variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 168.0 |
| Mastering Sketching | 0.97481854253363 | distance: 0.97482variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.9164818625249576 | distance: 0.91648variant: vectorized (all layers) 500px | 2.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.21931712341308596 |  distance: 0.21932variant: thresholded 500px | 5.0 |
| Poly Vector | 0.035735137939453133 |  distance: 0.03574variant: vectorized (all layers) 1000pxalg. parameter: noisy | 1021.0 |
| Real-Time Inking | 0.033837848663330075 |  distance: 0.03384variant: vectorized (shape strokes) 1000px | 4.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.036933217048645016 | distance: 0.03693variant: thresholded | 37.0 |
| Fidelity Simplicity | 0.06826533794403078 |  distance: 0.06827variant: originalalg. parameter: 0.75 | 315.0 |
| Poly Vector → Stroke Aggregator | 0.06356099319458007 | distance: 0.06356variant: vectorized (all layers) 500pxalg. parameter: noisy | 74.0 |
| Topology Driven → Stroke Aggregator | 0.05325410842895508 | distance: 0.05325variant: vectorized (shape strokes) 500px | 1013.0 |
| Topology Driven | 0.023409399032592773 |  distance: 0.02341variant: vectorized (shape strokes) 500px | 16.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
 |
|
 |
|
|
|
 |
|
|
||
| thresholded | |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| thresholded 500px | |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
 |
|
 |
 |
||||
| vectorized (all layers) 500px | |
|
 |
|
 |
 |
|
 |
 |
 |
|
|
|||
| vectorized (shape strokes) 1000px | |
|
 |
 |
 |
 |
 |
|
|
 |
 |
||||
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
|