A Benchmark for Rough Sketch Cleanup
Art_freeform_MP_01
Author: Anastasia Majzhegisheva (aka Morevna Project) Author Homepage: https://morevnaproject.org/category/artists/anastasia-majzhegisheva/ Licence: CC-BY-4.0Messiness: 0.17289
Ambiguity (Chamfer): 0.29445
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Real-Time Inking | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00348 |  distance: 0.00348 |  distance: 0.00353 |  distance: 0.0036 |  distance: 0.00456 |  distance: 0.00557 |  distance: 0.0058 |  distance: 0.00894 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.0055685784885861215 | distance: 0.00557variant: original | 362.0 |
| Fidelity Simplicity | 0.0057953269273432854 | distance: 0.0058variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 1724.0 |
| Mastering Sketching | 0.003477007383564309 | distance: 0.00348variant: vectorized (shape strokes) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.00893609891780158 | distance: 0.00894variant: vectorized (all layers) 500pxalg. parameter: noisy | 35.0 |
| Poly Vector | 0.003527145301232264 | distance: 0.00353variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 314.0 |
| Real-Time Inking | 0.0036009457242171423 | distance: 0.0036variant: vectorized (shape strokes) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.0045582468712376594 | distance: 0.00456variant: thresholded 1000px | 1344.0 |
| Topology Driven | 0.003483529425042139 | distance: 0.00348variant: vectorized (shape strokes) 1000px | 39.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2309086644492781 |  distance: 0.23091variant: thresholded 500px | 21.0 |
| Fidelity Simplicity | 0.19753127783376867 |  distance: 0.19753variant: thresholded 500pxalg. parameter: 0.6 | 221.0 |
| Mastering Sketching | 0.4277191099163565 |  distance: 0.42772variant: vectorized (all layers) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.23339990544108244 |  distance: 0.2334variant: vectorized (shape strokes) 500px | 28.0 |
| Poly Vector | 0.23695567745424195 |  distance: 0.23696variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 162.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.3405530288268193 |  distance: 0.34055variant: thresholded 500px | 1135.0 |
| Real-Time Inking | 0.2271516281431704 |  distance: 0.22715variant: original | 3.0 |
| Topology Driven | 0.038373542585280425 |  distance: 0.03837variant: original | 74.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3661576677151952 | distance: 0.36616variant: thresholded 500px | 21.0 |
| Fidelity Simplicity | 0.3028122561414067 |  distance: 0.30281variant: thresholded 500pxalg. parameter: 0.75 | 255.0 |
| Mastering Sketching | 0.5813852265502785 | distance: 0.58139variant: vectorized (all layers) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.35816846753217124 |  distance: 0.35817variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 29.0 |
| Poly Vector | 0.3661748041990876 | distance: 0.36617variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 162.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5142673715640769 | distance: 0.51427variant: thresholded 500px | 1135.0 |
| Real-Time Inking | 0.3322004474397968 | distance: 0.3322variant: original | 3.0 |
| Topology Driven | 0.07755454512396838 | distance: 0.07755variant: original | 74.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5037910150473379 | distance: 0.50379variant: thresholded 500px | 21.0 |
| Fidelity Simplicity | 0.422981063188966 | distance: 0.42298variant: thresholded 500pxalg. parameter: 0.75 | 255.0 |
| Mastering Sketching | 0.691376034469563 | distance: 0.69138variant: vectorized (all layers) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.4727039839008127 | distance: 0.4727variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 29.0 |
| Poly Vector | 0.4813601524971126 | distance: 0.48136variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 162.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6493837473298799 | distance: 0.64938variant: thresholded 500px | 1135.0 |
| Real-Time Inking | 0.4139182600932577 | distance: 0.41392variant: original | 3.0 |
| Topology Driven | 0.11061745491021342 | distance: 0.11062variant: original | 74.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6040996492462812 | distance: 0.6041variant: thresholded 500px | 21.0 |
| Mastering Sketching | 0.7512853971332396 | distance: 0.75129variant: vectorized (all layers) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.5437270577504655 | distance: 0.54373variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 29.0 |
| Poly Vector | 0.5519654832378781 | distance: 0.55197variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 162.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7237571883752167 | distance: 0.72376variant: thresholded 500px | 1135.0 |
| Fidelity Simplicity | 0.5117403857419995 | distance: 0.51174variant: thresholded 500pxalg. parameter: 0.6 | 221.0 |
| Real-Time Inking | 0.4925060824192361 | distance: 0.49251variant: original | 3.0 |
| Topology Driven | 0.14118530637220947 | distance: 0.14119variant: original | 74.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7048362967481633 | distance: 0.70484variant: thresholded 500px | 21.0 |
| Fidelity Simplicity | 0.5935803753427349 | distance: 0.59358variant: thresholded 500pxalg. parameter: 0.75 | 255.0 |
| Mastering Sketching | 0.8051175090419738 | distance: 0.80512variant: vectorized (all layers) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.6110098128288134 | distance: 0.61101variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 29.0 |
| Poly Vector | 0.619999970984772 |  distance: 0.62variant: vectorized (shape strokes) 500px | 171.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7910512788575231 | distance: 0.79105variant: thresholded 500px | 1135.0 |
| Topology Driven | 0.16887724901741094 | distance: 0.16888variant: original | 74.0 |
| Real-Time Inking | 0.5461302409291081 | distance: 0.54613variant: original | 3.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.2557264099121094 |  distance: 0.25573variant: thresholded 500px | 5.0 |
| Real-Time Inking | 0.06372549019607843 |  distance: 0.06373variant: thresholded | 3.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.04753945541381836 |  distance: 0.04754variant: vectorized (shape strokes) 500px | 6.0 |
| Fidelity Simplicity | 0.07867036146276138 |  distance: 0.07867variant: thresholdedalg. parameter: 0.75 | 393.0 |
| Poly Vector → Stroke Aggregator | 0.0855102310180664 | distance: 0.08551variant: vectorized (all layers) 500pxalg. parameter: noisy | 35.0 |
| Poly Vector | 0.07624303436279296 |  distance: 0.07624variant: vectorized (all layers) 1000pxalg. parameter: noisy | 554.0 |
| Topology Driven → Stroke Aggregator | 0.07025667572021485 | distance: 0.07026variant: thresholded 500px | 1135.0 |
| Topology Driven | 0.07025667572021485 |  distance: 0.07026variant: thresholded 500px | 129.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
|
|
|||||||
| thresholded | |
 |
 |
 |
|
 |
 |
||||||||
| thresholded 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
||||||
| thresholded 500px | |
 |
|
 |
 |
 |
|
|
|
|
|||||
| vectorized (all layers) 1000px |  |
 |
|
 |
 |
||||||||||
| vectorized (all layers) 500px |  |
|
 |
 |
 |
 |
 |
 |
 |
|
 |
||||
| vectorized (shape strokes) 1000px | |
|
|
|
 |
 |
|||||||||
| vectorized (shape strokes) 500px |  |
|
 |
 |
 |
 |
 |
 |
|
|
|
|
|