A Benchmark for Rough Sketch Cleanup
Art_freeform_AP_01
Author: AP Licence: CC-BY-SA-3.0Messiness: 0.14723
Ambiguity (Chamfer): 0.0846
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Mastering Sketching | Real-Time Inking | Poly Vector | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00143 |  distance: 0.00145 |  distance: 0.00157 |  distance: 0.00163 |  distance: 0.00238 |  distance: 0.00252 |  distance: 0.00275 |  distance: 0.00383 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.002748481489447845 | distance: 0.00275variant: vectorized (shape strokes) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.002384650891068134 | distance: 0.00238variant: vectorized (all layers) 1000px | 907.0 |
| Poly Vector | 0.0016297043937133248 | distance: 0.00163variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 411.0 |
| Real-Time Inking | 0.0015740401734123464 | distance: 0.00157variant: thresholded 1000px | 3.0 |
| Topology Driven | 0.001427623887934531 | distance: 0.00143variant: thresholded | 369.0 |
| Fidelity Simplicity | 0.0038337056713354865 | distance: 0.00383variant: vectorized (all layers) 1000pxalg. parameter: 0.3 | 174.0 |
| Mastering Sketching | 0.0014487514064678336 | distance: 0.00145variant: vectorized (shape strokes) 1000px | 7.0 |
| Topology Driven → Stroke Aggregator | 0.002516319736834794 | distance: 0.00252variant: vectorized (shape strokes) 500px | 580.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3745603598158913 |  distance: 0.37456variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.385698601396885 |  distance: 0.3857variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 148.0 |
| Mastering Sketching | 0.6912705792714897 |  distance: 0.69127variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5771443947047136 |  distance: 0.57714variant: vectorized (all layers) 500px | 53.0 |
| Poly Vector | 0.6031948420345963 |  distance: 0.60319variant: vectorized (all layers) 500pxalg. parameter: noisy | 179.0 |
| Real-Time Inking | 0.6590877485501752 |  distance: 0.65909variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5781871709679814 |  distance: 0.57819variant: vectorized (all layers) 500px | 536.0 |
| Topology Driven | 0.6781084388001196 |  distance: 0.67811variant: vectorized (all layers) 500px | 11.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5521951727433968 | distance: 0.5522variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.5391854452458134 | distance: 0.53919variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 148.0 |
| Mastering Sketching | 0.8175491134531212 |  distance: 0.81755variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7228052865364059 |  distance: 0.72281variant: thresholded 500pxalg. parameter: noisy | 38.0 |
| Poly Vector | 0.7378555310084327 |  distance: 0.73786variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 118.0 |
| Real-Time Inking | 0.8050671689464426 |  distance: 0.80507variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7579084791201002 |  distance: 0.75791variant: thresholded 500px | 493.0 |
| Topology Driven | 0.8123369121413426 | distance: 0.81234variant: vectorized (all layers) 500px | 11.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6979865771812079 | distance: 0.69799variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.6560154958065133 |  distance: 0.65602variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 164.0 |
| Mastering Sketching | 0.8801315816943384 | distance: 0.88013variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.8176221584420539 |  distance: 0.81762variant: thresholded 500pxalg. parameter: noisy | 158.0 |
| Real-Time Inking | 0.8762545902734108 | distance: 0.87625variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8527276559661551 | distance: 0.85273variant: thresholded 500px | 493.0 |
| Topology Driven | 0.8820291975964325 | distance: 0.88203variant: vectorized (all layers) 500px | 11.0 |
| Poly Vector → Stroke Aggregator | 0.8004453727378165 |  distance: 0.80045variant: thresholded 500px | 37.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7755135873913019 | distance: 0.77551variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.7278369203362378 | distance: 0.72784variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 164.0 |
| Mastering Sketching | 0.9134132281308164 | distance: 0.91341variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.9142605864141412 | distance: 0.91426variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8978666835154201 | distance: 0.89787variant: thresholded 500px | 493.0 |
| Topology Driven | 0.9165866771605808 |  distance: 0.91659variant: thresholded 500px | 9.0 |
| Poly Vector → Stroke Aggregator | 0.8396442821773863 | distance: 0.83964variant: thresholded 500pxalg. parameter: noisy | 38.0 |
| Poly Vector | 0.8551060438290876 |  distance: 0.85511variant: thresholded 500px | 165.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.849137387346739 | distance: 0.84914variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.7958759450104899 | distance: 0.79588variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 164.0 |
| Mastering Sketching | 0.9437805379034672 | distance: 0.94378variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.9436553234535414 |  distance: 0.94366variant: original | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9318821742731184 | distance: 0.93188variant: thresholded 500px | 493.0 |
| Topology Driven | 0.9444678143273209 | distance: 0.94447variant: thresholded 500px | 9.0 |
| Poly Vector → Stroke Aggregator | 0.8732255096584046 | distance: 0.87323variant: thresholded 500px | 37.0 |
| Poly Vector | 0.8868949500416567 | distance: 0.88689variant: thresholded 500px | 165.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.033837848663330075 |  distance: 0.03384variant: thresholded 1000px | 8.0 |
| Fidelity Simplicity | 0.08156592559814453 |  distance: 0.08157variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 209.0 |
| Poly Vector → Stroke Aggregator | 0.040049968719482416 | distance: 0.04005variant: vectorized (all layers) 1000px | 907.0 |
| Poly Vector | 0.033241539001464836 |  distance: 0.03324variant: thresholded 1000pxalg. parameter: noisy | 558.0 |
| Real-Time Inking | 0.03360059356689453 | distance: 0.0336variant: thresholded 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.039849716186523436 | distance: 0.03985variant: vectorized (all layers) 500px | 536.0 |
| Topology Driven | 0.033526107788085936 | distance: 0.03353variant: thresholded 500px | 9.0 |
| Mastering Sketching | 0.2281403045654297 | distance: 0.22814variant: vectorized (shape strokes) 1000px | 7.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
||||||||||||
| thresholded |  |
|
 |
||||||||||||
| thresholded 1000px | |
 |
 |
 |
 |
 |
 |
 |
|
 |
|
||||
| thresholded 500px | |
 |
 |
 |
 |
 |
 |
 |
|
|
|
 |
|
|
|
| vectorized (all layers) 1000px | |
|
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
|
|
|
|
 |
|
 |
|
|
| vectorized (shape strokes) 1000px |  |
|
 |
 |
 |
 |
|
 |
|
 |
|
||||
| vectorized (shape strokes) 500px | |
|
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |