A Benchmark for Rough Sketch Cleanup
Art_freeform_AP_02
Author: AP Licence: CC-BY-SA-3.0Messiness: 0.16646
Ambiguity (Chamfer): 0.12276
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Mastering Sketching | Poly Vector → Stroke Aggregator | Real-Time Inking | Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00257 |  distance: 0.00274 |  distance: 0.00286 |  distance: 0.00297 |  distance: 0.003 |  distance: 0.00324 |  distance: 0.00368 |  distance: 0.00405 |  distance: 0.01696 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.016960012294491452 | distance: 0.01696variant: originalalg. parameter: 0.75 | 419.0 |
| Delaunay Triangulation | 0.0040523419509289615 | distance: 0.00405variant: original | 31.0 |
| Mastering Sketching | 0.0028562391906167034 | distance: 0.00286variant: vectorized (shape strokes) 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.002970912304992295 | distance: 0.00297variant: thresholded 1000pxalg. parameter: noisy | 294.0 |
| Poly Vector | 0.0027376410545380987 | distance: 0.00274variant: thresholded 1000px | 648.0 |
| Real-Time Inking | 0.002997867482920078 | distance: 0.003variant: thresholded | 4.0 |
| Stroke Aggregator | 0.003239250298317944 | distance: 0.00324variant: vectorized (shape strokes) | 707.0 |
| Topology Driven → Stroke Aggregator | 0.003682345674738292 | distance: 0.00368variant: thresholded 500px | 447.0 |
| Topology Driven | 0.0025726898458462077 | distance: 0.00257variant: original | 94.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.15593040499958086 |  distance: 0.15593variant: thresholded 500pxalg. parameter: 0.75 | 112.0 |
| Poly Vector → Stroke Aggregator | 0.5954988065049934 | distance: 0.5955variant: thresholded 1000pxalg. parameter: noisy | 294.0 |
| Poly Vector | 0.3900694530697202 |  distance: 0.39007variant: vectorized (all layers) 500px | 181.0 |
| Real-Time Inking | 0.5507701748254064 |  distance: 0.55077variant: original | 4.0 |
| Topology Driven → Stroke Aggregator | 0.4837937122850335 |  distance: 0.48379variant: vectorized (all layers) 500px | 573.0 |
| Delaunay Triangulation | 0.31679157109491635 |  distance: 0.31679variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.614488042433647 |  distance: 0.61449variant: vectorized (all layers) 1000px | 6.0 |
| Stroke Aggregator | 0.6029587087479481 | distance: 0.60296variant: vectorized (shape strokes) | 707.0 |
| Topology Driven | 0.5996826377521902 |  distance: 0.59968variant: thresholded 1000px | 35.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2265318255847393 | distance: 0.22653variant: thresholded 500pxalg. parameter: 0.75 | 112.0 |
| Mastering Sketching | 0.7538323531257977 | distance: 0.75383variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.7449055509259767 | distance: 0.74491variant: thresholded 1000pxalg. parameter: noisy | 294.0 |
| Poly Vector | 0.5281557933159609 |  distance: 0.52816variant: vectorized (all layers) 500pxalg. parameter: noisy | 165.0 |
| Real-Time Inking | 0.6987760209470584 | distance: 0.69878variant: original | 4.0 |
| Stroke Aggregator | 0.7654118528755978 | distance: 0.76541variant: vectorized (shape strokes) | 707.0 |
| Topology Driven → Stroke Aggregator | 0.6508246352518028 | distance: 0.65082variant: vectorized (all layers) 500px | 573.0 |
| Topology Driven | 0.7368491868849651 |  distance: 0.73685variant: vectorized (all layers) 500px | 13.0 |
| Delaunay Triangulation | 0.5210154988380795 | distance: 0.52102variant: vectorized (all layers) 500px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2982168663637534 | distance: 0.29822variant: thresholded 500pxalg. parameter: 0.75 | 112.0 |
| Mastering Sketching | 0.8399214218975334 |  distance: 0.83992variant: thresholded 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.8389666189014492 | distance: 0.83897variant: thresholded 1000pxalg. parameter: noisy | 294.0 |
| Poly Vector | 0.6221657162614301 |  distance: 0.62217variant: vectorized (shape strokes) 500px | 86.0 |
| Real-Time Inking | 0.7860389669100732 | distance: 0.78604variant: original | 4.0 |
| Stroke Aggregator | 0.8488015907174123 | distance: 0.8488variant: vectorized (shape strokes) | 707.0 |
| Topology Driven → Stroke Aggregator | 0.7802898961982162 | distance: 0.78029variant: vectorized (all layers) 500px | 573.0 |
| Topology Driven | 0.8359430497842724 | distance: 0.83594variant: vectorized (all layers) 500px | 13.0 |
| Delaunay Triangulation | 0.668843902434827 | distance: 0.66884variant: vectorized (all layers) 500px | 2.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7408513315491252 | distance: 0.74085variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.8899288660348537 | distance: 0.88993variant: thresholded 1000pxalg. parameter: noisy | 294.0 |
| Poly Vector | 0.6742598680166938 | distance: 0.67426variant: vectorized (shape strokes) 500px | 86.0 |
| Real-Time Inking | 0.8350190996873896 | distance: 0.83502variant: original | 4.0 |
| Topology Driven | 0.8875145249050995 |  distance: 0.88751variant: thresholded 500px | 13.0 |
| Mastering Sketching | 0.8857835735078612 |  distance: 0.88578variant: vectorized (all layers) 500px | 6.0 |
| Stroke Aggregator | 0.8971574929336071 | distance: 0.89716variant: vectorized (shape strokes) | 707.0 |
| Topology Driven → Stroke Aggregator | 0.8501436986559286 |  distance: 0.85014variant: vectorized (shape strokes) 500px | 259.0 |
| Fidelity Simplicity | 0.3552369174356357 | distance: 0.35524variant: thresholded 500pxalg. parameter: 0.75 | 112.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8072330483673535 | distance: 0.80723variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.9167246391066564 | distance: 0.91672variant: thresholded 1000pxalg. parameter: noisy | 294.0 |
| Poly Vector | 0.7183646482037176 | distance: 0.71836variant: vectorized (shape strokes) 500px | 86.0 |
| Real-Time Inking | 0.8634454452090704 | distance: 0.86345variant: original | 4.0 |
| Topology Driven | 0.9192296649785676 | distance: 0.91923variant: thresholded 500px | 13.0 |
| Fidelity Simplicity | 0.3799631160986887 |  distance: 0.37996variant: thresholded 1000pxalg. parameter: 0.75 | 173.0 |
| Mastering Sketching | 0.9167315189617165 | distance: 0.91673variant: vectorized (all layers) 500px | 6.0 |
| Stroke Aggregator | 0.9235372816434514 | distance: 0.92354variant: vectorized (shape strokes) | 707.0 |
| Topology Driven → Stroke Aggregator | 0.8948254479622528 | distance: 0.89483variant: vectorized (shape strokes) 500px | 259.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.22730452764601936 | distance: 0.2273variant: originalalg. parameter: 0.75 | 419.0 |
| Mastering Sketching | 0.29173275756835937 |  distance: 0.29173variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.059665737152099614 |  distance: 0.05967variant: thresholded 500px | 114.0 |
| Delaunay Triangulation | 0.0740270233154297 |  distance: 0.07403variant: thresholded 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.07397972869873047 | distance: 0.07398variant: thresholded 1000pxalg. parameter: noisy | 294.0 |
| Real-Time Inking | 0.07424284362792967 |  distance: 0.07424variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.07476797194707961 | distance: 0.07477variant: vectorized (shape strokes) | 707.0 |
| Topology Driven → Stroke Aggregator | 0.06985699462890625 | distance: 0.06986variant: thresholded 500px | 447.0 |
| Topology Driven | 0.06985699462890625 | distance: 0.06986variant: thresholded 500px | 13.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
|
 |
|
 |
 |
|
|||||
| thresholded | |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px |  |
|
 |
 |
 |
|
 |
|
 |
|
|
|
|||
| thresholded 500px | |
 |
 |
 |
 |
 |
|
 |
|
 |
|
 |
|||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
 |
 |
|
|
|
|
|||
| vectorized (shape strokes) 1000px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
 |
 |
|
 |
|||
| vectorized (shape strokes) | |