A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_18
Author: Baseline Licence: Academic PaperMessiness: 0.08656
Ambiguity (Chamfer): 0.07421
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Poly Vector → Stroke Aggregator | Poly Vector | Topology Driven | Topology Driven → Stroke Aggregator | Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00066 |  distance: 0.00073 |  distance: 0.00075 |  distance: 0.00081 |  distance: 0.00087 |  distance: 0.00097 |  distance: 0.0021 |  distance: 0.00352 |  distance: 0.046 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0035172154364840253 | distance: 0.00352variant: original | 9.0 |
| Fidelity Simplicity | 0.045997996223664926 | distance: 0.046variant: originalalg. parameter: 0.3 | 285.0 |
| Mastering Sketching | 0.0006588095546885906 | distance: 0.00066variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0007470251264396071 | distance: 0.00075variant: originalalg. parameter: noisy | 84.0 |
| Poly Vector | 0.0008062032376213437 | distance: 0.00081variant: original | 134.0 |
| Real-Time Inking | 0.0007344088584947269 | distance: 0.00073variant: original | 2.0 |
| Stroke Aggregator | 0.0020994962460439155 | distance: 0.0021variant: vectorized (all layers) | 707.0 |
| Topology Driven → Stroke Aggregator | 0.0009687380388730467 | distance: 0.00097variant: original | 540.0 |
| Topology Driven | 0.0008670134099633614 | distance: 0.00087variant: original | 22.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.434409948199496 |  distance: 0.43441variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.12146487510345558 |  distance: 0.12146variant: original 1000pxalg. parameter: 0.75 | 1508.0 |
| Mastering Sketching | 0.749310061680841 | distance: 0.74931variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6506415860657875 |  distance: 0.65064variant: original 500px | 13.0 |
| Poly Vector | 0.6572575656595084 |  distance: 0.65726variant: original 500px | 42.0 |
| Real-Time Inking | 0.702643472411855 | distance: 0.70264variant: original | 2.0 |
| Stroke Aggregator | 0.64627841501074 | distance: 0.64628variant: vectorized (all layers) | 707.0 |
| Topology Driven → Stroke Aggregator | 0.6534138525746689 | distance: 0.65341variant: original | 540.0 |
| Topology Driven | 0.6754738121251093 | distance: 0.67547variant: original | 22.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6945827794039237 | distance: 0.69458variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.17688722027312764 | distance: 0.17689variant: original 1000pxalg. parameter: 0.75 | 1508.0 |
| Mastering Sketching | 0.92505823521824 | distance: 0.92506variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8319125344830061 | distance: 0.83191variant: original 500px | 13.0 |
| Poly Vector | 0.83104146583672 |  distance: 0.83104variant: original 500pxalg. parameter: noisy | 43.0 |
| Real-Time Inking | 0.8985950963647668 |  distance: 0.8986variant: original 500px | 2.0 |
| Stroke Aggregator | 0.8719855495877727 | distance: 0.87199variant: vectorized (all layers) | 707.0 |
| Topology Driven → Stroke Aggregator | 0.8942957102656454 | distance: 0.8943variant: original | 540.0 |
| Topology Driven | 0.9003002269557816 |  distance: 0.9003variant: original 500px | 4.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8483129075832869 | distance: 0.84831variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.19378118952687395 | distance: 0.19378variant: original 1000pxalg. parameter: 0.75 | 1508.0 |
| Mastering Sketching | 0.984683743374261 | distance: 0.98468variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8912258322589875 | distance: 0.89123variant: original 500px | 13.0 |
| Poly Vector | 0.8966278269887095 | distance: 0.89663variant: original 500pxalg. parameter: noisy | 43.0 |
| Real-Time Inking | 0.9724936791554888 | distance: 0.97249variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9489827203424946 | distance: 0.94898variant: vectorized (all layers) | 707.0 |
| Topology Driven → Stroke Aggregator | 0.9769944132595288 | distance: 0.97699variant: original | 540.0 |
| Topology Driven | 0.9752568574916629 | distance: 0.97526variant: original | 22.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8952110967573005 | distance: 0.89521variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.2024353273904384 | distance: 0.20244variant: original 1000pxalg. parameter: 0.75 | 1508.0 |
| Mastering Sketching | 0.998097596419778 |  distance: 0.9981variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.911610136791248 | distance: 0.91161variant: original 500px | 13.0 |
| Poly Vector | 0.9163383549969709 | distance: 0.91634variant: original 500pxalg. parameter: noisy | 43.0 |
| Real-Time Inking | 0.9926976772679312 | distance: 0.9927variant: original 500px | 2.0 |
| Topology Driven | 0.9947039190593338 | distance: 0.9947variant: original 500px | 4.0 |
| Stroke Aggregator | 0.9664725538576976 | distance: 0.96647variant: vectorized (all layers) | 707.0 |
| Topology Driven → Stroke Aggregator | 0.9966570091375084 | distance: 0.99666variant: original | 540.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.21686092648606836 | distance: 0.21686variant: original 1000pxalg. parameter: 0.75 | 1508.0 |
| Poly Vector → Stroke Aggregator | 0.9323885444346028 | distance: 0.93239variant: original 500px | 13.0 |
| Poly Vector | 0.9361576934392468 | distance: 0.93616variant: original 500px | 42.0 |
| Real-Time Inking | 0.9977827050997784 | distance: 0.99778variant: original 500px | 2.0 |
| Topology Driven | 0.9987539803405788 | distance: 0.99875variant: original 500px | 4.0 |
| Stroke Aggregator | 0.969361037799032 | distance: 0.96936variant: vectorized (all layers) | 707.0 |
| Topology Driven → Stroke Aggregator | 0.9992378532867576 | distance: 0.99924variant: original | 540.0 |
| Delaunay Triangulation | 0.9094458627421536 | distance: 0.90945variant: original 500px | 1.0 |
| Mastering Sketching | 0.999593306942948 | distance: 0.99959variant: original 1000px | 6.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.1090589455515646 | distance: 0.10906variant: original | 9.0 |
| Fidelity Simplicity | 0.26395326712881456 |  distance: 0.26395variant: originalalg. parameter: 0.75 | 277.0 |
| Poly Vector | 0.010198039054870605 |  distance: 0.0102variant: original 1000pxalg. parameter: noisy | 72.0 |
| Topology Driven → Stroke Aggregator | 0.01091805502202669 | distance: 0.01092variant: original | 540.0 |
| Topology Driven | 0.010816654205322266 |  distance: 0.01082variant: original 1000px | 11.0 |
| Poly Vector → Stroke Aggregator | 0.009970535774665898 | distance: 0.00997variant: originalalg. parameter: noisy | 84.0 |
| Stroke Aggregator | 0.11306263279547075 | distance: 0.11306variant: vectorized (all layers) | 707.0 |
| Mastering Sketching | 0.1592607879638672 | distance: 0.15926variant: original 500px | 5.0 |
| Real-Time Inking | 0.008246211051940918 |  distance: 0.00825variant: original 1000px | 2.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
 |
 |
|
 |
|
 |
|
|
|
 |
||
| original 1000px | |
|
|
|
|
 |
 |
 |
|||||||
| original 500px | |
|
 |
|
|
|
|
|
|||||||
| vectorized (all layers) | |