A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_16
Author: Enrique Rosales Licence: Academic PaperMessiness: 0.31689
Ambiguity (Chamfer): 0.13663
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Topology Driven | Stroke Aggregator | Poly Vector | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00191 |  distance: 0.00212 |  distance: 0.00214 |  distance: 0.00216 |  distance: 0.00225 |  distance: 0.00234 |  distance: 0.00249 |  distance: 0.00319 |  distance: 0.04086 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | 0.002157048711536438 | distance: 0.00216variant: vectorized (all layers) | 1709.0 |
| Poly Vector → Stroke Aggregator | 0.002339873410982357 | distance: 0.00234variant: original | 349.0 |
| Delaunay Triangulation | 0.003193802775189704 | distance: 0.00319variant: original | 10.0 |
| Fidelity Simplicity | 0.040860391931934636 | distance: 0.04086variant: original 500pxalg. parameter: 0.25 | 222.0 |
| Mastering Sketching | 0.0019085175493432265 | distance: 0.00191variant: original 500px | 5.0 |
| Poly Vector | 0.0022466095651783643 | distance: 0.00225variant: original | 189.0 |
| Real-Time Inking | 0.002116237018497184 | distance: 0.00212variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.0024873060463696693 | distance: 0.00249variant: original 1000px | 1466.0 |
| Topology Driven | 0.0021438108154419547 | distance: 0.00214variant: original | 51.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.6907054568145675 | distance: 0.69071variant: original 500px | 5.0 |
| Delaunay Triangulation | 0.300828665972426 |  distance: 0.30083variant: original 500px | 2.0 |
| Poly Vector | 0.5431660063159501 |  distance: 0.54317variant: original 500px | 64.0 |
| Real-Time Inking | 0.5918421352992229 | distance: 0.59184variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.4966780172748902 |  distance: 0.49668variant: original 500px | 195.0 |
| Topology Driven | 0.5633771061558192 | distance: 0.56338variant: original | 51.0 |
| Fidelity Simplicity | 0.14592709161593026 |  distance: 0.14593variant: original 1000pxalg. parameter: 0.75 | 274.0 |
| Poly Vector → Stroke Aggregator | 0.5364128305382408 |  distance: 0.53641variant: original 1000pxalg. parameter: noisy | 269.0 |
| Stroke Aggregator | 0.546588174202495 | distance: 0.54659variant: vectorized (all layers) | 1709.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2527617679165897 |  distance: 0.25276variant: original 1000pxalg. parameter: 0.25 | 248.0 |
| Mastering Sketching | 0.865544540197103 | distance: 0.86554variant: original 500px | 5.0 |
| Real-Time Inking | 0.795883488703721 | distance: 0.79588variant: original | 3.0 |
| Topology Driven | 0.7725594074732214 | distance: 0.77256variant: original | 51.0 |
| Poly Vector → Stroke Aggregator | 0.7651121887707296 |  distance: 0.76511variant: original 500px | 27.0 |
| Poly Vector | 0.7667984213244617 | distance: 0.7668variant: original 500px | 64.0 |
| Stroke Aggregator | 0.8119865087761926 | distance: 0.81199variant: vectorized (all layers) | 1709.0 |
| Topology Driven → Stroke Aggregator | 0.7168508156154166 | distance: 0.71685variant: original 500px | 195.0 |
| Delaunay Triangulation | 0.5486776484075551 | distance: 0.54868variant: original 500px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2989826128611212 | distance: 0.29898variant: original 1000pxalg. parameter: 0.25 | 248.0 |
| Mastering Sketching | 0.957892756617716 | distance: 0.95789variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8836663200695374 |  distance: 0.88367variant: original 500pxalg. parameter: noisy | 27.0 |
| Poly Vector | 0.87837906675999 | distance: 0.87838variant: original 500px | 64.0 |
| Real-Time Inking | 0.9074852962444562 | distance: 0.90749variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.8674014549747537 | distance: 0.8674variant: original 500px | 195.0 |
| Topology Driven | 0.8846735234642334 |  distance: 0.88467variant: original 1000px | 39.0 |
| Delaunay Triangulation | 0.7524812466260041 | distance: 0.75248variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9445502577404824 | distance: 0.94455variant: vectorized (all layers) | 1709.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.9260328094133814 | distance: 0.92603variant: original 500pxalg. parameter: noisy | 27.0 |
| Poly Vector | 0.9254828838560624 | distance: 0.92548variant: original 500px | 64.0 |
| Real-Time Inking | 0.9556408613797958 |  distance: 0.95564variant: original 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9213525630514746 | distance: 0.92135variant: original 500px | 195.0 |
| Topology Driven | 0.9349813090902864 | distance: 0.93498variant: original 1000px | 39.0 |
| Delaunay Triangulation | 0.8476921024099815 | distance: 0.84769variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.3177793487128016 | distance: 0.31778variant: original 1000pxalg. parameter: 0.75 | 274.0 |
| Mastering Sketching | 0.9761063192107544 | distance: 0.97611variant: original 500px | 5.0 |
| Stroke Aggregator | 0.984285973677278 | distance: 0.98429variant: vectorized (all layers) | 1709.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.9182007520514046 | distance: 0.9182variant: original 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.951755673813852 | distance: 0.95176variant: original 500px | 27.0 |
| Poly Vector | 0.9543810955765348 |  distance: 0.95438variant: original 500pxalg. parameter: noisy | 62.0 |
| Real-Time Inking | 0.9781309716507298 | distance: 0.97813variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9947487657803046 | distance: 0.99475variant: vectorized (all layers) | 1709.0 |
| Topology Driven → Stroke Aggregator | 0.9552746070700656 | distance: 0.95527variant: original 500px | 195.0 |
| Topology Driven | 0.9639014968614196 | distance: 0.9639variant: original 1000px | 39.0 |
| Fidelity Simplicity | 0.3312691852620105 | distance: 0.33127variant: original 1000pxalg. parameter: 0.25 | 248.0 |
| Mastering Sketching | 0.9879020706935584 | distance: 0.9879variant: original 500px | 5.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | 0.03446325207893852 | distance: 0.03446variant: vectorized (all layers) | 1709.0 |
| Poly Vector → Stroke Aggregator | 0.01673499404673276 | distance: 0.01673variant: original | 349.0 |
| Poly Vector | 0.01881662787936209 | distance: 0.01882variant: original | 189.0 |
| Real-Time Inking | 0.016552946090698243 |  distance: 0.01655variant: original 1000px | 2.0 |
| Delaunay Triangulation | 0.042953464508056635 |  distance: 0.04295variant: original 1000px | 8.0 |
| Fidelity Simplicity | 0.4728297729492187 |  distance: 0.47283variant: original 1000pxalg. parameter: 0.6 | 282.0 |
| Mastering Sketching | 0.2549431304931641 | distance: 0.25494variant: original 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.01886796188354492 | distance: 0.01887variant: original 500px | 195.0 |
| Topology Driven | 0.018439088821411133 |  distance: 0.01844variant: original 500px | 9.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
|
|
|
|||||||||
| original 1000px | |
|
 |
|
 |
|
|
|
 |
 |
|
|
 |
||
| original 500px | |
|
|
 |
|
 |
 |
 |
|
|
|
|
|
|
|
| vectorized (all layers) | |