A Benchmark for Rough Sketch Cleanup
Art_freeform_GW_01
Author: Graham Wilson Licence: CC-BY-4.0Messiness: 0.03717
Ambiguity (Chamfer): 0.01686
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Stroke Aggregator | Topology Driven | Poly Vector | Topology Driven → Stroke Aggregator | Real-Time Inking | Poly Vector → Stroke Aggregator | Mastering Sketching | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00049 |  distance: 0.00053 |  distance: 0.00055 |  distance: 0.00059 |  distance: 0.00065 |  distance: 0.00076 |  distance: 0.00078 |  distance: 0.00113 |  distance: 0.00168 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.001125127402658892 | distance: 0.00113variant: original | 86.0 |
| Fidelity Simplicity | 0.0016777706801592582 | distance: 0.00168variant: originalalg. parameter: 0.25 | 295.0 |
| Mastering Sketching | 0.0007801620617668532 | distance: 0.00078variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0007595028121019397 | distance: 0.00076variant: original 1000px | 100.0 |
| Poly Vector | 0.0005527655796733592 | distance: 0.00055variant: vectorized (all layers) 1000px | 170.0 |
| Real-Time Inking | 0.0006457091255940555 | distance: 0.00065variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.0004909308678153232 | distance: 0.00049variant: vectorized (all layers) | 343.0 |
| Topology Driven → Stroke Aggregator | 0.0005867741462360418 | distance: 0.00059variant: original | 1226.0 |
| Topology Driven | 0.000528731041137927 | distance: 0.00053variant: original | 337.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6219720224387429 |  distance: 0.62197variant: original 500pxalg. parameter: 0.75 | 159.0 |
| Mastering Sketching | 0.9217848050933056 | distance: 0.92178variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.5109687910982975 |  distance: 0.51097variant: vectorized (all layers) 500px | 59.0 |
| Real-Time Inking | 0.914041708999794 |  distance: 0.91404variant: original | 3.0 |
| Stroke Aggregator | 0.9338001943726876 | distance: 0.9338variant: vectorized (all layers) | 343.0 |
| Topology Driven → Stroke Aggregator | 0.7250055605677027 |  distance: 0.72501variant: vectorized (all layers) 500px | 118.0 |
| Topology Driven | 0.8833145483405263 |  distance: 0.88331variant: vectorized (all layers) 500px | 4.0 |
| Delaunay Triangulation | 0.3710219999183677 |  distance: 0.37102variant: vectorized (all layers) 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.8853307760525143 |  distance: 0.88533variant: original 500px | 52.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.5787167720741011 | distance: 0.57872variant: vectorized (all layers) 500px | 59.0 |
| Stroke Aggregator | 0.9702228275526632 | distance: 0.97022variant: vectorized (all layers) | 343.0 |
| Topology Driven → Stroke Aggregator | 0.8530961734276487 | distance: 0.8531variant: vectorized (all layers) 500px | 118.0 |
| Topology Driven | 0.9447580318198912 | distance: 0.94476variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.7542475175925184 | distance: 0.75425variant: original 500pxalg. parameter: 0.75 | 159.0 |
| Mastering Sketching | 0.9702506441789646 | distance: 0.97025variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.9592765172418912 | distance: 0.95928variant: original | 3.0 |
| Delaunay Triangulation | 0.6390749249200636 | distance: 0.63907variant: vectorized (all layers) 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.9322231674076809 | distance: 0.93222variant: original 500px | 52.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8203578809364059 |  distance: 0.82036variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 200.0 |
| Poly Vector | 0.6297472460488818 | distance: 0.62975variant: vectorized (all layers) 500px | 59.0 |
| Stroke Aggregator | 0.9786617253924194 | distance: 0.97866variant: vectorized (all layers) | 343.0 |
| Mastering Sketching | 0.9781021897810218 | distance: 0.9781variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.9701830271325609 | distance: 0.97018variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.9218801319286326 | distance: 0.92188variant: vectorized (all layers) 500px | 118.0 |
| Topology Driven | 0.9702190943536544 | distance: 0.97022variant: vectorized (all layers) 500px | 4.0 |
| Delaunay Triangulation | 0.7987635352066434 | distance: 0.79876variant: vectorized (all layers) 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.9541314490069988 | distance: 0.95413variant: original 500px | 52.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8313566889442391 |  distance: 0.83136variant: vectorized (all layers) 1000pxalg. parameter: 0.6 | 172.0 |
| Poly Vector | 0.6731599216592901 | distance: 0.67316variant: vectorized (all layers) 500px | 59.0 |
| Stroke Aggregator | 0.9830072553886212 | distance: 0.98301variant: vectorized (all layers) | 343.0 |
| Topology Driven → Stroke Aggregator | 0.9492409383276174 | distance: 0.94924variant: vectorized (all layers) 500px | 118.0 |
| Topology Driven | 0.977419827619671 |  distance: 0.97742variant: vectorized (all layers) 1000px | 14.0 |
| Delaunay Triangulation | 0.8458307044815693 | distance: 0.84583variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.9821717990275526 | distance: 0.98217variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.9778146777372796 |  distance: 0.97781variant: original 1000px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.9652523779817406 | distance: 0.96525variant: original 500px | 52.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8837873723656865 | distance: 0.88379variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.8407884601316179 | distance: 0.84079variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 200.0 |
| Poly Vector | 0.7209557291038684 |  distance: 0.72096variant: vectorized (all layers) 500pxalg. parameter: noisy | 56.0 |
| Real-Time Inking | 0.983884929053169 | distance: 0.98388variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.9863973206044464 | distance: 0.9864variant: vectorized (all layers) | 343.0 |
| Topology Driven → Stroke Aggregator | 0.9663769009001076 | distance: 0.96638variant: vectorized (all layers) 500px | 118.0 |
| Topology Driven | 0.9810793793154109 | distance: 0.98108variant: vectorized (all layers) 1000px | 14.0 |
| Mastering Sketching | 0.9860688255374112 | distance: 0.98607variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9762854097105552 | distance: 0.97629variant: original 500px | 52.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0294108829498291 |  distance: 0.02941variant: original 1000px | 7.0 |
| Fidelity Simplicity | 0.05290400336113367 |  distance: 0.0529variant: originalalg. parameter: 0.6 | 332.0 |
| Mastering Sketching | 0.3936495971679688 | distance: 0.39365variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.028999999999999998 | distance: 0.029variant: original 1000px | 100.0 |
| Poly Vector | 0.02720294189453125 |  distance: 0.0272variant: original 500px | 79.0 |
| Stroke Aggregator | 0.02812737706465044 | distance: 0.02813variant: vectorized (all layers) | 343.0 |
| Topology Driven → Stroke Aggregator | 0.026925823211669926 |  distance: 0.02693variant: vectorized (all layers) 1000px | 416.0 |
| Real-Time Inking | 0.02720294189453125 | distance: 0.0272variant: original 1000px | 2.0 |
| Topology Driven | 0.026000000000000002 | distance: 0.026variant: vectorized (all layers) 500px | 4.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
|
 |
 |
|
|
|
||||||
| vectorized (all layers) 1000px | |
|
 |
 |
 |
|
|
|
 |
|
 |
||||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
 |
 |
|
|
|
|
|||
| original 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
|
 |
|
|||
| original 500px |  |
 |
 |
 |
 |
|
 |
 |
 |
|
 |
|
|||
| vectorized (all layers) | |