A Benchmark for Rough Sketch Cleanup
Ind_product_GW_04
Author: Graham Wilson Licence: CC-BY-4.0Messiness: 0.09769
Ambiguity (Chamfer): 0.13653
Shading: No
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Stroke Aggregator | Real-Time Inking | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00169 |  distance: 0.00202 |  distance: 0.00205 |  distance: 0.00224 |  distance: 0.00226 |  distance: 0.00227 |  distance: 0.00248 |  distance: 0.00254 |  distance: 0.0035 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.002480517008018367 | distance: 0.00248variant: thresholdedalg. parameter: 0.6 | 690.0 |
| Delaunay Triangulation | 0.003497483113887561 | distance: 0.0035variant: original | 1787.0 |
| Mastering Sketching | 0.0016942829099803193 | distance: 0.00169variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0025373367607936155 | distance: 0.00254variant: vectorized (all layers) 1000pxalg. parameter: noisy | 342.0 |
| Poly Vector | 0.0020520444017004973 | distance: 0.00205variant: thresholded 1000pxalg. parameter: noisy | 1333.0 |
| Real-Time Inking | 0.002263974665031602 | distance: 0.00226variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.0022447066806613827 | distance: 0.00224variant: vectorized (all layers) | 558.0 |
| Topology Driven → Stroke Aggregator | 0.0022676755546442284 | distance: 0.00227variant: vectorized (all layers) 1000px | 1100.0 |
| Topology Driven | 0.002022947665812201 | distance: 0.00202variant: thresholded 1000px | 110.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.30367245862689785 |  distance: 0.30367variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.3616041627441248 |  distance: 0.3616variant: thresholded 500pxalg. parameter: 0.75 | 172.0 |
| Mastering Sketching | 0.6234164192445811 |  distance: 0.62342variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.3386345522283689 |  distance: 0.33863variant: vectorized (all layers) 500px | 15.0 |
| Poly Vector | 0.35492766306978474 |  distance: 0.35493variant: vectorized (all layers) 500px | 81.0 |
| Real-Time Inking | 0.5196459580402157 |  distance: 0.51965variant: original | 5.0 |
| Stroke Aggregator | 0.5439973671164375 | distance: 0.544variant: vectorized (all layers) | 558.0 |
| Topology Driven → Stroke Aggregator | 0.4347188702045761 |  distance: 0.43472variant: vectorized (all layers) 500px | 208.0 |
| Topology Driven | 0.5393212632386326 | distance: 0.53932variant: thresholded 1000px | 110.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4955413827208223 | distance: 0.49554variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.519966015293118 | distance: 0.51997variant: thresholded 500pxalg. parameter: 0.75 | 172.0 |
| Mastering Sketching | 0.7939669008198521 | distance: 0.79397variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4439103398409256 | distance: 0.44391variant: vectorized (all layers) 500px | 15.0 |
| Poly Vector | 0.45992618463115104 | distance: 0.45993variant: vectorized (all layers) 500px | 81.0 |
| Real-Time Inking | 0.7234297148458592 | distance: 0.72343variant: original | 5.0 |
| Stroke Aggregator | 0.7370929390739149 | distance: 0.73709variant: vectorized (all layers) | 558.0 |
| Topology Driven → Stroke Aggregator | 0.6324124721075809 | distance: 0.63241variant: vectorized (all layers) 500px | 208.0 |
| Topology Driven | 0.7221454231436695 |  distance: 0.72215variant: vectorized (all layers) 500px | 6.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6476272048667923 | distance: 0.64763variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.6365737174026516 | distance: 0.63657variant: thresholded 500pxalg. parameter: 0.75 | 172.0 |
| Mastering Sketching | 0.8837333598449315 | distance: 0.88373variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.533637163695404 | distance: 0.53364variant: vectorized (all layers) 500px | 15.0 |
| Poly Vector | 0.5477926823884433 |  distance: 0.54779variant: vectorized (all layers) 500pxalg. parameter: noisy | 97.0 |
| Real-Time Inking | 0.8004876809047291 | distance: 0.80049variant: original | 5.0 |
| Stroke Aggregator | 0.8388586073343048 | distance: 0.83886variant: vectorized (all layers) | 558.0 |
| Topology Driven → Stroke Aggregator | 0.7737327184693701 | distance: 0.77373variant: vectorized (all layers) 500px | 208.0 |
| Topology Driven | 0.8354889229090782 | distance: 0.83549variant: vectorized (all layers) 500px | 6.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7304286137726149 | distance: 0.73043variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.7316287295708459 | distance: 0.73163variant: thresholded 500pxalg. parameter: 0.75 | 172.0 |
| Mastering Sketching | 0.9221854246159896 | distance: 0.92219variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5941043804500045 |  distance: 0.5941variant: vectorized (all layers) 500pxalg. parameter: noisy | 15.0 |
| Poly Vector | 0.6066763485194169 | distance: 0.60668variant: vectorized (all layers) 500pxalg. parameter: noisy | 97.0 |
| Real-Time Inking | 0.8428823809252377 | distance: 0.84288variant: original | 5.0 |
| Stroke Aggregator | 0.8964543217746876 | distance: 0.89645variant: vectorized (all layers) | 558.0 |
| Topology Driven → Stroke Aggregator | 0.8504807199002307 | distance: 0.85048variant: vectorized (all layers) 500px | 208.0 |
| Topology Driven | 0.8933274371489229 | distance: 0.89333variant: vectorized (all layers) 500px | 6.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.809960223048677 | distance: 0.80996variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.8221403854333922 | distance: 0.82214variant: thresholded 500pxalg. parameter: 0.75 | 172.0 |
| Mastering Sketching | 0.9416752613456214 | distance: 0.94168variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6418987377386299 | distance: 0.6419variant: vectorized (all layers) 500pxalg. parameter: noisy | 15.0 |
| Poly Vector | 0.6560452542840497 | distance: 0.65605variant: vectorized (all layers) 500pxalg. parameter: noisy | 97.0 |
| Real-Time Inking | 0.8715612648131973 | distance: 0.87156variant: original | 5.0 |
| Stroke Aggregator | 0.926219234699486 | distance: 0.92622variant: vectorized (all layers) | 558.0 |
| Topology Driven → Stroke Aggregator | 0.90342565070192 | distance: 0.90343variant: vectorized (all layers) 500px | 208.0 |
| Topology Driven | 0.9290238357291252 | distance: 0.92902variant: vectorized (all layers) 500px | 6.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.40293423461914063 | distance: 0.40293variant: thresholded 500px | 5.0 |
| Delaunay Triangulation | 0.05120849609375 | distance: 0.05121variant: original | 1787.0 |
| Fidelity Simplicity | 0.028481348469803287 |  distance: 0.02848variant: thresholdedalg. parameter: 0.75 | 795.0 |
| Poly Vector → Stroke Aggregator | 0.04024922180175782 |  distance: 0.04025variant: thresholded 500px | 70.0 |
| Poly Vector | 0.04024922180175782 |  distance: 0.04025variant: thresholded 500pxalg. parameter: noisy | 203.0 |
| Real-Time Inking | 0.02785677719116211 |  distance: 0.02786variant: thresholded 500px | 2.0 |
| Stroke Aggregator | 0.06260202070216964 | distance: 0.0626variant: vectorized (all layers) | 558.0 |
| Topology Driven → Stroke Aggregator | 0.03736308288574219 |  distance: 0.03736variant: thresholded 500px | 730.0 |
| Topology Driven | 0.039293766021728516 |  distance: 0.03929variant: thresholded 500px | 24.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
|
||||||||
| thresholded |  |
 |
 |
 |
|
|
|||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
|
|
 |
 |
|||||
| thresholded 500px | |
|
|
 |
 |
 |
|
 |
|
|
 |
 |
|
||
| vectorized (all layers) 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
 |
 |
|
|
|
|
|
|
|
| vectorized (all layers) | |