A Benchmark for Rough Sketch Cleanup
Index
Rough Sketches
Ground Truth (artist cleaned)
Ground Truth metrics
Algorithm Output
Help
Ind_architecture_baseline_06
Author:
Baseline
Licence:
Academic Paper
Messiness:
-0.0
Ambiguity (Chamfer):
0.01553
Shading:
No
Scaffold:
No
Texture Strokes:
No
Background:
Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
Original
Ground Truth
Real-Time Inking
Mastering Sketching
Poly Vector
Topology Driven
Topology Driven → Stroke Aggregator
Poly Vector → Stroke Aggregator
Fidelity Simplicity
Delaunay Triangulation
distance:
0.00023
distance:
0.00028
distance:
0.00032
distance:
0.00034
distance:
0.00042
distance:
0.00045
distance:
0.00058
distance:
0.00732
Rough Sketch
Column visibility:
original
thresholded
all layers
shape
lighting
scaffold
shading
Ground Truth
Column visibility:
artist
all layers
shape
scaffold
shading
color region
text
extra
Branislav Mirkovic
Ge Jin
Santiago Rial
Automatic results, best result per algorithm
Select metric
Distance
Chamfer
F1 2/1000
F1 4/1000
F1 6/1000
F1 8/1000
F1 10/1000
Hausdorff
Column visibility:
Display labels:
Chamfer
algorithm
distance
result
running time
Stroke Aggregator
nan
Delaunay Triangulation
0.007322467466085853
distance:
0.00732
variant:
original
720.0
Fidelity Simplicity
0.0005772461382991158
distance:
0.00058
variant:
original
alg. parameter:
0.25
653.0
Mastering Sketching
0.0002822975184950851
distance:
0.00028
variant:
vectorized (all layers) 1000px
6.0
Poly Vector → Stroke Aggregator
0.00045200901845109353
distance:
0.00045
variant:
vectorized (all layers) 1000px
alg. parameter:
noisy
530.0
Poly Vector
0.00031667578173958624
distance:
0.00032
variant:
vectorized (all layers) 1000px
510.0
Real-Time Inking
0.00023465877716506318
distance:
0.00023
variant:
original
4.0
Topology Driven → Stroke Aggregator
0.0004224483229544651
distance:
0.00042
variant:
vectorized (all layers) 1000px
1277.0
Topology Driven
0.000339636734211089
distance:
0.00034
variant:
vectorized (all layers) 1000px
20.0
F12/1000
algorithm
distance
result
running time
Stroke Aggregator
nan
Fidelity Simplicity
0.5468111016553843
distance:
0.54681
variant:
thresholded 500px
alg. parameter:
0.75
151.0
Mastering Sketching
0.9371135266718386
distance:
0.93711
variant:
thresholded 500px
6.0
Poly Vector → Stroke Aggregator
0.4113243334252789
distance:
0.41132
variant:
vectorized (all layers) 500px
alg. parameter:
noisy
26.0
Poly Vector
0.4233951823422668
distance:
0.4234
variant:
vectorized (all layers) 500px
alg. parameter:
noisy
89.0
Real-Time Inking
0.8985753228100839
distance:
0.89858
variant:
vectorized (all layers) 500px
2.0
Topology Driven → Stroke Aggregator
0.801080757451316
distance:
0.80108
variant:
thresholded 500px
549.0
Topology Driven
0.8590630538687382
distance:
0.85906
variant:
original
293.0
Delaunay Triangulation
0.1655826476282672
distance:
0.16558
variant:
vectorized (all layers) 500px
4.0
F14/1000
algorithm
distance
result
running time
Stroke Aggregator
nan
Fidelity Simplicity
0.6940751471515785
distance:
0.69408
variant:
thresholded 500px
alg. parameter:
0.75
151.0
Mastering Sketching
0.9830430100284344
distance:
0.98304
variant:
thresholded 500px
6.0
Poly Vector → Stroke Aggregator
0.4737763975684077
distance:
0.47378
variant:
vectorized (all layers) 500px
alg. parameter:
noisy
26.0
Poly Vector
0.4834422041648677
distance:
0.48344
variant:
vectorized (all layers) 500px
89.0
Real-Time Inking
0.9426684966798256
distance:
0.94267
variant:
vectorized (all layers) 500px
2.0
Topology Driven → Stroke Aggregator
0.9122022151511452
distance:
0.9122
variant:
thresholded 500px
549.0
Topology Driven
0.9356296907672478
distance:
0.93563
variant:
original
293.0
Delaunay Triangulation
0.28449100234154073
distance:
0.28449
variant:
vectorized (all layers) 500px
4.0
F16/1000
algorithm
distance
result
running time
Stroke Aggregator
nan
Delaunay Triangulation
0.4118270400155085
distance:
0.41183
variant:
vectorized (all layers) 500px
4.0
Fidelity Simplicity
0.8151080162086617
distance:
0.81511
variant:
thresholded 500px
alg. parameter:
0.75
151.0
Mastering Sketching
0.9896078815236288
distance:
0.98961
variant:
thresholded 1000px
7.0
Poly Vector → Stroke Aggregator
0.5315096116207388
distance:
0.53151
variant:
vectorized (all layers) 500px
alg. parameter:
noisy
26.0
Poly Vector
0.5395807539036283
distance:
0.53958
variant:
vectorized (all layers) 500px
alg. parameter:
noisy
89.0
Real-Time Inking
0.9551502775180774
distance:
0.95515
variant:
vectorized (all layers) 500px
2.0
Topology Driven → Stroke Aggregator
0.9535956192614959
distance:
0.9536
variant:
thresholded 500px
549.0
Topology Driven
0.9586257661269536
distance:
0.95863
variant:
original
293.0
F18/1000
algorithm
distance
result
running time
Fidelity Simplicity
0.8767509643626109
distance:
0.87675
variant:
thresholded 500px
alg. parameter:
0.75
151.0
Stroke Aggregator
nan
Delaunay Triangulation
0.5075154943368637
distance:
0.50752
variant:
vectorized (all layers) 500px
4.0
Mastering Sketching
0.9922658552399666
distance:
0.99227
variant:
thresholded 1000px
7.0
Poly Vector → Stroke Aggregator
0.5863494520191944
distance:
0.58635
variant:
vectorized (all layers) 500px
alg. parameter:
noisy
26.0
Poly Vector
0.5944371228518567
distance:
0.59444
variant:
vectorized (all layers) 500px
89.0
Real-Time Inking
0.9626076790827643
distance:
0.96261
variant:
vectorized (all layers) 500px
2.0
Topology Driven → Stroke Aggregator
0.9711918499317821
distance:
0.97119
variant:
thresholded 500px
549.0
Topology Driven
0.9717797956822916
distance:
0.97178
variant:
original
293.0
F110/1000
algorithm
distance
result
running time
Delaunay Triangulation
0.6096031738442116
distance:
0.6096
variant:
vectorized (all layers) 500px
4.0
Stroke Aggregator
nan
Mastering Sketching
0.9947947279762596
distance:
0.99479
variant:
thresholded 1000px
7.0
Poly Vector → Stroke Aggregator
0.6425421574202294
distance:
0.64254
variant:
vectorized (all layers) 500px
alg. parameter:
noisy
26.0
Poly Vector
0.6504939945742011
distance:
0.65049
variant:
vectorized (all layers) 500px
alg. parameter:
noisy
89.0
Topology Driven → Stroke Aggregator
0.9814869261453498
distance:
0.98149
variant:
thresholded 500px
549.0
Topology Driven
0.9808697635852034
distance:
0.98087
variant:
original
293.0
Fidelity Simplicity
0.9130523752768038
distance:
0.91305
variant:
thresholded 500px
alg. parameter:
0.75
151.0
Real-Time Inking
0.968705983220038
distance:
0.96871
variant:
vectorized (all layers) 500px
2.0
Hausdorff
algorithm
distance
result
running time
Fidelity Simplicity
0.028999999999999998
distance:
0.029
variant:
thresholded 1000px
alg. parameter:
0.6
221.0
Poly Vector
0.013000000000000001
distance:
0.013
variant:
vectorized (all layers) 1000px
alg. parameter:
noisy
512.0
Real-Time Inking
0.019250253292806486
distance:
0.01925
variant:
original
4.0
Stroke Aggregator
nan
Delaunay Triangulation
0.11820934415467485
distance:
0.11821
variant:
original
720.0
Mastering Sketching
0.1563201904296875
distance:
0.15632
variant:
thresholded 500px
6.0
Poly Vector → Stroke Aggregator
0.016763053894042968
distance:
0.01676
variant:
vectorized (all layers) 1000px
alg. parameter:
noisy
530.0
Topology Driven → Stroke Aggregator
0.005
distance:
0.005
variant:
vectorized (all layers) 1000px
1277.0
Topology Driven
0.006
distance:
0.006
variant:
vectorized (all layers) 1000px
20.0
Automatic results for each input variant
Column visibility:
variant
Topology Driven → Stroke Aggregator
Real-Time Inking
Mastering Sketching
Fidelity Simplicity 0.3
Fidelity Simplicity 0.25
Fidelity Simplicity 0.5
Fidelity Simplicity 0.75
Fidelity Simplicity 0.6
Topology Driven
Poly Vector noisy
Poly Vector
Delaunay Triangulation
Stroke Aggregator
Poly Vector → Stroke Aggregator noisy
Poly Vector → Stroke Aggregator
original
thresholded
thresholded 1000px
thresholded 500px
vectorized (all layers) 1000px
vectorized (all layers) 500px