A Benchmark for Rough Sketch Cleanup
Index
Rough Sketches
Ground Truth (artist cleaned)
Ground Truth metrics
Algorithm Output
Help
Ind_architecture_baseline_04
Author:
Baseline
Licence:
Academic Paper
Messiness:
0.12374
Ambiguity (Chamfer):
0.19677
Shading:
Yes
Scaffold:
No
Texture Strokes:
No
Background:
Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
Original
Ground Truth
Mastering Sketching
Real-Time Inking
Poly Vector
Topology Driven
Stroke Aggregator
Delaunay Triangulation
Fidelity Simplicity
distance:
0.00131
distance:
0.0014
distance:
0.00142
distance:
0.00144
distance:
0.00155
distance:
0.0026
distance:
0.00861
Rough Sketch
Column visibility:
original
thresholded
all layers
shape
lighting
scaffold
shading
Ground Truth
Column visibility:
artist
all layers
shape
scaffold
shading
color region
text
extra
Branislav Mirkovic
Ge Jin
Santiago Rial
Automatic results, best result per algorithm
Select metric
Distance
Chamfer
F1 2/1000
F1 4/1000
F1 6/1000
F1 8/1000
F1 10/1000
Hausdorff
Column visibility:
Display labels:
Chamfer
algorithm
distance
result
running time
Fidelity Simplicity
0.008613722808291698
distance:
0.00861
variant:
original 500px
alg. parameter:
0.25
1490.0
Poly Vector → Stroke Aggregator
nan
Topology Driven → Stroke Aggregator
nan
Delaunay Triangulation
0.0025963736323073765
distance:
0.0026
variant:
original
28.0
Mastering Sketching
0.0013132947064531599
distance:
0.00131
variant:
original 1000px
6.0
Poly Vector
0.0014174128666106295
distance:
0.00142
variant:
original
alg. parameter:
noisy
564.0
Real-Time Inking
0.0014033009518306756
distance:
0.0014
variant:
original
4.0
Stroke Aggregator
0.0015519276780315274
distance:
0.00155
variant:
vectorized (all layers)
1251.0
Topology Driven
0.0014369100402497534
distance:
0.00144
variant:
original
90.0
F12/1000
algorithm
distance
result
running time
Fidelity Simplicity
0.3414089571893452
distance:
0.34141
variant:
original 500px
alg. parameter:
0.6
1752.0
Mastering Sketching
0.6936418422934125
distance:
0.69364
variant:
original 1000px
6.0
Poly Vector → Stroke Aggregator
nan
Real-Time Inking
0.5909557680069489
distance:
0.59096
variant:
original 1000px
3.0
Stroke Aggregator
0.6292840258907433
distance:
0.62928
variant:
vectorized (all layers)
1251.0
Topology Driven → Stroke Aggregator
nan
Topology Driven
0.6110700116706717
distance:
0.61107
variant:
original 500px
12.0
Delaunay Triangulation
0.2659302368684435
distance:
0.26593
variant:
original 500px
4.0
Poly Vector
0.4208767996250965
distance:
0.42088
variant:
original 500px
alg. parameter:
noisy
160.0
F14/1000
algorithm
distance
result
running time
Delaunay Triangulation
0.3836224601267206
distance:
0.38362
variant:
original 500px
4.0
Poly Vector → Stroke Aggregator
nan
Topology Driven → Stroke Aggregator
nan
Fidelity Simplicity
0.4961163867526536
distance:
0.49612
variant:
original 500px
alg. parameter:
0.6
1752.0
Mastering Sketching
0.8498380472314989
distance:
0.84984
variant:
original 1000px
6.0
Poly Vector
0.5549199481106325
distance:
0.55492
variant:
original 500px
163.0
Real-Time Inking
0.7675855174254209
distance:
0.76759
variant:
original 500px
3.0
Stroke Aggregator
0.8239065517138421
distance:
0.82391
variant:
vectorized (all layers)
1251.0
Topology Driven
0.8062010781988167
distance:
0.8062
variant:
original 500px
12.0
F16/1000
algorithm
distance
result
running time
Delaunay Triangulation
0.499557381025276
distance:
0.49956
variant:
original 500px
4.0
Poly Vector → Stroke Aggregator
nan
Topology Driven → Stroke Aggregator
nan
Fidelity Simplicity
0.5711662031740385
distance:
0.57117
variant:
original
alg. parameter:
0.75
262.0
Mastering Sketching
0.9208524699703508
distance:
0.92085
variant:
original 1000px
6.0
Poly Vector
0.6690298591424749
distance:
0.66903
variant:
original 500px
alg. parameter:
noisy
160.0
Real-Time Inking
0.8575131717705966
distance:
0.85751
variant:
original 500px
3.0
Stroke Aggregator
0.9049557114113698
distance:
0.90496
variant:
vectorized (all layers)
1251.0
Topology Driven
0.9032712354350276
distance:
0.90327
variant:
original 500px
12.0
F18/1000
algorithm
distance
result
running time
Delaunay Triangulation
0.5894609052559572
distance:
0.58946
variant:
original 500px
4.0
Poly Vector → Stroke Aggregator
nan
Topology Driven → Stroke Aggregator
nan
Mastering Sketching
0.9557242223467683
distance:
0.95572
variant:
original 500px
7.0
Poly Vector
0.7538006092246191
distance:
0.7538
variant:
original 500px
163.0
Real-Time Inking
0.9028252596744846
distance:
0.90283
variant:
original 500px
3.0
Stroke Aggregator
0.9513285830855108
distance:
0.95133
variant:
vectorized (all layers)
1251.0
Topology Driven
0.9514748607478009
distance:
0.95147
variant:
original 500px
12.0
Fidelity Simplicity
0.6261803286935457
distance:
0.62618
variant:
original 1000px
alg. parameter:
0.75
210.0
F110/1000
algorithm
distance
result
running time
Poly Vector → Stroke Aggregator
nan
Topology Driven → Stroke Aggregator
nan
Delaunay Triangulation
0.6704892074277883
distance:
0.67049
variant:
original 500px
4.0
Mastering Sketching
0.973836011504158
distance:
0.97384
variant:
original 500px
7.0
Poly Vector
0.8129894221163745
distance:
0.81299
variant:
original 500px
alg. parameter:
noisy
160.0
Real-Time Inking
0.9338637165767693
distance:
0.93386
variant:
original 500px
3.0
Stroke Aggregator
0.9699638408445058
distance:
0.96996
variant:
vectorized (all layers)
1251.0
Topology Driven
0.9720668367991192
distance:
0.97207
variant:
original 500px
12.0
Fidelity Simplicity
0.6611312387312827
distance:
0.66113
variant:
original 1000px
alg. parameter:
0.3
167.0
Hausdorff
algorithm
distance
result
running time
Fidelity Simplicity
0.07375635528564453
distance:
0.07376
variant:
original 500px
alg. parameter:
0.5
1720.0
Mastering Sketching
0.109123779296875
distance:
0.10912
variant:
original 500px
7.0
Poly Vector → Stroke Aggregator
nan
Topology Driven → Stroke Aggregator
nan
Topology Driven
0.021540658950805664
distance:
0.02154
variant:
original 500px
12.0
Delaunay Triangulation
0.029106300833622364
distance:
0.02911
variant:
original
28.0
Poly Vector
0.02121320343017578
distance:
0.02121
variant:
original 1000px
323.0
Real-Time Inking
0.021631004743891263
distance:
0.02163
variant:
original
4.0
Stroke Aggregator
0.020900214560527892
distance:
0.0209
variant:
vectorized (all layers)
1251.0
Automatic results for each input variant
Column visibility:
variant
Topology Driven → Stroke Aggregator
Real-Time Inking
Mastering Sketching
Fidelity Simplicity 0.3
Fidelity Simplicity 0.25
Fidelity Simplicity 0.5
Fidelity Simplicity 0.75
Fidelity Simplicity 0.6
Topology Driven
Poly Vector noisy
Poly Vector
Delaunay Triangulation
Stroke Aggregator
Poly Vector → Stroke Aggregator noisy
Poly Vector → Stroke Aggregator
original
original 1000px
original 500px
vectorized (all layers)