A Benchmark for Rough Sketch Cleanup
Ind_architecture_baseline_01
Author: Baseline Licence: Academic PaperMessiness: 0.06722
Ambiguity (Chamfer): 0.36044
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Poly Vector → Stroke Aggregator | Topology Driven | Poly Vector | Mastering Sketching | Stroke Aggregator | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00168 |  distance: 0.00169 |  distance: 0.00174 |  distance: 0.00175 |  distance: 0.00175 |  distance: 0.0018 |  distance: 0.0024 |  distance: 0.00281 |  distance: 0.00919 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.002404424163519928 | distance: 0.0024variant: original | 26.0 |
| Fidelity Simplicity | 0.009188513958692546 | distance: 0.00919variant: original 500pxalg. parameter: 0.75 | 197.0 |
| Mastering Sketching | 0.0017505498344150285 | distance: 0.00175variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0016915692742490687 | distance: 0.00169variant: original | 386.0 |
| Poly Vector | 0.0017461248732540734 | distance: 0.00175variant: original | 332.0 |
| Real-Time Inking | 0.0016839618601427672 | distance: 0.00168variant: original | 3.0 |
| Stroke Aggregator | 0.0017953421769584114 | distance: 0.0018variant: vectorized (all layers) | 466.0 |
| Topology Driven → Stroke Aggregator | 0.002808851725997857 | distance: 0.00281variant: original 500px | 82.0 |
| Topology Driven | 0.0017353813901903685 | distance: 0.00174variant: original | 37.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.26685333031547576 |  distance: 0.26685variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.19845128510031396 |  distance: 0.19845variant: originalalg. parameter: 0.25 | 620.0 |
| Mastering Sketching | 0.374251266586863 | distance: 0.37425variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.3438019063673595 |  distance: 0.3438variant: originalalg. parameter: noisy | 386.0 |
| Poly Vector | 0.25114271087377205 |  distance: 0.25114variant: original 500pxalg. parameter: noisy | 46.0 |
| Real-Time Inking | 0.3432521218226729 |  distance: 0.34325variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.3549907407928857 | distance: 0.35499variant: vectorized (all layers) | 466.0 |
| Topology Driven → Stroke Aggregator | 0.3040324432533438 | distance: 0.30403variant: original 500px | 82.0 |
| Topology Driven | 0.3524027886562266 | distance: 0.3524variant: original | 37.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3942566710301525 | distance: 0.39426variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.2986004623324171 |  distance: 0.2986variant: originalalg. parameter: 0.75 | 571.0 |
| Mastering Sketching | 0.5094149555866224 | distance: 0.50941variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.481153437445041 | distance: 0.48115variant: originalalg. parameter: noisy | 386.0 |
| Poly Vector | 0.34100387898583 | distance: 0.341variant: original 500pxalg. parameter: noisy | 46.0 |
| Real-Time Inking | 0.4885732651415926 | distance: 0.48857variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.4864646435015864 | distance: 0.48646variant: vectorized (all layers) | 466.0 |
| Topology Driven → Stroke Aggregator | 0.4592919265138767 | distance: 0.45929variant: original 500px | 82.0 |
| Topology Driven | 0.4904704257260862 | distance: 0.49047variant: original | 37.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4956251172120123 | distance: 0.49563variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.3769172117829233 | distance: 0.37692variant: originalalg. parameter: 0.75 | 571.0 |
| Mastering Sketching | 0.6091601797353126 | distance: 0.60916variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5792726709030049 | distance: 0.57927variant: original | 386.0 |
| Poly Vector | 0.4185316788116311 | distance: 0.41853variant: original 500pxalg. parameter: noisy | 46.0 |
| Real-Time Inking | 0.5786671885593456 | distance: 0.57867variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.5827830201872379 | distance: 0.58278variant: vectorized (all layers) | 466.0 |
| Topology Driven → Stroke Aggregator | 0.5676249607547678 | distance: 0.56762variant: original 500px | 82.0 |
| Topology Driven | 0.5922412127336301 | distance: 0.59224variant: original | 37.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5596840470227171 | distance: 0.55968variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.4579453403761299 | distance: 0.45795variant: originalalg. parameter: 0.75 | 571.0 |
| Mastering Sketching | 0.6826662802925688 | distance: 0.68267variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6730381805690356 |  distance: 0.67304variant: original 1000pxalg. parameter: noisy | 119.0 |
| Poly Vector | 0.483000686152595 | distance: 0.483variant: original 500pxalg. parameter: noisy | 46.0 |
| Real-Time Inking | 0.6441992727354149 | distance: 0.6442variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.6708872350988241 | distance: 0.67089variant: vectorized (all layers) | 466.0 |
| Topology Driven → Stroke Aggregator | 0.649791092800057 | distance: 0.64979variant: original 500px | 82.0 |
| Topology Driven | 0.6702856589091868 |  distance: 0.67029variant: original 500px | 4.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6216244228800568 | distance: 0.62162variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.5275413279588191 |  distance: 0.52754variant: original 1000pxalg. parameter: 0.5 | 306.0 |
| Mastering Sketching | 0.7505429394636312 |  distance: 0.75054variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.736044588556889 | distance: 0.73604variant: originalalg. parameter: noisy | 386.0 |
| Poly Vector | 0.5567887642340761 | distance: 0.55679variant: original 500pxalg. parameter: noisy | 46.0 |
| Real-Time Inking | 0.7144092535956509 | distance: 0.71441variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.7369897194928839 | distance: 0.73699variant: vectorized (all layers) | 466.0 |
| Topology Driven → Stroke Aggregator | 0.7208505711975246 | distance: 0.72085variant: original 500px | 82.0 |
| Topology Driven | 0.7396608424857212 | distance: 0.73966variant: original 500px | 4.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.1128716049194336 | distance: 0.11287variant: original 500pxalg. parameter: 0.75 | 197.0 |
| Poly Vector → Stroke Aggregator | 0.021575984990619138 | distance: 0.02158variant: original | 386.0 |
| Poly Vector | 0.022000000000000002 |  distance: 0.022variant: original 1000px | 108.0 |
| Real-Time Inking | 0.021575984990619138 | distance: 0.02158variant: original | 3.0 |
| Stroke Aggregator | 0.021575984990619138 | distance: 0.02158variant: vectorized (all layers) | 466.0 |
| Topology Driven → Stroke Aggregator | 0.02 | distance: 0.02variant: original 500px | 82.0 |
| Topology Driven | 0.021023796081542968 |  distance: 0.02102variant: original 1000px | 11.0 |
| Delaunay Triangulation | 0.06718630981445313 |  distance: 0.06719variant: original 1000px | 5.0 |
| Mastering Sketching | 0.1032279052734375 | distance: 0.10323variant: original 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
|
 |
|
 |
|
|
|
|
|||
| original 1000px | |
|
 |
 |
|
 |
 |
|
 |
|
|
|
|||
| original 500px | |
 |
|
 |
 |
 |
|
 |
|
|
 |
|
|||
| vectorized (all layers) | |