A Benchmark for Rough Sketch Cleanup
Ind_architecture_baseline_03
Author: Baseline Licence: Academic PaperMessiness: 0.18073
Ambiguity (Chamfer): 0.11618
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Stroke Aggregator | Poly Vector → Stroke Aggregator | Real-Time Inking | Topology Driven | Poly Vector | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00163 |  distance: 0.0018 |  distance: 0.00182 |  distance: 0.00206 |  distance: 0.0021 |  distance: 0.00216 |  distance: 0.00255 |  distance: 0.00329 |  distance: 0.00462 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0025521421503930217 | distance: 0.00255variant: original 1000px | 12.0 |
| Fidelity Simplicity | 0.004623813256897996 | distance: 0.00462variant: original 1000pxalg. parameter: 0.25 | 278.0 |
| Mastering Sketching | 0.0016309467565746821 | distance: 0.00163variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.001816297184720488 | distance: 0.00182variant: original 1000px | 353.0 |
| Poly Vector | 0.002162317458445425 | distance: 0.00216variant: originalalg. parameter: noisy | 253.0 |
| Real-Time Inking | 0.002061626762880837 | distance: 0.00206variant: original 1000px | 3.0 |
| Stroke Aggregator | 0.0017960698248148824 | distance: 0.0018variant: vectorized (all layers) | 497.0 |
| Topology Driven → Stroke Aggregator | 0.0032880682717798503 | distance: 0.00329variant: original 500px | 313.0 |
| Topology Driven | 0.0020984232652078573 | distance: 0.0021variant: original | 46.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4594273681264033 |  distance: 0.45943variant: original 500px | 3.0 |
| Mastering Sketching | 0.6888706142865016 | distance: 0.68887variant: original 500px | 5.0 |
| Fidelity Simplicity | 0.5041984801566325 |  distance: 0.5042variant: originalalg. parameter: 0.25 | 296.0 |
| Poly Vector → Stroke Aggregator | 0.4776971448154573 |  distance: 0.4777variant: original 500pxalg. parameter: noisy | 36.0 |
| Poly Vector | 0.5054193863491965 |  distance: 0.50542variant: original 500px | 66.0 |
| Real-Time Inking | 0.5685747439796414 |  distance: 0.56857variant: original | 3.0 |
| Stroke Aggregator | 0.5829717221689786 | distance: 0.58297variant: vectorized (all layers) | 497.0 |
| Topology Driven → Stroke Aggregator | 0.5148582007359949 | distance: 0.51486variant: original 500px | 313.0 |
| Topology Driven | 0.5459540964433837 | distance: 0.54595variant: original | 46.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7329498315082805 |  distance: 0.73295variant: originalalg. parameter: 0.75 | 376.0 |
| Mastering Sketching | 0.8381346227759416 | distance: 0.83813variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6495105402065386 | distance: 0.64951variant: original 500pxalg. parameter: noisy | 36.0 |
| Poly Vector | 0.638619824388435 | distance: 0.63862variant: original 500px | 66.0 |
| Real-Time Inking | 0.7634947088154503 | distance: 0.76349variant: original | 3.0 |
| Stroke Aggregator | 0.8088404063281004 | distance: 0.80884variant: vectorized (all layers) | 497.0 |
| Topology Driven → Stroke Aggregator | 0.6903706529446156 | distance: 0.69037variant: original 500px | 313.0 |
| Topology Driven | 0.7557751441651175 |  distance: 0.75578variant: original 500px | 9.0 |
| Delaunay Triangulation | 0.6952009862104669 | distance: 0.6952variant: original 500px | 3.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8168117064055711 | distance: 0.81681variant: originalalg. parameter: 0.25 | 296.0 |
| Mastering Sketching | 0.9239830702718363 | distance: 0.92398variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7367935178125664 |  distance: 0.73679variant: original 500px | 36.0 |
| Poly Vector | 0.7325467340816879 |  distance: 0.73255variant: original 500pxalg. parameter: noisy | 65.0 |
| Real-Time Inking | 0.8450905309766691 | distance: 0.84509variant: original | 3.0 |
| Stroke Aggregator | 0.8999950565831939 | distance: 0.9variant: vectorized (all layers) | 497.0 |
| Topology Driven → Stroke Aggregator | 0.8021649984123698 | distance: 0.80216variant: original 500px | 313.0 |
| Topology Driven | 0.8454493729023541 | distance: 0.84545variant: original 500px | 9.0 |
| Delaunay Triangulation | 0.8256219253569742 | distance: 0.82562variant: original 500px | 3.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.878384914870895 | distance: 0.87838variant: originalalg. parameter: 0.25 | 296.0 |
| Mastering Sketching | 0.9558456091892651 | distance: 0.95585variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8034257541753419 | distance: 0.80343variant: original 500px | 36.0 |
| Poly Vector | 0.7979632840640635 | distance: 0.79796variant: original 500px | 66.0 |
| Real-Time Inking | 0.91587547870842 | distance: 0.91588variant: original | 3.0 |
| Stroke Aggregator | 0.9531342604626084 | distance: 0.95313variant: vectorized (all layers) | 497.0 |
| Topology Driven → Stroke Aggregator | 0.8850256318297147 | distance: 0.88503variant: original 500px | 313.0 |
| Topology Driven | 0.9099461581777164 | distance: 0.90995variant: original 500px | 9.0 |
| Delaunay Triangulation | 0.8709192834096326 | distance: 0.87092variant: original 500px | 3.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8986571840512457 | distance: 0.89866variant: originalalg. parameter: 0.25 | 296.0 |
| Mastering Sketching | 0.9757037856300398 | distance: 0.9757variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8350106423607319 | distance: 0.83501variant: original 500px | 36.0 |
| Poly Vector | 0.8350661927555487 | distance: 0.83507variant: original 500pxalg. parameter: noisy | 65.0 |
| Real-Time Inking | 0.9476772020752648 |  distance: 0.94768variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9675950626357284 | distance: 0.9676variant: vectorized (all layers) | 497.0 |
| Topology Driven → Stroke Aggregator | 0.9251832860858534 | distance: 0.92518variant: original 500px | 313.0 |
| Topology Driven | 0.944367337370978 | distance: 0.94437variant: original 500px | 9.0 |
| Delaunay Triangulation | 0.9078416133035804 | distance: 0.90784variant: original 500px | 3.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.3432841491699219 | distance: 0.34328variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.03022160541018609 |  distance: 0.03022variant: original | 421.0 |
| Poly Vector | 0.03443835067749024 |  distance: 0.03444variant: original 1000pxalg. parameter: noisy | 187.0 |
| Stroke Aggregator | 0.03245629528444901 | distance: 0.03246variant: vectorized (all layers) | 497.0 |
| Real-Time Inking | 0.03576684344170019 | distance: 0.03577variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.033105892181396486 | distance: 0.03311variant: original 500px | 313.0 |
| Delaunay Triangulation | 0.029154760360717773 | distance: 0.02915variant: original 1000px | 12.0 |
| Fidelity Simplicity | 0.09090909090909093 | distance: 0.09091variant: originalalg. parameter: 0.75 | 376.0 |
| Topology Driven | 0.032 | distance: 0.032variant: original 500px | 9.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
|
 |
|
|
 |
 |
 |
|
|||
| original 1000px | |
 |
|
 |
 |
 |
 |
|
 |
|
 |
|
|||
| original 500px | |
|
|
 |
 |
 |
 |
 |
|
|
|
|
|
|
|
| vectorized (all layers) | |