A Benchmark for Rough Sketch Cleanup
Ind_architecture_baseline_02
Author: Baseline Licence: Academic PaperMessiness: 0.1857
Ambiguity (Chamfer): 0.06939
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Stroke Aggregator | Mastering Sketching | Real-Time Inking | Topology Driven | Poly Vector | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Poly Vector → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00083 |  distance: 0.00092 |  distance: 0.00104 |  distance: 0.00121 |  distance: 0.00122 |  distance: 0.00136 |  distance: 0.00166 |  distance: 0.00299 |  distance: 0.00424 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0016579243761872878 | distance: 0.00166variant: original 1000px | 11.0 |
| Fidelity Simplicity | 0.004236368512608759 | distance: 0.00424variant: original 1000pxalg. parameter: 0.25 | 284.0 |
| Mastering Sketching | 0.0009223058577541462 | distance: 0.00092variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.002989883650843624 | distance: 0.00299variant: original 500px | 34.0 |
| Poly Vector | 0.0012168747012676227 | distance: 0.00122variant: originalalg. parameter: noisy | 583.0 |
| Real-Time Inking | 0.0010410768907139518 | distance: 0.00104variant: original | 3.0 |
| Stroke Aggregator | 0.0008342682667070926 | distance: 0.00083variant: vectorized (all layers) | 703.0 |
| Topology Driven → Stroke Aggregator | 0.0013612781386320866 | distance: 0.00136variant: original 1000px | 1176.0 |
| Topology Driven | 0.001214489630504629 | distance: 0.00121variant: original | 137.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4832170213884034 |  distance: 0.48322variant: original 500px | 3.0 |
| Fidelity Simplicity | 0.6331829410941148 |  distance: 0.63318variant: original 500pxalg. parameter: 0.75 | 211.0 |
| Mastering Sketching | 0.8145875820873627 | distance: 0.81459variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6416220589399703 | distance: 0.64162variant: original 500px | 34.0 |
| Poly Vector | 0.6340797316054754 |  distance: 0.63408variant: original 500px | 103.0 |
| Real-Time Inking | 0.7246278918905715 |  distance: 0.72463variant: original 1000px | 3.0 |
| Stroke Aggregator | 0.7681838689495072 | distance: 0.76818variant: vectorized (all layers) | 703.0 |
| Topology Driven → Stroke Aggregator | 0.645823719309778 |  distance: 0.64582variant: original 500px | 201.0 |
| Topology Driven | 0.7064933520091591 | distance: 0.70649variant: original | 137.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7201747653018571 | distance: 0.72017variant: original 500px | 3.0 |
| Fidelity Simplicity | 0.8058805604741907 | distance: 0.80588variant: original 500pxalg. parameter: 0.75 | 211.0 |
| Poly Vector → Stroke Aggregator | 0.8015179444356701 | distance: 0.80152variant: original 500px | 34.0 |
| Poly Vector | 0.8008960324185503 | distance: 0.8009variant: original 500px | 103.0 |
| Stroke Aggregator | 0.943514481855348 | distance: 0.94351variant: vectorized (all layers) | 703.0 |
| Topology Driven | 0.8891054659733169 | distance: 0.88911variant: original | 137.0 |
| Mastering Sketching | 0.9437796106476972 | distance: 0.94378variant: original 500px | 5.0 |
| Real-Time Inking | 0.9089422457121246 | distance: 0.90894variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.8598941889301747 | distance: 0.85989variant: original 500px | 201.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Topology Driven | 0.9577670430445324 | distance: 0.95777variant: original | 137.0 |
| Delaunay Triangulation | 0.8474426413182965 | distance: 0.84744variant: original 500px | 3.0 |
| Fidelity Simplicity | 0.8821174174051304 | distance: 0.88212variant: original 500pxalg. parameter: 0.75 | 211.0 |
| Mastering Sketching | 0.9797795137539452 | distance: 0.97978variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8704106102396577 | distance: 0.87041variant: original 500px | 34.0 |
| Poly Vector | 0.8714430150918631 | distance: 0.87144variant: original 500px | 103.0 |
| Real-Time Inking | 0.9612862317682421 | distance: 0.96129variant: original | 3.0 |
| Stroke Aggregator | 0.9731033433579253 | distance: 0.9731variant: vectorized (all layers) | 703.0 |
| Topology Driven → Stroke Aggregator | 0.9443072571715068 | distance: 0.94431variant: original 500px | 201.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8886539000811168 | distance: 0.88865variant: original 500px | 3.0 |
| Fidelity Simplicity | 0.9132925029143104 |  distance: 0.91329variant: original 500pxalg. parameter: 0.5 | 191.0 |
| Poly Vector → Stroke Aggregator | 0.9043553859189538 | distance: 0.90436variant: original 500px | 34.0 |
| Real-Time Inking | 0.9828815181694144 |  distance: 0.98288variant: original 500px | 10.0 |
| Stroke Aggregator | 0.995155200675413 | distance: 0.99516variant: vectorized (all layers) | 703.0 |
| Mastering Sketching | 0.9937065310730566 | distance: 0.99371variant: original 500px | 5.0 |
| Poly Vector | 0.9063520175487212 | distance: 0.90635variant: original 500px | 103.0 |
| Topology Driven → Stroke Aggregator | 0.9805739133950032 | distance: 0.98057variant: original 500px | 201.0 |
| Topology Driven | 0.9815313607735944 | distance: 0.98153variant: original | 137.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.9118280590293254 | distance: 0.91183variant: original 500px | 3.0 |
| Mastering Sketching | 0.9979105090435012 | distance: 0.99791variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.923533136127082 | distance: 0.92353variant: original 500px | 34.0 |
| Poly Vector | 0.925920523571223 | distance: 0.92592variant: original 500px | 103.0 |
| Real-Time Inking | 0.9889175722951636 | distance: 0.98892variant: original 500px | 10.0 |
| Topology Driven → Stroke Aggregator | 0.9927288862106786 | distance: 0.99273variant: original 500px | 201.0 |
| Stroke Aggregator | 0.9982918573309096 | distance: 0.99829variant: vectorized (all layers) | 703.0 |
| Topology Driven | 0.9911127800726 | distance: 0.99111variant: original | 137.0 |
| Fidelity Simplicity | 0.9249671980632234 | distance: 0.92497variant: original 500pxalg. parameter: 0.75 | 211.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.039849716186523436 | distance: 0.03985variant: original 500px | 34.0 |
| Delaunay Triangulation | 0.05903388977050781 | distance: 0.05903variant: original 1000px | 11.0 |
| Fidelity Simplicity | 0.1853448275862069 |  distance: 0.18534variant: originalalg. parameter: 0.25 | 436.0 |
| Mastering Sketching | 0.11327841949462893 | distance: 0.11328variant: original 500px | 5.0 |
| Poly Vector | 0.01529705810546875 |  distance: 0.0153variant: original 1000pxalg. parameter: noisy | 266.0 |
| Real-Time Inking | 0.01581138801574707 | distance: 0.01581variant: original 1000px | 3.0 |
| Stroke Aggregator | 0.01532567049808429 | distance: 0.01533variant: vectorized (all layers) | 703.0 |
| Topology Driven → Stroke Aggregator | 0.01529705810546875 | distance: 0.0153variant: original 1000px | 1176.0 |
| Topology Driven | 0.014560219764709472 |  distance: 0.01456variant: original 500px | 9.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
 |
 |
|
|
 |
 |
|||||
| original 1000px | |
|
 |
|
 |
 |
 |
 |
|
 |
|
||||
| original 500px | |
|
|
 |
 |
|
|
 |
|
 |
|
|
 |
|
|
| vectorized (all layers) | |