A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_04
Author: Baseline Licence: Academic PaperMessiness: 0.23186
Ambiguity (Chamfer): 0.21369
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Stroke Aggregator | Poly Vector → Stroke Aggregator | Real-Time Inking | Topology Driven | Poly Vector | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0018 |  distance: 0.00197 |  distance: 0.00216 |  distance: 0.00228 |  distance: 0.00248 |  distance: 0.00253 |  distance: 0.00317 |  distance: 0.00405 |  distance: 0.00429 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.003166363222160259 | distance: 0.00317variant: original | 15.0 |
| Fidelity Simplicity | 0.004287157176224023 | distance: 0.00429variant: original 1000pxalg. parameter: 0.75 | 423.0 |
| Mastering Sketching | 0.00179791213662337 | distance: 0.0018variant: original 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.002155239203062853 | distance: 0.00216variant: original | 669.0 |
| Poly Vector | 0.002530334561319369 | distance: 0.00253variant: originalalg. parameter: noisy | 269.0 |
| Real-Time Inking | 0.002277301644055021 | distance: 0.00228variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.001974267561747812 | distance: 0.00197variant: vectorized (all layers) | 598.0 |
| Topology Driven → Stroke Aggregator | 0.0040494657118595005 | distance: 0.00405variant: original 500px | 281.0 |
| Topology Driven | 0.0024812381534909233 | distance: 0.00248variant: original | 46.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3612519608977847 |  distance: 0.36125variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.3100054917266987 |  distance: 0.31001variant: originalalg. parameter: 0.75 | 380.0 |
| Mastering Sketching | 0.5006298792307944 | distance: 0.50063variant: original 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.4069557471827994 | distance: 0.40696variant: original | 669.0 |
| Poly Vector | 0.3333814274932999 |  distance: 0.33338variant: original 500pxalg. parameter: noisy | 56.0 |
| Real-Time Inking | 0.4151905339191239 |  distance: 0.41519variant: original | 3.0 |
| Stroke Aggregator | 0.411887519074334 | distance: 0.41189variant: vectorized (all layers) | 598.0 |
| Topology Driven → Stroke Aggregator | 0.34367131887445695 | distance: 0.34367variant: original 500px | 281.0 |
| Topology Driven | 0.4279419573476828 | distance: 0.42794variant: original | 46.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5371911200599317 | distance: 0.53719variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.4756857715902906 |  distance: 0.47569variant: originalalg. parameter: 0.25 | 343.0 |
| Mastering Sketching | 0.7188171846994429 | distance: 0.71882variant: original 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.6245974233498337 | distance: 0.6246variant: original | 669.0 |
| Poly Vector | 0.4662093051752328 | distance: 0.46621variant: original 500pxalg. parameter: noisy | 56.0 |
| Real-Time Inking | 0.6422275535641466 |  distance: 0.64223variant: original 500px | 2.0 |
| Stroke Aggregator | 0.6562394141146595 | distance: 0.65624variant: vectorized (all layers) | 598.0 |
| Topology Driven → Stroke Aggregator | 0.5393085611582096 | distance: 0.53931variant: original 500px | 281.0 |
| Topology Driven | 0.6151189233108001 |  distance: 0.61512variant: original 500px | 8.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.8844792011212762 | distance: 0.88448variant: original 500px | 8.0 |
| Stroke Aggregator | 0.8477272108346346 | distance: 0.84773variant: vectorized (all layers) | 598.0 |
| Delaunay Triangulation | 0.7186152320795276 | distance: 0.71862variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.6437498845752052 |  distance: 0.64375variant: originalalg. parameter: 0.6 | 366.0 |
| Poly Vector → Stroke Aggregator | 0.8252822888437232 | distance: 0.82528variant: original | 669.0 |
| Poly Vector | 0.6355716495254409 |  distance: 0.63557variant: original 500px | 54.0 |
| Real-Time Inking | 0.80388610248807 | distance: 0.80389variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.7300111548926147 | distance: 0.73001variant: original 500px | 281.0 |
| Topology Driven | 0.7848806361812172 | distance: 0.78488variant: original 500px | 8.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8000772425400333 | distance: 0.80008variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.7290588967231052 | distance: 0.72906variant: originalalg. parameter: 0.6 | 366.0 |
| Mastering Sketching | 0.9413360774580428 | distance: 0.94134variant: original 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.9117624883087108 | distance: 0.91176variant: original | 669.0 |
| Poly Vector | 0.71817976882616 | distance: 0.71818variant: original 500px | 54.0 |
| Real-Time Inking | 0.8762803209637317 | distance: 0.87628variant: original | 3.0 |
| Stroke Aggregator | 0.9382751041888218 | distance: 0.93828variant: vectorized (all layers) | 598.0 |
| Topology Driven → Stroke Aggregator | 0.8386532561825114 | distance: 0.83865variant: original 500px | 281.0 |
| Topology Driven | 0.8637378915962802 | distance: 0.86374variant: original 500px | 8.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8596545614190693 | distance: 0.85965variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.7700084479886367 |  distance: 0.77001variant: originalalg. parameter: 0.3 | 361.0 |
| Mastering Sketching | 0.9668795599349764 | distance: 0.96688variant: original 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.94706550708225 | distance: 0.94707variant: original | 669.0 |
| Poly Vector | 0.7652934742982137 | distance: 0.76529variant: original 500pxalg. parameter: noisy | 56.0 |
| Real-Time Inking | 0.918807683826448 | distance: 0.91881variant: original | 3.0 |
| Stroke Aggregator | 0.9624994554891324 | distance: 0.9625variant: vectorized (all layers) | 598.0 |
| Topology Driven → Stroke Aggregator | 0.8999774801420903 | distance: 0.89998variant: original 500px | 281.0 |
| Topology Driven | 0.9196800421317292 | distance: 0.91968variant: original 500px | 8.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.024413110733032227 |  distance: 0.02441variant: original 1000pxalg. parameter: noisy | 196.0 |
| Real-Time Inking | 0.02476285528572942 | distance: 0.02476variant: original | 3.0 |
| Stroke Aggregator | 0.017048192455307663 | distance: 0.01705variant: vectorized (all layers) | 598.0 |
| Topology Driven | 0.02433936022253129 | distance: 0.02434variant: original | 46.0 |
| Delaunay Triangulation | 0.049491526851733636 | distance: 0.04949variant: original | 15.0 |
| Fidelity Simplicity | 0.11446208715107245 | distance: 0.11446variant: originalalg. parameter: 0.75 | 380.0 |
| Mastering Sketching | 0.17978875732421876 | distance: 0.17979variant: original 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.03172321080829901 | distance: 0.03172variant: original | 669.0 |
| Topology Driven → Stroke Aggregator | 0.050990196228027335 | distance: 0.05099variant: original 500px | 281.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
 |
|
|
|
|
 |
|
|
||||
| original 1000px | |
 |
 |
 |
|
 |
 |
|
 |
 |
|||||
| original 500px | |
|
|
 |
 |
 |
 |
 |
|
|
|
|
|||
| vectorized (all layers) | |