A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_13
Author: Enrique Rosales Licence: Academic PaperMessiness: 0.17065
Ambiguity (Chamfer): 0.13267
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector → Stroke Aggregator | Stroke Aggregator | Topology Driven | Poly Vector | Real-Time Inking | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0016 |  distance: 0.00171 |  distance: 0.00182 |  distance: 0.00184 |  distance: 0.00194 |  distance: 0.00196 |  distance: 0.00197 |  distance: 0.00387 |  distance: 0.02411 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0038668125854773743 | distance: 0.00387variant: original 1000px | 6.0 |
| Fidelity Simplicity | 0.024109131049435326 | distance: 0.02411variant: original 500pxalg. parameter: 0.25 | 153.0 |
| Mastering Sketching | 0.0016019268801056408 | distance: 0.0016variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0017076212249975988 | distance: 0.00171variant: originalalg. parameter: noisy | 393.0 |
| Poly Vector | 0.0019381029830682344 | distance: 0.00194variant: originalalg. parameter: noisy | 133.0 |
| Real-Time Inking | 0.001956449062835493 | distance: 0.00196variant: original 1000px | 3.0 |
| Stroke Aggregator | 0.001822834193029684 | distance: 0.00182variant: vectorized (all layers) | 351.0 |
| Topology Driven → Stroke Aggregator | 0.0019698246439980986 | distance: 0.00197variant: original | 888.0 |
| Topology Driven | 0.001843901837392864 | distance: 0.00184variant: original | 23.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.23640668358851955 |  distance: 0.23641variant: original 1000pxalg. parameter: 0.25 | 201.0 |
| Real-Time Inking | 0.5723159099819515 |  distance: 0.57232variant: original | 3.0 |
| Mastering Sketching | 0.6670376726380332 |  distance: 0.66704variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5015704165977196 |  distance: 0.50157variant: original | 391.0 |
| Stroke Aggregator | 0.5586163008012307 | distance: 0.55862variant: vectorized (all layers) | 351.0 |
| Topology Driven → Stroke Aggregator | 0.5520112711731389 |  distance: 0.55201variant: original 500px | 165.0 |
| Delaunay Triangulation | 0.427720027195064 |  distance: 0.42772variant: original 500px | 1.0 |
| Poly Vector | 0.5677213963997211 |  distance: 0.56772variant: original 500px | 46.0 |
| Topology Driven | 0.6066530130348697 | distance: 0.60665variant: original | 23.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.3458241250406179 | distance: 0.34582variant: original 1000pxalg. parameter: 0.25 | 201.0 |
| Delaunay Triangulation | 0.6554638144782922 | distance: 0.65546variant: original 500px | 1.0 |
| Mastering Sketching | 0.8404849435441283 | distance: 0.84048variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.815731581941351 | distance: 0.81573variant: originalalg. parameter: noisy | 393.0 |
| Poly Vector | 0.7511820741907458 | distance: 0.75118variant: original 500px | 46.0 |
| Real-Time Inking | 0.8130461031422346 | distance: 0.81305variant: original 1000px | 3.0 |
| Stroke Aggregator | 0.8438486968810571 | distance: 0.84385variant: vectorized (all layers) | 351.0 |
| Topology Driven → Stroke Aggregator | 0.7761521428500558 | distance: 0.77615variant: original 500px | 165.0 |
| Topology Driven | 0.8245872310085309 |  distance: 0.82459variant: original 500px | 6.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.817826460137112 | distance: 0.81783variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.4037071918521791 | distance: 0.40371variant: original 1000pxalg. parameter: 0.25 | 201.0 |
| Mastering Sketching | 0.9056819180352726 | distance: 0.90568variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9050970748615216 |  distance: 0.9051variant: original 1000pxalg. parameter: noisy | 230.0 |
| Poly Vector | 0.8264101929341262 |  distance: 0.82641variant: original 500pxalg. parameter: noisy | 49.0 |
| Real-Time Inking | 0.889547677007602 | distance: 0.88955variant: original | 3.0 |
| Stroke Aggregator | 0.9241613713098226 | distance: 0.92416variant: vectorized (all layers) | 351.0 |
| Topology Driven → Stroke Aggregator | 0.88556438738362 | distance: 0.88556variant: original 500px | 165.0 |
| Topology Driven | 0.904327910479344 | distance: 0.90433variant: original 500px | 6.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8788955173355403 |  distance: 0.8789variant: original | 6.0 |
| Mastering Sketching | 0.9431497881099165 | distance: 0.94315variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.937485124244188 | distance: 0.93749variant: original 1000pxalg. parameter: noisy | 230.0 |
| Poly Vector | 0.8667777288446407 | distance: 0.86678variant: original 500pxalg. parameter: noisy | 49.0 |
| Real-Time Inking | 0.9346080015119944 | distance: 0.93461variant: original | 3.0 |
| Stroke Aggregator | 0.9519754124977936 | distance: 0.95198variant: vectorized (all layers) | 351.0 |
| Topology Driven → Stroke Aggregator | 0.9336428676357976 | distance: 0.93364variant: original 500px | 165.0 |
| Topology Driven | 0.9449778523436558 | distance: 0.94498variant: original 500px | 6.0 |
| Fidelity Simplicity | 0.4223004413099355 |  distance: 0.4223variant: original 1000pxalg. parameter: 0.75 | 217.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.9850467324369392 | distance: 0.98505variant: originalalg. parameter: noisy | 393.0 |
| Delaunay Triangulation | 0.9232366506454996 | distance: 0.92324variant: original | 6.0 |
| Mastering Sketching | 0.9837207467318958 | distance: 0.98372variant: original 1000px | 6.0 |
| Poly Vector | 0.9042484026182006 | distance: 0.90425variant: original 500px | 46.0 |
| Real-Time Inking | 0.9712385124030972 | distance: 0.97124variant: original | 3.0 |
| Stroke Aggregator | 0.987255217473555 | distance: 0.98726variant: vectorized (all layers) | 351.0 |
| Topology Driven → Stroke Aggregator | 0.9718489251801262 | distance: 0.97185variant: original | 888.0 |
| Topology Driven | 0.9795926081414756 | distance: 0.97959variant: original | 23.0 |
| Fidelity Simplicity | 0.4317031927630411 |  distance: 0.4317variant: original 1000pxalg. parameter: 0.3 | 215.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.06760177612304688 | distance: 0.0676variant: original 1000px | 6.0 |
| Poly Vector | 0.016401220321655273 |  distance: 0.0164variant: original 1000px | 105.0 |
| Real-Time Inking | 0.016652877779974453 | distance: 0.01665variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.01612451553344726 |  distance: 0.01612variant: original 1000px | 1645.0 |
| Topology Driven | 0.0162788200378418 |  distance: 0.01628variant: original 1000px | 20.0 |
| Fidelity Simplicity | 0.2643785095214844 | distance: 0.26438variant: original 500pxalg. parameter: 0.25 | 153.0 |
| Mastering Sketching | 0.16056150817871093 | distance: 0.16056variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.011457527893176977 | distance: 0.01146variant: originalalg. parameter: noisy | 393.0 |
| Stroke Aggregator | 0.009628755458887072 | distance: 0.00963variant: vectorized (all layers) | 351.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
|
 |
|
|
|
|||||||
| original 1000px | |
|
|
|
|
 |
|
 |
|
 |
|
|
|
 |
|
| original 500px | |
 |
|
 |
|
 |
 |
 |
|
|
|
|
|||
| vectorized (all layers) | |