A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_15
Author: Enrique Rosales Licence: Academic PaperMessiness: 0.11303
Ambiguity (Chamfer): 0.0934
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Stroke Aggregator | Poly Vector → Stroke Aggregator | Mastering Sketching | Real-Time Inking | Poly Vector | Topology Driven | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00096 |  distance: 0.00097 |  distance: 0.00105 |  distance: 0.00108 |  distance: 0.00118 |  distance: 0.0012 |  distance: 0.00132 |  distance: 0.00445 |  distance: 0.02495 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.004446318442049617 | distance: 0.00445variant: original | 8.0 |
| Fidelity Simplicity | 0.024954673321632915 | distance: 0.02495variant: original 500pxalg. parameter: 0.6 | 215.0 |
| Mastering Sketching | 0.001046282373857709 | distance: 0.00105variant: original 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.0009695267515328596 | distance: 0.00097variant: original | 118.0 |
| Poly Vector | 0.0011813619286743394 | distance: 0.00118variant: original | 117.0 |
| Real-Time Inking | 0.0010815194517050306 | distance: 0.00108variant: original | 2.0 |
| Stroke Aggregator | 0.0009599004874694724 | distance: 0.00096variant: vectorized (all layers) | 205.0 |
| Topology Driven → Stroke Aggregator | 0.0013155386348564619 | distance: 0.00132variant: original | 791.0 |
| Topology Driven | 0.0011974693259531658 | distance: 0.0012variant: original | 21.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4944266088418246 |  distance: 0.49443variant: original 500pxalg. parameter: 0.75 | 231.0 |
| Mastering Sketching | 0.7964247200272406 | distance: 0.79642variant: original 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.7466711352009826 | distance: 0.74667variant: original | 118.0 |
| Poly Vector | 0.44661220080745656 |  distance: 0.44661variant: original 500px | 36.0 |
| Real-Time Inking | 0.7325958362877232 | distance: 0.7326variant: original | 2.0 |
| Topology Driven → Stroke Aggregator | 0.7000844910453343 |  distance: 0.70008variant: original 1000px | 219.0 |
| Topology Driven | 0.6627909040820112 |  distance: 0.66279variant: original 500px | 3.0 |
| Delaunay Triangulation | 0.3018531597218768 |  distance: 0.30185variant: original 500px | 0.0 |
| Stroke Aggregator | 0.7534808906990157 | distance: 0.75348variant: vectorized (all layers) | 205.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.624816526181001 |  distance: 0.62482variant: original 500pxalg. parameter: 0.5 | 224.0 |
| Mastering Sketching | 0.918133462981199 | distance: 0.91813variant: original 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.9098306945214008 | distance: 0.90983variant: original | 118.0 |
| Poly Vector | 0.5948310856524289 |  distance: 0.59483variant: original 500pxalg. parameter: noisy | 35.0 |
| Real-Time Inking | 0.8684712193453388 |  distance: 0.86847variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9083955435461912 | distance: 0.9084variant: vectorized (all layers) | 205.0 |
| Topology Driven → Stroke Aggregator | 0.8823568910647911 | distance: 0.88236variant: original | 791.0 |
| Topology Driven | 0.8435479079514488 | distance: 0.84355variant: original 500px | 3.0 |
| Delaunay Triangulation | 0.582865722773263 | distance: 0.58287variant: original 500px | 0.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6731050233019484 | distance: 0.67311variant: original 500pxalg. parameter: 0.6 | 215.0 |
| Mastering Sketching | 0.9636674812294616 | distance: 0.96367variant: original 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.9594893345120192 | distance: 0.95949variant: original | 118.0 |
| Poly Vector | 0.6794892250728675 | distance: 0.67949variant: original 500pxalg. parameter: noisy | 35.0 |
| Real-Time Inking | 0.9285959291505804 | distance: 0.9286variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9544285962559654 | distance: 0.95443variant: vectorized (all layers) | 205.0 |
| Topology Driven → Stroke Aggregator | 0.9408656249828148 | distance: 0.94087variant: original 1000px | 219.0 |
| Topology Driven | 0.9294947869328872 | distance: 0.92949variant: original 500px | 3.0 |
| Delaunay Triangulation | 0.7770142157200577 | distance: 0.77701variant: original 500px | 0.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7061023000294557 |  distance: 0.7061variant: original 500pxalg. parameter: 0.3 | 185.0 |
| Mastering Sketching | 0.9823676664644148 | distance: 0.98237variant: original 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.9925607222966238 |  distance: 0.99256variant: originalalg. parameter: noisy | 117.0 |
| Poly Vector | 0.7161254161466789 | distance: 0.71613variant: original 500pxalg. parameter: noisy | 35.0 |
| Topology Driven → Stroke Aggregator | 0.9738258509261616 | distance: 0.97383variant: original 1000px | 219.0 |
| Topology Driven | 0.9677926412154624 | distance: 0.96779variant: original 500px | 3.0 |
| Delaunay Triangulation | 0.8051824776593565 |  distance: 0.80518variant: original 1000px | 3.0 |
| Real-Time Inking | 0.9591355217667716 | distance: 0.95914variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9873636461820932 | distance: 0.98736variant: vectorized (all layers) | 205.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7188477737506392 |  distance: 0.71885variant: original 1000pxalg. parameter: 0.75 | 348.0 |
| Mastering Sketching | 0.995970089762209 | distance: 0.99597variant: original 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.9970801116195054 | distance: 0.99708variant: originalalg. parameter: noisy | 117.0 |
| Poly Vector | 0.7462003075075065 | distance: 0.7462variant: original 500px | 36.0 |
| Real-Time Inking | 0.9711622391613686 | distance: 0.97116variant: original 500px | 2.0 |
| Topology Driven | 0.9898608361398552 |  distance: 0.98986variant: original 1000px | 10.0 |
| Delaunay Triangulation | 0.8368342239046772 | distance: 0.83683variant: original 1000px | 3.0 |
| Stroke Aggregator | 0.9936944914003596 | distance: 0.99369variant: vectorized (all layers) | 205.0 |
| Topology Driven → Stroke Aggregator | 0.9903399273484804 | distance: 0.99034variant: original 1000px | 219.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.102 | distance: 0.102variant: original 500px | 0.0 |
| Poly Vector | 0.013601470947265623 |  distance: 0.0136variant: original 1000pxalg. parameter: noisy | 71.0 |
| Real-Time Inking | 0.013949645192999587 | distance: 0.01395variant: original | 2.0 |
| Topology Driven → Stroke Aggregator | 0.013768976384943182 | distance: 0.01377variant: original | 791.0 |
| Topology Driven | 0.013949645192999587 | distance: 0.01395variant: original | 21.0 |
| Stroke Aggregator | 0.010149857644259077 | distance: 0.01015variant: vectorized (all layers) | 205.0 |
| Fidelity Simplicity | 0.4936111755371094 |  distance: 0.49361variant: original 500pxalg. parameter: 0.25 | 187.0 |
| Mastering Sketching | 0.236541748046875 | distance: 0.23654variant: original 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.013239201176109496 | distance: 0.01324variant: original | 118.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
 |
|
|
|
|
|||||||
| original 1000px | |
 |
 |
 |
 |
|
 |
|
|
 |
|
||||
| original 500px | |
|
|
|
|
|
|
|
|
|
|
||||
| vectorized (all layers) | |