A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_12
Author: Enrique Rosales Licence: Academic PaperMessiness: 0.09703
Ambiguity (Chamfer): 0.08978
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Poly Vector | Topology Driven | Stroke Aggregator | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00128 |  distance: 0.00138 |  distance: 0.00138 |  distance: 0.00144 |  distance: 0.00148 |  distance: 0.00151 |  distance: 0.00281 |  distance: 0.0073 |  distance: 0.0079 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.002805294242560168 | distance: 0.00281variant: original | 12.0 |
| Fidelity Simplicity | 0.007896231457447491 | distance: 0.0079variant: original 1000pxalg. parameter: 0.75 | 312.0 |
| Mastering Sketching | 0.0012812889887113185 | distance: 0.00128variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.001508508225338552 | distance: 0.00151variant: original | 155.0 |
| Poly Vector | 0.0013825594669986002 | distance: 0.00138variant: original | 211.0 |
| Real-Time Inking | 0.0013768411897092455 | distance: 0.00138variant: original | 3.0 |
| Stroke Aggregator | 0.0014811931913011858 | distance: 0.00148variant: vectorized (all layers) | 358.0 |
| Topology Driven → Stroke Aggregator | 0.00729839059391503 | distance: 0.0073variant: original 500px | 45.0 |
| Topology Driven | 0.0014401364283558654 | distance: 0.00144variant: original 1000px | 7.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.7595901089970559 | distance: 0.75959variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.7214510561356604 |  distance: 0.72145variant: original 1000px | 62.0 |
| Stroke Aggregator | 0.7238841755851843 | distance: 0.72388variant: vectorized (all layers) | 358.0 |
| Delaunay Triangulation | 0.4088283065614947 |  distance: 0.40883variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.5481434993045645 |  distance: 0.54814variant: originalalg. parameter: 0.75 | 539.0 |
| Poly Vector | 0.4533875027718008 |  distance: 0.45339variant: original 500pxalg. parameter: noisy | 52.0 |
| Real-Time Inking | 0.6523411849427986 |  distance: 0.65234variant: original 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.5522302919981825 | distance: 0.55223variant: original 500px | 45.0 |
| Topology Driven | 0.7436777790166128 |  distance: 0.74368variant: original 500px | 3.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9004125749008974 | distance: 0.90041variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8772038814588684 | distance: 0.8772variant: original 1000px | 62.0 |
| Stroke Aggregator | 0.8906729427341719 | distance: 0.89067variant: vectorized (all layers) | 358.0 |
| Topology Driven → Stroke Aggregator | 0.7217906189400529 | distance: 0.72179variant: original 500px | 45.0 |
| Topology Driven | 0.8775596472546765 | distance: 0.87756variant: original 500px | 3.0 |
| Delaunay Triangulation | 0.6141911105570859 | distance: 0.61419variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.7101207500810905 |  distance: 0.71012variant: originalalg. parameter: 0.6 | 464.0 |
| Poly Vector | 0.5805198320065471 |  distance: 0.58052variant: original 500px | 54.0 |
| Real-Time Inking | 0.8730848888282415 | distance: 0.87308variant: original 1000px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9501706127395556 | distance: 0.95017variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9335116204943466 |  distance: 0.93351variant: original 1000pxalg. parameter: noisy | 62.0 |
| Poly Vector | 0.6426432245887125 | distance: 0.64264variant: original 500px | 54.0 |
| Real-Time Inking | 0.9156724302114204 | distance: 0.91567variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.9358720610501008 | distance: 0.93587variant: vectorized (all layers) | 358.0 |
| Topology Driven → Stroke Aggregator | 0.8013045813072418 | distance: 0.8013variant: original 500px | 45.0 |
| Topology Driven | 0.9368570448649806 | distance: 0.93686variant: original 500px | 3.0 |
| Delaunay Triangulation | 0.7649685502629434 | distance: 0.76497variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.7878276155105862 |  distance: 0.78783variant: originalalg. parameter: 0.5 | 451.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7935975699966994 | distance: 0.7936variant: originalalg. parameter: 0.5 | 451.0 |
| Mastering Sketching | 0.9688984345958448 | distance: 0.9689variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9597926412947276 | distance: 0.95979variant: original 1000pxalg. parameter: noisy | 62.0 |
| Poly Vector | 0.6651827747983833 | distance: 0.66518variant: original 500px | 54.0 |
| Real-Time Inking | 0.9393281937541416 | distance: 0.93933variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.9627607129313612 | distance: 0.96276variant: vectorized (all layers) | 358.0 |
| Topology Driven → Stroke Aggregator | 0.8291189962881568 | distance: 0.82912variant: original 500px | 45.0 |
| Topology Driven | 0.9552063841779596 | distance: 0.95521variant: original 500px | 3.0 |
| Delaunay Triangulation | 0.8461578118830009 | distance: 0.84616variant: original 500px | 1.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8793404025508775 | distance: 0.87934variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.7969906861991896 | distance: 0.79699variant: originalalg. parameter: 0.5 | 451.0 |
| Mastering Sketching | 0.9742367588445576 | distance: 0.97424variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9667817896389324 | distance: 0.96678variant: original 1000pxalg. parameter: noisy | 62.0 |
| Poly Vector | 0.6909359869620375 | distance: 0.69094variant: original 500pxalg. parameter: noisy | 52.0 |
| Real-Time Inking | 0.9516279051732932 | distance: 0.95163variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.969466799288664 | distance: 0.96947variant: vectorized (all layers) | 358.0 |
| Topology Driven → Stroke Aggregator | 0.8531283057251694 | distance: 0.85313variant: original 500px | 45.0 |
| Topology Driven | 0.9710941079071288 | distance: 0.97109variant: original 500px | 3.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0641248779296875 |  distance: 0.06412variant: original 1000px | 2.0 |
| Fidelity Simplicity | 0.09929753112792968 |  distance: 0.0993variant: original 500pxalg. parameter: 0.75 | 194.0 |
| Mastering Sketching | 0.195274169921875 |  distance: 0.19527variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.03786177829064534 |  distance: 0.03786variant: originalalg. parameter: noisy | 158.0 |
| Poly Vector | 0.036878177642822266 |  distance: 0.03688variant: original 1000pxalg. parameter: noisy | 89.0 |
| Real-Time Inking | 0.03756017149066533 | distance: 0.03756variant: original | 3.0 |
| Stroke Aggregator | 0.03756017149066533 | distance: 0.03756variant: vectorized (all layers) | 358.0 |
| Topology Driven | 0.031240999221801763 | distance: 0.03124variant: original 500px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.1261427764892578 | distance: 0.12614variant: original 500px | 45.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
|
|
|
 |
|
|
|
|
||||
| original 1000px | |
|
 |
 |
 |
|
 |
|
|
 |
|
|
|
||
| original 500px | |
 |
|
 |
 |
 |
|
 |
|
|
|
|
|||
| vectorized (all layers) | |