A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_04
Author: Baseline Licence: Academic PaperMessiness: 0.33063
Ambiguity (Chamfer): 0.18727
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Stroke Aggregator | Mastering Sketching | Poly Vector → Stroke Aggregator | Real-Time Inking | Topology Driven | Poly Vector | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00195 |  distance: 0.00219 |  distance: 0.00239 |  distance: 0.00246 |  distance: 0.00261 |  distance: 0.00279 |  distance: 0.00344 |  distance: 0.00345 |  distance: 0.00372 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0034442213400530663 | distance: 0.00344variant: original | 11.0 |
| Fidelity Simplicity | 0.0037181801901032658 | distance: 0.00372variant: original 1000pxalg. parameter: 0.75 | 326.0 |
| Mastering Sketching | 0.0021865868086139244 | distance: 0.00219variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.002391344184157805 | distance: 0.00239variant: original | 493.0 |
| Poly Vector | 0.002786727207656966 | distance: 0.00279variant: originalalg. parameter: noisy | 333.0 |
| Real-Time Inking | 0.002459607360530637 | distance: 0.00246variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.0019472215409215281 | distance: 0.00195variant: vectorized (all layers) | 706.0 |
| Topology Driven → Stroke Aggregator | 0.003448257743924921 | distance: 0.00345variant: original 500px | 859.0 |
| Topology Driven | 0.002611783270953293 | distance: 0.00261variant: original | 45.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.36366065513164497 |  distance: 0.36366variant: original 500px | 2.0 |
| Mastering Sketching | 0.6228391903930469 | distance: 0.62284variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4820050662772937 |  distance: 0.48201variant: original 1000pxalg. parameter: noisy | 1100.0 |
| Poly Vector | 0.4909334206748616 | distance: 0.49093variant: originalalg. parameter: noisy | 333.0 |
| Real-Time Inking | 0.4962719396993538 |  distance: 0.49627variant: original | 3.0 |
| Stroke Aggregator | 0.5547168067538362 | distance: 0.55472variant: vectorized (all layers) | 706.0 |
| Topology Driven → Stroke Aggregator | 0.4636996992423954 | distance: 0.4637variant: original 500px | 859.0 |
| Topology Driven | 0.5010487728997551 | distance: 0.50105variant: original | 45.0 |
| Fidelity Simplicity | 0.4656373283813145 |  distance: 0.46564variant: original 500pxalg. parameter: 0.75 | 252.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5604463807912109 | distance: 0.56045variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.6540661060873942 | distance: 0.65407variant: original 500pxalg. parameter: 0.75 | 252.0 |
| Mastering Sketching | 0.7729208740039749 | distance: 0.77292variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7074068210722811 | distance: 0.70741variant: original 1000pxalg. parameter: noisy | 1100.0 |
| Poly Vector | 0.6621118435007041 | distance: 0.66211variant: originalalg. parameter: noisy | 333.0 |
| Real-Time Inking | 0.6579953432716792 | distance: 0.658variant: original | 3.0 |
| Stroke Aggregator | 0.7771318225446587 | distance: 0.77713variant: vectorized (all layers) | 706.0 |
| Topology Driven → Stroke Aggregator | 0.6580547232465376 | distance: 0.65805variant: original 500px | 859.0 |
| Topology Driven | 0.676461901407043 |  distance: 0.67646variant: original 500px | 9.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7190865691610668 | distance: 0.71909variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.7923048420139034 | distance: 0.7923variant: original 500pxalg. parameter: 0.75 | 252.0 |
| Mastering Sketching | 0.8597192128480289 | distance: 0.85972variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8121984591882713 |  distance: 0.8122variant: original 500pxalg. parameter: noisy | 31.0 |
| Poly Vector | 0.7838893726549558 |  distance: 0.78389variant: original 1000px | 195.0 |
| Real-Time Inking | 0.7848084117483529 | distance: 0.78481variant: original | 3.0 |
| Stroke Aggregator | 0.8735508209132362 | distance: 0.87355variant: vectorized (all layers) | 706.0 |
| Topology Driven → Stroke Aggregator | 0.7821449733359668 | distance: 0.78214variant: original 500px | 859.0 |
| Topology Driven | 0.7940615213636187 | distance: 0.79406variant: original 500px | 9.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7872970663903631 | distance: 0.7873variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.8754611196065896 | distance: 0.87546variant: original 500pxalg. parameter: 0.75 | 252.0 |
| Mastering Sketching | 0.9038275250442228 | distance: 0.90383variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8615429530691191 |  distance: 0.86154variant: original 500px | 31.0 |
| Poly Vector | 0.8579997410961681 |  distance: 0.858variant: original | 309.0 |
| Real-Time Inking | 0.8485207167394438 | distance: 0.84852variant: original | 3.0 |
| Stroke Aggregator | 0.9229665322702832 | distance: 0.92297variant: vectorized (all layers) | 706.0 |
| Topology Driven → Stroke Aggregator | 0.8495050388048908 | distance: 0.84951variant: original 500px | 859.0 |
| Topology Driven | 0.8576699246403701 | distance: 0.85767variant: original 500px | 9.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.85582883163654 | distance: 0.85583variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.910058861273882 |  distance: 0.91006variant: originalalg. parameter: 0.3 | 234.0 |
| Mastering Sketching | 0.9398034812095414 | distance: 0.9398variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9046870839648664 | distance: 0.90469variant: original 500pxalg. parameter: noisy | 31.0 |
| Poly Vector | 0.9048150978893528 |  distance: 0.90482variant: original 500px | 64.0 |
| Real-Time Inking | 0.8937063746970458 | distance: 0.89371variant: original | 3.0 |
| Stroke Aggregator | 0.9536412356179829 | distance: 0.95364variant: vectorized (all layers) | 706.0 |
| Topology Driven → Stroke Aggregator | 0.9059377924519448 | distance: 0.90594variant: original 500px | 859.0 |
| Topology Driven | 0.9104918914075799 | distance: 0.91049variant: original 500px | 9.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.04919349670410157 | distance: 0.04919variant: original 500pxalg. parameter: 0.75 | 252.0 |
| Mastering Sketching | 0.21614810180664065 | distance: 0.21615variant: original 500px | 5.0 |
| Delaunay Triangulation | 0.04024922180175782 |  distance: 0.04025variant: original 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.033420578403817416 | distance: 0.03342variant: original | 493.0 |
| Poly Vector | 0.03463878850827272 | distance: 0.03464variant: original | 309.0 |
| Real-Time Inking | 0.028071336746215817 |  distance: 0.02807variant: original 500px | 2.0 |
| Stroke Aggregator | 0.020980185084350785 | distance: 0.02098variant: vectorized (all layers) | 706.0 |
| Topology Driven → Stroke Aggregator | 0.033286632537841795 | distance: 0.03329variant: original 500px | 859.0 |
| Topology Driven | 0.034 | distance: 0.034variant: original 500px | 9.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
 |
 |
 |
|
|
|
|
 |
|
|||
| original 1000px | |
 |
 |
 |
|
 |
 |
 |
|
|
|
 |
|||
| original 500px | |
|
|
 |
 |
 |
|
 |
|
 |
|
|
|
|
|
| vectorized (all layers) | |