A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_17
Author: Baseline Licence: Academic PaperMessiness: 0.01499
Ambiguity (Chamfer): 0.02489
Shading: No
Scaffold: No
Texture Strokes: Yes
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Topology Driven | Poly Vector | Mastering Sketching | Topology Driven → Stroke Aggregator | Stroke Aggregator | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00028 |  distance: 0.00031 |  distance: 0.00031 |  distance: 0.00034 |  distance: 0.00038 |  distance: 0.00039 |  distance: 0.00039 |  distance: 0.00129 |  distance: 0.0074 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0012902712152295884 | distance: 0.00129variant: original | 9.0 |
| Fidelity Simplicity | 0.007398059521725541 | distance: 0.0074variant: originalalg. parameter: 0.25 | 227.0 |
| Mastering Sketching | 0.00034265953358665835 | distance: 0.00034variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0003901844208324547 | distance: 0.00039variant: originalalg. parameter: noisy | 173.0 |
| Poly Vector | 0.00031354444102837985 | distance: 0.00031variant: originalalg. parameter: noisy | 212.0 |
| Real-Time Inking | 0.0002843862837495933 | distance: 0.00028variant: original | 3.0 |
| Stroke Aggregator | 0.0003892579129885292 | distance: 0.00039variant: vectorized (all layers) | 436.0 |
| Topology Driven → Stroke Aggregator | 0.00038069610663617903 | distance: 0.00038variant: original | 604.0 |
| Topology Driven | 0.00031093975976753213 | distance: 0.00031variant: original | 21.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9306842983561964 |  distance: 0.93068variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9186089058273664 | distance: 0.91861variant: originalalg. parameter: noisy | 173.0 |
| Poly Vector | 0.3272360100773594 |  distance: 0.32724variant: original 500px | 72.0 |
| Real-Time Inking | 0.9164121406080624 |  distance: 0.91641variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.9180293812166886 | distance: 0.91803variant: vectorized (all layers) | 436.0 |
| Topology Driven → Stroke Aggregator | 0.6885685787790923 |  distance: 0.68857variant: original 500px | 94.0 |
| Topology Driven | 0.8642138105844342 |  distance: 0.86421variant: original 500px | 4.0 |
| Fidelity Simplicity | 0.42522772331577785 |  distance: 0.42523variant: original 500pxalg. parameter: 0.75 | 161.0 |
| Delaunay Triangulation | 0.34928772273228625 |  distance: 0.34929variant: original 500px | 1.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5203780909320433 | distance: 0.52038variant: original 500pxalg. parameter: 0.75 | 161.0 |
| Mastering Sketching | 0.9812771726085552 | distance: 0.98128variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9793347894247251 |  distance: 0.97933variant: original 1000pxalg. parameter: noisy | 120.0 |
| Poly Vector | 0.3975963264282272 | distance: 0.3976variant: original 500px | 72.0 |
| Stroke Aggregator | 0.9786933632503091 | distance: 0.97869variant: vectorized (all layers) | 436.0 |
| Topology Driven → Stroke Aggregator | 0.8402839414017478 | distance: 0.84028variant: original 500px | 94.0 |
| Topology Driven | 0.9479604235736848 | distance: 0.94796variant: original 500px | 4.0 |
| Delaunay Triangulation | 0.6288326349086379 | distance: 0.62883variant: original 500px | 1.0 |
| Real-Time Inking | 0.9741751734281088 | distance: 0.97418variant: original 1000px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.9868975674054652 | distance: 0.9869variant: original 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.919304803624504 | distance: 0.9193variant: original 500px | 94.0 |
| Topology Driven | 0.9768905633399251 | distance: 0.97689variant: original 500px | 4.0 |
| Delaunay Triangulation | 0.7636477973769574 | distance: 0.76365variant: original 500px | 1.0 |
| Mastering Sketching | 0.9894968176955904 | distance: 0.9895variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9879431600715384 | distance: 0.98794variant: originalalg. parameter: noisy | 173.0 |
| Poly Vector | 0.4509394065570144 |  distance: 0.45094variant: original 500pxalg. parameter: noisy | 66.0 |
| Stroke Aggregator | 0.9873027404484096 | distance: 0.9873variant: vectorized (all layers) | 436.0 |
| Fidelity Simplicity | 0.5707645564591013 | distance: 0.57076variant: original 500pxalg. parameter: 0.75 | 161.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Topology Driven → Stroke Aggregator | 0.9553069606502506 | distance: 0.95531variant: original 500px | 94.0 |
| Delaunay Triangulation | 0.8079868073669668 | distance: 0.80799variant: original 500px | 1.0 |
| Mastering Sketching | 0.9944749502745523 | distance: 0.99447variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9933612143015916 | distance: 0.99336variant: originalalg. parameter: noisy | 173.0 |
| Poly Vector | 0.4924803527426808 | distance: 0.49248variant: original 500pxalg. parameter: noisy | 66.0 |
| Real-Time Inking | 0.9928322035959462 |  distance: 0.99283variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9926679775938744 | distance: 0.99267variant: vectorized (all layers) | 436.0 |
| Topology Driven | 0.987935996467585 | distance: 0.98794variant: original 500px | 4.0 |
| Fidelity Simplicity | 0.593691067128822 | distance: 0.59369variant: original 500pxalg. parameter: 0.75 | 161.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Topology Driven → Stroke Aggregator | 0.9784528760453529 | distance: 0.97845variant: original 500px | 94.0 |
| Delaunay Triangulation | 0.8446242599340713 | distance: 0.84462variant: original 500px | 1.0 |
| Mastering Sketching | 0.9971855820419788 | distance: 0.99719variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.99698451714264 | distance: 0.99698variant: originalalg. parameter: noisy | 173.0 |
| Poly Vector | 0.5392046267919274 | distance: 0.5392variant: original 500pxalg. parameter: noisy | 66.0 |
| Real-Time Inking | 0.9960166020599124 | distance: 0.99602variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9968445975277987 | distance: 0.99684variant: vectorized (all layers) | 436.0 |
| Topology Driven | 0.99486129507422 | distance: 0.99486variant: original 500px | 4.0 |
| Fidelity Simplicity | 0.6212152001625685 | distance: 0.62122variant: original 500pxalg. parameter: 0.75 | 161.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.05118219840094215 | distance: 0.05118variant: original | 9.0 |
| Mastering Sketching | 0.2666608276367187 | distance: 0.26666variant: original 500px | 5.0 |
| Fidelity Simplicity | 0.11435703415944788 |  distance: 0.11436variant: originalalg. parameter: 0.75 | 221.0 |
| Poly Vector → Stroke Aggregator | 0.013892443656921386 | distance: 0.01389variant: original 1000pxalg. parameter: noisy | 120.0 |
| Poly Vector | 0.013892443656921386 |  distance: 0.01389variant: original 1000px | 182.0 |
| Real-Time Inking | 0.014011210110521071 | distance: 0.01401variant: original | 3.0 |
| Stroke Aggregator | 0.014011210110521071 | distance: 0.01401variant: vectorized (all layers) | 436.0 |
| Topology Driven → Stroke Aggregator | 0.013416407585144044 |  distance: 0.01342variant: original 1000px | 341.0 |
| Topology Driven | 0.013601470947265623 |  distance: 0.0136variant: original 1000px | 11.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
|
 |
|
 |
|
|
 |
|
|
|||
| original 1000px | |
|
|
 |
 |
 |
 |
 |
|
 |
|
 |
|
 |
|
| original 500px | |
|
|
 |
 |
 |
|
 |
|
|
|
|
|||
| vectorized (all layers) | |