A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_02
Author: Baseline Licence: Academic PaperMessiness: 0.08544
Ambiguity (Chamfer): 0.12665
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Stroke Aggregator | Real-Time Inking | Poly Vector | Topology Driven | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00066 |  distance: 0.00068 |  distance: 0.00069 |  distance: 0.00075 |  distance: 0.00076 |  distance: 0.00082 |  distance: 0.00086 |  distance: 0.00207 |  distance: 0.043 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.002069657813617602 | distance: 0.00207variant: original | 46.0 |
| Fidelity Simplicity | 0.0430012537007444 | distance: 0.043variant: original 1000pxalg. parameter: 0.3 | 206.0 |
| Mastering Sketching | 0.0006553390136628303 | distance: 0.00066variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.000824895215307522 | distance: 0.00082variant: original 1000px | 74.0 |
| Poly Vector | 0.0007532688298027866 | distance: 0.00075variant: original | 250.0 |
| Real-Time Inking | 0.000685271056890271 | distance: 0.00069variant: original | 3.0 |
| Stroke Aggregator | 0.0006825176581001838 | distance: 0.00068variant: vectorized (all layers) | 256.0 |
| Topology Driven → Stroke Aggregator | 0.0008593101187278074 | distance: 0.00086variant: original | 1103.0 |
| Topology Driven | 0.0007615469686610584 | distance: 0.00076variant: original | 54.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.487981194057835 |  distance: 0.48798variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.11695273503869605 |  distance: 0.11695variant: originalalg. parameter: 0.6 | 177.0 |
| Mastering Sketching | 0.6929867288699766 | distance: 0.69299variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6656557185580843 |  distance: 0.66566variant: original 1000pxalg. parameter: noisy | 76.0 |
| Poly Vector | 0.6068060284614603 |  distance: 0.60681variant: original 500pxalg. parameter: noisy | 57.0 |
| Real-Time Inking | 0.6441511732451749 | distance: 0.64415variant: original | 3.0 |
| Stroke Aggregator | 0.6334285072624539 | distance: 0.63343variant: vectorized (all layers) | 256.0 |
| Topology Driven → Stroke Aggregator | 0.6268815941123321 | distance: 0.62688variant: original | 1103.0 |
| Topology Driven | 0.6409327031727408 | distance: 0.64093variant: original | 54.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6904459158812138 | distance: 0.69045variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.15313507205127305 |  distance: 0.15314variant: originalalg. parameter: 0.3 | 199.0 |
| Mastering Sketching | 0.8398637713593629 | distance: 0.83986variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8201450343058502 | distance: 0.82015variant: original 1000pxalg. parameter: noisy | 76.0 |
| Poly Vector | 0.7480799953620256 | distance: 0.74808variant: original 500pxalg. parameter: noisy | 57.0 |
| Real-Time Inking | 0.8211569353390935 |  distance: 0.82116variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.8225746865788442 | distance: 0.82257variant: vectorized (all layers) | 256.0 |
| Topology Driven → Stroke Aggregator | 0.825323554000438 | distance: 0.82532variant: original | 1103.0 |
| Topology Driven | 0.8275190028478759 |  distance: 0.82752variant: original 500px | 5.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8191242574524834 | distance: 0.81912variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.16716323987148166 | distance: 0.16716variant: originalalg. parameter: 0.6 | 177.0 |
| Mastering Sketching | 0.909780215389948 | distance: 0.90978variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9002923789102621 | distance: 0.90029variant: original 1000pxalg. parameter: noisy | 76.0 |
| Poly Vector | 0.8344506248030189 | distance: 0.83445variant: original 500pxalg. parameter: noisy | 57.0 |
| Real-Time Inking | 0.9005149918424853 | distance: 0.90051variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.8991137831679122 | distance: 0.89911variant: vectorized (all layers) | 256.0 |
| Topology Driven → Stroke Aggregator | 0.902626370743882 | distance: 0.90263variant: original | 1103.0 |
| Topology Driven | 0.9014476389809144 | distance: 0.90145variant: original 500px | 5.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8769431035707064 | distance: 0.87694variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.17164940266530454 | distance: 0.17165variant: originalalg. parameter: 0.6 | 177.0 |
| Mastering Sketching | 0.943550111356186 | distance: 0.94355variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9382313335741096 | distance: 0.93823variant: original 1000pxalg. parameter: noisy | 76.0 |
| Poly Vector | 0.8798760786989667 |  distance: 0.87988variant: original 500px | 54.0 |
| Real-Time Inking | 0.9352840996303938 |  distance: 0.93528variant: original 500px | 2.0 |
| Stroke Aggregator | 0.938696265141694 | distance: 0.9387variant: vectorized (all layers) | 256.0 |
| Topology Driven → Stroke Aggregator | 0.9366995054172756 |  distance: 0.9367variant: original 1000px | 321.0 |
| Topology Driven | 0.9305408401010138 | distance: 0.93054variant: original 500px | 5.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.9077196558324424 |  distance: 0.90772variant: original 1000px | 6.0 |
| Fidelity Simplicity | 0.1786679518328456 |  distance: 0.17867variant: originalalg. parameter: 0.25 | 211.0 |
| Mastering Sketching | 0.968722380684276 | distance: 0.96872variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.968285974631878 | distance: 0.96829variant: original 1000px | 74.0 |
| Poly Vector | 0.9248284178326012 | distance: 0.92483variant: original 500pxalg. parameter: noisy | 57.0 |
| Real-Time Inking | 0.9651042823958852 | distance: 0.9651variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9659076146684772 | distance: 0.96591variant: vectorized (all layers) | 256.0 |
| Topology Driven → Stroke Aggregator | 0.9638252612091828 | distance: 0.96383variant: original 1000px | 321.0 |
| Topology Driven | 0.9631257940750918 | distance: 0.96313variant: original 500px | 5.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.05189412307739258 | distance: 0.05189variant: original 1000px | 6.0 |
| Fidelity Simplicity | 0.3104126281738281 |  distance: 0.31041variant: original 500pxalg. parameter: 0.6 | 1549.0 |
| Mastering Sketching | 0.122 |  distance: 0.122variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.00948683261871338 | distance: 0.00949variant: original 1000pxalg. parameter: noisy | 76.0 |
| Poly Vector | 0.009000000000000001 |  distance: 0.009variant: original 1000pxalg. parameter: noisy | 111.0 |
| Real-Time Inking | 0.01127281291235548 | distance: 0.01127variant: original | 3.0 |
| Stroke Aggregator | 0.0091310383487323 | distance: 0.00913variant: vectorized (all layers) | 256.0 |
| Topology Driven → Stroke Aggregator | 0.009000000000000001 | distance: 0.009variant: original 1000px | 321.0 |
| Topology Driven | 0.009000000000000001 |  distance: 0.009variant: original 1000px | 17.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
|
 |
 |
|
|
 |
|
|
||||
| original 1000px | |
|
|
|
 |
 |
 |
|
|
 |
|
|
|
||
| original 500px | |
|
 |
 |
 |
 |
|
|
|
|
|
||||
| vectorized (all layers) | |