A Benchmark for Rough Sketch Cleanup
Ind_product_AS_20
Author: Akshay Sharma Licence: CC-BY-SAMessiness: 0.42736
Ambiguity (Chamfer): 0.11278
Shading: No
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Stroke Aggregator | Mastering Sketching | Real-Time Inking | Fidelity Simplicity | Delaunay Triangulation | Poly Vector → Stroke Aggregator | Poly Vector | Topology Driven | Topology Driven → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 4e-05 |  distance: 0.00055 |  distance: 0.00096 |  distance: 0.00165 |  distance: 0.00336 |  distance: 0.00995 |  distance: 0.00996 |  distance: 0.01003 |  distance: 0.01283 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Liliya Larsen |  | |  | ||||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0033568674071533843 | distance: 0.00336variant: vectorized (shape strokes) 1000px | 1.0 |
| Fidelity Simplicity | 0.0016490899572043794 | distance: 0.00165variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 196.0 |
| Mastering Sketching | 0.0005530793214637832 | distance: 0.00055variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.009947278069469715 | distance: 0.00995variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 13.0 |
| Poly Vector | 0.009955005931623243 | distance: 0.00996variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 40.0 |
| Real-Time Inking | 0.0009574375954337894 | distance: 0.00096variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 3.939960297617408e-05 | distance: 4e-05variant: vectorized (shape strokes) | 138.0 |
| Topology Driven → Stroke Aggregator | 0.01282607475909336 | distance: 0.01283variant: vectorized (shape strokes) 500px | 12.0 |
| Topology Driven | 0.010032795139582652 | distance: 0.01003variant: vectorized (shape strokes) 1000px | 2.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2489003573763816 |  distance: 0.2489variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 302.0 |
| Mastering Sketching | 0.35687551107380205 |  distance: 0.35688variant: vectorized (all layers) 500px | 5.0 |
| Stroke Aggregator | 0.7828386245976114 | distance: 0.78284variant: vectorized (shape strokes) | 138.0 |
| Topology Driven → Stroke Aggregator | 0.3532512066870733 |  distance: 0.35325variant: vectorized (all layers) 500px | 194.0 |
| Topology Driven | 0.401156140261998 |  distance: 0.40116variant: vectorized (all layers) 500px | 3.0 |
| Delaunay Triangulation | 0.17506005575060846 |  distance: 0.17506variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.13533064187348698 |  distance: 0.13533variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.1418077470865987 |  distance: 0.14181variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 30.0 |
| Real-Time Inking | 0.3276678333571353 |  distance: 0.32767variant: original | 8.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.3702431841868266 | distance: 0.37024variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 302.0 |
| Mastering Sketching | 0.4460636048132977 | distance: 0.44606variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.4657264588950546 |  distance: 0.46573variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8821811974795648 | distance: 0.88218variant: vectorized (shape strokes) | 138.0 |
| Topology Driven → Stroke Aggregator | 0.42218429820429854 | distance: 0.42218variant: vectorized (all layers) 500px | 194.0 |
| Topology Driven | 0.4612490076453888 | distance: 0.46125variant: vectorized (all layers) 500px | 3.0 |
| Delaunay Triangulation | 0.298294633394354 | distance: 0.29829variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.1702493551160791 |  distance: 0.17025variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 5.0 |
| Poly Vector | 0.17886178861788615 | distance: 0.17886variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 30.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.448638898646394 | distance: 0.44864variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 302.0 |
| Mastering Sketching | 0.4993816871874832 | distance: 0.49938variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.517514221747522 | distance: 0.51751variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8970984137769531 | distance: 0.8971variant: vectorized (shape strokes) | 138.0 |
| Topology Driven → Stroke Aggregator | 0.47413218151553294 | distance: 0.47413variant: vectorized (all layers) 500px | 194.0 |
| Topology Driven | 0.5058238806675518 | distance: 0.50582variant: vectorized (all layers) 500px | 3.0 |
| Delaunay Triangulation | 0.3637023399466765 |  distance: 0.3637variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.1973739940703092 | distance: 0.19737variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.20800000000000002 |  distance: 0.208variant: vectorized (shape strokes) 500px | 29.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.47810472402369 | distance: 0.4781variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 302.0 |
| Mastering Sketching | 0.5287295730100158 | distance: 0.52873variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.5468963987203952 | distance: 0.5469variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9054860735464588 | distance: 0.90549variant: vectorized (shape strokes) | 138.0 |
| Topology Driven → Stroke Aggregator | 0.5111970027194133 | distance: 0.5112variant: vectorized (all layers) 500px | 194.0 |
| Topology Driven | 0.5363231653861935 | distance: 0.53632variant: vectorized (all layers) 500px | 3.0 |
| Delaunay Triangulation | 0.4164340212270874 | distance: 0.41643variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.21700879765395895 | distance: 0.21701variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.22888056595921766 | distance: 0.22888variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 30.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.453684461449333 | distance: 0.45368variant: vectorized (all layers) 1000px | 7.0 |
| Fidelity Simplicity | 0.5052674037177659 | distance: 0.50527variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 302.0 |
| Mastering Sketching | 0.5579208432365402 | distance: 0.55792variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.5748051789554439 | distance: 0.57481variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9121693497244622 | distance: 0.91217variant: vectorized (shape strokes) | 138.0 |
| Topology Driven → Stroke Aggregator | 0.5395319447374107 | distance: 0.53953variant: vectorized (all layers) 500px | 194.0 |
| Topology Driven | 0.560734476362053 | distance: 0.56073variant: vectorized (all layers) 500px | 3.0 |
| Poly Vector → Stroke Aggregator | 0.2434997936442427 | distance: 0.2435variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.25787965616045844 | distance: 0.25788variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 30.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.09676776123046876 |  distance: 0.09677variant: vectorized (shape strokes) 500px | 0.0 |
| Fidelity Simplicity | 0.12509996032714846 | distance: 0.1251variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 196.0 |
| Real-Time Inking | 0.025961509704589845 | distance: 0.02596variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.00625 | distance: 0.00625variant: vectorized (shape strokes) | 138.0 |
| Mastering Sketching | 0.2969983215332031 | distance: 0.297variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.11901680755615235 | distance: 0.11902variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 13.0 |
| Poly Vector | 0.11940686798095705 |  distance: 0.11941variant: vectorized (shape strokes) 1000px | 36.0 |
| Topology Driven → Stroke Aggregator | 0.1320605926513672 | distance: 0.13206variant: vectorized (shape strokes) 500px | 12.0 |
| Topology Driven | 0.11940686798095705 | distance: 0.11941variant: vectorized (shape strokes) 1000px | 2.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
||||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
|
 |
 |
 |
 |
|
 |
|||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
 |
 |
|
 |
 |
|
|||
| vectorized (shape strokes) 1000px | |
 |
|
 |
 |
 |
|
|
|
|
|
||||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
 |
|
|
|
|
|
|
| vectorized (shape strokes) | |