A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_11
Author: Baseline Licence: Academic PaperMessiness: 0.00101
Ambiguity (Chamfer): 0.05777
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Mastering Sketching | Real-Time Inking | Poly Vector | Poly Vector → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | Topology Driven → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00041 |  distance: 0.00042 |  distance: 0.00046 |  distance: 0.00048 |  distance: 0.00048 |  distance: 0.00097 |  distance: 0.00105 |  distance: 0.00119 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.0010517613302709582 | distance: 0.00105variant: original | 48.0 |
| Fidelity Simplicity | 0.0009699584009087332 | distance: 0.00097variant: originalalg. parameter: 0.25 | 311.0 |
| Mastering Sketching | 0.00042137092426247565 | distance: 0.00042variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0004807440001078418 | distance: 0.00048variant: thresholded 1000pxalg. parameter: noisy | 86.0 |
| Poly Vector | 0.00047954491437651487 | distance: 0.00048variant: thresholded 1000pxalg. parameter: noisy | 254.0 |
| Real-Time Inking | 0.00045704467516430157 | distance: 0.00046variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.0011885198015642595 | distance: 0.00119variant: thresholded 500px | 97.0 |
| Topology Driven | 0.0004141724539708233 | distance: 0.00041variant: thresholded | 241.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6204307927263732 |  distance: 0.62043variant: thresholded 500pxalg. parameter: 0.75 | 232.0 |
| Mastering Sketching | 0.8442567122928533 |  distance: 0.84426variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8221604147915733 |  distance: 0.82216variant: originalalg. parameter: noisy | 149.0 |
| Poly Vector | 0.11404589245288765 |  distance: 0.11405variant: vectorized (all layers) 500pxalg. parameter: noisy | 40.0 |
| Real-Time Inking | 0.7353145920335954 |  distance: 0.73531variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7783916791879549 | distance: 0.77839variant: thresholded 500px | 97.0 |
| Topology Driven | 0.4761860693551847 |  distance: 0.47619variant: original | 57.0 |
| Delaunay Triangulation | 0.3697731004614256 |  distance: 0.36977variant: vectorized (all layers) 500px | 1.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7913761646406626 | distance: 0.79138variant: thresholded 500pxalg. parameter: 0.75 | 232.0 |
| Mastering Sketching | 0.9697849097781878 |  distance: 0.96978variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9497351868336922 | distance: 0.94974variant: originalalg. parameter: noisy | 149.0 |
| Real-Time Inking | 0.8674642796444678 | distance: 0.86746variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9337648208509562 | distance: 0.93376variant: thresholded 500px | 97.0 |
| Topology Driven | 0.5885083216656658 | distance: 0.58851variant: original | 57.0 |
| Delaunay Triangulation | 0.5993618704537786 | distance: 0.59936variant: vectorized (all layers) 500px | 1.0 |
| Poly Vector | 0.1542279737635171 |  distance: 0.15423variant: vectorized (all layers) 500px | 38.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7418486053088788 | distance: 0.74185variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.8841684704971744 | distance: 0.88417variant: thresholded 500pxalg. parameter: 0.75 | 232.0 |
| Stroke Aggregator | nan | ||
| Mastering Sketching | 0.9936914929467688 | distance: 0.99369variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9675001443042504 |  distance: 0.9675variant: original | 150.0 |
| Poly Vector | 0.1840533568822477 | distance: 0.18405variant: vectorized (all layers) 500pxalg. parameter: noisy | 40.0 |
| Topology Driven → Stroke Aggregator | 0.985225117413342 | distance: 0.98523variant: thresholded 500px | 97.0 |
| Topology Driven | 0.6343762950676434 | distance: 0.63438variant: original | 57.0 |
| Real-Time Inking | 0.8931754799159412 | distance: 0.89318variant: vectorized (all layers) 1000px | 2.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7908274690609075 | distance: 0.79083variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.9155199831952916 | distance: 0.91552variant: thresholded 500pxalg. parameter: 0.75 | 232.0 |
| Stroke Aggregator | nan | ||
| Mastering Sketching | 0.9947444895795156 | distance: 0.99474variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9751287560264038 | distance: 0.97513variant: originalalg. parameter: noisy | 149.0 |
| Topology Driven → Stroke Aggregator | 0.9902469380589668 | distance: 0.99025variant: thresholded 500px | 97.0 |
| Topology Driven | 0.6688324485172934 | distance: 0.66883variant: original | 57.0 |
| Poly Vector | 0.20853406744666209 | distance: 0.20853variant: vectorized (all layers) 500pxalg. parameter: noisy | 40.0 |
| Real-Time Inking | 0.9045035897616126 | distance: 0.9045variant: vectorized (all layers) 1000px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8287695381360912 | distance: 0.82877variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.9371766563172722 | distance: 0.93718variant: thresholded 500pxalg. parameter: 0.75 | 232.0 |
| Stroke Aggregator | nan | ||
| Mastering Sketching | 0.9952620209258184 | distance: 0.99526variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9798710457245108 | distance: 0.97987variant: originalalg. parameter: noisy | 149.0 |
| Topology Driven → Stroke Aggregator | 0.9933111464158144 | distance: 0.99331variant: thresholded 500px | 97.0 |
| Topology Driven | 0.6967291139530328 | distance: 0.69673variant: original | 57.0 |
| Poly Vector | 0.236449864498645 | distance: 0.23645variant: vectorized (all layers) 500px | 38.0 |
| Real-Time Inking | 0.9142797362887288 | distance: 0.91428variant: vectorized (all layers) 1000px | 2.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.006999999999999999 |  distance: 0.007variant: vectorized (all layers) 1000px | 83.0 |
| Poly Vector | 0.006999999999999999 |  distance: 0.007variant: vectorized (all layers) 1000px | 101.0 |
| Real-Time Inking | 0.007397405616132728 | distance: 0.0074variant: original | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.015620499610900881 | distance: 0.01562variant: thresholded 500px | 97.0 |
| Topology Driven | 0.006708203792572021 |  distance: 0.00671variant: thresholded 1000px | 28.0 |
| Mastering Sketching | 0.2562576904296875 | distance: 0.25626variant: thresholded 500px | 5.0 |
| Delaunay Triangulation | 0.0756090040330763 |  distance: 0.07561variant: thresholded | 92.0 |
| Fidelity Simplicity | 0.07789736938476563 |  distance: 0.0779variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 181.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
 |
 |
|
 |
 |
|
|
|
|||
| thresholded |  |
 |
 |
 |
 |
 |
|
|
|||||||
| thresholded 1000px |  |
|
 |
 |
 |
 |
 |
|
|
 |
 |
|
|||
| thresholded 500px | |
 |
|
 |
 |
 |
|
 |
 |
 |
 |
 |
 |
||
| vectorized (all layers) 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
|
 |
|
|||
| vectorized (all layers) 500px |  |
 |
 |
 |
 |
 |
|
 |
|
|
|