A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_05
Author: Baseline Licence: Academic PaperMessiness: 0.40577
Ambiguity (Chamfer): 0.28935
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Real-Time Inking | Mastering Sketching | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00221 |  distance: 0.0024 |  distance: 0.00243 |  distance: 0.00244 |  distance: 0.00262 |  distance: 0.00267 |  distance: 0.00311 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.003105710138283532 | distance: 0.00311variant: original | 49.0 |
| Fidelity Simplicity | 0.00262361143987278 | distance: 0.00262variant: original 1000pxalg. parameter: 0.25 | 212.0 |
| Mastering Sketching | 0.002438768387904272 | distance: 0.00244variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.002669701975097595 | distance: 0.00267variant: original 500pxalg. parameter: noisy | 79.0 |
| Poly Vector | 0.002404131176623399 | distance: 0.0024variant: originalalg. parameter: noisy | 762.0 |
| Real-Time Inking | 0.002425549165716029 | distance: 0.00243variant: original | 3.0 |
| Topology Driven | 0.0022060058862743686 | distance: 0.00221variant: original | 213.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5106987246025405 |  distance: 0.5107variant: original 500pxalg. parameter: 0.6 | 189.0 |
| Mastering Sketching | 0.593670655402783 | distance: 0.59367variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5990102865058187 | distance: 0.59901variant: original 500pxalg. parameter: noisy | 79.0 |
| Poly Vector | 0.5467470629600657 |  distance: 0.54675variant: original | 789.0 |
| Real-Time Inking | 0.5501455440113165 | distance: 0.55015variant: original | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.5465317959600186 |  distance: 0.54653variant: original 1000px | 97.0 |
| Delaunay Triangulation | 0.4038228906025256 |  distance: 0.40382variant: original 500px | 4.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6851543112246404 |  distance: 0.68515variant: original 500pxalg. parameter: 0.75 | 191.0 |
| Mastering Sketching | 0.7599086676848694 | distance: 0.75991variant: original 500px | 5.0 |
| Poly Vector | 0.7507457493141847 | distance: 0.75075variant: originalalg. parameter: noisy | 762.0 |
| Real-Time Inking | 0.7487921803255831 |  distance: 0.74879variant: original 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.7271831067409716 |  distance: 0.72718variant: original 500px | 22.0 |
| Poly Vector → Stroke Aggregator | 0.7810690153529367 | distance: 0.78107variant: original 500pxalg. parameter: noisy | 79.0 |
| Delaunay Triangulation | 0.6282075025985071 | distance: 0.62821variant: original 500px | 4.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8142398624930641 | distance: 0.81424variant: original 500pxalg. parameter: 0.75 | 191.0 |
| Mastering Sketching | 0.8702445990719183 | distance: 0.87024variant: original 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.8342554361026003 | distance: 0.83426variant: original 500px | 22.0 |
| Delaunay Triangulation | 0.8022935718187479 | distance: 0.80229variant: original 500px | 4.0 |
| Poly Vector → Stroke Aggregator | 0.8637092570967521 |  distance: 0.86371variant: original 500px | 79.0 |
| Poly Vector | 0.8584020142551855 | distance: 0.8584variant: original | 789.0 |
| Real-Time Inking | 0.8657232697227744 | distance: 0.86572variant: original | 3.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9220608140244194 | distance: 0.92206variant: original 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.862637517961521 | distance: 0.86264variant: original 500px | 4.0 |
| Fidelity Simplicity | 0.8844928538654593 |  distance: 0.88449variant: original 500pxalg. parameter: 0.25 | 169.0 |
| Poly Vector → Stroke Aggregator | 0.9019180159288592 | distance: 0.90192variant: original 500px | 79.0 |
| Poly Vector | 0.8991298205324926 |  distance: 0.89913variant: original 500px | 194.0 |
| Real-Time Inking | 0.9070173997297676 | distance: 0.90702variant: original 500px | 2.0 |
| Topology Driven | 0.8819317274114852 | distance: 0.88193variant: original 500px | 22.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.9163630455651292 | distance: 0.91636variant: original 500px | 4.0 |
| Mastering Sketching | 0.9585660510661888 | distance: 0.95857variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9372043537130924 | distance: 0.9372variant: original 500px | 79.0 |
| Poly Vector | 0.9344259194462043 | distance: 0.93443variant: originalalg. parameter: noisy | 762.0 |
| Real-Time Inking | 0.9462409559328228 | distance: 0.94624variant: original | 3.0 |
| Topology Driven | 0.9270781234370312 | distance: 0.92708variant: original 500px | 22.0 |
| Fidelity Simplicity | 0.9446536399962576 |  distance: 0.94465variant: original 500pxalg. parameter: 0.3 | 187.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.03189043807983399 |  distance: 0.03189variant: original 1000pxalg. parameter: 0.75 | 239.0 |
| Poly Vector | 0.0357770881652832 |  distance: 0.03578variant: original 1000px | 464.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.0357770881652832 | distance: 0.03578variant: original 1000px | 97.0 |
| Delaunay Triangulation | 0.04379145385198963 | distance: 0.04379variant: original | 49.0 |
| Poly Vector → Stroke Aggregator | 0.04686149978637695 | distance: 0.04686variant: original 500pxalg. parameter: noisy | 79.0 |
| Real-Time Inking | 0.026248809814453124 |  distance: 0.02625variant: original 1000px | 3.0 |
| Mastering Sketching | 0.2532982482910156 | distance: 0.2533variant: original 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
|
|
|
|
|||||
| original 1000px | |
 |
|
 |
|
 |
|
 |
|
 |
|||||
| original 500px | |
|
|
|
 |
|
|
|
 |
|
|
|
|