A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_08
Author: Baseline Licence: Academic PaperMessiness: 0.19289
Ambiguity (Chamfer): 0.15461
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Stroke Aggregator | Mastering Sketching | Poly Vector → Stroke Aggregator | Real-Time Inking | Topology Driven | Poly Vector | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00236 |  distance: 0.00245 |  distance: 0.0025 |  distance: 0.00273 |  distance: 0.00277 |  distance: 0.00281 |  distance: 0.00305 |  distance: 0.00313 |  distance: 0.00358 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Topology Driven → Stroke Aggregator | 0.003134925361639834 | distance: 0.00313variant: original 1000px | 799.0 |
| Delaunay Triangulation | 0.003053541638113937 | distance: 0.00305variant: original 1000px | 7.0 |
| Fidelity Simplicity | 0.003580894666586559 | distance: 0.00358variant: originalalg. parameter: 0.25 | 391.0 |
| Mastering Sketching | 0.0024532500242832023 | distance: 0.00245variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0024976388637873784 | distance: 0.0025variant: originalalg. parameter: noisy | 396.0 |
| Poly Vector | 0.002811871202737112 | distance: 0.00281variant: original | 168.0 |
| Real-Time Inking | 0.0027266397774015853 | distance: 0.00273variant: original | 3.0 |
| Stroke Aggregator | 0.002361604169567252 | distance: 0.00236variant: vectorized (all layers) | 249.0 |
| Topology Driven | 0.0027662148536212266 | distance: 0.00277variant: original | 30.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.6206718171128534 | distance: 0.62067variant: original 500px | 5.0 |
| Topology Driven | 0.5296910907733097 | distance: 0.52969variant: original | 30.0 |
| Delaunay Triangulation | 0.4077845405951917 |  distance: 0.40778variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.4823552751637912 |  distance: 0.48236variant: original 500pxalg. parameter: 0.75 | 186.0 |
| Poly Vector → Stroke Aggregator | 0.4419876700028058 |  distance: 0.44199variant: original 500pxalg. parameter: noisy | 17.0 |
| Poly Vector | 0.4559361541507458 |  distance: 0.45594variant: original 500px | 97.0 |
| Real-Time Inking | 0.5071045145009319 |  distance: 0.5071variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.5305687067810895 | distance: 0.53057variant: vectorized (all layers) | 249.0 |
| Topology Driven → Stroke Aggregator | 0.5034847196294902 |  distance: 0.50348variant: original 500px | 146.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6665002829558481 | distance: 0.6665variant: original 500pxalg. parameter: 0.75 | 186.0 |
| Mastering Sketching | 0.7683969437251685 | distance: 0.7684variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5836911296447395 |  distance: 0.58369variant: original 500px | 17.0 |
| Poly Vector | 0.5836181731536737 | distance: 0.58362variant: original 500px | 97.0 |
| Topology Driven | 0.7265970996963356 | distance: 0.7266variant: original | 30.0 |
| Delaunay Triangulation | 0.6182011632240897 | distance: 0.6182variant: original 500px | 2.0 |
| Real-Time Inking | 0.6934027055789349 | distance: 0.6934variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.7443178881383615 | distance: 0.74432variant: vectorized (all layers) | 249.0 |
| Topology Driven → Stroke Aggregator | 0.6949995391353851 | distance: 0.695variant: original 500px | 146.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7409129488047127 | distance: 0.74091variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.763214718451202 |  distance: 0.76321variant: original 500pxalg. parameter: 0.5 | 210.0 |
| Mastering Sketching | 0.8725509364166489 | distance: 0.87255variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6345245787185427 | distance: 0.63452variant: original 500px | 17.0 |
| Poly Vector | 0.6395279137301915 | distance: 0.63953variant: original 500px | 97.0 |
| Topology Driven → Stroke Aggregator | 0.8074282956469564 | distance: 0.80743variant: original 1000px | 799.0 |
| Topology Driven | 0.8184385507823034 |  distance: 0.81844variant: original 500px | 6.0 |
| Real-Time Inking | 0.7898741926510279 | distance: 0.78987variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.8558588072642928 | distance: 0.85586variant: vectorized (all layers) | 249.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8145086552210636 | distance: 0.81451variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.8506260953493687 | distance: 0.85063variant: original 500pxalg. parameter: 0.5 | 210.0 |
| Mastering Sketching | 0.9195640943040974 | distance: 0.91956variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6837705059327146 | distance: 0.68377variant: original 500px | 17.0 |
| Poly Vector | 0.6914682702797159 | distance: 0.69147variant: original 500px | 97.0 |
| Real-Time Inking | 0.8670127328855711 | distance: 0.86701variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.9054053474131885 | distance: 0.90541variant: vectorized (all layers) | 249.0 |
| Topology Driven → Stroke Aggregator | 0.8775849811889941 | distance: 0.87758variant: original 500px | 146.0 |
| Topology Driven | 0.8762646898993829 | distance: 0.87626variant: original | 30.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8773510103236805 | distance: 0.87735variant: original 500px | 2.0 |
| Mastering Sketching | 0.9516599386526928 | distance: 0.95166variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7258834233933115 | distance: 0.72588variant: original 500px | 17.0 |
| Poly Vector | 0.7337368665487921 | distance: 0.73374variant: original 500px | 97.0 |
| Real-Time Inking | 0.9120024199059952 | distance: 0.912variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.9434717809495214 | distance: 0.94347variant: vectorized (all layers) | 249.0 |
| Topology Driven → Stroke Aggregator | 0.9297791796255568 | distance: 0.92978variant: original 500px | 146.0 |
| Topology Driven | 0.9256335086944298 | distance: 0.92563variant: original | 30.0 |
| Fidelity Simplicity | 0.910809439571108 |  distance: 0.91081variant: original 1000pxalg. parameter: 0.75 | 303.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.06645367412140575 | distance: 0.06645variant: originalalg. parameter: 0.25 | 391.0 |
| Delaunay Triangulation | 0.026248809814453124 | distance: 0.02625variant: original 1000px | 7.0 |
| Mastering Sketching | 0.034928497314453126 | distance: 0.03493variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.03275667953491211 |  distance: 0.03276variant: original 1000px | 695.0 |
| Poly Vector | 0.03275667953491211 |  distance: 0.03276variant: original 1000pxalg. parameter: noisy | 179.0 |
| Real-Time Inking | 0.03333724634335064 | distance: 0.03334variant: original | 3.0 |
| Stroke Aggregator | 0.03285612892419005 | distance: 0.03286variant: vectorized (all layers) | 249.0 |
| Topology Driven → Stroke Aggregator | 0.029120439529418944 | distance: 0.02912variant: original 500px | 146.0 |
| Topology Driven | 0.031048349380493164 | distance: 0.03105variant: original 500px | 6.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
 |
 |
|
 |
|
 |
|
 |
|||
| original 1000px | |
|
 |
 |
 |
|
 |
 |
|
 |
|
 |
|
||
| original 500px | |
 |
|
 |
 |
|
|
 |
|
 |
|
|
|
|
|
| vectorized (all layers) | |