A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_07
Author: Baseline Licence: Academic PaperMessiness: 0.28868
Ambiguity (Chamfer): 0.10331
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Stroke Aggregator | Mastering Sketching | Real-Time Inking | Topology Driven | Poly Vector | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00083 |  distance: 0.00091 |  distance: 0.00119 |  distance: 0.00128 |  distance: 0.0013 |  distance: 0.0014 |  distance: 0.00166 |  distance: 0.00193 |  distance: 0.00203 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0013986466541812464 | distance: 0.0014variant: original | 86.0 |
| Fidelity Simplicity | 0.00192679647519168 | distance: 0.00193variant: original 500pxalg. parameter: 0.25 | 206.0 |
| Mastering Sketching | 0.0009052950836363227 | distance: 0.00091variant: original 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0020306950388067017 | distance: 0.00203variant: original 500pxalg. parameter: noisy | 22.0 |
| Poly Vector | 0.0012957862220448633 | distance: 0.0013variant: original | 1359.0 |
| Real-Time Inking | 0.0011938473133052186 | distance: 0.00119variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.0008324743092308175 | distance: 0.00083variant: vectorized (all layers) | 1665.0 |
| Topology Driven → Stroke Aggregator | 0.0016580437406887804 | distance: 0.00166variant: original 1000px | 1679.0 |
| Topology Driven | 0.0012772538011020429 | distance: 0.00128variant: original | 235.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5008230889076193 |  distance: 0.50082variant: originalalg. parameter: 0.6 | 469.0 |
| Mastering Sketching | 0.6878818115188955 | distance: 0.68788variant: original 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6155648129526271 |  distance: 0.61556variant: original 500px | 23.0 |
| Poly Vector | 0.6257175566247801 |  distance: 0.62572variant: original 500px | 75.0 |
| Real-Time Inking | 0.6095636700978547 |  distance: 0.60956variant: original | 3.0 |
| Stroke Aggregator | 0.6321965662620554 | distance: 0.6322variant: vectorized (all layers) | 1665.0 |
| Topology Driven → Stroke Aggregator | 0.5698873827320189 |  distance: 0.56989variant: original 500px | 149.0 |
| Topology Driven | 0.6299426625572327 | distance: 0.62994variant: original | 235.0 |
| Delaunay Triangulation | 0.3629860171617288 |  distance: 0.36299variant: original 500px | 5.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9089425265502836 |  distance: 0.90894variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8277889892016287 | distance: 0.82779variant: original 500pxalg. parameter: noisy | 22.0 |
| Poly Vector | 0.8338814150296076 |  distance: 0.83388variant: original 500pxalg. parameter: noisy | 83.0 |
| Real-Time Inking | 0.8430525097662697 |  distance: 0.84305variant: original 500px | 2.0 |
| Stroke Aggregator | 0.8861868018579911 | distance: 0.88619variant: vectorized (all layers) | 1665.0 |
| Topology Driven → Stroke Aggregator | 0.8058602012798532 | distance: 0.80586variant: original 500px | 149.0 |
| Topology Driven | 0.8306115120284229 |  distance: 0.83061variant: original 1000px | 41.0 |
| Delaunay Triangulation | 0.568237611701672 | distance: 0.56824variant: original 500px | 5.0 |
| Fidelity Simplicity | 0.7093419461947621 |  distance: 0.70934variant: originalalg. parameter: 0.25 | 413.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9717706545802276 | distance: 0.97177variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9163260062676416 | distance: 0.91633variant: original 500px | 23.0 |
| Poly Vector | 0.9102356838405212 | distance: 0.91024variant: original 500pxalg. parameter: noisy | 83.0 |
| Real-Time Inking | 0.9409184970581754 | distance: 0.94092variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9709948714256992 | distance: 0.97099variant: vectorized (all layers) | 1665.0 |
| Topology Driven → Stroke Aggregator | 0.9232638181275828 | distance: 0.92326variant: original 1000px | 1679.0 |
| Topology Driven | 0.9232565913617842 | distance: 0.92326variant: original 1000px | 41.0 |
| Delaunay Triangulation | 0.7532315581876824 | distance: 0.75323variant: original 500px | 5.0 |
| Fidelity Simplicity | 0.7571393923779893 | distance: 0.75714variant: originalalg. parameter: 0.25 | 413.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9862382611777214 | distance: 0.98624variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.946262909455999 | distance: 0.94626variant: original 500px | 23.0 |
| Poly Vector | 0.9467565687316728 | distance: 0.94676variant: original 500pxalg. parameter: noisy | 83.0 |
| Real-Time Inking | 0.9730980713521182 | distance: 0.9731variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9855802420874532 | distance: 0.98558variant: vectorized (all layers) | 1665.0 |
| Topology Driven → Stroke Aggregator | 0.9532295885738648 | distance: 0.95323variant: original 1000px | 1679.0 |
| Topology Driven | 0.9614777275898791 | distance: 0.96148variant: original 1000px | 41.0 |
| Delaunay Triangulation | 0.8527225431518032 | distance: 0.85272variant: original 500px | 5.0 |
| Fidelity Simplicity | 0.7769416056520285 |  distance: 0.77694variant: originalalg. parameter: 0.3 | 401.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.905579278274999 | distance: 0.90558variant: original 500px | 5.0 |
| Mastering Sketching | 0.9884587886834848 | distance: 0.98846variant: original 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9562131176151326 | distance: 0.95621variant: original 500px | 23.0 |
| Poly Vector | 0.9611731685271416 | distance: 0.96117variant: original 500px | 75.0 |
| Real-Time Inking | 0.978675746149256 | distance: 0.97868variant: original 500px | 2.0 |
| Stroke Aggregator | 0.986586686661668 | distance: 0.98659variant: vectorized (all layers) | 1665.0 |
| Topology Driven → Stroke Aggregator | 0.967492325160856 | distance: 0.96749variant: original 1000px | 1679.0 |
| Topology Driven | 0.9727186331821333 |  distance: 0.97272variant: original 500px | 9.0 |
| Fidelity Simplicity | 0.787854332508259 | distance: 0.78785variant: originalalg. parameter: 0.3 | 401.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.042190044403076166 |  distance: 0.04219variant: original 500pxalg. parameter: 0.6 | 209.0 |
| Delaunay Triangulation | 0.06049440409007825 | distance: 0.06049variant: original | 86.0 |
| Mastering Sketching | 0.09050966644287108 | distance: 0.09051variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.040496913909912106 | distance: 0.0405variant: original 500px | 23.0 |
| Poly Vector | 0.01835755920410156 |  distance: 0.01836variant: original 1000pxalg. parameter: noisy | 263.0 |
| Real-Time Inking | 0.018703233254583257 | distance: 0.0187variant: original | 3.0 |
| Stroke Aggregator | 0.01826417132427818 | distance: 0.01826variant: vectorized (all layers) | 1665.0 |
| Topology Driven → Stroke Aggregator | 0.019798990249633792 | distance: 0.0198variant: original 500px | 149.0 |
| Topology Driven | 0.014142135620117187 | distance: 0.01414variant: original 500px | 9.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
 |
 |
|
|
 |
|
|
|||||
| original 1000px | |
|
|
 |
 |
 |
 |
 |
|
|
 |
 |
|||
| original 500px | |
|
|
 |
|
 |
 |
|
|
|
|
|
|
|
|
| vectorized (all layers) | |