A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_14
Author: Baseline Licence: Academic PaperMessiness: 0.53799
Ambiguity (Chamfer): 0.46879
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Fidelity Simplicity | Real-Time Inking | Delaunay Triangulation | Topology Driven | Poly Vector | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00178 |  distance: 0.00205 |  distance: 0.00225 |  distance: 0.00249 |  distance: 0.00261 |  distance: 0.00273 |  distance: 0.00279 |  distance: 0.00291 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.002487618540863127 | distance: 0.00249variant: original | 87.0 |
| Fidelity Simplicity | 0.002047062188932196 | distance: 0.00205variant: thresholded 1000pxalg. parameter: 0.6 | 331.0 |
| Mastering Sketching | 0.0017796464432431702 | distance: 0.00178variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.002905770802869962 | distance: 0.00291variant: thresholded 1000pxalg. parameter: noisy | 180.0 |
| Poly Vector | 0.002730212523368621 | distance: 0.00273variant: thresholded 500pxalg. parameter: noisy | 209.0 |
| Real-Time Inking | 0.0022463340909381125 | distance: 0.00225variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.0027856510840751345 | distance: 0.00279variant: thresholded | 1078.0 |
| Topology Driven | 0.002611981069298469 | distance: 0.00261variant: thresholded | 532.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3728912733678005 |  distance: 0.37289variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.5950000264900429 |  distance: 0.595variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4666139226545336 |  distance: 0.46661variant: vectorized (all layers) 500px | 35.0 |
| Poly Vector | 0.4689329992804184 |  distance: 0.46893variant: vectorized (all layers) 500px | 194.0 |
| Real-Time Inking | 0.4833142496154534 |  distance: 0.48331variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.4410651078024379 |  distance: 0.44107variant: original | 190.0 |
| Topology Driven | 0.46588168927567 |  distance: 0.46588variant: original | 167.0 |
| Fidelity Simplicity | 0.4400851270418899 |  distance: 0.44009variant: originalalg. parameter: 0.5 | 360.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5733510037020685 | distance: 0.57335variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.7745224575333644 | distance: 0.77452variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6515019551833645 | distance: 0.6515variant: vectorized (all layers) 500px | 35.0 |
| Poly Vector | 0.6568086162867682 |  distance: 0.65681variant: vectorized (all layers) 500pxalg. parameter: noisy | 224.0 |
| Real-Time Inking | 0.7129528286391248 | distance: 0.71295variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6732789784001811 |  distance: 0.67328variant: vectorized (all layers) 500px | 527.0 |
| Topology Driven | 0.6901446184245187 |  distance: 0.69014variant: vectorized (all layers) 500px | 12.0 |
| Fidelity Simplicity | 0.6841525669837106 |  distance: 0.68415variant: thresholded 500pxalg. parameter: 0.5 | 239.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7322592768423551 | distance: 0.73226variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.8838690776753115 | distance: 0.88387variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7841184711551656 | distance: 0.78412variant: vectorized (all layers) 500px | 35.0 |
| Poly Vector | 0.7915082788930781 | distance: 0.79151variant: vectorized (all layers) 500px | 194.0 |
| Real-Time Inking | 0.8435318269788192 | distance: 0.84353variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.8176018230424187 |  distance: 0.8176variant: thresholded 500pxalg. parameter: 0.75 | 204.0 |
| Topology Driven → Stroke Aggregator | 0.7893811680241218 | distance: 0.78938variant: original | 190.0 |
| Topology Driven | 0.7939298600773282 | distance: 0.79393variant: original | 167.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8262181744290419 | distance: 0.82622variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.9306063832727988 | distance: 0.93061variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8586111842196394 | distance: 0.85861variant: vectorized (all layers) 500px | 35.0 |
| Poly Vector | 0.8635252153738369 | distance: 0.86353variant: vectorized (all layers) 500pxalg. parameter: noisy | 224.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.8822641866448729 |  distance: 0.88226variant: thresholded 500pxalg. parameter: 0.6 | 211.0 |
| Topology Driven → Stroke Aggregator | 0.8370838444420241 | distance: 0.83708variant: original | 190.0 |
| Topology Driven | 0.8411535408115096 | distance: 0.84115variant: original | 167.0 |
| Real-Time Inking | 0.8986046869360074 |  distance: 0.8986variant: vectorized (all layers) 500px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8923600801767724 | distance: 0.89236variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.9414829342622556 | distance: 0.94148variant: thresholded 500pxalg. parameter: 0.75 | 204.0 |
| Topology Driven → Stroke Aggregator | 0.8744770835986371 | distance: 0.87448variant: original | 190.0 |
| Topology Driven | 0.8774484805802847 | distance: 0.87745variant: original | 167.0 |
| Mastering Sketching | 0.9514596062457571 | distance: 0.95146variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8947819374286737 |  distance: 0.89478variant: vectorized (all layers) 500pxalg. parameter: noisy | 35.0 |
| Poly Vector | 0.9010109784576128 | distance: 0.90101variant: vectorized (all layers) 500pxalg. parameter: noisy | 224.0 |
| Real-Time Inking | 0.9247124980797272 | distance: 0.92471variant: vectorized (all layers) 500px | 2.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.04 |  distance: 0.04variant: thresholded 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Mastering Sketching | 0.11907980346679688 | distance: 0.11908variant: thresholded 500px | 5.0 |
| Poly Vector | 0.049030601501464835 | distance: 0.04903variant: vectorized (all layers) 500px | 194.0 |
| Real-Time Inking | 0.049497474670410165 | distance: 0.0495variant: vectorized (all layers) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.04808325958251953 | distance: 0.04808variant: vectorized (all layers) 500px | 527.0 |
| Topology Driven | 0.04947726821899414 | distance: 0.04948variant: vectorized (all layers) 500px | 12.0 |
| Fidelity Simplicity | 0.01886796188354492 |  distance: 0.01887variant: vectorized (all layers) 500pxalg. parameter: 0.3 | 204.0 |
| Poly Vector → Stroke Aggregator | 0.050477718353271486 |  distance: 0.05048variant: thresholded 500pxalg. parameter: noisy | 55.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
 |
|
 |
 |
|
|
||||||
| thresholded | |
 |
 |
 |
 |
 |
 |
|
 |
||||||
| thresholded 1000px |  |
 |
 |
 |
 |
|
 |
 |
 |
 |
|
 |
|||
| thresholded 500px |  |
 |
|
 |
 |
|
|
|
 |
|
 |
|
|
||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| vectorized (all layers) 500px | |
|
|
|
 |
 |
 |
 |
|
|
|
|
|
|