A Benchmark for Rough Sketch Cleanup
Ind_product_PM_03
Author: Patrick Murphy Author Homepage: https://www.flickr.com/photos/pmurf/ Licence: CC-BY-2.0Messiness: 0.41666
Ambiguity (Chamfer): 0.09472
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Mastering Sketching | Real-Time Inking | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00293 |  distance: 0.00296 |  distance: 0.00328 |  distance: 0.00367 |  distance: 0.00392 |  distance: 0.00467 |  distance: 0.00486 |  distance: 0.00543 |  distance: 0.00564 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Liliya Larsen |  | |  | ||||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.005430594210624632 | distance: 0.00543variant: vectorized (shape strokes) 500px | 2.0 |
| Fidelity Simplicity | 0.005642540922577282 | distance: 0.00564variant: vectorized (shape strokes) 1000pxalg. parameter: 0.5 | 211.0 |
| Mastering Sketching | 0.0032760649867666198 | distance: 0.00328variant: vectorized (shape strokes) 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.003916552623211917 | distance: 0.00392variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 375.0 |
| Poly Vector | 0.0029556879426616447 | distance: 0.00296variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 251.0 |
| Real-Time Inking | 0.0036703024875002783 | distance: 0.00367variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.004859383756809679 | distance: 0.00486variant: vectorized (shape strokes) | 153.0 |
| Topology Driven → Stroke Aggregator | 0.004666828571873932 | distance: 0.00467variant: vectorized (shape strokes) 500px | 125.0 |
| Topology Driven | 0.002926949995273565 | distance: 0.00293variant: vectorized (shape strokes) 1000px | 20.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.18540941847228187 |  distance: 0.18541variant: original | 30.0 |
| Fidelity Simplicity | 0.18314555507928867 |  distance: 0.18315variant: thresholded 500pxalg. parameter: 0.75 | 174.0 |
| Mastering Sketching | 0.35692427351680306 |  distance: 0.35692variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.2971631175005577 |  distance: 0.29716variant: thresholded | 1233.0 |
| Poly Vector | 0.3046251558186045 |  distance: 0.30463variant: thresholded | 1078.0 |
| Real-Time Inking | 0.4140913079633687 |  distance: 0.41409variant: thresholded | 2.0 |
| Stroke Aggregator | 0.22767293269563604 |  distance: 0.22767variant: vectorized (all layers) | 495.0 |
| Topology Driven → Stroke Aggregator | 0.3665962109138446 |  distance: 0.3666variant: vectorized (all layers) 500px | 980.0 |
| Topology Driven | 0.2969883515321687 |  distance: 0.29699variant: original | 109.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3100435277400937 |  distance: 0.31004variant: thresholded 500px | 11.0 |
| Fidelity Simplicity | 0.2557215798097067 | distance: 0.25572variant: thresholded 500pxalg. parameter: 0.75 | 174.0 |
| Mastering Sketching | 0.4715307693941935 | distance: 0.47153variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.467650898380026 | distance: 0.46765variant: thresholded | 1233.0 |
| Poly Vector | 0.455977142998713 |  distance: 0.45598variant: thresholded 500pxalg. parameter: noisy | 440.0 |
| Real-Time Inking | 0.6387593226523434 |  distance: 0.63876variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.37929490075040107 | distance: 0.37929variant: vectorized (all layers) | 495.0 |
| Topology Driven → Stroke Aggregator | 0.5206921397108921 | distance: 0.52069variant: vectorized (all layers) 500px | 980.0 |
| Topology Driven | 0.4467962600835473 |  distance: 0.4468variant: thresholded 500px | 57.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.40630858572407097 | distance: 0.40631variant: original | 30.0 |
| Fidelity Simplicity | 0.29805724795953564 |  distance: 0.29806variant: thresholded 500pxalg. parameter: 0.3 | 135.0 |
| Mastering Sketching | 0.5531836777509703 | distance: 0.55318variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5177796272135169 |  distance: 0.51778variant: thresholdedalg. parameter: noisy | 1223.0 |
| Poly Vector | 0.5032732260071864 | distance: 0.50327variant: thresholded | 1078.0 |
| Real-Time Inking | 0.7169368530198229 | distance: 0.71694variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.4582101093024493 | distance: 0.45821variant: vectorized (all layers) | 495.0 |
| Topology Driven → Stroke Aggregator | 0.6177241468589992 | distance: 0.61772variant: vectorized (all layers) 500px | 980.0 |
| Topology Driven | 0.5096617437773389 | distance: 0.50966variant: original | 109.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4782149336215633 | distance: 0.47821variant: thresholded 500px | 11.0 |
| Topology Driven → Stroke Aggregator | 0.673428142435974 | distance: 0.67343variant: vectorized (all layers) 500px | 980.0 |
| Fidelity Simplicity | 0.3362740746552089 | distance: 0.33627variant: thresholded 500pxalg. parameter: 0.3 | 135.0 |
| Mastering Sketching | 0.6043511257272958 | distance: 0.60435variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5734250186599755 |  distance: 0.57343variant: thresholded 500px | 620.0 |
| Poly Vector | 0.5521712414728659 |  distance: 0.55217variant: thresholded 500px | 461.0 |
| Real-Time Inking | 0.7645710685141371 | distance: 0.76457variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.5455937751564405 | distance: 0.54559variant: vectorized (all layers) | 495.0 |
| Topology Driven | 0.5772965197586607 | distance: 0.5773variant: thresholded 500px | 57.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5336116803564172 | distance: 0.53361variant: thresholded 500px | 11.0 |
| Fidelity Simplicity | 0.3791728230638664 |  distance: 0.37917variant: thresholded 500pxalg. parameter: 0.6 | 140.0 |
| Mastering Sketching | 0.6595232888694511 | distance: 0.65952variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6270750904781437 | distance: 0.62708variant: thresholded 500px | 620.0 |
| Poly Vector | 0.6083811960925741 | distance: 0.60838variant: thresholded 500pxalg. parameter: noisy | 440.0 |
| Real-Time Inking | 0.8126662568758561 | distance: 0.81267variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.6163802316711571 | distance: 0.61638variant: vectorized (all layers) | 495.0 |
| Topology Driven → Stroke Aggregator | 0.7219196005759241 | distance: 0.72192variant: vectorized (all layers) 500px | 980.0 |
| Topology Driven | 0.6403480357221757 | distance: 0.64035variant: thresholded 500px | 57.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.07473285675048827 |  distance: 0.07473variant: vectorized (all layers) 1000pxalg. parameter: 0.6 | 196.0 |
| Mastering Sketching | 0.3067572326660156 |  distance: 0.30676variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0776208724975586 |  distance: 0.07762variant: vectorized (shape strokes) 1000px | 369.0 |
| Poly Vector | 0.0776208724975586 |  distance: 0.07762variant: vectorized (shape strokes) 1000px | 250.0 |
| Stroke Aggregator | 0.07741146299836073 | distance: 0.07741variant: vectorized (shape strokes) | 153.0 |
| Delaunay Triangulation | 0.07088018035888671 | distance: 0.07088variant: vectorized (shape strokes) 500px | 2.0 |
| Real-Time Inking | 0.068 | distance: 0.068variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.07787811279296875 | distance: 0.07788variant: vectorized (shape strokes) 1000px | 20.0 |
| Topology Driven → Stroke Aggregator | 0.07531268310546875 | distance: 0.07531variant: vectorized (shape strokes) 500px | 125.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
 |
|
 |
 |
|
|||||
| thresholded | |
 |
 |
 |
 |
 |
 |
 |
 |
|
 |
|
|
||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 500px |  |
|
|
 |
|
|
|
|
|
|
 |
|
|||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
|
 |
 |
 |
 |
|||||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||
| vectorized (shape strokes) 1000px | |
 |
 |
|
 |
 |
|
|
|
 |
|
|
|||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
|||
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |