A Benchmark for Rough Sketch Cleanup
Ind_product_PM_47
Author: Patrick Murphy Author Homepage: https://www.flickr.com/photos/pmurf/ Licence: CC-BY-2.0Messiness: 0.4987
Ambiguity (Chamfer): 0.23338
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Mastering Sketching | Real-Time Inking | Stroke Aggregator | Fidelity Simplicity | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00381 |  distance: 0.00391 |  distance: 0.00397 |  distance: 0.00421 |  distance: 0.00479 |  distance: 0.00499 |  distance: 0.00506 |  distance: 0.00593 |  distance: 0.00596 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  |  | |||
| Maria Hegedus |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.004989020727807349 | distance: 0.00499variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 141.0 |
| Mastering Sketching | 0.0039723991958072425 | distance: 0.00397variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.005961083624718231 | distance: 0.00596variant: vectorized (shape strokes) 500px | 32.0 |
| Poly Vector | 0.003912474337324646 | distance: 0.00391variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 327.0 |
| Real-Time Inking | 0.004214552315989275 | distance: 0.00421variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.004786421425028859 | distance: 0.00479variant: vectorized (shape strokes) | 669.0 |
| Topology Driven → Stroke Aggregator | 0.005060469843788515 | distance: 0.00506variant: vectorized (shape strokes) 500px | 554.0 |
| Topology Driven | 0.003809996721500497 | distance: 0.00381variant: vectorized (shape strokes) 1000px | 31.0 |
| Delaunay Triangulation | 0.0059255188126514655 | distance: 0.00593variant: vectorized (shape strokes) 1000px | 9.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2611282522329021 |  distance: 0.26113variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.2116701244813278 |  distance: 0.21167variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 133.0 |
| Mastering Sketching | 0.39871854478759977 |  distance: 0.39872variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.3612289998358936 |  distance: 0.36123variant: vectorized (all layers) 500px | 66.0 |
| Poly Vector | 0.3835345644692397 |  distance: 0.38353variant: vectorized (all layers) 500px | 229.0 |
| Real-Time Inking | 0.3707597065407063 |  distance: 0.37076variant: thresholded 1000px | 3.0 |
| Stroke Aggregator | 0.47462542793587 | distance: 0.47463variant: vectorized (shape strokes) | 669.0 |
| Topology Driven → Stroke Aggregator | 0.35808836058912435 |  distance: 0.35809variant: vectorized (all layers) 500px | 1511.0 |
| Topology Driven | 0.36385790212387453 |  distance: 0.36386variant: original | 1529.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3999385000523539 | distance: 0.39994variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.3175647868607314 | distance: 0.31756variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 133.0 |
| Mastering Sketching | 0.5303553231849032 | distance: 0.53036variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5158580441909649 | distance: 0.51586variant: vectorized (all layers) 500px | 66.0 |
| Poly Vector | 0.5334591613862566 |  distance: 0.53346variant: thresholded 1000pxalg. parameter: noisy | 1712.0 |
| Real-Time Inking | 0.5590342795620569 | distance: 0.55903variant: thresholded 1000px | 3.0 |
| Stroke Aggregator | 0.6242851169506416 | distance: 0.62429variant: vectorized (shape strokes) | 669.0 |
| Topology Driven → Stroke Aggregator | 0.5184101057986463 | distance: 0.51841variant: vectorized (all layers) 500px | 1511.0 |
| Topology Driven | 0.5196063870664724 | distance: 0.51961variant: original | 1529.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.517269872748306 | distance: 0.51727variant: vectorized (all layers) 500px | 4.0 |
| Mastering Sketching | 0.6295903079076602 | distance: 0.62959variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6234133229275933 | distance: 0.62341variant: vectorized (all layers) 500px | 66.0 |
| Poly Vector | 0.6166439536524101 | distance: 0.61664variant: thresholded 1000pxalg. parameter: noisy | 1712.0 |
| Real-Time Inking | 0.6517076435897208 |  distance: 0.65171variant: thresholded 500px | 2.0 |
| Stroke Aggregator | 0.7147326038454819 | distance: 0.71473variant: vectorized (shape strokes) | 669.0 |
| Topology Driven → Stroke Aggregator | 0.6285258808822213 | distance: 0.62853variant: vectorized (all layers) 500px | 1511.0 |
| Topology Driven | 0.6159285105936834 |  distance: 0.61593variant: thresholded 1000px | 129.0 |
| Fidelity Simplicity | 0.4105876937104033 |  distance: 0.41059variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 137.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5947094262337098 | distance: 0.59471variant: vectorized (all layers) 500px | 4.0 |
| Mastering Sketching | 0.6934806746885849 | distance: 0.69348variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6869128613035181 | distance: 0.68691variant: vectorized (all layers) 500px | 66.0 |
| Poly Vector | 0.6770759199026708 | distance: 0.67708variant: thresholded 1000pxalg. parameter: noisy | 1712.0 |
| Real-Time Inking | 0.6971434190104339 | distance: 0.69714variant: thresholded 500px | 2.0 |
| Stroke Aggregator | 0.8008139017270087 | distance: 0.80081variant: vectorized (shape strokes) | 669.0 |
| Topology Driven → Stroke Aggregator | 0.7015421419748378 | distance: 0.70154variant: vectorized (all layers) 500px | 1511.0 |
| Topology Driven | 0.6785801288986325 |  distance: 0.67858variant: thresholded 500px | 35.0 |
| Fidelity Simplicity | 0.4876555281051509 |  distance: 0.48766variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 124.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.7541640271940052 | distance: 0.75416variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7481759505800458 |  distance: 0.74818variant: thresholded 500pxalg. parameter: noisy | 269.0 |
| Poly Vector | 0.733048793812494 | distance: 0.73305variant: thresholded 1000pxalg. parameter: noisy | 1712.0 |
| Real-Time Inking | 0.7469915658826812 | distance: 0.74699variant: thresholded 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.766168874116031 | distance: 0.76617variant: vectorized (all layers) 500px | 1511.0 |
| Topology Driven | 0.7412830728962966 | distance: 0.74128variant: thresholded 500px | 35.0 |
| Delaunay Triangulation | 0.6637654629806361 | distance: 0.66377variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.5469390177091655 | distance: 0.54694variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 137.0 |
| Stroke Aggregator | 0.8375629318250513 | distance: 0.83756variant: vectorized (shape strokes) | 669.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.05846366500854493 | distance: 0.05846variant: vectorized (shape strokes) 1000px | 9.0 |
| Fidelity Simplicity | 0.048764739990234375 |  distance: 0.04876variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 193.0 |
| Poly Vector → Stroke Aggregator | 0.06212889862060547 |  distance: 0.06213variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 32.0 |
| Real-Time Inking | 0.059665737152099614 |  distance: 0.05967variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | 0.06002696278331044 | distance: 0.06003variant: vectorized (shape strokes) | 669.0 |
| Topology Driven → Stroke Aggregator | 0.05727128601074219 | distance: 0.05727variant: vectorized (shape strokes) 500px | 554.0 |
| Mastering Sketching | 0.17618171691894532 |  distance: 0.17618variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.06001666259765625 | distance: 0.06002variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 327.0 |
| Topology Driven | 0.059665737152099614 | distance: 0.05967variant: vectorized (shape strokes) 1000px | 31.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px | |
 |
 |
 |
 |
 |
 |
|
|
 |
|||||
| thresholded 500px | |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
|
 |
||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 500px | |
 |
|
 |
 |
|
|
|
 |
 |
|
|
|
||
| vectorized (shape strokes) 1000px | |
|
|
|
 |
 |
 |
|
|
 |
|
||||
| vectorized (shape strokes) 500px | |
|
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
|
| vectorized (shape strokes) | |