A Benchmark for Rough Sketch Cleanup
Ind_fashion_RB_04
Author: Rachel Bake Author Homepage: https://www.flickr.com/photos/rachel_bake/ Licence: CC-BY-NC-2.0Messiness: 0.26359
Ambiguity (Chamfer): 0.09771
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Real-Time Inking | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00227 |  distance: 0.00229 |  distance: 0.00235 |  distance: 0.00246 |  distance: 0.0025 |  distance: 0.00268 |  distance: 0.00324 |  distance: 0.00337 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.003368418924009518 | distance: 0.00337variant: vectorized (shape strokes) 1000px | 6.0 |
| Fidelity Simplicity | 0.0032365870582453525 | distance: 0.00324variant: vectorized (shape strokes) 1000pxalg. parameter: 0.5 | 162.0 |
| Mastering Sketching | 0.0022738501231404896 | distance: 0.00227variant: vectorized (shape strokes) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.002680259751767586 | distance: 0.00268variant: vectorized (shape strokes) 1000px | 522.0 |
| Poly Vector | 0.002350145146023677 | distance: 0.00235variant: vectorized (shape strokes) 1000px | 283.0 |
| Real-Time Inking | 0.0024646857668891692 | distance: 0.00246variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.002502801857114222 | distance: 0.0025variant: vectorized (shape strokes) 1000px | 1686.0 |
| Topology Driven | 0.002289221992649746 | distance: 0.00229variant: vectorized (shape strokes) 1000px | 23.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.26551299702505066 |  distance: 0.26551variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.2965068910519821 |  distance: 0.29651variant: thresholded 500pxalg. parameter: 0.75 | 199.0 |
| Poly Vector → Stroke Aggregator | 0.4579017923986789 |  distance: 0.4579variant: vectorized (all layers) 500pxalg. parameter: noisy | 97.0 |
| Poly Vector | 0.4800870090415516 |  distance: 0.48009variant: vectorized (all layers) 500px | 234.0 |
| Stroke Aggregator | nan | ||
| Mastering Sketching | 0.5689349265588772 |  distance: 0.56893variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.6069477689182987 |  distance: 0.60695variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.5946746978072228 |  distance: 0.59467variant: vectorized (shape strokes) 500px | 407.0 |
| Topology Driven | 0.4067982318118944 |  distance: 0.4068variant: original | 843.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4169307475873609 | distance: 0.41693variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.4586049877996218 |  distance: 0.4586variant: thresholded 500pxalg. parameter: 0.6 | 183.0 |
| Poly Vector → Stroke Aggregator | 0.5839431200904736 |  distance: 0.58394variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 24.0 |
| Poly Vector | 0.6022578582668989 |  distance: 0.60226variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 78.0 |
| Stroke Aggregator | nan | ||
| Mastering Sketching | 0.7015922618413647 | distance: 0.70159variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.7217868563195119 | distance: 0.72179variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.7503384224769182 | distance: 0.75034variant: vectorized (shape strokes) 500px | 407.0 |
| Topology Driven | 0.5334881576859174 | distance: 0.53349variant: original | 843.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5325255858611417 | distance: 0.53253variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.5999405735427679 | distance: 0.59994variant: thresholded 500pxalg. parameter: 0.75 | 199.0 |
| Stroke Aggregator | nan | ||
| Mastering Sketching | 0.7777037008225537 | distance: 0.7777variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.7832898640111011 | distance: 0.78329variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.8379801242027273 | distance: 0.83798variant: vectorized (shape strokes) 500px | 407.0 |
| Poly Vector → Stroke Aggregator | 0.6689013781764349 | distance: 0.6689variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 24.0 |
| Poly Vector | 0.6794503600750382 |  distance: 0.67945variant: vectorized (shape strokes) 500px | 83.0 |
| Topology Driven | 0.6163495983510731 | distance: 0.61635variant: original | 843.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6029118777003387 | distance: 0.60291variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.680715669867907 | distance: 0.68072variant: thresholded 500pxalg. parameter: 0.75 | 199.0 |
| Poly Vector → Stroke Aggregator | 0.7174825337409761 |  distance: 0.71748variant: vectorized (shape strokes) 500px | 24.0 |
| Poly Vector | 0.7277938159805645 | distance: 0.72779variant: vectorized (shape strokes) 500px | 83.0 |
| Stroke Aggregator | nan | ||
| Mastering Sketching | 0.8221891319059025 |  distance: 0.82219variant: vectorized (all layers) 500px | 7.0 |
| Real-Time Inking | 0.8239735689566251 | distance: 0.82397variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.8861356743222983 | distance: 0.88614variant: vectorized (shape strokes) 500px | 407.0 |
| Topology Driven | 0.6812621772949846 | distance: 0.68126variant: original | 843.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7431884192346987 | distance: 0.74319variant: thresholded 500pxalg. parameter: 0.75 | 199.0 |
| Poly Vector → Stroke Aggregator | 0.7613587802245547 | distance: 0.76136variant: vectorized (shape strokes) 500px | 24.0 |
| Poly Vector | 0.7712030602446909 | distance: 0.7712variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 78.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.6668708659473329 |  distance: 0.66687variant: vectorized (shape strokes) 500px | 2.0 |
| Mastering Sketching | 0.8603027214463906 | distance: 0.8603variant: vectorized (all layers) 500px | 7.0 |
| Real-Time Inking | 0.8611525600723774 | distance: 0.86115variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9180170222497164 | distance: 0.91802variant: vectorized (shape strokes) 500px | 407.0 |
| Topology Driven | 0.7235889409275036 | distance: 0.72359variant: original | 843.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.04743416595458985 |  distance: 0.04743variant: vectorized (all layers) 1000px | 12.0 |
| Poly Vector → Stroke Aggregator | 0.037000000000000005 |  distance: 0.037variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 526.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.0342344856262207 | distance: 0.03423variant: vectorized (shape strokes) 500px | 407.0 |
| Fidelity Simplicity | 0.0383275375366211 |  distance: 0.03833variant: vectorized (all layers) 1000pxalg. parameter: 0.3 | 147.0 |
| Mastering Sketching | 0.14401388549804686 |  distance: 0.14401variant: thresholded 500px | 5.0 |
| Poly Vector | 0.03667424011230469 |  distance: 0.03667variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 267.0 |
| Real-Time Inking | 0.036000000000000004 | distance: 0.036variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.036000000000000004 |  distance: 0.036variant: vectorized (shape strokes) 500px | 7.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
|
 |
||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
||||||
| thresholded 500px |  |
|
 |
 |
 |
|
|
 |
 |
 |
 |
||||
| vectorized (all layers) 1000px |  |
|
|
 |
 |
 |
 |
 |
 |
 |
|
||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
 |
 |
|
|
|
 |
||
| vectorized (shape strokes) 1000px | |
|
|
 |
 |
|
 |
 |
|
|
|
|
|
|
|
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
 |
 |
|
|
|
|
|
|