A Benchmark for Rough Sketch Cleanup
Ind_fashion_HF_02
Author: Hugo Fonseca Author Homepage: www.thestyleconfessions.com/ Licence: CC-BY-NC-SA-3.0Messiness: 0.15306
Ambiguity (Chamfer): 0.02199
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Real-Time Inking | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00071 |  distance: 0.0008 |  distance: 0.00083 |  distance: 0.00098 |  distance: 0.0016 |  distance: 0.00162 |  distance: 0.00181 |  distance: 0.00247 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.0007132734567753173 | distance: 0.00071variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0016248688338556185 | distance: 0.00162variant: thresholded 1000pxalg. parameter: noisy | 1424.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.0007980353630053982 | distance: 0.0008variant: thresholded | 278.0 |
| Delaunay Triangulation | 0.00247302850402452 | distance: 0.00247variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector | 0.0008260896079921108 | distance: 0.00083variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 186.0 |
| Real-Time Inking | 0.001814218036474018 | distance: 0.00181variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.000979732815745828 | distance: 0.00098variant: vectorized (shape strokes) 1000px | 845.0 |
| Fidelity Simplicity | 0.0015954594060361225 | distance: 0.0016variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 181.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.6646992184213829 |  distance: 0.6647variant: vectorized (shape strokes) 1000px | 414.0 |
| Poly Vector | 0.4074626892059624 |  distance: 0.40746variant: vectorized (shape strokes) 500px | 100.0 |
| Real-Time Inking | 0.6443153516887193 | distance: 0.64432variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5538280609681446 |  distance: 0.55383variant: vectorized (shape strokes) 500px | 599.0 |
| Fidelity Simplicity | 0.31168292363656985 |  distance: 0.31168variant: thresholded 500pxalg. parameter: 0.75 | 163.0 |
| Delaunay Triangulation | 0.24194763090263144 |  distance: 0.24195variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.7082843357294406 |  distance: 0.70828variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven | 0.691853499249451 |  distance: 0.69185variant: vectorized (all layers) 1000px | 49.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.758382931835749 |  distance: 0.75838variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 405.0 |
| Poly Vector | 0.5030100243284584 | distance: 0.50301variant: vectorized (shape strokes) 500px | 100.0 |
| Real-Time Inking | 0.7367840445431496 | distance: 0.73678variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7063245167186104 | distance: 0.70632variant: vectorized (shape strokes) 500px | 599.0 |
| Fidelity Simplicity | 0.427213890785063 | distance: 0.42721variant: thresholded 500pxalg. parameter: 0.75 | 163.0 |
| Delaunay Triangulation | 0.3720251861069367 | distance: 0.37203variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.7875646869227154 | distance: 0.78756variant: vectorized (all layers) 1000px | 6.0 |
| Topology Driven | 0.7756809953951498 | distance: 0.77568variant: vectorized (all layers) 1000px | 49.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.8145168706070097 | distance: 0.81452variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 405.0 |
| Poly Vector | 0.5862580714707729 | distance: 0.58626variant: vectorized (shape strokes) 500px | 100.0 |
| Real-Time Inking | 0.7941055639576148 | distance: 0.79411variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.813517846937412 | distance: 0.81352variant: vectorized (shape strokes) 500px | 599.0 |
| Delaunay Triangulation | 0.5025815467235534 | distance: 0.50258variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.5267678923346002 |  distance: 0.52677variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 165.0 |
| Mastering Sketching | 0.8388426100144568 |  distance: 0.83884variant: thresholded 1000px | 6.0 |
| Topology Driven | 0.8373008664701818 | distance: 0.8373variant: vectorized (all layers) 1000px | 49.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.8545401461982609 | distance: 0.85454variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 405.0 |
| Poly Vector | 0.6487455091529242 |  distance: 0.64875variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 94.0 |
| Real-Time Inking | 0.8390546401425587 | distance: 0.83905variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.6077956432816387 | distance: 0.6078variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.6001325910112438 | distance: 0.60013variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 165.0 |
| Mastering Sketching | 0.8820623065998984 | distance: 0.88206variant: thresholded 1000px | 6.0 |
| Topology Driven → Stroke Aggregator | 0.8725319116388958 |  distance: 0.87253variant: thresholded 500px | 851.0 |
| Topology Driven | 0.8800274115033792 | distance: 0.88003variant: vectorized (all layers) 1000px | 49.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.8832657558627771 | distance: 0.88327variant: vectorized (shape strokes) 1000px | 414.0 |
| Poly Vector | 0.7065276930674939 | distance: 0.70653variant: vectorized (shape strokes) 500px | 100.0 |
| Real-Time Inking | 0.8781605299937729 | distance: 0.87816variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.711113648277701 | distance: 0.71111variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.6994534023503215 |  distance: 0.69945variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 132.0 |
| Mastering Sketching | 0.9097129546502316 | distance: 0.90971variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.9116125252739904 | distance: 0.91161variant: thresholded 500px | 851.0 |
| Topology Driven | 0.9104096740080004 | distance: 0.91041variant: vectorized (all layers) 1000px | 49.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.031507513330101794 |  distance: 0.03151variant: original | 72.0 |
| Mastering Sketching | 0.27743106079101565 |  distance: 0.27743variant: vectorized (shape strokes) 500px | 10.0 |
| Poly Vector | 0.015 |  distance: 0.015variant: vectorized (all layers) 1000px | 650.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.015 |  distance: 0.015variant: thresholded 1000px | 50.0 |
| Fidelity Simplicity | 0.026248809814453124 |  distance: 0.02625variant: vectorized (shape strokes) 1000pxalg. parameter: 0.75 | 219.0 |
| Poly Vector → Stroke Aggregator | 0.0264007568359375 | distance: 0.0264variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 405.0 |
| Real-Time Inking | 0.026683328628540042 |  distance: 0.02668variant: vectorized (shape strokes) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.025806976318359376 | distance: 0.02581variant: vectorized (shape strokes) 1000px | 845.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||||
| thresholded |  |
|
 |
||||||||||||
| thresholded 1000px |  |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
|
 |
||
| thresholded 500px | |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
|
 |
|
 |
||||
| vectorized (all layers) 500px |  |
|
 |
 |
|
|
 |
 |
 |
 |
|
||||
| vectorized (shape strokes) 1000px | |
|
 |
 |
|
 |
|
 |
 |
|
 |
|
|
|
|
| vectorized (shape strokes) 500px | |
|
|
 |
 |
 |
 |
 |
 |
|
|
 |