A Benchmark for Rough Sketch Cleanup
Ind_product_JM_09
Author: Jaguar MENA Author Homepage: https://www.flickr.com/photos/jaguarcarsmena/ Licence: CC-BY-2.0Messiness: 0.30674
Ambiguity (Chamfer): 0.0195
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Poly Vector | Topology Driven | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00071 |  distance: 0.00076 |  distance: 0.00078 |  distance: 0.00079 |  distance: 0.0016 |  distance: 0.00263 |  distance: 0.00538 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Liliya Larsen |  | |  |  | |||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.005375665893545379 | distance: 0.00538variant: vectorized (shape strokes) 1000px | 27.0 |
| Fidelity Simplicity | 0.0016025595808933355 | distance: 0.0016variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 125.0 |
| Mastering Sketching | 0.0007073567187647112 | distance: 0.00071variant: vectorized (shape strokes) 1000px | 5.0 |
| Poly Vector | 0.0007828026849560764 | distance: 0.00078variant: vectorized (shape strokes) 1000px | 445.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.0007869365310185082 | distance: 0.00079variant: vectorized (shape strokes) 1000px | 44.0 |
| Poly Vector → Stroke Aggregator | 0.0026258851590937283 | distance: 0.00263variant: thresholded 500pxalg. parameter: noisy | 147.0 |
| Real-Time Inking | 0.0007597127744790786 | distance: 0.00076variant: original | 3.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.632822894977887 |  distance: 0.63282variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 653.0 |
| Real-Time Inking | 0.6707194008667525 |  distance: 0.67072variant: thresholded 500px | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.2550213081056833 |  distance: 0.25502variant: vectorized (all layers) 500px | 16.0 |
| Fidelity Simplicity | 0.2579966034966588 |  distance: 0.258variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 97.0 |
| Mastering Sketching | 0.6492904829087341 |  distance: 0.64929variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.5963851844156092 |  distance: 0.59639variant: vectorized (all layers) 500pxalg. parameter: noisy | 1007.0 |
| Topology Driven | 0.5801453099402463 |  distance: 0.58015variant: vectorized (all layers) 1000px | 377.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.7600606142200964 | distance: 0.76006variant: thresholded 500px | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.39074555848243786 | distance: 0.39075variant: vectorized (all layers) 500px | 16.0 |
| Fidelity Simplicity | 0.3685835208174916 |  distance: 0.36858variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 141.0 |
| Mastering Sketching | 0.7518538629049079 | distance: 0.75185variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.7054649283059135 |  distance: 0.70546variant: vectorized (all layers) 500px | 1033.0 |
| Topology Driven | 0.7089409401677046 | distance: 0.70894variant: vectorized (all layers) 1000px | 377.0 |
| Poly Vector → Stroke Aggregator | 0.7402629983484206 | distance: 0.74026variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 653.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.8141776610967856 | distance: 0.81418variant: thresholded 500px | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.4911543358541425 | distance: 0.49115variant: vectorized (all layers) 500px | 16.0 |
| Fidelity Simplicity | 0.4548996455708446 |  distance: 0.4549variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 178.0 |
| Mastering Sketching | 0.8126419062260457 | distance: 0.81264variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8047230562226311 | distance: 0.80472variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 653.0 |
| Poly Vector | 0.7835816198841159 | distance: 0.78358variant: vectorized (all layers) 500pxalg. parameter: noisy | 1007.0 |
| Topology Driven | 0.7843892726455817 |  distance: 0.78439variant: vectorized (all layers) 500px | 102.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.8482189139144533 | distance: 0.84822variant: thresholded 500px | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.5638224733057625 | distance: 0.56382variant: vectorized (all layers) 500px | 16.0 |
| Fidelity Simplicity | 0.5157377138736468 | distance: 0.51574variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 178.0 |
| Mastering Sketching | 0.8511580160173415 | distance: 0.85116variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8489320833342268 | distance: 0.84893variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 653.0 |
| Poly Vector | 0.8349750810831907 | distance: 0.83498variant: vectorized (all layers) 500pxalg. parameter: noisy | 1007.0 |
| Topology Driven | 0.8288016967906039 | distance: 0.8288variant: vectorized (all layers) 500px | 102.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.638803574466494 | distance: 0.6388variant: vectorized (all layers) 500px | 16.0 |
| Fidelity Simplicity | 0.5839279515818913 | distance: 0.58393variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 178.0 |
| Mastering Sketching | 0.8809608722006325 | distance: 0.88096variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8889958172540646 | distance: 0.889variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 653.0 |
| Poly Vector | 0.8756254093949337 | distance: 0.87563variant: vectorized (all layers) 500pxalg. parameter: noisy | 1007.0 |
| Topology Driven | 0.8622174635274796 | distance: 0.86222variant: vectorized (all layers) 500px | 102.0 |
| Real-Time Inking | 0.8856349121898931 | distance: 0.88563variant: thresholded 500px | 4.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.024 | distance: 0.024variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 125.0 |
| Mastering Sketching | 0.2023561248779297 | distance: 0.20236variant: vectorized (all layers) 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.026000000000000002 |  distance: 0.026variant: vectorized (shape strokes) 500px | 13.0 |
| Delaunay Triangulation | 0.044271888732910165 |  distance: 0.04427variant: thresholded 500px | 13.0 |
| Poly Vector → Stroke Aggregator | 0.03162277603149414 | distance: 0.03162variant: thresholded 500pxalg. parameter: noisy | 147.0 |
| Poly Vector | 0.026000000000000002 |  distance: 0.026variant: vectorized (shape strokes) 500px | 136.0 |
| Real-Time Inking | 0.028635643005371095 |  distance: 0.02864variant: vectorized (all layers) 500px | 2.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
||||||
| thresholded 500px | |
 |
 |
 |
 |
 |
 |
 |
|
|
|||||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
|
 |
||||||
| vectorized (all layers) 500px | |
|
 |
|
 |
|
|
|
|
|
|
||||
| vectorized (shape strokes) 1000px |  |
|
|
 |
 |
 |
|
 |
|
|
|||||
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
|
 |
|
 |
|