A Benchmark for Rough Sketch Cleanup
Ind_product_JM_03
Author: Jaguar MENA Author Homepage: https://www.flickr.com/photos/jaguarcarsmena/ Licence: CC-BY-2.0Messiness: 0.14124
Ambiguity (Chamfer): 0.02447
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Poly Vector | Topology Driven | Stroke Aggregator | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00083 |  distance: 0.0009 |  distance: 0.00094 |  distance: 0.001 |  distance: 0.00124 |  distance: 0.00203 |  distance: 0.00256 |  distance: 0.00351 |  distance: 0.00415 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Liliya Larsen |  | |  |  | |||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.004150640518955514 | distance: 0.00415variant: original | 344.0 |
| Fidelity Simplicity | 0.003512667697785965 | distance: 0.00351variant: vectorized (shape strokes) 500pxalg. parameter: 0.25 | 96.0 |
| Mastering Sketching | 0.0008277438819080063 | distance: 0.00083variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0020262238367106922 | distance: 0.00203variant: thresholded 500px | 148.0 |
| Poly Vector | 0.0009396966316099901 | distance: 0.00094variant: vectorized (shape strokes) 1000px | 449.0 |
| Real-Time Inking | 0.0008981584937991795 | distance: 0.0009variant: thresholded | 3.0 |
| Stroke Aggregator | 0.0012355264931450418 | distance: 0.00124variant: vectorized (shape strokes) | 1044.0 |
| Topology Driven → Stroke Aggregator | 0.002560916139813561 | distance: 0.00256variant: vectorized (all layers) 500px | 864.0 |
| Topology Driven | 0.001001845309802116 | distance: 0.001variant: vectorized (shape strokes) 1000px | 47.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.7856132844429491 |  distance: 0.78561variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.6987643262683645 | distance: 0.69876variant: vectorized (all layers) 500px | 864.0 |
| Delaunay Triangulation | 0.3417550203404789 |  distance: 0.34176variant: vectorized (shape strokes) 500px | 5.0 |
| Fidelity Simplicity | 0.472510890610805 |  distance: 0.47251variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 146.0 |
| Mastering Sketching | 0.8474253479889517 |  distance: 0.84743variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7117023676607631 |  distance: 0.7117variant: vectorized (shape strokes) 500px | 97.0 |
| Poly Vector | 0.7468118692583091 |  distance: 0.74681variant: vectorized (all layers) 500pxalg. parameter: noisy | 243.0 |
| Stroke Aggregator | 0.8084756779720272 | distance: 0.80848variant: vectorized (shape strokes) | 1044.0 |
| Topology Driven | 0.7353150361389641 |  distance: 0.73532variant: vectorized (all layers) 1000px | 88.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.8632371975422816 | distance: 0.86324variant: vectorized (all layers) 500px | 2.0 |
| Delaunay Triangulation | 0.5039383856722589 | distance: 0.50394variant: vectorized (shape strokes) 500px | 5.0 |
| Fidelity Simplicity | 0.6328610794110279 |  distance: 0.63286variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 118.0 |
| Mastering Sketching | 0.9120202347755028 | distance: 0.91202variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8039454184927534 | distance: 0.80395variant: vectorized (shape strokes) 500px | 97.0 |
| Poly Vector | 0.8393651319135224 |  distance: 0.83937variant: vectorized (all layers) 500px | 224.0 |
| Stroke Aggregator | 0.9232445014259356 | distance: 0.92324variant: vectorized (shape strokes) | 1044.0 |
| Topology Driven → Stroke Aggregator | 0.8318680737663167 | distance: 0.83187variant: vectorized (all layers) 500px | 864.0 |
| Topology Driven | 0.8414760922878917 | distance: 0.84148variant: vectorized (all layers) 1000px | 88.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.9061780091099506 | distance: 0.90618variant: vectorized (all layers) 500px | 2.0 |
| Delaunay Triangulation | 0.6277023412778043 | distance: 0.6277variant: vectorized (shape strokes) 500px | 5.0 |
| Fidelity Simplicity | 0.7445233615667197 | distance: 0.74452variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 118.0 |
| Mastering Sketching | 0.941634804445272 | distance: 0.94163variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8686932334999952 | distance: 0.86869variant: vectorized (shape strokes) 500px | 97.0 |
| Poly Vector | 0.898732825616682 |  distance: 0.89873variant: vectorized (shape strokes) 500px | 148.0 |
| Stroke Aggregator | 0.9570065740334948 | distance: 0.95701variant: vectorized (shape strokes) | 1044.0 |
| Topology Driven → Stroke Aggregator | 0.8993485958503056 | distance: 0.89935variant: vectorized (all layers) 500px | 864.0 |
| Topology Driven | 0.8922364872110755 | distance: 0.89224variant: vectorized (all layers) 1000px | 88.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7167655713739557 | distance: 0.71677variant: vectorized (shape strokes) 500px | 5.0 |
| Fidelity Simplicity | 0.8093146142145223 | distance: 0.80931variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 146.0 |
| Mastering Sketching | 0.9602236030409448 | distance: 0.96022variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9032589516034244 | distance: 0.90326variant: vectorized (shape strokes) 500px | 97.0 |
| Poly Vector | 0.9272442170840934 | distance: 0.92724variant: vectorized (shape strokes) 500px | 148.0 |
| Real-Time Inking | 0.9299488322552324 | distance: 0.92995variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9701867580289052 | distance: 0.97019variant: vectorized (shape strokes) | 1044.0 |
| Topology Driven → Stroke Aggregator | 0.9270418004693206 | distance: 0.92704variant: vectorized (all layers) 500px | 864.0 |
| Topology Driven | 0.9232359453942302 | distance: 0.92324variant: vectorized (all layers) 1000px | 88.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7960190704036239 |  distance: 0.79602variant: vectorized (all layers) 500px | 6.0 |
| Fidelity Simplicity | 0.855173540593079 | distance: 0.85517variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 146.0 |
| Mastering Sketching | 0.9742716399143714 | distance: 0.97427variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9260463070993756 | distance: 0.92605variant: vectorized (shape strokes) 500px | 97.0 |
| Poly Vector | 0.9463281195365472 |  distance: 0.94633variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 163.0 |
| Real-Time Inking | 0.9493157992704838 | distance: 0.94932variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.980132412791196 | distance: 0.98013variant: vectorized (shape strokes) | 1044.0 |
| Topology Driven → Stroke Aggregator | 0.9474949173503142 | distance: 0.94749variant: vectorized (all layers) 500px | 864.0 |
| Topology Driven | 0.9474017510593812 | distance: 0.9474variant: vectorized (all layers) 1000px | 88.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.09108238220214844 |  distance: 0.09108variant: vectorized (shape strokes) 500px | 6.0 |
| Delaunay Triangulation | 0.12913631497146033 |  distance: 0.12914variant: thresholded | 489.0 |
| Fidelity Simplicity | 0.04418144226074218 |  distance: 0.04418variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 148.0 |
| Topology Driven | 0.036370903277378096 |  distance: 0.03637variant: original | 667.0 |
| Poly Vector → Stroke Aggregator | 0.03805259704589844 |  distance: 0.03805variant: thresholded 500pxalg. parameter: noisy | 146.0 |
| Poly Vector | 0.03805259704589844 |  distance: 0.03805variant: thresholded 500pxalg. parameter: noisy | 281.0 |
| Real-Time Inking | 0.045963229416466835 |  distance: 0.04596variant: original | 4.0 |
| Stroke Aggregator | 0.04676258992805756 | distance: 0.04676variant: vectorized (shape strokes) | 1044.0 |
| Topology Driven → Stroke Aggregator | 0.046 | distance: 0.046variant: vectorized (all layers) 500px | 864.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
|
|
|||||||
| thresholded | |
 |
 |
 |
 |
 |
 |
|
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
|
|
||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
|
|
 |
 |
|
|
|
|||
| vectorized (shape strokes) 1000px |  |
|
 |
 |
 |
 |
 |
|
 |
|
|||||
| vectorized (shape strokes) 500px |  |
|
 |
|
 |
|
 |
 |
|
|
|
|
|||
| vectorized (shape strokes) | |