A Benchmark for Rough Sketch Cleanup
Ind_product_PM_43
Author: Patrick Murphy Author Homepage: https://www.flickr.com/photos/pmurf/ Licence: CC-BY-2.0Messiness: 0.30176
Ambiguity (Chamfer): 0.13947
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector | Delaunay Triangulation | Topology Driven | Real-Time Inking | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00204 |  distance: 0.00251 |  distance: 0.00252 |  distance: 0.00256 |  distance: 0.00265 |  distance: 0.00348 |  distance: 0.00547 |  distance: 0.00703 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  |  | |||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.002516414585859449 | distance: 0.00252variant: vectorized (shape strokes) 1000px | 4.0 |
| Mastering Sketching | 0.0020436802043187173 | distance: 0.00204variant: vectorized (shape strokes) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.005467867093342483 | distance: 0.00547variant: thresholded 500pxalg. parameter: noisy | 128.0 |
| Topology Driven → Stroke Aggregator | 0.003475855873573937 | distance: 0.00348variant: vectorized (shape strokes) 500px | 105.0 |
| Topology Driven | 0.0025581521825048447 | distance: 0.00256variant: vectorized (shape strokes) 1000px | 9.0 |
| Fidelity Simplicity | 0.00702896020605797 | distance: 0.00703variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 174.0 |
| Poly Vector | 0.002509777814059932 | distance: 0.00251variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 169.0 |
| Real-Time Inking | 0.0026471785355294 | distance: 0.00265variant: vectorized (shape strokes) 1000px | 2.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.4664022253379727 |  distance: 0.4664variant: thresholded 500px | 5.0 |
| Poly Vector | 0.018058690744920995 |  distance: 0.01806variant: vectorized (shape strokes) 500px | 34.0 |
| Real-Time Inking | 0.4290346587553308 |  distance: 0.42903variant: original | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.4692138171049282 |  distance: 0.46921variant: vectorized (all layers) 1000px | 1225.0 |
| Topology Driven | 0.43302027685822303 |  distance: 0.43302variant: thresholded 1000px | 366.0 |
| Delaunay Triangulation | 0.18854716290833884 |  distance: 0.18855variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.12638619961274425 |  distance: 0.12639variant: thresholded 500pxalg. parameter: 0.25 | 90.0 |
| Poly Vector → Stroke Aggregator | 0.38309129828726746 |  distance: 0.38309variant: vectorized (all layers) 500pxalg. parameter: noisy | 25.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.1935798763296301 | distance: 0.19358variant: thresholded 500pxalg. parameter: 0.25 | 90.0 |
| Mastering Sketching | 0.6273202696742486 | distance: 0.62732variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5192146333277395 |  distance: 0.51921variant: vectorized (all layers) 500px | 25.0 |
| Real-Time Inking | 0.6340429565479653 |  distance: 0.63404variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6317228517239875 | distance: 0.63172variant: vectorized (all layers) 1000px | 1225.0 |
| Topology Driven | 0.5984183211682225 | distance: 0.59842variant: thresholded 1000px | 366.0 |
| Delaunay Triangulation | 0.335386909368461 | distance: 0.33539variant: vectorized (all layers) 500px | 3.0 |
| Poly Vector | 0.02827568795758647 | distance: 0.02828variant: vectorized (shape strokes) 500px | 34.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.26303056220105764 | distance: 0.26303variant: thresholded 500pxalg. parameter: 0.25 | 90.0 |
| Mastering Sketching | 0.7243218302873883 | distance: 0.72432variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6066773089750024 | distance: 0.60668variant: vectorized (all layers) 500px | 25.0 |
| Real-Time Inking | 0.7454538311772244 | distance: 0.74545variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.706291968261922 | distance: 0.70629variant: vectorized (all layers) 1000px | 1225.0 |
| Topology Driven | 0.7010629213196706 | distance: 0.70106variant: thresholded 1000px | 366.0 |
| Delaunay Triangulation | 0.4636949164877552 | distance: 0.46369variant: vectorized (all layers) 500px | 3.0 |
| Poly Vector | 0.040706777007380894 | distance: 0.04071variant: vectorized (shape strokes) 500px | 34.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.7837129055335312 |  distance: 0.78371variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6811569036999552 |  distance: 0.68116variant: vectorized (shape strokes) 500px | 15.0 |
| Real-Time Inking | 0.8168497715161438 | distance: 0.81685variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7757273818517759 | distance: 0.77573variant: vectorized (all layers) 1000px | 1225.0 |
| Topology Driven | 0.7727087472002974 |  distance: 0.77271variant: vectorized (all layers) 500px | 24.0 |
| Delaunay Triangulation | 0.5330756859555681 | distance: 0.53308variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.33951306577394635 |  distance: 0.33951variant: thresholded 500pxalg. parameter: 0.75 | 118.0 |
| Poly Vector | 0.05463024650233178 | distance: 0.05463variant: vectorized (shape strokes) 500px | 34.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.8204035334314506 | distance: 0.8204variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.73426093438085 | distance: 0.73426variant: vectorized (shape strokes) 500px | 15.0 |
| Real-Time Inking | 0.8627279724151657 | distance: 0.86273variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8230345799820853 | distance: 0.82303variant: vectorized (all layers) 1000px | 1225.0 |
| Topology Driven | 0.8196482906747807 |  distance: 0.81965variant: thresholded 500px | 53.0 |
| Poly Vector | 0.06589147286821706 | distance: 0.06589variant: vectorized (shape strokes) 500px | 34.0 |
| Delaunay Triangulation | 0.6172855685741709 | distance: 0.61729variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.4118610568973132 | distance: 0.41186variant: thresholded 500pxalg. parameter: 0.75 | 118.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2389476928710937 |  distance: 0.23895variant: vectorized (shape strokes) 500pxalg. parameter: 0.25 | 100.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.033105892181396486 | distance: 0.03311variant: vectorized (shape strokes) 1000px | 4.0 |
| Poly Vector → Stroke Aggregator | 0.038 | distance: 0.038variant: thresholded 500pxalg. parameter: noisy | 128.0 |
| Poly Vector | 0.038 |  distance: 0.038variant: thresholded 500pxalg. parameter: noisy | 528.0 |
| Real-Time Inking | 0.032202484130859375 | distance: 0.0322variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.029732137680053713 | distance: 0.02973variant: vectorized (shape strokes) 500px | 105.0 |
| Topology Driven | 0.037656341552734375 | distance: 0.03766variant: thresholded 1000px | 366.0 |
| Mastering Sketching | 0.315372802734375 | distance: 0.31537variant: thresholded 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded 500px | |
|
 |
|
 |
|
 |
|
|
 |
 |
|
|||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
||||||
| vectorized (all layers) 500px |  |
|
 |
 |
 |
 |
 |
|
 |
 |
|
|
|
||
| vectorized (shape strokes) 1000px | |
|
 |
 |
 |
 |
|
|
 |
|
|||||
| vectorized (shape strokes) 500px | |
 |
|
 |
|
 |
 |
 |
 |
 |
|
 |
 |
|