A Benchmark for Rough Sketch Cleanup
Art_logo_VFS_01
Author: VFS Digital Design Author Homepage: https://www.flickr.com/photos/vfsdigitaldesign/ Licence: CC-BY-2.0Messiness: 0.11985
Ambiguity (Chamfer): 0.32926
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Poly Vector | Topology Driven | Topology Driven → Stroke Aggregator | Real-Time Inking | Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0026 |  distance: 0.00287 |  distance: 0.00308 |  distance: 0.00308 |  distance: 0.00314 |  distance: 0.00328 |  distance: 0.00331 |  distance: 0.00334 |  distance: 0.00396 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.003959710824827377 | distance: 0.00396variant: vectorized (shape strokes) 1000px | 2.0 |
| Fidelity Simplicity | 0.0028669241942697555 | distance: 0.00287variant: vectorized (shape strokes) 1000pxalg. parameter: 0.5 | 212.0 |
| Mastering Sketching | 0.002601538575137649 | distance: 0.0026variant: thresholded | 5.0 |
| Poly Vector → Stroke Aggregator | 0.003081820635082113 | distance: 0.00308variant: vectorized (all layers) 1000pxalg. parameter: noisy | 87.0 |
| Poly Vector | 0.003083790788779065 | distance: 0.00308variant: vectorized (all layers) 1000pxalg. parameter: noisy | 169.0 |
| Real-Time Inking | 0.0033111409388087683 | distance: 0.00331variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.003335260371138109 | distance: 0.00334variant: vectorized (shape strokes) | 64.0 |
| Topology Driven → Stroke Aggregator | 0.0032792592958392442 | distance: 0.00328variant: vectorized (all layers) 1000px | 179.0 |
| Topology Driven | 0.003141889604437149 | distance: 0.00314variant: vectorized (all layers) 1000px | 7.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.1840342520341779 |  distance: 0.18403variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Delaunay Triangulation | 0.22716845475863734 |  distance: 0.22717variant: thresholded | 14.0 |
| Fidelity Simplicity | 0.2460234626142863 |  distance: 0.24602variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 166.0 |
| Mastering Sketching | 0.3630684576124037 | distance: 0.36307variant: thresholded | 5.0 |
| Poly Vector → Stroke Aggregator | 0.3148612592182642 |  distance: 0.31486variant: originalalg. parameter: noisy | 66.0 |
| Real-Time Inking | 0.3388509884957733 |  distance: 0.33885variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.3036707781627172 | distance: 0.30367variant: vectorized (shape strokes) | 64.0 |
| Topology Driven → Stroke Aggregator | 0.2601640435703215 |  distance: 0.26016variant: vectorized (all layers) 500px | 51.0 |
| Topology Driven | 0.32309604849149937 |  distance: 0.3231variant: vectorized (all layers) 500px | 2.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3953904582062104 | distance: 0.39539variant: thresholded | 14.0 |
| Fidelity Simplicity | 0.454369909398737 |  distance: 0.45437variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 176.0 |
| Mastering Sketching | 0.5470283667739293 |  distance: 0.54703variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5265335213990057 |  distance: 0.52653variant: vectorized (all layers) 1000px | 88.0 |
| Poly Vector | 0.2911806606713561 |  distance: 0.29118variant: vectorized (all layers) 500px | 55.0 |
| Real-Time Inking | 0.5210926669376766 |  distance: 0.52109variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.5275898338328301 | distance: 0.52759variant: vectorized (shape strokes) | 64.0 |
| Topology Driven → Stroke Aggregator | 0.4201237784035297 | distance: 0.42012variant: vectorized (all layers) 500px | 51.0 |
| Topology Driven | 0.4924599930568776 | distance: 0.49246variant: vectorized (all layers) 500px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.36695048053940016 | distance: 0.36695variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Delaunay Triangulation | 0.4815013157177002 | distance: 0.4815variant: thresholded | 14.0 |
| Fidelity Simplicity | 0.5907405270492144 | distance: 0.59074variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 176.0 |
| Mastering Sketching | 0.6370397024160191 | distance: 0.63704variant: thresholded | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6323721410817607 | distance: 0.63237variant: originalalg. parameter: noisy | 66.0 |
| Real-Time Inking | 0.6232324829381121 | distance: 0.62323variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.6415939052052914 | distance: 0.64159variant: vectorized (shape strokes) | 64.0 |
| Topology Driven → Stroke Aggregator | 0.5613634911193153 | distance: 0.56136variant: vectorized (all layers) 500px | 51.0 |
| Topology Driven | 0.6116993362191526 | distance: 0.6117variant: vectorized (all layers) 500px | 2.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.4157015082847757 | distance: 0.4157variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Delaunay Triangulation | 0.553146036560049 | distance: 0.55315variant: thresholded | 14.0 |
| Fidelity Simplicity | 0.6594878504398118 | distance: 0.65949variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 176.0 |
| Mastering Sketching | 0.7048473132968597 |  distance: 0.70485variant: original | 10.0 |
| Poly Vector → Stroke Aggregator | 0.6993308489349402 | distance: 0.69933variant: originalalg. parameter: noisy | 66.0 |
| Real-Time Inking | 0.6775467862354414 | distance: 0.67755variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7138017206199764 |  distance: 0.7138variant: vectorized (all layers) | 130.0 |
| Topology Driven → Stroke Aggregator | 0.6512957257226133 | distance: 0.6513variant: vectorized (all layers) 500px | 51.0 |
| Topology Driven | 0.6816128864794311 | distance: 0.68161variant: vectorized (all layers) 500px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.4656992295229177 | distance: 0.4657variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Delaunay Triangulation | 0.6086776113480962 | distance: 0.60868variant: thresholded | 14.0 |
| Fidelity Simplicity | 0.7357334880735127 |  distance: 0.73573variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 141.0 |
| Mastering Sketching | 0.7386018654537249 | distance: 0.7386variant: original | 10.0 |
| Poly Vector → Stroke Aggregator | 0.7423095147588299 | distance: 0.74231variant: originalalg. parameter: noisy | 66.0 |
| Real-Time Inking | 0.7325242619627819 | distance: 0.73252variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7588349568888616 | distance: 0.75883variant: vectorized (all layers) | 130.0 |
| Topology Driven → Stroke Aggregator | 0.7225610790155002 | distance: 0.72256variant: vectorized (all layers) 500px | 51.0 |
| Topology Driven | 0.7364324288638397 |  distance: 0.73643variant: original | 72.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.04242640686035156 |  distance: 0.04243variant: vectorized (all layers) 500px | 0.0 |
| Fidelity Simplicity | 0.048373546600341794 |  distance: 0.04837variant: thresholded 500pxalg. parameter: 0.75 | 219.0 |
| Poly Vector → Stroke Aggregator | 0.048551534139635484 | distance: 0.04855variant: originalalg. parameter: noisy | 66.0 |
| Poly Vector | 0.048551534139635484 |  distance: 0.04855variant: original | 811.0 |
| Real-Time Inking | 0.04758283111240953 |  distance: 0.04758variant: original | 2.0 |
| Stroke Aggregator | 0.05461631379167766 | distance: 0.05462variant: vectorized (shape strokes) | 64.0 |
| Topology Driven → Stroke Aggregator | 0.048551534139635484 |  distance: 0.04855variant: thresholded | 101.0 |
| Topology Driven | 0.0464062339865543 | distance: 0.04641variant: original | 72.0 |
| Mastering Sketching | 0.38 | distance: 0.38variant: vectorized (all layers) 500px | 6.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
 |
 |
 |
 |
|
 |
|
 |
|
|||
| thresholded | |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
|||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 500px |  |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 1000px | |
|
 |
 |
 |
 |
 |
|
|
 |
 |
|
|
||
| vectorized (all layers) 500px | |
|
|
 |
|
 |
|
|
|
 |
|
|
|||
| vectorized (shape strokes) 1000px |  |
|
 |
 |
|
 |
 |
 |
 |
 |
|
||||
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
||||
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |