A Benchmark for Rough Sketch Cleanup
Art_freeform_LTV_06
Author: Lunatics TV Author Homepage: https://www.flickr.com/photos/lunatics_tv/ Licence: CC-BY-SA 2.0Messiness: 0.1297
Ambiguity (Chamfer): 0.15372
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Real-Time Inking | Poly Vector | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00122 |  distance: 0.00124 |  distance: 0.00124 |  distance: 0.00125 |  distance: 0.00132 |  distance: 0.00159 |  distance: 0.00279 |  distance: 0.00531 |  distance: 0.00875 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  |  | |||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.008752444597480686 | distance: 0.00875variant: thresholded 1000pxalg. parameter: 0.5 | 229.0 |
| Delaunay Triangulation | 0.0053094715721233405 | distance: 0.00531variant: vectorized (shape strokes) 500px | 1.0 |
| Mastering Sketching | 0.0012222547024572654 | distance: 0.00122variant: thresholded | 5.0 |
| Stroke Aggregator | 0.002791240340330416 | distance: 0.00279variant: vectorized (shape strokes) | 66.0 |
| Poly Vector → Stroke Aggregator | 0.0015879125569103136 | distance: 0.00159variant: thresholdedalg. parameter: noisy | 34.0 |
| Poly Vector | 0.0012455691185824258 | distance: 0.00125variant: thresholded 1000px | 410.0 |
| Real-Time Inking | 0.001241276426243381 | distance: 0.00124variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.0013205852933111145 | distance: 0.00132variant: thresholded 1000px | 225.0 |
| Topology Driven | 0.0012373462298040342 | distance: 0.00124variant: thresholded 1000px | 62.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.4417670682730924 | distance: 0.44177variant: thresholded | 5.0 |
| Real-Time Inking | 0.41548439400081066 |  distance: 0.41548variant: original | 2.0 |
| Stroke Aggregator | 0.22231966673975004 | distance: 0.22232variant: vectorized (shape strokes) | 66.0 |
| Fidelity Simplicity | 0.17648585517778353 |  distance: 0.17649variant: originalalg. parameter: 0.75 | 216.0 |
| Poly Vector → Stroke Aggregator | 0.360837142169834 |  distance: 0.36084variant: original | 22.0 |
| Poly Vector | 0.416374269005848 |  distance: 0.41637variant: originalalg. parameter: noisy | 61.0 |
| Topology Driven → Stroke Aggregator | 0.10250737463126844 |  distance: 0.10251variant: original | 77.0 |
| Topology Driven | 0.4301386876423101 |  distance: 0.43014variant: original | 6.0 |
| Delaunay Triangulation | 0.08333333333333333 |  distance: 0.08333variant: thresholded | 1.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.8699965633452592 |  distance: 0.87variant: original | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6989850911005815 |  distance: 0.69899variant: vectorized (all layers) 1000pxalg. parameter: noisy | 24.0 |
| Real-Time Inking | 0.8648764078059524 | distance: 0.86488variant: original | 2.0 |
| Stroke Aggregator | 0.6639235825373181 |  distance: 0.66392variant: vectorized (all layers) | 65.0 |
| Topology Driven → Stroke Aggregator | 0.39986643355069146 | distance: 0.39987variant: original | 77.0 |
| Topology Driven | 0.7820523312761186 |  distance: 0.78205variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.5517350550862445 | distance: 0.55174variant: originalalg. parameter: 0.75 | 216.0 |
| Poly Vector | 0.6330342576160136 |  distance: 0.63303variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Delaunay Triangulation | 0.4969666754607861 | distance: 0.49697variant: thresholded | 1.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6977398174693135 |  distance: 0.69774variant: original | 1.0 |
| Mastering Sketching | 0.9278455750665872 | distance: 0.92785variant: original | 5.0 |
| Real-Time Inking | 0.9154385424633408 | distance: 0.91544variant: original | 2.0 |
| Stroke Aggregator | 0.8284339434701422 | distance: 0.82843variant: vectorized (shape strokes) | 66.0 |
| Topology Driven → Stroke Aggregator | 0.5312794988414999 | distance: 0.53128variant: original | 77.0 |
| Fidelity Simplicity | 0.7064839787957525 | distance: 0.70648variant: originalalg. parameter: 0.75 | 216.0 |
| Poly Vector | 0.696071268088888 | distance: 0.69607variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Poly Vector → Stroke Aggregator | 0.7479557841635878 | distance: 0.74796variant: vectorized (all layers) 1000pxalg. parameter: noisy | 24.0 |
| Topology Driven | 0.8569446766323795 | distance: 0.85694variant: vectorized (all layers) 500px | 4.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7771284231665321 | distance: 0.77713variant: original | 1.0 |
| Mastering Sketching | 0.9454615932712525 | distance: 0.94546variant: original | 5.0 |
| Real-Time Inking | 0.9317608348490622 | distance: 0.93176variant: original | 2.0 |
| Stroke Aggregator | 0.9271953040828906 | distance: 0.9272variant: vectorized (shape strokes) | 66.0 |
| Topology Driven → Stroke Aggregator | 0.6109196074428083 | distance: 0.61092variant: original | 77.0 |
| Fidelity Simplicity | 0.7826532136230735 |  distance: 0.78265variant: originalalg. parameter: 0.5 | 172.0 |
| Poly Vector → Stroke Aggregator | 0.7764083271850074 | distance: 0.77641variant: vectorized (all layers) 1000pxalg. parameter: noisy | 24.0 |
| Poly Vector | 0.7264360645306882 | distance: 0.72644variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Topology Driven | 0.8944848141906628 | distance: 0.89448variant: vectorized (all layers) 500px | 4.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8343864670542984 | distance: 0.83439variant: original | 1.0 |
| Mastering Sketching | 0.9518617146632276 | distance: 0.95186variant: original | 5.0 |
| Real-Time Inking | 0.9441000757497444 | distance: 0.9441variant: original | 2.0 |
| Stroke Aggregator | 0.9604924862580384 | distance: 0.96049variant: vectorized (shape strokes) | 66.0 |
| Topology Driven → Stroke Aggregator | 0.6731840169861256 | distance: 0.67318variant: original | 77.0 |
| Fidelity Simplicity | 0.8310941408032065 | distance: 0.83109variant: originalalg. parameter: 0.5 | 172.0 |
| Poly Vector → Stroke Aggregator | 0.8001383939985173 | distance: 0.80014variant: vectorized (all layers) 1000pxalg. parameter: noisy | 24.0 |
| Poly Vector | 0.7512822757141121 |  distance: 0.75128variant: vectorized (shape strokes) 500px | 41.0 |
| Topology Driven | 0.9221839440915384 |  distance: 0.92218variant: vectorized (shape strokes) 500px | 4.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2702966562319573 |  distance: 0.2703variant: thresholdedalg. parameter: 0.25 | 133.0 |
| Delaunay Triangulation | 0.07467261505126953 | distance: 0.07467variant: vectorized (shape strokes) 500px | 1.0 |
| Stroke Aggregator | 0.01633041064678659 | distance: 0.01633variant: vectorized (all layers) | 65.0 |
| Topology Driven → Stroke Aggregator | 0.0178885440826416 | distance: 0.01789variant: thresholded 1000px | 225.0 |
| Mastering Sketching | 0.09057122950741103 | distance: 0.09057variant: original | 5.0 |
| Poly Vector → Stroke Aggregator | 0.01633041064678659 | distance: 0.01633variant: thresholdedalg. parameter: noisy | 34.0 |
| Poly Vector | 0.01633041064678659 |  distance: 0.01633variant: thresholdedalg. parameter: noisy | 81.0 |
| Real-Time Inking | 0.1004987564086914 |  distance: 0.1005variant: vectorized (shape strokes) 500px | 2.0 |
| Topology Driven | 0.01720465087890625 |  distance: 0.0172variant: thresholded 500px | 10.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
 |
 |
|
|
 |
|
|
 |
|
|
||
| thresholded |  |
|
 |
|
 |
 |
 |
 |
|
 |
|
|
|||
| thresholded 1000px | |
 |
 |
 |
|
 |
 |
|
 |
|
 |
||||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
|
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||
| vectorized (all layers) 500px |  |
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
|||
| vectorized (shape strokes) 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
 |
|
|
|
|
||||
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |