A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_08
Author: Enrique Rosales Licence: Academic PaperMessiness: 0.1841
Ambiguity (Chamfer): 0.07729
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Poly Vector → Stroke Aggregator | Mastering Sketching | Real-Time Inking | Poly Vector | Topology Driven | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00108 |  distance: 0.00108 |  distance: 0.00112 |  distance: 0.00135 |  distance: 0.00137 |  distance: 0.00171 |  distance: 0.00776 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.0017100792969360695 | distance: 0.00171variant: original | 17.0 |
| Fidelity Simplicity | 0.007760432124583953 | distance: 0.00776variant: originalalg. parameter: 0.25 | 228.0 |
| Mastering Sketching | 0.0010796756250401106 | distance: 0.00108variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0010781221992749296 | distance: 0.00108variant: original | 591.0 |
| Poly Vector | 0.001351514824764506 | distance: 0.00135variant: originalalg. parameter: noisy | 474.0 |
| Real-Time Inking | 0.0011209786103957248 | distance: 0.00112variant: original | 4.0 |
| Topology Driven | 0.0013712459672425294 | distance: 0.00137variant: original | 80.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.7155518741822563 | distance: 0.71555variant: original | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.522592309038625 |  distance: 0.52259variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.5194311402643841 |  distance: 0.51943variant: original 500pxalg. parameter: 0.75 | 201.0 |
| Mastering Sketching | 0.8173331129051266 | distance: 0.81733variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.650699203966182 |  distance: 0.6507variant: original 500px | 30.0 |
| Poly Vector | 0.6732767242361806 |  distance: 0.67328variant: original 500pxalg. parameter: noisy | 76.0 |
| Topology Driven | 0.6790956671113425 | distance: 0.6791variant: original | 80.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9281898310470654 | distance: 0.92819variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8086740958310069 |  distance: 0.80867variant: original 500pxalg. parameter: noisy | 30.0 |
| Poly Vector | 0.8199508277202912 | distance: 0.81995variant: original 500pxalg. parameter: noisy | 76.0 |
| Real-Time Inking | 0.8996892342627599 |  distance: 0.89969variant: original 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.8583565906244406 |  distance: 0.85836variant: original 1000px | 45.0 |
| Delaunay Triangulation | 0.7514942984465363 | distance: 0.75149variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.7003124914667861 | distance: 0.70031variant: original 500pxalg. parameter: 0.75 | 201.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8638989279314848 | distance: 0.8639variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.7952256528767214 | distance: 0.79523variant: original 500pxalg. parameter: 0.75 | 201.0 |
| Mastering Sketching | 0.9724419843315278 | distance: 0.97244variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8750358932224913 | distance: 0.87504variant: original 500pxalg. parameter: noisy | 30.0 |
| Poly Vector | 0.8858473016728731 | distance: 0.88585variant: original 500pxalg. parameter: noisy | 76.0 |
| Real-Time Inking | 0.945452289771422 | distance: 0.94545variant: original | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.9245758667221171 | distance: 0.92458variant: original 1000px | 45.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.9109804352907592 | distance: 0.91098variant: original 500px | 2.0 |
| Mastering Sketching | 0.9857610104499276 | distance: 0.98576variant: original 500px | 5.0 |
| Real-Time Inking | 0.971045304467703 | distance: 0.97105variant: original | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.9579043804382272 |  distance: 0.9579variant: original 500px | 11.0 |
| Fidelity Simplicity | 0.8240149258097791 | distance: 0.82401variant: original 500pxalg. parameter: 0.75 | 201.0 |
| Poly Vector → Stroke Aggregator | 0.9010394350245204 | distance: 0.90104variant: original 500pxalg. parameter: noisy | 30.0 |
| Poly Vector | 0.9114090769737192 |  distance: 0.91141variant: original 500px | 75.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9936393035938402 | distance: 0.99364variant: original 500px | 5.0 |
| Real-Time Inking | 0.9829355254790652 | distance: 0.98294variant: original | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.9781687506407168 | distance: 0.97817variant: original 1000px | 45.0 |
| Delaunay Triangulation | 0.9422824741527159 | distance: 0.94228variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.8422984065668759 | distance: 0.8423variant: original 500pxalg. parameter: 0.75 | 201.0 |
| Poly Vector → Stroke Aggregator | 0.9246114442392452 | distance: 0.92461variant: original 500px | 30.0 |
| Poly Vector | 0.9325380800194673 | distance: 0.93254variant: original 500pxalg. parameter: noisy | 76.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.028600698471069337 |  distance: 0.0286variant: original 1000px | 10.0 |
| Mastering Sketching | 0.2 | distance: 0.2variant: original 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.2485155944824219 |  distance: 0.24852variant: original 500pxalg. parameter: 0.6 | 162.0 |
| Poly Vector → Stroke Aggregator | 0.016876309935809575 | distance: 0.01688variant: original | 591.0 |
| Poly Vector | 0.017804492950439454 |  distance: 0.0178variant: original 1000px | 288.0 |
| Real-Time Inking | 0.018636767627202976 | distance: 0.01864variant: original | 4.0 |
| Topology Driven | 0.018157518397994902 | distance: 0.01816variant: original | 80.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
 |
 |
|
|
 |
|
 |
|
|||
| original 1000px | |
 |
 |
 |
 |
 |
|
 |
|
|
|||||
| original 500px |  |
|
 |
 |
 |
|
|
|
|
|
|
|
|