A Benchmark for Rough Sketch Cleanup
Art_freeform_MF_02
Author: Maria Fiddler (aka Maria Hegedus) Author Homepage: https://www.upwork.com/freelancers/~018a9abad1b9695c08 Licence: CC-BY-NC-SA-4.0Messiness: 0.07432
Ambiguity (Chamfer): 0.01206
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Poly Vector | Topology Driven | Topology Driven → Stroke Aggregator | Mastering Sketching | Real-Time Inking | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00023 |  distance: 0.0003 |  distance: 0.00043 |  distance: 0.00066 |  distance: 0.00068 |  distance: 0.00087 |  distance: 0.00262 |  distance: 0.00329 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Liliya Larsen |  | |  | ||||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.002623076985910763 | distance: 0.00262variant: vectorized (shape strokes) 1000px | 8.0 |
| Fidelity Simplicity | 0.0032937901622206297 | distance: 0.00329variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 172.0 |
| Mastering Sketching | 0.0006612309307044237 | distance: 0.00066variant: vectorized (shape strokes) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.0008650200670210509 | distance: 0.00087variant: vectorized (shape strokes) 1000px | 677.0 |
| Poly Vector | 0.0002282900574015376 | distance: 0.00023variant: vectorized (shape strokes) 1000px | 321.0 |
| Real-Time Inking | 0.0006764090981869352 | distance: 0.00068variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.0004279290484782919 | distance: 0.00043variant: vectorized (shape strokes) 1000px | 1210.0 |
| Topology Driven | 0.00029550936400699247 | distance: 0.0003variant: vectorized (shape strokes) 1000px | 22.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.8500558164469667 |  distance: 0.85006variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5270381718670698 |  distance: 0.52704variant: vectorized (all layers) 500px | 58.0 |
| Poly Vector | 0.5549551801124025 |  distance: 0.55496variant: vectorized (all layers) 500px | 270.0 |
| Real-Time Inking | 0.8249967173080702 |  distance: 0.825variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7195302499358254 |  distance: 0.71953variant: vectorized (all layers) 500px | 1264.0 |
| Topology Driven | 0.7923050066936526 |  distance: 0.79231variant: thresholded 500px | 17.0 |
| Delaunay Triangulation | 0.3580286822721641 |  distance: 0.35803variant: vectorized (shape strokes) 500px | 2.0 |
| Fidelity Simplicity | 0.4128461219268531 |  distance: 0.41285variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 219.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.657138000592222 | distance: 0.65714variant: vectorized (all layers) 500px | 58.0 |
| Poly Vector | 0.6836060556344012 |  distance: 0.68361variant: vectorized (all layers) 500pxalg. parameter: noisy | 458.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8550694956217235 | distance: 0.85507variant: vectorized (all layers) 500px | 1264.0 |
| Mastering Sketching | 0.9361611620250128 | distance: 0.93616variant: thresholded 500px | 5.0 |
| Real-Time Inking | 0.8928165495745897 | distance: 0.89282variant: thresholded 500px | 2.0 |
| Topology Driven | 0.8667759293116666 | distance: 0.86678variant: thresholded 500px | 17.0 |
| Delaunay Triangulation | 0.5427034750737679 |  distance: 0.5427variant: thresholded 500px | 3.0 |
| Fidelity Simplicity | 0.5626938394237703 |  distance: 0.56269variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 224.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6476233502340403 |  distance: 0.64762variant: thresholdedalg. parameter: 0.75 | 1075.0 |
| Poly Vector → Stroke Aggregator | 0.7463745956694667 |  distance: 0.74637variant: vectorized (shape strokes) 500px | 39.0 |
| Poly Vector | 0.7683206063102554 |  distance: 0.76832variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 139.0 |
| Real-Time Inking | 0.926499036652734 | distance: 0.9265variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.935048074206118 | distance: 0.93505variant: vectorized (all layers) 500px | 1264.0 |
| Delaunay Triangulation | 0.6737430934550548 | distance: 0.67374variant: thresholded 500px | 3.0 |
| Mastering Sketching | 0.9634762196641694 | distance: 0.96348variant: thresholded 500px | 5.0 |
| Topology Driven | 0.9157715361622232 | distance: 0.91577variant: thresholded 500px | 17.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.7987782361362412 |  distance: 0.79878variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Poly Vector | 0.8193573947886761 |  distance: 0.81936variant: vectorized (shape strokes) 500px | 136.0 |
| Real-Time Inking | 0.9418144360238394 | distance: 0.94181variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9649999150131864 | distance: 0.965variant: vectorized (all layers) 500px | 1264.0 |
| Delaunay Triangulation | 0.7453125468594421 | distance: 0.74531variant: thresholded 500px | 3.0 |
| Fidelity Simplicity | 0.692083540795221 | distance: 0.69208variant: thresholdedalg. parameter: 0.75 | 1075.0 |
| Mastering Sketching | 0.9712988043448522 |  distance: 0.9713variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven | 0.9376183562932314 | distance: 0.93762variant: thresholded 500px | 17.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7185147582813358 | distance: 0.71851variant: thresholdedalg. parameter: 0.75 | 1075.0 |
| Poly Vector → Stroke Aggregator | 0.8480735601532017 | distance: 0.84807variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Poly Vector | 0.865533801256003 | distance: 0.86553variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 139.0 |
| Real-Time Inking | 0.9587607465137636 | distance: 0.95876variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.821203509442842 | distance: 0.8212variant: thresholded 500px | 3.0 |
| Mastering Sketching | 0.9779541685921658 | distance: 0.97795variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.9791204079035708 | distance: 0.97912variant: vectorized (all layers) 500px | 1264.0 |
| Topology Driven | 0.9571991312962912 | distance: 0.9572variant: thresholded 500px | 17.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.15141995239257813 |  distance: 0.15142variant: thresholded 500pxalg. parameter: 0.25 | 145.0 |
| Mastering Sketching | 0.21778889465332035 | distance: 0.21779variant: thresholded 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.03667424011230469 |  distance: 0.03667variant: vectorized (all layers) 1000px | 11.0 |
| Poly Vector → Stroke Aggregator | 0.02202271461486817 | distance: 0.02202variant: vectorized (shape strokes) 1000px | 677.0 |
| Real-Time Inking | 0.036878177642822266 |  distance: 0.03688variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector | 0.02256102752685547 |  distance: 0.02256variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 333.0 |
| Topology Driven → Stroke Aggregator | 0.02256102752685547 | distance: 0.02256variant: vectorized (shape strokes) 1000px | 1210.0 |
| Topology Driven | 0.022000000000000002 |  distance: 0.022variant: vectorized (shape strokes) 500px | 8.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
|||||||||||||
| thresholded |  |
 |
 |
 |
|
 |
 |
||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| thresholded 500px | |
|
 |
|
 |
 |
 |
|
 |
 |
|
||||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
|
 |
 |
|
|
 |
 |
|
|
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
|
|
|
 |
|
||
| vectorized (shape strokes) 500px |  |
 |
|
 |
 |
 |
|
 |
|
|
|
|
|
|