A Benchmark for Rough Sketch Cleanup
Art_freeform_MF_01
Author: Maria Fiddler (aka Maria Hegedus) Author Homepage: https://www.upwork.com/freelancers/~018a9abad1b9695c08 Licence: CC-BY-NC-SA-4.0Messiness: 0.02381
Ambiguity (Chamfer): -1e-05
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Real-Time Inking | Stroke Aggregator | Poly Vector | Mastering Sketching | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00028 |  distance: 0.00034 |  distance: 0.00036 |  distance: 0.00044 |  distance: 0.0007 |  distance: 0.00073 |  distance: 0.00085 |  distance: 0.00262 |  distance: 0.00473 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Liliya Larsen |  | |  | ||||
| Maria Hegedus |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0026245428579526413 | distance: 0.00262variant: original | 151.0 |
| Fidelity Simplicity | 0.004733175096933557 | distance: 0.00473variant: thresholded 1000pxalg. parameter: 0.3 | 108.0 |
| Mastering Sketching | 0.0007048928128500695 | distance: 0.0007variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0007338543406568063 | distance: 0.00073variant: vectorized (all layers) 1000pxalg. parameter: noisy | 298.0 |
| Poly Vector | 0.000438687257784423 | distance: 0.00044variant: thresholded 1000px | 384.0 |
| Real-Time Inking | 0.00033706576032271034 | distance: 0.00034variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.00035823697642582204 | distance: 0.00036variant: vectorized (shape strokes) | 1220.0 |
| Topology Driven → Stroke Aggregator | 0.000848199778954066 | distance: 0.00085variant: vectorized (all layers) 1000px | 1046.0 |
| Topology Driven | 0.00027587125360550526 | distance: 0.00028variant: original | 640.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3669440319763913 |  distance: 0.36694variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.948475641809168 |  distance: 0.94848variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4767271005744637 |  distance: 0.47673variant: vectorized (all layers) 500pxalg. parameter: noisy | 25.0 |
| Poly Vector | 0.5130766116523462 |  distance: 0.51308variant: vectorized (all layers) 500px | 119.0 |
| Real-Time Inking | 0.9361196304051942 |  distance: 0.93612variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | 0.9513825210029176 | distance: 0.95138variant: vectorized (shape strokes) | 1220.0 |
| Topology Driven → Stroke Aggregator | 0.7612118312688793 |  distance: 0.76121variant: vectorized (all layers) 500px | 282.0 |
| Topology Driven | 0.9163898932496888 |  distance: 0.91639variant: vectorized (shape strokes) 500px | 6.0 |
| Fidelity Simplicity | 0.4619853114964536 |  distance: 0.46199variant: thresholded 500pxalg. parameter: 0.75 | 109.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5823789545299921 | distance: 0.58238variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.5765513068609757 | distance: 0.57655variant: vectorized (all layers) 500pxalg. parameter: noisy | 25.0 |
| Poly Vector | 0.6072961012300391 |  distance: 0.6073variant: vectorized (all layers) 500pxalg. parameter: noisy | 116.0 |
| Stroke Aggregator | 0.9833823976179944 | distance: 0.98338variant: vectorized (shape strokes) | 1220.0 |
| Topology Driven → Stroke Aggregator | 0.8865080061927837 | distance: 0.88651variant: vectorized (all layers) 500px | 282.0 |
| Topology Driven | 0.96159897976332 |  distance: 0.9616variant: vectorized (all layers) 500px | 6.0 |
| Mastering Sketching | 0.9856604801170029 | distance: 0.98566variant: vectorized (shape strokes) 500px | 5.0 |
| Fidelity Simplicity | 0.6119141572414685 | distance: 0.61191variant: thresholded 500pxalg. parameter: 0.75 | 109.0 |
| Real-Time Inking | 0.9695541348826592 |  distance: 0.96955variant: thresholded | 4.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.6563474182903494 | distance: 0.65635variant: vectorized (all layers) 500pxalg. parameter: noisy | 25.0 |
| Poly Vector | 0.6881278097247115 | distance: 0.68813variant: vectorized (all layers) 500px | 119.0 |
| Mastering Sketching | 0.9945845394794136 |  distance: 0.99458variant: thresholded 500px | 5.0 |
| Stroke Aggregator | 0.9912391528473804 | distance: 0.99124variant: vectorized (shape strokes) | 1220.0 |
| Topology Driven | 0.9824792691838564 | distance: 0.98248variant: vectorized (all layers) 500px | 6.0 |
| Delaunay Triangulation | 0.7199707991277805 |  distance: 0.71997variant: vectorized (shape strokes) 500px | 2.0 |
| Fidelity Simplicity | 0.6987590275658631 |  distance: 0.69876variant: vectorized (shape strokes) 1000pxalg. parameter: 0.75 | 125.0 |
| Real-Time Inking | 0.9770799785744396 | distance: 0.97708variant: thresholded | 4.0 |
| Topology Driven → Stroke Aggregator | 0.9489992993448072 | distance: 0.949variant: vectorized (all layers) 500px | 282.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.7034792891504652 | distance: 0.70348variant: vectorized (all layers) 500pxalg. parameter: noisy | 25.0 |
| Poly Vector | 0.7362312414345314 | distance: 0.73623variant: vectorized (all layers) 500pxalg. parameter: noisy | 116.0 |
| Mastering Sketching | 0.9967045857144512 | distance: 0.9967variant: thresholded 500px | 5.0 |
| Stroke Aggregator | 0.9941875281278588 | distance: 0.99419variant: vectorized (shape strokes) | 1220.0 |
| Topology Driven | 0.9887703860322596 | distance: 0.98877variant: vectorized (all layers) 500px | 6.0 |
| Delaunay Triangulation | 0.7761172053301921 | distance: 0.77612variant: vectorized (shape strokes) 500px | 2.0 |
| Fidelity Simplicity | 0.7324746098588061 | distance: 0.73247variant: vectorized (shape strokes) 1000pxalg. parameter: 0.75 | 125.0 |
| Real-Time Inking | 0.9826835622347181 | distance: 0.98268variant: thresholded | 4.0 |
| Topology Driven → Stroke Aggregator | 0.9721233189562191 | distance: 0.97212variant: vectorized (all layers) 500px | 282.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8308540744503302 | distance: 0.83085variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.7512293526077466 | distance: 0.75123variant: vectorized (all layers) 500pxalg. parameter: noisy | 25.0 |
| Poly Vector | 0.7821506092697459 | distance: 0.78215variant: vectorized (all layers) 500pxalg. parameter: noisy | 116.0 |
| Fidelity Simplicity | 0.7612868866348738 |  distance: 0.76129variant: vectorized (shape strokes) 1000pxalg. parameter: 0.5 | 112.0 |
| Mastering Sketching | 0.9976365876725259 | distance: 0.99764variant: thresholded 500px | 5.0 |
| Real-Time Inking | 0.9866216124166516 | distance: 0.98662variant: thresholded | 4.0 |
| Stroke Aggregator | 0.9950909367127642 | distance: 0.99509variant: vectorized (shape strokes) | 1220.0 |
| Topology Driven → Stroke Aggregator | 0.9820548307510114 | distance: 0.98205variant: vectorized (all layers) 500px | 282.0 |
| Topology Driven | 0.990853590807054 |  distance: 0.99085variant: vectorized (all layers) 1000px | 20.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0608276252746582 | distance: 0.06083variant: vectorized (shape strokes) 500px | 2.0 |
| Fidelity Simplicity | 0.08318653869628906 |  distance: 0.08319variant: thresholded 500pxalg. parameter: 0.3 | 85.0 |
| Mastering Sketching | 0.3006725769042969 | distance: 0.30067variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.04716990661621094 |  distance: 0.04717variant: vectorized (shape strokes) 1000px | 311.0 |
| Topology Driven → Stroke Aggregator | 0.05916925048828125 | distance: 0.05917variant: vectorized (all layers) 1000px | 1046.0 |
| Poly Vector | 0.0162788200378418 |  distance: 0.01628variant: thresholded 1000pxalg. parameter: noisy | 365.0 |
| Real-Time Inking | 0.012806248664855958 |  distance: 0.01281variant: thresholded 500px | 2.0 |
| Topology Driven | 0.015386184692382813 |  distance: 0.01539variant: thresholded | 624.0 |
| Stroke Aggregator | 0.030287061418805807 | distance: 0.03029variant: vectorized (shape strokes) | 1220.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
|
|
||||||||||||
| thresholded | |
|
 |
||||||||||||
| thresholded 1000px |  |
|
 |
 |
 |
 |
 |
|
|
 |
|||||
| thresholded 500px | |
|
|
 |
 |
|
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
|
 |
||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
 |
 |
|
|
|
|
|
||
| vectorized (shape strokes) 1000px | |
 |
 |
|
|
 |
 |
 |
 |
 |
 |
|
|||
| vectorized (shape strokes) 500px |  |
|
|
 |
 |
 |
 |
 |
|
 |
 |
|
|||
| vectorized (shape strokes) | |