A Benchmark for Rough Sketch Cleanup
Art_freeform_AG_03
Author: Anton Gulic Author Homepage: https://www.upwork.com/freelancers/~0168eeeb4816b24940 Licence: CC-BY-4.0Messiness: 0.28479
Ambiguity (Chamfer): 0.00201
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Topology Driven | Poly Vector | Stroke Aggregator | Poly Vector → Stroke Aggregator | Mastering Sketching | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00044 |  distance: 0.00045 |  distance: 0.0005 |  distance: 0.00074 |  distance: 0.00086 |  distance: 0.00097 |  distance: 0.0013 |  distance: 0.00137 |  distance: 0.00552 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Liliya Larsen |  | |  |  | |||
| Maria Hegedus |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0013652853209629688 | distance: 0.00137variant: original | 33.0 |
| Fidelity Simplicity | 0.005522855017418755 | distance: 0.00552variant: thresholdedalg. parameter: 0.6 | 357.0 |
| Mastering Sketching | 0.0009732548250783847 | distance: 0.00097variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.00085559215493813 | distance: 0.00086variant: vectorized (shape strokes) 1000px | 419.0 |
| Poly Vector | 0.0004973938788506403 | distance: 0.0005variant: thresholded 1000pxalg. parameter: noisy | 298.0 |
| Real-Time Inking | 0.0004448088094760712 | distance: 0.00044variant: original | 3.0 |
| Stroke Aggregator | 0.0007402076617423324 | distance: 0.00074variant: vectorized (shape strokes) | 974.0 |
| Topology Driven → Stroke Aggregator | 0.0013020827265222887 | distance: 0.0013variant: vectorized (shape strokes) 500px | 668.0 |
| Topology Driven | 0.0004490722598052872 | distance: 0.00045variant: original | 130.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3859049463130231 |  distance: 0.3859variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.2664340120313852 |  distance: 0.26643variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 171.0 |
| Poly Vector → Stroke Aggregator | 0.5737319832158608 |  distance: 0.57373variant: vectorized (all layers) 500px | 297.0 |
| Topology Driven → Stroke Aggregator | 0.8175794715979279 |  distance: 0.81758variant: thresholded 500px | 148.0 |
| Mastering Sketching | 0.6559637216721161 |  distance: 0.65596variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector | 0.5974822036492832 |  distance: 0.59748variant: vectorized (all layers) 500px | 249.0 |
| Real-Time Inking | 0.7222262848702891 |  distance: 0.72223variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9304068697896954 | distance: 0.93041variant: vectorized (shape strokes) | 974.0 |
| Topology Driven | 0.6214261081264187 |  distance: 0.62143variant: vectorized (all layers) 1000px | 106.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.556997762550555 | distance: 0.557variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.3970351168778671 |  distance: 0.39704variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 153.0 |
| Topology Driven → Stroke Aggregator | 0.9191113535242018 | distance: 0.91911variant: thresholded 500px | 148.0 |
| Mastering Sketching | 0.7543700915638232 | distance: 0.75437variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6889409637595748 | distance: 0.68894variant: vectorized (all layers) 500px | 297.0 |
| Poly Vector | 0.7040239236226046 | distance: 0.70402variant: vectorized (all layers) 500px | 249.0 |
| Real-Time Inking | 0.7999139895692639 | distance: 0.79991variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.961362378734547 | distance: 0.96136variant: vectorized (shape strokes) | 974.0 |
| Topology Driven | 0.7387793792133929 | distance: 0.73878variant: vectorized (all layers) 1000px | 106.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6522058637747921 | distance: 0.65221variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.5097024884438597 | distance: 0.5097variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 153.0 |
| Topology Driven → Stroke Aggregator | 0.9601305055661636 | distance: 0.96013variant: thresholded 500px | 148.0 |
| Mastering Sketching | 0.8239327532006014 | distance: 0.82393variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7666875143953323 | distance: 0.76669variant: vectorized (all layers) 500px | 297.0 |
| Poly Vector | 0.7762212069530897 | distance: 0.77622variant: vectorized (all layers) 500px | 249.0 |
| Real-Time Inking | 0.844887357726118 | distance: 0.84489variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.971792194411088 | distance: 0.97179variant: vectorized (shape strokes) | 974.0 |
| Topology Driven | 0.8151012058353849 |  distance: 0.8151variant: vectorized (all layers) 500px | 27.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5897507277026893 | distance: 0.58975variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 171.0 |
| Delaunay Triangulation | 0.7363017481588991 | distance: 0.7363variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9781585272193828 | distance: 0.97816variant: vectorized (shape strokes) 500px | 668.0 |
| Mastering Sketching | 0.871183216538575 | distance: 0.87118variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8197222617466017 | distance: 0.81972variant: vectorized (all layers) 500px | 297.0 |
| Poly Vector | 0.8237941011059264 |  distance: 0.82379variant: vectorized (all layers) 500pxalg. parameter: noisy | 248.0 |
| Real-Time Inking | 0.8783793797843753 | distance: 0.87838variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9761807390050071 | distance: 0.97618variant: vectorized (shape strokes) | 974.0 |
| Topology Driven | 0.865336520975447 | distance: 0.86534variant: vectorized (all layers) 500px | 27.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8126591829489646 | distance: 0.81266variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.6678312898908356 |  distance: 0.66783variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 151.0 |
| Mastering Sketching | 0.9098223052801624 | distance: 0.90982variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8652315621430539 | distance: 0.86523variant: vectorized (all layers) 500px | 297.0 |
| Poly Vector | 0.8697549507768939 | distance: 0.86975variant: vectorized (all layers) 500px | 249.0 |
| Real-Time Inking | 0.9073721627460356 | distance: 0.90737variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9795475452096748 | distance: 0.97955variant: vectorized (shape strokes) | 974.0 |
| Topology Driven → Stroke Aggregator | 0.9831620380494206 | distance: 0.98316variant: vectorized (shape strokes) 500px | 668.0 |
| Topology Driven | 0.9035377090205892 | distance: 0.90354variant: vectorized (all layers) 500px | 27.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.2729468688964844 |  distance: 0.27295variant: vectorized (shape strokes) 500px | 5.0 |
| Delaunay Triangulation | 0.03862641525268555 |  distance: 0.03863variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.16576422119140624 | distance: 0.16576variant: thresholdedalg. parameter: 0.6 | 357.0 |
| Poly Vector → Stroke Aggregator | 0.040024993896484375 |  distance: 0.04002variant: vectorized (all layers) 1000px | 988.0 |
| Poly Vector | 0.02039607810974121 |  distance: 0.0204variant: thresholded 500px | 99.0 |
| Real-Time Inking | 0.016292466481526692 | distance: 0.01629variant: original | 3.0 |
| Stroke Aggregator | 0.04166666666666666 | distance: 0.04167variant: vectorized (shape strokes) | 974.0 |
| Topology Driven → Stroke Aggregator | 0.018000000000000002 | distance: 0.018variant: thresholded 500px | 148.0 |
| Topology Driven | 0.01720465087890625 |  distance: 0.0172variant: thresholded 500px | 6.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
|
|
|||||||||
| thresholded |  |
|
 |
 |
|||||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
|
 |
 |
|||||||
| thresholded 500px | |
 |
|
 |
 |
 |
 |
 |
|
 |
|
 |
|||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
|
||
| vectorized (all layers) 500px | |
 |
 |
 |
|
|
|
|
|
|
|
|
|||
| vectorized (shape strokes) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
|||
| vectorized (shape strokes) | |