A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_10
Author: Cristina Arciniega Licence: Academic PaperMessiness: 0.20017
Ambiguity (Chamfer): 0.04208
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Stroke Aggregator | Real-Time Inking | Poly Vector → Stroke Aggregator | Poly Vector | Topology Driven | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00061 |  distance: 0.00064 |  distance: 0.00072 |  distance: 0.00091 |  distance: 0.00095 |  distance: 0.001 |  distance: 0.0011 |  distance: 0.00263 |  distance: 0.02867 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.002633068245304405 | distance: 0.00263variant: original | 28.0 |
| Fidelity Simplicity | 0.028668272603319955 | distance: 0.02867variant: originalalg. parameter: 0.75 | 243.0 |
| Mastering Sketching | 0.0006052425315663846 | distance: 0.00061variant: original 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0009148037610535653 | distance: 0.00091variant: original 1000pxalg. parameter: noisy | 108.0 |
| Poly Vector | 0.0009511993553693248 | distance: 0.00095variant: originalalg. parameter: noisy | 496.0 |
| Real-Time Inking | 0.000717560902799432 | distance: 0.00072variant: original | 3.0 |
| Stroke Aggregator | 0.0006366810901328303 | distance: 0.00064variant: vectorized (all layers) | 1174.0 |
| Topology Driven → Stroke Aggregator | 0.0011004921394254053 | distance: 0.0011variant: original 1000px | 674.0 |
| Topology Driven | 0.0009990421669101518 | distance: 0.001variant: original | 75.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.3464098763813683 |  distance: 0.34641variant: original 500pxalg. parameter: 0.6 | 1700.0 |
| Mastering Sketching | 0.9009054513244262 |  distance: 0.90091variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8079604642518973 | distance: 0.80796variant: original 1000pxalg. parameter: noisy | 108.0 |
| Poly Vector | 0.7834143253635569 |  distance: 0.78341variant: original | 412.0 |
| Real-Time Inking | 0.8358087005728146 | distance: 0.83581variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.7767108747955319 | distance: 0.77671variant: original 1000px | 674.0 |
| Topology Driven | 0.7730408762957208 | distance: 0.77304variant: original | 75.0 |
| Delaunay Triangulation | 0.4941834590629907 |  distance: 0.49418variant: original 500px | 1.0 |
| Stroke Aggregator | 0.8592618848318894 | distance: 0.85926variant: vectorized (all layers) | 1174.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.9327377796245644 |  distance: 0.93274variant: original 1000pxalg. parameter: noisy | 150.0 |
| Real-Time Inking | 0.9808009230263124 |  distance: 0.9808variant: original 1000px | 3.0 |
| Stroke Aggregator | 0.982167173441534 | distance: 0.98217variant: vectorized (all layers) | 1174.0 |
| Topology Driven | 0.9219838389342566 |  distance: 0.92198variant: original 1000px | 20.0 |
| Delaunay Triangulation | 0.7204672127636284 | distance: 0.72047variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.3930423091722343 | distance: 0.39304variant: original 500pxalg. parameter: 0.6 | 1700.0 |
| Mastering Sketching | 0.9864971605560876 | distance: 0.9865variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9541799715859224 |  distance: 0.95418variant: original 500pxalg. parameter: noisy | 23.0 |
| Topology Driven → Stroke Aggregator | 0.9402085635393056 |  distance: 0.94021variant: original 500px | 78.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4132784354091611 |  distance: 0.41328variant: original 500pxalg. parameter: 0.25 | 1626.0 |
| Mastering Sketching | 0.9983806523671828 | distance: 0.99838variant: original 500px | 6.0 |
| Poly Vector | 0.9756232468096876 |  distance: 0.97562variant: original 1000px | 142.0 |
| Real-Time Inking | 0.9952850717667501 |  distance: 0.99529variant: original 500px | 4.0 |
| Stroke Aggregator | 0.9955537726072275 | distance: 0.99555variant: vectorized (all layers) | 1174.0 |
| Topology Driven | 0.9736190223351788 | distance: 0.97362variant: original 1000px | 20.0 |
| Delaunay Triangulation | 0.8459921396581667 | distance: 0.84599variant: original 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.9770050045565394 | distance: 0.97701variant: original 500pxalg. parameter: noisy | 23.0 |
| Topology Driven → Stroke Aggregator | 0.982688215603831 | distance: 0.98269variant: original 500px | 78.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4222108495394064 | distance: 0.42221variant: original 500pxalg. parameter: 0.25 | 1626.0 |
| Mastering Sketching | 0.999616828875776 | distance: 0.99962variant: original 500px | 6.0 |
| Stroke Aggregator | 0.9985000499983332 | distance: 0.9985variant: vectorized (all layers) | 1174.0 |
| Topology Driven → Stroke Aggregator | 0.9929359819928472 | distance: 0.99294variant: original 500px | 78.0 |
| Topology Driven | 0.9916743048521408 | distance: 0.99167variant: original | 75.0 |
| Delaunay Triangulation | 0.8768922200497902 | distance: 0.87689variant: original 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.9825761276665038 | distance: 0.98258variant: original 500pxalg. parameter: noisy | 23.0 |
| Poly Vector | 0.9837198505280608 |  distance: 0.98372variant: original 500pxalg. parameter: noisy | 62.0 |
| Real-Time Inking | 0.9980220917485626 | distance: 0.99802variant: original 500px | 4.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4294447274579725 | distance: 0.42944variant: original 500pxalg. parameter: 0.6 | 1700.0 |
| Topology Driven → Stroke Aggregator | 0.9982381952581716 | distance: 0.99824variant: original 500px | 78.0 |
| Topology Driven | 0.9973449530154288 | distance: 0.99734variant: original | 75.0 |
| Delaunay Triangulation | 0.8984706755318344 | distance: 0.89847variant: original 500px | 1.0 |
| Mastering Sketching | 0.999923389259174 | distance: 0.99992variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9883419689119172 | distance: 0.98834variant: original 500pxalg. parameter: noisy | 23.0 |
| Poly Vector | 0.9885057471264368 | distance: 0.98851variant: original 500pxalg. parameter: noisy | 62.0 |
| Real-Time Inking | 0.9995326789581748 | distance: 0.99953variant: original 500px | 4.0 |
| Stroke Aggregator | 1.0 | distance: 1.0variant: vectorized (all layers) | 1174.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.12101652526855468 |  distance: 0.12102variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.012369317054748537 |  distance: 0.01237variant: original 1000px | 108.0 |
| Topology Driven → Stroke Aggregator | 0.0089442720413208 | distance: 0.00894variant: original 1000px | 674.0 |
| Real-Time Inking | 0.008565417029206317 | distance: 0.00857variant: original | 3.0 |
| Fidelity Simplicity | 0.28913965822760024 |  distance: 0.28914variant: originalalg. parameter: 0.25 | 194.0 |
| Mastering Sketching | 0.087132080078125 | distance: 0.08713variant: original 500px | 6.0 |
| Poly Vector | 0.009201784062206295 | distance: 0.0092variant: original | 412.0 |
| Stroke Aggregator | 0.007088789784519893 | distance: 0.00709variant: vectorized (all layers) | 1174.0 |
| Topology Driven | 0.009848857879638672 | distance: 0.00985variant: original 1000px | 20.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
|
 |
|
|
|
|
|||||
| original 1000px | |
|
|
 |
 |
 |
 |
 |
|
|
|
|
|
|
|
| original 500px | |
|
|
|
|
 |
|
 |
|
|
|||||
| vectorized (all layers) | |