A Benchmark for Rough Sketch Cleanup
Art_freeform_PB_02
Author: Cartoon Animation by Preston Blair (1994). Mission Viejo, CA: Walter Foster Publishing (aka Preston Blair) Licence: Explicit permissionMessiness: 0.5678
Ambiguity (Chamfer): 0.06581
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Real-Time Inking | Poly Vector | Poly Vector → Stroke Aggregator | Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00177 |  distance: 0.00198 |  distance: 0.00205 |  distance: 0.00205 |  distance: 0.00222 |  distance: 0.00249 |  distance: 0.00286 |  distance: 0.00303 |  distance: 0.0048 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.0017746293332555406 | distance: 0.00177variant: vectorized (shape strokes) 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.0022188805007692675 | distance: 0.00222variant: vectorized (shape strokes) 1000px | 1085.0 |
| Poly Vector | 0.002050947324107312 | distance: 0.00205variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 484.0 |
| Real-Time Inking | 0.002047829781864062 | distance: 0.00205variant: vectorized (shape strokes) 1000px | 3.0 |
| Stroke Aggregator | 0.002487616980028712 | distance: 0.00249variant: vectorized (shape strokes) | 459.0 |
| Topology Driven → Stroke Aggregator | 0.002855477532132579 | distance: 0.00286variant: vectorized (shape strokes) 500px | 562.0 |
| Topology Driven | 0.0019816116395543685 | distance: 0.00198variant: vectorized (shape strokes) 1000px | 50.0 |
| Fidelity Simplicity | 0.004799912607051194 | distance: 0.0048variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 218.0 |
| Delaunay Triangulation | 0.003031923363570673 | distance: 0.00303variant: vectorized (shape strokes) 1000px | 11.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.21002699775461345 |  distance: 0.21003variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.23479110624060265 |  distance: 0.23479variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 202.0 |
| Topology Driven → Stroke Aggregator | 0.6082389738028902 | distance: 0.60824variant: vectorized (shape strokes) 500px | 562.0 |
| Real-Time Inking | 0.4758324972160522 |  distance: 0.47583variant: original | 5.0 |
| Stroke Aggregator | 0.5700574068959768 | distance: 0.57006variant: vectorized (shape strokes) | 459.0 |
| Topology Driven | 0.427633947250087 |  distance: 0.42763variant: vectorized (all layers) 1000px | 594.0 |
| Mastering Sketching | 0.4546691916051221 |  distance: 0.45467variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4830934144982494 |  distance: 0.48309variant: vectorized (all layers) 500px | 121.0 |
| Poly Vector | 0.5009607650318877 |  distance: 0.50096variant: vectorized (all layers) 500px | 476.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3310713163682061 | distance: 0.33107variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.3313822001019368 |  distance: 0.33138variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 169.0 |
| Real-Time Inking | 0.5979065344177507 | distance: 0.59791variant: original | 5.0 |
| Stroke Aggregator | 0.7838587963276087 | distance: 0.78386variant: vectorized (shape strokes) | 459.0 |
| Topology Driven → Stroke Aggregator | 0.7895347791077163 | distance: 0.78953variant: vectorized (shape strokes) 500px | 562.0 |
| Topology Driven | 0.5644100447958447 |  distance: 0.56441variant: vectorized (all layers) 500px | 61.0 |
| Mastering Sketching | 0.5777336297485101 | distance: 0.57773variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.621198874221853 |  distance: 0.6212variant: vectorized (all layers) 500pxalg. parameter: noisy | 121.0 |
| Poly Vector | 0.6317464725417279 | distance: 0.63175variant: vectorized (all layers) 500px | 476.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4610038018932918 | distance: 0.461variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.4090252309160537 | distance: 0.40903variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 169.0 |
| Real-Time Inking | 0.6495724882175496 | distance: 0.64957variant: original | 5.0 |
| Stroke Aggregator | 0.8924381209329189 | distance: 0.89244variant: vectorized (shape strokes) | 459.0 |
| Topology Driven → Stroke Aggregator | 0.8878855089262229 | distance: 0.88789variant: vectorized (shape strokes) 500px | 562.0 |
| Topology Driven | 0.6514987549989435 | distance: 0.6515variant: vectorized (all layers) 500px | 61.0 |
| Mastering Sketching | 0.6551628188044408 | distance: 0.65516variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7019985709043075 | distance: 0.702variant: vectorized (all layers) 500pxalg. parameter: noisy | 121.0 |
| Poly Vector | 0.7162051996238142 |  distance: 0.71621variant: vectorized (all layers) 500pxalg. parameter: noisy | 536.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5368098855777067 | distance: 0.53681variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.4563824334742038 |  distance: 0.45638variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 173.0 |
| Real-Time Inking | 0.687089121907137 | distance: 0.68709variant: original | 5.0 |
| Stroke Aggregator | 0.9357571543145594 | distance: 0.93576variant: vectorized (shape strokes) | 459.0 |
| Topology Driven → Stroke Aggregator | 0.9285295673214532 | distance: 0.92853variant: vectorized (shape strokes) 500px | 562.0 |
| Topology Driven | 0.7039547641112189 | distance: 0.70395variant: vectorized (all layers) 500px | 61.0 |
| Mastering Sketching | 0.6990875645422859 | distance: 0.69909variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7450316164990278 | distance: 0.74503variant: vectorized (all layers) 500px | 121.0 |
| Poly Vector | 0.7582544028418456 | distance: 0.75825variant: vectorized (all layers) 500px | 476.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.7202723951351968 | distance: 0.72027variant: original | 5.0 |
| Delaunay Triangulation | 0.6010538840727521 | distance: 0.60105variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.5071951577638207 | distance: 0.5072variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 202.0 |
| Mastering Sketching | 0.745832214737094 | distance: 0.74583variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7918642088014549 | distance: 0.79186variant: vectorized (all layers) 500px | 121.0 |
| Poly Vector | 0.8032836702462325 | distance: 0.80328variant: vectorized (all layers) 500pxalg. parameter: noisy | 536.0 |
| Stroke Aggregator | 0.9589374108174052 | distance: 0.95894variant: vectorized (shape strokes) | 459.0 |
| Topology Driven → Stroke Aggregator | 0.9536609630686878 | distance: 0.95366variant: vectorized (shape strokes) 500px | 562.0 |
| Topology Driven | 0.7563560719797591 | distance: 0.75636variant: vectorized (all layers) 500px | 61.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.043266616821289065 | distance: 0.04327variant: vectorized (shape strokes) 1000px | 11.0 |
| Mastering Sketching | 0.2489658660888672 |  distance: 0.24897variant: thresholded 500px | 5.0 |
| Fidelity Simplicity | 0.07413036843153664 |  distance: 0.07413variant: originalalg. parameter: 0.6 | 1728.0 |
| Poly Vector → Stroke Aggregator | 0.03590264511108398 | distance: 0.0359variant: vectorized (shape strokes) 1000px | 1085.0 |
| Poly Vector | 0.035693138122558594 |  distance: 0.03569variant: vectorized (shape strokes) 1000px | 431.0 |
| Real-Time Inking | 0.028844409942626957 |  distance: 0.02884variant: vectorized (shape strokes) 500px | 4.0 |
| Stroke Aggregator | 0.036241180243745987 | distance: 0.03624variant: vectorized (shape strokes) | 459.0 |
| Topology Driven → Stroke Aggregator | 0.029120439529418944 | distance: 0.02912variant: vectorized (shape strokes) 500px | 562.0 |
| Topology Driven | 0.033526107788085936 |  distance: 0.03353variant: vectorized (shape strokes) 500px | 12.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
|
 |
|||||||||
| thresholded |  |
 |
|||||||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 500px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| vectorized (all layers) 500px |  |
|
 |
|
|
|
 |
|
|
|
|
|
|
||
| vectorized (shape strokes) 1000px | |
 |
|
 |
 |
 |
|
|
|
|
|
||||
| vectorized (shape strokes) 500px | |
|
|
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
|
| vectorized (shape strokes) | |