A Benchmark for Rough Sketch Cleanup
Art_freeform_PB_01
Author: Cartoon Animation by Preston Blair (1994). Mission Viejo, CA: Walter Foster Publishing (aka Preston Blair) Licence: Explicit permissionMessiness: 0.22137
Ambiguity (Chamfer): 0.08479
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector | Topology Driven | Real-Time Inking | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00141 |  distance: 0.00151 |  distance: 0.00152 |  distance: 0.00154 |  distance: 0.00156 |  distance: 0.00164 |  distance: 0.00164 |  distance: 0.00249 |  distance: 0.00405 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.002486563185337561 | distance: 0.00249variant: vectorized (shape strokes) 1000px | 3.0 |
| Fidelity Simplicity | 0.004053771136347526 | distance: 0.00405variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 239.0 |
| Mastering Sketching | 0.0014052433454473253 | distance: 0.00141variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0015636697608114095 | distance: 0.00156variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 98.0 |
| Poly Vector | 0.0015055442847376312 | distance: 0.00151variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 140.0 |
| Real-Time Inking | 0.001539177157266574 | distance: 0.00154variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.0016434142279266831 | distance: 0.00164variant: vectorized (shape strokes) | 257.0 |
| Topology Driven → Stroke Aggregator | 0.0016380058278275705 | distance: 0.00164variant: vectorized (shape strokes) 1000px | 234.0 |
| Topology Driven | 0.0015206560545612798 | distance: 0.00152variant: vectorized (shape strokes) 1000px | 9.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.3031386001764848 |  distance: 0.30314variant: thresholded 500pxalg. parameter: 0.75 | 182.0 |
| Mastering Sketching | 0.4522443710870592 |  distance: 0.45224variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6921098298349879 | distance: 0.69211variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 98.0 |
| Poly Vector | 0.19418524638379392 |  distance: 0.19419variant: vectorized (shape strokes) 500px | 50.0 |
| Real-Time Inking | 0.4909925005080775 |  distance: 0.49099variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | 0.6910734326988276 | distance: 0.69107variant: vectorized (shape strokes) | 257.0 |
| Topology Driven → Stroke Aggregator | 0.3675180357584403 |  distance: 0.36752variant: vectorized (all layers) 500px | 1025.0 |
| Topology Driven | 0.26454800517271826 |  distance: 0.26455variant: thresholded 1000px | 1406.0 |
| Delaunay Triangulation | 0.2604478939720659 |  distance: 0.26045variant: vectorized (all layers) 500px | 3.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4221712519572759 | distance: 0.42217variant: thresholded 500pxalg. parameter: 0.75 | 182.0 |
| Poly Vector → Stroke Aggregator | 0.8648827117314759 | distance: 0.86488variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 98.0 |
| Poly Vector | 0.2717796497735977 | distance: 0.27178variant: vectorized (shape strokes) 500px | 50.0 |
| Stroke Aggregator | 0.8616377451541958 | distance: 0.86164variant: vectorized (shape strokes) | 257.0 |
| Topology Driven → Stroke Aggregator | 0.5292563197710991 | distance: 0.52926variant: vectorized (all layers) 500px | 1025.0 |
| Delaunay Triangulation | 0.4082107956604065 | distance: 0.40821variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.5675406632001246 | distance: 0.56754variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.6336172861692119 | distance: 0.63362variant: vectorized (all layers) 1000px | 3.0 |
| Topology Driven | 0.3633242252772889 |  distance: 0.36332variant: thresholded 500px | 102.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5088823722433453 | distance: 0.50888variant: thresholded 500pxalg. parameter: 0.75 | 182.0 |
| Poly Vector → Stroke Aggregator | 0.9357246512587658 | distance: 0.93572variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 98.0 |
| Poly Vector | 0.33092409438272125 | distance: 0.33092variant: vectorized (shape strokes) 500px | 50.0 |
| Stroke Aggregator | 0.9256892968797532 | distance: 0.92569variant: vectorized (shape strokes) | 257.0 |
| Delaunay Triangulation | 0.513626849952391 | distance: 0.51363variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.6281996495073124 | distance: 0.6282variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.7070521517197097 | distance: 0.70705variant: vectorized (all layers) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.6176183405740762 | distance: 0.61762variant: vectorized (all layers) 500px | 1025.0 |
| Topology Driven | 0.4297163281733358 | distance: 0.42972variant: thresholded 500px | 102.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5637159307587145 |  distance: 0.56372variant: thresholded 500pxalg. parameter: 0.3 | 168.0 |
| Poly Vector → Stroke Aggregator | 0.9657319313200587 | distance: 0.96573variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 98.0 |
| Delaunay Triangulation | 0.57814606476928 | distance: 0.57815variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.6633353022974279 | distance: 0.66334variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.7483451378808109 | distance: 0.74835variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | 0.9566133609403976 | distance: 0.95661variant: vectorized (shape strokes) | 257.0 |
| Topology Driven → Stroke Aggregator | 0.6700447755972586 | distance: 0.67004variant: vectorized (all layers) 500px | 1025.0 |
| Topology Driven | 0.4774719445492425 | distance: 0.47747variant: thresholded 500px | 102.0 |
| Poly Vector | 0.3781781550698328 |  distance: 0.37818variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 48.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6220583308211902 | distance: 0.62206variant: thresholded 500pxalg. parameter: 0.75 | 182.0 |
| Delaunay Triangulation | 0.6373652488178211 | distance: 0.63737variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.7008118921866107 | distance: 0.70081variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9753595635783144 | distance: 0.97536variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 98.0 |
| Real-Time Inking | 0.7785482134058622 | distance: 0.77855variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | 0.9660596438237188 | distance: 0.96606variant: vectorized (shape strokes) | 257.0 |
| Topology Driven → Stroke Aggregator | 0.7172305118125722 | distance: 0.71723variant: vectorized (all layers) 500px | 1025.0 |
| Topology Driven | 0.5262642574242744 | distance: 0.52626variant: thresholded 500px | 102.0 |
| Poly Vector | 0.4284647465079969 | distance: 0.42846variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 48.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.057801383972167976 | distance: 0.0578variant: vectorized (shape strokes) 1000px | 3.0 |
| Fidelity Simplicity | 0.08280096435546876 |  distance: 0.0828variant: vectorized (shape strokes) 500pxalg. parameter: 0.6 | 180.0 |
| Real-Time Inking | 0.023853721618652343 | distance: 0.02385variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.023804236063668015 | distance: 0.0238variant: vectorized (shape strokes) | 257.0 |
| Topology Driven | 0.023853721618652343 | distance: 0.02385variant: vectorized (shape strokes) 1000px | 9.0 |
| Mastering Sketching | 0.25424397277832034 |  distance: 0.25424variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.023430749893188475 | distance: 0.02343variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 98.0 |
| Poly Vector | 0.023430749893188475 |  distance: 0.02343variant: vectorized (shape strokes) 1000px | 134.0 |
| Topology Driven → Stroke Aggregator | 0.023345235824584958 | distance: 0.02335variant: vectorized (shape strokes) 1000px | 234.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
||||||||||||||
| thresholded |  |
||||||||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded 500px |  |
|
|
 |
 |
|
 |
|
 |
 |
 |
||||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
||||||||||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
|||
| vectorized (shape strokes) 1000px | |
|
 |
 |
 |
 |
|
|
|
|
|
|
|||
| vectorized (shape strokes) 500px |  |
 |
|
 |
 |
 |
 |
|
 |
|
|
 |
|||
| vectorized (shape strokes) | |