A Benchmark for Rough Sketch Cleanup
Art_freeform_PB_11
Author: Cartoon Animation by Preston Blair (1994). Mission Viejo, CA: Walter Foster Publishing (aka Preston Blair) Licence: Explicit permissionMessiness: 0.05922
Ambiguity (Chamfer): 0.10075
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Real-Time Inking | Mastering Sketching | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Poly Vector → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0009 |  distance: 0.00096 |  distance: 0.00104 |  distance: 0.00104 |  distance: 0.00271 |  distance: 0.00422 |  distance: 0.00513 |  distance: 0.00687 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.0042209976446237725 | distance: 0.00422variant: vectorized (all layers) 1000px | 41.0 |
| Mastering Sketching | 0.0010415328903607454 | distance: 0.00104variant: thresholded 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.005128241791992198 | distance: 0.00513variant: vectorized (all layers) 500pxalg. parameter: noisy | 82.0 |
| Poly Vector | 0.0009585089752321843 | distance: 0.00096variant: vectorized (all layers) 1000pxalg. parameter: noisy | 1684.0 |
| Real-Time Inking | 0.001036231009409824 | distance: 0.00104variant: original | 7.0 |
| Topology Driven | 0.0009019541606453857 | distance: 0.0009variant: thresholded 1000px | 261.0 |
| Fidelity Simplicity | 0.0068714556895763355 | distance: 0.00687variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 1726.0 |
| Topology Driven → Stroke Aggregator | 0.002705946542474029 | distance: 0.00271variant: vectorized (shape strokes) 500px | 1030.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.3093577388879153 |  distance: 0.30936variant: thresholded 500pxalg. parameter: 0.75 | 161.0 |
| Poly Vector → Stroke Aggregator | 0.41157982767446505 |  distance: 0.41158variant: vectorized (shape strokes) 500px | 56.0 |
| Poly Vector | 0.4377240938058256 |  distance: 0.43772variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 171.0 |
| Real-Time Inking | 0.7432861720144369 |  distance: 0.74329variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6106568142347327 | distance: 0.61066variant: vectorized (shape strokes) 500px | 1030.0 |
| Delaunay Triangulation | 0.2920082530543602 |  distance: 0.29201variant: thresholded 500px | 15.0 |
| Mastering Sketching | 0.8091552835387388 |  distance: 0.80916variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven | 0.7898533743726563 |  distance: 0.78985variant: vectorized (all layers) 500px | 31.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4416963013287331 | distance: 0.4417variant: thresholded 500pxalg. parameter: 0.75 | 161.0 |
| Poly Vector → Stroke Aggregator | 0.5150320591512886 |  distance: 0.51503variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 59.0 |
| Poly Vector | 0.5399047829929657 |  distance: 0.5399variant: vectorized (shape strokes) 500px | 155.0 |
| Real-Time Inking | 0.8637038153750101 | distance: 0.8637variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7630542767271503 | distance: 0.76305variant: vectorized (shape strokes) 500px | 1030.0 |
| Topology Driven | 0.874752766378034 |  distance: 0.87475variant: vectorized (shape strokes) 500px | 16.0 |
| Delaunay Triangulation | 0.4567151497931909 | distance: 0.45672variant: thresholded 500px | 15.0 |
| Mastering Sketching | 0.8929767033607586 | distance: 0.89298variant: vectorized (all layers) 500px | 5.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.550100816800448 | distance: 0.5501variant: thresholded 500pxalg. parameter: 0.75 | 161.0 |
| Poly Vector → Stroke Aggregator | 0.6089443851608038 | distance: 0.60894variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 59.0 |
| Poly Vector | 0.6351730207531725 | distance: 0.63517variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 171.0 |
| Real-Time Inking | 0.911991590590384 | distance: 0.91199variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8585648997132856 | distance: 0.85856variant: vectorized (shape strokes) 500px | 1030.0 |
| Topology Driven | 0.919161821529014 | distance: 0.91916variant: vectorized (shape strokes) 500px | 16.0 |
| Delaunay Triangulation | 0.6072862230895394 | distance: 0.60729variant: thresholded 500px | 15.0 |
| Mastering Sketching | 0.9251694520327841 | distance: 0.92517variant: vectorized (all layers) 500px | 5.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6171859146624071 | distance: 0.61719variant: thresholded 500pxalg. parameter: 0.75 | 161.0 |
| Poly Vector → Stroke Aggregator | 0.6773019009856575 | distance: 0.6773variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 59.0 |
| Poly Vector | 0.7030158512332438 | distance: 0.70302variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 171.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9047422210195988 | distance: 0.90474variant: vectorized (shape strokes) 500px | 1030.0 |
| Topology Driven | 0.9383603982998924 | distance: 0.93836variant: vectorized (shape strokes) 500px | 16.0 |
| Delaunay Triangulation | 0.6942381329730543 | distance: 0.69424variant: thresholded 500px | 15.0 |
| Mastering Sketching | 0.9399883806867646 | distance: 0.93999variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.9382195289941976 |  distance: 0.93822variant: vectorized (all layers) 500px | 3.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6774536407704022 | distance: 0.67745variant: thresholded 500pxalg. parameter: 0.75 | 161.0 |
| Poly Vector → Stroke Aggregator | 0.7456381385113289 | distance: 0.74564variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 59.0 |
| Poly Vector | 0.7727609817066181 | distance: 0.77276variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 171.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9325793214941224 | distance: 0.93258variant: vectorized (shape strokes) 500px | 1030.0 |
| Topology Driven | 0.9517256012721416 | distance: 0.95173variant: vectorized (shape strokes) 500px | 16.0 |
| Delaunay Triangulation | 0.779670905404877 | distance: 0.77967variant: thresholded 500px | 15.0 |
| Mastering Sketching | 0.9517848153903394 | distance: 0.95178variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.9515523075229604 | distance: 0.95155variant: vectorized (all layers) 500px | 3.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.14153445434570314 |  distance: 0.14153variant: thresholded 1000pxalg. parameter: 0.75 | 224.0 |
| Mastering Sketching | 0.09620810699462892 | distance: 0.09621variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.04898120464759416 | distance: 0.04898variant: original | 7.0 |
| Topology Driven | 0.04833218383789063 |  distance: 0.04833variant: thresholded 500px | 50.0 |
| Delaunay Triangulation | 0.042047592163085935 |  distance: 0.04205variant: vectorized (shape strokes) 1000px | 32.0 |
| Poly Vector → Stroke Aggregator | 0.07789736938476563 | distance: 0.0779variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 59.0 |
| Poly Vector | 0.05110773086547851 |  distance: 0.05111variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 677.0 |
| Topology Driven → Stroke Aggregator | 0.06403124237060548 | distance: 0.06403variant: vectorized (shape strokes) 500px | 1030.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
||||||||||||||
| thresholded | |
||||||||||||||
| thresholded 1000px |  |
 |
 |
 |
|
 |
|
 |
|||||||
| thresholded 500px |  |
|
 |
 |
 |
|
 |
|
 |
 |
|
||||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
|
 |
|
||||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
|
|||
| vectorized (shape strokes) 1000px |  |
 |
|
 |
 |
 |
|
 |
|
||||||
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
 |
 |
|
|
|
 |
|
|