A Benchmark for Rough Sketch Cleanup
Art_freeform_PB_09
Author: Cartoon Animation by Preston Blair (1994). Mission Viejo, CA: Walter Foster Publishing (aka Preston Blair) Licence: Explicit permissionMessiness: 0.13536
Ambiguity (Chamfer): 0.05453
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Mastering Sketching | Poly Vector | Topology Driven | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00154 |  distance: 0.00156 |  distance: 0.00158 |  distance: 0.00159 |  distance: 0.00166 |  distance: 0.00172 |  distance: 0.00212 |  distance: 0.00241 |  distance: 0.00633 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  |  |  | ||
| Liliya Larsen |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.0015624449083932767 | distance: 0.00156variant: vectorized (shape strokes) 500px | 7.0 |
| Poly Vector | 0.0015760793569477116 | distance: 0.00158variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 331.0 |
| Real-Time Inking | 0.0015374258549700653 | distance: 0.00154variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.001659714337559968 | distance: 0.00166variant: vectorized (shape strokes) 1000px | 1267.0 |
| Topology Driven | 0.0015902249669878733 | distance: 0.00159variant: vectorized (shape strokes) 1000px | 19.0 |
| Delaunay Triangulation | 0.002414169159966005 | distance: 0.00241variant: vectorized (shape strokes) 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.0017156806008020893 | distance: 0.00172variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 433.0 |
| Stroke Aggregator | 0.002124979876802073 | distance: 0.00212variant: vectorized (all layers) | 1555.0 |
| Fidelity Simplicity | 0.00633336899827656 | distance: 0.00633variant: vectorized (shape strokes) 500pxalg. parameter: 0.3 | 164.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3415193887240441 |  distance: 0.34152variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.3837255277696925 |  distance: 0.38373variant: thresholded 500pxalg. parameter: 0.75 | 178.0 |
| Stroke Aggregator | 0.7075191673381129 | distance: 0.70752variant: vectorized (all layers) | 1555.0 |
| Poly Vector → Stroke Aggregator | 0.3252328480680379 |  distance: 0.32523variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 23.0 |
| Poly Vector | 0.3432354645322649 |  distance: 0.34324variant: vectorized (shape strokes) 500px | 113.0 |
| Mastering Sketching | 0.7101600621437523 |  distance: 0.71016variant: vectorized (all layers) 500px | 7.0 |
| Real-Time Inking | 0.6458984636941408 |  distance: 0.6459variant: thresholded | 4.0 |
| Topology Driven → Stroke Aggregator | 0.5730877020215729 |  distance: 0.57309variant: vectorized (all layers) 500px | 519.0 |
| Topology Driven | 0.4811298243498491 |  distance: 0.48113variant: thresholded 1000px | 442.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5210347877120172 | distance: 0.52103variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.5248893070238485 | distance: 0.52489variant: thresholded 500pxalg. parameter: 0.75 | 178.0 |
| Poly Vector → Stroke Aggregator | 0.4176585053028876 | distance: 0.41766variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 23.0 |
| Poly Vector | 0.4391740308029645 | distance: 0.43917variant: vectorized (shape strokes) 500px | 113.0 |
| Mastering Sketching | 0.8227229296799327 | distance: 0.82272variant: vectorized (all layers) 500px | 7.0 |
| Real-Time Inking | 0.8243044462302912 | distance: 0.8243variant: thresholded | 4.0 |
| Stroke Aggregator | 0.8279280700637206 | distance: 0.82793variant: vectorized (all layers) | 1555.0 |
| Topology Driven → Stroke Aggregator | 0.7353400519127685 | distance: 0.73534variant: vectorized (all layers) 500px | 519.0 |
| Topology Driven | 0.6485353574051553 | distance: 0.64854variant: thresholded 1000px | 442.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6392999934016008 | distance: 0.6393variant: vectorized (all layers) 500px | 3.0 |
| Poly Vector → Stroke Aggregator | 0.4881192284939931 | distance: 0.48812variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 23.0 |
| Poly Vector | 0.507681519942568 |  distance: 0.50768variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 109.0 |
| Fidelity Simplicity | 0.6085601721930491 |  distance: 0.60856variant: thresholded 500pxalg. parameter: 0.25 | 137.0 |
| Mastering Sketching | 0.8748642065590282 | distance: 0.87486variant: vectorized (all layers) 500px | 7.0 |
| Real-Time Inking | 0.8756252137321636 | distance: 0.87563variant: thresholded | 4.0 |
| Stroke Aggregator | 0.8807091705692124 | distance: 0.88071variant: vectorized (all layers) | 1555.0 |
| Topology Driven → Stroke Aggregator | 0.8303455125997167 | distance: 0.83035variant: vectorized (all layers) 500px | 519.0 |
| Topology Driven | 0.7537041071730319 | distance: 0.7537variant: thresholded 1000px | 442.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6996319617182446 | distance: 0.69963variant: vectorized (all layers) 500px | 3.0 |
| Poly Vector → Stroke Aggregator | 0.5336231702935994 | distance: 0.53362variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 23.0 |
| Poly Vector | 0.5506113323462295 | distance: 0.55061variant: vectorized (shape strokes) 500px | 113.0 |
| Fidelity Simplicity | 0.6520277963224224 | distance: 0.65203variant: thresholded 500pxalg. parameter: 0.75 | 178.0 |
| Mastering Sketching | 0.9031103259100842 | distance: 0.90311variant: vectorized (all layers) 500px | 7.0 |
| Real-Time Inking | 0.9059037373151502 | distance: 0.9059variant: thresholded | 4.0 |
| Stroke Aggregator | 0.9145162745774624 | distance: 0.91452variant: vectorized (all layers) | 1555.0 |
| Topology Driven → Stroke Aggregator | 0.8754969020499302 | distance: 0.8755variant: vectorized (all layers) 500px | 519.0 |
| Topology Driven | 0.8209665797632468 | distance: 0.82097variant: thresholded 1000px | 442.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.762842144805692 | distance: 0.76284variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.7029684606036943 |  distance: 0.70297variant: thresholded 500pxalg. parameter: 0.6 | 183.0 |
| Poly Vector → Stroke Aggregator | 0.5862001299283068 |  distance: 0.5862variant: vectorized (shape strokes) 500px | 20.0 |
| Poly Vector | 0.6010881857629286 | distance: 0.60109variant: vectorized (shape strokes) 500px | 113.0 |
| Mastering Sketching | 0.9321776912806354 | distance: 0.93218variant: vectorized (all layers) 500px | 7.0 |
| Real-Time Inking | 0.9274629210951796 | distance: 0.92746variant: thresholded | 4.0 |
| Stroke Aggregator | 0.9362110043910814 | distance: 0.93621variant: vectorized (all layers) | 1555.0 |
| Topology Driven → Stroke Aggregator | 0.9144929342148372 | distance: 0.91449variant: vectorized (all layers) 500px | 519.0 |
| Topology Driven | 0.8715783406026902 | distance: 0.87158variant: thresholded 1000px | 442.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.08185963439941406 |  distance: 0.08186variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 175.0 |
| Mastering Sketching | 0.19530488586425784 |  distance: 0.1953variant: thresholded 500px | 5.0 |
| Poly Vector | 0.02607680892944336 |  distance: 0.02608variant: thresholded 500pxalg. parameter: noisy | 678.0 |
| Real-Time Inking | 0.025612497329711915 |  distance: 0.02561variant: thresholded 500px | 3.0 |
| Topology Driven | 0.0344093017578125 |  distance: 0.03441variant: vectorized (shape strokes) 500px | 6.0 |
| Topology Driven → Stroke Aggregator | 0.033241539001464836 | distance: 0.03324variant: vectorized (shape strokes) 1000px | 1267.0 |
| Delaunay Triangulation | 0.0383275375366211 | distance: 0.03833variant: vectorized (shape strokes) 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.0342344856262207 |  distance: 0.03423variant: vectorized (shape strokes) 1000px | 435.0 |
| Stroke Aggregator | 0.034474628448486325 | distance: 0.03447variant: vectorized (all layers) | 1555.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded | |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded 500px |  |
|
|
 |
|
 |
|
|
 |
|
 |
 |
|||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
||||||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
|
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
|
 |
|
|
|
||
| vectorized (shape strokes) 500px |  |
 |
|
|
 |
 |
 |
 |
|
|
|
 |
|
|
|
| vectorized (all layers) | |