A Benchmark for Rough Sketch Cleanup
Ind_product_PM_01
Author: Patrick Murphy Author Homepage: https://www.flickr.com/photos/pmurf/ Licence: CC-BY-2.0Messiness: 0.80023
Ambiguity (Chamfer): 0.15778
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Poly Vector | Fidelity Simplicity | Topology Driven | Mastering Sketching | Real-Time Inking | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Stroke Aggregator | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00253 |  distance: 0.0031 |  distance: 0.00321 |  distance: 0.00345 |  distance: 0.00391 |  distance: 0.00397 |  distance: 0.00403 |  distance: 0.00427 |  distance: 0.00459 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.003965342961771467 | distance: 0.00397variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.003097497875765968 | distance: 0.0031variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 155.0 |
| Mastering Sketching | 0.003451607426333921 | distance: 0.00345variant: vectorized (shape strokes) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.004593113588963497 | distance: 0.00459variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 277.0 |
| Poly Vector | 0.002530533762719896 | distance: 0.00253variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 50.0 |
| Real-Time Inking | 0.003911019644515953 | distance: 0.00391variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.004272777582411829 | distance: 0.00427variant: vectorized (shape strokes) | 793.0 |
| Topology Driven → Stroke Aggregator | 0.004034529783974526 | distance: 0.00403variant: vectorized (shape strokes) 500px | 103.0 |
| Topology Driven | 0.0032132330347839715 | distance: 0.00321variant: vectorized (shape strokes) 1000px | 15.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.04932511335253488 |  distance: 0.04933variant: original | 1254.0 |
| Fidelity Simplicity | 0.19988398342220948 |  distance: 0.19988variant: thresholded 500pxalg. parameter: 0.6 | 113.0 |
| Mastering Sketching | 0.3446854168168688 |  distance: 0.34469variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.2870388446719793 |  distance: 0.28704variant: vectorized (all layers) 1000px | 865.0 |
| Poly Vector | 0.2972918459005005 |  distance: 0.29729variant: vectorized (all layers) 1000pxalg. parameter: noisy | 389.0 |
| Real-Time Inking | 0.3414933297489835 |  distance: 0.34149variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.4817878181579067 | distance: 0.48179variant: vectorized (shape strokes) | 793.0 |
| Topology Driven → Stroke Aggregator | 0.30644634576448304 |  distance: 0.30645variant: vectorized (all layers) 500px | 969.0 |
| Topology Driven | 0.3339901291999605 |  distance: 0.33399variant: vectorized (all layers) 1000px | 53.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.08191435842131484 | distance: 0.08191variant: original | 1254.0 |
| Fidelity Simplicity | 0.2842022769215212 | distance: 0.2842variant: thresholded 500pxalg. parameter: 0.6 | 113.0 |
| Mastering Sketching | 0.4870713002288277 | distance: 0.48707variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4299158296625805 |  distance: 0.42992variant: vectorized (all layers) 1000pxalg. parameter: noisy | 867.0 |
| Poly Vector | 0.4446232927646879 | distance: 0.44462variant: vectorized (all layers) 1000pxalg. parameter: noisy | 389.0 |
| Real-Time Inking | 0.4751333093698292 | distance: 0.47513variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.6925165411503221 | distance: 0.69252variant: vectorized (shape strokes) | 793.0 |
| Topology Driven → Stroke Aggregator | 0.4521249669063539 | distance: 0.45212variant: vectorized (all layers) 500px | 969.0 |
| Topology Driven | 0.4822645915251538 |  distance: 0.48226variant: vectorized (all layers) 500px | 14.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.11095654673928186 | distance: 0.11096variant: original | 1254.0 |
| Fidelity Simplicity | 0.3688120693252 |  distance: 0.36881variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 110.0 |
| Mastering Sketching | 0.5646195082158256 |  distance: 0.56462variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5275415270870895 | distance: 0.52754variant: vectorized (all layers) 1000px | 865.0 |
| Poly Vector | 0.5450775901318428 | distance: 0.54508variant: vectorized (all layers) 1000pxalg. parameter: noisy | 389.0 |
| Real-Time Inking | 0.5259400024165999 | distance: 0.52594variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7441306687419517 | distance: 0.74413variant: vectorized (shape strokes) | 793.0 |
| Topology Driven → Stroke Aggregator | 0.5541934377455261 | distance: 0.55419variant: vectorized (all layers) 500px | 969.0 |
| Topology Driven | 0.5851668423410316 | distance: 0.58517variant: vectorized (all layers) 500px | 14.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.14149648531029593 | distance: 0.1415variant: original | 1254.0 |
| Fidelity Simplicity | 0.4375426935112676 | distance: 0.43754variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 110.0 |
| Mastering Sketching | 0.6084058298497345 | distance: 0.60841variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5874262416282577 | distance: 0.58743variant: vectorized (all layers) 1000px | 865.0 |
| Poly Vector | 0.6091991167124469 |  distance: 0.6092variant: vectorized (all layers) 1000px | 386.0 |
| Real-Time Inking | 0.5523876905129673 | distance: 0.55239variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7913744391268304 | distance: 0.79137variant: vectorized (shape strokes) | 793.0 |
| Topology Driven → Stroke Aggregator | 0.6125733217329622 | distance: 0.61257variant: vectorized (all layers) 500px | 969.0 |
| Topology Driven | 0.6443649373881932 | distance: 0.64436variant: vectorized (all layers) 500px | 14.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.16730500213912386 | distance: 0.16731variant: original | 1254.0 |
| Mastering Sketching | 0.6603948012398716 | distance: 0.66039variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6428227279727952 | distance: 0.64282variant: vectorized (all layers) 1000px | 865.0 |
| Poly Vector | 0.6677844558516264 | distance: 0.66778variant: vectorized (all layers) 1000pxalg. parameter: noisy | 389.0 |
| Real-Time Inking | 0.5715877599065876 | distance: 0.57159variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8253628315684535 | distance: 0.82536variant: vectorized (shape strokes) | 793.0 |
| Topology Driven → Stroke Aggregator | 0.6745361746532388 | distance: 0.67454variant: vectorized (all layers) 500px | 969.0 |
| Topology Driven | 0.7122100433341829 | distance: 0.71221variant: vectorized (all layers) 500px | 14.0 |
| Fidelity Simplicity | 0.5210892072183699 | distance: 0.52109variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 110.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.1866761932373047 |  distance: 0.18668variant: vectorized (shape strokes) 500px | 6.0 |
| Delaunay Triangulation | 0.034 | distance: 0.034variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.03733630752563477 | distance: 0.03734variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 155.0 |
| Poly Vector → Stroke Aggregator | 0.03640055084228516 | distance: 0.0364variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 277.0 |
| Poly Vector | 0.033526107788085936 | distance: 0.03353variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 50.0 |
| Real-Time Inking | 0.03736308288574219 |  distance: 0.03736variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | 0.03721025855140348 | distance: 0.03721variant: vectorized (shape strokes) | 793.0 |
| Topology Driven → Stroke Aggregator | 0.03716180801391602 |  distance: 0.03716variant: vectorized (shape strokes) 1000px | 1064.0 |
| Topology Driven | 0.03736308288574219 |  distance: 0.03736variant: vectorized (shape strokes) 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
|
||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
|||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
|
|
|
 |
|
|
||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
|
 |
|
 |
 |
 |
 |
 |
|
| vectorized (shape strokes) 1000px | |
|
|
|
 |
 |
 |
 |
|
 |
 |
 |
|
 |
|
| vectorized (shape strokes) 500px | |
|
|
 |
 |
 |
 |
 |
|
|
 |
|
|||
| vectorized (shape strokes) | |