A Benchmark for Rough Sketch Cleanup
Ind_product_JM_05
Author: Jaguar MENA Author Homepage: https://www.flickr.com/photos/jaguarcarsmena/ Licence: CC-BY-2.0Messiness: 0.29497
Ambiguity (Chamfer): 0.08219
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Real-Time Inking | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Poly Vector → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00179 |  distance: 0.00195 |  distance: 0.00198 |  distance: 0.0022 |  distance: 0.00309 |  distance: 0.00429 |  distance: 0.00456 |  distance: 0.00614 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.004289816071506856 | distance: 0.00429variant: vectorized (shape strokes) 1000px | 27.0 |
| Real-Time Inking | 0.002198004929606917 | distance: 0.0022variant: thresholded 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.0030863858366486185 | distance: 0.00309variant: vectorized (shape strokes) 500px | 826.0 |
| Mastering Sketching | 0.0017897967931089379 | distance: 0.00179variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector | 0.001983281037181051 | distance: 0.00198variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 766.0 |
| Topology Driven | 0.0019516113112919046 | distance: 0.00195variant: vectorized (shape strokes) 1000px | 84.0 |
| Fidelity Simplicity | 0.0061357183633651705 | distance: 0.00614variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 1455.0 |
| Poly Vector → Stroke Aggregator | 0.004562653215105228 | distance: 0.00456variant: thresholded 500pxalg. parameter: noisy | 84.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.5498351268327218 |  distance: 0.54984variant: vectorized (all layers) 500pxalg. parameter: noisy | 211.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.5674426330283326 |  distance: 0.56744variant: original | 1590.0 |
| Fidelity Simplicity | 0.26187098850970897 |  distance: 0.26187variant: thresholded 500pxalg. parameter: 0.75 | 199.0 |
| Topology Driven → Stroke Aggregator | 0.6325816234095908 | distance: 0.63258variant: vectorized (shape strokes) 500px | 826.0 |
| Delaunay Triangulation | 0.3117466116795196 |  distance: 0.31175variant: vectorized (all layers) 500px | 11.0 |
| Mastering Sketching | 0.6594996993360555 |  distance: 0.6595variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.5571573348258445 |  distance: 0.55716variant: vectorized (all layers) 500px | 847.0 |
| Real-Time Inking | 0.6368696111816841 |  distance: 0.63687variant: vectorized (all layers) 500px | 3.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.6706504521625747 |  distance: 0.67065variant: vectorized (all layers) 500px | 212.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.37944326405844186 | distance: 0.37944variant: thresholded 500pxalg. parameter: 0.75 | 199.0 |
| Poly Vector | 0.6684155163365949 |  distance: 0.66842variant: vectorized (all layers) 500pxalg. parameter: noisy | 882.0 |
| Topology Driven → Stroke Aggregator | 0.7827284616831688 | distance: 0.78273variant: vectorized (shape strokes) 500px | 826.0 |
| Topology Driven | 0.7321191675545221 |  distance: 0.73212variant: vectorized (all layers) 500px | 91.0 |
| Delaunay Triangulation | 0.4678594757759748 | distance: 0.46786variant: vectorized (all layers) 500px | 11.0 |
| Mastering Sketching | 0.786404819979399 | distance: 0.7864variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.7535882713371049 | distance: 0.75359variant: vectorized (all layers) 500px | 3.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.4805088385287942 | distance: 0.48051variant: thresholded 500pxalg. parameter: 0.75 | 199.0 |
| Poly Vector → Stroke Aggregator | 0.7518377817827528 | distance: 0.75184variant: vectorized (all layers) 500pxalg. parameter: noisy | 211.0 |
| Poly Vector | 0.7446075912061189 | distance: 0.74461variant: vectorized (all layers) 500px | 847.0 |
| Topology Driven → Stroke Aggregator | 0.8566922116519334 | distance: 0.85669variant: vectorized (shape strokes) 500px | 826.0 |
| Topology Driven | 0.8011522298784336 | distance: 0.80115variant: vectorized (all layers) 500px | 91.0 |
| Delaunay Triangulation | 0.5864636094113982 | distance: 0.58646variant: vectorized (all layers) 500px | 11.0 |
| Mastering Sketching | 0.8464108069979208 | distance: 0.84641variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8174728162264427 | distance: 0.81747variant: vectorized (all layers) 500px | 3.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.5549826028058744 | distance: 0.55498variant: thresholded 500pxalg. parameter: 0.75 | 199.0 |
| Poly Vector → Stroke Aggregator | 0.7957494857372952 | distance: 0.79575variant: vectorized (all layers) 500px | 212.0 |
| Poly Vector | 0.7864596574815859 | distance: 0.78646variant: vectorized (all layers) 500pxalg. parameter: noisy | 882.0 |
| Topology Driven → Stroke Aggregator | 0.8922126353133755 | distance: 0.89221variant: vectorized (shape strokes) 500px | 826.0 |
| Topology Driven | 0.8381386329164977 | distance: 0.83814variant: vectorized (all layers) 500px | 91.0 |
| Delaunay Triangulation | 0.6559713504794686 | distance: 0.65597variant: vectorized (all layers) 500px | 11.0 |
| Mastering Sketching | 0.8769894621734338 | distance: 0.87699variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8497678627005114 | distance: 0.84977variant: vectorized (all layers) 500px | 3.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.6258209331183192 | distance: 0.62582variant: thresholded 500pxalg. parameter: 0.75 | 199.0 |
| Mastering Sketching | 0.9016825644191534 | distance: 0.90168variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.8345813329970303 | distance: 0.83458variant: vectorized (all layers) 500pxalg. parameter: noisy | 882.0 |
| Topology Driven → Stroke Aggregator | 0.9231862130408588 | distance: 0.92319variant: vectorized (shape strokes) 500px | 826.0 |
| Topology Driven | 0.872162436044537 | distance: 0.87216variant: vectorized (all layers) 500px | 91.0 |
| Delaunay Triangulation | 0.7302770303411311 | distance: 0.73028variant: vectorized (all layers) 500px | 11.0 |
| Poly Vector → Stroke Aggregator | 0.8365468229842478 |  distance: 0.83655variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 64.0 |
| Real-Time Inking | 0.8786939451143433 | distance: 0.87869variant: vectorized (all layers) 500px | 3.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.04103656768798828 |  distance: 0.04104variant: vectorized (all layers) 1000px | 59.0 |
| Poly Vector → Stroke Aggregator | 0.059665737152099614 |  distance: 0.05967variant: vectorized (shape strokes) 500px | 64.0 |
| Poly Vector | 0.04161730575561524 | distance: 0.04162variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 766.0 |
| Real-Time Inking | 0.03847076797485351 |  distance: 0.03847variant: vectorized (shape strokes) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.048 | distance: 0.048variant: vectorized (shape strokes) 500px | 826.0 |
| Topology Driven | 0.04161730575561524 | distance: 0.04162variant: vectorized (shape strokes) 1000px | 84.0 |
| Fidelity Simplicity | 0.14993331909179688 |  distance: 0.14993variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 1695.0 |
| Mastering Sketching | 0.2144108276367188 |  distance: 0.21441variant: thresholded 500px | 7.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
||||||
| thresholded 500px |  |
|
 |
 |
 |
|
 |
 |
 |
 |
 |
|
 |
||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
|
 |
|
|||||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
|
|
|
|
|
|
||
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
|
 |
|
||||
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|