A Benchmark for Rough Sketch Cleanup
Ind_product_JM_07
Author: Jaguar MENA Author Homepage: https://www.flickr.com/photos/jaguarcarsmena/ Licence: CC-BY-2.0Messiness: 0.34622
Ambiguity (Chamfer): 0.08027
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Mastering Sketching | Poly Vector | Topology Driven | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00088 |  distance: 0.00091 |  distance: 0.00108 |  distance: 0.0011 |  distance: 0.00185 |  distance: 0.00204 |  distance: 0.00302 |  distance: 0.00321 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.00321307654210757 | distance: 0.00321variant: vectorized (shape strokes) 1000px | 28.0 |
| Fidelity Simplicity | 0.003024735114393146 | distance: 0.00302variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 121.0 |
| Mastering Sketching | 0.0009096955149261124 | distance: 0.00091variant: vectorized (shape strokes) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0018455464801060378 | distance: 0.00185variant: vectorized (shape strokes) 500px | 75.0 |
| Poly Vector | 0.001084323384886577 | distance: 0.00108variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 439.0 |
| Real-Time Inking | 0.0008768533693720675 | distance: 0.00088variant: original | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.0020447693643449974 | distance: 0.00204variant: vectorized (shape strokes) 500px | 501.0 |
| Topology Driven | 0.0010954738774708675 | distance: 0.0011variant: vectorized (shape strokes) 1000px | 47.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.3095334193487481 |  distance: 0.30953variant: vectorized (all layers) 500px | 16.0 |
| Fidelity Simplicity | 0.23566121662770897 |  distance: 0.23566variant: thresholded 500pxalg. parameter: 0.6 | 153.0 |
| Mastering Sketching | 0.6630435754651661 |  distance: 0.66304variant: vectorized (all layers) 1000px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.7114196119603288 | distance: 0.71142variant: vectorized (shape strokes) 500px | 501.0 |
| Topology Driven | 0.4926999968914346 |  distance: 0.4927variant: vectorized (all layers) 1000px | 348.0 |
| Poly Vector → Stroke Aggregator | 0.597236913601888 |  distance: 0.59724variant: thresholded 500px | 212.0 |
| Poly Vector | 0.6188184315621792 |  distance: 0.61882variant: vectorized (all layers) 500px | 956.0 |
| Real-Time Inking | 0.6515009160511642 |  distance: 0.6515variant: thresholded 500px | 2.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4754545607321409 | distance: 0.47545variant: vectorized (all layers) 500px | 16.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.3493389253404311 |  distance: 0.34934variant: thresholded 500pxalg. parameter: 0.75 | 162.0 |
| Topology Driven → Stroke Aggregator | 0.8581670449818708 | distance: 0.85817variant: vectorized (shape strokes) 500px | 501.0 |
| Topology Driven | 0.6414941856960045 | distance: 0.64149variant: vectorized (all layers) 1000px | 348.0 |
| Mastering Sketching | 0.7520221130597243 | distance: 0.75202variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7287270429073193 | distance: 0.72873variant: thresholded 500px | 212.0 |
| Poly Vector | 0.7199680963522235 | distance: 0.71997variant: vectorized (all layers) 500px | 956.0 |
| Real-Time Inking | 0.7415529728651563 | distance: 0.74155variant: thresholded 500px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5816937013157704 | distance: 0.58169variant: vectorized (all layers) 500px | 16.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.4683681796959714 | distance: 0.46837variant: thresholded 500pxalg. parameter: 0.75 | 162.0 |
| Topology Driven → Stroke Aggregator | 0.9222534389869032 | distance: 0.92225variant: vectorized (shape strokes) 500px | 501.0 |
| Mastering Sketching | 0.7994449775244918 | distance: 0.79944variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8037424681427608 |  distance: 0.80374variant: thresholded 500pxalg. parameter: noisy | 213.0 |
| Poly Vector | 0.7818110204153136 | distance: 0.78181variant: vectorized (all layers) 500px | 956.0 |
| Real-Time Inking | 0.7863312885958217 | distance: 0.78633variant: thresholded 500px | 2.0 |
| Topology Driven | 0.7257608792420294 | distance: 0.72576variant: vectorized (all layers) 1000px | 348.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.6508666208358254 | distance: 0.65087variant: vectorized (all layers) 500px | 16.0 |
| Fidelity Simplicity | 0.5644491079616867 |  distance: 0.56445variant: thresholded 500pxalg. parameter: 0.5 | 175.0 |
| Mastering Sketching | 0.8311116438399374 | distance: 0.83111variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8394468153667691 | distance: 0.83945variant: thresholded 500px | 212.0 |
| Poly Vector | 0.8146528080630027 | distance: 0.81465variant: vectorized (all layers) 500px | 956.0 |
| Real-Time Inking | 0.8176537976093452 | distance: 0.81765variant: thresholded 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9500058440926769 | distance: 0.95001variant: vectorized (shape strokes) 500px | 501.0 |
| Topology Driven | 0.7734152260613875 |  distance: 0.77342variant: vectorized (all layers) 500px | 98.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.7188639443647753 | distance: 0.71886variant: vectorized (all layers) 500px | 16.0 |
| Fidelity Simplicity | 0.6337696063567705 |  distance: 0.63377variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 141.0 |
| Mastering Sketching | 0.8567232698193307 | distance: 0.85672variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8679597836333987 | distance: 0.86796variant: thresholded 500px | 212.0 |
| Poly Vector | 0.8435656268997361 | distance: 0.84357variant: vectorized (all layers) 500px | 956.0 |
| Real-Time Inking | 0.8518055282085111 | distance: 0.85181variant: thresholded 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9603933338384 | distance: 0.96039variant: vectorized (shape strokes) 500px | 501.0 |
| Topology Driven | 0.8034307154706574 | distance: 0.80343variant: vectorized (all layers) 500px | 98.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.02 | distance: 0.02variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 439.0 |
| Real-Time Inking | 0.021587032318115238 |  distance: 0.02159variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.02039607810974121 | distance: 0.0204variant: vectorized (shape strokes) 500px | 501.0 |
| Topology Driven | 0.019 | distance: 0.019variant: vectorized (shape strokes) 1000px | 47.0 |
| Delaunay Triangulation | 0.03640055084228516 | distance: 0.0364variant: vectorized (shape strokes) 1000px | 28.0 |
| Poly Vector → Stroke Aggregator | 0.03 | distance: 0.03variant: vectorized (shape strokes) 500px | 75.0 |
| Fidelity Simplicity | 0.049010204315185546 |  distance: 0.04901variant: thresholded 1000pxalg. parameter: 0.6 | 188.0 |
| Mastering Sketching | 0.12625371551513673 |  distance: 0.12625variant: thresholded 500px | 13.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
|||||||||
| thresholded |  |
 |
 |
 |
 |
 |
|||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
||||
| thresholded 500px | |
|
 |
|
|
|
 |
 |
 |
 |
|
|
|||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
|
 |
||||||
| vectorized (all layers) 500px |  |
 |
 |
 |
 |
 |
|
|
 |
|
|
||||
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
|
 |
|
||||
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|