A Benchmark for Rough Sketch Cleanup
Art_freeform_GL_02
Author: Gregory Laufersweiler Author Homepage: http://gregmrl.fr/ Licence: CC-BY-3.0Messiness: 0.3631
Ambiguity (Chamfer): 0.17196
Shading: Yes
Scaffold: Yes
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Topology Driven → Stroke Aggregator | Real-Time Inking | Poly Vector → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00212 |  distance: 0.00219 |  distance: 0.00229 |  distance: 0.00233 |  distance: 0.00247 |  distance: 0.00254 |  distance: 0.00378 |  distance: 0.00473 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.00472856778783809 | distance: 0.00473variant: original | 16.0 |
| Fidelity Simplicity | 0.0037781813205352032 | distance: 0.00378variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 210.0 |
| Mastering Sketching | 0.002117158896036269 | distance: 0.00212variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.002536838363785338 | distance: 0.00254variant: originalalg. parameter: noisy | 253.0 |
| Poly Vector | 0.002288175995836174 | distance: 0.00229variant: thresholded 1000px | 1582.0 |
| Real-Time Inking | 0.002470224739887051 | distance: 0.00247variant: thresholded 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.002334893202914354 | distance: 0.00233variant: original | 1487.0 |
| Topology Driven | 0.0021874010529455853 | distance: 0.00219variant: original | 50.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.3047013853744063 |  distance: 0.3047variant: thresholded 500pxalg. parameter: 0.6 | 165.0 |
| Mastering Sketching | 0.5191850952906141 |  distance: 0.51919variant: vectorized (all layers) 1000px | 9.0 |
| Poly Vector | 0.4940783243612865 |  distance: 0.49408variant: vectorized (all layers) 1000px | 1393.0 |
| Real-Time Inking | 0.5599793975715658 |  distance: 0.55998variant: vectorized (all layers) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.508697844929913 |  distance: 0.5087variant: thresholded 500px | 1189.0 |
| Topology Driven | 0.4676060303628876 |  distance: 0.46761variant: thresholded | 101.0 |
| Delaunay Triangulation | 0.2298610716872408 |  distance: 0.22986variant: vectorized (all layers) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.5581679290040488 |  distance: 0.55817variant: vectorized (all layers) 500pxalg. parameter: noisy | 133.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.38559792456933 | distance: 0.3856variant: vectorized (all layers) 500px | 7.0 |
| Mastering Sketching | 0.6647315727969257 | distance: 0.66473variant: vectorized (all layers) 1000px | 9.0 |
| Poly Vector → Stroke Aggregator | 0.7059201488632096 |  distance: 0.70592variant: vectorized (all layers) 500px | 130.0 |
| Poly Vector | 0.6478531869289985 | distance: 0.64785variant: vectorized (all layers) 1000px | 1393.0 |
| Real-Time Inking | 0.7367464367330122 | distance: 0.73675variant: vectorized (all layers) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.6740034606904961 | distance: 0.674variant: thresholded 500px | 1189.0 |
| Topology Driven | 0.6607795761192857 |  distance: 0.66078variant: vectorized (all layers) 1000px | 183.0 |
| Fidelity Simplicity | 0.4595054800618811 |  distance: 0.45951variant: thresholded 500pxalg. parameter: 0.75 | 183.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.5071766888472503 | distance: 0.50718variant: vectorized (all layers) 500px | 7.0 |
| Mastering Sketching | 0.7618595331082371 | distance: 0.76186variant: vectorized (all layers) 1000px | 9.0 |
| Poly Vector → Stroke Aggregator | 0.8008484023017038 | distance: 0.80085variant: vectorized (all layers) 500pxalg. parameter: noisy | 133.0 |
| Poly Vector | 0.7527040091016095 | distance: 0.7527variant: vectorized (all layers) 1000px | 1393.0 |
| Real-Time Inking | 0.8169610388220472 |  distance: 0.81696variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.7840971534574708 | distance: 0.7841variant: thresholded 500px | 1189.0 |
| Topology Driven | 0.7715382479710433 |  distance: 0.77154variant: vectorized (all layers) 500px | 35.0 |
| Fidelity Simplicity | 0.5830663297366653 |  distance: 0.58307variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 158.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.6055786763247045 | distance: 0.60558variant: vectorized (all layers) 500px | 7.0 |
| Mastering Sketching | 0.815631804328359 |  distance: 0.81563variant: vectorized (all layers) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.856746742774501 | distance: 0.85675variant: vectorized (all layers) 500px | 130.0 |
| Poly Vector | 0.8108198744869063 | distance: 0.81082variant: vectorized (all layers) 1000px | 1393.0 |
| Real-Time Inking | 0.8522054050439968 | distance: 0.85221variant: vectorized (all layers) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.8430634009656767 |  distance: 0.84306variant: vectorized (shape strokes) 500px | 1709.0 |
| Topology Driven | 0.8308212143558277 | distance: 0.83082variant: vectorized (all layers) 500px | 35.0 |
| Fidelity Simplicity | 0.6830489575662677 |  distance: 0.68305variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 168.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.7158645990138484 | distance: 0.71586variant: vectorized (all layers) 500px | 7.0 |
| Fidelity Simplicity | 0.7629494387782775 | distance: 0.76295variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 168.0 |
| Mastering Sketching | 0.8542774320655626 | distance: 0.85428variant: vectorized (all layers) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.9092934332904128 | distance: 0.90929variant: vectorized (all layers) 500px | 130.0 |
| Poly Vector | 0.8569755981963695 | distance: 0.85698variant: vectorized (all layers) 1000px | 1393.0 |
| Real-Time Inking | 0.8849568296227726 | distance: 0.88496variant: vectorized (all layers) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.8915173791446498 | distance: 0.89152variant: vectorized (shape strokes) 500px | 1709.0 |
| Topology Driven | 0.8758247202795068 | distance: 0.87582variant: vectorized (all layers) 1000px | 183.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.051291209042823326 | distance: 0.05129variant: original | 16.0 |
| Mastering Sketching | 0.18987364196777345 |  distance: 0.18987variant: thresholded 500px | 6.0 |
| Stroke Aggregator | nan | ||
| Real-Time Inking | 0.05174963253060567 |  distance: 0.05175variant: original | 3.0 |
| Fidelity Simplicity | 0.048 | distance: 0.048variant: thresholded 500pxalg. parameter: 0.75 | 183.0 |
| Poly Vector → Stroke Aggregator | 0.03605551147460938 |  distance: 0.03606variant: thresholded 500pxalg. parameter: noisy | 103.0 |
| Poly Vector | 0.028844409942626957 | distance: 0.02884variant: thresholded 1000px | 1582.0 |
| Topology Driven → Stroke Aggregator | 0.03162277603149414 | distance: 0.03162variant: thresholded 500px | 1189.0 |
| Topology Driven | 0.03006659317016602 |  distance: 0.03007variant: thresholded 500px | 31.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
 |
 |
 |
 |
 |
|
 |
 |
|
|
 |
|
| thresholded |  |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
||||
| thresholded 1000px | |
|
 |
 |
 |
 |
 |
 |
|
 |
|||||
| thresholded 500px | |
 |
|
 |
 |
 |
|
|
|
 |
 |
 |
|
||
| vectorized (all layers) 1000px | |
|
 |
 |
 |
 |
 |
|
|
 |
|||||
| vectorized (all layers) 500px | |
|
 |
 |
|
 |
|
|
 |
 |
|
|
|
||
| vectorized (shape strokes) 1000px |  |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
||||
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |