A Benchmark for Rough Sketch Cleanup
Art_freeform_GL_01
Author: Gregory Laufersweiler Author Homepage: http://gregmrl.fr/ Licence: CC-BY-3.0Messiness: 0.10439
Ambiguity (Chamfer): 0.02351
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Stroke Aggregator | Real-Time Inking | Poly Vector | Poly Vector → Stroke Aggregator | Topology Driven | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00051 |  distance: 0.00052 |  distance: 0.00055 |  distance: 0.00066 |  distance: 0.00072 |  distance: 0.00078 |  distance: 0.00095 |  distance: 0.00228 |  distance: 0.00391 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.002280080053968121 | distance: 0.00228variant: original | 58.0 |
| Fidelity Simplicity | 0.0039130383340112325 | distance: 0.00391variant: originalalg. parameter: 0.3 | 379.0 |
| Mastering Sketching | 0.0005145454936322278 | distance: 0.00051variant: vectorized (shape strokes) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0007164763755961014 | distance: 0.00072variant: vectorized (shape strokes) 1000px | 166.0 |
| Poly Vector | 0.0006628423401739675 | distance: 0.00066variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 141.0 |
| Real-Time Inking | 0.0005547144784201747 | distance: 0.00055variant: thresholded | 3.0 |
| Stroke Aggregator | 0.0005248669479771878 | distance: 0.00052variant: vectorized (shape strokes) | 706.0 |
| Topology Driven → Stroke Aggregator | 0.000950998119230242 | distance: 0.00095variant: thresholded 1000px | 936.0 |
| Topology Driven | 0.0007774288932877794 | distance: 0.00078variant: thresholded | 254.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4154309331562776 |  distance: 0.41543variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.5739514089064062 |  distance: 0.57395variant: thresholded 500pxalg. parameter: 0.75 | 144.0 |
| Mastering Sketching | 0.8687304538092931 |  distance: 0.86873variant: vectorized (all layers) 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.8907512143428861 |  distance: 0.89075variant: thresholded 1000pxalg. parameter: noisy | 151.0 |
| Poly Vector | 0.6826733241941106 |  distance: 0.68267variant: vectorized (all layers) 500pxalg. parameter: noisy | 212.0 |
| Real-Time Inking | 0.8904067600599993 |  distance: 0.89041variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | 0.9091361583211182 | distance: 0.90914variant: vectorized (shape strokes) | 706.0 |
| Topology Driven → Stroke Aggregator | 0.7260129012020975 |  distance: 0.72601variant: vectorized (all layers) 500px | 153.0 |
| Topology Driven | 0.834897075151502 |  distance: 0.8349variant: vectorized (all layers) 1000px | 47.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6402879943085358 | distance: 0.64029variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.6921551702378205 |  distance: 0.69216variant: thresholdedalg. parameter: 0.3 | 256.0 |
| Mastering Sketching | 0.9464978390967258 | distance: 0.9465variant: vectorized (all layers) 1000px | 8.0 |
| Poly Vector | 0.7771085881149628 |  distance: 0.77711variant: vectorized (all layers) 500px | 237.0 |
| Real-Time Inking | 0.9626261825439952 | distance: 0.96263variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | 0.9823144068702749 | distance: 0.98231variant: vectorized (shape strokes) | 706.0 |
| Topology Driven → Stroke Aggregator | 0.8745116443126553 | distance: 0.87451variant: vectorized (all layers) 500px | 153.0 |
| Topology Driven | 0.9306621189706822 | distance: 0.93066variant: vectorized (all layers) 1000px | 47.0 |
| Poly Vector → Stroke Aggregator | 0.958736517687095 |  distance: 0.95874variant: thresholded 1000px | 152.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7208388088095579 |  distance: 0.72084variant: thresholdedalg. parameter: 0.6 | 270.0 |
| Mastering Sketching | 0.9726770898738796 | distance: 0.97268variant: vectorized (all layers) 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.9804000715118838 | distance: 0.9804variant: thresholded 1000pxalg. parameter: noisy | 151.0 |
| Topology Driven | 0.9636827558828198 | distance: 0.96368variant: vectorized (all layers) 1000px | 47.0 |
| Delaunay Triangulation | 0.7796787356612258 | distance: 0.77968variant: vectorized (all layers) 500px | 1.0 |
| Real-Time Inking | 0.9821578720925356 |  distance: 0.98216variant: original | 5.0 |
| Stroke Aggregator | 0.9967423189862372 | distance: 0.99674variant: vectorized (shape strokes) | 706.0 |
| Poly Vector | 0.8352683296238607 |  distance: 0.83527variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 58.0 |
| Topology Driven → Stroke Aggregator | 0.9489351626937752 | distance: 0.94894variant: vectorized (all layers) 500px | 153.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7479061275341816 | distance: 0.74791variant: thresholdedalg. parameter: 0.6 | 270.0 |
| Mastering Sketching | 0.9855275429597872 | distance: 0.98553variant: vectorized (all layers) 1000px | 8.0 |
| Poly Vector | 0.8753522653370909 | distance: 0.87535variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 58.0 |
| Real-Time Inking | 0.9883514820624218 | distance: 0.98835variant: original | 5.0 |
| Topology Driven → Stroke Aggregator | 0.9754397996603786 | distance: 0.97544variant: vectorized (all layers) 500px | 153.0 |
| Topology Driven | 0.978509382103875 | distance: 0.97851variant: vectorized (all layers) 1000px | 47.0 |
| Delaunay Triangulation | 0.8323577074445214 | distance: 0.83236variant: vectorized (all layers) 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.9892113272817764 | distance: 0.98921variant: thresholded 1000pxalg. parameter: noisy | 151.0 |
| Stroke Aggregator | 0.9991122149270608 | distance: 0.99911variant: vectorized (shape strokes) | 706.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7639751315846581 |  distance: 0.76398variant: thresholdedalg. parameter: 0.75 | 331.0 |
| Mastering Sketching | 0.990306141267562 | distance: 0.99031variant: vectorized (all layers) 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.9923117680012756 | distance: 0.99231variant: thresholded 1000px | 152.0 |
| Stroke Aggregator | 0.9996119379817192 | distance: 0.99961variant: vectorized (shape strokes) | 706.0 |
| Topology Driven → Stroke Aggregator | 0.9911170159103816 |  distance: 0.99112variant: vectorized (all layers) 1000px | 871.0 |
| Topology Driven | 0.9850549084140332 | distance: 0.98505variant: vectorized (all layers) 1000px | 47.0 |
| Delaunay Triangulation | 0.8784195393684721 | distance: 0.87842variant: vectorized (all layers) 500px | 1.0 |
| Poly Vector | 0.9098135126872516 |  distance: 0.90981variant: vectorized (shape strokes) 500px | 63.0 |
| Real-Time Inking | 0.9911352120398499 | distance: 0.99114variant: original | 5.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.11150785064697266 |  distance: 0.11151variant: vectorized (shape strokes) 1000px | 4.0 |
| Poly Vector → Stroke Aggregator | 0.01029563045501709 |  distance: 0.0103variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 167.0 |
| Poly Vector | 0.00943398094177246 | distance: 0.00943variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 141.0 |
| Real-Time Inking | 0.010198039054870605 |  distance: 0.0102variant: thresholded 500px | 2.0 |
| Stroke Aggregator | 0.010818785483684016 | distance: 0.01082variant: vectorized (shape strokes) | 706.0 |
| Topology Driven → Stroke Aggregator | 0.021540658950805664 | distance: 0.02154variant: vectorized (all layers) 500px | 153.0 |
| Topology Driven | 0.011661903381347656 |  distance: 0.01166variant: vectorized (shape strokes) 500px | 5.0 |
| Fidelity Simplicity | 0.07694153594970703 |  distance: 0.07694variant: vectorized (shape strokes) 500pxalg. parameter: 0.3 | 122.0 |
| Mastering Sketching | 0.31628466796875 |  distance: 0.31628variant: vectorized (all layers) 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
 |
 |
 |
 |
|
|||||||
| thresholded | |
|
 |
 |
|
|
|
 |
|||||||
| thresholded 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
|
| thresholded 500px | |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 1000px | |
 |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
|||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
 |
 |
 |
|
|
|
|||
| vectorized (shape strokes) 1000px |  |
|
 |
 |
 |
 |
 |
|
 |
|
|
|
|||
| vectorized (shape strokes) 500px |  |
 |
 |
|
 |
 |
 |
 |
|
|
|
 |
|||
| vectorized (shape strokes) | |