A Benchmark for Rough Sketch Cleanup
Art_freeform_DR_03
Author: David Revoy Author Homepage: https://www.davidrevoy.com/ Licence: CC-BY-4.0Messiness: 0.27134
Ambiguity (Chamfer): 0.05715
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Topology Driven → Stroke Aggregator | Real-Time Inking | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0014 |  distance: 0.00143 |  distance: 0.00147 |  distance: 0.00157 |  distance: 0.00178 |  distance: 0.00247 |  distance: 0.00326 |  distance: 0.00383 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.003831437952431545 | distance: 0.00383variant: vectorized (shape strokes) 1000px | 8.0 |
| Fidelity Simplicity | 0.002473664086362826 | distance: 0.00247variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 139.0 |
| Mastering Sketching | 0.0014028083978340888 | distance: 0.0014variant: vectorized (shape strokes) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0032616595981709603 | distance: 0.00326variant: thresholded 500pxalg. parameter: noisy | 180.0 |
| Poly Vector | 0.001465433792585985 | distance: 0.00147variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 297.0 |
| Real-Time Inking | 0.0017751503633801253 | distance: 0.00178variant: vectorized (shape strokes) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.0015714378938236743 | distance: 0.00157variant: vectorized (shape strokes) 1000px | 1402.0 |
| Topology Driven | 0.0014335774548199492 | distance: 0.00143variant: vectorized (shape strokes) 1000px | 24.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2262339115540865 |  distance: 0.22623variant: vectorized (all layers) 500px | 6.0 |
| Fidelity Simplicity | 0.2314434061466172 |  distance: 0.23144variant: thresholded 500pxalg. parameter: 0.75 | 195.0 |
| Poly Vector → Stroke Aggregator | 0.3930925830524615 |  distance: 0.39309variant: vectorized (shape strokes) 500px | 29.0 |
| Poly Vector | 0.4202238661707484 |  distance: 0.42022variant: vectorized (shape strokes) 500px | 83.0 |
| Real-Time Inking | 0.5792294432347734 |  distance: 0.57923variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5877496964824922 |  distance: 0.58775variant: vectorized (shape strokes) 500px | 367.0 |
| Mastering Sketching | 0.6179553101375432 |  distance: 0.61796variant: vectorized (all layers) 1000px | 5.0 |
| Topology Driven | 0.5385981148631966 |  distance: 0.5386variant: vectorized (all layers) 1000px | 345.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3624149645496021 | distance: 0.36241variant: vectorized (all layers) 500px | 6.0 |
| Fidelity Simplicity | 0.3584672414605168 | distance: 0.35847variant: thresholded 500pxalg. parameter: 0.75 | 195.0 |
| Poly Vector → Stroke Aggregator | 0.5037599577224953 | distance: 0.50376variant: vectorized (shape strokes) 500px | 29.0 |
| Poly Vector | 0.5361041839422467 |  distance: 0.5361variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 78.0 |
| Real-Time Inking | 0.6956917071762649 | distance: 0.69569variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7627290730058636 | distance: 0.76273variant: vectorized (shape strokes) 500px | 367.0 |
| Mastering Sketching | 0.7571451927507797 | distance: 0.75715variant: vectorized (all layers) 1000px | 5.0 |
| Topology Driven | 0.6892796058428036 |  distance: 0.68928variant: thresholded 500px | 135.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5063602990703924 | distance: 0.50636variant: vectorized (all layers) 500px | 6.0 |
| Fidelity Simplicity | 0.4595411243065598 | distance: 0.45954variant: thresholded 500pxalg. parameter: 0.75 | 195.0 |
| Poly Vector → Stroke Aggregator | 0.5863615265432246 | distance: 0.58636variant: vectorized (shape strokes) 500px | 29.0 |
| Poly Vector | 0.6282604899256082 | distance: 0.62826variant: vectorized (shape strokes) 500px | 83.0 |
| Real-Time Inking | 0.7817157353682472 | distance: 0.78172variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8707479064742445 | distance: 0.87075variant: vectorized (shape strokes) 500px | 367.0 |
| Mastering Sketching | 0.8348889249066055 |  distance: 0.83489variant: vectorized (all layers) 500px | 6.0 |
| Topology Driven | 0.7905353308037879 | distance: 0.79054variant: thresholded 500px | 135.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6074981880303586 | distance: 0.6075variant: vectorized (all layers) 500px | 6.0 |
| Fidelity Simplicity | 0.533301218585163 | distance: 0.5333variant: thresholded 500pxalg. parameter: 0.75 | 195.0 |
| Poly Vector → Stroke Aggregator | 0.6531384111331446 | distance: 0.65314variant: vectorized (shape strokes) 500px | 29.0 |
| Poly Vector | 0.6994937916095864 | distance: 0.69949variant: vectorized (shape strokes) 500px | 83.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9236633951418496 | distance: 0.92366variant: vectorized (shape strokes) 500px | 367.0 |
| Mastering Sketching | 0.8689945704224815 | distance: 0.86899variant: vectorized (all layers) 500px | 6.0 |
| Real-Time Inking | 0.8256360024158552 | distance: 0.82564variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.8405168907383056 | distance: 0.84052variant: thresholded 500px | 135.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7107080269150235 | distance: 0.71071variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.7207328076876636 | distance: 0.72073variant: vectorized (shape strokes) 500px | 29.0 |
| Poly Vector | 0.7656409383667311 | distance: 0.76564variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 78.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.6041104183805965 |  distance: 0.60411variant: thresholded 500pxalg. parameter: 0.3 | 128.0 |
| Mastering Sketching | 0.902417086582002 | distance: 0.90242variant: vectorized (all layers) 500px | 6.0 |
| Real-Time Inking | 0.8711647265493336 | distance: 0.87116variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9561727724470148 | distance: 0.95617variant: vectorized (shape strokes) 500px | 367.0 |
| Topology Driven | 0.8857110393900041 | distance: 0.88571variant: thresholded 500px | 135.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.035057094573974615 |  distance: 0.03506variant: vectorized (shape strokes) 1000pxalg. parameter: 0.5 | 159.0 |
| Poly Vector → Stroke Aggregator | 0.032802440643310546 |  distance: 0.0328variant: thresholded 500px | 180.0 |
| Stroke Aggregator | nan | ||
| Mastering Sketching | 0.08141252899169922 | distance: 0.08141variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector | 0.034928497314453126 |  distance: 0.03493variant: thresholded 500pxalg. parameter: noisy | 824.0 |
| Delaunay Triangulation | 0.04964876556396485 | distance: 0.04965variant: vectorized (shape strokes) 1000px | 8.0 |
| Real-Time Inking | 0.04118252182006836 |  distance: 0.04118variant: vectorized (shape strokes) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.04 | distance: 0.04variant: vectorized (shape strokes) 500px | 367.0 |
| Topology Driven | 0.040496913909912106 |  distance: 0.0405variant: vectorized (shape strokes) 500px | 8.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
||||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
||||||
| thresholded 500px |  |
 |
|
 |
 |
|
 |
|
|
 |
 |
|
|
||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
|
 |
||||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
||
| vectorized (shape strokes) 1000px | |
|
|
 |
|
|
 |
 |
|
|
 |
|
|||
| vectorized (shape strokes) 500px | |
|
 |
 |
 |
 |
 |
 |
|
|
|
 |
 |
|