A Benchmark for Rough Sketch Cleanup
Art_logo_VFS_16
Author: VFS Digital Design Author Homepage: https://www.flickr.com/photos/vfsdigitaldesign/ Licence: CC-BY-2.0Messiness: 0.15573
Ambiguity (Chamfer): 0.07173
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector → Stroke Aggregator | Real-Time Inking | Poly Vector | Topology Driven | Stroke Aggregator | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00063 |  distance: 0.00074 |  distance: 0.0008 |  distance: 0.00083 |  distance: 0.00087 |  distance: 0.00092 |  distance: 0.00184 |  distance: 0.00211 |  distance: 0.01565 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Topology Driven → Stroke Aggregator | 0.002113002770794646 | distance: 0.00211variant: original | 127.0 |
| Topology Driven | 0.0008705371022164138 | distance: 0.00087variant: vectorized (shape strokes) 1000px | 10.0 |
| Delaunay Triangulation | 0.0018376334767342343 | distance: 0.00184variant: vectorized (shape strokes) 1000px | 2.0 |
| Fidelity Simplicity | 0.015647615200845923 | distance: 0.01565variant: vectorized (shape strokes) 1000pxalg. parameter: 0.75 | 164.0 |
| Mastering Sketching | 0.000625694772100078 | distance: 0.00063variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.00074398208398024 | distance: 0.00074variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 67.0 |
| Poly Vector | 0.0008312807106166275 | distance: 0.00083variant: vectorized (shape strokes) 1000px | 71.0 |
| Real-Time Inking | 0.0008006790572508928 | distance: 0.0008variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.0009211951812998842 | distance: 0.00092variant: vectorized (shape strokes) | 174.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.12406828564558788 |  distance: 0.12407variant: vectorized (all layers) 500pxalg. parameter: 0.3 | 95.0 |
| Delaunay Triangulation | 0.3656309200924027 |  distance: 0.36563variant: original | 3.0 |
| Mastering Sketching | 0.5579967762366677 |  distance: 0.558variant: original | 5.0 |
| Poly Vector → Stroke Aggregator | 0.3248921423108593 |  distance: 0.32489variant: vectorized (shape strokes) 500px | 10.0 |
| Poly Vector | 0.3495391181655592 |  distance: 0.34954variant: vectorized (shape strokes) 500px | 45.0 |
| Real-Time Inking | 0.4778288451001274 |  distance: 0.47783variant: original | 2.0 |
| Stroke Aggregator | 0.6484160778645162 | distance: 0.64842variant: vectorized (shape strokes) | 174.0 |
| Topology Driven → Stroke Aggregator | 0.4349355103946671 |  distance: 0.43494variant: vectorized (all layers) 500px | 292.0 |
| Topology Driven | 0.5395919472033317 |  distance: 0.53959variant: original | 18.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.17540768561605058 |  distance: 0.17541variant: thresholded 500pxalg. parameter: 0.5 | 99.0 |
| Poly Vector → Stroke Aggregator | 0.5892417157284324 | distance: 0.58924variant: vectorized (shape strokes) 500px | 10.0 |
| Poly Vector | 0.5881600220881242 |  distance: 0.58816variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 44.0 |
| Delaunay Triangulation | 0.5549808246100094 |  distance: 0.55498variant: vectorized (all layers) 500px | 0.0 |
| Mastering Sketching | 0.8431876174186935 | distance: 0.84319variant: original | 5.0 |
| Real-Time Inking | 0.8146662024494401 |  distance: 0.81467variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9155335029737623 | distance: 0.91553variant: vectorized (shape strokes) | 174.0 |
| Topology Driven → Stroke Aggregator | 0.7031160082941577 | distance: 0.70312variant: vectorized (all layers) 500px | 292.0 |
| Topology Driven | 0.7896948221589207 |  distance: 0.78969variant: vectorized (all layers) 500px | 7.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2158873698611529 | distance: 0.21589variant: thresholded 500pxalg. parameter: 0.5 | 99.0 |
| Mastering Sketching | 0.9123710554867226 | distance: 0.91237variant: original | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6210191082802548 | distance: 0.62102variant: vectorized (shape strokes) 500px | 10.0 |
| Poly Vector | 0.6237584425903854 | distance: 0.62376variant: vectorized (shape strokes) 500px | 45.0 |
| Real-Time Inking | 0.902154464520124 | distance: 0.90215variant: original | 2.0 |
| Delaunay Triangulation | 0.7031898208648834 | distance: 0.70319variant: vectorized (all layers) 500px | 0.0 |
| Stroke Aggregator | 0.9790703346998394 | distance: 0.97907variant: vectorized (shape strokes) | 174.0 |
| Topology Driven → Stroke Aggregator | 0.8563872933630398 | distance: 0.85639variant: vectorized (all layers) 500px | 292.0 |
| Topology Driven | 0.8874637658793724 | distance: 0.88746variant: vectorized (all layers) 500px | 7.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2506372132540357 |  distance: 0.25064variant: thresholded 500pxalg. parameter: 0.3 | 99.0 |
| Delaunay Triangulation | 0.7876099225620159 | distance: 0.78761variant: vectorized (all layers) 500px | 0.0 |
| Poly Vector → Stroke Aggregator | 0.6489859594383776 | distance: 0.64899variant: vectorized (shape strokes) 500px | 10.0 |
| Poly Vector | 0.6495126705653022 | distance: 0.64951variant: vectorized (shape strokes) 500px | 45.0 |
| Real-Time Inking | 0.92767927116412 | distance: 0.92768variant: original | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9244859810417956 |  distance: 0.92449variant: thresholded 500px | 120.0 |
| Mastering Sketching | 0.9423565143897018 |  distance: 0.94236variant: vectorized (all layers) 1000px | 5.0 |
| Stroke Aggregator | 0.9863109331240782 | distance: 0.98631variant: vectorized (shape strokes) | 174.0 |
| Topology Driven | 0.9234848932242604 | distance: 0.92348variant: vectorized (all layers) 500px | 7.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2726510067114094 | distance: 0.27265variant: thresholded 500pxalg. parameter: 0.5 | 99.0 |
| Delaunay Triangulation | 0.8562311319884657 | distance: 0.85623variant: vectorized (all layers) 500px | 0.0 |
| Mastering Sketching | 0.9621904006972738 | distance: 0.96219variant: original | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6758409785932722 | distance: 0.67584variant: vectorized (shape strokes) 500px | 10.0 |
| Poly Vector | 0.6753346080305928 | distance: 0.67533variant: vectorized (shape strokes) 500px | 45.0 |
| Real-Time Inking | 0.9485714120643942 | distance: 0.94857variant: original | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9566299789001392 | distance: 0.95663variant: thresholded 500px | 120.0 |
| Stroke Aggregator | 0.9891566204108888 | distance: 0.98916variant: vectorized (shape strokes) | 174.0 |
| Topology Driven | 0.9508615593875334 | distance: 0.95086variant: vectorized (all layers) 500px | 7.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.022803508758544918 | distance: 0.0228variant: vectorized (shape strokes) 1000px | 2.0 |
| Fidelity Simplicity | 0.20554318237304686 |  distance: 0.20554variant: vectorized (shape strokes) 500pxalg. parameter: 0.6 | 118.0 |
| Real-Time Inking | 0.01 |  distance: 0.01variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | 0.01164167598066037 | distance: 0.01164variant: vectorized (shape strokes) | 174.0 |
| Topology Driven → Stroke Aggregator | 0.02009975051879883 | distance: 0.0201variant: vectorized (all layers) 500px | 292.0 |
| Topology Driven | 0.008485280990600584 | distance: 0.00849variant: vectorized (shape strokes) 1000px | 10.0 |
| Poly Vector → Stroke Aggregator | 0.007280109882354736 | distance: 0.00728variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 67.0 |
| Poly Vector | 0.007615773200988768 |  distance: 0.00762variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 79.0 |
| Mastering Sketching | 0.01811077117919922 |  distance: 0.01811variant: thresholded 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
 |
 |
 |
 |
 |
|
 |
 |
|
 |
 |
|
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| thresholded 500px | |
 |
|
|
 |
|
 |
 |
 |
 |
 |
 |
 |
||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 500px | |
|
 |
|
 |
 |
 |
 |
|
 |
 |
|
 |
||
| vectorized (shape strokes) 1000px | |
|
 |
 |
 |
|
 |
|
|
|
|
|
 |
||
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
|
 |
|
|
 |
|
|||
| vectorized (shape strokes) | |