A Benchmark for Rough Sketch Cleanup
Art_logo_VFS_08
Author: VFS Digital Design Author Homepage: https://www.flickr.com/photos/vfsdigitaldesign/ Licence: CC-BY-2.0Messiness: 0.03474
Ambiguity (Chamfer): 0.09365
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Mastering Sketching | Topology Driven | Poly Vector | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00148 |  distance: 0.00152 |  distance: 0.00161 |  distance: 0.00163 |  distance: 0.00166 |  distance: 0.00172 |  distance: 0.00212 |  distance: 0.00256 |  distance: 0.00264 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.0025590334701779804 | distance: 0.00256variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 129.0 |
| Poly Vector → Stroke Aggregator | 0.0016572758452944752 | distance: 0.00166variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 68.0 |
| Poly Vector | 0.0016277355363089894 | distance: 0.00163variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 123.0 |
| Topology Driven → Stroke Aggregator | 0.0017196627441003185 | distance: 0.00172variant: vectorized (shape strokes) 1000px | 142.0 |
| Topology Driven | 0.0016103288597212678 | distance: 0.00161variant: vectorized (shape strokes) 1000px | 6.0 |
| Delaunay Triangulation | 0.002123234101082789 | distance: 0.00212variant: vectorized (shape strokes) 1000px | 2.0 |
| Mastering Sketching | 0.0015169848186085886 | distance: 0.00152variant: thresholded | 5.0 |
| Real-Time Inking | 0.0014816293275802931 | distance: 0.00148variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.002642566564822664 | distance: 0.00264variant: vectorized (shape strokes) | 68.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.618080527901055 | distance: 0.61808variant: thresholded | 5.0 |
| Topology Driven → Stroke Aggregator | 0.5166691182574578 |  distance: 0.51667variant: thresholded | 132.0 |
| Topology Driven | 0.3906658686822536 |  distance: 0.39067variant: original | 67.0 |
| Delaunay Triangulation | 0.2782557841219748 |  distance: 0.27826variant: vectorized (all layers) 500px | 0.0 |
| Fidelity Simplicity | 0.4529842875803361 |  distance: 0.45298variant: originalalg. parameter: 0.75 | 222.0 |
| Poly Vector → Stroke Aggregator | 0.2539523118164303 |  distance: 0.25395variant: vectorized (all layers) 500px | 10.0 |
| Poly Vector | 0.2516582527984005 |  distance: 0.25166variant: vectorized (shape strokes) 500px | 34.0 |
| Real-Time Inking | 0.41435738041971576 |  distance: 0.41436variant: original | 2.0 |
| Stroke Aggregator | 0.4864370479687281 | distance: 0.48644variant: vectorized (shape strokes) | 68.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4658210839963422 | distance: 0.46582variant: vectorized (all layers) 500px | 0.0 |
| Mastering Sketching | 0.8528952163741543 | distance: 0.8529variant: thresholded | 5.0 |
| Real-Time Inking | 0.6292060829335215 | distance: 0.62921variant: original | 2.0 |
| Stroke Aggregator | 0.7889762996333926 | distance: 0.78898variant: vectorized (shape strokes) | 68.0 |
| Topology Driven → Stroke Aggregator | 0.7323778326881242 |  distance: 0.73238variant: vectorized (shape strokes) 500px | 49.0 |
| Topology Driven | 0.6266314805110305 | distance: 0.62663variant: original | 67.0 |
| Fidelity Simplicity | 0.6402879863330203 |  distance: 0.64029variant: thresholded 500pxalg. parameter: 0.75 | 169.0 |
| Poly Vector → Stroke Aggregator | 0.3574449002807369 | distance: 0.35744variant: vectorized (all layers) 500px | 10.0 |
| Poly Vector | 0.3501507602508909 |  distance: 0.35015variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 34.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6248367302395372 | distance: 0.62484variant: vectorized (all layers) 500px | 0.0 |
| Mastering Sketching | 0.9316746114332471 | distance: 0.93167variant: thresholded | 5.0 |
| Real-Time Inking | 0.7185910915279711 | distance: 0.71859variant: original | 2.0 |
| Stroke Aggregator | 0.880772364448266 | distance: 0.88077variant: vectorized (shape strokes) | 68.0 |
| Topology Driven → Stroke Aggregator | 0.8481159460534291 |  distance: 0.84812variant: thresholded 500px | 110.0 |
| Topology Driven | 0.7269738291741751 | distance: 0.72697variant: original | 67.0 |
| Poly Vector → Stroke Aggregator | 0.4382385967419041 | distance: 0.43824variant: vectorized (all layers) 500px | 10.0 |
| Fidelity Simplicity | 0.7610100984039321 |  distance: 0.76101variant: thresholded 500pxalg. parameter: 0.5 | 129.0 |
| Poly Vector | 0.42916683224967705 | distance: 0.42917variant: vectorized (shape strokes) 500px | 34.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7055922105634912 | distance: 0.70559variant: vectorized (all layers) 500px | 0.0 |
| Mastering Sketching | 0.9669471284503064 | distance: 0.96695variant: thresholded | 5.0 |
| Poly Vector | 0.4824717031285738 | distance: 0.48247variant: vectorized (shape strokes) 500px | 34.0 |
| Real-Time Inking | 0.7714034455193937 | distance: 0.7714variant: original | 2.0 |
| Stroke Aggregator | 0.9249082853763436 | distance: 0.92491variant: vectorized (shape strokes) | 68.0 |
| Topology Driven → Stroke Aggregator | 0.8978769656084968 | distance: 0.89788variant: thresholded 500px | 110.0 |
| Poly Vector → Stroke Aggregator | 0.4958070738223189 | distance: 0.49581variant: vectorized (all layers) 500px | 10.0 |
| Fidelity Simplicity | 0.8125259974592753 |  distance: 0.81253variant: thresholded 500pxalg. parameter: 0.3 | 130.0 |
| Topology Driven | 0.7887753564734566 | distance: 0.78878variant: original | 67.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7707846254559058 | distance: 0.77078variant: vectorized (all layers) 500px | 0.0 |
| Mastering Sketching | 0.9806462087382788 | distance: 0.98065variant: thresholded | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5547630526792465 | distance: 0.55476variant: vectorized (all layers) 500px | 10.0 |
| Poly Vector | 0.5347040296268071 | distance: 0.5347variant: vectorized (shape strokes) 500px | 34.0 |
| Real-Time Inking | 0.8004628980555367 | distance: 0.80046variant: original | 2.0 |
| Stroke Aggregator | 0.9530769010825086 | distance: 0.95308variant: vectorized (shape strokes) | 68.0 |
| Topology Driven | 0.8177003673044432 | distance: 0.8177variant: original | 67.0 |
| Topology Driven → Stroke Aggregator | 0.9364813986689344 | distance: 0.93648variant: thresholded | 132.0 |
| Fidelity Simplicity | 0.8623139278893117 | distance: 0.86231variant: thresholded 500pxalg. parameter: 0.3 | 130.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.03939543151855469 |  distance: 0.0394variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 106.0 |
| Mastering Sketching | 0.3904664001464844 |  distance: 0.39047variant: vectorized (shape strokes) 500px | 6.0 |
| Delaunay Triangulation | 0.024413110733032227 | distance: 0.02441variant: vectorized (shape strokes) 1000px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.016492422103881837 | distance: 0.01649variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 68.0 |
| Poly Vector | 0.016401220321655273 | distance: 0.0164variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 123.0 |
| Real-Time Inking | 0.016401220321655273 | distance: 0.0164variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.02552369269410509 | distance: 0.02552variant: vectorized (shape strokes) | 68.0 |
| Topology Driven → Stroke Aggregator | 0.016401220321655273 | distance: 0.0164variant: vectorized (shape strokes) 1000px | 142.0 |
| Topology Driven | 0.014764822959899903 |  distance: 0.01476variant: vectorized (all layers) 1000px | 18.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
|
 |
|
 |
 |
 |
||||
| thresholded | |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 500px | |
 |
 |
|
 |
|
|
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
||||
| vectorized (all layers) 500px |  |
 |
 |
|
 |
 |
 |
 |
 |
 |
|
|
|||
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
|
 |
|
|
|||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
 |
|
|
 |
|||
| vectorized (shape strokes) | |