A Benchmark for Rough Sketch Cleanup
Art_logo_JST_05
Author: Jakub Steiner Author Homepage: https://www.flickr.com/photos/jakubsteiner/ Licence: CC-BY-SA 2.0Messiness: 0.60201
Ambiguity (Chamfer): 0.11124
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Topology Driven | Poly Vector | Stroke Aggregator | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00193 |  distance: 0.00204 |  distance: 0.00218 |  distance: 0.00231 |  distance: 0.00244 |  distance: 0.0027 |  distance: 0.00335 |  distance: 0.00339 |  distance: 0.00399 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  |  | |||
| Liliya Larsen |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.003987485357690022 | distance: 0.00399variant: vectorized (shape strokes) 1000px | 20.0 |
| Fidelity Simplicity | 0.003389927385573109 | distance: 0.00339variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 178.0 |
| Mastering Sketching | 0.0019301665928637577 | distance: 0.00193variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.002305712223479629 | distance: 0.00231variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 524.0 |
| Real-Time Inking | 0.002036618839781929 | distance: 0.00204variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.0024432502753470565 | distance: 0.00244variant: vectorized (shape strokes) | 912.0 |
| Topology Driven → Stroke Aggregator | 0.0033534767756929185 | distance: 0.00335variant: vectorized (shape strokes) 500px | 667.0 |
| Topology Driven | 0.0021834470853507107 | distance: 0.00218variant: vectorized (shape strokes) 1000px | 79.0 |
| Poly Vector → Stroke Aggregator | 0.002701517497777521 | distance: 0.0027variant: vectorized (shape strokes) 500px | 56.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.5264115266639662 |  distance: 0.52641variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.43106949645086573 |  distance: 0.43107variant: vectorized (all layers) 1000px | 1016.0 |
| Real-Time Inking | 0.4656085233236633 |  distance: 0.46561variant: thresholded | 3.0 |
| Topology Driven | 0.25992825521684965 |  distance: 0.25993variant: thresholded | 516.0 |
| Delaunay Triangulation | 0.26350084747018954 |  distance: 0.2635variant: original | 28.0 |
| Fidelity Simplicity | 0.21714169918483064 |  distance: 0.21714variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 175.0 |
| Poly Vector → Stroke Aggregator | 0.5259709211150887 |  distance: 0.52597variant: thresholded 500pxalg. parameter: noisy | 90.0 |
| Stroke Aggregator | 0.5372323607384047 | distance: 0.53723variant: vectorized (shape strokes) | 912.0 |
| Topology Driven → Stroke Aggregator | 0.5332061778935616 | distance: 0.53321variant: vectorized (shape strokes) 500px | 667.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.6747581263810051 | distance: 0.67476variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.6039898956118785 |  distance: 0.60399variant: vectorized (all layers) 1000pxalg. parameter: noisy | 1162.0 |
| Real-Time Inking | 0.7103989587492455 | distance: 0.7104variant: thresholded | 3.0 |
| Topology Driven → Stroke Aggregator | 0.7168607294111 | distance: 0.71686variant: vectorized (shape strokes) 500px | 667.0 |
| Topology Driven | 0.4564884658204826 | distance: 0.45649variant: thresholded | 516.0 |
| Delaunay Triangulation | 0.4559365576922882 |  distance: 0.45594variant: vectorized (all layers) 500px | 7.0 |
| Fidelity Simplicity | 0.33471907809113444 | distance: 0.33472variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 175.0 |
| Poly Vector → Stroke Aggregator | 0.6975439750534658 |  distance: 0.69754variant: vectorized (all layers) 500pxalg. parameter: noisy | 126.0 |
| Stroke Aggregator | 0.762104585997122 | distance: 0.7621variant: vectorized (shape strokes) | 912.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5961146123947313 | distance: 0.59611variant: vectorized (all layers) 500px | 7.0 |
| Real-Time Inking | 0.8086251635606534 |  distance: 0.80863variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.7632503730804409 | distance: 0.76325variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.7112497420245555 | distance: 0.71125variant: vectorized (all layers) 1000pxalg. parameter: noisy | 1162.0 |
| Topology Driven → Stroke Aggregator | 0.8461646685167671 | distance: 0.84616variant: vectorized (shape strokes) 500px | 667.0 |
| Topology Driven | 0.5785960597616603 |  distance: 0.5786variant: thresholded 1000px | 612.0 |
| Fidelity Simplicity | 0.4259461801922031 |  distance: 0.42595variant: vectorized (all layers) 500pxalg. parameter: 0.3 | 124.0 |
| Poly Vector → Stroke Aggregator | 0.8021537416223372 | distance: 0.80215variant: vectorized (all layers) 500pxalg. parameter: noisy | 126.0 |
| Stroke Aggregator | 0.8582180195362692 | distance: 0.85822variant: vectorized (shape strokes) | 912.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.850532405605143 | distance: 0.85053variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.8113997547942353 | distance: 0.8114variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8481887898805244 |  distance: 0.84819variant: vectorized (all layers) 500px | 125.0 |
| Poly Vector | 0.7761238848240789 | distance: 0.77612variant: vectorized (all layers) 1000px | 1016.0 |
| Topology Driven → Stroke Aggregator | 0.8980226028543471 | distance: 0.89802variant: vectorized (shape strokes) 500px | 667.0 |
| Topology Driven | 0.6616340086820433 | distance: 0.66163variant: thresholded 1000px | 612.0 |
| Delaunay Triangulation | 0.6844507902129711 | distance: 0.68445variant: vectorized (all layers) 500px | 7.0 |
| Fidelity Simplicity | 0.4902938335571294 | distance: 0.49029variant: vectorized (all layers) 500pxalg. parameter: 0.3 | 124.0 |
| Stroke Aggregator | 0.9016566140223184 | distance: 0.90166variant: vectorized (shape strokes) | 912.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7709391364694503 | distance: 0.77094variant: vectorized (all layers) 500px | 7.0 |
| Real-Time Inking | 0.87726268427225 | distance: 0.87726variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.8506945221106315 | distance: 0.85069variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8841261990608893 | distance: 0.88413variant: vectorized (all layers) 500px | 125.0 |
| Poly Vector | 0.8247554029694338 | distance: 0.82476variant: vectorized (all layers) 1000pxalg. parameter: noisy | 1162.0 |
| Topology Driven → Stroke Aggregator | 0.9311082634962292 | distance: 0.93111variant: vectorized (shape strokes) 500px | 667.0 |
| Topology Driven | 0.7306261166261434 | distance: 0.73063variant: thresholded 1000px | 612.0 |
| Fidelity Simplicity | 0.5566382494654205 |  distance: 0.55664variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 131.0 |
| Stroke Aggregator | 0.9318867988424632 | distance: 0.93189variant: vectorized (shape strokes) | 912.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.04242640686035156 |  distance: 0.04243variant: thresholded 500px | 7.0 |
| Fidelity Simplicity | 0.09202626856361948 |  distance: 0.09203variant: thresholdedalg. parameter: 0.6 | 231.0 |
| Mastering Sketching | 0.44720016479492186 | distance: 0.4472variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.024331050872802733 | distance: 0.02433variant: vectorized (shape strokes) 500px | 56.0 |
| Poly Vector | 0.024331050872802733 |  distance: 0.02433variant: vectorized (shape strokes) 500px | 156.0 |
| Real-Time Inking | 0.039215002602678 | distance: 0.03922variant: thresholded | 3.0 |
| Stroke Aggregator | 0.046192351395521705 | distance: 0.04619variant: vectorized (shape strokes) | 912.0 |
| Topology Driven → Stroke Aggregator | 0.045607017517089836 | distance: 0.04561variant: vectorized (shape strokes) 500px | 667.0 |
| Topology Driven | 0.045607017517089836 |  distance: 0.04561variant: vectorized (shape strokes) 500px | 16.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||||
| thresholded | |
 |
 |
 |
 |
|
|
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
 |
||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
|
|
 |
|||||
| vectorized (all layers) 500px | |
|
|
|
 |
|
 |
 |
 |
 |
|
|
|
||
| vectorized (shape strokes) 1000px | |
 |
|
 |
 |
 |
|
|
 |
|
|||||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
|
 |
|
 |
|
||
| vectorized (shape strokes) | |