A Benchmark for Rough Sketch Cleanup
Ind_architecture_NMC_01
Author: Nancy McClure Author Homepage: https://www.flickr.com/photos/aperte/ Licence: CC-BY-2.0Messiness: 0.0208
Ambiguity (Chamfer): 0.04349
Shading: No
Scaffold: Yes
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Real-Time Inking | Mastering Sketching | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00034 |  distance: 0.00035 |  distance: 0.00058 |  distance: 0.00085 |  distance: 0.00289 |  distance: 0.00401 |  distance: 0.00669 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.002893896506243852 | distance: 0.00289variant: vectorized (all layers) 1000pxalg. parameter: 0.25 | 224.0 |
| Delaunay Triangulation | 0.00668638808285556 | distance: 0.00669variant: vectorized (shape strokes) 1000px | 40.0 |
| Mastering Sketching | 0.0008468944937517207 | distance: 0.00085variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.004011635681601583 | distance: 0.00401variant: vectorized (all layers) 500pxalg. parameter: noisy | 170.0 |
| Poly Vector | 0.0003548945862588264 | distance: 0.00035variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 1075.0 |
| Real-Time Inking | 0.0005784766337265133 | distance: 0.00058variant: vectorized (shape strokes) 1000px | 3.0 |
| Topology Driven | 0.0003427328400911521 | distance: 0.00034variant: original | 1148.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4109331029526389 |  distance: 0.41093variant: thresholded 500pxalg. parameter: 0.75 | 157.0 |
| Mastering Sketching | 0.9006636752169332 |  distance: 0.90066variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5227364363353721 |  distance: 0.52274variant: vectorized (shape strokes) 500px | 124.0 |
| Poly Vector | 0.5437400436675017 |  distance: 0.54374variant: vectorized (shape strokes) 500px | 369.0 |
| Real-Time Inking | 0.6187359823285872 |  distance: 0.61874variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.8727589790161423 |  distance: 0.87276variant: vectorized (shape strokes) 500px | 20.0 |
| Delaunay Triangulation | 0.2110948880587309 |  distance: 0.21109variant: original | 257.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3741200204580326 |  distance: 0.37412variant: vectorized (all layers) 500px | 10.0 |
| Fidelity Simplicity | 0.5834188839794668 | distance: 0.58342variant: thresholded 500pxalg. parameter: 0.75 | 157.0 |
| Poly Vector → Stroke Aggregator | 0.6504927496829882 | distance: 0.65049variant: vectorized (shape strokes) 500px | 124.0 |
| Poly Vector | 0.6660766019623833 |  distance: 0.66608variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 393.0 |
| Real-Time Inking | 0.7527980579908797 | distance: 0.7528variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Mastering Sketching | 0.9645486315274971 |  distance: 0.96455variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven | 0.9484301479341763 |  distance: 0.94843variant: vectorized (all layers) 500px | 21.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4897493127523896 | distance: 0.48975variant: vectorized (all layers) 500px | 10.0 |
| Poly Vector → Stroke Aggregator | 0.7409472574624735 | distance: 0.74095variant: vectorized (shape strokes) 500px | 124.0 |
| Poly Vector | 0.7530679968575252 | distance: 0.75307variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 393.0 |
| Real-Time Inking | 0.8191668124301991 | distance: 0.81917variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Mastering Sketching | 0.9741000136150244 | distance: 0.9741variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven | 0.9693296738755764 | distance: 0.96933variant: vectorized (all layers) 500px | 21.0 |
| Fidelity Simplicity | 0.6516429621156501 |  distance: 0.65164variant: originalalg. parameter: 0.75 | 387.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5715438453623098 | distance: 0.57154variant: vectorized (all layers) 500px | 10.0 |
| Poly Vector → Stroke Aggregator | 0.7975714920257825 | distance: 0.79757variant: vectorized (shape strokes) 500px | 124.0 |
| Poly Vector | 0.8091002876450153 | distance: 0.8091variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 393.0 |
| Real-Time Inking | 0.8582655521593835 | distance: 0.85827variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Mastering Sketching | 0.9789652915602424 | distance: 0.97897variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven | 0.9794430126097532 | distance: 0.97944variant: vectorized (all layers) 500px | 21.0 |
| Fidelity Simplicity | 0.6683785062595813 | distance: 0.66838variant: originalalg. parameter: 0.75 | 387.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6449884513546444 | distance: 0.64499variant: vectorized (all layers) 500px | 10.0 |
| Poly Vector → Stroke Aggregator | 0.8504979831520422 | distance: 0.8505variant: vectorized (shape strokes) 500px | 124.0 |
| Poly Vector | 0.8612552104830001 | distance: 0.86126variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 393.0 |
| Real-Time Inking | 0.8887922648440786 | distance: 0.88879variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Mastering Sketching | 0.9822771261650984 | distance: 0.98228variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven | 0.9850990778889542 |  distance: 0.9851variant: vectorized (all layers) 1000px | 72.0 |
| Fidelity Simplicity | 0.6871974689104932 | distance: 0.6872variant: originalalg. parameter: 0.75 | 387.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.061 | distance: 0.061variant: vectorized (shape strokes) 1000px | 40.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.12624182891845706 |  distance: 0.12624variant: vectorized (all layers) 1000pxalg. parameter: 0.6 | 235.0 |
| Mastering Sketching | 0.020880613327026367 | distance: 0.02088variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0842140121459961 | distance: 0.08421variant: vectorized (shape strokes) 500px | 124.0 |
| Poly Vector | 0.016763053894042968 | distance: 0.01676variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 1075.0 |
| Real-Time Inking | 0.01835755920410156 | distance: 0.01836variant: vectorized (shape strokes) 1000px | 3.0 |
| Topology Driven | 0.015231546401977537 | distance: 0.01523variant: vectorized (shape strokes) 500px | 20.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
|
 |
|
|
|||||||
| thresholded | |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| thresholded 500px |  |
|
 |
 |
 |
|
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 1000px |  |
 |
|
 |
 |
|
|
 |
 |
 |
|||||
| vectorized (all layers) 500px |  |
|
 |
 |
 |
 |
 |
|
 |
 |
|
|
|||
| vectorized (shape strokes) 1000px | |
 |
 |
 |
 |
 |
|
 |
|
||||||
| vectorized (shape strokes) 500px |  |
|
 |
 |
 |
 |
 |
|
|
|
 |
|