A Benchmark for Rough Sketch Cleanup
Ind_architecture_AST_02
Author: Alexander Strugach Author Homepage: https://www.flickr.com/photos/alexander_str/ Licence: CC-BY-2.0Messiness: 0.50487
Ambiguity (Chamfer): 0.3341
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Topology Driven | Poly Vector | Fidelity Simplicity | Delaunay Triangulation | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00321 |  distance: 0.00399 |  distance: 0.00478 |  distance: 0.00505 |  distance: 0.00523 |  distance: 0.00654 |  distance: 0.00724 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Liliya Larsen |  | |  | ||||
| Maria Hegedus |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.006538088915492043 | distance: 0.00654variant: thresholded 1000px | 32.0 |
| Mastering Sketching | 0.003211537709411653 | distance: 0.00321variant: thresholded 1000px | 6.0 |
| Poly Vector | 0.005053908242297221 | distance: 0.00505variant: thresholded 500pxalg. parameter: noisy | 409.0 |
| Real-Time Inking | 0.003993820767493343 | distance: 0.00399variant: thresholded 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.004781226459362914 | distance: 0.00478variant: thresholded 500px | 39.0 |
| Fidelity Simplicity | 0.00523166620345021 | distance: 0.00523variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 176.0 |
| Poly Vector → Stroke Aggregator | 0.007241892838649645 | distance: 0.00724variant: vectorized (shape strokes) 500px | 239.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.29761022710574925 |  distance: 0.29761variant: original | 17.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.17469335518171436 |  distance: 0.17469variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.1775570109221196 |  distance: 0.17756variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 157.0 |
| Mastering Sketching | 0.4923050401421637 |  distance: 0.49231variant: vectorized (all layers) 1000px | 9.0 |
| Poly Vector → Stroke Aggregator | 0.42672801501472174 | distance: 0.42673variant: vectorized (shape strokes) 500px | 239.0 |
| Poly Vector | 0.4157839754608377 | distance: 0.41578variant: thresholded 500pxalg. parameter: noisy | 409.0 |
| Topology Driven | 0.014736604385927743 |  distance: 0.01474variant: original | 300.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Real-Time Inking | 0.3956978748903264 | distance: 0.3957variant: original | 17.0 |
| Topology Driven | 0.030094402600967962 | distance: 0.03009variant: original | 300.0 |
| Delaunay Triangulation | 0.2981863548262098 | distance: 0.29819variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.269866194762855 |  distance: 0.26987variant: vectorized (all layers) 500pxalg. parameter: 0.3 | 134.0 |
| Mastering Sketching | 0.6477451540020429 |  distance: 0.64775variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5583825559950105 | distance: 0.55838variant: vectorized (shape strokes) 500px | 239.0 |
| Poly Vector | 0.5616397009216335 | distance: 0.56164variant: thresholded 500pxalg. parameter: noisy | 409.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Poly Vector → Stroke Aggregator | 0.6417886914030654 | distance: 0.64179variant: vectorized (shape strokes) 500px | 239.0 |
| Poly Vector | 0.659540835451901 |  distance: 0.65954variant: thresholded 500px | 398.0 |
| Real-Time Inking | 0.44539723820920457 | distance: 0.4454variant: original | 17.0 |
| Topology Driven | 0.04560165075575715 | distance: 0.0456variant: original | 300.0 |
| Delaunay Triangulation | 0.4222248765710823 | distance: 0.42222variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.3632628271705766 |  distance: 0.36326variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 140.0 |
| Mastering Sketching | 0.7365017626851121 |  distance: 0.7365variant: vectorized (shape strokes) 500px | 5.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Mastering Sketching | 0.7838909632269645 | distance: 0.78389variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7021315124630076 | distance: 0.70213variant: vectorized (shape strokes) 500px | 239.0 |
| Poly Vector | 0.723984470040708 | distance: 0.72398variant: thresholded 500pxalg. parameter: noisy | 409.0 |
| Real-Time Inking | 0.499774454359684 | distance: 0.49977variant: original | 17.0 |
| Topology Driven | 0.06455566080940303 | distance: 0.06456variant: original | 300.0 |
| Delaunay Triangulation | 0.5091343714537688 | distance: 0.50913variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.43933721560529904 | distance: 0.43934variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 157.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.8206252205692012 | distance: 0.82063variant: vectorized (shape strokes) 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Poly Vector → Stroke Aggregator | 0.7598582173692945 | distance: 0.75986variant: vectorized (shape strokes) 500px | 239.0 |
| Poly Vector | 0.7842810670896646 | distance: 0.78428variant: thresholded 500pxalg. parameter: noisy | 409.0 |
| Real-Time Inking | 0.5489457425343921 | distance: 0.54895variant: original | 17.0 |
| Topology Driven | 0.08632545417878774 | distance: 0.08633variant: original | 300.0 |
| Delaunay Triangulation | 0.5751836457439091 |  distance: 0.57518variant: vectorized (all layers) 1000px | 39.0 |
| Fidelity Simplicity | 0.5194035308406167 | distance: 0.5194variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 157.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0600333251953125 |  distance: 0.06003variant: thresholded 500px | 5.0 |
| Poly Vector | 0.0684689712524414 | distance: 0.06847variant: thresholded 500pxalg. parameter: noisy | 409.0 |
| Real-Time Inking | 0.08841986887933627 |  distance: 0.08842variant: thresholded | 6.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.07764663696289062 |  distance: 0.07765variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 205.0 |
| Mastering Sketching | 0.3640054931640625 | distance: 0.36401variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.08459314727783203 | distance: 0.08459variant: vectorized (shape strokes) 500px | 239.0 |
| Topology Driven | 0.102956298828125 | distance: 0.10296variant: thresholded 500px | 39.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|||||||||||||
| thresholded | |
||||||||||||||
| thresholded 1000px | |
|
 |
 |
 |
 |
 |
 |
|
||||||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
|
|
|
|
||||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
|
 |
 |
|
||||||
| vectorized (all layers) 500px |  |
|
|
|
 |
|
 |
 |
 |
 |
|
||||
| vectorized (shape strokes) 1000px |  |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (shape strokes) 500px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
|