A Benchmark for Rough Sketch Cleanup
Ind_architecture_AST_05
Author: Alexander Strugach Author Homepage: https://www.flickr.com/photos/alexander_str/ Licence: CC-BY-2.0Messiness: 0.43862
Ambiguity (Chamfer): 0.0545
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Mastering Sketching | Topology Driven | Poly Vector | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00123 |  distance: 0.00136 |  distance: 0.0015 |  distance: 0.00152 |  distance: 0.00205 |  distance: 0.0031 |  distance: 0.00512 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  |  | |||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.002051770841341712 | distance: 0.00205variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 192.0 |
| Mastering Sketching | 0.00136022092903891 | distance: 0.00136variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.003098784099036996 | distance: 0.0031variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 141.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.005122104742846735 | distance: 0.00512variant: vectorized (shape strokes) 1000px | 25.0 |
| Poly Vector | 0.0015227199739695596 | distance: 0.00152variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 627.0 |
| Real-Time Inking | 0.001229577673764925 | distance: 0.00123variant: original | 17.0 |
| Topology Driven | 0.0015027283700692069 | distance: 0.0015variant: vectorized (shape strokes) 1000px | 61.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.17997673842251433 |  distance: 0.17998variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 217.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.20315209853341848 |  distance: 0.20315variant: thresholded 500px | 8.0 |
| Mastering Sketching | 0.5685758376272455 |  distance: 0.56858variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.5863198469778421 | distance: 0.58632variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 141.0 |
| Poly Vector | 0.4972598524073164 |  distance: 0.49726variant: thresholded 500pxalg. parameter: noisy | 1200.0 |
| Real-Time Inking | 0.4375184200672306 |  distance: 0.43752variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.5091331339432343 |  distance: 0.50913variant: thresholded 1000px | 1226.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.29293088185020905 |  distance: 0.29293variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 201.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.3587418663258141 | distance: 0.35874variant: thresholded 500px | 8.0 |
| Mastering Sketching | 0.7451238694448594 | distance: 0.74512variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.7640532474339526 | distance: 0.76405variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 141.0 |
| Poly Vector | 0.6240398065667876 |  distance: 0.62404variant: thresholded 500px | 1158.0 |
| Real-Time Inking | 0.5921107814639247 | distance: 0.59211variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.6835552896593876 | distance: 0.68356variant: thresholded 1000px | 1226.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.4968256751646318 |  distance: 0.49683variant: vectorized (all layers) 500px | 13.0 |
| Fidelity Simplicity | 0.399107974618704 | distance: 0.39911variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 201.0 |
| Mastering Sketching | 0.842498815022604 | distance: 0.8425variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.8510609532273508 | distance: 0.85106variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 141.0 |
| Poly Vector | 0.7262066491648382 | distance: 0.72621variant: thresholded 500pxalg. parameter: noisy | 1200.0 |
| Real-Time Inking | 0.6986094985724377 | distance: 0.69861variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.7972235144578518 | distance: 0.79722variant: thresholded 1000px | 1226.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.5935321997869196 | distance: 0.59353variant: vectorized (all layers) 500px | 13.0 |
| Fidelity Simplicity | 0.4796156846339808 | distance: 0.47962variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 217.0 |
| Mastering Sketching | 0.9014874530299652 |  distance: 0.90149variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.899928086842775 | distance: 0.89993variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 141.0 |
| Poly Vector | 0.7903628926011821 | distance: 0.79036variant: thresholded 500pxalg. parameter: noisy | 1200.0 |
| Real-Time Inking | 0.7515531290028967 | distance: 0.75155variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.8653415425059533 | distance: 0.86534variant: thresholded 1000px | 1226.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.7017107223387343 | distance: 0.70171variant: vectorized (all layers) 500px | 13.0 |
| Fidelity Simplicity | 0.5639754354760889 |  distance: 0.56398variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 148.0 |
| Mastering Sketching | 0.9414600199697928 | distance: 0.94146variant: thresholded 1000px | 6.0 |
| Poly Vector | 0.8617506482280591 | distance: 0.86175variant: thresholded 500px | 1158.0 |
| Real-Time Inking | 0.8010754360992765 | distance: 0.80108variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.9139389222187841 | distance: 0.91394variant: thresholded 1000px | 1226.0 |
| Poly Vector → Stroke Aggregator | 0.9328333512299928 | distance: 0.93283variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 141.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.044777225494384766 | distance: 0.04478variant: vectorized (shape strokes) 1000px | 25.0 |
| Poly Vector | 0.034365680694580084 | distance: 0.03437variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 627.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.0342344856262207 |  distance: 0.03423variant: vectorized (shape strokes) 500px | 16.0 |
| Fidelity Simplicity | 0.03736308288574219 |  distance: 0.03736variant: vectorized (shape strokes) 1000pxalg. parameter: 0.75 | 259.0 |
| Mastering Sketching | 0.4746914672851562 |  distance: 0.47469variant: thresholded 500px | 5.0 |
| Real-Time Inking | 0.0211231324059763 | distance: 0.02112variant: original | 17.0 |
| Poly Vector → Stroke Aggregator | 0.04440720748901368 |  distance: 0.04441variant: vectorized (shape strokes) 500px | 140.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
||||||||||||||
| thresholded |  |
||||||||||||||
| thresholded 1000px |  |
|
 |
 |
 |
 |
 |
|
 |
||||||
| thresholded 500px |  |
|
 |
 |
 |
 |
 |
 |
|
|
|
||||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
 |
|||||||
| vectorized (all layers) 500px | |
 |
 |
|
 |
|
|
 |
|
||||||
| vectorized (shape strokes) 1000px |  |
|
|
 |
 |
|
 |
|
|
 |
|
||||
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
|
|