A Benchmark for Rough Sketch Cleanup
Ind_architecture_JJ_04
Author: Jinho Jung Author Homepage: https://www.flickr.com/photos/phploveme/ Licence: CC-BY-SA-2.0Messiness: 0.12263
Ambiguity (Chamfer): 0.10679
Shading: No
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Real-Time Inking | Poly Vector → Stroke Aggregator | Mastering Sketching | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00204 |  distance: 0.00205 |  distance: 0.00229 |  distance: 0.00232 |  distance: 0.0024 |  distance: 0.00297 |  distance: 0.00456 |  distance: 0.00493 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.0022887715289840235 | distance: 0.00229variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.004561071842076167 | distance: 0.00456variant: vectorized (shape strokes) 1000px | 19.0 |
| Fidelity Simplicity | 0.0049327769141404975 | distance: 0.00493variant: vectorized (all layers) 1000pxalg. parameter: 0.25 | 231.0 |
| Mastering Sketching | 0.0023955427542641378 | distance: 0.0024variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.002052984705216143 | distance: 0.00205variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 453.0 |
| Topology Driven → Stroke Aggregator | 0.002967206195871353 | distance: 0.00297variant: vectorized (shape strokes) 500px | 518.0 |
| Topology Driven | 0.0020375140547467907 | distance: 0.00204variant: vectorized (shape strokes) 1000px | 33.0 |
| Poly Vector → Stroke Aggregator | 0.0023248111939096995 | distance: 0.00232variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 840.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.4255190326260148 |  distance: 0.42552variant: vectorized (shape strokes) 500px | 44.0 |
| Poly Vector | 0.4447185375969096 |  distance: 0.44472variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 137.0 |
| Real-Time Inking | 0.2864349219307866 |  distance: 0.28643variant: original | 8.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5716833941296594 | distance: 0.57168variant: vectorized (shape strokes) 500px | 518.0 |
| Topology Driven | 0.10255112915835778 |  distance: 0.10255variant: original | 172.0 |
| Fidelity Simplicity | 0.3843514993454872 |  distance: 0.38435variant: thresholded 500pxalg. parameter: 0.75 | 147.0 |
| Delaunay Triangulation | 0.2651321045960519 |  distance: 0.26513variant: vectorized (all layers) 500px | 7.0 |
| Mastering Sketching | 0.707535191754812 |  distance: 0.70754variant: vectorized (all layers) 500px | 5.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.5461006431353456 | distance: 0.5461variant: vectorized (shape strokes) 500px | 44.0 |
| Poly Vector | 0.5624398672339807 | distance: 0.56244variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 137.0 |
| Real-Time Inking | 0.3509281997297024 | distance: 0.35093variant: original | 8.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.15685015741299396 | distance: 0.15685variant: original | 172.0 |
| Fidelity Simplicity | 0.5574053239829442 | distance: 0.55741variant: thresholded 500pxalg. parameter: 0.75 | 147.0 |
| Delaunay Triangulation | 0.4108629243789189 | distance: 0.41086variant: vectorized (all layers) 500px | 7.0 |
| Mastering Sketching | 0.7928928675298442 | distance: 0.79289variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.7264137414122938 |  distance: 0.72641variant: vectorized (all layers) 500px | 716.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.6312567454325125 |  distance: 0.63126variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 42.0 |
| Poly Vector | 0.6456348347740064 | distance: 0.64563variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 137.0 |
| Real-Time Inking | 0.39379249505616093 | distance: 0.39379variant: original | 8.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.20945769288714614 | distance: 0.20946variant: original | 172.0 |
| Fidelity Simplicity | 0.6713972700087216 | distance: 0.6714variant: thresholded 500pxalg. parameter: 0.75 | 147.0 |
| Delaunay Triangulation | 0.531549337440563 | distance: 0.53155variant: vectorized (all layers) 500px | 7.0 |
| Mastering Sketching | 0.8309192591754733 | distance: 0.83092variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.8056871280592834 | distance: 0.80569variant: vectorized (all layers) 500px | 716.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.6944848050437212 | distance: 0.69448variant: vectorized (shape strokes) 500px | 44.0 |
| Poly Vector | 0.7065852319882615 |  distance: 0.70659variant: vectorized (shape strokes) 500px | 126.0 |
| Real-Time Inking | 0.4304045769396008 | distance: 0.4304variant: original | 8.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.2627906943274439 | distance: 0.26279variant: original | 172.0 |
| Fidelity Simplicity | 0.7380799314023204 | distance: 0.73808variant: thresholded 500pxalg. parameter: 0.75 | 147.0 |
| Delaunay Triangulation | 0.6175717800627785 | distance: 0.61757variant: vectorized (all layers) 500px | 7.0 |
| Mastering Sketching | 0.8577790523101837 | distance: 0.85778variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.8487693793125805 | distance: 0.84877variant: vectorized (all layers) 500px | 716.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7739433969015395 |  distance: 0.77394variant: vectorized (shape strokes) 1000pxalg. parameter: 0.75 | 168.0 |
| Poly Vector → Stroke Aggregator | 0.7477788347962948 | distance: 0.74778variant: vectorized (shape strokes) 500px | 44.0 |
| Poly Vector | 0.758818655514486 | distance: 0.75882variant: vectorized (shape strokes) 500px | 126.0 |
| Real-Time Inking | 0.473293102760676 | distance: 0.47329variant: original | 8.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.313240266266786 | distance: 0.31324variant: original | 172.0 |
| Delaunay Triangulation | 0.6988505905415945 | distance: 0.69885variant: vectorized (all layers) 500px | 7.0 |
| Mastering Sketching | 0.8816806500627602 | distance: 0.88168variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.8791288452242702 | distance: 0.87913variant: vectorized (all layers) 500px | 716.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.064 | distance: 0.064variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.0607652395887448 | distance: 0.06077variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.062 | distance: 0.062variant: vectorized (all layers) 500px | 716.0 |
| Topology Driven | 0.064 |  distance: 0.064variant: vectorized (all layers) 500px | 13.0 |
| Fidelity Simplicity | 0.09024411010742188 |  distance: 0.09024variant: vectorized (all layers) 1000pxalg. parameter: 0.6 | 226.0 |
| Poly Vector → Stroke Aggregator | 0.06280127334594726 | distance: 0.0628variant: vectorized (shape strokes) 500px | 44.0 |
| Poly Vector | 0.062 | distance: 0.062variant: vectorized (shape strokes) 500px | 126.0 |
| Delaunay Triangulation | 0.061188232421875 | distance: 0.06119variant: vectorized (all layers) 500px | 7.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|||||||||||||
| thresholded | |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 500px |  |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
 |
 |
||
| vectorized (all layers) 1000px |  |
 |
|
 |
 |
|
 |
 |
 |
 |
|||||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
 |
 |
|
 |
 |
|
|||
| vectorized (shape strokes) 1000px |  |
 |
 |
 |
|
 |
|
|
 |
|
|
 |
|||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
 |
|
|
 |
|
|