A Benchmark for Rough Sketch Cleanup
Art_logo_BF_01
Author: Bee Forks Author Homepage: https://www.flickr.com/photos/the_britters/ Licence: CC-BY-NC 2.0Messiness: 0.01125
Ambiguity (Chamfer): 0.04455
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Poly Vector | Mastering Sketching | Poly Vector → Stroke Aggregator | Topology Driven | Fidelity Simplicity | Topology Driven → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00089 |  distance: 0.00107 |  distance: 0.00108 |  distance: 0.00113 |  distance: 0.00114 |  distance: 0.00139 |  distance: 0.00185 |  distance: 0.00415 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | | |||||
| Liliya Larsen |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.00414901638322163 | distance: 0.00415variant: vectorized (shape strokes) 1000px | 1.0 |
| Fidelity Simplicity | 0.0013914652917933208 | distance: 0.00139variant: vectorized (shape strokes) 1000pxalg. parameter: 0.5 | 112.0 |
| Mastering Sketching | 0.0010840837734296983 | distance: 0.00108variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0011320144816192098 | distance: 0.00113variant: thresholded 1000pxalg. parameter: noisy | 33.0 |
| Poly Vector | 0.0010688377055494546 | distance: 0.00107variant: vectorized (shape strokes) 1000px | 55.0 |
| Real-Time Inking | 0.000889832065196392 | distance: 0.00089variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.0018453189929843914 | distance: 0.00185variant: thresholded 500px | 30.0 |
| Topology Driven | 0.0011403481514710673 | distance: 0.00114variant: vectorized (shape strokes) 1000px | 3.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.349601770648775 |  distance: 0.3496variant: vectorized (shape strokes) 500px | 0.0 |
| Mastering Sketching | 0.052320076998206885 |  distance: 0.05232variant: original | 6.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5651124553390121 |  distance: 0.56511variant: vectorized (all layers) 500px | 29.0 |
| Topology Driven | 0.7336886053104179 |  distance: 0.73369variant: vectorized (all layers) 500px | 2.0 |
| Real-Time Inking | 0.1863896894154406 |  distance: 0.18639variant: original | 3.0 |
| Fidelity Simplicity | 0.3078041272968476 |  distance: 0.3078variant: thresholded 500pxalg. parameter: 0.75 | 104.0 |
| Poly Vector → Stroke Aggregator | 0.1279950621840291 |  distance: 0.128variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 5.0 |
| Poly Vector | 0.1312457735367045 |  distance: 0.13125variant: vectorized (shape strokes) 500px | 31.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.08921341502455579 | distance: 0.08921variant: original | 6.0 |
| Real-Time Inking | 0.4997495373459954 | distance: 0.49975variant: original | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7936264413573376 | distance: 0.79363variant: vectorized (all layers) 500px | 29.0 |
| Topology Driven | 0.8723689615783372 |  distance: 0.87237variant: thresholded | 49.0 |
| Delaunay Triangulation | 0.5161269432787158 | distance: 0.51613variant: vectorized (shape strokes) 500px | 0.0 |
| Fidelity Simplicity | 0.4211100009083477 | distance: 0.42111variant: thresholded 500pxalg. parameter: 0.75 | 104.0 |
| Poly Vector → Stroke Aggregator | 0.16658253407370013 | distance: 0.16658variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 5.0 |
| Poly Vector | 0.1689280868385346 |  distance: 0.16893variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 32.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5242811764974138 |  distance: 0.52428variant: thresholded 500pxalg. parameter: 0.3 | 90.0 |
| Mastering Sketching | 0.10823103464043178 | distance: 0.10823variant: original | 6.0 |
| Real-Time Inking | 0.6772047556581623 | distance: 0.6772variant: original | 3.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.6370386513285908 | distance: 0.63704variant: vectorized (shape strokes) 500px | 0.0 |
| Poly Vector → Stroke Aggregator | 0.17988969028425966 |  distance: 0.17989variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector | 0.18143281051292925 | distance: 0.18143variant: vectorized (shape strokes) 500px | 31.0 |
| Topology Driven → Stroke Aggregator | 0.8921984092387071 | distance: 0.8922variant: vectorized (all layers) 500px | 29.0 |
| Topology Driven | 0.9218463573505632 | distance: 0.92185variant: thresholded | 49.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6555800215125218 | distance: 0.65558variant: thresholded 500pxalg. parameter: 0.75 | 104.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.9595969574236886 | distance: 0.9596variant: thresholded | 49.0 |
| Delaunay Triangulation | 0.6908808014876096 | distance: 0.69088variant: vectorized (shape strokes) 500px | 0.0 |
| Mastering Sketching | 0.11593759092415362 | distance: 0.11594variant: original | 6.0 |
| Poly Vector → Stroke Aggregator | 0.19292333614153329 | distance: 0.19292variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 5.0 |
| Poly Vector | 0.19444444444444445 | distance: 0.19444variant: vectorized (shape strokes) 500px | 31.0 |
| Real-Time Inking | 0.7468451767319347 | distance: 0.74685variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.9341614906832296 | distance: 0.93416variant: vectorized (all layers) 500px | 29.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.7378640776699029 | distance: 0.73786variant: vectorized (shape strokes) 500px | 0.0 |
| Fidelity Simplicity | 0.7587867960793382 | distance: 0.75879variant: thresholded 500pxalg. parameter: 0.75 | 104.0 |
| Mastering Sketching | 0.11772420857719702 | distance: 0.11772variant: original | 6.0 |
| Poly Vector → Stroke Aggregator | 0.20502092050209209 | distance: 0.20502variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 5.0 |
| Poly Vector | 0.208768267223382 | distance: 0.20877variant: vectorized (shape strokes) 500px | 31.0 |
| Real-Time Inking | 0.7660881105691769 | distance: 0.76609variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.9567120622568094 | distance: 0.95671variant: vectorized (all layers) 500px | 29.0 |
| Topology Driven | 0.9776845317566278 | distance: 0.97768variant: thresholded | 49.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.3562021789550781 | distance: 0.3562variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.012806248664855958 |  distance: 0.01281variant: thresholded 500pxalg. parameter: noisy | 20.0 |
| Poly Vector | 0.012806248664855958 |  distance: 0.01281variant: thresholded 500px | 72.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.056142673492431634 |  distance: 0.05614variant: thresholded 1000px | 12.0 |
| Fidelity Simplicity | 0.036769554138183586 |  distance: 0.03677variant: vectorized (shape strokes) 500pxalg. parameter: 0.25 | 87.0 |
| Real-Time Inking | 0.006 | distance: 0.006variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.023409399032592773 | distance: 0.02341variant: vectorized (all layers) 500px | 29.0 |
| Topology Driven | 0.021540658950805664 |  distance: 0.02154variant: vectorized (shape strokes) 500px | 2.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
 |
|||
| thresholded 500px | |
 |
 |
|
 |
 |
|
 |
 |
 |
|
 |
|
||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
|
| vectorized (shape strokes) 1000px | |
 |
 |
|
 |
 |
|
 |
|
|
|||||
| vectorized (shape strokes) 500px |  |
 |
 |
|
 |
 |
 |
|
|
|
|
|
|