A Benchmark for Rough Sketch Cleanup
Art_logo_JST_01
Author: Jakub Steiner Author Homepage: https://www.flickr.com/photos/jakubsteiner/ Licence: CC-BY-SA 2.0Messiness: 0.71126
Ambiguity (Chamfer): 0.11172
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Fidelity Simplicity | Mastering Sketching | Topology Driven | Poly Vector | Poly Vector → Stroke Aggregator | Real-Time Inking | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00239 |  distance: 0.00243 |  distance: 0.00351 |  distance: 0.00378 |  distance: 0.00391 |  distance: 0.00398 |  distance: 0.00462 |  distance: 0.00485 |  distance: 0.00568 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  | ||||
| Liliya Larsen |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0048548836298231 | distance: 0.00485variant: original | 1.0 |
| Fidelity Simplicity | 0.0023885170738739557 | distance: 0.00239variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 248.0 |
| Mastering Sketching | 0.0024262051196010967 | distance: 0.00243variant: original | 5.0 |
| Stroke Aggregator | 0.005682146198441141 | distance: 0.00568variant: vectorized (shape strokes) | 50.0 |
| Topology Driven → Stroke Aggregator | 0.004619528159384701 | distance: 0.00462variant: vectorized (shape strokes) 500px | 52.0 |
| Poly Vector → Stroke Aggregator | 0.003914002828345885 | distance: 0.00391variant: thresholded 500pxalg. parameter: noisy | 29.0 |
| Poly Vector | 0.00377659955396824 | distance: 0.00378variant: thresholded | 236.0 |
| Real-Time Inking | 0.003981266970362345 | distance: 0.00398variant: thresholded 1000px | 2.0 |
| Topology Driven | 0.0035084727214453803 | distance: 0.00351variant: original | 5.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.2579570688378979 |  distance: 0.25796variant: thresholded | 7.0 |
| Topology Driven → Stroke Aggregator | 0.08596373404969779 |  distance: 0.08596variant: original | 120.0 |
| Topology Driven | 0.1444075972264094 |  distance: 0.14441variant: thresholded | 9.0 |
| Poly Vector | 0.16460305899490166 | distance: 0.1646variant: thresholded | 236.0 |
| Real-Time Inking | 0.15851517431652873 |  distance: 0.15852variant: original | 2.0 |
| Stroke Aggregator | 0.14774624373956596 | distance: 0.14775variant: vectorized (shape strokes) | 50.0 |
| Delaunay Triangulation | 0.15184381778741865 | distance: 0.15184variant: original | 1.0 |
| Fidelity Simplicity | 0.08653846153846154 |  distance: 0.08654variant: originalalg. parameter: 0.6 | 145.0 |
| Poly Vector → Stroke Aggregator | 0.16591773245765645 |  distance: 0.16592variant: thresholded | 29.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | 0.5892283558676329 | distance: 0.58923variant: vectorized (shape strokes) | 50.0 |
| Fidelity Simplicity | 0.4481345749474317 |  distance: 0.44813variant: originalalg. parameter: 0.5 | 139.0 |
| Topology Driven → Stroke Aggregator | 0.4283382676687163 | distance: 0.42834variant: original | 120.0 |
| Topology Driven | 0.4592469256360897 |  distance: 0.45925variant: vectorized (all layers) 1000px | 25.0 |
| Delaunay Triangulation | 0.4252997950781068 |  distance: 0.4253variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.43069883689413146 |  distance: 0.4307variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4373613087932988 |  distance: 0.43736variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 8.0 |
| Poly Vector | 0.4514079430151609 |  distance: 0.45141variant: vectorized (shape strokes) 500px | 51.0 |
| Real-Time Inking | 0.39404682621023546 |  distance: 0.39405variant: vectorized (all layers) 500px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5101887238555474 |  distance: 0.51019variant: vectorized (all layers) 1000px | 9.0 |
| Mastering Sketching | 0.5583084469999515 | distance: 0.55831variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6374508506180581 |  distance: 0.63745variant: original | 9.0 |
| Poly Vector | 0.6526047123423632 |  distance: 0.6526variant: vectorized (all layers) 1000pxalg. parameter: noisy | 533.0 |
| Stroke Aggregator | 0.7938819345867939 | distance: 0.79388variant: vectorized (shape strokes) | 50.0 |
| Topology Driven → Stroke Aggregator | 0.5782011050302021 |  distance: 0.5782variant: vectorized (all layers) 1000px | 291.0 |
| Topology Driven | 0.5797078658147314 | distance: 0.57971variant: vectorized (all layers) 1000px | 25.0 |
| Fidelity Simplicity | 0.5649555661914094 |  distance: 0.56496variant: originalalg. parameter: 0.75 | 161.0 |
| Real-Time Inking | 0.5101997571127873 | distance: 0.5102variant: vectorized (all layers) 500px | 2.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.6265972088947219 | distance: 0.6266variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7320058601732529 |  distance: 0.73201variant: vectorized (all layers) 1000px | 47.0 |
| Poly Vector | 0.7379767453402698 | distance: 0.73798variant: vectorized (all layers) 1000pxalg. parameter: noisy | 533.0 |
| Real-Time Inking | 0.5810091975360729 | distance: 0.58101variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.6651478444454538 | distance: 0.66515variant: vectorized (all layers) 1000px | 291.0 |
| Topology Driven | 0.666730139952233 | distance: 0.66673variant: vectorized (all layers) 1000px | 25.0 |
| Fidelity Simplicity | 0.6366838670009567 | distance: 0.63668variant: originalalg. parameter: 0.75 | 161.0 |
| Delaunay Triangulation | 0.5596606434336037 | distance: 0.55966variant: vectorized (all layers) 1000px | 9.0 |
| Stroke Aggregator | 0.8702705681379842 | distance: 0.87027variant: vectorized (shape strokes) | 50.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.6988314176158679 | distance: 0.69883variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.7941548044438852 | distance: 0.79415variant: vectorized (all layers) 1000pxalg. parameter: noisy | 533.0 |
| Real-Time Inking | 0.6375894129224622 | distance: 0.63759variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.88 | distance: 0.88variant: vectorized (shape strokes) | 50.0 |
| Topology Driven → Stroke Aggregator | 0.7317407680618262 | distance: 0.73174variant: vectorized (all layers) 1000px | 291.0 |
| Topology Driven | 0.7328882906078487 | distance: 0.73289variant: vectorized (all layers) 1000px | 25.0 |
| Delaunay Triangulation | 0.5821907071231442 | distance: 0.58219variant: vectorized (all layers) 1000px | 9.0 |
| Fidelity Simplicity | 0.6835383964116718 | distance: 0.68354variant: originalalg. parameter: 0.75 | 161.0 |
| Poly Vector → Stroke Aggregator | 0.7844061650045332 | distance: 0.78441variant: original | 9.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.032177638181876314 | distance: 0.03218variant: original | 1.0 |
| Poly Vector → Stroke Aggregator | 0.044643028259277344 |  distance: 0.04464variant: vectorized (shape strokes) 1000px | 26.0 |
| Poly Vector | 0.04410215377807617 |  distance: 0.0441variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 231.0 |
| Stroke Aggregator | 0.12028089746252282 | distance: 0.12028variant: vectorized (shape strokes) | 50.0 |
| Fidelity Simplicity | 0.034176013946533204 |  distance: 0.03418variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 174.0 |
| Mastering Sketching | 0.441653924586969 | distance: 0.44165variant: thresholded | 7.0 |
| Topology Driven → Stroke Aggregator | 0.0344093017578125 | distance: 0.03441variant: vectorized (shape strokes) 500px | 52.0 |
| Real-Time Inking | 0.1183385009765625 |  distance: 0.11834variant: vectorized (shape strokes) 500px | 2.0 |
| Topology Driven | 0.031216893877301893 | distance: 0.03122variant: original | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
 |
 |
|
|
|
|
 |
 |
|
|
||
| thresholded |  |
|
 |
 |
 |
 |
 |
|
 |
|
 |
|
|||
| thresholded 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
|
|
 |
|
 |
|
||
| vectorized (all layers) 500px |  |
|
|
 |
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
|
| vectorized (shape strokes) 1000px |  |
 |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
|
||
| vectorized (shape strokes) 500px | |
|
 |
 |
 |
 |
|
 |
 |
 |
|
 |
|
 |
|
| vectorized (shape strokes) | |