A Benchmark for Rough Sketch Cleanup
Ind_product_PM_46
Author: Patrick Murphy Author Homepage: https://www.flickr.com/photos/pmurf/ Licence: CC-BY-2.0Messiness: 0.20064
Ambiguity (Chamfer): 0.05882
Shading: No
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Real-Time Inking | Stroke Aggregator | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00195 |  distance: 0.00203 |  distance: 0.00206 |  distance: 0.00206 |  distance: 0.0022 |  distance: 0.00222 |  distance: 0.00245 |  distance: 0.00275 |  distance: 0.00323 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0027504905179644872 | distance: 0.00275variant: vectorized (shape strokes) 1000px | 5.0 |
| Fidelity Simplicity | 0.003226044910597057 | distance: 0.00323variant: thresholdedalg. parameter: 0.25 | 208.0 |
| Mastering Sketching | 0.0019480778689461614 | distance: 0.00195variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0024490329456412275 | distance: 0.00245variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 287.0 |
| Poly Vector | 0.0020588123149856094 | distance: 0.00206variant: vectorized (shape strokes) 1000px | 225.0 |
| Real-Time Inking | 0.002061507136612216 | distance: 0.00206variant: original | 3.0 |
| Stroke Aggregator | 0.002200557643353345 | distance: 0.0022variant: vectorized (shape strokes) | 289.0 |
| Topology Driven → Stroke Aggregator | 0.0022161261829136926 | distance: 0.00222variant: vectorized (shape strokes) 1000px | 1005.0 |
| Topology Driven | 0.002026569742663074 | distance: 0.00203variant: original | 1090.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3625797911849914 |  distance: 0.36258variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.4219569031495707 |  distance: 0.42196variant: vectorized (all layers) 500px | 29.0 |
| Real-Time Inking | 0.5445481626336226 |  distance: 0.54455variant: thresholded | 3.0 |
| Stroke Aggregator | 0.4850465620198098 |  distance: 0.48505variant: vectorized (all layers) | 452.0 |
| Topology Driven | 0.6085660431857148 |  distance: 0.60857variant: vectorized (all layers) 500px | 6.0 |
| Fidelity Simplicity | 0.18743346090069304 |  distance: 0.18743variant: thresholded 500pxalg. parameter: 0.75 | 175.0 |
| Mastering Sketching | 0.6039189623282052 |  distance: 0.60392variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.4357937583023585 |  distance: 0.43579variant: vectorized (shape strokes) 500px | 61.0 |
| Topology Driven → Stroke Aggregator | 0.5764876435764537 |  distance: 0.57649variant: thresholded 500px | 343.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.7433023189011858 |  distance: 0.7433variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.5513196473002939 | distance: 0.55132variant: vectorized (all layers) 500px | 29.0 |
| Stroke Aggregator | 0.6402897198372257 | distance: 0.64029variant: vectorized (all layers) | 452.0 |
| Topology Driven | 0.7352814845396031 | distance: 0.73528variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector | 0.5524810088212285 | distance: 0.55248variant: vectorized (shape strokes) 500px | 61.0 |
| Real-Time Inking | 0.7139823016560931 |  distance: 0.71398variant: vectorized (all layers) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.7195311927668496 |  distance: 0.71953variant: thresholded 1000px | 737.0 |
| Delaunay Triangulation | 0.5619285563948051 | distance: 0.56193variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.333169956127243 | distance: 0.33317variant: thresholded 500pxalg. parameter: 0.75 | 175.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.808688699887657 | distance: 0.80869variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.7899722303808369 |  distance: 0.78997variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7427736497387837 | distance: 0.74277variant: vectorized (all layers) | 452.0 |
| Topology Driven | 0.8061193559745764 | distance: 0.80612variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6389471388587671 | distance: 0.63895variant: vectorized (all layers) 500px | 29.0 |
| Poly Vector | 0.6271783356513316 |  distance: 0.62718variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 65.0 |
| Topology Driven → Stroke Aggregator | 0.7965906160507065 | distance: 0.79659variant: thresholded 1000px | 737.0 |
| Delaunay Triangulation | 0.6797092001416822 | distance: 0.67971variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.4584256302738904 | distance: 0.45843variant: thresholded 500pxalg. parameter: 0.75 | 175.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5440657029998619 | distance: 0.54407variant: thresholded 500pxalg. parameter: 0.75 | 175.0 |
| Mastering Sketching | 0.8471484612400653 | distance: 0.84715variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7022847222022843 | distance: 0.70228variant: vectorized (all layers) 500px | 29.0 |
| Real-Time Inking | 0.8351287815965374 | distance: 0.83513variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.8453300752783873 | distance: 0.84533variant: thresholded 1000px | 737.0 |
| Topology Driven | 0.8513348754713804 | distance: 0.85133variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector | 0.6786487565601179 | distance: 0.67865variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 65.0 |
| Stroke Aggregator | 0.8268602909157939 | distance: 0.82686variant: vectorized (all layers) | 452.0 |
| Delaunay Triangulation | 0.7526712790482137 | distance: 0.75267variant: vectorized (all layers) 500px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6745718050065876 | distance: 0.67457variant: thresholded 500pxalg. parameter: 0.75 | 175.0 |
| Mastering Sketching | 0.8845039826212889 | distance: 0.8845variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.894188388755347 | distance: 0.89419variant: thresholded 1000px | 737.0 |
| Topology Driven | 0.8894108053583402 | distance: 0.88941variant: vectorized (all layers) 500px | 6.0 |
| Delaunay Triangulation | 0.8116626659562429 | distance: 0.81166variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector | 0.7225102067341422 | distance: 0.72251variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 65.0 |
| Poly Vector → Stroke Aggregator | 0.7519971686449217 | distance: 0.752variant: vectorized (all layers) 500px | 29.0 |
| Real-Time Inking | 0.8732673533086741 | distance: 0.87327variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8924388794208591 | distance: 0.89244variant: vectorized (all layers) | 452.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.13029965209960934 | distance: 0.1303variant: vectorized (shape strokes) 1000px | 6.0 |
| Stroke Aggregator | 0.042060607703179466 | distance: 0.04206variant: vectorized (all layers) | 452.0 |
| Delaunay Triangulation | 0.041231056213378914 | distance: 0.04123variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.034044784626389414 | distance: 0.03404variant: thresholdedalg. parameter: 0.25 | 208.0 |
| Poly Vector → Stroke Aggregator | 0.056320510864257815 |  distance: 0.05632variant: thresholded 500px | 59.0 |
| Poly Vector | 0.056320510864257815 |  distance: 0.05632variant: thresholded 500pxalg. parameter: noisy | 249.0 |
| Real-Time Inking | 0.05727128601074219 |  distance: 0.05727variant: thresholded 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.056142673492431634 | distance: 0.05614variant: thresholded 500px | 343.0 |
| Topology Driven | 0.056142673492431634 |  distance: 0.05614variant: vectorized (shape strokes) 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
|
 |
||||||||
| thresholded |  |
|
 |
|
 |
 |
 |
 |
 |
||||||
| thresholded 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
| thresholded 500px | |
|
 |
 |
 |
 |
|
 |
 |
|
 |
 |
|
||
| vectorized (all layers) 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
|
 |
 |
|
 |
|
||
| vectorized (shape strokes) 1000px | |
 |
|
 |
 |
 |
 |
 |
 |
 |
|
|
|
 |
|
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
|
|
|
 |
||||
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |