A Benchmark for Rough Sketch Cleanup
Art_logo_JS_02
Author: jwalsh Author Homepage: https://www.flickr.com/photos/jwalsh_/ Licence: CC-BY-2.0Messiness: 0.14441
Ambiguity (Chamfer): 0.10663
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Stroke Aggregator | Poly Vector | Topology Driven | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | Real-Time Inking | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00175 |  distance: 0.00181 |  distance: 0.0019 |  distance: 0.0019 |  distance: 0.00191 |  distance: 0.00204 |  distance: 0.00219 |  distance: 0.00227 |  distance: 0.00241 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0021894982568257076 | distance: 0.00219variant: vectorized (shape strokes) 1000px | 7.0 |
| Fidelity Simplicity | 0.0022725327482046487 | distance: 0.00227variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 283.0 |
| Mastering Sketching | 0.0017508206606281686 | distance: 0.00175variant: vectorized (shape strokes) 500px | 9.0 |
| Poly Vector → Stroke Aggregator | 0.0019121183305510683 | distance: 0.00191variant: vectorized (shape strokes) 1000px | 269.0 |
| Poly Vector | 0.001895271172659504 | distance: 0.0019variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 125.0 |
| Real-Time Inking | 0.002405594990142429 | distance: 0.00241variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.0018138420102326684 | distance: 0.00181variant: vectorized (shape strokes) | 120.0 |
| Topology Driven → Stroke Aggregator | 0.0020448866933971987 | distance: 0.00204variant: vectorized (shape strokes) 1000px | 349.0 |
| Topology Driven | 0.0019026995872882238 | distance: 0.0019variant: vectorized (shape strokes) 1000px | 16.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | 0.4850564377283417 |  distance: 0.48506variant: vectorized (all layers) | 686.0 |
| Delaunay Triangulation | 0.3127493104599357 |  distance: 0.31275variant: original | 19.0 |
| Fidelity Simplicity | 0.16168811116829646 |  distance: 0.16169variant: originalalg. parameter: 0.75 | 302.0 |
| Mastering Sketching | 0.5265446151276855 |  distance: 0.52654variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.1274744929067924 |  distance: 0.12747variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 7.0 |
| Poly Vector | 0.13165233310626706 |  distance: 0.13165variant: vectorized (shape strokes) 500px | 51.0 |
| Real-Time Inking | 0.538759496511004 |  distance: 0.53876variant: vectorized (all layers) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.3295065125929444 |  distance: 0.32951variant: vectorized (all layers) 500px | 647.0 |
| Topology Driven | 0.4339573656565904 |  distance: 0.43396variant: vectorized (all layers) 500px | 8.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5200939433621325 |  distance: 0.52009variant: vectorized (all layers) 500px | 3.0 |
| Real-Time Inking | 0.6959476665789991 |  distance: 0.69595variant: original | 3.0 |
| Fidelity Simplicity | 0.22398273392003276 |  distance: 0.22398variant: originalalg. parameter: 0.25 | 199.0 |
| Mastering Sketching | 0.6825451163681127 | distance: 0.68255variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.1903661508708067 | distance: 0.19037variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 7.0 |
| Poly Vector | 0.19909742102433964 | distance: 0.1991variant: vectorized (shape strokes) 500px | 51.0 |
| Stroke Aggregator | 0.6596154733282811 | distance: 0.65962variant: vectorized (all layers) | 686.0 |
| Topology Driven → Stroke Aggregator | 0.5055893513912799 | distance: 0.50559variant: vectorized (all layers) 500px | 647.0 |
| Topology Driven | 0.5927438618004045 | distance: 0.59274variant: vectorized (all layers) 500px | 8.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6915311703998211 | distance: 0.69153variant: vectorized (all layers) 500px | 3.0 |
| Real-Time Inking | 0.7836316816991984 | distance: 0.78363variant: original | 3.0 |
| Fidelity Simplicity | 0.31051190706314336 |  distance: 0.31051variant: originalalg. parameter: 0.3 | 201.0 |
| Mastering Sketching | 0.7717521613744925 | distance: 0.77175variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.2419136239863868 | distance: 0.24191variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 7.0 |
| Poly Vector | 0.2535117788167804 |  distance: 0.25351variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 50.0 |
| Stroke Aggregator | 0.7618275849426955 | distance: 0.76183variant: vectorized (all layers) | 686.0 |
| Topology Driven → Stroke Aggregator | 0.6409767254069002 | distance: 0.64098variant: vectorized (all layers) 500px | 647.0 |
| Topology Driven | 0.7000435037241381 | distance: 0.70004variant: vectorized (all layers) 500px | 8.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7510694751417808 | distance: 0.75107variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.3599244551805313 | distance: 0.35992variant: originalalg. parameter: 0.75 | 302.0 |
| Mastering Sketching | 0.8066847909209833 | distance: 0.80668variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.2754952326154858 | distance: 0.2755variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 7.0 |
| Poly Vector | 0.2889240373444564 | distance: 0.28892variant: vectorized (shape strokes) 500px | 51.0 |
| Real-Time Inking | 0.8127042168532649 | distance: 0.8127variant: original | 3.0 |
| Stroke Aggregator | 0.7946732741919897 | distance: 0.79467variant: vectorized (all layers) | 686.0 |
| Topology Driven → Stroke Aggregator | 0.719072379937048 | distance: 0.71907variant: vectorized (all layers) 500px | 647.0 |
| Topology Driven | 0.7569750584336815 | distance: 0.75698variant: vectorized (all layers) 500px | 8.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7960677746226615 | distance: 0.79607variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.4209982712299549 | distance: 0.421variant: originalalg. parameter: 0.75 | 302.0 |
| Mastering Sketching | 0.8359539169697359 | distance: 0.83595variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.3136727452067177 | distance: 0.31367variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 7.0 |
| Poly Vector | 0.32970561998215875 | distance: 0.32971variant: vectorized (shape strokes) 500px | 51.0 |
| Real-Time Inking | 0.8277308098134538 | distance: 0.82773variant: original | 3.0 |
| Stroke Aggregator | 0.8296361631603377 | distance: 0.82964variant: vectorized (all layers) | 686.0 |
| Topology Driven → Stroke Aggregator | 0.7827932580335691 | distance: 0.78279variant: vectorized (all layers) 500px | 647.0 |
| Topology Driven | 0.8022799263770429 | distance: 0.80228variant: vectorized (all layers) 500px | 8.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.30123080444335937 | distance: 0.30123variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.031 | distance: 0.031variant: vectorized (shape strokes) 1000px | 269.0 |
| Poly Vector | 0.031 |  distance: 0.031variant: vectorized (shape strokes) 1000px | 128.0 |
| Stroke Aggregator | 0.03172413793103448 | distance: 0.03172variant: vectorized (shape strokes) | 120.0 |
| Topology Driven → Stroke Aggregator | 0.031 | distance: 0.031variant: vectorized (shape strokes) 1000px | 349.0 |
| Topology Driven | 0.031240999221801763 |  distance: 0.03124variant: vectorized (shape strokes) 500px | 4.0 |
| Delaunay Triangulation | 0.03862641525268555 |  distance: 0.03863variant: thresholded 500px | 7.0 |
| Fidelity Simplicity | 0.06390618133544923 |  distance: 0.06391variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 230.0 |
| Real-Time Inking | 0.03360059356689453 | distance: 0.0336variant: vectorized (shape strokes) 1000px | 2.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
|
 |
|
|
 |
|
 |
 |
 |
 |
|
|||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
 |
||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
 |
 |
|
 |
 |
|
 |
||
| vectorized (shape strokes) 1000px | |
|
|
 |
 |
 |
 |
|
|
|
|
 |
|
||
| vectorized (shape strokes) 500px |  |
 |
|
 |
 |
 |
|
 |
|
|
|
 |
|
||
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |