A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_07
Author: Cristina Arciniega Licence: Academic PaperMessiness: 0.27153
Ambiguity (Chamfer): 0.29212
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Stroke Aggregator | Mastering Sketching | Poly Vector → Stroke Aggregator | Real-Time Inking | Topology Driven | Poly Vector | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00111 |  distance: 0.0012 |  distance: 0.00125 |  distance: 0.00131 |  distance: 0.00135 |  distance: 0.00141 |  distance: 0.00167 |  distance: 0.00223 |  distance: 0.00675 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.002230209979532225 | distance: 0.00223variant: original | 27.0 |
| Fidelity Simplicity | 0.006749038264461493 | distance: 0.00675variant: originalalg. parameter: 0.25 | 334.0 |
| Mastering Sketching | 0.0011954456393327422 | distance: 0.0012variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0012473103394482676 | distance: 0.00125variant: original | 412.0 |
| Poly Vector | 0.0014099028760565376 | distance: 0.00141variant: originalalg. parameter: noisy | 434.0 |
| Real-Time Inking | 0.0013104588893631164 | distance: 0.00131variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.0011131176975616717 | distance: 0.00111variant: vectorized (all layers) | 1213.0 |
| Topology Driven → Stroke Aggregator | 0.0016662523527532654 | distance: 0.00167variant: original 1000px | 622.0 |
| Topology Driven | 0.001347812874833722 | distance: 0.00135variant: original | 73.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.17950990845481546 | distance: 0.17951variant: original | 27.0 |
| Fidelity Simplicity | 0.103979801122188 |  distance: 0.10398variant: originalalg. parameter: 0.75 | 464.0 |
| Mastering Sketching | 0.2265370784906509 |  distance: 0.22654variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.16553730752521634 | distance: 0.16554variant: original | 412.0 |
| Poly Vector | 0.194193361741758 |  distance: 0.19419variant: original 500pxalg. parameter: noisy | 73.0 |
| Real-Time Inking | 0.1808732733278339 |  distance: 0.18087variant: original | 3.0 |
| Stroke Aggregator | 0.17862900848581814 | distance: 0.17863variant: vectorized (all layers) | 1213.0 |
| Topology Driven → Stroke Aggregator | 0.19728388218398046 |  distance: 0.19728variant: original 500px | 99.0 |
| Topology Driven | 0.22022888957624492 |  distance: 0.22023variant: original 500px | 7.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3739310090225919 | distance: 0.37393variant: original | 27.0 |
| Fidelity Simplicity | 0.2488562130855499 |  distance: 0.24886variant: original 500pxalg. parameter: 0.6 | 186.0 |
| Mastering Sketching | 0.3921241336279544 | distance: 0.39212variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.35055435939696783 | distance: 0.35055variant: original | 412.0 |
| Poly Vector | 0.3605176786500821 | distance: 0.36052variant: original 500pxalg. parameter: noisy | 73.0 |
| Real-Time Inking | 0.3605059698369784 | distance: 0.36051variant: original | 3.0 |
| Stroke Aggregator | 0.36903998673654975 | distance: 0.36904variant: vectorized (all layers) | 1213.0 |
| Topology Driven → Stroke Aggregator | 0.34858783759223577 | distance: 0.34859variant: original 500px | 99.0 |
| Topology Driven | 0.384444476729186 | distance: 0.38444variant: original 500px | 7.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5719235030501422 | distance: 0.57192variant: original | 27.0 |
| Fidelity Simplicity | 0.3965010834978712 | distance: 0.3965variant: original 500pxalg. parameter: 0.6 | 186.0 |
| Mastering Sketching | 0.5743839253821772 | distance: 0.57438variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5241060754511766 | distance: 0.52411variant: original | 412.0 |
| Poly Vector | 0.5551338606304712 | distance: 0.55513variant: original 500pxalg. parameter: noisy | 73.0 |
| Real-Time Inking | 0.5382494546480808 | distance: 0.53825variant: original | 3.0 |
| Stroke Aggregator | 0.5413050961330226 | distance: 0.54131variant: vectorized (all layers) | 1213.0 |
| Topology Driven → Stroke Aggregator | 0.5192747903797909 | distance: 0.51927variant: original 500px | 99.0 |
| Topology Driven | 0.554049102235251 | distance: 0.55405variant: original 500px | 7.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6704393572327241 | distance: 0.67044variant: original | 27.0 |
| Fidelity Simplicity | 0.5200101841873054 |  distance: 0.52001variant: original 500pxalg. parameter: 0.25 | 163.0 |
| Mastering Sketching | 0.6833669447820099 | distance: 0.68337variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6644012306504384 | distance: 0.6644variant: original | 412.0 |
| Poly Vector | 0.6797199977537958 |  distance: 0.67972variant: original 1000px | 168.0 |
| Real-Time Inking | 0.6706163298959469 | distance: 0.67062variant: original | 3.0 |
| Stroke Aggregator | 0.6827337136105557 | distance: 0.68273variant: vectorized (all layers) | 1213.0 |
| Topology Driven → Stroke Aggregator | 0.6567519365603158 | distance: 0.65675variant: original 500px | 99.0 |
| Topology Driven | 0.6727892873166275 | distance: 0.67279variant: original | 73.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7412458719327943 | distance: 0.74125variant: original | 27.0 |
| Fidelity Simplicity | 0.5927618976321095 | distance: 0.59276variant: original 500pxalg. parameter: 0.25 | 163.0 |
| Mastering Sketching | 0.7574545192479459 | distance: 0.75745variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.7487071664872527 | distance: 0.74871variant: original | 412.0 |
| Poly Vector | 0.7655783092160928 |  distance: 0.76558variant: original 500px | 75.0 |
| Real-Time Inking | 0.7414525584103399 | distance: 0.74145variant: original | 3.0 |
| Stroke Aggregator | 0.7567502828919239 | distance: 0.75675variant: vectorized (all layers) | 1213.0 |
| Topology Driven → Stroke Aggregator | 0.7512205077844806 | distance: 0.75122variant: original 500px | 99.0 |
| Topology Driven | 0.76440874702079 | distance: 0.76441variant: original | 73.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.2686633605957031 | distance: 0.26866variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.019646883010864258 |  distance: 0.01965variant: original 1000pxalg. parameter: noisy | 232.0 |
| Poly Vector | 0.02009975051879883 |  distance: 0.0201variant: original 1000pxalg. parameter: noisy | 171.0 |
| Real-Time Inking | 0.019166445155189355 | distance: 0.01917variant: original | 3.0 |
| Stroke Aggregator | 0.019824326944002355 | distance: 0.01982variant: vectorized (all layers) | 1213.0 |
| Topology Driven → Stroke Aggregator | 0.0178885440826416 | distance: 0.01789variant: original 500px | 99.0 |
| Topology Driven | 0.01897366523742676 | distance: 0.01897variant: original 500px | 7.0 |
| Delaunay Triangulation | 0.07025667572021485 |  distance: 0.07026variant: original 1000px | 7.0 |
| Fidelity Simplicity | 0.14926486206054687 | distance: 0.14926variant: original 500pxalg. parameter: 0.6 | 186.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
|
 |
|
|
 |
|
|
||||
| original 1000px | |
|
|
 |
 |
 |
 |
 |
 |
|
|
|
|
 |
|
| original 500px | |
 |
|
 |
|
 |
 |
|
|
|
|
 |
 |
 |
|
| vectorized (all layers) | |