A Benchmark for Rough Sketch Cleanup
Art_freeform_AP_05
Author: AP Licence: CC-BY-SA-3.0Messiness: 0.16273
Ambiguity (Chamfer): 0.10018
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Stroke Aggregator | Real-Time Inking | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | Topology Driven → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0016 |  distance: 0.00172 |  distance: 0.00177 |  distance: 0.00182 |  distance: 0.00188 |  distance: 0.00229 |  distance: 0.00234 |  distance: 0.00249 |  distance: 0.00272 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.0018784399148403738 | distance: 0.00188variant: thresholded | 3.0 |
| Delaunay Triangulation | 0.0023403267916031747 | distance: 0.00234variant: vectorized (shape strokes) 1000px | 4.0 |
| Fidelity Simplicity | 0.002487477984643053 | distance: 0.00249variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 202.0 |
| Mastering Sketching | 0.001602512722737598 | distance: 0.0016variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0022881196723180826 | distance: 0.00229variant: vectorized (shape strokes) 1000px | 539.0 |
| Poly Vector | 0.0017684184572561304 | distance: 0.00177variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 204.0 |
| Stroke Aggregator | 0.0018177718489534797 | distance: 0.00182variant: vectorized (shape strokes) | 516.0 |
| Topology Driven → Stroke Aggregator | 0.0027246652463456607 | distance: 0.00272variant: vectorized (all layers) 500px | 248.0 |
| Topology Driven | 0.0017243971664034352 | distance: 0.00172variant: vectorized (shape strokes) 1000px | 16.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.6872222732697241 | distance: 0.68722variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.520398540675471 |  distance: 0.5204variant: vectorized (all layers) 500pxalg. parameter: noisy | 22.0 |
| Poly Vector | 0.5409941110498003 |  distance: 0.54099variant: vectorized (shape strokes) 500px | 76.0 |
| Real-Time Inking | 0.6665922386964285 |  distance: 0.66659variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.6845125452164438 |  distance: 0.68451variant: vectorized (all layers) | 519.0 |
| Topology Driven → Stroke Aggregator | 0.5703013657256657 | distance: 0.5703variant: vectorized (all layers) 500px | 248.0 |
| Topology Driven | 0.6608720738400304 |  distance: 0.66087variant: vectorized (shape strokes) 500px | 5.0 |
| Delaunay Triangulation | 0.3965877830953009 |  distance: 0.39659variant: thresholded 500px | 1.0 |
| Fidelity Simplicity | 0.3736408361440321 |  distance: 0.37364variant: originalalg. parameter: 0.25 | 228.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.8203650356981665 | distance: 0.82037variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6540950054299878 |  distance: 0.6541variant: vectorized (shape strokes) 500px | 22.0 |
| Poly Vector | 0.6661514501732282 | distance: 0.66615variant: vectorized (shape strokes) 500px | 76.0 |
| Real-Time Inking | 0.8013216143179114 |  distance: 0.80132variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | 0.8155463896422857 | distance: 0.81555variant: vectorized (all layers) | 519.0 |
| Delaunay Triangulation | 0.5903575164964904 | distance: 0.59036variant: thresholded 500px | 1.0 |
| Fidelity Simplicity | 0.4941588565010461 |  distance: 0.49416variant: originalalg. parameter: 0.5 | 259.0 |
| Topology Driven | 0.7925294924267954 |  distance: 0.79253variant: original | 54.0 |
| Topology Driven → Stroke Aggregator | 0.7473125433853774 |  distance: 0.74731variant: thresholded 500px | 218.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.8872868196164413 | distance: 0.88729variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.7298178811932898 | distance: 0.72982variant: vectorized (shape strokes) 500px | 22.0 |
| Poly Vector | 0.7412474148493903 |  distance: 0.74125variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 78.0 |
| Real-Time Inking | 0.8671941515156091 | distance: 0.86719variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | 0.8821621545280902 | distance: 0.88216variant: vectorized (shape strokes) | 516.0 |
| Fidelity Simplicity | 0.5563819349546247 |  distance: 0.55638variant: originalalg. parameter: 0.6 | 272.0 |
| Delaunay Triangulation | 0.7286530933154248 | distance: 0.72865variant: thresholded 500px | 1.0 |
| Topology Driven → Stroke Aggregator | 0.8399359912289331 | distance: 0.83994variant: thresholded 500px | 218.0 |
| Topology Driven | 0.8511618832966364 | distance: 0.85116variant: original | 54.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9243471270272048 | distance: 0.92435variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.7760206161862717 | distance: 0.77602variant: vectorized (shape strokes) 500px | 22.0 |
| Poly Vector | 0.7886171086646641 | distance: 0.78862variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 78.0 |
| Stroke Aggregator | 0.9086052487472536 | distance: 0.90861variant: vectorized (shape strokes) | 516.0 |
| Fidelity Simplicity | 0.6057773623228857 | distance: 0.60578variant: originalalg. parameter: 0.5 | 259.0 |
| Delaunay Triangulation | 0.8016369340035128 | distance: 0.80164variant: thresholded 500px | 1.0 |
| Real-Time Inking | 0.898321573933285 |  distance: 0.89832variant: original | 4.0 |
| Topology Driven → Stroke Aggregator | 0.8779344420977409 | distance: 0.87793variant: thresholded 500px | 218.0 |
| Topology Driven | 0.8859715329679949 | distance: 0.88597variant: original | 54.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9451308632907636 | distance: 0.94513variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector | 0.8314156144099311 | distance: 0.83142variant: vectorized (shape strokes) 500px | 76.0 |
| Stroke Aggregator | 0.9298502433048532 | distance: 0.92985variant: vectorized (shape strokes) | 516.0 |
| Fidelity Simplicity | 0.6344542709983989 | distance: 0.63445variant: originalalg. parameter: 0.5 | 259.0 |
| Poly Vector → Stroke Aggregator | 0.8155709302815309 | distance: 0.81557variant: vectorized (all layers) 500pxalg. parameter: noisy | 22.0 |
| Delaunay Triangulation | 0.8620360223110506 | distance: 0.86204variant: thresholded 500px | 1.0 |
| Real-Time Inking | 0.918726882844354 | distance: 0.91873variant: original | 4.0 |
| Topology Driven → Stroke Aggregator | 0.9039319403059634 |  distance: 0.90393variant: original | 810.0 |
| Topology Driven | 0.9053930120234882 | distance: 0.90539variant: original | 54.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.02778488731384277 |  distance: 0.02778variant: vectorized (shape strokes) 500px | 1.0 |
| Mastering Sketching | 0.2927456359863281 |  distance: 0.29275variant: vectorized (shape strokes) 500px | 6.0 |
| Real-Time Inking | 0.022530424358650013 | distance: 0.02253variant: thresholded | 3.0 |
| Topology Driven | 0.03590264511108398 |  distance: 0.0359variant: thresholded 1000px | 24.0 |
| Fidelity Simplicity | 0.04186884307861328 |  distance: 0.04187variant: vectorized (all layers) 1000pxalg. parameter: 0.5 | 192.0 |
| Poly Vector → Stroke Aggregator | 0.036000000000000004 | distance: 0.036variant: vectorized (shape strokes) 1000px | 539.0 |
| Poly Vector | 0.036000000000000004 |  distance: 0.036variant: vectorized (all layers) 1000px | 253.0 |
| Stroke Aggregator | 0.03627838311764628 | distance: 0.03628variant: vectorized (shape strokes) | 516.0 |
| Topology Driven → Stroke Aggregator | 0.03605551147460938 | distance: 0.03606variant: vectorized (all layers) 500px | 248.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
|
|
 |
|
|
 |
 |
 |
||||
| thresholded | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
||
| thresholded 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
 |
||
| vectorized (all layers) 1000px |  |
 |
 |
 |
|
 |
 |
 |
 |
|
 |
||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
||
| vectorized (shape strokes) 1000px |  |
|
 |
 |
 |
 |
|
|
|
 |
|
 |
|
||
| vectorized (shape strokes) 500px | |
|
 |
 |
 |
 |
 |
|
|
|
|
|
|||
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |