A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_19
Author: Baseline Licence: Academic PaperMessiness: 0.13671
Ambiguity (Chamfer): 0.10573
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector → Stroke Aggregator | Real-Time Inking | Stroke Aggregator | Topology Driven | Poly Vector | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00128 |  distance: 0.00135 |  distance: 0.00144 |  distance: 0.00148 |  distance: 0.00151 |  distance: 0.00153 |  distance: 0.00162 |  distance: 0.00406 |  distance: 0.01672 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.016721810788383702 | distance: 0.01672variant: originalalg. parameter: 0.5 | 308.0 |
| Mastering Sketching | 0.0012766895547428089 | distance: 0.00128variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0013525194151737605 | distance: 0.00135variant: originalalg. parameter: noisy | 220.0 |
| Poly Vector | 0.0015281363140766133 | distance: 0.00153variant: originalalg. parameter: noisy | 593.0 |
| Real-Time Inking | 0.0014444652808525602 | distance: 0.00144variant: original 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.0016170464054294205 | distance: 0.00162variant: original | 895.0 |
| Topology Driven | 0.0015098256663040946 | distance: 0.00151variant: original | 30.0 |
| Delaunay Triangulation | 0.004055710474024435 | distance: 0.00406variant: original | 10.0 |
| Stroke Aggregator | 0.0014770433903596582 | distance: 0.00148variant: vectorized (all layers) | 526.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4473355113278334 |  distance: 0.44734variant: original 500px | 1.0 |
| Mastering Sketching | 0.7353586266029359 | distance: 0.73536variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.671025927915707 | distance: 0.67103variant: originalalg. parameter: noisy | 220.0 |
| Poly Vector | 0.5280913884285935 |  distance: 0.52809variant: original 500pxalg. parameter: noisy | 87.0 |
| Real-Time Inking | 0.6513805261925588 |  distance: 0.65138variant: original | 3.0 |
| Stroke Aggregator | 0.6759224493822432 | distance: 0.67592variant: vectorized (all layers) | 526.0 |
| Topology Driven → Stroke Aggregator | 0.5484664835127379 |  distance: 0.54847variant: original 500px | 89.0 |
| Topology Driven | 0.6322011680692103 | distance: 0.6322variant: original | 30.0 |
| Fidelity Simplicity | 0.5263440310278085 |  distance: 0.52634variant: originalalg. parameter: 0.25 | 287.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6563862802693454 | distance: 0.65639variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.6493425007347458 |  distance: 0.64934variant: original 1000pxalg. parameter: 0.6 | 288.0 |
| Mastering Sketching | 0.8942802170974959 | distance: 0.89428variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8387110392572844 |  distance: 0.83871variant: original 1000px | 108.0 |
| Poly Vector | 0.6638806492881907 |  distance: 0.66388variant: original 500px | 72.0 |
| Real-Time Inking | 0.8438444026713428 | distance: 0.84384variant: original | 3.0 |
| Stroke Aggregator | 0.8597445323859911 | distance: 0.85974variant: vectorized (all layers) | 526.0 |
| Topology Driven → Stroke Aggregator | 0.7543604117729095 | distance: 0.75436variant: original 500px | 89.0 |
| Topology Driven | 0.8175571275019844 |  distance: 0.81756variant: original 500px | 5.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7916268884690484 | distance: 0.79163variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.7079935525035663 |  distance: 0.70799variant: original 1000pxalg. parameter: 0.5 | 258.0 |
| Mastering Sketching | 0.9616119114637532 | distance: 0.96161variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9365858912136144 | distance: 0.93659variant: original 1000px | 108.0 |
| Poly Vector | 0.7627792172836957 | distance: 0.76278variant: original 500px | 72.0 |
| Real-Time Inking | 0.930151104847957 | distance: 0.93015variant: original | 3.0 |
| Stroke Aggregator | 0.946578245773802 | distance: 0.94658variant: vectorized (all layers) | 526.0 |
| Topology Driven → Stroke Aggregator | 0.8748593574399762 | distance: 0.87486variant: original 500px | 89.0 |
| Topology Driven | 0.9157484020543104 | distance: 0.91575variant: original 500px | 5.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.843807941316528 | distance: 0.84381variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.7377197511863859 |  distance: 0.73772variant: original 500pxalg. parameter: 0.75 | 197.0 |
| Mastering Sketching | 0.980904913581184 | distance: 0.9809variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9699851570621768 | distance: 0.96999variant: original 1000px | 108.0 |
| Poly Vector | 0.8143312125444293 | distance: 0.81433variant: original 500pxalg. parameter: noisy | 87.0 |
| Real-Time Inking | 0.9715910469675768 | distance: 0.97159variant: original | 3.0 |
| Stroke Aggregator | 0.9816430025451348 | distance: 0.98164variant: vectorized (all layers) | 526.0 |
| Topology Driven → Stroke Aggregator | 0.9347608941508068 | distance: 0.93476variant: original 500px | 89.0 |
| Topology Driven | 0.9651519628492382 | distance: 0.96515variant: original 500px | 5.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8931691056920852 | distance: 0.89317variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.7472669762423402 |  distance: 0.74727variant: original 500pxalg. parameter: 0.6 | 191.0 |
| Mastering Sketching | 0.989573364912256 | distance: 0.98957variant: original 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9822172088352792 | distance: 0.98222variant: original 1000px | 108.0 |
| Poly Vector | 0.847840001428984 | distance: 0.84784variant: original 500px | 72.0 |
| Real-Time Inking | 0.9866987238079212 | distance: 0.9867variant: original | 3.0 |
| Stroke Aggregator | 0.9900712126941617 | distance: 0.99007variant: vectorized (all layers) | 526.0 |
| Topology Driven → Stroke Aggregator | 0.9662895411838038 | distance: 0.96629variant: original 500px | 89.0 |
| Topology Driven | 0.9857082041524884 | distance: 0.98571variant: original | 30.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.24741738868000815 | distance: 0.24742variant: originalalg. parameter: 0.5 | 308.0 |
| Mastering Sketching | 0.15742935180664064 | distance: 0.15743variant: original 500px | 6.0 |
| Delaunay Triangulation | 0.1223315200805664 |  distance: 0.12233variant: original 1000px | 4.0 |
| Poly Vector → Stroke Aggregator | 0.013168319075820986 | distance: 0.01317variant: originalalg. parameter: noisy | 220.0 |
| Poly Vector | 0.012806248664855958 |  distance: 0.01281variant: original 1000pxalg. parameter: noisy | 102.0 |
| Real-Time Inking | 0.01306037970911102 | distance: 0.01306variant: original | 3.0 |
| Stroke Aggregator | 0.012992462893457091 | distance: 0.01299variant: vectorized (all layers) | 526.0 |
| Topology Driven → Stroke Aggregator | 0.012549091137143418 | distance: 0.01255variant: original | 895.0 |
| Topology Driven | 0.011661903381347656 | distance: 0.01166variant: original 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
|
|
 |
 |
|
|
 |
|
|
|||
| original 1000px |  |
|
 |
 |
|
 |
|
 |
|
 |
|
 |
|
||
| original 500px | |
 |
|
 |
 |
 |
|
|
|
|
|
|
|||
| vectorized (all layers) | |