A Benchmark for Rough Sketch Cleanup
Ind_product_GW_06
Author: Graham Wilson Licence: CC-BY-4.0Messiness: 0.19317
Ambiguity (Chamfer): 0.10749
Shading: No
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Fidelity Simplicity | Mastering Sketching | Topology Driven | Poly Vector → Stroke Aggregator | Poly Vector | Topology Driven → Stroke Aggregator | Real-Time Inking | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00214 |  distance: 0.00242 |  distance: 0.00262 |  distance: 0.00272 |  distance: 0.00274 |  distance: 0.00275 |  distance: 0.00277 |  distance: 0.00279 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.002791636528520682 | distance: 0.00279variant: vectorized (all layers) 1000px | 8.0 |
| Fidelity Simplicity | 0.0021425728390367053 | distance: 0.00214variant: thresholdedalg. parameter: 0.25 | 208.0 |
| Mastering Sketching | 0.0024204455161775623 | distance: 0.00242variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.0027433879689549513 | distance: 0.00274variant: vectorized (all layers) 1000pxalg. parameter: noisy | 250.0 |
| Stroke Aggregator | nan | ||
| Real-Time Inking | 0.0027747430071267056 | distance: 0.00277variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.002722978471595437 | distance: 0.00272variant: vectorized (all layers) 1000pxalg. parameter: noisy | 192.0 |
| Topology Driven → Stroke Aggregator | 0.0027491806050084005 | distance: 0.00275variant: original | 785.0 |
| Topology Driven | 0.0026245223305827532 | distance: 0.00262variant: vectorized (all layers) 1000px | 28.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.39042171843515705 |  distance: 0.39042variant: original | 26.0 |
| Mastering Sketching | 0.6671855316095276 |  distance: 0.66719variant: thresholded 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.272359316817302 |  distance: 0.27236variant: originalalg. parameter: 0.6 | 241.0 |
| Poly Vector → Stroke Aggregator | 0.4418865407297313 |  distance: 0.44189variant: original | 156.0 |
| Poly Vector | 0.43909908806178943 |  distance: 0.4391variant: originalalg. parameter: noisy | 696.0 |
| Real-Time Inking | 0.42026633400918695 |  distance: 0.42027variant: thresholded | 2.0 |
| Topology Driven → Stroke Aggregator | 0.4556083535866293 |  distance: 0.45561variant: thresholded | 348.0 |
| Topology Driven | 0.4444499332132562 |  distance: 0.44445variant: original | 80.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5028440917588676 |  distance: 0.50284variant: originalalg. parameter: 0.75 | 272.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.690716448589537 | distance: 0.69072variant: original | 785.0 |
| Mastering Sketching | 0.8345147388143916 | distance: 0.83451variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7164410763793638 |  distance: 0.71644variant: originalalg. parameter: noisy | 157.0 |
| Real-Time Inking | 0.6938722509962091 |  distance: 0.69387variant: vectorized (all layers) 1000px | 2.0 |
| Topology Driven | 0.7045723177213126 | distance: 0.70457variant: original | 80.0 |
| Delaunay Triangulation | 0.6735829213183189 |  distance: 0.67358variant: thresholded 500px | 3.0 |
| Poly Vector | 0.6067588104895933 |  distance: 0.60676variant: vectorized (all layers) 500pxalg. parameter: noisy | 44.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6807719200772073 | distance: 0.68077variant: originalalg. parameter: 0.75 | 272.0 |
| Mastering Sketching | 0.8994877601548137 | distance: 0.89949variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8097209813661225 | distance: 0.80972variant: originalalg. parameter: noisy | 157.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8005347650685591 | distance: 0.80053variant: original | 785.0 |
| Delaunay Triangulation | 0.7808387650374817 |  distance: 0.78084variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector | 0.667929178935552 | distance: 0.66793variant: vectorized (all layers) 500pxalg. parameter: noisy | 44.0 |
| Real-Time Inking | 0.8031657239222667 | distance: 0.80317variant: vectorized (all layers) 1000px | 2.0 |
| Topology Driven | 0.8180055762626668 | distance: 0.81801variant: original | 80.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9359144786080248 | distance: 0.93591variant: thresholded 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8736245142948933 | distance: 0.87362variant: original | 785.0 |
| Real-Time Inking | 0.8528106968186494 | distance: 0.85281variant: vectorized (all layers) 1000px | 2.0 |
| Delaunay Triangulation | 0.8456154385823235 | distance: 0.84562variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.7690217669312984 | distance: 0.76902variant: originalalg. parameter: 0.75 | 272.0 |
| Poly Vector → Stroke Aggregator | 0.8914276217867787 | distance: 0.89143variant: original | 156.0 |
| Poly Vector | 0.7187643753987198 | distance: 0.71876variant: vectorized (all layers) 500pxalg. parameter: noisy | 44.0 |
| Topology Driven | 0.8780759887184995 | distance: 0.87808variant: original | 80.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.9302751077345311 | distance: 0.93028variant: originalalg. parameter: noisy | 157.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.920897508578524 | distance: 0.9209variant: original | 785.0 |
| Poly Vector | 0.7466328945474052 | distance: 0.74663variant: vectorized (all layers) 500pxalg. parameter: noisy | 44.0 |
| Real-Time Inking | 0.8861736214887491 | distance: 0.88617variant: vectorized (all layers) 1000px | 2.0 |
| Delaunay Triangulation | 0.8977195254209978 | distance: 0.89772variant: original | 26.0 |
| Fidelity Simplicity | 0.8216047112242142 | distance: 0.8216variant: originalalg. parameter: 0.75 | 272.0 |
| Mastering Sketching | 0.9581772029493532 | distance: 0.95818variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven | 0.920193750318924 | distance: 0.92019variant: original | 80.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.07334848022460938 | distance: 0.07335variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector → Stroke Aggregator | 0.07432361602783204 |  distance: 0.07432variant: thresholded 1000px | 115.0 |
| Poly Vector | 0.050990196228027335 |  distance: 0.05099variant: thresholded 500px | 70.0 |
| Real-Time Inking | 0.07373601531982422 | distance: 0.07374variant: vectorized (all layers) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.07022820281982421 |  distance: 0.07023variant: thresholded 500px | 169.0 |
| Topology Driven | 0.07211102294921876 |  distance: 0.07211variant: thresholded 500px | 10.0 |
| Fidelity Simplicity | 0.014560219764709472 |  distance: 0.01456variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 191.0 |
| Mastering Sketching | 0.3130814514160156 | distance: 0.31308variant: vectorized (all layers) 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
|
|
|
|
 |
|
|
|
||
| thresholded | |
|
 |
|
 |
 |
 |
 |
 |
 |
|||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
||
| thresholded 500px | |
 |
|
 |
 |
 |
 |
 |
|
 |
|
|
|||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
|
|
 |
|
|
 |
||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
|
 |
|
 |
|