A Benchmark for Rough Sketch Cleanup
Ind_product_GW_03
Author: Graham Wilson Licence: CC-BY-4.0Messiness: 0.06845
Ambiguity (Chamfer): 0.08676
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector | Poly Vector → Stroke Aggregator | Topology Driven | Real-Time Inking | Fidelity Simplicity | Delaunay Triangulation | Topology Driven → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00141 |  distance: 0.00176 |  distance: 0.00176 |  distance: 0.00178 |  distance: 0.00186 |  distance: 0.00252 |  distance: 0.00267 |  distance: 0.0029 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.002672152465793359 | distance: 0.00267variant: vectorized (all layers) 1000px | 4.0 |
| Fidelity Simplicity | 0.002516209025920812 | distance: 0.00252variant: thresholdedalg. parameter: 0.75 | 745.0 |
| Mastering Sketching | 0.0014122694450903288 | distance: 0.00141variant: thresholded 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0017609250913838321 | distance: 0.00176variant: thresholded 1000pxalg. parameter: noisy | 99.0 |
| Poly Vector | 0.0017564933725116095 | distance: 0.00176variant: thresholded 1000px | 739.0 |
| Real-Time Inking | 0.0018649638011570423 | distance: 0.00186variant: thresholded | 4.0 |
| Topology Driven → Stroke Aggregator | 0.002902528056127177 | distance: 0.0029variant: thresholded 500px | 217.0 |
| Topology Driven | 0.0017829513392561226 | distance: 0.00178variant: thresholded 1000px | 68.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.34851905135072964 |  distance: 0.34852variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.41791811639648624 |  distance: 0.41792variant: originalalg. parameter: 0.5 | 662.0 |
| Mastering Sketching | 0.6563875961650699 |  distance: 0.65639variant: vectorized (all layers) 500px | 11.0 |
| Poly Vector → Stroke Aggregator | 0.5976594253451 |  distance: 0.59766variant: vectorized (all layers) 1000px | 124.0 |
| Poly Vector | 0.2763067934086479 |  distance: 0.27631variant: vectorized (all layers) 500pxalg. parameter: noisy | 56.0 |
| Real-Time Inking | 0.5854373401083828 |  distance: 0.58544variant: original | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.509192045173479 | distance: 0.50919variant: thresholded 500px | 217.0 |
| Topology Driven | 0.5956196165402231 |  distance: 0.59562variant: thresholded 500px | 13.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5432364275189844 | distance: 0.54324variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.5761732145747233 |  distance: 0.57617variant: originalalg. parameter: 0.6 | 692.0 |
| Mastering Sketching | 0.8220115408094268 | distance: 0.82201variant: vectorized (all layers) 500px | 11.0 |
| Poly Vector → Stroke Aggregator | 0.787180016879923 |  distance: 0.78718variant: vectorized (all layers) 1000pxalg. parameter: noisy | 123.0 |
| Poly Vector | 0.3758408653567703 | distance: 0.37584variant: vectorized (all layers) 500pxalg. parameter: noisy | 56.0 |
| Real-Time Inking | 0.7471818753743263 | distance: 0.74718variant: original | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7398655816154079 | distance: 0.73987variant: thresholded 500px | 217.0 |
| Topology Driven | 0.7718661124480419 |  distance: 0.77187variant: vectorized (all layers) 500px | 4.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.684987818583637 | distance: 0.68499variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.6140927769508765 | distance: 0.61409variant: originalalg. parameter: 0.6 | 692.0 |
| Mastering Sketching | 0.9063935953073304 | distance: 0.90639variant: vectorized (all layers) 500px | 11.0 |
| Poly Vector → Stroke Aggregator | 0.8926408458930776 |  distance: 0.89264variant: thresholded 1000px | 98.0 |
| Poly Vector | 0.4450042758998044 |  distance: 0.445variant: vectorized (all layers) 500px | 51.0 |
| Real-Time Inking | 0.8183495096941941 | distance: 0.81835variant: original | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8587057468122896 | distance: 0.85871variant: thresholded 500px | 217.0 |
| Topology Driven | 0.8682631416209117 | distance: 0.86826variant: thresholded 500px | 13.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7617822908693882 | distance: 0.76178variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.6517948474102593 | distance: 0.65179variant: originalalg. parameter: 0.5 | 662.0 |
| Mastering Sketching | 0.9486987006640338 | distance: 0.9487variant: vectorized (all layers) 500px | 11.0 |
| Poly Vector → Stroke Aggregator | 0.937582409705136 | distance: 0.93758variant: thresholded 1000pxalg. parameter: noisy | 99.0 |
| Poly Vector | 0.5003950803330011 | distance: 0.5004variant: vectorized (all layers) 500px | 51.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9052651111374316 | distance: 0.90527variant: thresholded 500px | 217.0 |
| Topology Driven | 0.909095329268294 | distance: 0.9091variant: thresholded 500px | 13.0 |
| Real-Time Inking | 0.8478107332370065 | distance: 0.84781variant: original | 4.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8274738803716529 | distance: 0.82747variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.6777053595821312 | distance: 0.67771variant: originalalg. parameter: 0.6 | 692.0 |
| Mastering Sketching | 0.9797044070820341 | distance: 0.9797variant: vectorized (all layers) 500px | 11.0 |
| Poly Vector → Stroke Aggregator | 0.9644410270246718 | distance: 0.96444variant: thresholded 1000pxalg. parameter: noisy | 99.0 |
| Poly Vector | 0.5501341803748481 | distance: 0.55013variant: vectorized (all layers) 500px | 51.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.942292958971446 | distance: 0.94229variant: thresholded 500px | 217.0 |
| Topology Driven | 0.9380121573183459 | distance: 0.93801variant: thresholded 500px | 13.0 |
| Real-Time Inking | 0.8704327810581901 | distance: 0.87043variant: original | 4.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.055464873046875 |  distance: 0.05546variant: thresholdedalg. parameter: 0.5 | 634.0 |
| Mastering Sketching | 0.4613458557128906 | distance: 0.46135variant: thresholded 500px | 6.0 |
| Real-Time Inking | 0.026172504425048832 |  distance: 0.02617variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.024166091918945316 | distance: 0.02417variant: vectorized (all layers) 500px | 4.0 |
| Delaunay Triangulation | 0.057314918518066416 | distance: 0.05731variant: vectorized (all layers) 1000px | 4.0 |
| Poly Vector → Stroke Aggregator | 0.023323806762695312 |  distance: 0.02332variant: thresholded 500pxalg. parameter: noisy | 51.0 |
| Poly Vector | 0.023323806762695312 |  distance: 0.02332variant: thresholded 500pxalg. parameter: noisy | 107.0 |
| Topology Driven → Stroke Aggregator | 0.045607017517089836 | distance: 0.04561variant: thresholded 500px | 217.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
|
 |
|
 |
||||||||
| thresholded | |
 |
 |
|
|
 |
|||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
|
 |
|
 |
|
|
|||
| thresholded 500px | |
 |
|
 |
 |
 |
 |
 |
|
|
 |
 |
|
 |
|
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
|
|||
| vectorized (all layers) 500px |  |
|
 |
 |
 |
 |
 |
|
|
|
|