A Benchmark for Rough Sketch Cleanup
Ind_product_GW_01
Author: Graham Wilson Licence: CC-BY-4.0Messiness: 0.10324
Ambiguity (Chamfer): 0.06454
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Poly Vector | Delaunay Triangulation | Topology Driven | Poly Vector → Stroke Aggregator | Real-Time Inking | Topology Driven → Stroke Aggregator | Mastering Sketching | Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00174 |  distance: 0.0018 |  distance: 0.00185 |  distance: 0.0019 |  distance: 0.00191 |  distance: 0.00207 |  distance: 0.00209 |  distance: 0.00253 |  distance: 0.00374 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.001905127416655751 | distance: 0.00191variant: original | 5.0 |
| Delaunay Triangulation | 0.0017969365435956293 | distance: 0.0018variant: original | 1480.0 |
| Fidelity Simplicity | 0.003744092088424878 | distance: 0.00374variant: thresholdedalg. parameter: 0.25 | 706.0 |
| Mastering Sketching | 0.0020895622042509947 | distance: 0.00209variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0018999292950271649 | distance: 0.0019variant: thresholded 500px | 39.0 |
| Poly Vector | 0.0017388148900405794 | distance: 0.00174variant: thresholded 1000px | 263.0 |
| Stroke Aggregator | 0.002533523415458541 | distance: 0.00253variant: vectorized (all layers) | 1619.0 |
| Topology Driven → Stroke Aggregator | 0.0020732494665929354 | distance: 0.00207variant: thresholded 1000px | 522.0 |
| Topology Driven | 0.0018468099534499727 | distance: 0.00185variant: thresholded 1000px | 35.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4965818932860583 |  distance: 0.49658variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.474237427006159 |  distance: 0.47424variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 207.0 |
| Mastering Sketching | 0.6859396297527498 |  distance: 0.68594variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.43434010194808775 |  distance: 0.43434variant: vectorized (all layers) 500pxalg. parameter: noisy | 17.0 |
| Poly Vector | 0.4557214581134826 |  distance: 0.45572variant: vectorized (all layers) 500pxalg. parameter: noisy | 64.0 |
| Real-Time Inking | 0.6501275954811385 |  distance: 0.65013variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.6664592196492052 | distance: 0.66646variant: vectorized (all layers) | 1619.0 |
| Topology Driven → Stroke Aggregator | 0.5839354795191344 |  distance: 0.58394variant: vectorized (all layers) 500px | 234.0 |
| Topology Driven | 0.6741863372988627 |  distance: 0.67419variant: vectorized (all layers) 1000px | 17.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6670047977037146 | distance: 0.667variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.6420887908621561 |  distance: 0.64209variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 173.0 |
| Mastering Sketching | 0.8076139356435827 | distance: 0.80761variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.7887315389391942 | distance: 0.78873variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.8243471194821432 | distance: 0.82435variant: vectorized (all layers) | 1619.0 |
| Topology Driven → Stroke Aggregator | 0.7433738030540542 | distance: 0.74337variant: vectorized (all layers) 500px | 234.0 |
| Topology Driven | 0.7947998788374238 |  distance: 0.7948variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5314076355333723 | distance: 0.53141variant: vectorized (all layers) 500pxalg. parameter: noisy | 17.0 |
| Poly Vector | 0.54426594060194 |  distance: 0.54427variant: vectorized (all layers) 500px | 57.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7612381563012041 | distance: 0.76124variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.7369644634555662 |  distance: 0.73696variant: originalalg. parameter: 0.5 | 987.0 |
| Mastering Sketching | 0.872286834868603 | distance: 0.87229variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5987038712675161 |  distance: 0.5987variant: vectorized (all layers) 500px | 17.0 |
| Poly Vector | 0.608818975650374 | distance: 0.60882variant: vectorized (all layers) 500pxalg. parameter: noisy | 64.0 |
| Real-Time Inking | 0.8587325418135143 | distance: 0.85873variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.8689828210362766 | distance: 0.86898variant: vectorized (all layers) | 1619.0 |
| Topology Driven → Stroke Aggregator | 0.8502728129843534 | distance: 0.85027variant: vectorized (all layers) 500px | 234.0 |
| Topology Driven | 0.8704042768715756 | distance: 0.8704variant: vectorized (all layers) 500px | 6.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8081143416270619 | distance: 0.80811variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.7597477566969243 |  distance: 0.75975variant: originalalg. parameter: 0.3 | 989.0 |
| Mastering Sketching | 0.9025081398871958 |  distance: 0.90251variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.640006892211713 | distance: 0.64001variant: vectorized (all layers) 500pxalg. parameter: noisy | 17.0 |
| Poly Vector | 0.6506432985513119 | distance: 0.65064variant: vectorized (all layers) 500px | 57.0 |
| Real-Time Inking | 0.8989067849398635 | distance: 0.89891variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.9006467944040791 | distance: 0.90065variant: vectorized (all layers) | 1619.0 |
| Topology Driven → Stroke Aggregator | 0.8949356193546402 | distance: 0.89494variant: vectorized (all layers) 500px | 234.0 |
| Topology Driven | 0.9062979065018848 | distance: 0.9063variant: vectorized (all layers) 500px | 6.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8584109244554701 | distance: 0.85841variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.7755916915337588 |  distance: 0.77559variant: originalalg. parameter: 0.75 | 1142.0 |
| Mastering Sketching | 0.924376438940632 | distance: 0.92438variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.684543152637591 | distance: 0.68454variant: vectorized (all layers) 500pxalg. parameter: noisy | 17.0 |
| Poly Vector | 0.6973846464637962 | distance: 0.69738variant: vectorized (all layers) 500px | 57.0 |
| Real-Time Inking | 0.921367909410828 |  distance: 0.92137variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9231763785598152 | distance: 0.92318variant: vectorized (all layers) | 1619.0 |
| Topology Driven → Stroke Aggregator | 0.9291649594801986 |  distance: 0.92916variant: vectorized (all layers) 1000px | 1151.0 |
| Topology Driven | 0.9338505680385256 | distance: 0.93385variant: vectorized (all layers) 500px | 6.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.16458432006835938 | distance: 0.16458variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.039293766021728516 | distance: 0.03929variant: thresholded 500px | 39.0 |
| Poly Vector | 0.039293766021728516 |  distance: 0.03929variant: thresholded 500px | 90.0 |
| Real-Time Inking | 0.032455699366707585 | distance: 0.03246variant: original | 5.0 |
| Topology Driven → Stroke Aggregator | 0.0394461669921875 |  distance: 0.03945variant: thresholded 500px | 237.0 |
| Topology Driven | 0.039849716186523436 |  distance: 0.03985variant: thresholded 500px | 9.0 |
| Delaunay Triangulation | 0.036213587700272686 | distance: 0.03621variant: original | 1480.0 |
| Fidelity Simplicity | 0.04262030179003249 |  distance: 0.04262variant: thresholdedalg. parameter: 0.75 | 1124.0 |
| Stroke Aggregator | 0.05805529724213832 | distance: 0.05806variant: vectorized (all layers) | 1619.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
|
|
|
|||||||||
| thresholded |  |
|
 |
|
|||||||||||
| thresholded 1000px | |
 |
|
 |
 |
 |
 |
 |
|
 |
|
 |
 |
 |
|
| thresholded 500px | |
 |
 |
 |
 |
 |
 |
 |
|
 |
|
 |
 |
|
|
| vectorized (all layers) 1000px | |
|
|
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
|
|
|
|
|
|
|
|
|
| vectorized (all layers) | |