A Benchmark for Rough Sketch Cleanup
Ind_architecture_GD_05
Author: Guillaume Dufour Licence: CC-BY-NC-SA-4.0Messiness: 0.00481
Ambiguity (Chamfer): 0.02445
Shading: No
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Mastering Sketching | Poly Vector | Real-Time Inking | Poly Vector → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00016 |  distance: 0.00029 |  distance: 0.00034 |  distance: 0.00036 |  distance: 0.00075 |  distance: 0.00394 |  distance: 0.00459 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | |  | ||||
| Maria Hegedus |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.003941062139948229 | distance: 0.00394variant: vectorized (all layers) 1000pxalg. parameter: 0.25 | 206.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.004590937851864222 | distance: 0.00459variant: thresholded | 490.0 |
| Mastering Sketching | 0.00028806778703372284 | distance: 0.00029variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0007481071795988392 | distance: 0.00075variant: thresholded 1000pxalg. parameter: noisy | 1501.0 |
| Poly Vector | 0.00033572792006977766 | distance: 0.00034variant: vectorized (all layers) 1000px | 477.0 |
| Real-Time Inking | 0.00035516969698955604 | distance: 0.00036variant: thresholded 1000px | 3.0 |
| Topology Driven | 0.00016151479238616168 | distance: 0.00016variant: thresholded | 1378.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9188560921693896 |  distance: 0.91886variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.7580688290705823 |  distance: 0.75807variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.8799945252712178 |  distance: 0.87999variant: vectorized (all layers) 500px | 13.0 |
| Delaunay Triangulation | 0.24849032021119696 |  distance: 0.24849variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.4787904591425578 |  distance: 0.47879variant: vectorized (all layers) 500px | 72.0 |
| Poly Vector | 0.4993799725266003 |  distance: 0.49938variant: vectorized (all layers) 500pxalg. parameter: noisy | 153.0 |
| Fidelity Simplicity | 0.3491635389560116 |  distance: 0.34916variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 159.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9589485925492092 | distance: 0.95895variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8226818711977458 | distance: 0.82268variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.9466165733779376 | distance: 0.94662variant: vectorized (all layers) 500px | 13.0 |
| Poly Vector → Stroke Aggregator | 0.5923129172978744 | distance: 0.59231variant: vectorized (all layers) 500px | 72.0 |
| Poly Vector | 0.6095220908899516 | distance: 0.60952variant: vectorized (all layers) 500pxalg. parameter: noisy | 153.0 |
| Delaunay Triangulation | 0.38049975436592187 | distance: 0.3805variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.4849519781848875 |  distance: 0.48495variant: thresholded 500pxalg. parameter: 0.75 | 177.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9663370967532384 | distance: 0.96634variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8700446638353472 | distance: 0.87004variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.9717891953988784 | distance: 0.97179variant: vectorized (all layers) 500px | 13.0 |
| Poly Vector → Stroke Aggregator | 0.6870811522007025 | distance: 0.68708variant: vectorized (all layers) 500px | 72.0 |
| Poly Vector | 0.7008739146317475 | distance: 0.70087variant: vectorized (all layers) 500pxalg. parameter: noisy | 153.0 |
| Delaunay Triangulation | 0.4958580878782151 | distance: 0.49586variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.5802710738351369 | distance: 0.58027variant: thresholded 500pxalg. parameter: 0.75 | 177.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9708032029804794 | distance: 0.9708variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.902211691192378 | distance: 0.90221variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.977566799524555 |  distance: 0.97757variant: original | 1706.0 |
| Poly Vector → Stroke Aggregator | 0.7495541401586983 | distance: 0.74955variant: vectorized (all layers) 500px | 72.0 |
| Poly Vector | 0.7610012327812617 |  distance: 0.761variant: vectorized (all layers) 500px | 137.0 |
| Delaunay Triangulation | 0.5780782652043868 | distance: 0.57808variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.6358968375301716 | distance: 0.6359variant: thresholded 500pxalg. parameter: 0.75 | 177.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9754024468770122 | distance: 0.9754variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.9270170998604256 | distance: 0.92702variant: thresholded | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.9811342201721512 | distance: 0.98113variant: original | 1706.0 |
| Poly Vector → Stroke Aggregator | 0.8003060087241893 | distance: 0.80031variant: vectorized (all layers) 500px | 72.0 |
| Poly Vector | 0.8104464170847806 | distance: 0.81045variant: vectorized (all layers) 500px | 137.0 |
| Delaunay Triangulation | 0.6553725582628679 | distance: 0.65537variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.6884501537488864 | distance: 0.68845variant: thresholded 500pxalg. parameter: 0.75 | 177.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.06403124237060548 |  distance: 0.06403variant: thresholded 1000px | 36.0 |
| Mastering Sketching | 0.2203361053466797 |  distance: 0.22034variant: thresholded 500px | 6.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Poly Vector | 0.032802440643310546 | distance: 0.0328variant: vectorized (all layers) 1000px | 477.0 |
| Topology Driven | 0.028635643005371095 |  distance: 0.02864variant: vectorized (all layers) 1000px | 38.0 |
| Fidelity Simplicity | 0.10824047088623047 |  distance: 0.10824variant: vectorized (all layers) 1000pxalg. parameter: 0.3 | 216.0 |
| Poly Vector → Stroke Aggregator | 0.03748332977294922 | distance: 0.03748variant: thresholded 1000pxalg. parameter: noisy | 1501.0 |
| Real-Time Inking | 0.015 |  distance: 0.015variant: vectorized (all layers) 1000px | 3.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
|
 |
||||||||||||
| thresholded | |
|
|
||||||||||||
| thresholded 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
|
|||
| thresholded 500px |  |
|
 |
 |
 |
|
 |
 |
 |
 |
 |
 |
 |
||
| vectorized (all layers) 1000px | |
 |
|
|
 |
 |
 |
|
 |
|
 |
||||
| vectorized (all layers) 500px |  |
|
 |
 |
 |
|
 |
|
|
|
|
 |
|