A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_09
Author: Baseline Licence: Academic PaperMessiness: 0.11745
Ambiguity (Chamfer): 0.56601
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector | Topology Driven | Fidelity Simplicity | Real-Time Inking | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0008 |  distance: 0.00097 |  distance: 0.00106 |  distance: 0.00113 |  distance: 0.00123 |  distance: 0.00123 |  distance: 0.00128 |  distance: 0.00197 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.0019714118463362677 | distance: 0.00197variant: original | 39.0 |
| Fidelity Simplicity | 0.0011274099483914752 | distance: 0.00113variant: originalalg. parameter: 0.75 | 552.0 |
| Mastering Sketching | 0.0008020150074102987 | distance: 0.0008variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0012332147176099214 | distance: 0.00123variant: thresholded 1000px | 129.0 |
| Poly Vector | 0.0009687645264961613 | distance: 0.00097variant: original | 1534.0 |
| Real-Time Inking | 0.001232591942799711 | distance: 0.00123variant: thresholded | 3.0 |
| Topology Driven → Stroke Aggregator | 0.001277500288029308 | distance: 0.00128variant: thresholded 1000px | 230.0 |
| Topology Driven | 0.0010632034603937654 | distance: 0.00106variant: thresholded | 218.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.571388424385663 |  distance: 0.57139variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 236.0 |
| Mastering Sketching | 0.6469824994778655 |  distance: 0.64698variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6246800495477179 | distance: 0.62468variant: thresholded 1000px | 129.0 |
| Poly Vector | 0.2229142006396951 |  distance: 0.22291variant: vectorized (all layers) 500px | 36.0 |
| Real-Time Inking | 0.5617522858297228 |  distance: 0.56175variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.4735105671097718 |  distance: 0.47351variant: vectorized (all layers) 500px | 91.0 |
| Topology Driven | 0.5859321811984812 |  distance: 0.58593variant: vectorized (all layers) 500px | 3.0 |
| Delaunay Triangulation | 0.3781756567972718 |  distance: 0.37818variant: vectorized (all layers) 500px | 1.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8106738383851436 | distance: 0.81067variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 236.0 |
| Mastering Sketching | 0.8242824073936473 | distance: 0.82428variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8066810473270235 |  distance: 0.80668variant: vectorized (all layers) 1000px | 132.0 |
| Poly Vector | 0.32925620527435223 | distance: 0.32926variant: vectorized (all layers) 500px | 36.0 |
| Real-Time Inking | 0.7569991458888312 | distance: 0.757variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7123841752763685 | distance: 0.71238variant: vectorized (all layers) 500px | 91.0 |
| Topology Driven | 0.7885799407920984 | distance: 0.78858variant: vectorized (all layers) 500px | 3.0 |
| Delaunay Triangulation | 0.5820055593747198 | distance: 0.58201variant: vectorized (all layers) 500px | 1.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8875776868914407 |  distance: 0.88758variant: vectorized (all layers) 1000pxalg. parameter: 0.6 | 349.0 |
| Mastering Sketching | 0.8989565954713553 | distance: 0.89896variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8890240235115074 | distance: 0.88902variant: vectorized (all layers) 1000px | 132.0 |
| Real-Time Inking | 0.8416443167667187 | distance: 0.84164variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8376533649143099 | distance: 0.83765variant: vectorized (all layers) 500px | 91.0 |
| Topology Driven | 0.8663665433590814 |  distance: 0.86637variant: original | 129.0 |
| Delaunay Triangulation | 0.7195126650583508 | distance: 0.71951variant: vectorized (all layers) 500px | 1.0 |
| Poly Vector | 0.4052624546032389 | distance: 0.40526variant: vectorized (all layers) 500px | 36.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.931111432572327 |  distance: 0.93111variant: thresholded 500pxalg. parameter: 0.6 | 258.0 |
| Mastering Sketching | 0.9459834927072552 | distance: 0.94598variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9316969611614491 | distance: 0.9317variant: vectorized (all layers) 1000px | 132.0 |
| Real-Time Inking | 0.9095215430036498 | distance: 0.90952variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9169005168552916 | distance: 0.9169variant: vectorized (all layers) 500px | 91.0 |
| Topology Driven | 0.9171116168231872 | distance: 0.91711variant: original | 129.0 |
| Delaunay Triangulation | 0.7835595000308877 | distance: 0.78356variant: vectorized (all layers) 500px | 1.0 |
| Poly Vector | 0.4611873273152672 |  distance: 0.46119variant: vectorized (all layers) 500pxalg. parameter: noisy | 39.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9629985505142372 | distance: 0.963variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.965017807140604 | distance: 0.96502variant: thresholded 1000px | 129.0 |
| Real-Time Inking | 0.9377488478211063 |  distance: 0.93775variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9491196742325096 | distance: 0.94912variant: vectorized (all layers) 500px | 91.0 |
| Topology Driven | 0.9322903325927882 | distance: 0.93229variant: original | 129.0 |
| Delaunay Triangulation | 0.8260424634307074 | distance: 0.82604variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.9567701807952812 |  distance: 0.95677variant: thresholded 500pxalg. parameter: 0.75 | 251.0 |
| Poly Vector | 0.5020117610646858 | distance: 0.50201variant: vectorized (all layers) 500px | 36.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.01897366523742676 |  distance: 0.01897variant: thresholded 500pxalg. parameter: 0.25 | 224.0 |
| Poly Vector → Stroke Aggregator | 0.025961509704589845 | distance: 0.02596variant: thresholded 1000px | 129.0 |
| Real-Time Inking | 0.033957940021544016 |  distance: 0.03396variant: original | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.02607680892944336 | distance: 0.02608variant: vectorized (all layers) 500px | 91.0 |
| Topology Driven | 0.026000000000000002 |  distance: 0.026variant: thresholded 500px | 8.0 |
| Mastering Sketching | 0.1004390335083008 |  distance: 0.10044variant: thresholded 500px | 5.0 |
| Poly Vector | 0.02268103788827212 |  distance: 0.02268variant: originalalg. parameter: noisy | 1488.0 |
| Delaunay Triangulation | 0.076843994140625 |  distance: 0.07684variant: vectorized (all layers) 1000px | 3.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
|
 |
|
|
|
|
|||||
| thresholded | |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded 1000px | |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
||
| thresholded 500px |  |
|
 |
|
 |
|
|
|
 |
 |
 |
||||
| vectorized (all layers) 1000px |  |
|
|
 |
 |
 |
 |
|
 |
 |
 |
|
|
||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
|
 |
|
|
|
|