A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_10
Author: Baseline Licence: Academic PaperMessiness: 0.217
Ambiguity (Chamfer): 0.38874
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Mastering Sketching | Topology Driven | Fidelity Simplicity | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00109 |  distance: 0.00121 |  distance: 0.00139 |  distance: 0.00147 |  distance: 0.00148 |  distance: 0.00167 |  distance: 0.00175 |  distance: 0.00175 |  distance: 0.00211 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0016738330202792852 | distance: 0.00167variant: original | 57.0 |
| Fidelity Simplicity | 0.0014711654390907568 | distance: 0.00147variant: originalalg. parameter: 0.25 | 350.0 |
| Mastering Sketching | 0.0012080297276886901 | distance: 0.00121variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0017530627757253552 | distance: 0.00175variant: thresholded 500px | 45.0 |
| Poly Vector | 0.0014752155340519164 | distance: 0.00148variant: thresholded 1000pxalg. parameter: noisy | 771.0 |
| Real-Time Inking | 0.0010853248240204076 | distance: 0.00109variant: thresholded | 3.0 |
| Stroke Aggregator | 0.0017510661024303007 | distance: 0.00175variant: vectorized (all layers) | 1169.0 |
| Topology Driven → Stroke Aggregator | 0.002110513991123096 | distance: 0.00211variant: vectorized (all layers) 1000px | 1775.0 |
| Topology Driven | 0.0013913319001637278 | distance: 0.00139variant: thresholded | 355.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5074140583095901 |  distance: 0.50741variant: thresholdedalg. parameter: 0.75 | 479.0 |
| Real-Time Inking | 0.5592858673625121 |  distance: 0.55929variant: vectorized (all layers) 1000px | 2.0 |
| Topology Driven | 0.4868283298471922 |  distance: 0.48683variant: original | 141.0 |
| Delaunay Triangulation | 0.370279115064568 |  distance: 0.37028variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.6568552264787155 |  distance: 0.65686variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.385019042271876 |  distance: 0.38502variant: vectorized (all layers) 500px | 15.0 |
| Poly Vector | 0.3941670932901756 |  distance: 0.39417variant: vectorized (all layers) 500pxalg. parameter: noisy | 62.0 |
| Stroke Aggregator | 0.5370741188309663 | distance: 0.53707variant: vectorized (all layers) | 1169.0 |
| Topology Driven → Stroke Aggregator | 0.4964400812778028 |  distance: 0.49644variant: vectorized (all layers) 500px | 206.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7732139074529589 |  distance: 0.77321variant: thresholded 1000pxalg. parameter: 0.3 | 318.0 |
| Poly Vector → Stroke Aggregator | 0.5243955067577971 | distance: 0.5244variant: vectorized (all layers) 500px | 15.0 |
| Poly Vector | 0.5336633591932264 | distance: 0.53366variant: vectorized (all layers) 500pxalg. parameter: noisy | 62.0 |
| Real-Time Inking | 0.7481284969075559 | distance: 0.74813variant: vectorized (all layers) 1000px | 2.0 |
| Topology Driven | 0.6811454923293929 | distance: 0.68115variant: original | 141.0 |
| Delaunay Triangulation | 0.5535186004423325 | distance: 0.55352variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.8227234529801729 | distance: 0.82272variant: vectorized (all layers) 500px | 8.0 |
| Stroke Aggregator | 0.7896745101812499 | distance: 0.78967variant: vectorized (all layers) | 1169.0 |
| Topology Driven → Stroke Aggregator | 0.6974704068738818 | distance: 0.69747variant: vectorized (all layers) 500px | 206.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9099515436216096 | distance: 0.90995variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector | 0.6177114119128521 |  distance: 0.61771variant: vectorized (all layers) 500px | 58.0 |
| Real-Time Inking | 0.8419239978569332 | distance: 0.84192variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.8930870979148319 | distance: 0.89309variant: vectorized (all layers) | 1169.0 |
| Topology Driven → Stroke Aggregator | 0.8289891241694274 | distance: 0.82899variant: vectorized (all layers) 500px | 206.0 |
| Topology Driven | 0.7494937501718509 | distance: 0.74949variant: original | 141.0 |
| Delaunay Triangulation | 0.7097276275715196 | distance: 0.70973variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.8772120921054409 |  distance: 0.87721variant: thresholdedalg. parameter: 0.25 | 316.0 |
| Poly Vector → Stroke Aggregator | 0.6071543865736964 | distance: 0.60715variant: vectorized (all layers) 500px | 15.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9385219765190094 | distance: 0.93852variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.6516772746559981 | distance: 0.65168variant: vectorized (all layers) 500px | 15.0 |
| Poly Vector | 0.6590131557578569 | distance: 0.65901variant: vectorized (all layers) 500pxalg. parameter: noisy | 62.0 |
| Real-Time Inking | 0.8874992252884045 | distance: 0.8875variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.9402599908433276 | distance: 0.94026variant: vectorized (all layers) | 1169.0 |
| Topology Driven → Stroke Aggregator | 0.8843523736739135 | distance: 0.88435variant: vectorized (all layers) 500px | 206.0 |
| Delaunay Triangulation | 0.7816643727070591 | distance: 0.78166variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.9430120801915708 |  distance: 0.94301variant: thresholdedalg. parameter: 0.6 | 459.0 |
| Topology Driven | 0.7859234816187114 | distance: 0.78592variant: original | 141.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.9656202763185538 |  distance: 0.96562variant: vectorized (all layers) 1000pxalg. parameter: 0.5 | 330.0 |
| Mastering Sketching | 0.9634325744308232 | distance: 0.96343variant: vectorized (all layers) 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.6868352309575733 | distance: 0.68684variant: vectorized (all layers) 500px | 15.0 |
| Poly Vector | 0.6956791905028844 | distance: 0.69568variant: vectorized (all layers) 500pxalg. parameter: noisy | 62.0 |
| Real-Time Inking | 0.9267115943400512 | distance: 0.92671variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.9575791663699668 | distance: 0.95758variant: vectorized (all layers) | 1169.0 |
| Topology Driven → Stroke Aggregator | 0.9257751293812913 | distance: 0.92578variant: vectorized (all layers) 500px | 206.0 |
| Delaunay Triangulation | 0.8405168280508414 | distance: 0.84052variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.8079914235174438 | distance: 0.80799variant: original | 141.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.015620499610900881 |  distance: 0.01562variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 247.0 |
| Poly Vector → Stroke Aggregator | 0.024 |  distance: 0.024variant: vectorized (all layers) 1000px | 500.0 |
| Poly Vector | 0.02353720474243164 |  distance: 0.02354variant: thresholded 1000px | 763.0 |
| Real-Time Inking | 0.020236087689713318 | distance: 0.02024variant: thresholded | 3.0 |
| Stroke Aggregator | 0.02304665542439573 | distance: 0.02305variant: vectorized (all layers) | 1169.0 |
| Topology Driven → Stroke Aggregator | 0.023 | distance: 0.023variant: vectorized (all layers) 1000px | 1775.0 |
| Topology Driven | 0.022000000000000002 |  distance: 0.022variant: thresholded 1000px | 91.0 |
| Delaunay Triangulation | 0.04077164305268278 | distance: 0.04077variant: original | 57.0 |
| Mastering Sketching | 0.3532987365722656 | distance: 0.3533variant: vectorized (all layers) 500px | 8.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
|
 |
 |
 |
|
|
|||||||
| thresholded | |
 |
|
 |
|
|
|
 |
|||||||
| thresholded 1000px |  |
|
 |
 |
 |
 |
|
|
|
 |
|||||
| thresholded 500px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
||
| vectorized (all layers) 1000px | |
|
 |
 |
|
 |
 |
 |
 |
 |
 |
|
|||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
 |
|
 |
|
|
|
|
||
| vectorized (all layers) | |