A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_13
Author: Baseline Licence: Academic PaperMessiness: 0.03291
Ambiguity (Chamfer): 0.25146
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Poly Vector | Topology Driven | Stroke Aggregator | Mastering Sketching | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00072 |  distance: 0.00076 |  distance: 0.00077 |  distance: 0.00085 |  distance: 0.00093 |  distance: 0.00103 |  distance: 0.00117 |  distance: 0.0015 |  distance: 0.00253 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0014950238313545575 | distance: 0.0015variant: thresholded | 20.0 |
| Fidelity Simplicity | 0.0025256221601357817 | distance: 0.00253variant: thresholdedalg. parameter: 0.75 | 372.0 |
| Mastering Sketching | 0.0009339354804595438 | distance: 0.00093variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0011738910508969562 | distance: 0.00117variant: thresholded 500px | 21.0 |
| Poly Vector | 0.0007594127676105968 | distance: 0.00076variant: thresholdedalg. parameter: noisy | 739.0 |
| Real-Time Inking | 0.0007193190184891561 | distance: 0.00072variant: thresholded | 3.0 |
| Stroke Aggregator | 0.0008494599671561514 | distance: 0.00085variant: vectorized (all layers) | 154.0 |
| Topology Driven → Stroke Aggregator | 0.0010300846343895868 | distance: 0.00103variant: vectorized (all layers) 1000px | 105.0 |
| Topology Driven | 0.0007660447919662117 | distance: 0.00077variant: thresholded | 83.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6339399280824454 | distance: 0.63394variant: thresholdedalg. parameter: 0.75 | 372.0 |
| Mastering Sketching | 0.7719267709097322 |  distance: 0.77193variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7191494356136346 | distance: 0.71915variant: thresholded 500px | 21.0 |
| Poly Vector | 0.32353213248343105 |  distance: 0.32353variant: vectorized (all layers) 500pxalg. parameter: noisy | 39.0 |
| Real-Time Inking | 0.6312017366319747 |  distance: 0.6312variant: original | 3.0 |
| Stroke Aggregator | 0.7078143803771937 | distance: 0.70781variant: vectorized (all layers) | 154.0 |
| Topology Driven → Stroke Aggregator | 0.7369042596230279 | distance: 0.7369variant: vectorized (all layers) 1000px | 105.0 |
| Topology Driven | 0.35474548432270264 |  distance: 0.35475variant: original | 22.0 |
| Delaunay Triangulation | 0.0018484901022916176 |  distance: 0.00185variant: original | 1.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.8580153307612665 |  distance: 0.85802variant: originalalg. parameter: 0.25 | 374.0 |
| Poly Vector → Stroke Aggregator | 0.906558046268342 | distance: 0.90656variant: thresholded 500px | 21.0 |
| Poly Vector | 0.4076246220948472 | distance: 0.40762variant: vectorized (all layers) 500pxalg. parameter: noisy | 39.0 |
| Real-Time Inking | 0.8275641960191329 |  distance: 0.82756variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8999041643854478 | distance: 0.8999variant: vectorized (all layers) | 154.0 |
| Topology Driven → Stroke Aggregator | 0.8950707394074392 | distance: 0.89507variant: vectorized (all layers) 1000px | 105.0 |
| Mastering Sketching | 0.926379905369998 | distance: 0.92638variant: thresholded 500px | 5.0 |
| Topology Driven | 0.5209217956462064 | distance: 0.52092variant: original | 22.0 |
| Delaunay Triangulation | 0.003821534346039936 | distance: 0.00382variant: original | 1.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.96898631471331 | distance: 0.96899variant: thresholded 500px | 21.0 |
| Poly Vector | 0.47313250474212 | distance: 0.47313variant: vectorized (all layers) 500pxalg. parameter: noisy | 39.0 |
| Real-Time Inking | 0.9044967235656196 | distance: 0.9045variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9795530079949074 | distance: 0.97955variant: vectorized (all layers) | 154.0 |
| Topology Driven → Stroke Aggregator | 0.9785511675582146 | distance: 0.97855variant: vectorized (all layers) 1000px | 105.0 |
| Fidelity Simplicity | 0.9443221930314928 |  distance: 0.94432variant: thresholded 500pxalg. parameter: 0.75 | 140.0 |
| Mastering Sketching | 0.974600251105026 | distance: 0.9746variant: thresholded 500px | 5.0 |
| Topology Driven | 0.6156678788192215 | distance: 0.61567variant: original | 22.0 |
| Delaunay Triangulation | 0.004965148477036189 | distance: 0.00497variant: original | 1.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.9560052716424666 |  distance: 0.95601variant: thresholded 1000pxalg. parameter: 0.5 | 233.0 |
| Mastering Sketching | 0.9891534130367762 | distance: 0.98915variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.982266424598598 | distance: 0.98227variant: thresholded 500px | 21.0 |
| Poly Vector | 0.5054565070947207 |  distance: 0.50546variant: vectorized (all layers) 500px | 38.0 |
| Real-Time Inking | 0.9249671166448741 | distance: 0.92497variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9895310538495942 | distance: 0.98953variant: vectorized (all layers) | 154.0 |
| Topology Driven → Stroke Aggregator | 0.9907260291147636 | distance: 0.99073variant: vectorized (all layers) 1000px | 105.0 |
| Topology Driven | 0.6624743615750446 | distance: 0.66247variant: original | 22.0 |
| Delaunay Triangulation | 0.006170876009924295 | distance: 0.00617variant: original | 1.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.9602286139962048 |  distance: 0.96023variant: thresholded 1000pxalg. parameter: 0.3 | 259.0 |
| Mastering Sketching | 0.9949452878164444 | distance: 0.99495variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.988518817232458 | distance: 0.98852variant: thresholded 500px | 21.0 |
| Poly Vector | 0.5410775971380767 | distance: 0.54108variant: vectorized (all layers) 500pxalg. parameter: noisy | 39.0 |
| Real-Time Inking | 0.9402369447744892 | distance: 0.94024variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9931487758758374 | distance: 0.99315variant: vectorized (all layers) | 154.0 |
| Topology Driven → Stroke Aggregator | 0.9936954087242924 | distance: 0.9937variant: vectorized (all layers) 1000px | 105.0 |
| Topology Driven | 0.696639578300022 | distance: 0.69664variant: original | 22.0 |
| Delaunay Triangulation | 0.0073751470260991206 | distance: 0.00738variant: original | 1.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.08575732922215745 | distance: 0.08576variant: thresholded | 20.0 |
| Fidelity Simplicity | 0.10068763732910156 |  distance: 0.10069variant: vectorized (all layers) 1000pxalg. parameter: 0.5 | 241.0 |
| Poly Vector | 0.008917793999580226 | distance: 0.00892variant: thresholdedalg. parameter: noisy | 739.0 |
| Mastering Sketching | 0.37200537109375 | distance: 0.37201variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.024166091918945316 | distance: 0.02417variant: thresholded 500px | 21.0 |
| Real-Time Inking | 0.013137151865475564 | distance: 0.01314variant: thresholded | 3.0 |
| Stroke Aggregator | 0.016889288496858373 | distance: 0.01689variant: vectorized (all layers) | 154.0 |
| Topology Driven → Stroke Aggregator | 0.01612451553344726 | distance: 0.01612variant: vectorized (all layers) 1000px | 105.0 |
| Topology Driven | 0.008 |  distance: 0.008variant: thresholded 1000px | 15.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
 |
 |
|
 |
 |
|
|||||
| thresholded | |
 |
 |
 |
|
 |
|
|
 |
|
|||||
| thresholded 1000px |  |
|
 |
|
 |
 |
|
 |
 |
 |
|||||
| thresholded 500px |  |
|
 |
 |
 |
|
 |
 |
 |
 |
 |
|
|||
| vectorized (all layers) 1000px | |
 |
 |
 |
|
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
 |
|
|
 |
||||
| vectorized (all layers) | |