A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_15
Author: Baseline Licence: Academic PaperMessiness: 0.25434
Ambiguity (Chamfer): 0.16578
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Stroke Aggregator | Fidelity Simplicity | Topology Driven | Poly Vector | Real-Time Inking | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0014 |  distance: 0.00153 |  distance: 0.00168 |  distance: 0.00171 |  distance: 0.00172 |  distance: 0.00176 |  distance: 0.0018 |  distance: 0.00183 |  distance: 0.00236 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0023581946743110797 | distance: 0.00236variant: vectorized (all layers) 1000px | 5.0 |
| Fidelity Simplicity | 0.00167839692685896 | distance: 0.00168variant: vectorized (all layers) 1000pxalg. parameter: 0.3 | 343.0 |
| Mastering Sketching | 0.0014026428102698596 | distance: 0.0014variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0017952712983157425 | distance: 0.0018variant: vectorized (all layers) 1000pxalg. parameter: noisy | 176.0 |
| Poly Vector | 0.0017220304241099547 | distance: 0.00172variant: vectorized (all layers) 1000px | 147.0 |
| Real-Time Inking | 0.0017598719477715094 | distance: 0.00176variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.0015314553866480325 | distance: 0.00153variant: vectorized (all layers) | 282.0 |
| Topology Driven → Stroke Aggregator | 0.001832177145458906 | distance: 0.00183variant: thresholded 1000px | 414.0 |
| Topology Driven | 0.0017110781280630465 | distance: 0.00171variant: vectorized (all layers) 1000px | 20.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4012438209219369 |  distance: 0.40124variant: thresholded 500pxalg. parameter: 0.6 | 230.0 |
| Mastering Sketching | 0.5325600374321864 | distance: 0.53256variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4265836741705029 |  distance: 0.42658variant: original | 254.0 |
| Poly Vector | 0.4585090347514275 |  distance: 0.45851variant: thresholded | 928.0 |
| Real-Time Inking | 0.4820602677951352 |  distance: 0.48206variant: original | 3.0 |
| Stroke Aggregator | 0.4339358310876977 | distance: 0.43394variant: vectorized (all layers) | 282.0 |
| Topology Driven → Stroke Aggregator | 0.4146142342034391 |  distance: 0.41461variant: thresholded | 669.0 |
| Topology Driven | 0.4514820900117821 |  distance: 0.45148variant: thresholded | 95.0 |
| Delaunay Triangulation | 0.3648150972261558 |  distance: 0.36482variant: thresholded 500px | 2.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5229938184608944 | distance: 0.52299variant: thresholded 500px | 2.0 |
| Fidelity Simplicity | 0.5958312307433616 |  distance: 0.59583variant: thresholded 500pxalg. parameter: 0.75 | 222.0 |
| Mastering Sketching | 0.6804852963139683 |  distance: 0.68049variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6335009457694525 | distance: 0.6335variant: original | 254.0 |
| Poly Vector | 0.6696507731008161 |  distance: 0.66965variant: thresholdedalg. parameter: noisy | 850.0 |
| Real-Time Inking | 0.670945145808437 |  distance: 0.67095variant: thresholded | 3.0 |
| Stroke Aggregator | 0.6515592439855351 | distance: 0.65156variant: vectorized (all layers) | 282.0 |
| Topology Driven → Stroke Aggregator | 0.6301945388119058 |  distance: 0.63019variant: thresholded 500px | 141.0 |
| Topology Driven | 0.6503542848124869 |  distance: 0.65035variant: thresholded 500px | 10.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.641933264768184 | distance: 0.64193variant: thresholded 500px | 2.0 |
| Fidelity Simplicity | 0.7416245367868688 |  distance: 0.74162variant: thresholdedalg. parameter: 0.25 | 454.0 |
| Mastering Sketching | 0.7782072297978683 | distance: 0.77821variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7694250700454265 | distance: 0.76943variant: vectorized (all layers) 1000pxalg. parameter: noisy | 176.0 |
| Real-Time Inking | 0.7639893345430832 | distance: 0.76399variant: thresholded | 3.0 |
| Stroke Aggregator | 0.7646979008185203 | distance: 0.7647variant: vectorized (all layers) | 282.0 |
| Topology Driven → Stroke Aggregator | 0.7542413113287174 | distance: 0.75424variant: thresholded 500px | 141.0 |
| Topology Driven | 0.7787400375823074 | distance: 0.77874variant: thresholded 500px | 10.0 |
| Poly Vector | 0.7744575454330458 |  distance: 0.77446variant: vectorized (all layers) 500px | 44.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7156688763606288 | distance: 0.71567variant: thresholded 500px | 2.0 |
| Fidelity Simplicity | 0.80059272859078 |  distance: 0.80059variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 214.0 |
| Mastering Sketching | 0.815985734234678 | distance: 0.81599variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8183655813102649 | distance: 0.81837variant: vectorized (all layers) 1000pxalg. parameter: noisy | 176.0 |
| Real-Time Inking | 0.8215260142403507 | distance: 0.82153variant: thresholded | 3.0 |
| Stroke Aggregator | 0.8218632308030542 | distance: 0.82186variant: vectorized (all layers) | 282.0 |
| Topology Driven → Stroke Aggregator | 0.8106678485828218 | distance: 0.81067variant: thresholded 500px | 141.0 |
| Topology Driven | 0.8344460418150871 | distance: 0.83445variant: thresholded 500px | 10.0 |
| Poly Vector | 0.7980684474763345 |  distance: 0.79807variant: vectorized (all layers) 500pxalg. parameter: noisy | 48.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7948434496428253 |  distance: 0.79484variant: original | 22.0 |
| Fidelity Simplicity | 0.8270242082995858 |  distance: 0.82702variant: thresholdedalg. parameter: 0.6 | 564.0 |
| Mastering Sketching | 0.8469588044787187 | distance: 0.84696variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8486406337945002 | distance: 0.84864variant: vectorized (all layers) 1000pxalg. parameter: noisy | 176.0 |
| Real-Time Inking | 0.8544063815388082 | distance: 0.85441variant: thresholded | 3.0 |
| Stroke Aggregator | 0.8386684629072287 | distance: 0.83867variant: vectorized (all layers) | 282.0 |
| Topology Driven → Stroke Aggregator | 0.8463023575779726 | distance: 0.8463variant: thresholded 500px | 141.0 |
| Topology Driven | 0.872839153519945 | distance: 0.87284variant: thresholded 500px | 10.0 |
| Poly Vector | 0.8140498620000648 | distance: 0.81405variant: vectorized (all layers) 500pxalg. parameter: noisy | 48.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.037121421813964835 | distance: 0.03712variant: vectorized (all layers) 1000px | 5.0 |
| Mastering Sketching | 0.16643316650390624 | distance: 0.16643variant: thresholded 500px | 5.0 |
| Fidelity Simplicity | 0.03981205749511719 |  distance: 0.03981variant: thresholded 1000pxalg. parameter: 0.3 | 402.0 |
| Poly Vector → Stroke Aggregator | 0.031659968330053266 | distance: 0.03166variant: original | 254.0 |
| Poly Vector | 0.031659968330053266 |  distance: 0.03166variant: originalalg. parameter: noisy | 593.0 |
| Real-Time Inking | 0.030083217620849614 | distance: 0.03008variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.033858736052767915 | distance: 0.03386variant: vectorized (all layers) | 282.0 |
| Topology Driven → Stroke Aggregator | 0.03231098937988281 | distance: 0.03231variant: thresholded 500px | 141.0 |
| Topology Driven | 0.03224903106689453 |  distance: 0.03225variant: vectorized (all layers) 500px | 6.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
|
 |
 |
 |
 |
 |
 |
|
 |
|
|
|||
| thresholded | |
|
 |
|
 |
 |
|
|
|
|
 |
||||
| thresholded 1000px | |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
||||
| thresholded 500px | |
 |
|
 |
 |
 |
|
|
|
 |
 |
|
 |
 |
|
| vectorized (all layers) 1000px |  |
|
|
 |
 |
 |
 |
|
 |
|
|
|
|||
| vectorized (all layers) 500px |  |
 |
|
 |
|
 |
 |
 |
|
|
|
 |
|||
| vectorized (all layers) | |