A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_03
Author: Baseline Licence: Academic PaperMessiness: 0.27195
Ambiguity (Chamfer): 0.16701
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Stroke Aggregator | Poly Vector → Stroke Aggregator | Real-Time Inking | Topology Driven | Poly Vector | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00179 |  distance: 0.00208 |  distance: 0.00239 |  distance: 0.0024 |  distance: 0.00244 |  distance: 0.00247 |  distance: 0.0027 |  distance: 0.00274 |  distance: 0.00497 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0026987758320471586 | distance: 0.0027variant: original | 24.0 |
| Fidelity Simplicity | 0.004974082630541893 | distance: 0.00497variant: original 500pxalg. parameter: 0.25 | 223.0 |
| Mastering Sketching | 0.001787686948932525 | distance: 0.00179variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0023886756148259565 | distance: 0.00239variant: original 1000pxalg. parameter: noisy | 291.0 |
| Poly Vector | 0.0024731117792102385 | distance: 0.00247variant: originalalg. parameter: noisy | 307.0 |
| Real-Time Inking | 0.0023984692970949024 | distance: 0.0024variant: original | 3.0 |
| Stroke Aggregator | 0.0020765885288264014 | distance: 0.00208variant: vectorized (all layers) | 613.0 |
| Topology Driven → Stroke Aggregator | 0.002742194089598532 | distance: 0.00274variant: original 1000px | 1476.0 |
| Topology Driven | 0.002442629842218453 | distance: 0.00244variant: original | 59.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3324784374660039 |  distance: 0.33248variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.3988400442038143 |  distance: 0.39884variant: original 1000pxalg. parameter: 0.5 | 348.0 |
| Mastering Sketching | 0.5179208850036152 | distance: 0.51792variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4726629608729073 |  distance: 0.47266variant: original 1000px | 292.0 |
| Poly Vector | 0.3918140416232129 |  distance: 0.39181variant: original 500pxalg. parameter: noisy | 65.0 |
| Real-Time Inking | 0.4099145997047093 |  distance: 0.40991variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.4287632459711914 | distance: 0.42876variant: vectorized (all layers) | 613.0 |
| Topology Driven → Stroke Aggregator | 0.4251314849002261 |  distance: 0.42513variant: original 500px | 236.0 |
| Topology Driven | 0.4458991231631317 | distance: 0.4459variant: original | 59.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5044435539675032 | distance: 0.50444variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.6609632319677095 |  distance: 0.66096variant: original 1000pxalg. parameter: 0.25 | 319.0 |
| Mastering Sketching | 0.7291489389998788 | distance: 0.72915variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7052655327605944 | distance: 0.70527variant: original 1000pxalg. parameter: noisy | 291.0 |
| Poly Vector | 0.6036962567864043 |  distance: 0.6037variant: original 500px | 62.0 |
| Real-Time Inking | 0.6646374405759132 | distance: 0.66464variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.6741161238365553 | distance: 0.67412variant: vectorized (all layers) | 613.0 |
| Topology Driven → Stroke Aggregator | 0.6466183233217111 | distance: 0.64662variant: original 500px | 236.0 |
| Topology Driven | 0.6663231578981469 |  distance: 0.66632variant: original 1000px | 29.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6954945099442594 | distance: 0.69549variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.8193147300036037 |  distance: 0.81931variant: originalalg. parameter: 0.3 | 414.0 |
| Mastering Sketching | 0.8655250819223897 | distance: 0.86553variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8579240415067969 | distance: 0.85792variant: original 1000px | 292.0 |
| Poly Vector | 0.7538200958263935 | distance: 0.75382variant: original 500pxalg. parameter: noisy | 65.0 |
| Real-Time Inking | 0.8124525698842645 | distance: 0.81245variant: original | 3.0 |
| Stroke Aggregator | 0.8305052151996543 | distance: 0.83051variant: vectorized (all layers) | 613.0 |
| Topology Driven → Stroke Aggregator | 0.7986341684506941 | distance: 0.79863variant: original 500px | 236.0 |
| Topology Driven | 0.8077016158646911 | distance: 0.8077variant: original | 59.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8084445448195337 | distance: 0.80844variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.8777821907275241 | distance: 0.87778variant: original 1000pxalg. parameter: 0.5 | 348.0 |
| Mastering Sketching | 0.9478658127193436 | distance: 0.94787variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9393460778280076 | distance: 0.93935variant: original 1000px | 292.0 |
| Poly Vector | 0.8369840303337427 | distance: 0.83698variant: original 500pxalg. parameter: noisy | 65.0 |
| Real-Time Inking | 0.9087626876595624 | distance: 0.90876variant: original | 3.0 |
| Stroke Aggregator | 0.9274281038298468 | distance: 0.92743variant: vectorized (all layers) | 613.0 |
| Topology Driven → Stroke Aggregator | 0.8873336104637415 | distance: 0.88733variant: original 500px | 236.0 |
| Topology Driven | 0.8954941411914581 |  distance: 0.89549variant: original 500px | 8.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8804343087819873 | distance: 0.88043variant: original 500px | 2.0 |
| Fidelity Simplicity | 0.904883481781912 |  distance: 0.90488variant: originalalg. parameter: 0.6 | 444.0 |
| Mastering Sketching | 0.9918707397121941 | distance: 0.99187variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9631912201560002 | distance: 0.96319variant: original 1000px | 292.0 |
| Poly Vector | 0.894022264190255 | distance: 0.89402variant: original 500px | 62.0 |
| Real-Time Inking | 0.9519699137563208 | distance: 0.95197variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.9791412210713324 | distance: 0.97914variant: vectorized (all layers) | 613.0 |
| Topology Driven → Stroke Aggregator | 0.9503281127186488 | distance: 0.95033variant: original 500px | 236.0 |
| Topology Driven | 0.9483119186134032 | distance: 0.94831variant: original 1000px | 29.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.03535767746220518 | distance: 0.03536variant: original | 24.0 |
| Poly Vector → Stroke Aggregator | 0.0162788200378418 | distance: 0.01628variant: original 1000px | 292.0 |
| Topology Driven | 0.023409399032592773 | distance: 0.02341variant: original 500px | 8.0 |
| Fidelity Simplicity | 0.1522636836600008 |  distance: 0.15226variant: originalalg. parameter: 0.5 | 432.0 |
| Mastering Sketching | 0.013416407585144044 | distance: 0.01342variant: original 500px | 5.0 |
| Real-Time Inking | 0.01886796188354492 |  distance: 0.01887variant: original 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.021260292053222656 | distance: 0.02126variant: original 500px | 236.0 |
| Poly Vector | 0.023345235824584958 |  distance: 0.02335variant: original 1000pxalg. parameter: noisy | 200.0 |
| Stroke Aggregator | 0.014081560546715744 | distance: 0.01408variant: vectorized (all layers) | 613.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
|
 |
|
|
|
 |
|
|||||
| original 1000px | |
|
 |
|
|
 |
 |
|
|
 |
 |
|
|
||
| original 500px | |
|
|
 |
|
 |
 |
 |
|
|
|
|
|||
| vectorized (all layers) | |