A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_01
Author: Baseline Licence: Academic PaperMessiness: 0.22931
Ambiguity (Chamfer): 0.07436
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Fidelity Simplicity | Mastering Sketching | Stroke Aggregator | Poly Vector → Stroke Aggregator | Topology Driven | Poly Vector | Real-Time Inking | Topology Driven → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00103 |  distance: 0.00109 |  distance: 0.00124 |  distance: 0.00126 |  distance: 0.0013 |  distance: 0.00137 |  distance: 0.00138 |  distance: 0.00151 |  distance: 0.00218 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.002179028083697001 | distance: 0.00218variant: original | 55.0 |
| Fidelity Simplicity | 0.001029802726883875 | distance: 0.00103variant: originalalg. parameter: 0.25 | 340.0 |
| Mastering Sketching | 0.0010906393676157276 | distance: 0.00109variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0012569129365127202 | distance: 0.00126variant: originalalg. parameter: noisy | 519.0 |
| Poly Vector | 0.0013738738384057663 | distance: 0.00137variant: original | 596.0 |
| Real-Time Inking | 0.0013847385125377587 | distance: 0.00138variant: original | 3.0 |
| Stroke Aggregator | 0.0012367087856547823 | distance: 0.00124variant: vectorized (all layers) | 491.0 |
| Topology Driven → Stroke Aggregator | 0.0015062582411285404 | distance: 0.00151variant: original 1000px | 655.0 |
| Topology Driven | 0.0013038957526204855 | distance: 0.0013variant: original | 126.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.7158351021431707 |  distance: 0.71584variant: original 500pxalg. parameter: 0.75 | 141.0 |
| Mastering Sketching | 0.7855007188694205 |  distance: 0.7855variant: original 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.7307632491119604 |  distance: 0.73076variant: original 500px | 26.0 |
| Real-Time Inking | 0.7401845347807567 | distance: 0.74018variant: original | 3.0 |
| Stroke Aggregator | 0.7409010636910612 | distance: 0.7409variant: vectorized (all layers) | 491.0 |
| Poly Vector | 0.7039718206856619 | distance: 0.70397variant: original | 596.0 |
| Topology Driven → Stroke Aggregator | 0.6613616218061441 |  distance: 0.66136variant: original 500px | 89.0 |
| Topology Driven | 0.7151738565687502 | distance: 0.71517variant: original | 126.0 |
| Delaunay Triangulation | 0.4300808056688725 |  distance: 0.43008variant: original 500px | 1.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.9064810472801604 | distance: 0.90648variant: original 500pxalg. parameter: 0.75 | 141.0 |
| Mastering Sketching | 0.9239861333475304 | distance: 0.92399variant: original 1000px | 8.0 |
| Poly Vector | 0.8755106720916078 |  distance: 0.87551variant: original 1000pxalg. parameter: noisy | 154.0 |
| Stroke Aggregator | 0.9272764105750164 | distance: 0.92728variant: vectorized (all layers) | 491.0 |
| Topology Driven → Stroke Aggregator | 0.8621219353478736 | distance: 0.86212variant: original 500px | 89.0 |
| Topology Driven | 0.8789403211648508 |  distance: 0.87894variant: original 1000px | 25.0 |
| Poly Vector → Stroke Aggregator | 0.8737882359986131 |  distance: 0.87379variant: original 500pxalg. parameter: noisy | 26.0 |
| Real-Time Inking | 0.9110358072574256 | distance: 0.91104variant: original | 3.0 |
| Delaunay Triangulation | 0.7138061693934823 | distance: 0.71381variant: original 500px | 1.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.9649137412120071 | distance: 0.96491variant: original 500pxalg. parameter: 0.75 | 141.0 |
| Mastering Sketching | 0.9677165541963124 | distance: 0.96772variant: original 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.9404219129423208 | distance: 0.94042variant: original 500px | 26.0 |
| Poly Vector | 0.9391021317549038 |  distance: 0.9391variant: original 500pxalg. parameter: noisy | 57.0 |
| Real-Time Inking | 0.9584664623718951 | distance: 0.95847variant: original | 3.0 |
| Stroke Aggregator | 0.9569361107189008 | distance: 0.95694variant: vectorized (all layers) | 491.0 |
| Topology Driven → Stroke Aggregator | 0.9396742207562192 | distance: 0.93967variant: original 500px | 89.0 |
| Topology Driven | 0.9457906633123854 |  distance: 0.94579variant: original 500px | 7.0 |
| Delaunay Triangulation | 0.8505781271578149 | distance: 0.85058variant: original 500px | 1.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.988894175769663 |  distance: 0.98889variant: originalalg. parameter: 0.5 | 346.0 |
| Mastering Sketching | 0.9813006485106279 | distance: 0.9813variant: original 1000px | 8.0 |
| Delaunay Triangulation | 0.8987142605138675 | distance: 0.89871variant: original 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.9548539832578448 | distance: 0.95485variant: original 500px | 26.0 |
| Poly Vector | 0.9562957179500541 |  distance: 0.9563variant: original 500px | 54.0 |
| Real-Time Inking | 0.9745316065253704 |  distance: 0.97453variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.9719913144561664 | distance: 0.97199variant: vectorized (all layers) | 491.0 |
| Topology Driven → Stroke Aggregator | 0.9640190192827638 | distance: 0.96402variant: original 500px | 89.0 |
| Topology Driven | 0.9674647839835108 | distance: 0.96746variant: original 500px | 7.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.9939383391434714 |  distance: 0.99394variant: original 500pxalg. parameter: 0.5 | 146.0 |
| Mastering Sketching | 0.9865203033743885 | distance: 0.98652variant: original 1000px | 8.0 |
| Real-Time Inking | 0.981657499640923 | distance: 0.98166variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.9797247748146564 | distance: 0.97972variant: original 500px | 89.0 |
| Topology Driven | 0.9812020446793528 | distance: 0.9812variant: original 500px | 7.0 |
| Delaunay Triangulation | 0.9231039420998788 | distance: 0.9231variant: original 500px | 1.0 |
| Stroke Aggregator | 0.9777869862490868 | distance: 0.97779variant: vectorized (all layers) | 491.0 |
| Poly Vector → Stroke Aggregator | 0.967880019852268 | distance: 0.96788variant: original 500px | 26.0 |
| Poly Vector | 0.9693273495061268 | distance: 0.96933variant: original 500px | 54.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.045607017517089836 | distance: 0.04561variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.010770329475402832 |  distance: 0.01077variant: original 1000pxalg. parameter: 0.5 | 241.0 |
| Mastering Sketching | 0.18872467041015625 | distance: 0.18872variant: original 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.020880613327026367 |  distance: 0.02088variant: original 1000px | 166.0 |
| Poly Vector | 0.023194826126098637 | distance: 0.02319variant: original 1000pxalg. parameter: noisy | 154.0 |
| Real-Time Inking | 0.01990148072601646 | distance: 0.0199variant: original | 3.0 |
| Stroke Aggregator | 0.023479300878381217 | distance: 0.02348variant: vectorized (all layers) | 491.0 |
| Topology Driven → Stroke Aggregator | 0.02256102752685547 | distance: 0.02256variant: original 1000px | 655.0 |
| Topology Driven | 0.023345235824584958 | distance: 0.02335variant: original 1000px | 25.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
|
 |
 |
|
 |
|
|
|
 |
|||
| original 1000px | |
|
|
 |
 |
|
 |
 |
|
|
 |
 |
 |
|
|
| original 500px | |
 |
|
 |
 |
|
|
 |
|
|
|
|
|
|
|
| vectorized (all layers) | |