A Benchmark for Rough Sketch Cleanup
Ind_product_baseline_06
Author: Enrique Rosales Licence: Academic PaperMessiness: 0.12927
Ambiguity (Chamfer): 0.10729
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector → Stroke Aggregator | Stroke Aggregator | Topology Driven | Poly Vector | Topology Driven → Stroke Aggregator | Real-Time Inking | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00129 |  distance: 0.00141 |  distance: 0.00151 |  distance: 0.00152 |  distance: 0.00153 |  distance: 0.00162 |  distance: 0.00173 |  distance: 0.00435 |  distance: 0.00845 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.004347393914280321 | distance: 0.00435variant: original | 3.0 |
| Fidelity Simplicity | 0.008452752075587927 | distance: 0.00845variant: originalalg. parameter: 0.25 | 300.0 |
| Mastering Sketching | 0.0012911616766604311 | distance: 0.00129variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0014139939767171489 | distance: 0.00141variant: original 1000px | 70.0 |
| Poly Vector | 0.001534498559368456 | distance: 0.00153variant: original | 68.0 |
| Real-Time Inking | 0.001731894451619722 | distance: 0.00173variant: original 1000px | 3.0 |
| Stroke Aggregator | 0.0015134533482546134 | distance: 0.00151variant: vectorized (all layers) | 51.0 |
| Topology Driven → Stroke Aggregator | 0.0016245117366605858 | distance: 0.00162variant: original | 426.0 |
| Topology Driven | 0.0015162578196744893 | distance: 0.00152variant: original 1000px | 8.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4031450741285416 |  distance: 0.40315variant: original 500px | 0.0 |
| Real-Time Inking | 0.6165405652321386 |  distance: 0.61654variant: original | 2.0 |
| Stroke Aggregator | 0.6466019776347703 | distance: 0.6466variant: vectorized (all layers) | 51.0 |
| Fidelity Simplicity | 0.5597236835528073 |  distance: 0.55972variant: original 500pxalg. parameter: 0.75 | 227.0 |
| Mastering Sketching | 0.7057157435955288 |  distance: 0.70572variant: original 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6544654421736901 | distance: 0.65447variant: original 1000px | 70.0 |
| Poly Vector | 0.5682199271826364 |  distance: 0.56822variant: original 500pxalg. parameter: noisy | 34.0 |
| Topology Driven → Stroke Aggregator | 0.5712509195167994 |  distance: 0.57125variant: original 500px | 28.0 |
| Topology Driven | 0.6530403125841976 |  distance: 0.65304variant: original | 10.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6279775077933616 | distance: 0.62798variant: original 500px | 0.0 |
| Mastering Sketching | 0.8924251001457235 | distance: 0.89243variant: original 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8895107609213513 | distance: 0.88951variant: original 1000px | 70.0 |
| Poly Vector | 0.7279324623928016 |  distance: 0.72793variant: original 500px | 34.0 |
| Real-Time Inking | 0.7970085964427359 | distance: 0.79701variant: original | 2.0 |
| Stroke Aggregator | 0.8734763997508028 | distance: 0.87348variant: vectorized (all layers) | 51.0 |
| Topology Driven | 0.8559961986085416 | distance: 0.856variant: original | 10.0 |
| Fidelity Simplicity | 0.7634095539837696 | distance: 0.76341variant: original 500pxalg. parameter: 0.75 | 227.0 |
| Topology Driven → Stroke Aggregator | 0.7999318271819061 | distance: 0.79993variant: original 500px | 28.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7471397687596384 | distance: 0.74714variant: original 500px | 0.0 |
| Stroke Aggregator | 0.9487714997684512 | distance: 0.94877variant: vectorized (all layers) | 51.0 |
| Fidelity Simplicity | 0.8400233236013919 |  distance: 0.84002variant: original 1000pxalg. parameter: 0.5 | 340.0 |
| Mastering Sketching | 0.9454114205631012 | distance: 0.94541variant: original 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9488765071901458 | distance: 0.94888variant: original 1000px | 70.0 |
| Real-Time Inking | 0.9139761144622084 | distance: 0.91398variant: original | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9073356027280852 | distance: 0.90734variant: original 500px | 28.0 |
| Topology Driven | 0.9405707529386484 |  distance: 0.94057variant: original 500px | 3.0 |
| Poly Vector | 0.7953777960873971 | distance: 0.79538variant: original 500pxalg. parameter: noisy | 34.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8487802922246299 | distance: 0.84878variant: original 500px | 0.0 |
| Fidelity Simplicity | 0.8763464195892079 |  distance: 0.87635variant: originalalg. parameter: 0.6 | 353.0 |
| Mastering Sketching | 0.9661606647838328 | distance: 0.96616variant: original 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9662233011039406 | distance: 0.96622variant: original 1000px | 70.0 |
| Poly Vector | 0.828505005834912 | distance: 0.82851variant: original 500px | 34.0 |
| Real-Time Inking | 0.950597064250872 | distance: 0.9506variant: original | 2.0 |
| Stroke Aggregator | 0.965074376083114 | distance: 0.96507variant: vectorized (all layers) | 51.0 |
| Topology Driven → Stroke Aggregator | 0.9460717753706532 | distance: 0.94607variant: original 500px | 28.0 |
| Topology Driven | 0.9650016193659664 | distance: 0.965variant: original 1000px | 8.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8873830108649523 | distance: 0.88738variant: original 500px | 0.0 |
| Fidelity Simplicity | 0.8948348549898435 | distance: 0.89483variant: original 500pxalg. parameter: 0.75 | 227.0 |
| Mastering Sketching | 0.9831653701515796 | distance: 0.98317variant: original 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9852640970835956 | distance: 0.98526variant: original 1000px | 70.0 |
| Real-Time Inking | 0.9715777529004904 | distance: 0.97158variant: original | 2.0 |
| Stroke Aggregator | 0.9807334356773708 | distance: 0.98073variant: vectorized (all layers) | 51.0 |
| Topology Driven → Stroke Aggregator | 0.9785027632836992 | distance: 0.9785variant: original 500px | 28.0 |
| Topology Driven | 0.983080325156194 | distance: 0.98308variant: original | 10.0 |
| Poly Vector | 0.8595519152011564 | distance: 0.85955variant: original 500pxalg. parameter: noisy | 34.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.08904516407150435 | distance: 0.08905variant: original | 3.0 |
| Fidelity Simplicity | 0.16465268131073846 |  distance: 0.16465variant: originalalg. parameter: 0.5 | 309.0 |
| Mastering Sketching | 0.08099382781982421 | distance: 0.08099variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.00806225776672363 | distance: 0.00806variant: original 1000px | 70.0 |
| Poly Vector | 0.013000000000000001 |  distance: 0.013variant: original 1000px | 62.0 |
| Real-Time Inking | 0.02301681531344955 | distance: 0.02302variant: original | 2.0 |
| Stroke Aggregator | 0.00825553887647835 | distance: 0.00826variant: vectorized (all layers) | 51.0 |
| Topology Driven → Stroke Aggregator | 0.01309346153470317 | distance: 0.01309variant: original | 426.0 |
| Topology Driven | 0.01325346857983828 | distance: 0.01325variant: original | 10.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
|
|
 |
|
|
 |
|
|
||||
| original 1000px |  |
|
|
 |
 |
|
 |
 |
|
 |
|
 |
|
||
| original 500px | |
 |
|
 |
 |
 |
|
 |
|
|
|
|
|||
| vectorized (all layers) | |