A Benchmark for Rough Sketch Cleanup
Ind_product_TI_01
Author: Trip Ivey Author Homepage: www.tripivey.com Licence: CC-BY-4.0Messiness: 0.49117
Ambiguity (Chamfer): 0.52046
Shading: Yes
Scaffold: Yes
Texture Strokes: Yes
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Poly Vector | Fidelity Simplicity | Stroke Aggregator | Mastering Sketching | Real-Time Inking | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00286 |  distance: 0.00301 |  distance: 0.00314 |  distance: 0.00328 |  distance: 0.00352 |  distance: 0.00373 |  distance: 0.00454 |  distance: 0.0048 |  distance: 0.00505 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.003730677281013597 | distance: 0.00373variant: original | 10.0 |
| Delaunay Triangulation | 0.0045438846916081846 | distance: 0.00454variant: vectorized (shape strokes) 1000px | 7.0 |
| Fidelity Simplicity | 0.0031371130152970635 | distance: 0.00314variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 201.0 |
| Mastering Sketching | 0.0035192759792764664 | distance: 0.00352variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.00504722788798985 | distance: 0.00505variant: thresholded 500pxalg. parameter: noisy | 33.0 |
| Poly Vector | 0.0030142939040023672 | distance: 0.00301variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 298.0 |
| Stroke Aggregator | 0.0032761922876918424 | distance: 0.00328variant: vectorized (shape strokes) | 851.0 |
| Topology Driven → Stroke Aggregator | 0.004796617171091124 | distance: 0.0048variant: thresholded 1000px | 1673.0 |
| Topology Driven | 0.0028577875169033986 | distance: 0.00286variant: vectorized (shape strokes) 1000px | 24.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.4580992890548699 |  distance: 0.4581variant: vectorized (all layers) 500px | 38.0 |
| Delaunay Triangulation | 0.15811446355354614 |  distance: 0.15811variant: thresholded | 741.0 |
| Fidelity Simplicity | 0.1556693022464679 |  distance: 0.15567variant: thresholded 500pxalg. parameter: 0.75 | 150.0 |
| Mastering Sketching | 0.3306863527859355 |  distance: 0.33069variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.3916931147603209 |  distance: 0.39169variant: vectorized (all layers) 1000pxalg. parameter: noisy | 454.0 |
| Real-Time Inking | 0.3848614129249176 |  distance: 0.38486variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.48412720575468 | distance: 0.48413variant: vectorized (shape strokes) | 851.0 |
| Topology Driven → Stroke Aggregator | 0.40688641015621707 |  distance: 0.40689variant: vectorized (shape strokes) 500px | 433.0 |
| Topology Driven | 0.3961488061635035 |  distance: 0.39615variant: vectorized (all layers) 1000px | 54.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.5780248598116619 | distance: 0.57802variant: vectorized (all layers) 500px | 38.0 |
| Delaunay Triangulation | 0.2563287664719659 |  distance: 0.25633variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.2745030247213471 | distance: 0.2745variant: thresholded 500pxalg. parameter: 0.75 | 150.0 |
| Mastering Sketching | 0.4473645387305029 | distance: 0.44736variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.4984764683127081 | distance: 0.49848variant: vectorized (all layers) 1000pxalg. parameter: noisy | 454.0 |
| Real-Time Inking | 0.5023343715155045 | distance: 0.50233variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.6008310041224418 | distance: 0.60083variant: vectorized (shape strokes) | 851.0 |
| Topology Driven → Stroke Aggregator | 0.5353945586097033 | distance: 0.53539variant: vectorized (shape strokes) 500px | 433.0 |
| Topology Driven | 0.5134519776502345 |  distance: 0.51345variant: vectorized (all layers) 500px | 13.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.6606478716726917 | distance: 0.66065variant: vectorized (all layers) 500px | 38.0 |
| Delaunay Triangulation | 0.35384204362612265 | distance: 0.35384variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.4203400457677729 | distance: 0.42034variant: thresholded 500pxalg. parameter: 0.75 | 150.0 |
| Mastering Sketching | 0.5253537007529543 | distance: 0.52535variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.5842976516678366 |  distance: 0.5843variant: vectorized (all layers) 1000px | 412.0 |
| Real-Time Inking | 0.5668035237858454 | distance: 0.5668variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.6698967162968603 | distance: 0.6699variant: vectorized (shape strokes) | 851.0 |
| Topology Driven → Stroke Aggregator | 0.6114769520225776 | distance: 0.61148variant: vectorized (shape strokes) 500px | 433.0 |
| Topology Driven | 0.6008932929906899 | distance: 0.60089variant: vectorized (all layers) 500px | 13.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4269777857646425 | distance: 0.42698variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.5123331688381063 |  distance: 0.51233variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 178.0 |
| Mastering Sketching | 0.5689626360528467 | distance: 0.56896variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7138188294520048 | distance: 0.71382variant: vectorized (all layers) 500px | 38.0 |
| Poly Vector | 0.6395665136117337 | distance: 0.63957variant: vectorized (all layers) 1000px | 412.0 |
| Real-Time Inking | 0.6016637186258343 | distance: 0.60166variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | 0.7275867699171551 | distance: 0.72759variant: vectorized (shape strokes) | 851.0 |
| Topology Driven → Stroke Aggregator | 0.6598059674440705 | distance: 0.65981variant: vectorized (shape strokes) 500px | 433.0 |
| Topology Driven | 0.6512942034269048 | distance: 0.65129variant: vectorized (all layers) 500px | 13.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4976439485442154 | distance: 0.49764variant: thresholded | 741.0 |
| Fidelity Simplicity | 0.5686266613560105 |  distance: 0.56863variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 161.0 |
| Mastering Sketching | 0.6025960847321467 | distance: 0.6026variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7565194521559248 | distance: 0.75652variant: vectorized (all layers) 500px | 38.0 |
| Poly Vector | 0.6789510386070199 | distance: 0.67895variant: vectorized (all layers) 1000px | 412.0 |
| Real-Time Inking | 0.6241083940975135 |  distance: 0.62411variant: thresholded 500px | 2.0 |
| Stroke Aggregator | 0.7547879643491548 | distance: 0.75479variant: vectorized (shape strokes) | 851.0 |
| Topology Driven → Stroke Aggregator | 0.701505428201879 | distance: 0.70151variant: vectorized (shape strokes) 500px | 433.0 |
| Topology Driven | 0.692871654447487 | distance: 0.69287variant: vectorized (all layers) 500px | 13.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.03736308288574219 |  distance: 0.03736variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 189.0 |
| Delaunay Triangulation | 0.04024922180175782 |  distance: 0.04025variant: vectorized (shape strokes) 500px | 5.0 |
| Mastering Sketching | 0.4204806823730469 | distance: 0.42048variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.08854377746582033 | distance: 0.08854variant: thresholded 500pxalg. parameter: noisy | 33.0 |
| Poly Vector | 0.08728115844726562 |  distance: 0.08728variant: thresholded 1000px | 655.0 |
| Real-Time Inking | 0.09055384826660157 |  distance: 0.09055variant: thresholded 1000px | 2.0 |
| Stroke Aggregator | 0.09133485763792007 | distance: 0.09133variant: vectorized (shape strokes) | 851.0 |
| Topology Driven → Stroke Aggregator | 0.08633075714111328 | distance: 0.08633variant: thresholded 1000px | 1673.0 |
| Topology Driven | 0.08664871978759765 |  distance: 0.08665variant: thresholded 500px | 11.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
||||||||||||||
| thresholded |  |
|
|||||||||||||
| thresholded 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
|
 |
||||
| thresholded 500px | |
 |
 |
 |
 |
|
 |
|
 |
 |
 |
|
|||
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
|
|
|
 |
|||||
| vectorized (all layers) 500px |  |
|
 |
 |
|
|
 |
|
 |
 |
|
 |
|
||
| vectorized (shape strokes) 1000px |  |
|
 |
 |
 |
 |
|
|
 |
|
|||||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
|
 |
 |
 |
 |
|
 |
 |
|
| vectorized (shape strokes) | |