A Benchmark for Rough Sketch Cleanup
Ind_product_MMX_02
Author: MQ-MX-XQ Author Homepage: https://www.deviantart.com/mq-mx-xq Licence: CC-BY-3.0Messiness: 0.1557
Ambiguity (Chamfer): 0.04425
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector | Topology Driven | Real-Time Inking | Fidelity Simplicity | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00062 |  distance: 0.00069 |  distance: 0.00071 |  distance: 0.00113 |  distance: 0.00153 |  distance: 0.0021 |  distance: 0.00286 |  distance: 0.00664 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.006636296904563225 | distance: 0.00664variant: vectorized (shape strokes) 1000px | 25.0 |
| Fidelity Simplicity | 0.0015302754412565554 | distance: 0.00153variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 147.0 |
| Mastering Sketching | 0.0006218396828599834 | distance: 0.00062variant: vectorized (shape strokes) 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.0028577917049787283 | distance: 0.00286variant: thresholded 500pxalg. parameter: noisy | 360.0 |
| Poly Vector | 0.0006850707433343666 | distance: 0.00069variant: vectorized (shape strokes) 1000px | 426.0 |
| Real-Time Inking | 0.001132459398255738 | distance: 0.00113variant: vectorized (shape strokes) 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.002101751235778486 | distance: 0.0021variant: vectorized (shape strokes) 500px | 810.0 |
| Topology Driven | 0.0007075300590446699 | distance: 0.00071variant: vectorized (shape strokes) 1000px | 46.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.16356528597163733 |  distance: 0.16357variant: vectorized (all layers) 500px | 15.0 |
| Fidelity Simplicity | 0.30512954065000303 |  distance: 0.30513variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 180.0 |
| Mastering Sketching | 0.6783592535814726 |  distance: 0.67836variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.3877176954326336 |  distance: 0.38772variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 44.0 |
| Poly Vector | 0.40678424065056107 |  distance: 0.40678variant: vectorized (shape strokes) 500px | 166.0 |
| Real-Time Inking | 0.693099292018958 |  distance: 0.6931variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6340020554102239 | distance: 0.634variant: vectorized (shape strokes) 500px | 810.0 |
| Topology Driven | 0.6412921436642477 |  distance: 0.64129variant: vectorized (all layers) 500px | 74.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.27247103680332196 | distance: 0.27247variant: vectorized (all layers) 500px | 15.0 |
| Fidelity Simplicity | 0.4592390190167409 | distance: 0.45924variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 180.0 |
| Mastering Sketching | 0.7925602962766503 | distance: 0.79256variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4986288467363287 | distance: 0.49863variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 44.0 |
| Poly Vector | 0.5154033023955146 |  distance: 0.5154variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 164.0 |
| Real-Time Inking | 0.8116605304904001 |  distance: 0.81166variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.80895102203116 | distance: 0.80895variant: vectorized (shape strokes) 500px | 810.0 |
| Topology Driven | 0.7608616986607831 | distance: 0.76086variant: vectorized (all layers) 500px | 74.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3940399960618614 | distance: 0.39404variant: vectorized (all layers) 500px | 15.0 |
| Fidelity Simplicity | 0.5934235778990667 | distance: 0.59342variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 180.0 |
| Mastering Sketching | 0.8553598134340826 | distance: 0.85536variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.5845994556426177 |  distance: 0.5846variant: vectorized (shape strokes) 500px | 36.0 |
| Poly Vector | 0.5999489841545237 | distance: 0.59995variant: vectorized (shape strokes) 500px | 166.0 |
| Real-Time Inking | 0.877074449098027 | distance: 0.87707variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9071640313778304 | distance: 0.90716variant: vectorized (shape strokes) 500px | 810.0 |
| Topology Driven | 0.8376286824319535 | distance: 0.83763variant: vectorized (all layers) 500px | 74.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4796319929194056 | distance: 0.47963variant: vectorized (all layers) 500px | 15.0 |
| Fidelity Simplicity | 0.6774457519756528 | distance: 0.67745variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 180.0 |
| Mastering Sketching | 0.8911131188131849 | distance: 0.89111variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6497192566350617 | distance: 0.64972variant: vectorized (shape strokes) 500px | 36.0 |
| Poly Vector | 0.6635826790432412 | distance: 0.66358variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 164.0 |
| Real-Time Inking | 0.9088354155253856 | distance: 0.90884variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.948231219193773 | distance: 0.94823variant: vectorized (shape strokes) 500px | 810.0 |
| Topology Driven | 0.8751494481918687 | distance: 0.87515variant: vectorized (all layers) 500px | 74.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5689998462682299 | distance: 0.569variant: vectorized (all layers) 500px | 15.0 |
| Fidelity Simplicity | 0.75548490255783 |  distance: 0.75548variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 129.0 |
| Mastering Sketching | 0.916390900235266 | distance: 0.91639variant: vectorized (all layers) 1000px | 6.0 |
| Real-Time Inking | 0.9342122661084574 | distance: 0.93421variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9753945507565612 | distance: 0.97539variant: vectorized (shape strokes) 500px | 810.0 |
| Topology Driven | 0.9039572090186456 | distance: 0.90396variant: vectorized (all layers) 500px | 74.0 |
| Poly Vector → Stroke Aggregator | 0.7171319196603254 | distance: 0.71713variant: vectorized (shape strokes) 500px | 36.0 |
| Poly Vector | 0.7289821260536541 | distance: 0.72898variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 164.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.06440496826171875 |  distance: 0.0644variant: vectorized (shape strokes) 500px | 6.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.032984844207763674 | distance: 0.03298variant: vectorized (shape strokes) 500px | 810.0 |
| Delaunay Triangulation | 0.0975807342529297 | distance: 0.09758variant: vectorized (shape strokes) 1000px | 25.0 |
| Real-Time Inking | 0.031240999221801763 | distance: 0.03124variant: vectorized (shape strokes) 1000px | 3.0 |
| Fidelity Simplicity | 0.030083217620849614 | distance: 0.03008variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 147.0 |
| Poly Vector → Stroke Aggregator | 0.102956298828125 |  distance: 0.10296variant: vectorized (all layers) 500px | 199.0 |
| Poly Vector | 0.0202237491607666 | distance: 0.02022variant: vectorized (shape strokes) 1000px | 426.0 |
| Topology Driven | 0.019697715759277343 |  distance: 0.0197variant: vectorized (shape strokes) 500px | 13.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
||||||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||
| vectorized (all layers) 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 500px | |
 |
 |
 |
|
|
 |
|
 |
 |
|
 |
|
||
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
 |
|
|
||||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
|
|
|
 |
|
|