A Benchmark for Rough Sketch Cleanup
Art_freeform_Krenz_10
Author: Krenz Cushart Author Homepage: https://krenz.artstation.com/ Licence: CC-BY-NC-4.0Messiness: 0.04486
Ambiguity (Chamfer): 0.02778
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Topology Driven | Poly Vector | Stroke Aggregator | Topology Driven → Stroke Aggregator | Mastering Sketching | Poly Vector → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00064 |  distance: 0.00065 |  distance: 0.00066 |  distance: 0.00072 |  distance: 0.00076 |  distance: 0.00088 |  distance: 0.00088 |  distance: 0.00143 |  distance: 0.00412 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.004122420319163573 | distance: 0.00412variant: original | 121.0 |
| Fidelity Simplicity | 0.0014274318224751516 | distance: 0.00143variant: thresholdedalg. parameter: 0.3 | 245.0 |
| Mastering Sketching | 0.0008838284935050064 | distance: 0.00088variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0008839869706647207 | distance: 0.00088variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 586.0 |
| Poly Vector | 0.0006590386535324452 | distance: 0.00066variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 277.0 |
| Real-Time Inking | 0.0006355028224883225 | distance: 0.00064variant: vectorized (shape strokes) 1000px | 3.0 |
| Stroke Aggregator | 0.0007247251406562809 | distance: 0.00072variant: vectorized (shape strokes) | 811.0 |
| Topology Driven → Stroke Aggregator | 0.0007573079330964547 | distance: 0.00076variant: vectorized (shape strokes) 1000px | 1057.0 |
| Topology Driven | 0.0006479597460000972 | distance: 0.00065variant: vectorized (shape strokes) 1000px | 20.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.3687298151590829 |  distance: 0.36873variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 185.0 |
| Mastering Sketching | 0.7910351223844365 |  distance: 0.79104variant: vectorized (all layers) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.3064117377257161 |  distance: 0.30641variant: vectorized (shape strokes) 500px | 15.0 |
| Poly Vector | 0.3309920520012504 |  distance: 0.33099variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 71.0 |
| Real-Time Inking | 0.7997894544837653 |  distance: 0.79979variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | 0.773120874246912 |  distance: 0.77312variant: vectorized (all layers) | 1255.0 |
| Topology Driven → Stroke Aggregator | 0.6238074367857641 |  distance: 0.62381variant: vectorized (all layers) 500px | 490.0 |
| Delaunay Triangulation | 0.262760917226898 |  distance: 0.26276variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven | 0.7197900274830559 |  distance: 0.71979variant: original | 336.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4021407421897656 | distance: 0.40214variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.5177221746226542 | distance: 0.51772variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 185.0 |
| Mastering Sketching | 0.8782808306796545 | distance: 0.87828variant: vectorized (all layers) 500px | 7.0 |
| Real-Time Inking | 0.8714478154319437 | distance: 0.87145variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | 0.8570318891160442 | distance: 0.85703variant: vectorized (all layers) | 1255.0 |
| Topology Driven → Stroke Aggregator | 0.7753760514567335 | distance: 0.77538variant: vectorized (all layers) 500px | 490.0 |
| Poly Vector → Stroke Aggregator | 0.3981859470337426 | distance: 0.39819variant: vectorized (shape strokes) 500px | 15.0 |
| Poly Vector | 0.4239987899454473 | distance: 0.424variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 71.0 |
| Topology Driven | 0.8092107266811116 | distance: 0.80921variant: original | 336.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5451618118085886 | distance: 0.54516variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.9180229415650709 | distance: 0.91802variant: vectorized (all layers) 500px | 7.0 |
| Real-Time Inking | 0.9131304405258612 | distance: 0.91313variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | 0.9060987233998274 | distance: 0.9061variant: vectorized (all layers) | 1255.0 |
| Topology Driven → Stroke Aggregator | 0.8805696275617518 | distance: 0.88057variant: vectorized (all layers) 500px | 490.0 |
| Fidelity Simplicity | 0.6391369839910528 | distance: 0.63914variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 185.0 |
| Topology Driven | 0.8707665426140144 |  distance: 0.87077variant: thresholded | 335.0 |
| Poly Vector → Stroke Aggregator | 0.4918826499275073 | distance: 0.49188variant: vectorized (shape strokes) 500px | 15.0 |
| Poly Vector | 0.520082036981493 |  distance: 0.52008variant: vectorized (shape strokes) 500px | 81.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.5629681630472084 | distance: 0.56297variant: vectorized (shape strokes) 500px | 15.0 |
| Poly Vector | 0.5937440152144697 | distance: 0.59374variant: vectorized (shape strokes) 500px | 81.0 |
| Real-Time Inking | 0.9381647674305066 | distance: 0.93816variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.9267599167425687 | distance: 0.92676variant: vectorized (all layers) 500px | 490.0 |
| Delaunay Triangulation | 0.6409577515786092 | distance: 0.64096variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.9382575385522052 | distance: 0.93826variant: vectorized (all layers) 500px | 7.0 |
| Stroke Aggregator | 0.9341868497873876 | distance: 0.93419variant: vectorized (all layers) | 1255.0 |
| Topology Driven | 0.9131357721780172 | distance: 0.91314variant: original | 336.0 |
| Fidelity Simplicity | 0.7186182678285096 |  distance: 0.71862variant: thresholded 500pxalg. parameter: 0.6 | 1757.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.6389301732841229 | distance: 0.63893variant: vectorized (shape strokes) 500px | 15.0 |
| Poly Vector | 0.6714785250278638 | distance: 0.67148variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 71.0 |
| Real-Time Inking | 0.9590744744604054 | distance: 0.95907variant: vectorized (all layers) 500px | 3.0 |
| Delaunay Triangulation | 0.7527236322060369 | distance: 0.75272variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.9580505860579888 | distance: 0.95805variant: vectorized (all layers) 500px | 7.0 |
| Stroke Aggregator | 0.9529382108688434 | distance: 0.95294variant: vectorized (all layers) | 1255.0 |
| Topology Driven → Stroke Aggregator | 0.9559460999237732 | distance: 0.95595variant: vectorized (all layers) 500px | 490.0 |
| Topology Driven | 0.9409049792623471 | distance: 0.9409variant: original | 336.0 |
| Fidelity Simplicity | 0.7853981163678188 |  distance: 0.7854variant: thresholded 500pxalg. parameter: 0.75 | 1754.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.027999999999999997 |  distance: 0.028variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | 0.02845294863237545 | distance: 0.02845variant: vectorized (shape strokes) | 811.0 |
| Topology Driven → Stroke Aggregator | 0.028178005218505855 | distance: 0.02818variant: vectorized (shape strokes) 1000px | 1057.0 |
| Topology Driven | 0.023 |  distance: 0.023variant: thresholded 1000px | 70.0 |
| Delaunay Triangulation | 0.046690471649169916 |  distance: 0.04669variant: vectorized (shape strokes) 500px | 2.0 |
| Fidelity Simplicity | 0.03473744138682558 |  distance: 0.03474variant: originalalg. parameter: 0.75 | 325.0 |
| Mastering Sketching | 0.18915602111816407 | distance: 0.18916variant: vectorized (all layers) 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.028284271240234374 | distance: 0.02828variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 586.0 |
| Poly Vector | 0.028284271240234374 | distance: 0.02828variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 277.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
|
 |
|
|
|||||||
| thresholded |  |
|
 |
 |
 |
 |
|
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
|||
| thresholded 500px |  |
 |
 |
 |
 |
 |
|
|
 |
 |
 |
 |
 |
 |
|
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
|
 |
 |
 |
 |
|
 |
||
| vectorized (shape strokes) 1000px | |
|
 |
 |
 |
 |
 |
|
|
 |
 |
|
 |
||
| vectorized (shape strokes) 500px |  |
|
|
 |
 |
 |
 |
 |
 |
|
|
|
|
||
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |