A Benchmark for Rough Sketch Cleanup
Art_freeform_Krenz_26
Author: Krenz Cushart Author Homepage: https://krenz.artstation.com/ Licence: CC-BY-NC-4.0Messiness: 0.14897
Ambiguity (Chamfer): 0.06475
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Topology Driven | Fidelity Simplicity | Poly Vector | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0009 |  distance: 0.00096 |  distance: 0.00108 |  distance: 0.00166 |  distance: 0.00252 |  distance: 0.00279 |  distance: 0.00621 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.00621280460306598 | distance: 0.00621variant: original | 597.0 |
| Fidelity Simplicity | 0.0016621057046481654 | distance: 0.00166variant: originalalg. parameter: 0.25 | 687.0 |
| Mastering Sketching | 0.0008983628611711453 | distance: 0.0009variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.002786766698296765 | distance: 0.00279variant: thresholded 500pxalg. parameter: noisy | 437.0 |
| Poly Vector | 0.002516999934795272 | distance: 0.00252variant: thresholded 500pxalg. parameter: noisy | 813.0 |
| Real-Time Inking | 0.0009647316077783364 | distance: 0.00096variant: thresholded | 5.0 |
| Topology Driven | 0.001075385583996334 | distance: 0.00108variant: original | 1400.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.5886741965704809 |  distance: 0.58867variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 957.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.18258108293998493 |  distance: 0.18258variant: vectorized (shape strokes) 500px | 19.0 |
| Fidelity Simplicity | 0.2642005343020101 |  distance: 0.2642variant: thresholded 500pxalg. parameter: 0.75 | 196.0 |
| Mastering Sketching | 0.7320575026249719 |  distance: 0.73206variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.6046471023038953 |  distance: 0.60465variant: thresholded 500px | 475.0 |
| Real-Time Inking | 0.6961763931058652 |  distance: 0.69618variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven | 0.6958272359480943 |  distance: 0.69583variant: vectorized (all layers) 500px | 81.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.29348765028972634 | distance: 0.29349variant: vectorized (shape strokes) 500px | 19.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.4013152814283504 | distance: 0.40132variant: thresholded 500pxalg. parameter: 0.75 | 196.0 |
| Mastering Sketching | 0.8368952004567853 | distance: 0.8369variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.7402605174799425 | distance: 0.74026variant: thresholded 500px | 475.0 |
| Poly Vector | 0.7265201583390556 |  distance: 0.72652variant: vectorized (shape strokes) 500px | 1070.0 |
| Real-Time Inking | 0.7958827559036699 | distance: 0.79588variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven | 0.8124795371789607 | distance: 0.81248variant: vectorized (all layers) 500px | 81.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4135999224800041 | distance: 0.4136variant: vectorized (shape strokes) 500px | 19.0 |
| Fidelity Simplicity | 0.5297551188343872 |  distance: 0.52976variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 155.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Mastering Sketching | 0.8989080069771864 | distance: 0.89891variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8331421864124938 | distance: 0.83314variant: thresholded 500px | 475.0 |
| Poly Vector | 0.8181010083989071 | distance: 0.8181variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 957.0 |
| Real-Time Inking | 0.8620108250943181 | distance: 0.86201variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven | 0.8835452054226711 | distance: 0.88355variant: vectorized (all layers) 500px | 81.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5091605655229342 | distance: 0.50916variant: vectorized (shape strokes) 500px | 19.0 |
| Fidelity Simplicity | 0.613713756653111 | distance: 0.61371variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 155.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Mastering Sketching | 0.929612915093614 |  distance: 0.92961variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8820998661961686 | distance: 0.8821variant: thresholded 500px | 475.0 |
| Poly Vector | 0.8714693275629115 | distance: 0.87147variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 957.0 |
| Real-Time Inking | 0.9003811943605993 | distance: 0.90038variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven | 0.9195901371381152 | distance: 0.91959variant: vectorized (all layers) 500px | 81.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.615868521290156 | distance: 0.61587variant: vectorized (shape strokes) 500px | 19.0 |
| Fidelity Simplicity | 0.6996643490882021 | distance: 0.69966variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 155.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Mastering Sketching | 0.9533590178987672 | distance: 0.95336variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9226185886381651 | distance: 0.92262variant: thresholded 500px | 475.0 |
| Poly Vector | 0.9182386848764248 | distance: 0.91824variant: vectorized (shape strokes) 500px | 1070.0 |
| Real-Time Inking | 0.9339539045075116 | distance: 0.93395variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven | 0.9480207264540422 | distance: 0.94802variant: vectorized (all layers) 500px | 81.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.05656854248046875 | distance: 0.05657variant: thresholded 500pxalg. parameter: noisy | 437.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.05830952072143555 |  distance: 0.05831variant: vectorized (all layers) 1000pxalg. parameter: 0.6 | 232.0 |
| Mastering Sketching | 0.08050466156005859 |  distance: 0.0805variant: vectorized (shape strokes) 1000px | 5.0 |
| Delaunay Triangulation | 0.04964876556396485 |  distance: 0.04965variant: vectorized (shape strokes) 1000px | 85.0 |
| Poly Vector | 0.04118252182006836 |  distance: 0.04118variant: vectorized (all layers) 500px | 729.0 |
| Real-Time Inking | 0.02801798280517694 |  distance: 0.02802variant: original | 5.0 |
| Topology Driven | 0.02529822158813477 |  distance: 0.0253variant: vectorized (shape strokes) 500px | 71.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
 |
 |
|
|
|||||||
| thresholded | |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 1000px |  |
|
 |
 |
 |
 |
 |
 |
 |
||||||
| thresholded 500px |  |
 |
 |
 |
 |
|
 |
 |
|
 |
 |
|
|
||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
|
 |
 |
||||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
|
|
 |
|
 |
||||
| vectorized (shape strokes) 1000px |  |
|
 |
 |
 |
 |
 |
 |
|
||||||
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
|
|
|
|