A Benchmark for Rough Sketch Cleanup
Art_freeform_Krenz_02
Author: Krenz Cushart Author Homepage: https://krenz.artstation.com/ Licence: CC-BY-NC-4.0Messiness: 0.1068
Ambiguity (Chamfer): 0.14719
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Topology Driven | Poly Vector | Mastering Sketching | Poly Vector → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0017 |  distance: 0.00176 |  distance: 0.00185 |  distance: 0.0019 |  distance: 0.00282 |  distance: 0.00456 |  distance: 0.00524 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.005243193693547015 | distance: 0.00524variant: vectorized (shape strokes) 1000px | 28.0 |
| Fidelity Simplicity | 0.004555391482946253 | distance: 0.00456variant: vectorized (all layers) 1000pxalg. parameter: 0.3 | 262.0 |
| Mastering Sketching | 0.0019037801364031426 | distance: 0.0019variant: vectorized (shape strokes) 500px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.0028204494556515122 | distance: 0.00282variant: thresholded 500px | 399.0 |
| Poly Vector | 0.001853399289275402 | distance: 0.00185variant: thresholded 1000px | 1287.0 |
| Real-Time Inking | 0.001696322964700401 | distance: 0.0017variant: original | 4.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.0017635700318150546 | distance: 0.00176variant: thresholded | 1024.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.20744288681657447 |  distance: 0.20744variant: vectorized (all layers) 500px | 11.0 |
| Fidelity Simplicity | 0.2805273199554071 |  distance: 0.28053variant: thresholded 500pxalg. parameter: 0.75 | 213.0 |
| Mastering Sketching | 0.6050911790683491 |  distance: 0.60509variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.24771425032768485 |  distance: 0.24771variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 28.0 |
| Poly Vector | 0.2623028552007998 |  distance: 0.2623variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 226.0 |
| Real-Time Inking | 0.5983281141759548 |  distance: 0.59833variant: vectorized (all layers) 1000px | 3.0 |
| Topology Driven | 0.5680690066380679 |  distance: 0.56807variant: original | 272.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.3243018624878477 | distance: 0.3243variant: vectorized (all layers) 500px | 11.0 |
| Fidelity Simplicity | 0.4231527739834491 | distance: 0.42315variant: thresholded 500pxalg. parameter: 0.75 | 213.0 |
| Mastering Sketching | 0.7507908649268769 | distance: 0.75079variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.3409537335141978 | distance: 0.34095variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 28.0 |
| Poly Vector | 0.35570600522944074 | distance: 0.35571variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 226.0 |
| Real-Time Inking | 0.7504453181611797 |  distance: 0.75045variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven | 0.7303516837261841 | distance: 0.73035variant: original | 272.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Real-Time Inking | 0.8308446525593198 | distance: 0.83084variant: vectorized (all layers) 500px | 3.0 |
| Delaunay Triangulation | 0.4453557417657308 | distance: 0.44536variant: vectorized (all layers) 500px | 11.0 |
| Fidelity Simplicity | 0.5517906712141004 |  distance: 0.55179variant: thresholded 500pxalg. parameter: 0.5 | 176.0 |
| Mastering Sketching | 0.8335544354247137 | distance: 0.83355variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4175405860415525 | distance: 0.41754variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 28.0 |
| Poly Vector | 0.4357799421140781 | distance: 0.43578variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 226.0 |
| Topology Driven | 0.8185785536796811 | distance: 0.81858variant: original | 272.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Mastering Sketching | 0.8763440860215054 | distance: 0.87634variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8662281676408157 | distance: 0.86623variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven | 0.860763420401482 | distance: 0.86076variant: original | 272.0 |
| Delaunay Triangulation | 0.5352734239258462 | distance: 0.53527variant: vectorized (all layers) 500px | 11.0 |
| Fidelity Simplicity | 0.6394240595889498 | distance: 0.63942variant: thresholded 500pxalg. parameter: 0.75 | 213.0 |
| Poly Vector → Stroke Aggregator | 0.4800866378585099 | distance: 0.48009variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 28.0 |
| Poly Vector | 0.49980377360676603 |  distance: 0.4998variant: vectorized (shape strokes) 500px | 279.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.6364272263583289 | distance: 0.63643variant: vectorized (all layers) 500px | 11.0 |
| Fidelity Simplicity | 0.7199928297317004 | distance: 0.71999variant: thresholded 500pxalg. parameter: 0.75 | 213.0 |
| Mastering Sketching | 0.9103539014341372 | distance: 0.91035variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.5668272199902065 | distance: 0.56683variant: vectorized (shape strokes) 500px | 279.0 |
| Real-Time Inking | 0.8995901553559097 | distance: 0.89959variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven | 0.889654760207458 | distance: 0.88965variant: original | 272.0 |
| Poly Vector → Stroke Aggregator | 0.5485702252871082 | distance: 0.54857variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 28.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.058855754852294925 | distance: 0.05886variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.05091168975830078 |  distance: 0.05091variant: thresholded 500pxalg. parameter: noisy | 400.0 |
| Poly Vector | 0.04024922180175782 |  distance: 0.04025variant: vectorized (shape strokes) 1000px | 456.0 |
| Real-Time Inking | 0.04024922180175782 |  distance: 0.04025variant: vectorized (shape strokes) 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.035608985900878916 |  distance: 0.03561variant: vectorized (shape strokes) 500px | 14.0 |
| Fidelity Simplicity | 0.06723094177246093 |  distance: 0.06723variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 165.0 |
| Delaunay Triangulation | 0.05909314727783204 |  distance: 0.05909variant: thresholded 500px | 17.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
|
||||||||
| thresholded |  |
|
 |
||||||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|
 |
|||||
| thresholded 500px |  |
 |
 |
 |
|
|
 |
 |
 |
 |
|
|
|
||
| vectorized (all layers) 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
|
 |
 |
 |
|
 |
|||
| vectorized (shape strokes) 1000px | |
 |
 |
|
|
||||||||||
| vectorized (shape strokes) 500px |  |
|
|
|
|
 |
|