A Benchmark for Rough Sketch Cleanup
Art_freeform_Krenz_07
Author: Krenz Cushart Author Homepage: https://krenz.artstation.com/ Licence: CC-BY-NC-4.0Messiness: 0.10807
Ambiguity (Chamfer): 0.74444
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Real-Time Inking | Topology Driven → Stroke Aggregator | Poly Vector | Fidelity Simplicity | Delaunay Triangulation | Poly Vector → Stroke Aggregator | |||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  |  distance: 0.00088 |  distance: 0.00095 |  distance: 0.00111 |  distance: 0.00119 |  distance: 0.00125 |  distance: 0.00265 |  distance: 0.00276 |  distance: 0.00424 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | |  |  | |||
| Jonathan Velasco |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.002764227977429142 | distance: 0.00276variant: original | 79.0 |
| Fidelity Simplicity | 0.0026499180016539337 | distance: 0.00265variant: thresholded 1000pxalg. parameter: 0.25 | 159.0 |
| Mastering Sketching | 0.0008779740627254296 | distance: 0.00088variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.004241492553871349 | distance: 0.00424variant: thresholded 500pxalg. parameter: noisy | 61.0 |
| Poly Vector | 0.0012545964502645099 | distance: 0.00125variant: vectorized (all layers) 1000px | 419.0 |
| Real-Time Inking | 0.0011050289263464686 | distance: 0.00111variant: original | 4.0 |
| Topology Driven → Stroke Aggregator | 0.0011882734098970554 | distance: 0.00119variant: thresholded 1000px | 1506.0 |
| Topology Driven | 0.0009521051981871447 | distance: 0.00095variant: thresholded | 369.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.4483527257910255 |  distance: 0.44835variant: vectorized (all layers) 500pxalg. parameter: noisy | 66.0 |
| Poly Vector | 0.4728155393394562 |  distance: 0.47282variant: vectorized (all layers) 500px | 286.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.20303680884850608 |  distance: 0.20304variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.22570984728820384 |  distance: 0.22571variant: vectorized (all layers) 500pxalg. parameter: 0.25 | 92.0 |
| Mastering Sketching | 0.5158608608767311 |  distance: 0.51586variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.4767722239021971 |  distance: 0.47677variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.4909719688461868 |  distance: 0.49097variant: thresholded 500px | 528.0 |
| Topology Driven | 0.5634650620663575 |  distance: 0.56347variant: vectorized (all layers) 500px | 11.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.2933829498849047 | distance: 0.29338variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.33464412270932464 |  distance: 0.33464variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 171.0 |
| Mastering Sketching | 0.5934900313915504 | distance: 0.59349variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.5420446527142408 | distance: 0.54204variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.5883519564690309 | distance: 0.58835variant: thresholded 500px | 528.0 |
| Topology Driven | 0.6320081004509673 | distance: 0.63201variant: vectorized (all layers) 500px | 11.0 |
| Poly Vector → Stroke Aggregator | 0.5717400944692268 | distance: 0.57174variant: vectorized (all layers) 500pxalg. parameter: noisy | 66.0 |
| Poly Vector | 0.5940543558608264 | distance: 0.59405variant: vectorized (all layers) 500px | 286.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.3668977260078251 | distance: 0.3669variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.4215637088336364 |  distance: 0.42156variant: thresholded 500pxalg. parameter: 0.75 | 160.0 |
| Mastering Sketching | 0.6302190410924136 | distance: 0.63022variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6509764787687127 | distance: 0.65098variant: thresholded 500pxalg. parameter: noisy | 61.0 |
| Poly Vector | 0.6545935251139279 |  distance: 0.65459variant: thresholded 500pxalg. parameter: noisy | 232.0 |
| Real-Time Inking | 0.5746017555700794 |  distance: 0.5746variant: thresholded 500px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.6400280573574287 | distance: 0.64003variant: thresholded 500px | 528.0 |
| Topology Driven | 0.6631518626902053 | distance: 0.66315variant: vectorized (all layers) 500px | 11.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.4125441622257531 | distance: 0.41254variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.4762186339449075 |  distance: 0.47622variant: thresholded 500pxalg. parameter: 0.5 | 141.0 |
| Mastering Sketching | 0.6481977807279011 | distance: 0.6482variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6719330940730804 | distance: 0.67193variant: thresholded 500pxalg. parameter: noisy | 61.0 |
| Poly Vector | 0.6757329222889855 |  distance: 0.67573variant: thresholded 500px | 233.0 |
| Real-Time Inking | 0.5907176700526401 | distance: 0.59072variant: thresholded 500px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.6639530381883062 | distance: 0.66395variant: thresholded 500px | 528.0 |
| Topology Driven | 0.6786254693298729 |  distance: 0.67863variant: original | 193.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.4583987250880137 | distance: 0.4584variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.5259337497830759 |  distance: 0.52593variant: thresholded 500pxalg. parameter: 0.25 | 119.0 |
| Mastering Sketching | 0.6648524281932658 | distance: 0.66485variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.693632610033994 | distance: 0.69363variant: thresholded 500pxalg. parameter: noisy | 61.0 |
| Poly Vector | 0.692860554098728 | distance: 0.69286variant: vectorized (all layers) 1000px | 419.0 |
| Real-Time Inking | 0.6023406579106685 | distance: 0.60234variant: thresholded 500px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.6839003810809674 | distance: 0.6839variant: thresholded 500px | 528.0 |
| Topology Driven | 0.6907692860999796 | distance: 0.69077variant: original | 193.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven | 0.039849716186523436 |  distance: 0.03985variant: thresholded 500px | 13.0 |
| Delaunay Triangulation | 0.05091168975830078 |  distance: 0.05091variant: vectorized (all layers) 1000px | 16.0 |
| Fidelity Simplicity | 0.0822982406616211 |  distance: 0.0823variant: thresholded 1000pxalg. parameter: 0.75 | 201.0 |
| Mastering Sketching | 0.20035968017578126 | distance: 0.20036variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.10816654205322264 | distance: 0.10817variant: thresholded 500pxalg. parameter: noisy | 61.0 |
| Poly Vector | 0.043600460052490235 |  distance: 0.0436variant: thresholded 1000pxalg. parameter: noisy | 788.0 |
| Real-Time Inking | 0.04770845562416242 |  distance: 0.04771variant: thresholded | 3.0 |
| Topology Driven → Stroke Aggregator | 0.043786022822661405 |  distance: 0.04379variant: original | 1548.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
 |
 |
 |
 |
|
|
||||||
| thresholded | |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded 1000px | |
 |
|
 |
|
 |
|
 |
 |
|
 |
 |
|||
| thresholded 500px | |
|
 |
 |
|
|
|
 |
|
|
|
 |
|
||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
||||
| vectorized (all layers) 500px |  |
|
|
 |
|
 |
|
 |
|
 |
|
|
|
 |