A Benchmark for Rough Sketch Cleanup
Art_freeform_AP_03
Author: AP Licence: CC-BY-SA-3.0Messiness: 0.20537
Ambiguity (Chamfer): 0.07451
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Poly Vector | Topology Driven | Real-Time Inking | Poly Vector → Stroke Aggregator | Mastering Sketching | Topology Driven → Stroke Aggregator | Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00146 |  distance: 0.00155 |  distance: 0.00156 |  distance: 0.00164 |  distance: 0.00165 |  distance: 0.00188 |  distance: 0.0019 |  distance: 0.00225 |  distance: 0.00236 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.0016374503558454847 | distance: 0.00164variant: originalalg. parameter: noisy | 256.0 |
| Poly Vector | 0.0014573968830581807 | distance: 0.00146variant: originalalg. parameter: noisy | 1362.0 |
| Real-Time Inking | 0.0015583647794746994 | distance: 0.00156variant: original | 4.0 |
| Topology Driven → Stroke Aggregator | 0.0018753767349183692 | distance: 0.00188variant: vectorized (shape strokes) 1000px | 373.0 |
| Topology Driven | 0.001548579644819363 | distance: 0.00155variant: original | 104.0 |
| Fidelity Simplicity | 0.0023593292233890697 | distance: 0.00236variant: vectorized (shape strokes) 1000pxalg. parameter: 0.5 | 188.0 |
| Stroke Aggregator | 0.0019044097048058 | distance: 0.0019variant: vectorized (shape strokes) | 246.0 |
| Delaunay Triangulation | 0.002245286706493104 | distance: 0.00225variant: vectorized (shape strokes) 1000px | 3.0 |
| Mastering Sketching | 0.0016549466051201526 | distance: 0.00165variant: vectorized (shape strokes) 500px | 6.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.31859650105401705 |  distance: 0.3186variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.3825967880521455 |  distance: 0.3826variant: thresholdedalg. parameter: 0.5 | 218.0 |
| Mastering Sketching | 0.574512033840118 |  distance: 0.57451variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.3619932063947147 |  distance: 0.36199variant: vectorized (shape strokes) 500px | 13.0 |
| Poly Vector | 0.3919228747297812 |  distance: 0.39192variant: vectorized (shape strokes) 500px | 57.0 |
| Real-Time Inking | 0.6388388125565972 |  distance: 0.63884variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.5588659324224949 |  distance: 0.55887variant: vectorized (all layers) | 749.0 |
| Topology Driven → Stroke Aggregator | 0.4791216900088249 |  distance: 0.47912variant: vectorized (all layers) 500px | 409.0 |
| Topology Driven | 0.5622910603013952 |  distance: 0.56229variant: vectorized (all layers) 500px | 8.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4846548728129712 | distance: 0.48465variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.4664492285906336 |  distance: 0.46645variant: thresholdedalg. parameter: 0.75 | 218.0 |
| Poly Vector | 0.5048335575868218 |  distance: 0.50483variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 54.0 |
| Mastering Sketching | 0.6949357154726183 | distance: 0.69494variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.4747679810925378 | distance: 0.47477variant: vectorized (shape strokes) 500px | 13.0 |
| Real-Time Inking | 0.77055287490989 | distance: 0.77055variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.6937265954246089 | distance: 0.69373variant: vectorized (all layers) | 749.0 |
| Topology Driven → Stroke Aggregator | 0.6264330484746352 | distance: 0.62643variant: vectorized (all layers) 500px | 409.0 |
| Topology Driven | 0.6804443805030942 | distance: 0.68044variant: vectorized (all layers) 500px | 8.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6119117327567478 | distance: 0.61191variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.7740192715861846 |  distance: 0.77402variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5605835834315387 |  distance: 0.56058variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 13.0 |
| Poly Vector | 0.5912016340866338 | distance: 0.5912variant: vectorized (shape strokes) 500px | 57.0 |
| Real-Time Inking | 0.8267293530017691 | distance: 0.82673variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7607473152480843 | distance: 0.76075variant: vectorized (all layers) | 749.0 |
| Topology Driven → Stroke Aggregator | 0.7352947540676535 | distance: 0.73529variant: vectorized (all layers) 500px | 409.0 |
| Topology Driven | 0.7701389065757842 | distance: 0.77014variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.5034326789660442 |  distance: 0.50343variant: thresholdedalg. parameter: 0.6 | 226.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6773141213464864 | distance: 0.67731variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.8168847398201866 | distance: 0.81688variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6169567816603955 | distance: 0.61696variant: vectorized (shape strokes) 500px | 13.0 |
| Poly Vector | 0.6452192586639615 | distance: 0.64522variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 54.0 |
| Real-Time Inking | 0.8591746466495808 | distance: 0.85917variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8058299811719135 | distance: 0.80583variant: vectorized (all layers) | 749.0 |
| Topology Driven → Stroke Aggregator | 0.7924056608614444 | distance: 0.79241variant: vectorized (all layers) 500px | 409.0 |
| Topology Driven | 0.8180127403276518 | distance: 0.81801variant: vectorized (all layers) 500px | 8.0 |
| Fidelity Simplicity | 0.53275492942802 | distance: 0.53275variant: thresholdedalg. parameter: 0.6 | 226.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7447522145991109 | distance: 0.74475variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.5535420950891378 | distance: 0.55354variant: thresholdedalg. parameter: 0.6 | 226.0 |
| Mastering Sketching | 0.8569885645252127 | distance: 0.85699variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6715869947864583 | distance: 0.67159variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 13.0 |
| Poly Vector | 0.699572350841078 | distance: 0.69957variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 54.0 |
| Real-Time Inking | 0.8901780346735033 | distance: 0.89018variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8409872896264033 | distance: 0.84099variant: vectorized (all layers) | 749.0 |
| Topology Driven → Stroke Aggregator | 0.8485228573159121 | distance: 0.84852variant: vectorized (all layers) 500px | 409.0 |
| Topology Driven | 0.8641534803501946 | distance: 0.86415variant: vectorized (all layers) 500px | 8.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.028600698471069337 |  distance: 0.0286variant: thresholded 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.02801785087585449 |  distance: 0.02802variant: thresholded 1000pxalg. parameter: noisy | 126.0 |
| Poly Vector | 0.02801785087585449 |  distance: 0.02802variant: thresholded 1000px | 467.0 |
| Real-Time Inking | 0.029120439529418944 |  distance: 0.02912variant: thresholded 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.02801785087585449 |  distance: 0.02802variant: thresholded 1000px | 800.0 |
| Topology Driven | 0.02801785087585449 |  distance: 0.02802variant: thresholded 1000px | 25.0 |
| Fidelity Simplicity | 0.03001666259765625 |  distance: 0.03002variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 205.0 |
| Mastering Sketching | 0.20700241088867188 |  distance: 0.207variant: thresholded 1000px | 6.0 |
| Stroke Aggregator | 0.031211700366757612 | distance: 0.03121variant: vectorized (shape strokes) | 246.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
|
|
 |
 |
|
 |
|||
| thresholded |  |
 |
 |
|
|
|
 |
 |
|||||||
| thresholded 1000px | |
 |
|
 |
 |
 |
 |
 |
|
 |
|
|
|
 |
|
| thresholded 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
 |
 |
|
 |
 |
|
 |
||
| vectorized (shape strokes) 1000px | |
 |
 |
 |
 |
|
 |
|
 |
 |
 |
|
 |
 |
|
| vectorized (shape strokes) 500px |  |
 |
|
 |
 |
 |
 |
 |
 |
|
|
 |
|
|
|
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |