A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_01
Author: Baseline Licence: Academic PaperMessiness: 0.09587
Ambiguity (Chamfer): 0.07946
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Poly Vector → Stroke Aggregator | Poly Vector | Topology Driven | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00098 |  distance: 0.00098 |  distance: 0.00114 |  distance: 0.0012 |  distance: 0.00124 |  distance: 0.00132 |  distance: 0.00189 |  distance: 0.00263 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.0026334289180761287 | distance: 0.00263variant: original | 6.0 |
| Fidelity Simplicity | 0.0018876446968182656 | distance: 0.00189variant: originalalg. parameter: 0.3 | 236.0 |
| Mastering Sketching | 0.0009814356847790099 | distance: 0.00098variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0011383711799405134 | distance: 0.00114variant: originalalg. parameter: noisy | 179.0 |
| Poly Vector | 0.0011986764784197301 | distance: 0.0012variant: original 1000px | 153.0 |
| Real-Time Inking | 0.0009831227154607674 | distance: 0.00098variant: original 1000px | 3.0 |
| Topology Driven | 0.0012407827249017868 | distance: 0.00124variant: original 1000px | 19.0 |
| Topology Driven → Stroke Aggregator | 0.0013218927688581795 | distance: 0.00132variant: original | 836.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6665207870679407 |  distance: 0.66652variant: original 500pxalg. parameter: 0.75 | 1721.0 |
| Mastering Sketching | 0.7943986629012154 | distance: 0.7944variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7276614771209677 |  distance: 0.72766variant: original 1000pxalg. parameter: noisy | 152.0 |
| Poly Vector | 0.5637123270420523 |  distance: 0.56371variant: original 500px | 64.0 |
| Real-Time Inking | 0.7478994814997371 |  distance: 0.7479variant: original | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7079034618474909 |  distance: 0.7079variant: original 1000px | 664.0 |
| Topology Driven | 0.7156044642049368 |  distance: 0.7156variant: original 500px | 6.0 |
| Delaunay Triangulation | 0.4139633015660377 |  distance: 0.41396variant: original 500px | 1.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6777720947700936 | distance: 0.67777variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.8400554197640846 | distance: 0.84006variant: original 500pxalg. parameter: 0.75 | 1721.0 |
| Mastering Sketching | 0.931525539531202 | distance: 0.93153variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9154873485400046 | distance: 0.91549variant: original 1000pxalg. parameter: noisy | 152.0 |
| Poly Vector | 0.7291503388648145 | distance: 0.72915variant: original 500px | 64.0 |
| Real-Time Inking | 0.9139485852684834 | distance: 0.91395variant: original | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8959704565470578 | distance: 0.89597variant: original 1000px | 664.0 |
| Topology Driven | 0.8879598299254166 | distance: 0.88796variant: original 500px | 6.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8283175757015733 | distance: 0.82832variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.9222705920187354 | distance: 0.92227variant: original 500pxalg. parameter: 0.75 | 1721.0 |
| Mastering Sketching | 0.9805331649896578 | distance: 0.98053variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.964736005562596 | distance: 0.96474variant: original 1000pxalg. parameter: noisy | 152.0 |
| Poly Vector | 0.811146804313098 | distance: 0.81115variant: original 500px | 64.0 |
| Real-Time Inking | 0.9671141068317592 | distance: 0.96711variant: original | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9617642598759762 | distance: 0.96176variant: original 1000px | 664.0 |
| Topology Driven | 0.9596757106385514 | distance: 0.95968variant: original 500px | 6.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8829584211266892 | distance: 0.88296variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.9485707900910774 |  distance: 0.94857variant: original 500pxalg. parameter: 0.3 | 1767.0 |
| Mastering Sketching | 0.9910994921873042 | distance: 0.9911variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9815673860260123 |  distance: 0.98157variant: original 1000px | 153.0 |
| Poly Vector | 0.8587313604116211 |  distance: 0.85873variant: original 500pxalg. parameter: noisy | 71.0 |
| Real-Time Inking | 0.9889421956091334 | distance: 0.98894variant: original | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9841489207689224 | distance: 0.98415variant: original 1000px | 664.0 |
| Topology Driven | 0.9856675879914756 |  distance: 0.98567variant: original | 22.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.9230330524761079 | distance: 0.92303variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.9553164639595954 |  distance: 0.95532variant: original 500pxalg. parameter: 0.25 | 1520.0 |
| Mastering Sketching | 0.9949596607286944 | distance: 0.99496variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.991383256530211 | distance: 0.99138variant: original 1000pxalg. parameter: noisy | 152.0 |
| Poly Vector | 0.8935105215207109 | distance: 0.89351variant: original 500px | 64.0 |
| Real-Time Inking | 0.993425597806278 | distance: 0.99343variant: original 1000px | 3.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.9931166280236564 | distance: 0.99312variant: original 1000px | 664.0 |
| Topology Driven | 0.9935258315330036 | distance: 0.99353variant: original 500px | 6.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.06 | distance: 0.06variant: original 500pxalg. parameter: 0.25 | 1520.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.09234716796875 | distance: 0.09235variant: original 500px | 1.0 |
| Mastering Sketching | 0.11954915618896485 | distance: 0.11955variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.013262019437902114 | distance: 0.01326variant: originalalg. parameter: noisy | 179.0 |
| Poly Vector | 0.012727922439575195 |  distance: 0.01273variant: original 1000pxalg. parameter: noisy | 178.0 |
| Real-Time Inking | 0.008 |  distance: 0.008variant: original 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.012412804573494862 | distance: 0.01241variant: original | 836.0 |
| Topology Driven | 0.012727922439575195 | distance: 0.01273variant: original 1000px | 19.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
 |
 |
 |
 |
|
 |
 |
|
|
 |
||
| original 1000px | |
|
 |
 |
 |
 |
 |
|
|
|
 |
|
|
||
| original 500px | |
|
|
|
|
|
|
|
|