A Benchmark for Rough Sketch Cleanup
Ind_product_AS_11
Author: Akshay Sharma Licence: CC-BY-SAMessiness: 0.34341
Ambiguity (Chamfer): 0.17208
Shading: No
Scaffold: Yes
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Mastering Sketching | Poly Vector | Real-Time Inking | Delaunay Triangulation | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0031 |  distance: 0.00313 |  distance: 0.00319 |  distance: 0.00324 |  distance: 0.00431 |  distance: 0.00452 |  distance: 0.00542 |  distance: 0.00544 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.003130125876234379 | distance: 0.00313variant: vectorized (shape strokes) 1000px | 7.0 |
| Poly Vector | 0.003190659384569929 | distance: 0.00319variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 582.0 |
| Real-Time Inking | 0.003243899261417887 | distance: 0.00324variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.004517449419307256 | distance: 0.00452variant: vectorized (shape strokes) 500px | 397.0 |
| Topology Driven | 0.0031036853038925016 | distance: 0.0031variant: vectorized (shape strokes) 1000px | 33.0 |
| Poly Vector → Stroke Aggregator | 0.005438205059317466 | distance: 0.00544variant: thresholded 500pxalg. parameter: noisy | 129.0 |
| Delaunay Triangulation | 0.004309531516924421 | distance: 0.00431variant: vectorized (shape strokes) 1000px | 10.0 |
| Fidelity Simplicity | 0.005424963007807135 | distance: 0.00542variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 191.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.24616979498095096 |  distance: 0.24617variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.3392754009794958 |  distance: 0.33928variant: thresholded 500pxalg. parameter: 0.75 | 189.0 |
| Stroke Aggregator | nan | ||
| Real-Time Inking | 0.20646124057969564 |  distance: 0.20646variant: original | 5.0 |
| Mastering Sketching | 0.5109045488239156 |  distance: 0.5109variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4789232225269186 |  distance: 0.47892variant: thresholded 1000px | 684.0 |
| Poly Vector | 0.5106327775966968 |  distance: 0.51063variant: vectorized (all layers) 1000pxalg. parameter: noisy | 450.0 |
| Topology Driven → Stroke Aggregator | 0.4577074484945878 |  distance: 0.45771variant: vectorized (all layers) 500px | 1769.0 |
| Topology Driven | 0.5025148607734592 |  distance: 0.50251variant: vectorized (all layers) 500px | 14.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.486909142300996 | distance: 0.48691variant: thresholded 500pxalg. parameter: 0.75 | 189.0 |
| Real-Time Inking | 0.31832426494124466 | distance: 0.31832variant: original | 5.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.39357406557382735 | distance: 0.39357variant: vectorized (all layers) 500px | 4.0 |
| Mastering Sketching | 0.6265580145895594 |  distance: 0.62656variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6085716404661554 | distance: 0.60857variant: thresholded 1000px | 684.0 |
| Poly Vector | 0.6384128701607567 | distance: 0.63841variant: vectorized (all layers) 1000pxalg. parameter: noisy | 450.0 |
| Topology Driven → Stroke Aggregator | 0.5933977661043972 | distance: 0.5934variant: vectorized (all layers) 500px | 1769.0 |
| Topology Driven | 0.6150095826634552 | distance: 0.61501variant: vectorized (all layers) 500px | 14.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.40013914583825627 | distance: 0.40014variant: original | 5.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.5017801876205442 | distance: 0.50178variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.5745947501004326 |  distance: 0.57459variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 169.0 |
| Mastering Sketching | 0.6989084293511219 | distance: 0.69891variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6868068023414786 |  distance: 0.68681variant: thresholded 1000pxalg. parameter: noisy | 679.0 |
| Poly Vector | 0.7181618918901379 | distance: 0.71816variant: vectorized (all layers) 1000pxalg. parameter: noisy | 450.0 |
| Topology Driven → Stroke Aggregator | 0.6816554134091076 | distance: 0.68166variant: vectorized (all layers) 500px | 1769.0 |
| Topology Driven | 0.6952111774215771 | distance: 0.69521variant: vectorized (all layers) 500px | 14.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.5717333333333334 | distance: 0.57173variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.6325205506108571 | distance: 0.63252variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 169.0 |
| Mastering Sketching | 0.742011140428027 | distance: 0.74201variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7324306797118827 | distance: 0.73243variant: thresholded 1000px | 684.0 |
| Poly Vector | 0.7599480901230514 |  distance: 0.75995variant: vectorized (all layers) 1000px | 342.0 |
| Real-Time Inking | 0.4920929032967704 | distance: 0.49209variant: original | 5.0 |
| Topology Driven → Stroke Aggregator | 0.7235640633751669 | distance: 0.72356variant: vectorized (all layers) 500px | 1769.0 |
| Topology Driven | 0.7371420859908642 | distance: 0.73714variant: vectorized (all layers) 500px | 14.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.6393418683401239 | distance: 0.63934variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.6878679441188128 | distance: 0.68787variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 169.0 |
| Mastering Sketching | 0.7813467382352106 | distance: 0.78135variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7694415105743537 | distance: 0.76944variant: thresholded 1000pxalg. parameter: noisy | 679.0 |
| Poly Vector | 0.7974368478129764 |  distance: 0.79744variant: vectorized (all layers) 500pxalg. parameter: noisy | 168.0 |
| Real-Time Inking | 0.5559632368346015 | distance: 0.55596variant: original | 5.0 |
| Topology Driven → Stroke Aggregator | 0.7735922310713246 | distance: 0.77359variant: vectorized (all layers) 500px | 1769.0 |
| Topology Driven | 0.7842446520630578 | distance: 0.78424variant: vectorized (all layers) 500px | 14.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.07202777099609375 |  distance: 0.07203variant: vectorized (all layers) 500pxalg. parameter: noisy | 51.0 |
| Poly Vector | 0.038013156890869135 | distance: 0.03801variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 582.0 |
| Real-Time Inking | 0.039962482452392575 | distance: 0.03996variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.044271888732910165 | distance: 0.04427variant: vectorized (shape strokes) 500px | 397.0 |
| Topology Driven | 0.038013156890869135 | distance: 0.03801variant: vectorized (shape strokes) 1000px | 33.0 |
| Delaunay Triangulation | 0.045967380523681635 | distance: 0.04597variant: vectorized (shape strokes) 1000px | 10.0 |
| Fidelity Simplicity | 0.09102197265625 |  distance: 0.09102variant: vectorized (all layers) 1000pxalg. parameter: 0.75 | 245.0 |
| Mastering Sketching | 0.24915858459472656 |  distance: 0.24916variant: vectorized (shape strokes) 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
||||||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
|
| thresholded 500px |  |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
|
 |
|
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
|
 |
 |
|
|
 |
||||
| vectorized (all layers) 500px | |
 |
|
 |
 |
|
 |
 |
|
|
 |
|
|
 |
|
| vectorized (shape strokes) 1000px | |
|
|
 |
 |
 |
 |
|
|
 |
|
||||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |