A Benchmark for Rough Sketch Cleanup
Ind_fashion_HF_05
Author: Hugo Fonseca Author Homepage: www.thestyleconfessions.com/ Licence: CC-BY-NC-SA-3.0Messiness: 0.10028
Ambiguity (Chamfer): 0.08216
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Stroke Aggregator | Real-Time Inking | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00079 |  distance: 0.00088 |  distance: 0.00088 |  distance: 0.00112 |  distance: 0.00145 |  distance: 0.00165 |  distance: 0.0017 |  distance: 0.00243 |  distance: 0.0028 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  |  | |||
| Liliya Larsen |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0027986984917103518 | distance: 0.0028variant: original | 40.0 |
| Fidelity Simplicity | 0.002430089948933934 | distance: 0.00243variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 113.0 |
| Mastering Sketching | 0.0007937166291692066 | distance: 0.00079variant: vectorized (shape strokes) 1000px | 8.0 |
| Poly Vector → Stroke Aggregator | 0.0016482524638446973 | distance: 0.00165variant: vectorized (shape strokes) 1000px | 431.0 |
| Poly Vector | 0.0008812007685609645 | distance: 0.00088variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 223.0 |
| Real-Time Inking | 0.0014525067182446134 | distance: 0.00145variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | 0.0011246776033424044 | distance: 0.00112variant: vectorized (shape strokes) | 635.0 |
| Topology Driven → Stroke Aggregator | 0.0017028013675084806 | distance: 0.0017variant: thresholded 1000px | 1381.0 |
| Topology Driven | 0.0008787351811395197 | distance: 0.00088variant: vectorized (shape strokes) 1000px | 18.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.3064823015412258 |  distance: 0.30648variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.4431233216291094 |  distance: 0.44312variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 178.0 |
| Mastering Sketching | 0.7285157085446154 |  distance: 0.72852variant: vectorized (all layers) 500px | 6.0 |
| Real-Time Inking | 0.7139375398369022 |  distance: 0.71394variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7480716895786779 |  distance: 0.74807variant: vectorized (all layers) | 1045.0 |
| Topology Driven → Stroke Aggregator | 0.6665549502348895 |  distance: 0.66655variant: thresholded 500px | 364.0 |
| Topology Driven | 0.7140175271821041 |  distance: 0.71402variant: vectorized (all layers) 500px | 21.0 |
| Poly Vector → Stroke Aggregator | 0.4985133068906956 |  distance: 0.49851variant: vectorized (all layers) 500px | 29.0 |
| Poly Vector | 0.5226703708628873 |  distance: 0.52267variant: vectorized (all layers) 500px | 212.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4780283552648226 | distance: 0.47803variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.598460783390627 | distance: 0.59846variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 178.0 |
| Mastering Sketching | 0.7883089008099365 |  distance: 0.78831variant: vectorized (all layers) 1000px | 7.0 |
| Real-Time Inking | 0.7802769899240753 | distance: 0.78028variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8155131783548998 | distance: 0.81551variant: vectorized (all layers) | 1045.0 |
| Topology Driven → Stroke Aggregator | 0.7635550697356297 | distance: 0.76356variant: thresholded 500px | 364.0 |
| Topology Driven | 0.7720353415431793 | distance: 0.77204variant: vectorized (all layers) 500px | 21.0 |
| Poly Vector → Stroke Aggregator | 0.5970684554706549 |  distance: 0.59707variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 30.0 |
| Poly Vector | 0.6182437392615816 |  distance: 0.61824variant: vectorized (all layers) 500pxalg. parameter: noisy | 206.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5956004616521287 | distance: 0.5956variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.7036595328384703 | distance: 0.70366variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 178.0 |
| Mastering Sketching | 0.8223943745675141 | distance: 0.82239variant: vectorized (all layers) 500px | 6.0 |
| Real-Time Inking | 0.8177104518323387 | distance: 0.81771variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8502910078267736 | distance: 0.85029variant: vectorized (all layers) | 1045.0 |
| Topology Driven → Stroke Aggregator | 0.8275432395839958 | distance: 0.82754variant: thresholded 500px | 364.0 |
| Topology Driven | 0.8102439708729803 | distance: 0.81024variant: vectorized (all layers) 500px | 21.0 |
| Poly Vector → Stroke Aggregator | 0.6758671740517407 | distance: 0.67587variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 30.0 |
| Poly Vector | 0.6995449197712221 | distance: 0.69954variant: vectorized (all layers) 500pxalg. parameter: noisy | 206.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6619651723756594 | distance: 0.66197variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.746202552886855 |  distance: 0.7462variant: originalalg. parameter: 0.75 | 232.0 |
| Mastering Sketching | 0.8436276193747853 | distance: 0.84363variant: vectorized (all layers) 500px | 6.0 |
| Real-Time Inking | 0.8431602358116492 | distance: 0.84316variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8740555026621051 | distance: 0.87406variant: vectorized (all layers) | 1045.0 |
| Topology Driven → Stroke Aggregator | 0.8652089150896533 | distance: 0.86521variant: thresholded 500px | 364.0 |
| Topology Driven | 0.8377746789021555 | distance: 0.83777variant: vectorized (all layers) 500px | 21.0 |
| Poly Vector → Stroke Aggregator | 0.7292689937525506 | distance: 0.72927variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 30.0 |
| Poly Vector | 0.7552464171538606 | distance: 0.75525variant: vectorized (all layers) 500px | 212.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7282526913178979 | distance: 0.72825variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.7745624966085931 |  distance: 0.77456variant: originalalg. parameter: 0.6 | 206.0 |
| Mastering Sketching | 0.8673620457604307 | distance: 0.86736variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector | 0.7998416997032192 | distance: 0.79984variant: vectorized (all layers) 500pxalg. parameter: noisy | 206.0 |
| Real-Time Inking | 0.8719281230541338 | distance: 0.87193variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8875105313616688 | distance: 0.88751variant: vectorized (all layers) | 1045.0 |
| Topology Driven → Stroke Aggregator | 0.8880769414519325 | distance: 0.88808variant: thresholded 1000px | 1381.0 |
| Topology Driven | 0.8623319094271823 | distance: 0.86233variant: vectorized (all layers) 500px | 21.0 |
| Poly Vector → Stroke Aggregator | 0.7813271684915138 | distance: 0.78133variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 30.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.28425341796875 |  distance: 0.28425variant: vectorized (shape strokes) 500px | 5.0 |
| Delaunay Triangulation | 0.029154760360717773 |  distance: 0.02915variant: thresholded 1000px | 9.0 |
| Fidelity Simplicity | 0.0305941162109375 |  distance: 0.03059variant: vectorized (all layers) 1000pxalg. parameter: 0.25 | 156.0 |
| Poly Vector → Stroke Aggregator | 0.025 |  distance: 0.025variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 430.0 |
| Poly Vector | 0.022000000000000002 | distance: 0.022variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 223.0 |
| Real-Time Inking | 0.023409399032592773 |  distance: 0.02341variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | 0.02230787646862888 | distance: 0.02231variant: vectorized (shape strokes) | 635.0 |
| Topology Driven → Stroke Aggregator | 0.03080584335327148 | distance: 0.03081variant: thresholded 1000px | 1381.0 |
| Topology Driven | 0.02262741661071777 |  distance: 0.02263variant: vectorized (shape strokes) 500px | 6.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
|
|
 |
|
|||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
||||
| thresholded 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
| vectorized (all layers) 1000px |  |
|
 |
|
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
|
 |
|
|
|
|
 |
|
||
| vectorized (shape strokes) 1000px | |
|
 |
|
 |
 |
 |
|
|
 |
 |
|
|
||
| vectorized (shape strokes) 500px | |
|
 |
 |
 |
 |
|
 |
 |
 |
|
 |
|||
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |