A Benchmark for Rough Sketch Cleanup
Ind_fashion_ML_05
Author: Myriam Lasserre Licence: CC-BY-SA-4.0Messiness: 0.13106
Ambiguity (Chamfer): 0.11636
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Real-Time Inking | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00122 |  distance: 0.00129 |  distance: 0.00135 |  distance: 0.00136 |  distance: 0.00142 |  distance: 0.00185 |  distance: 0.00348 |  distance: 0.00881 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Diego Barrionuevo |  | |  |  | |||
| Liliya Larsen |  | |  |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0034838552456748725 | distance: 0.00348variant: vectorized (shape strokes) 1000px | 3.0 |
| Mastering Sketching | 0.0012243309413503347 | distance: 0.00122variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.001853764570777333 | distance: 0.00185variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 154.0 |
| Poly Vector | 0.0013467084255956894 | distance: 0.00135variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 169.0 |
| Real-Time Inking | 0.001360759547868924 | distance: 0.00136variant: vectorized (shape strokes) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.0014179820993337482 | distance: 0.00142variant: vectorized (shape strokes) 1000px | 361.0 |
| Topology Driven | 0.0012916242435110086 | distance: 0.00129variant: vectorized (shape strokes) 1000px | 11.0 |
| Fidelity Simplicity | 0.008810106529273136 | distance: 0.00881variant: originalalg. parameter: 0.6 | 474.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.5012123328854412 |  distance: 0.50121variant: vectorized (all layers) 500px | 110.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.38181411100780616 |  distance: 0.38181variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.7504884807966528 |  distance: 0.75049variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.6293653163861379 |  distance: 0.62937variant: thresholded 500px | 256.0 |
| Topology Driven | 0.6364725020689863 |  distance: 0.63647variant: thresholded | 1104.0 |
| Fidelity Simplicity | 0.25622861116320983 |  distance: 0.25623variant: thresholded 500pxalg. parameter: 0.75 | 150.0 |
| Poly Vector → Stroke Aggregator | 0.6527749769752205 |  distance: 0.65277variant: thresholded 500pxalg. parameter: noisy | 55.0 |
| Real-Time Inking | 0.7714676685157901 |  distance: 0.77147variant: original | 3.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.565896934794586 | distance: 0.5659variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.8049474057553004 |  distance: 0.80495variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.7463701739801354 | distance: 0.74637variant: thresholded 500pxalg. parameter: noisy | 55.0 |
| Poly Vector | 0.5938143381903637 | distance: 0.59381variant: vectorized (all layers) 500px | 110.0 |
| Real-Time Inking | 0.8231433670740996 |  distance: 0.82314variant: vectorized (all layers) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.7500386020896599 | distance: 0.75004variant: thresholded 500px | 256.0 |
| Topology Driven | 0.7184124745016541 | distance: 0.71841variant: thresholded | 1104.0 |
| Fidelity Simplicity | 0.3782378181654797 |  distance: 0.37824variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 155.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.6718153315927109 | distance: 0.67182variant: vectorized (all layers) 500px | 1.0 |
| Mastering Sketching | 0.8360558409763524 | distance: 0.83606variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.8068861593754149 |  distance: 0.80689variant: vectorized (all layers) 1000pxalg. parameter: noisy | 255.0 |
| Poly Vector | 0.6627902234821365 |  distance: 0.66279variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 71.0 |
| Real-Time Inking | 0.8453035668935861 | distance: 0.8453variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.8168600291804374 | distance: 0.81686variant: thresholded 500px | 256.0 |
| Topology Driven | 0.7638985042159987 | distance: 0.7639variant: thresholded | 1104.0 |
| Fidelity Simplicity | 0.4736859804643233 | distance: 0.47369variant: thresholded 500pxalg. parameter: 0.75 | 150.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.7318362508111153 |  distance: 0.73184variant: vectorized (shape strokes) 500px | 1.0 |
| Mastering Sketching | 0.8513567536917603 | distance: 0.85136variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8312309769749089 |  distance: 0.83123variant: vectorized (all layers) 1000px | 256.0 |
| Poly Vector | 0.7013844356714144 | distance: 0.70138variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 71.0 |
| Real-Time Inking | 0.8610531165396649 | distance: 0.86105variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.8469278056918791 | distance: 0.84693variant: thresholded 500px | 256.0 |
| Topology Driven | 0.7968261653472466 | distance: 0.79683variant: thresholded | 1104.0 |
| Fidelity Simplicity | 0.5341904292413783 | distance: 0.53419variant: thresholded 500pxalg. parameter: 0.75 | 150.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.7829751352746439 | distance: 0.78298variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.6019794537129917 |  distance: 0.60198variant: thresholded 500pxalg. parameter: 0.3 | 101.0 |
| Mastering Sketching | 0.8680697534576066 | distance: 0.86807variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.7322578579945345 |  distance: 0.73226variant: vectorized (shape strokes) 500px | 71.0 |
| Real-Time Inking | 0.8755795240825837 | distance: 0.87558variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.8670802383041818 | distance: 0.86708variant: thresholded 500px | 256.0 |
| Topology Driven | 0.8209930745372402 | distance: 0.82099variant: thresholded | 1104.0 |
| Poly Vector → Stroke Aggregator | 0.8541074651652719 | distance: 0.85411variant: vectorized (all layers) 1000pxalg. parameter: noisy | 255.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.04440720748901368 | distance: 0.04441variant: vectorized (shape strokes) 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.02961418533325195 | distance: 0.02961variant: vectorized (all layers) 1000px | 256.0 |
| Poly Vector | 0.02961418533325195 |  distance: 0.02961variant: vectorized (shape strokes) 1000px | 166.0 |
| Real-Time Inking | 0.029529645919799806 |  distance: 0.02953variant: vectorized (shape strokes) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.029529645919799806 |  distance: 0.02953variant: vectorized (all layers) 500px | 158.0 |
| Topology Driven | 0.029529645919799806 |  distance: 0.02953variant: thresholded 500px | 11.0 |
| Fidelity Simplicity | 0.15433709439602078 |  distance: 0.15434variant: originalalg. parameter: 0.3 | 402.0 |
| Mastering Sketching | 0.23994166564941405 |  distance: 0.23994variant: vectorized (shape strokes) 500px | 6.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
 |
 |
|
 |
 |
|||||||
| thresholded |  |
 |
 |
 |
 |
 |
|
 |
|||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
| thresholded 500px | |
 |
 |
|
 |
 |
|
 |
|
 |
 |
 |
|
||
| vectorized (all layers) 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
||
| vectorized (all layers) 500px | |
 |
|
 |
 |
 |
|
 |
 |
 |
|
|
|||
| vectorized (shape strokes) 1000px | |
|
|
 |
 |
 |
 |
 |
|
|
|
|
|
||
| vectorized (shape strokes) 500px | |
|
 |
 |
 |
 |
 |
 |
|
|
|