A Benchmark for Rough Sketch Cleanup
Ind_product_AS_12
Author: Akshay Sharma Licence: CC-BY-SAMessiness: 0.39408
Ambiguity (Chamfer): 0.25036
Shading: Yes
Scaffold: Yes
Texture Strokes: Yes
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Poly Vector | Topology Driven | Real-Time Inking | Fidelity Simplicity | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00065 |  distance: 0.00068 |  distance: 0.00069 |  distance: 0.00075 |  distance: 0.00161 |  distance: 0.00233 |  distance: 0.00286 |  distance: 0.00871 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  |  | ||
| Liliya Larsen |  | |  | ||||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.002862611020712401 | distance: 0.00286variant: vectorized (shape strokes) 1000px | 5.0 |
| Fidelity Simplicity | 0.0016111122413682993 | distance: 0.00161variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 182.0 |
| Mastering Sketching | 0.0006523657332135756 | distance: 0.00065variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.008710681333324966 | distance: 0.00871variant: thresholded 500pxalg. parameter: noisy | 139.0 |
| Poly Vector | 0.0006823593636130365 | distance: 0.00068variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 163.0 |
| Real-Time Inking | 0.0007510289642947058 | distance: 0.00075variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.0023254203525318443 | distance: 0.00233variant: vectorized (shape strokes) 500px | 247.0 |
| Topology Driven | 0.0006857349511258088 | distance: 0.00069variant: vectorized (shape strokes) 1000px | 14.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.4859709774000149 |  distance: 0.48597variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4363349128901251 | distance: 0.43633variant: thresholded 500pxalg. parameter: noisy | 139.0 |
| Poly Vector | 0.4480723818859429 |  distance: 0.44807variant: vectorized (all layers) 500px | 1072.0 |
| Real-Time Inking | 0.4555930475308747 |  distance: 0.45559variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.35367138919756363 |  distance: 0.35367variant: vectorized (all layers) 500px | 1465.0 |
| Topology Driven | 0.393940576761229 |  distance: 0.39394variant: thresholded 500px | 148.0 |
| Delaunay Triangulation | 0.2081657205158089 |  distance: 0.20817variant: vectorized (all layers) 500px | 6.0 |
| Fidelity Simplicity | 0.18737173390975886 |  distance: 0.18737variant: thresholded 500pxalg. parameter: 0.75 | 151.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.5740547506616238 | distance: 0.57405variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5243487845662385 | distance: 0.52435variant: thresholded 500pxalg. parameter: noisy | 139.0 |
| Poly Vector | 0.5332779183991028 |  distance: 0.53328variant: thresholded 500px | 662.0 |
| Real-Time Inking | 0.5189146179013789 | distance: 0.51891variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.4347413905178737 | distance: 0.43474variant: vectorized (all layers) 500px | 1465.0 |
| Topology Driven | 0.4719145523298214 | distance: 0.47191variant: thresholded 500px | 148.0 |
| Delaunay Triangulation | 0.3371982825674656 | distance: 0.3372variant: vectorized (all layers) 500px | 6.0 |
| Fidelity Simplicity | 0.26665216478804543 | distance: 0.26665variant: thresholded 500pxalg. parameter: 0.75 | 151.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.6333378745834976 | distance: 0.63334variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.590035074334814 | distance: 0.59004variant: thresholded 500pxalg. parameter: noisy | 139.0 |
| Poly Vector | 0.5973137106499168 |  distance: 0.59731variant: thresholded 500pxalg. parameter: noisy | 681.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5023077004093435 | distance: 0.50231variant: vectorized (all layers) 500px | 1465.0 |
| Topology Driven | 0.5388704385948857 | distance: 0.53887variant: thresholded 500px | 148.0 |
| Delaunay Triangulation | 0.4704128826584955 | distance: 0.47041variant: vectorized (all layers) 500px | 6.0 |
| Fidelity Simplicity | 0.3509919086540436 | distance: 0.35099variant: thresholded 500pxalg. parameter: 0.75 | 151.0 |
| Real-Time Inking | 0.5695012058936864 | distance: 0.5695variant: vectorized (all layers) 500px | 2.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5355546435858648 | distance: 0.53555variant: vectorized (all layers) 500px | 6.0 |
| Mastering Sketching | 0.6691285256616802 | distance: 0.66913variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6306786667420137 | distance: 0.63068variant: thresholded 500pxalg. parameter: noisy | 139.0 |
| Poly Vector | 0.6375350067659026 | distance: 0.63754variant: thresholded 500px | 662.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5430878246684484 | distance: 0.54309variant: vectorized (all layers) 500px | 1465.0 |
| Topology Driven | 0.5815363512869458 | distance: 0.58154variant: thresholded 500px | 148.0 |
| Fidelity Simplicity | 0.4177105910784539 | distance: 0.41771variant: thresholded 500pxalg. parameter: 0.75 | 151.0 |
| Real-Time Inking | 0.5949888989041601 | distance: 0.59499variant: vectorized (all layers) 500px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6006760237167336 | distance: 0.60068variant: vectorized (all layers) 500px | 6.0 |
| Mastering Sketching | 0.7102380705556085 |  distance: 0.71024variant: thresholded 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.6749289180092402 | distance: 0.67493variant: thresholded 500pxalg. parameter: noisy | 139.0 |
| Poly Vector | 0.6846835965587813 | distance: 0.68468variant: thresholded 500px | 662.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5920599319106113 | distance: 0.59206variant: vectorized (all layers) 500px | 1465.0 |
| Topology Driven | 0.6281542766912251 | distance: 0.62815variant: thresholded 500px | 148.0 |
| Fidelity Simplicity | 0.4935389013983024 |  distance: 0.49354variant: thresholded 500pxalg. parameter: 0.5 | 149.0 |
| Real-Time Inking | 0.6195814590652751 | distance: 0.61958variant: vectorized (all layers) 500px | 2.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.026172504425048832 | distance: 0.02617variant: vectorized (shape strokes) 1000px | 5.0 |
| Fidelity Simplicity | 0.0395600814819336 |  distance: 0.03956variant: vectorized (shape strokes) 1000pxalg. parameter: 0.5 | 180.0 |
| Poly Vector → Stroke Aggregator | 0.08881441497802735 | distance: 0.08881variant: thresholded 500pxalg. parameter: noisy | 139.0 |
| Poly Vector | 0.02505992889404297 |  distance: 0.02506variant: vectorized (shape strokes) 1000px | 154.0 |
| Real-Time Inking | 0.02531797790527344 | distance: 0.02532variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.06440496826171875 | distance: 0.0644variant: vectorized (shape strokes) 500px | 247.0 |
| Topology Driven | 0.02505992889404297 |  distance: 0.02506variant: vectorized (shape strokes) 500px | 5.0 |
| Mastering Sketching | 0.3892248840332031 | distance: 0.38922variant: vectorized (all layers) 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
||||||||||||||
| thresholded |  |
||||||||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 500px |  |
|
 |
 |
|
|
 |
|
|
|
 |
|
|||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
||||||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
 |
 |
 |
 |
|
|
|||
| vectorized (shape strokes) 1000px | |
|
 |
|
|
 |
 |
|
|
|
|
||||
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |