A Benchmark for Rough Sketch Cleanup
Art_freeform_AG_05
Author: Anton Gulic Author Homepage: https://www.upwork.com/freelancers/~0168eeeb4816b24940 Licence: CC-BY-4.0Messiness: 0.23925
Ambiguity (Chamfer): 0.34478
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Topology Driven | Stroke Aggregator | Mastering Sketching | Poly Vector | Real-Time Inking | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00236 |  distance: 0.00238 |  distance: 0.00242 |  distance: 0.00244 |  distance: 0.00249 |  distance: 0.0025 |  distance: 0.00287 |  distance: 0.00515 |  distance: 0.00627 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Liliya Larsen |  | |  | ||||
| Maria Hegedus |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.005148239680283265 | distance: 0.00515variant: original | 188.0 |
| Fidelity Simplicity | 0.006274961772407914 | distance: 0.00627variant: thresholdedalg. parameter: 0.25 | 294.0 |
| Mastering Sketching | 0.0024162372993850267 | distance: 0.00242variant: thresholded 500px | 5.0 |
| Real-Time Inking | 0.002486242960309353 | distance: 0.00249variant: original | 3.0 |
| Poly Vector → Stroke Aggregator | 0.002866984532773129 | distance: 0.00287variant: vectorized (shape strokes) 1000px | 82.0 |
| Poly Vector | 0.0024375398432559185 | distance: 0.00244variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 138.0 |
| Stroke Aggregator | 0.002381855595542483 | distance: 0.00238variant: vectorized (shape strokes) | 142.0 |
| Topology Driven → Stroke Aggregator | 0.002501962762462814 | distance: 0.0025variant: vectorized (shape strokes) 1000px | 237.0 |
| Topology Driven | 0.0023648736510398305 | distance: 0.00236variant: vectorized (shape strokes) 1000px | 12.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2520385684696683 |  distance: 0.25204variant: vectorized (shape strokes) 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.3986774137250076 |  distance: 0.39868variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 26.0 |
| Stroke Aggregator | 0.4775948326139841 | distance: 0.47759variant: vectorized (shape strokes) | 142.0 |
| Topology Driven → Stroke Aggregator | 0.4241681260945709 |  distance: 0.42417variant: vectorized (shape strokes) 500px | 117.0 |
| Mastering Sketching | 0.39865143096360095 |  distance: 0.39865variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.4075047900553063 |  distance: 0.4075variant: vectorized (all layers) 1000pxalg. parameter: noisy | 453.0 |
| Real-Time Inking | 0.451107273363783 |  distance: 0.45111variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.3913005383515787 |  distance: 0.3913variant: original | 840.0 |
| Fidelity Simplicity | 0.15851030196939858 |  distance: 0.15851variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 242.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.40107962636402 |  distance: 0.40108variant: vectorized (all layers) 500px | 6.0 |
| Mastering Sketching | 0.4714787695118729 | distance: 0.47148variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4564304074868286 |  distance: 0.45643variant: vectorized (all layers) 500px | 414.0 |
| Poly Vector | 0.4591575260749898 |  distance: 0.45916variant: vectorized (all layers) 500px | 165.0 |
| Real-Time Inking | 0.5125493302282269 | distance: 0.51255variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.4679792428040953 |  distance: 0.46798variant: vectorized (all layers) 500px | 28.0 |
| Fidelity Simplicity | 0.19411646653510387 |  distance: 0.19412variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 225.0 |
| Stroke Aggregator | 0.6226627336463154 | distance: 0.62266variant: vectorized (shape strokes) | 142.0 |
| Topology Driven → Stroke Aggregator | 0.5691886157813062 | distance: 0.56919variant: vectorized (shape strokes) 500px | 117.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4702640904156786 | distance: 0.47026variant: vectorized (all layers) 500px | 6.0 |
| Mastering Sketching | 0.531266018694739 | distance: 0.53127variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5151554926674387 |  distance: 0.51516variant: vectorized (all layers) 500pxalg. parameter: noisy | 412.0 |
| Poly Vector | 0.5178165115333137 | distance: 0.51782variant: vectorized (all layers) 500px | 165.0 |
| Real-Time Inking | 0.5661414637137521 | distance: 0.56614variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.5413968052088551 | distance: 0.5414variant: vectorized (all layers) 500px | 28.0 |
| Fidelity Simplicity | 0.21730124885775207 | distance: 0.2173variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 225.0 |
| Stroke Aggregator | 0.6798703806588328 | distance: 0.67987variant: vectorized (shape strokes) | 142.0 |
| Topology Driven → Stroke Aggregator | 0.6516222510569152 | distance: 0.65162variant: vectorized (shape strokes) 500px | 117.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5164721770674773 | distance: 0.51647variant: vectorized (all layers) 500px | 6.0 |
| Mastering Sketching | 0.5761149712837699 | distance: 0.57611variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5738450758112559 | distance: 0.57385variant: vectorized (all layers) 500pxalg. parameter: noisy | 412.0 |
| Poly Vector | 0.5781149637488451 | distance: 0.57811variant: vectorized (all layers) 500px | 165.0 |
| Real-Time Inking | 0.6130953833403872 | distance: 0.6131variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.5963175597375934 | distance: 0.59632variant: vectorized (all layers) 500px | 28.0 |
| Fidelity Simplicity | 0.22749645708385066 | distance: 0.2275variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 225.0 |
| Stroke Aggregator | 0.7156753669759864 | distance: 0.71568variant: vectorized (shape strokes) | 142.0 |
| Topology Driven → Stroke Aggregator | 0.6931797357694955 | distance: 0.69318variant: vectorized (shape strokes) 500px | 117.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5738490698984937 | distance: 0.57385variant: vectorized (all layers) 500px | 6.0 |
| Mastering Sketching | 0.6290701763369411 | distance: 0.62907variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.628255585804097 | distance: 0.62826variant: vectorized (all layers) 500px | 414.0 |
| Poly Vector | 0.6308899313932589 |  distance: 0.63089variant: vectorized (all layers) 500pxalg. parameter: noisy | 175.0 |
| Real-Time Inking | 0.6605795089545402 | distance: 0.66058variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.6516282249458499 | distance: 0.65163variant: vectorized (all layers) 500px | 28.0 |
| Fidelity Simplicity | 0.2371225635725712 | distance: 0.23712variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 225.0 |
| Stroke Aggregator | 0.7527157755345529 | distance: 0.75272variant: vectorized (shape strokes) | 142.0 |
| Topology Driven → Stroke Aggregator | 0.7377840858808012 | distance: 0.73778variant: vectorized (shape strokes) 500px | 117.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.14094803550026633 |  distance: 0.14095variant: originalalg. parameter: 0.6 | 356.0 |
| Mastering Sketching | 0.2612048950195313 | distance: 0.2612variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.04833218383789063 | distance: 0.04833variant: vectorized (all layers) 500pxalg. parameter: noisy | 412.0 |
| Poly Vector | 0.039597980499267584 |  distance: 0.0396variant: thresholded 500px | 426.0 |
| Real-Time Inking | 0.039597980499267584 |  distance: 0.0396variant: thresholded 500px | 2.0 |
| Topology Driven | 0.039597980499267584 |  distance: 0.0396variant: thresholded 500px | 56.0 |
| Delaunay Triangulation | 0.07337574768066406 | distance: 0.07338variant: vectorized (shape strokes) 500px | 1.0 |
| Stroke Aggregator | 0.06252323930913753 | distance: 0.06252variant: vectorized (shape strokes) | 142.0 |
| Topology Driven → Stroke Aggregator | 0.05803447341918945 | distance: 0.05803variant: vectorized (shape strokes) 500px | 117.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
|
|
|
|||||||
| thresholded |  |
 |
|
 |
 |
 |
 |
||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 500px | |
|
 |
 |
 |
 |
 |
|
 |
|
 |
||||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
|
 |
 |
|||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
|
|
|
|
|
|
||
| vectorized (shape strokes) 1000px | |
 |
 |
 |
 |
 |
|
|
|
 |
 |
|
|||
| vectorized (shape strokes) 500px | |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
|
|
 |
|
| vectorized (shape strokes) | |