A Benchmark for Rough Sketch Cleanup
Art_freeform_MP_02
Author: Anastasia Majzhegisheva (aka Morevna Project) Author Homepage: https://morevnaproject.org/category/artists/anastasia-majzhegisheva/ Licence: CC-BY-4.0Messiness: 0.12715
Ambiguity (Chamfer): 0.11019
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Mastering Sketching | Stroke Aggregator | Topology Driven | Poly Vector | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00177 |  distance: 0.00178 |  distance: 0.00181 |  distance: 0.00194 |  distance: 0.00197 |  distance: 0.00209 |  distance: 0.00218 |  distance: 0.0029 |  distance: 0.00541 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.002897157083969727 | distance: 0.0029variant: thresholded | 101.0 |
| Fidelity Simplicity | 0.005405543694943497 | distance: 0.00541variant: thresholdedalg. parameter: 0.75 | 304.0 |
| Mastering Sketching | 0.0017789440060210406 | distance: 0.00178variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0020856881892587385 | distance: 0.00209variant: thresholded 1000px | 276.0 |
| Poly Vector | 0.001971213647568239 | distance: 0.00197variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 303.0 |
| Real-Time Inking | 0.0017690619720251075 | distance: 0.00177variant: thresholded | 5.0 |
| Stroke Aggregator | 0.0018086914962172449 | distance: 0.00181variant: vectorized (shape strokes) | 1027.0 |
| Topology Driven → Stroke Aggregator | 0.0021821178537456487 | distance: 0.00218variant: thresholded 1000px | 1530.0 |
| Topology Driven | 0.0019370197553297565 | distance: 0.00194variant: vectorized (shape strokes) 1000px | 36.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.20959799893515316 |  distance: 0.2096variant: original | 9.0 |
| Fidelity Simplicity | 0.3450394856434749 |  distance: 0.34504variant: thresholded 1000pxalg. parameter: 0.75 | 200.0 |
| Poly Vector | 0.3945644971230992 |  distance: 0.39456variant: vectorized (all layers) 500pxalg. parameter: noisy | 163.0 |
| Mastering Sketching | 0.7152192783514143 |  distance: 0.71522variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.702653519023276 |  distance: 0.70265variant: thresholded 1000pxalg. parameter: noisy | 276.0 |
| Real-Time Inking | 0.6961618326636317 |  distance: 0.69616variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.6828040127992421 |  distance: 0.6828variant: vectorized (all layers) | 1259.0 |
| Topology Driven → Stroke Aggregator | 0.0 |  distance: 0.0variant: original | 5.0 |
| Topology Driven | 6.404406231487263e-05 |  distance: 6e-05variant: original | 12.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.32969064508399604 | distance: 0.32969variant: original | 9.0 |
| Fidelity Simplicity | 0.4612211334234682 |  distance: 0.46122variant: thresholded 1000pxalg. parameter: 0.6 | 185.0 |
| Poly Vector → Stroke Aggregator | 0.8308146916416513 | distance: 0.83081variant: thresholded 1000pxalg. parameter: noisy | 276.0 |
| Poly Vector | 0.5321923303629057 |  distance: 0.53219variant: vectorized (all layers) 500px | 172.0 |
| Real-Time Inking | 0.8088056642727828 |  distance: 0.80881variant: original | 3.0 |
| Stroke Aggregator | 0.8194462197894655 | distance: 0.81945variant: vectorized (all layers) | 1259.0 |
| Mastering Sketching | 0.8350650907132751 | distance: 0.83507variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.0012483795073702404 | distance: 0.00125variant: original | 5.0 |
| Topology Driven | 0.0014083154626636366 | distance: 0.00141variant: original | 12.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5432389265851931 | distance: 0.54324variant: thresholded 1000pxalg. parameter: 0.75 | 200.0 |
| Poly Vector → Stroke Aggregator | 0.8952886124198361 | distance: 0.89529variant: thresholded 1000pxalg. parameter: noisy | 276.0 |
| Poly Vector | 0.6203821677127349 |  distance: 0.62038variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 150.0 |
| Stroke Aggregator | 0.8891612763007877 | distance: 0.88916variant: vectorized (all layers) | 1259.0 |
| Delaunay Triangulation | 0.4024540313805152 | distance: 0.40245variant: original | 9.0 |
| Real-Time Inking | 0.8596296605811193 | distance: 0.85963variant: original | 3.0 |
| Mastering Sketching | 0.8920837265939235 | distance: 0.89208variant: vectorized (all layers) 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.001983873032125944 | distance: 0.00198variant: original | 5.0 |
| Topology Driven | 0.002143691308451583 | distance: 0.00214variant: original | 12.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5911851394974715 | distance: 0.59119variant: thresholded 1000pxalg. parameter: 0.75 | 200.0 |
| Poly Vector → Stroke Aggregator | 0.926797613659633 | distance: 0.9268variant: thresholded 1000pxalg. parameter: noisy | 276.0 |
| Poly Vector | 0.6690506670661217 | distance: 0.66905variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 150.0 |
| Delaunay Triangulation | 0.4490240868276269 | distance: 0.44902variant: original | 9.0 |
| Real-Time Inking | 0.8879425683634985 | distance: 0.88794variant: original | 3.0 |
| Mastering Sketching | 0.9167982399658072 | distance: 0.9168variant: vectorized (all layers) 500px | 5.0 |
| Stroke Aggregator | 0.9239002424777856 | distance: 0.9239variant: vectorized (all layers) | 1259.0 |
| Topology Driven → Stroke Aggregator | 0.0026549380247900835 | distance: 0.00265variant: original | 5.0 |
| Topology Driven | 0.002782708823106079 | distance: 0.00278variant: original | 12.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6298291926560982 | distance: 0.62983variant: thresholded 1000pxalg. parameter: 0.6 | 185.0 |
| Poly Vector → Stroke Aggregator | 0.9489828736346526 | distance: 0.94898variant: thresholded 1000pxalg. parameter: noisy | 276.0 |
| Poly Vector | 0.7099730434687148 | distance: 0.70997variant: vectorized (all layers) 500pxalg. parameter: noisy | 163.0 |
| Stroke Aggregator | 0.9462506113242924 | distance: 0.94625variant: vectorized (all layers) | 1259.0 |
| Delaunay Triangulation | 0.4922184800116888 | distance: 0.49222variant: original | 9.0 |
| Real-Time Inking | 0.9063671003620084 | distance: 0.90637variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.0032842837363557327 | distance: 0.00328variant: original | 5.0 |
| Topology Driven | 0.003412859396632216 | distance: 0.00341variant: original | 12.0 |
| Mastering Sketching | 0.9409816509493054 | distance: 0.94098variant: vectorized (all layers) 500px | 5.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.16902662658691406 | distance: 0.16903variant: thresholded 1000px | 276.0 |
| Fidelity Simplicity | 0.1340718956032068 | distance: 0.13407variant: thresholdedalg. parameter: 0.75 | 304.0 |
| Mastering Sketching | 0.22643321228027344 | distance: 0.22643variant: thresholded 500px | 5.0 |
| Topology Driven → Stroke Aggregator | 0.046818798065185546 |  distance: 0.04682variant: vectorized (all layers) 500px | 560.0 |
| Delaunay Triangulation | 0.032201966730369416 | distance: 0.0322variant: thresholded | 101.0 |
| Poly Vector | 0.0304138126373291 | distance: 0.03041variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 303.0 |
| Real-Time Inking | 0.0304138126373291 |  distance: 0.03041variant: vectorized (shape strokes) 1000px | 3.0 |
| Stroke Aggregator | 0.030433057418162487 | distance: 0.03043variant: vectorized (shape strokes) | 1027.0 |
| Topology Driven | 0.028844409942626957 |  distance: 0.02884variant: vectorized (shape strokes) 500px | 9.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
|
|||||||||||
| thresholded | |
|
 |
|
|||||||||||
| thresholded 1000px | |
 |
 |
 |
 |
|
|
 |
 |
 |
 |
|
|
||
| thresholded 500px |  |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
 |
 |
 |
|
|
 |
|||
| vectorized (shape strokes) 1000px | |
 |
 |
 |
 |
 |
|
|
 |
 |
|||||
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
|
|
 |
 |
||||
| vectorized (all layers) | |
||||||||||||||
| vectorized (shape strokes) | |