A Benchmark for Rough Sketch Cleanup
Art_freeform_Rui_01
Author: Rui Hao (aka Rui) Author Homepage: https://www.instagram.com/imtintone/ Licence: CC-BY-NC-4.0Messiness: 0.50287
Ambiguity (Chamfer): 0.1111
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Mastering Sketching | Fidelity Simplicity | Topology Driven | Poly Vector | Stroke Aggregator | Topology Driven → Stroke Aggregator | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0026 |  distance: 0.00315 |  distance: 0.00367 |  distance: 0.0041 |  distance: 0.0042 |  distance: 0.00432 |  distance: 0.00546 |  distance: 0.00701 |  distance: 0.00703 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.0026012730660959693 | distance: 0.0026variant: thresholded | 3.0 |
| Fidelity Simplicity | 0.0036748069261051813 | distance: 0.00367variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 207.0 |
| Delaunay Triangulation | 0.007025913930246031 | distance: 0.00703variant: vectorized (shape strokes) 1000px | 10.0 |
| Mastering Sketching | 0.0031464089213590523 | distance: 0.00315variant: thresholded 500px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.007008129931171191 | distance: 0.00701variant: vectorized (all layers) 500px | 252.0 |
| Poly Vector | 0.004196442485850208 | distance: 0.0042variant: vectorized (shape strokes) 1000px | 247.0 |
| Stroke Aggregator | 0.004323485930037235 | distance: 0.00432variant: vectorized (shape strokes) | 1159.0 |
| Topology Driven → Stroke Aggregator | 0.005461158145523174 | distance: 0.00546variant: vectorized (shape strokes) 500px | 475.0 |
| Topology Driven | 0.0041019398986395575 | distance: 0.0041variant: vectorized (shape strokes) 1000px | 28.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.15586542448815133 |  distance: 0.15587variant: original | 564.0 |
| Mastering Sketching | 0.4482642855063572 |  distance: 0.44826variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.3300326876063397 | distance: 0.33003variant: vectorized (all layers) 500px | 252.0 |
| Poly Vector | 0.3408819652932187 |  distance: 0.34088variant: vectorized (all layers) 500pxalg. parameter: noisy | 847.0 |
| Stroke Aggregator | 0.5637845043176727 | distance: 0.56378variant: vectorized (shape strokes) | 1159.0 |
| Topology Driven → Stroke Aggregator | 0.5141299953646552 | distance: 0.51413variant: vectorized (shape strokes) 500px | 475.0 |
| Topology Driven | 0.39864741295639694 |  distance: 0.39865variant: vectorized (all layers) 500px | 93.0 |
| Fidelity Simplicity | 0.11277810510818476 |  distance: 0.11278variant: thresholded 500pxalg. parameter: 0.6 | 167.0 |
| Real-Time Inking | 0.4402224721403803 |  distance: 0.44022variant: vectorized (all layers) 500px | 2.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2687116238761077 | distance: 0.26871variant: original | 564.0 |
| Mastering Sketching | 0.5798750168796989 | distance: 0.57988variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4495249245222045 | distance: 0.44952variant: vectorized (all layers) 500px | 252.0 |
| Poly Vector | 0.4570166188198359 |  distance: 0.45702variant: vectorized (all layers) 500px | 794.0 |
| Stroke Aggregator | 0.7296094423719327 | distance: 0.72961variant: vectorized (shape strokes) | 1159.0 |
| Topology Driven → Stroke Aggregator | 0.6791299188993436 | distance: 0.67913variant: vectorized (shape strokes) 500px | 475.0 |
| Topology Driven | 0.5239049435645795 | distance: 0.5239variant: vectorized (all layers) 500px | 93.0 |
| Fidelity Simplicity | 0.1770011895196881 | distance: 0.177variant: thresholded 500pxalg. parameter: 0.6 | 167.0 |
| Real-Time Inking | 0.5616132078834948 | distance: 0.56161variant: vectorized (all layers) 500px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2549127633703769 | distance: 0.25491variant: thresholded 500pxalg. parameter: 0.6 | 167.0 |
| Mastering Sketching | 0.6701237268191812 | distance: 0.67012variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5622831957159014 | distance: 0.56228variant: vectorized (all layers) 500px | 252.0 |
| Poly Vector | 0.5645215533442799 | distance: 0.56452variant: vectorized (all layers) 500px | 794.0 |
| Stroke Aggregator | 0.7948721532969567 | distance: 0.79487variant: vectorized (shape strokes) | 1159.0 |
| Topology Driven → Stroke Aggregator | 0.7777011947746393 | distance: 0.7777variant: vectorized (shape strokes) 500px | 475.0 |
| Topology Driven | 0.6148435819363721 | distance: 0.61484variant: vectorized (all layers) 500px | 93.0 |
| Delaunay Triangulation | 0.3652640951489962 | distance: 0.36526variant: original | 564.0 |
| Real-Time Inking | 0.6513809845210536 | distance: 0.65138variant: vectorized (all layers) 500px | 2.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.32031967204684403 |  distance: 0.32032variant: thresholded 500pxalg. parameter: 0.25 | 147.0 |
| Mastering Sketching | 0.7259581154616304 | distance: 0.72596variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6351873071575551 | distance: 0.63519variant: vectorized (all layers) 500px | 252.0 |
| Poly Vector | 0.634086780244511 | distance: 0.63409variant: vectorized (all layers) 500px | 794.0 |
| Stroke Aggregator | 0.831472266059578 | distance: 0.83147variant: vectorized (shape strokes) | 1159.0 |
| Topology Driven → Stroke Aggregator | 0.8213159278770243 | distance: 0.82132variant: vectorized (shape strokes) 500px | 475.0 |
| Topology Driven | 0.6698116239021649 | distance: 0.66981variant: vectorized (all layers) 500px | 93.0 |
| Delaunay Triangulation | 0.4400383025208252 | distance: 0.44004variant: original | 564.0 |
| Real-Time Inking | 0.7138217894964228 | distance: 0.71382variant: vectorized (all layers) 500px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.7786243223898491 | distance: 0.77862variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7110943261678211 | distance: 0.71109variant: vectorized (all layers) 500px | 252.0 |
| Poly Vector | 0.7057354686707646 | distance: 0.70574variant: vectorized (all layers) 500px | 794.0 |
| Stroke Aggregator | 0.8586526832537685 | distance: 0.85865variant: vectorized (shape strokes) | 1159.0 |
| Topology Driven → Stroke Aggregator | 0.8603903409474996 | distance: 0.86039variant: vectorized (shape strokes) 500px | 475.0 |
| Topology Driven | 0.7207327307434215 | distance: 0.72073variant: vectorized (all layers) 500px | 93.0 |
| Delaunay Triangulation | 0.4973357905313492 | distance: 0.49734variant: original | 564.0 |
| Fidelity Simplicity | 0.3885831407954602 | distance: 0.38858variant: thresholded 500pxalg. parameter: 0.6 | 167.0 |
| Real-Time Inking | 0.7666419215401249 | distance: 0.76664variant: vectorized (all layers) 500px | 2.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.07488658142089842 |  distance: 0.07489variant: vectorized (shape strokes) 500px | 100.0 |
| Stroke Aggregator | 0.0867416434817844 | distance: 0.08674variant: vectorized (shape strokes) | 1159.0 |
| Topology Driven → Stroke Aggregator | 0.0855102310180664 | distance: 0.08551variant: vectorized (shape strokes) 500px | 475.0 |
| Topology Driven | 0.0855102310180664 | distance: 0.08551variant: vectorized (all layers) 500px | 93.0 |
| Delaunay Triangulation | 0.07547184753417968 |  distance: 0.07547variant: thresholded 1000px | 84.0 |
| Real-Time Inking | 0.07877889739142524 | distance: 0.07878variant: thresholded | 3.0 |
| Fidelity Simplicity | 0.0544058837890625 |  distance: 0.05441variant: vectorized (shape strokes) 500pxalg. parameter: 0.25 | 148.0 |
| Mastering Sketching | 0.2586812744140625 | distance: 0.25868variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.10160708618164062 |  distance: 0.10161variant: vectorized (shape strokes) 500px | 106.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
|
|||||||||||||
| thresholded | |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
|
||||||||
| thresholded 500px |  |
|
 |
|
 |
 |
|
 |
 |
||||||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
|||||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
|
|
|
 |
|
|||
| vectorized (shape strokes) 1000px |  |
 |
|
 |
 |
 |
|
 |
|
|
|||||
| vectorized (shape strokes) 500px | |
 |
 |
 |
|
 |
 |
 |
 |
 |
|
 |
|
||
| vectorized (shape strokes) | |