A Benchmark for Rough Sketch Cleanup
Ind_product_JM_08
Author: Jaguar MENA Author Homepage: https://www.flickr.com/photos/jaguarcarsmena/ Licence: CC-BY-2.0Messiness: 0.26624
Ambiguity (Chamfer): 0.12516
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Real-Time Inking | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00152 |  distance: 0.00157 |  distance: 0.00207 |  distance: 0.00224 |  distance: 0.00264 |  distance: 0.0032 |  distance: 0.00445 |  distance: 0.00464 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.004454132873606395 | distance: 0.00445variant: original | 389.0 |
| Fidelity Simplicity | 0.004638106027957083 | distance: 0.00464variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 124.0 |
| Mastering Sketching | 0.001521391453803114 | distance: 0.00152variant: thresholded 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.0026386989461847604 | distance: 0.00264variant: thresholded 1000pxalg. parameter: noisy | 777.0 |
| Poly Vector | 0.0020710750319087624 | distance: 0.00207variant: thresholded 1000px | 1530.0 |
| Real-Time Inking | 0.002237528470020135 | distance: 0.00224variant: thresholded | 3.0 |
| Topology Driven | 0.0015678521910661718 | distance: 0.00157variant: original | 1175.0 |
| Topology Driven → Stroke Aggregator | 0.003199157055653364 | distance: 0.0032variant: vectorized (shape strokes) 500px | 882.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.2823670136644252 |  distance: 0.28237variant: vectorized (shape strokes) 500px | 5.0 |
| Fidelity Simplicity | 0.2724982614558586 |  distance: 0.2725variant: thresholded 500pxalg. parameter: 0.6 | 126.0 |
| Mastering Sketching | 0.6059334202316942 |  distance: 0.60593variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5132437854620445 |  distance: 0.51324variant: vectorized (all layers) 500pxalg. parameter: noisy | 88.0 |
| Poly Vector | 0.560588116853854 |  distance: 0.56059variant: vectorized (all layers) 500pxalg. parameter: noisy | 468.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.5532474450808306 | distance: 0.55325variant: vectorized (shape strokes) 500px | 882.0 |
| Topology Driven | 0.5380601153611209 |  distance: 0.53806variant: vectorized (all layers) 1000px | 220.0 |
| Real-Time Inking | 0.5843354707728784 |  distance: 0.58434variant: vectorized (all layers) 500px | 2.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4524531940391509 |  distance: 0.45245variant: vectorized (all layers) 500px | 7.0 |
| Fidelity Simplicity | 0.39380505868041854 |  distance: 0.39381variant: thresholded 500pxalg. parameter: 0.5 | 131.0 |
| Mastering Sketching | 0.7466777330203745 | distance: 0.74668variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6680360570890799 |  distance: 0.66804variant: vectorized (shape strokes) 500px | 65.0 |
| Poly Vector | 0.6950794527280296 |  distance: 0.69508variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 168.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.7182669801559857 | distance: 0.71827variant: vectorized (shape strokes) 500px | 882.0 |
| Topology Driven | 0.692486456635928 | distance: 0.69249variant: vectorized (all layers) 1000px | 220.0 |
| Real-Time Inking | 0.7005024521758855 | distance: 0.7005variant: vectorized (all layers) 500px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5826825699854841 | distance: 0.58268variant: vectorized (all layers) 500px | 7.0 |
| Fidelity Simplicity | 0.4952099073136536 | distance: 0.49521variant: thresholded 500pxalg. parameter: 0.5 | 131.0 |
| Mastering Sketching | 0.8230578420180761 | distance: 0.82306variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7345139132950325 | distance: 0.73451variant: vectorized (shape strokes) 500px | 65.0 |
| Poly Vector | 0.7533827553626293 |  distance: 0.75338variant: vectorized (shape strokes) 500px | 151.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8061055633949852 | distance: 0.80611variant: vectorized (shape strokes) 500px | 882.0 |
| Topology Driven | 0.7869578609831231 | distance: 0.78696variant: vectorized (all layers) 1000px | 220.0 |
| Real-Time Inking | 0.7726501928206425 | distance: 0.77265variant: vectorized (all layers) 500px | 2.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6663882219837969 | distance: 0.66639variant: vectorized (all layers) 500px | 7.0 |
| Fidelity Simplicity | 0.5622170391418735 |  distance: 0.56222variant: thresholded 500pxalg. parameter: 0.25 | 91.0 |
| Mastering Sketching | 0.8678737440038309 | distance: 0.86787variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7744616174905804 | distance: 0.77446variant: vectorized (shape strokes) 500px | 65.0 |
| Poly Vector | 0.7924608501029491 | distance: 0.79246variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 168.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8498200991553515 | distance: 0.84982variant: vectorized (shape strokes) 500px | 882.0 |
| Topology Driven | 0.8414391548909316 | distance: 0.84144variant: vectorized (all layers) 1000px | 220.0 |
| Real-Time Inking | 0.8141569347263262 | distance: 0.81416variant: vectorized (all layers) 500px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7331204053652652 | distance: 0.73312variant: vectorized (all layers) 500px | 7.0 |
| Fidelity Simplicity | 0.6410466384124733 |  distance: 0.64105variant: thresholded 500pxalg. parameter: 0.75 | 138.0 |
| Mastering Sketching | 0.9004554639638195 | distance: 0.90046variant: vectorized (all layers) 1000px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8231580056694443 | distance: 0.82316variant: vectorized (shape strokes) 500px | 65.0 |
| Poly Vector | 0.8320723060992608 | distance: 0.83207variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 168.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.880912291896803 | distance: 0.88091variant: vectorized (shape strokes) 500px | 882.0 |
| Topology Driven | 0.8824984078935398 | distance: 0.8825variant: vectorized (all layers) 1000px | 220.0 |
| Real-Time Inking | 0.8508439227237196 | distance: 0.85084variant: vectorized (all layers) 500px | 2.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.21540658569335935 |  distance: 0.21541variant: vectorized (shape strokes) 500px | 5.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.09484724426269532 |  distance: 0.09485variant: vectorized (all layers) 1000pxalg. parameter: 0.6 | 156.0 |
| Delaunay Triangulation | 0.04304267161410018 | distance: 0.04304variant: original | 389.0 |
| Poly Vector → Stroke Aggregator | 0.04229657363891602 | distance: 0.0423variant: thresholded 1000pxalg. parameter: noisy | 777.0 |
| Poly Vector | 0.04 |  distance: 0.04variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 395.0 |
| Real-Time Inking | 0.034 |  distance: 0.034variant: vectorized (shape strokes) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.04079215621948242 | distance: 0.04079variant: vectorized (shape strokes) 500px | 882.0 |
| Topology Driven | 0.038 |  distance: 0.038variant: vectorized (shape strokes) 500px | 12.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
 |
|
|
|||||||
| thresholded | |
 |
 |
 |
 |
 |
 |
 |
|||||||
| thresholded 1000px |  |
|
 |
 |
 |
 |
 |
 |
 |
|
 |
|
|||
| thresholded 500px |  |
 |
 |
|
|
|
|
 |
 |
 |
 |
||||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
|
|
 |
 |
 |
||||
| vectorized (all layers) 500px | |
 |
 |
 |
 |
 |
 |
 |
|
 |
|
|
 |
||
| vectorized (shape strokes) 1000px | |
 |
 |
|
 |
 |
 |
 |
|
 |
 |
||||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
|
|
|
|
 |
|