A Benchmark for Rough Sketch Cleanup
Ind_product_GW_02
Author: Graham Wilson Licence: CC-BY-4.0Messiness: 0.0515
Ambiguity (Chamfer): 0.12587
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Topology Driven | Poly Vector | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00131 |  distance: 0.00137 |  distance: 0.00142 |  distance: 0.00143 |  distance: 0.00146 |  distance: 0.00152 |  distance: 0.00253 |  distance: 0.00254 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.0025346003080778004 | distance: 0.00253variant: thresholded 1000px | 26.0 |
| Fidelity Simplicity | 0.0025379634930687424 | distance: 0.00254variant: vectorized (all layers) 1000pxalg. parameter: 0.6 | 200.0 |
| Mastering Sketching | 0.0013138791643492913 | distance: 0.00131variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0014551474287228525 | distance: 0.00146variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 92.0 |
| Poly Vector | 0.0014268769750000454 | distance: 0.00143variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 103.0 |
| Real-Time Inking | 0.0013730748143209307 | distance: 0.00137variant: vectorized (shape strokes) 1000px | 4.0 |
| Topology Driven → Stroke Aggregator | 0.0015214517847008345 | distance: 0.00152variant: vectorized (shape strokes) 1000px | 233.0 |
| Topology Driven | 0.001418096996477277 | distance: 0.00142variant: vectorized (shape strokes) 1000px | 8.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4596686542055538 |  distance: 0.45967variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.3880062303936754 |  distance: 0.38801variant: thresholded 500pxalg. parameter: 0.75 | 202.0 |
| Mastering Sketching | 0.6454996221490265 |  distance: 0.6455variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.20862186074821595 |  distance: 0.20862variant: vectorized (all layers) 500px | 10.0 |
| Poly Vector | 0.1986735267320789 |  distance: 0.19867variant: vectorized (shape strokes) 500px | 64.0 |
| Real-Time Inking | 0.5906675245889232 |  distance: 0.59067variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.4659019576405231 |  distance: 0.4659variant: vectorized (shape strokes) 500px | 59.0 |
| Topology Driven | 0.5607535508590394 |  distance: 0.56075variant: vectorized (all layers) 500px | 3.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5596598759165914 | distance: 0.55966variant: thresholded 500pxalg. parameter: 0.75 | 202.0 |
| Mastering Sketching | 0.7988648138531981 | distance: 0.79886variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.272276702664752 | distance: 0.27228variant: vectorized (all layers) 500px | 10.0 |
| Poly Vector | 0.25782729132984883 | distance: 0.25783variant: vectorized (shape strokes) 500px | 64.0 |
| Real-Time Inking | 0.7708971738230116 |  distance: 0.7709variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.6790181117851725 | distance: 0.67902variant: vectorized (shape strokes) 500px | 59.0 |
| Topology Driven | 0.7480365845108393 | distance: 0.74804variant: vectorized (all layers) 500px | 3.0 |
| Delaunay Triangulation | 0.6428145251004502 | distance: 0.64281variant: vectorized (shape strokes) 500px | 1.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7511470171045331 | distance: 0.75115variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.6379269599586112 |  distance: 0.63793variant: originalalg. parameter: 0.5 | 658.0 |
| Mastering Sketching | 0.8750073032118431 | distance: 0.87501variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.32608167212883005 |  distance: 0.32608variant: vectorized (all layers) 500pxalg. parameter: noisy | 10.0 |
| Poly Vector | 0.31245754370173723 |  distance: 0.31246variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 67.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8137650807120991 | distance: 0.81377variant: vectorized (shape strokes) 500px | 59.0 |
| Topology Driven | 0.8429661367081628 | distance: 0.84297variant: vectorized (all layers) 500px | 3.0 |
| Real-Time Inking | 0.8504718097970605 |  distance: 0.85047variant: original | 4.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6622890057046196 | distance: 0.66229variant: originalalg. parameter: 0.5 | 658.0 |
| Mastering Sketching | 0.9044284761080948 | distance: 0.90443variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.36568838960462735 | distance: 0.36569variant: vectorized (all layers) 500pxalg. parameter: noisy | 10.0 |
| Poly Vector | 0.35072883435582825 | distance: 0.35073variant: vectorized (shape strokes) 500px | 64.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.8780590658369041 | distance: 0.87806variant: vectorized (shape strokes) 500px | 59.0 |
| Topology Driven | 0.8857244840546386 | distance: 0.88572variant: vectorized (all layers) 500px | 3.0 |
| Delaunay Triangulation | 0.793612692381621 | distance: 0.79361variant: vectorized (shape strokes) 500px | 1.0 |
| Real-Time Inking | 0.8737736565353852 | distance: 0.87377variant: original | 4.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8292709391687579 | distance: 0.82927variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.6751599768843144 | distance: 0.67516variant: originalalg. parameter: 0.5 | 658.0 |
| Mastering Sketching | 0.9297672493092096 | distance: 0.92977variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4094331463069514 | distance: 0.40943variant: vectorized (all layers) 500px | 10.0 |
| Poly Vector | 0.392826019734068 | distance: 0.39283variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 67.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.918695216868226 | distance: 0.9187variant: vectorized (shape strokes) 500px | 59.0 |
| Topology Driven | 0.9150919966522582 | distance: 0.91509variant: vectorized (all layers) 500px | 3.0 |
| Real-Time Inking | 0.8925945724268667 | distance: 0.89259variant: original | 4.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.26569906616210937 | distance: 0.2657variant: vectorized (all layers) 500px | 6.0 |
| Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.05544366455078125 | distance: 0.05544variant: thresholded 1000px | 26.0 |
| Fidelity Simplicity | 0.057280014038085934 |  distance: 0.05728variant: vectorized (all layers) 1000pxalg. parameter: 0.25 | 153.0 |
| Poly Vector → Stroke Aggregator | 0.03360059356689453 | distance: 0.0336variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 92.0 |
| Poly Vector | 0.03360059356689453 | distance: 0.0336variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 103.0 |
| Real-Time Inking | 0.035805027008056635 | distance: 0.03581variant: vectorized (shape strokes) 1000px | 4.0 |
| Topology Driven → Stroke Aggregator | 0.032802440643310546 | distance: 0.0328variant: vectorized (shape strokes) 500px | 59.0 |
| Topology Driven | 0.032802440643310546 |  distance: 0.0328variant: vectorized (shape strokes) 500px | 3.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
|||||||||||
| thresholded |  |
 |
 |
 |
 |
 |
|||||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
|
|||||
| thresholded 500px |  |
 |
 |
 |
 |
 |
|
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 1000px | |
 |
|
 |
 |
|
 |
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
|
 |
 |
 |
|
|
||
| vectorized (shape strokes) 1000px | |
|
 |
 |
 |
 |
|
|
 |
 |
|
 |
|||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
|
|
|
|