A Benchmark for Rough Sketch Cleanup
Art_freeform_DR_05
Author: David Revoy Author Homepage: https://www.davidrevoy.com/ Licence: CC-BY-4.0Messiness: 0.30132
Ambiguity (Chamfer): 0.15078
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Real-Time Inking | Poly Vector | Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | Poly Vector → Stroke Aggregator | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00148 |  distance: 0.0016 |  distance: 0.00161 |  distance: 0.00161 |  distance: 0.00168 |  distance: 0.00176 |  distance: 0.00464 |  distance: 0.0053 |  distance: 0.00685 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.006846342611187974 | distance: 0.00685variant: vectorized (all layers) 500px | 344.0 |
| Delaunay Triangulation | 0.004641572377841068 | distance: 0.00464variant: vectorized (shape strokes) 1000px | 11.0 |
| Fidelity Simplicity | 0.005302158349558738 | distance: 0.0053variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 154.0 |
| Mastering Sketching | 0.0014845611999964685 | distance: 0.00148variant: vectorized (shape strokes) 1000px | 8.0 |
| Poly Vector | 0.0016098370563867425 | distance: 0.00161variant: vectorized (shape strokes) 1000px | 394.0 |
| Real-Time Inking | 0.0016083319602450108 | distance: 0.00161variant: vectorized (shape strokes) 1000px | 3.0 |
| Stroke Aggregator | 0.0016793890739752464 | distance: 0.00168variant: vectorized (shape strokes) | 950.0 |
| Topology Driven → Stroke Aggregator | 0.0017603247972219965 | distance: 0.00176variant: vectorized (shape strokes) 1000px | 1566.0 |
| Topology Driven | 0.0015992007484756964 | distance: 0.0016variant: vectorized (shape strokes) 1000px | 22.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.29999109319351697 |  distance: 0.29999variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 75.0 |
| Delaunay Triangulation | 0.2466571251941519 |  distance: 0.24666variant: vectorized (all layers) 500px | 10.0 |
| Fidelity Simplicity | 0.018511922644507284 |  distance: 0.01851variant: originalalg. parameter: 0.75 | 276.0 |
| Mastering Sketching | 0.5463162117204593 |  distance: 0.54632variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.6252248840725799 |  distance: 0.62522variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.7171128762467249 | distance: 0.71711variant: vectorized (shape strokes) | 950.0 |
| Topology Driven → Stroke Aggregator | 0.7104538498272178 |  distance: 0.71045variant: thresholded 1000px | 1411.0 |
| Topology Driven | 0.467419459197539 |  distance: 0.46742variant: vectorized (all layers) 1000px | 502.0 |
| Poly Vector → Stroke Aggregator | 0.3481369659230225 | distance: 0.34814variant: vectorized (all layers) 500px | 344.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.3877649320137056 |  distance: 0.38776variant: vectorized (shape strokes) 500px | 83.0 |
| Delaunay Triangulation | 0.3803801820706232 | distance: 0.38038variant: vectorized (all layers) 500px | 10.0 |
| Fidelity Simplicity | 0.03560272615279946 | distance: 0.0356variant: originalalg. parameter: 0.75 | 276.0 |
| Mastering Sketching | 0.6490371116237412 |  distance: 0.64904variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.4767086477366795 | distance: 0.47671variant: vectorized (all layers) 500px | 344.0 |
| Real-Time Inking | 0.7129476628814706 | distance: 0.71295variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8044681127426586 | distance: 0.80447variant: vectorized (shape strokes) | 950.0 |
| Topology Driven → Stroke Aggregator | 0.8201492018419508 | distance: 0.82015variant: thresholded 1000px | 1411.0 |
| Topology Driven | 0.5884794513664158 | distance: 0.58848variant: vectorized (all layers) 1000px | 502.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.4782494389020042 | distance: 0.47825variant: vectorized (shape strokes) 500px | 83.0 |
| Delaunay Triangulation | 0.5007939946542466 | distance: 0.50079variant: vectorized (all layers) 500px | 10.0 |
| Fidelity Simplicity | 0.0505472403907864 | distance: 0.05055variant: originalalg. parameter: 0.75 | 276.0 |
| Mastering Sketching | 0.7118883193503676 | distance: 0.71189variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5774265193211944 | distance: 0.57743variant: vectorized (all layers) 500px | 344.0 |
| Real-Time Inking | 0.7672224006017431 | distance: 0.76722variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8469702055481351 | distance: 0.84697variant: vectorized (shape strokes) | 950.0 |
| Topology Driven → Stroke Aggregator | 0.8594602255363928 | distance: 0.85946variant: vectorized (shape strokes) 1000px | 1566.0 |
| Topology Driven | 0.6676361035020447 | distance: 0.66764variant: vectorized (all layers) 1000px | 502.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.5561856558405195 | distance: 0.55619variant: vectorized (shape strokes) 500px | 83.0 |
| Delaunay Triangulation | 0.586903601007977 | distance: 0.5869variant: vectorized (all layers) 500px | 10.0 |
| Fidelity Simplicity | 0.06478540563947302 |  distance: 0.06479variant: originalalg. parameter: 0.3 | 225.0 |
| Mastering Sketching | 0.7489384547510203 | distance: 0.74894variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6460378758114728 | distance: 0.64604variant: vectorized (all layers) 500px | 344.0 |
| Real-Time Inking | 0.8002146310838297 | distance: 0.80021variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8742612424943426 | distance: 0.87426variant: vectorized (shape strokes) | 950.0 |
| Topology Driven → Stroke Aggregator | 0.8812052395152481 | distance: 0.88121variant: vectorized (shape strokes) 1000px | 1566.0 |
| Topology Driven | 0.7219650174670906 | distance: 0.72197variant: vectorized (all layers) 1000px | 502.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.6343221104792768 | distance: 0.63432variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 75.0 |
| Delaunay Triangulation | 0.6768112350765983 | distance: 0.67681variant: vectorized (all layers) 500px | 10.0 |
| Fidelity Simplicity | 0.07879063742798574 | distance: 0.07879variant: originalalg. parameter: 0.75 | 276.0 |
| Mastering Sketching | 0.7881164036151975 | distance: 0.78812variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7085176536793681 | distance: 0.70852variant: vectorized (all layers) 500px | 344.0 |
| Real-Time Inking | 0.8328897018207344 | distance: 0.83289variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8935874324913686 | distance: 0.89359variant: vectorized (shape strokes) | 950.0 |
| Topology Driven → Stroke Aggregator | 0.8982636252907372 | distance: 0.89826variant: vectorized (shape strokes) 1000px | 1566.0 |
| Topology Driven | 0.7689226559543563 | distance: 0.76892variant: vectorized (all layers) 1000px | 502.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.10196568298339843 | distance: 0.10197variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 154.0 |
| Real-Time Inking | 0.04079215621948242 | distance: 0.04079variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven | 0.04079215621948242 | distance: 0.04079variant: vectorized (all layers) 1000px | 502.0 |
| Delaunay Triangulation | 0.056850681304931636 |  distance: 0.05685variant: vectorized (shape strokes) 500px | 3.0 |
| Mastering Sketching | 0.3464851989746094 |  distance: 0.34649variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.10890362548828124 | distance: 0.1089variant: vectorized (all layers) 500px | 344.0 |
| Poly Vector | 0.05178802871704102 | distance: 0.05179variant: vectorized (shape strokes) 1000px | 394.0 |
| Stroke Aggregator | 0.0512842089674711 | distance: 0.05128variant: vectorized (shape strokes) | 950.0 |
| Topology Driven → Stroke Aggregator | 0.04767599105834961 | distance: 0.04768variant: thresholded 1000px | 1411.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
|
 |
 |
|
 |
 |
 |
|||||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
 |
||||||
| thresholded 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| thresholded 500px |  |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
|
 |
||||||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
|
|
|||
| vectorized (shape strokes) 1000px | |
|
|
 |
|
 |
 |
 |
|
 |
|
|
|||
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
 |
|
|
|
||||
| vectorized (shape strokes) | |