A Benchmark for Rough Sketch Cleanup
Art_freeform_LTV_01
Author: Lunatics TV Author Homepage: https://www.flickr.com/photos/lunatics_tv/ Licence: CC-BY-SA 2.0Messiness: 0.21747
Ambiguity (Chamfer): 0.0323
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Paper
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Poly Vector | Topology Driven | Stroke Aggregator | Poly Vector → Stroke Aggregator | Mastering Sketching | Fidelity Simplicity | Topology Driven → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00117 |  distance: 0.00121 |  distance: 0.00121 |  distance: 0.00126 |  distance: 0.00136 |  distance: 0.00137 |  distance: 0.00188 |  distance: 0.00223 |  distance: 0.00255 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.0013693377880345785 | distance: 0.00137variant: vectorized (shape strokes) 500px | 6.0 |
| Real-Time Inking | 0.001174126698756152 | distance: 0.00117variant: original | 3.0 |
| Stroke Aggregator | 0.001262436684685671 | distance: 0.00126variant: vectorized (shape strokes) | 363.0 |
| Delaunay Triangulation | 0.0025534004588139946 | distance: 0.00255variant: vectorized (shape strokes) 1000px | 4.0 |
| Fidelity Simplicity | 0.0018810587962831914 | distance: 0.00188variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 159.0 |
| Poly Vector → Stroke Aggregator | 0.0013606065612495053 | distance: 0.00136variant: vectorized (shape strokes) 1000px | 214.0 |
| Poly Vector | 0.001209053730057076 | distance: 0.00121variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 531.0 |
| Topology Driven → Stroke Aggregator | 0.0022254624389203485 | distance: 0.00223variant: vectorized (shape strokes) 500px | 128.0 |
| Topology Driven | 0.001209433630741941 | distance: 0.00121variant: vectorized (shape strokes) 1000px | 17.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.4388553112537357 |  distance: 0.43886variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 190.0 |
| Poly Vector → Stroke Aggregator | 0.7194978510093086 |  distance: 0.7195variant: thresholded 500px | 69.0 |
| Poly Vector | 0.5391781263321126 |  distance: 0.53918variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 174.0 |
| Stroke Aggregator | 0.8509168686573849 | distance: 0.85092variant: vectorized (shape strokes) | 363.0 |
| Delaunay Triangulation | 0.3754213021038347 |  distance: 0.37542variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.7040960635641526 |  distance: 0.7041variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.7064376667825298 |  distance: 0.70644variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.5769099049578962 |  distance: 0.57691variant: vectorized (all layers) 500px | 221.0 |
| Topology Driven | 0.6681288673500092 |  distance: 0.66813variant: vectorized (all layers) 1000px | 182.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6063518719203693 |  distance: 0.60635variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 142.0 |
| Poly Vector | 0.6345576923911832 |  distance: 0.63456variant: vectorized (shape strokes) 500px | 85.0 |
| Delaunay Triangulation | 0.5728456506548845 | distance: 0.57285variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.8208474699541218 | distance: 0.82085variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8225508672084021 |  distance: 0.82255variant: thresholded 500pxalg. parameter: noisy | 69.0 |
| Real-Time Inking | 0.8193647066214655 | distance: 0.81936variant: vectorized (all layers) 500px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.7217005709604419 | distance: 0.7217variant: vectorized (all layers) 500px | 221.0 |
| Topology Driven | 0.7777752746990948 | distance: 0.77778variant: vectorized (all layers) 1000px | 182.0 |
| Stroke Aggregator | 0.9379587943311452 | distance: 0.93796variant: vectorized (shape strokes) | 363.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7036129645229866 | distance: 0.70361variant: vectorized (all layers) 500px | 2.0 |
| Poly Vector | 0.7034093762804162 | distance: 0.70341variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 174.0 |
| Poly Vector → Stroke Aggregator | 0.8878980761563624 | distance: 0.8879variant: thresholded 500px | 69.0 |
| Real-Time Inking | 0.8846776493786711 | distance: 0.88468variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | 0.96228575568671 | distance: 0.96229variant: vectorized (shape strokes) | 363.0 |
| Topology Driven → Stroke Aggregator | 0.8205821711439909 | distance: 0.82058variant: vectorized (all layers) 500px | 221.0 |
| Topology Driven | 0.8457406743455737 | distance: 0.84574variant: vectorized (all layers) 1000px | 182.0 |
| Fidelity Simplicity | 0.7087551908177543 | distance: 0.70876variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 142.0 |
| Mastering Sketching | 0.8778095772174959 | distance: 0.87781variant: vectorized (all layers) 500px | 5.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7641136333792421 | distance: 0.76411variant: vectorized (all layers) 500px | 2.0 |
| Mastering Sketching | 0.9072714544386632 | distance: 0.90727variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9246374118303696 | distance: 0.92464variant: thresholded 500pxalg. parameter: noisy | 69.0 |
| Poly Vector | 0.7489673009238169 | distance: 0.74897variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 174.0 |
| Stroke Aggregator | 0.9749538771174596 | distance: 0.97495variant: vectorized (shape strokes) | 363.0 |
| Topology Driven → Stroke Aggregator | 0.8675707084741869 | distance: 0.86757variant: vectorized (all layers) 500px | 221.0 |
| Topology Driven | 0.8874901191309106 | distance: 0.88749variant: vectorized (all layers) 1000px | 182.0 |
| Fidelity Simplicity | 0.7701423441034788 | distance: 0.77014variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 142.0 |
| Real-Time Inking | 0.9079685792405784 | distance: 0.90797variant: vectorized (all layers) 500px | 3.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.9491777021103536 | distance: 0.94918variant: thresholded 500pxalg. parameter: noisy | 69.0 |
| Mastering Sketching | 0.9301124579342278 | distance: 0.93011variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.7932137607106292 | distance: 0.79321variant: vectorized (shape strokes) 500px | 85.0 |
| Stroke Aggregator | 0.9808793285531656 | distance: 0.98088variant: vectorized (shape strokes) | 363.0 |
| Topology Driven → Stroke Aggregator | 0.9088584869872124 | distance: 0.90886variant: vectorized (all layers) 500px | 221.0 |
| Topology Driven | 0.917670760017222 | distance: 0.91767variant: vectorized (all layers) 1000px | 182.0 |
| Delaunay Triangulation | 0.8142245186474684 | distance: 0.81422variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.8160539403467786 | distance: 0.81605variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 190.0 |
| Real-Time Inking | 0.925402099611194 | distance: 0.9254variant: vectorized (all layers) 500px | 3.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.3233635864257812 | distance: 0.32336variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector | 0.026832815170288085 |  distance: 0.02683variant: thresholded 500pxalg. parameter: noisy | 311.0 |
| Delaunay Triangulation | 0.05458937454223633 |  distance: 0.05459variant: vectorized (shape strokes) 500px | 1.0 |
| Fidelity Simplicity | 0.04205948257446289 |  distance: 0.04206variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 189.0 |
| Poly Vector → Stroke Aggregator | 0.034928497314453126 | distance: 0.03493variant: thresholded 500pxalg. parameter: noisy | 69.0 |
| Real-Time Inking | 0.05803447341918945 |  distance: 0.05803variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | 0.058114399503298525 | distance: 0.05811variant: vectorized (shape strokes) | 363.0 |
| Topology Driven → Stroke Aggregator | 0.053366657257080084 |  distance: 0.05337variant: thresholded 500px | 714.0 |
| Topology Driven | 0.053366657257080084 |  distance: 0.05337variant: thresholded 500px | 28.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| thresholded |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||||
| thresholded 500px | |
 |
 |
 |
 |
 |
 |
 |
|
|
 |
 |
|
|
|
| vectorized (all layers) 1000px | |
 |
 |
 |
 |
 |
|
 |
 |
 |
|||||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
|
|
 |
 |
 |
|
|||
| vectorized (shape strokes) 1000px |  |
 |
|
 |
 |
|
|
|
 |
|
 |
|
|||
| vectorized (shape strokes) 500px | |
 |
|
 |
 |
 |
 |
 |
 |
|
|
|
|||
| vectorized (shape strokes) | |