A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_14
Author: Enrique Rosales Licence: Academic PaperMessiness: 0.13819
Ambiguity (Chamfer): 0.11862
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Stroke Aggregator | Poly Vector → Stroke Aggregator | Real-Time Inking | Poly Vector | Topology Driven | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.0012 |  distance: 0.00138 |  distance: 0.00145 |  distance: 0.00149 |  distance: 0.00156 |  distance: 0.00156 |  distance: 0.00168 |  distance: 0.00277 |  distance: 0.06733 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0027689687547942906 | distance: 0.00277variant: original | 6.0 |
| Fidelity Simplicity | 0.06733246546590288 | distance: 0.06733variant: originalalg. parameter: 0.25 | 1731.0 |
| Mastering Sketching | 0.0012021739689661035 | distance: 0.0012variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.001453058200988244 | distance: 0.00145variant: original 1000pxalg. parameter: noisy | 156.0 |
| Poly Vector | 0.0015553687922967335 | distance: 0.00156variant: original 1000px | 145.0 |
| Real-Time Inking | 0.0014928964991340007 | distance: 0.00149variant: original | 3.0 |
| Stroke Aggregator | 0.0013763055014031785 | distance: 0.00138variant: vectorized (all layers) | 343.0 |
| Topology Driven → Stroke Aggregator | 0.0016759379377106545 | distance: 0.00168variant: original 1000px | 661.0 |
| Topology Driven | 0.0015624283278600733 | distance: 0.00156variant: original 1000px | 19.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.1753777531333328 |  distance: 0.17538variant: original 500pxalg. parameter: 0.6 | 105.0 |
| Poly Vector → Stroke Aggregator | 0.6401171927022236 |  distance: 0.64012variant: original | 244.0 |
| Poly Vector | 0.5956817713902411 |  distance: 0.59568variant: original 500pxalg. parameter: noisy | 50.0 |
| Real-Time Inking | 0.6529506081790976 |  distance: 0.65295variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.6626618169359618 | distance: 0.66266variant: vectorized (all layers) | 343.0 |
| Topology Driven → Stroke Aggregator | 0.6638776429001836 | distance: 0.66388variant: original 1000px | 661.0 |
| Topology Driven | 0.6574107640040691 |  distance: 0.65741variant: original | 19.0 |
| Delaunay Triangulation | 0.3912026642655205 |  distance: 0.3912variant: original 500px | 1.0 |
| Mastering Sketching | 0.7518958164154631 | distance: 0.7519variant: original 500px | 5.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2385950142887209 | distance: 0.2386variant: original 500pxalg. parameter: 0.6 | 105.0 |
| Topology Driven | 0.8491337195700938 |  distance: 0.84913variant: original 500px | 6.0 |
| Delaunay Triangulation | 0.6405965239599785 | distance: 0.6406variant: original 500px | 1.0 |
| Mastering Sketching | 0.8958748086757684 | distance: 0.89587variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8514780622624532 |  distance: 0.85148variant: originalalg. parameter: noisy | 241.0 |
| Poly Vector | 0.7457687098745718 |  distance: 0.74577variant: original 500px | 49.0 |
| Real-Time Inking | 0.8522485115556895 | distance: 0.85225variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.8715719987631461 | distance: 0.87157variant: vectorized (all layers) | 343.0 |
| Topology Driven → Stroke Aggregator | 0.856943295807019 | distance: 0.85694variant: original 1000px | 661.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2848718280307144 |  distance: 0.28487variant: original 500pxalg. parameter: 0.25 | 122.0 |
| Poly Vector → Stroke Aggregator | 0.9446030522930052 |  distance: 0.9446variant: original 1000px | 155.0 |
| Topology Driven → Stroke Aggregator | 0.9408297188906249 | distance: 0.94083variant: original 1000px | 661.0 |
| Topology Driven | 0.9303160970804716 | distance: 0.93032variant: original 500px | 6.0 |
| Delaunay Triangulation | 0.8137354659827148 | distance: 0.81374variant: original 500px | 1.0 |
| Mastering Sketching | 0.9596240924620634 | distance: 0.95962variant: original 500px | 5.0 |
| Poly Vector | 0.8022526066976213 | distance: 0.80225variant: original 500px | 49.0 |
| Real-Time Inking | 0.9280766969464832 |  distance: 0.92808variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9474188906984145 | distance: 0.94742variant: vectorized (all layers) | 343.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9827669012363742 | distance: 0.98277variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9676260572645768 | distance: 0.96763variant: original 1000px | 155.0 |
| Poly Vector | 0.8388131102123665 | distance: 0.83881variant: original 500px | 49.0 |
| Stroke Aggregator | 0.9712959107743222 | distance: 0.9713variant: vectorized (all layers) | 343.0 |
| Topology Driven → Stroke Aggregator | 0.966039987835146 | distance: 0.96604variant: original 1000px | 661.0 |
| Topology Driven | 0.9592491591198488 | distance: 0.95925variant: original 500px | 6.0 |
| Delaunay Triangulation | 0.8841932951016713 | distance: 0.88419variant: original 500px | 1.0 |
| Real-Time Inking | 0.9622764983087588 | distance: 0.96228variant: original | 3.0 |
| Fidelity Simplicity | 0.2978027964408934 |  distance: 0.2978variant: original 500pxalg. parameter: 0.75 | 105.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9867889009858278 | distance: 0.98679variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.978932971901163 | distance: 0.97893variant: originalalg. parameter: noisy | 241.0 |
| Poly Vector | 0.8633552328251985 | distance: 0.86336variant: original 500pxalg. parameter: noisy | 50.0 |
| Real-Time Inking | 0.9774983622800352 | distance: 0.9775variant: original | 3.0 |
| Stroke Aggregator | 0.9801073067599844 | distance: 0.98011variant: vectorized (all layers) | 343.0 |
| Topology Driven → Stroke Aggregator | 0.9767094859154424 | distance: 0.97671variant: original 1000px | 661.0 |
| Topology Driven | 0.9760435973245964 | distance: 0.97604variant: original 500px | 6.0 |
| Delaunay Triangulation | 0.9381125396357448 | distance: 0.93811variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.3077485380116959 | distance: 0.30775variant: original 500pxalg. parameter: 0.25 | 122.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.057982757568359376 |  distance: 0.05798variant: original 1000px | 6.0 |
| Fidelity Simplicity | 0.4957731857515935 | distance: 0.49577variant: originalalg. parameter: 0.25 | 1731.0 |
| Real-Time Inking | 0.023021728515625 | distance: 0.02302variant: original 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.01802775573730469 | distance: 0.01803variant: original 1000px | 661.0 |
| Mastering Sketching | 0.10607544708251954 | distance: 0.10608variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.016552946090698243 | distance: 0.01655variant: original 1000pxalg. parameter: noisy | 156.0 |
| Poly Vector | 0.01736050714739546 |  distance: 0.01736variant: originalalg. parameter: noisy | 160.0 |
| Stroke Aggregator | 0.017741542812559942 | distance: 0.01774variant: vectorized (all layers) | 343.0 |
| Topology Driven | 0.01823721211174955 | distance: 0.01824variant: original | 19.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
|
|
 |
|
|
|
|||||||
| original 1000px | |
|
|
 |
|
|
|
|
|||||||
| original 500px | |
|
 |
|
 |
|
|
|
|
|
|
||||
| vectorized (all layers) | |