A Benchmark for Rough Sketch Cleanup
Ind_product_PM_14
Author: Patrick Murphy Author Homepage: https://www.flickr.com/photos/pmurf/ Licence: CC-BY-2.0Messiness: 0.2141
Ambiguity (Chamfer): 0.02094
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Poly Vector | Poly Vector → Stroke Aggregator | Mastering Sketching | Real-Time Inking | Stroke Aggregator | Delaunay Triangulation | Topology Driven | Topology Driven → Stroke Aggregator | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00117 |  distance: 0.00118 |  distance: 0.00119 |  distance: 0.00124 |  distance: 0.00131 |  distance: 0.00136 |  distance: 0.00174 |  distance: 0.00184 |  distance: 0.00245 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.001190501450185458 | distance: 0.00119variant: vectorized (shape strokes) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.0011824375296037976 | distance: 0.00118variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 63.0 |
| Poly Vector | 0.001169496586649751 | distance: 0.00117variant: vectorized (shape strokes) 1000px | 126.0 |
| Real-Time Inking | 0.0012370305897046398 | distance: 0.00124variant: thresholded | 2.0 |
| Stroke Aggregator | 0.0013084071935950633 | distance: 0.00131variant: vectorized (shape strokes) | 57.0 |
| Topology Driven → Stroke Aggregator | 0.00183757144178082 | distance: 0.00184variant: vectorized (shape strokes) 1000px | 145.0 |
| Delaunay Triangulation | 0.0013612071178066706 | distance: 0.00136variant: vectorized (shape strokes) 1000px | 2.0 |
| Fidelity Simplicity | 0.002446916543518284 | distance: 0.00245variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 155.0 |
| Topology Driven | 0.0017419887842198749 | distance: 0.00174variant: vectorized (shape strokes) 1000px | 7.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2795421979215054 |  distance: 0.27954variant: thresholdedalg. parameter: 0.75 | 205.0 |
| Mastering Sketching | 0.6233486812158672 |  distance: 0.62335variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.6187942165116523 |  distance: 0.61879variant: thresholded 1000pxalg. parameter: noisy | 157.0 |
| Poly Vector | 0.30346874382752004 |  distance: 0.30347variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Real-Time Inking | 0.7240044197890148 |  distance: 0.724variant: vectorized (all layers) 1000px | 3.0 |
| Stroke Aggregator | 0.8811012698453916 | distance: 0.8811variant: vectorized (shape strokes) | 57.0 |
| Topology Driven | 0.5791892958676434 |  distance: 0.57919variant: thresholded | 177.0 |
| Delaunay Triangulation | 0.1866871896755858 |  distance: 0.18669variant: vectorized (all layers) 500px | 1.0 |
| Topology Driven → Stroke Aggregator | 0.5258135838735751 |  distance: 0.52581variant: vectorized (all layers) 500px | 620.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.37121040032151537 |  distance: 0.37121variant: vectorized (shape strokes) 500px | 0.0 |
| Fidelity Simplicity | 0.4210437522868413 |  distance: 0.42104variant: thresholdedalg. parameter: 0.25 | 146.0 |
| Poly Vector | 0.3413674372848008 | distance: 0.34137variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Real-Time Inking | 0.846313278827765 |  distance: 0.84631variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.9515647661064848 | distance: 0.95156variant: vectorized (shape strokes) | 57.0 |
| Mastering Sketching | 0.7771265360413891 | distance: 0.77713variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7894752930665551 |  distance: 0.78948variant: vectorized (all layers) 1000px | 942.0 |
| Topology Driven → Stroke Aggregator | 0.7176921004630773 | distance: 0.71769variant: vectorized (all layers) 500px | 620.0 |
| Topology Driven | 0.7219675960530484 | distance: 0.72197variant: thresholded | 177.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.534264969077584 | distance: 0.53426variant: vectorized (all layers) 500px | 1.0 |
| Poly Vector | 0.3836615609044493 | distance: 0.38366variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Stroke Aggregator | 0.9695749401042816 | distance: 0.96957variant: vectorized (shape strokes) | 57.0 |
| Real-Time Inking | 0.8858380044468928 | distance: 0.88584variant: vectorized (all layers) 500px | 2.0 |
| Fidelity Simplicity | 0.7045645402057721 | distance: 0.70456variant: thresholdedalg. parameter: 0.25 | 146.0 |
| Mastering Sketching | 0.8730407202730187 | distance: 0.87304variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.8924431856138313 |  distance: 0.89244variant: vectorized (all layers) 1000pxalg. parameter: noisy | 943.0 |
| Topology Driven → Stroke Aggregator | 0.821853479188206 |  distance: 0.82185variant: thresholded | 1170.0 |
| Topology Driven | 0.8281959543520993 | distance: 0.8282variant: thresholded | 177.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | 0.9753399881743244 | distance: 0.97534variant: vectorized (shape strokes) | 57.0 |
| Delaunay Triangulation | 0.6303328590134558 | distance: 0.63033variant: vectorized (shape strokes) 500px | 0.0 |
| Poly Vector | 0.4194984766815093 | distance: 0.4195variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Topology Driven → Stroke Aggregator | 0.8646759172795965 | distance: 0.86468variant: thresholded | 1170.0 |
| Topology Driven | 0.8674693492839846 | distance: 0.86747variant: thresholded | 177.0 |
| Fidelity Simplicity | 0.8165487878712009 | distance: 0.81655variant: thresholdedalg. parameter: 0.75 | 205.0 |
| Mastering Sketching | 0.9025180382114971 | distance: 0.90252variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9306279929980232 | distance: 0.93063variant: thresholded 1000pxalg. parameter: noisy | 157.0 |
| Real-Time Inking | 0.9077579810384012 | distance: 0.90776variant: vectorized (all layers) 500px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.6841317227317509 | distance: 0.68413variant: vectorized (shape strokes) 500px | 0.0 |
| Poly Vector | 0.4660821412090448 | distance: 0.46608variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 40.0 |
| Stroke Aggregator | 0.981151651392011 | distance: 0.98115variant: vectorized (shape strokes) | 57.0 |
| Topology Driven → Stroke Aggregator | 0.8961861776613694 | distance: 0.89619variant: thresholded | 1170.0 |
| Topology Driven | 0.8961234624632755 | distance: 0.89612variant: thresholded | 177.0 |
| Fidelity Simplicity | 0.8507459845355558 | distance: 0.85075variant: thresholdedalg. parameter: 0.25 | 146.0 |
| Mastering Sketching | 0.9237505485864229 | distance: 0.92375variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.9418945568901764 | distance: 0.94189variant: vectorized (all layers) 1000pxalg. parameter: noisy | 943.0 |
| Real-Time Inking | 0.93010682060586 | distance: 0.93011variant: vectorized (all layers) 500px | 2.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.030083217620849614 | distance: 0.03008variant: thresholded 1000pxalg. parameter: noisy | 157.0 |
| Poly Vector | 0.02785677719116211 |  distance: 0.02786variant: thresholded 500pxalg. parameter: noisy | 144.0 |
| Real-Time Inking | 0.022259983476236183 | distance: 0.02226variant: thresholded | 2.0 |
| Stroke Aggregator | 0.275436065599213 | distance: 0.27544variant: vectorized (shape strokes) | 57.0 |
| Topology Driven → Stroke Aggregator | 0.03046309280395508 | distance: 0.03046variant: vectorized (all layers) 500px | 620.0 |
| Delaunay Triangulation | 0.03427830690665272 |  distance: 0.03428variant: original | 27.0 |
| Fidelity Simplicity | 0.12180312347412107 |  distance: 0.1218variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 117.0 |
| Mastering Sketching | 0.3771604309082031 |  distance: 0.37716variant: vectorized (all layers) 1000px | 6.0 |
| Topology Driven | 0.03046309280395508 |  distance: 0.03046variant: thresholded 500px | 18.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
 |
 |
 |
|
||||||
| thresholded | |
|
 |
 |
|
|
 |
|
 |
||||||
| thresholded 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
|
|
 |
 |
||||
| vectorized (all layers) 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
|
||
| vectorized (all layers) 500px | |
|
|
 |
 |
 |
 |
|
 |
 |
 |
|
|||
| vectorized (shape strokes) 1000px | |
 |
 |
 |
|
 |
 |
 |
|
 |
|
|
|
 |
|
| vectorized (shape strokes) 500px |  |
 |
|
 |
 |
 |
 |
 |
 |
|
 |
|
|||
| vectorized (shape strokes) | |