A Benchmark for Rough Sketch Cleanup
Art_freeform_PB_06
Author: Cartoon Animation by Preston Blair (1994). Mission Viejo, CA: Walter Foster Publishing (aka Preston Blair) Licence: Explicit permissionMessiness: 0.04097
Ambiguity (Chamfer): 0.00329
Shading: Yes
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Poly Vector → Stroke Aggregator | Real-Time Inking | Topology Driven → Stroke Aggregator | Fidelity Simplicity | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00039 |  distance: 0.00042 |  distance: 0.00044 |  distance: 0.00051 |  distance: 0.00076 |  distance: 0.00096 |  distance: 0.00116 |  distance: 0.00169 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Diego Barrionuevo |  | |  |  | |||
| Liliya Larsen |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0016852382626665972 | distance: 0.00169variant: thresholded | 276.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.0011636203754687153 | distance: 0.00116variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 168.0 |
| Mastering Sketching | 0.0003867490574570025 | distance: 0.00039variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0005143046269885554 | distance: 0.00051variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 93.0 |
| Poly Vector | 0.0004374395805864395 | distance: 0.00044variant: vectorized (shape strokes) 1000px | 104.0 |
| Real-Time Inking | 0.0007561700884748606 | distance: 0.00076variant: original | 5.0 |
| Topology Driven → Stroke Aggregator | 0.000961949490416666 | distance: 0.00096variant: thresholded 1000px | 306.0 |
| Topology Driven | 0.0004227435745786056 | distance: 0.00042variant: vectorized (shape strokes) 1000px | 9.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.34627446515623544 |  distance: 0.34627variant: vectorized (all layers) 500px | 1.0 |
| Fidelity Simplicity | 0.6710517251337262 |  distance: 0.67105variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 154.0 |
| Poly Vector | 0.28844761023044313 |  distance: 0.28845variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 44.0 |
| Stroke Aggregator | nan | ||
| Topology Driven | 0.8375475683716508 |  distance: 0.83755variant: vectorized (all layers) 500px | 6.0 |
| Mastering Sketching | 0.8886623717488832 |  distance: 0.88866variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.2852196045223491 |  distance: 0.28522variant: vectorized (all layers) 500px | 17.0 |
| Real-Time Inking | 0.8980903541084863 |  distance: 0.89809variant: vectorized (all layers) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.7827470451135218 |  distance: 0.78275variant: thresholded 500px | 284.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.3454222762617299 |  distance: 0.34542variant: vectorized (shape strokes) 500px | 44.0 |
| Real-Time Inking | 0.9461455557456048 | distance: 0.94615variant: vectorized (all layers) 1000px | 2.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.7986350372060573 |  distance: 0.79864variant: thresholdedalg. parameter: 0.75 | 675.0 |
| Mastering Sketching | 0.9366143674072996 |  distance: 0.93661variant: vectorized (all layers) 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.3486210546295785 | distance: 0.34862variant: vectorized (all layers) 500px | 17.0 |
| Topology Driven | 0.9003504081105779 | distance: 0.90035variant: vectorized (all layers) 500px | 6.0 |
| Delaunay Triangulation | 0.612924170295286 | distance: 0.61292variant: vectorized (all layers) 500px | 1.0 |
| Topology Driven → Stroke Aggregator | 0.8793634362171572 | distance: 0.87936variant: thresholded 500px | 284.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7559602007113426 | distance: 0.75596variant: vectorized (all layers) 500px | 1.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.8304238266775625 |  distance: 0.83042variant: thresholdedalg. parameter: 0.3 | 625.0 |
| Mastering Sketching | 0.9542947301388172 | distance: 0.95429variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4145221720328488 | distance: 0.41452variant: vectorized (all layers) 500px | 17.0 |
| Poly Vector | 0.3978609625668449 | distance: 0.39786variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 44.0 |
| Real-Time Inking | 0.96405331749746 | distance: 0.96405variant: vectorized (all layers) 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9289444033000028 | distance: 0.92894variant: thresholded 500px | 284.0 |
| Topology Driven | 0.940465119145597 | distance: 0.94047variant: vectorized (all layers) 500px | 6.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.8567019660129666 | distance: 0.8567variant: thresholdedalg. parameter: 0.3 | 625.0 |
| Mastering Sketching | 0.9655654605838141 | distance: 0.96557variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.4667263994881737 | distance: 0.46673variant: vectorized (all layers) 500px | 17.0 |
| Poly Vector | 0.4377234803337306 | distance: 0.43772variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 44.0 |
| Topology Driven → Stroke Aggregator | 0.9556389701645608 | distance: 0.95564variant: thresholded 500px | 284.0 |
| Topology Driven | 0.9613817669574068 |  distance: 0.96138variant: thresholded 500px | 14.0 |
| Delaunay Triangulation | 0.8039013173894781 | distance: 0.8039variant: vectorized (all layers) 500px | 1.0 |
| Real-Time Inking | 0.9725572787482052 | distance: 0.97256variant: vectorized (all layers) 1000px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8517071205831744 | distance: 0.85171variant: vectorized (all layers) 500px | 1.0 |
| Stroke Aggregator | nan | ||
| Fidelity Simplicity | 0.873931461348412 |  distance: 0.87393variant: thresholdedalg. parameter: 0.5 | 576.0 |
| Mastering Sketching | 0.9750162372807968 | distance: 0.97502variant: vectorized (all layers) 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.5211854576856364 | distance: 0.52119variant: vectorized (all layers) 500px | 17.0 |
| Poly Vector | 0.4886134332660709 | distance: 0.48861variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 44.0 |
| Topology Driven → Stroke Aggregator | 0.973949786204633 | distance: 0.97395variant: thresholded 500px | 284.0 |
| Topology Driven | 0.9767086559920914 | distance: 0.97671variant: thresholded 500px | 14.0 |
| Real-Time Inking | 0.9805297533881714 | distance: 0.98053variant: vectorized (all layers) 1000px | 2.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Real-Time Inking | 0.016970561981201168 |  distance: 0.01697variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | 0.01835755920410156 | distance: 0.01836variant: thresholded 1000px | 306.0 |
| Delaunay Triangulation | 0.045453273773193366 |  distance: 0.04545variant: vectorized (shape strokes) 1000px | 3.0 |
| Fidelity Simplicity | 0.049517673492431635 |  distance: 0.04952variant: vectorized (shape strokes) 500pxalg. parameter: 0.5 | 129.0 |
| Poly Vector → Stroke Aggregator | 0.01345362377166748 | distance: 0.01345variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 93.0 |
| Poly Vector | 0.013341664314270021 |  distance: 0.01334variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 113.0 |
| Topology Driven | 0.013152946472167968 | distance: 0.01315variant: vectorized (shape strokes) 1000px | 9.0 |
| Mastering Sketching | 0.22077137756347656 |  distance: 0.22077variant: vectorized (shape strokes) 500px | 5.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
 |
||||||||
| thresholded |  |
|
 |
|
|
 |
|
||||||||
| thresholded 1000px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||
| thresholded 500px | |
|
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
|||
| vectorized (all layers) 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 500px |  |
|
 |
 |
 |
|
 |
|
 |
 |
|
|
|||
| vectorized (shape strokes) 1000px |  |
|
 |
|
 |
 |
 |
|
|
|
|
|
 |
||
| vectorized (shape strokes) 500px |  |
|
 |
 |
|
 |
 |
 |
|
|
 |