A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_03
Author: Enrique Rosales Licence: Academic PaperMessiness: 0.15538
Ambiguity (Chamfer): 0.08327
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Stroke Aggregator | Poly Vector → Stroke Aggregator | Topology Driven | Poly Vector | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00095 |  distance: 0.00115 |  distance: 0.00116 |  distance: 0.00117 |  distance: 0.00123 |  distance: 0.00126 |  distance: 0.00142 |  distance: 0.0023 |  distance: 0.00508 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.002302119619138912 | distance: 0.0023variant: original | 8.0 |
| Mastering Sketching | 0.0009544429017634596 | distance: 0.00095variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0011686544889900282 | distance: 0.00117variant: originalalg. parameter: noisy | 140.0 |
| Poly Vector | 0.0012578108422241305 | distance: 0.00126variant: originalalg. parameter: noisy | 195.0 |
| Stroke Aggregator | 0.0011648594026016528 | distance: 0.00116variant: vectorized (all layers) | 747.0 |
| Fidelity Simplicity | 0.005080439866068662 | distance: 0.00508variant: original 1000pxalg. parameter: 0.25 | 219.0 |
| Real-Time Inking | 0.001151173338847344 | distance: 0.00115variant: original 1000px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.0014156707072344365 | distance: 0.00142variant: original 1000px | 595.0 |
| Topology Driven | 0.0012298279877183491 | distance: 0.00123variant: original | 34.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector | 0.7528322274080955 |  distance: 0.75283variant: original | 170.0 |
| Topology Driven | 0.7539937041194767 | distance: 0.75399variant: original | 34.0 |
| Fidelity Simplicity | 0.41471225746947016 |  distance: 0.41471variant: originalalg. parameter: 0.6 | 282.0 |
| Poly Vector → Stroke Aggregator | 0.734856805087807 |  distance: 0.73486variant: original 500px | 23.0 |
| Real-Time Inking | 0.7737544201197432 |  distance: 0.77375variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.6918112355740189 |  distance: 0.69181variant: original 500px | 86.0 |
| Delaunay Triangulation | 0.44466708811055455 |  distance: 0.44467variant: original 500px | 1.0 |
| Mastering Sketching | 0.8318332878512363 | distance: 0.83183variant: original 1000px | 6.0 |
| Stroke Aggregator | 0.7896492258592437 | distance: 0.78965variant: vectorized (all layers) | 747.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9521062528797444 |  distance: 0.95211variant: original 500px | 5.0 |
| Real-Time Inking | 0.9370323697484078 | distance: 0.93703variant: original | 3.0 |
| Stroke Aggregator | 0.9470159143727436 | distance: 0.94702variant: vectorized (all layers) | 747.0 |
| Topology Driven | 0.9127827449471678 | distance: 0.91278variant: original | 34.0 |
| Fidelity Simplicity | 0.5141923248388601 |  distance: 0.51419variant: originalalg. parameter: 0.25 | 251.0 |
| Poly Vector → Stroke Aggregator | 0.8712691805171315 | distance: 0.87127variant: original 500px | 23.0 |
| Poly Vector | 0.8830381006378196 |  distance: 0.88304variant: original 500pxalg. parameter: noisy | 78.0 |
| Topology Driven → Stroke Aggregator | 0.8763202585088568 | distance: 0.87632variant: original 500px | 86.0 |
| Delaunay Triangulation | 0.6797656981055467 | distance: 0.67977variant: original 500px | 1.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9833207258306708 | distance: 0.98332variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.936912776310812 | distance: 0.93691variant: original 500px | 23.0 |
| Poly Vector | 0.938350264074098 | distance: 0.93835variant: original 500pxalg. parameter: noisy | 78.0 |
| Real-Time Inking | 0.9812757021269116 |  distance: 0.98128variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9833034220936951 | distance: 0.9833variant: vectorized (all layers) | 747.0 |
| Topology Driven → Stroke Aggregator | 0.9590428709250252 | distance: 0.95904variant: original 500px | 86.0 |
| Topology Driven | 0.9783281741109876 |  distance: 0.97833variant: original 500px | 6.0 |
| Fidelity Simplicity | 0.5662703137808471 | distance: 0.56627variant: originalalg. parameter: 0.6 | 282.0 |
| Delaunay Triangulation | 0.834588464605298 | distance: 0.83459variant: original 500px | 1.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8920144465498513 | distance: 0.89201variant: original 500px | 1.0 |
| Mastering Sketching | 0.9909740479641184 | distance: 0.99097variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9562879368904066 | distance: 0.95629variant: original 500px | 23.0 |
| Poly Vector | 0.9570963516453199 | distance: 0.9571variant: original 500pxalg. parameter: noisy | 78.0 |
| Real-Time Inking | 0.9902635978055117 | distance: 0.99026variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9901088962760324 | distance: 0.99011variant: vectorized (all layers) | 747.0 |
| Topology Driven → Stroke Aggregator | 0.9771321949901458 | distance: 0.97713variant: original 500px | 86.0 |
| Topology Driven | 0.98706608395105 | distance: 0.98707variant: original 500px | 6.0 |
| Fidelity Simplicity | 0.5828001448282434 |  distance: 0.5828variant: originalalg. parameter: 0.75 | 302.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.9238852231536708 | distance: 0.92389variant: original 500px | 1.0 |
| Mastering Sketching | 0.9981310645640086 | distance: 0.99813variant: original 1000px | 6.0 |
| Real-Time Inking | 0.9962792681647404 | distance: 0.99628variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9964805217415555 | distance: 0.99648variant: vectorized (all layers) | 747.0 |
| Topology Driven → Stroke Aggregator | 0.9909189189189188 | distance: 0.99092variant: original 500px | 86.0 |
| Poly Vector → Stroke Aggregator | 0.9722618133976536 | distance: 0.97226variant: original 500px | 23.0 |
| Poly Vector | 0.9731624493372768 |  distance: 0.97316variant: original 500px | 80.0 |
| Topology Driven | 0.9954977687148996 | distance: 0.9955variant: original 500px | 6.0 |
| Fidelity Simplicity | 0.5878539077383301 | distance: 0.58785variant: originalalg. parameter: 0.75 | 302.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.04569700604025652 | distance: 0.0457variant: original | 8.0 |
| Fidelity Simplicity | 0.08994442749023437 |  distance: 0.08994variant: original 1000pxalg. parameter: 0.3 | 195.0 |
| Mastering Sketching | 0.011313708305358886 | distance: 0.01131variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.012041594505310059 |  distance: 0.01204variant: original 1000pxalg. parameter: noisy | 131.0 |
| Poly Vector | 0.01233323595301825 | distance: 0.01233variant: original | 170.0 |
| Real-Time Inking | 0.014317821502685547 | distance: 0.01432variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.007465218146320297 | distance: 0.00747variant: vectorized (all layers) | 747.0 |
| Topology Driven → Stroke Aggregator | 0.011704699516296388 | distance: 0.0117variant: original 1000px | 595.0 |
| Topology Driven | 0.012083045959472656 |  distance: 0.01208variant: original 1000px | 23.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
|
 |
|
|
|
|
|
|
|
 |
|||
| original 1000px | |
|
|
|
|
 |
 |
 |
|
 |
 |
 |
|
 |
|
| original 500px | |
|
|
 |
 |
 |
 |
 |
|
|
|
|
|
||
| vectorized (all layers) | |