A Benchmark for Rough Sketch Cleanup
Art_freeform_baseline_11
Author: Enrique Rosales Licence: Academic PaperMessiness: 0.14086
Ambiguity (Chamfer): 0.08211
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean (Vector)
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Stroke Aggregator | Mastering Sketching | Poly Vector → Stroke Aggregator | Topology Driven | Real-Time Inking | Poly Vector | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00091 |  distance: 0.00096 |  distance: 0.00103 |  distance: 0.00111 |  distance: 0.00111 |  distance: 0.00112 |  distance: 0.00123 |  distance: 0.00215 |  distance: 0.00328 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | | |||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0021478659537788342 | distance: 0.00215variant: original | 8.0 |
| Fidelity Simplicity | 0.003276448599074889 | distance: 0.00328variant: original 1000pxalg. parameter: 0.3 | 219.0 |
| Mastering Sketching | 0.0009552106345424336 | distance: 0.00096variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.001028428883729275 | distance: 0.00103variant: original 1000px | 90.0 |
| Poly Vector | 0.0011202090519329137 | distance: 0.00112variant: original | 129.0 |
| Real-Time Inking | 0.0011137221534560382 | distance: 0.00111variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.0009103301088298848 | distance: 0.00091variant: vectorized (all layers) | 269.0 |
| Topology Driven → Stroke Aggregator | 0.0012310979339745325 | distance: 0.00123variant: original 1000px | 423.0 |
| Topology Driven | 0.0011063470902381912 | distance: 0.00111variant: original | 28.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.4737742637694974 |  distance: 0.47377variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.5674046882433935 |  distance: 0.5674variant: originalalg. parameter: 0.75 | 366.0 |
| Mastering Sketching | 0.7981530840583076 |  distance: 0.79815variant: original 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7240201000122349 | distance: 0.72402variant: original 1000px | 90.0 |
| Poly Vector | 0.7134929719915072 |  distance: 0.71349variant: original 500pxalg. parameter: noisy | 61.0 |
| Real-Time Inking | 0.721173786548601 | distance: 0.72117variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.7039574723574888 | distance: 0.70396variant: vectorized (all layers) | 269.0 |
| Topology Driven → Stroke Aggregator | 0.7274635752260236 |  distance: 0.72746variant: original | 851.0 |
| Topology Driven | 0.7487790616788925 | distance: 0.74878variant: original | 28.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7041224290414374 | distance: 0.70412variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.7237142955491087 | distance: 0.72371variant: originalalg. parameter: 0.75 | 366.0 |
| Mastering Sketching | 0.927489767497777 | distance: 0.92749variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9035958529828978 |  distance: 0.9036variant: original 1000pxalg. parameter: noisy | 90.0 |
| Poly Vector | 0.8240454173797463 |  distance: 0.82405variant: original 500px | 62.0 |
| Real-Time Inking | 0.8946005249086685 |  distance: 0.8946variant: original 500px | 2.0 |
| Stroke Aggregator | 0.8958679575818076 | distance: 0.89587variant: vectorized (all layers) | 269.0 |
| Topology Driven → Stroke Aggregator | 0.8984054832502043 | distance: 0.89841variant: original | 851.0 |
| Topology Driven | 0.8864411655798041 |  distance: 0.88644variant: original 500px | 5.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8505990888226076 | distance: 0.8506variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.7675402038292051 | distance: 0.76754variant: originalalg. parameter: 0.75 | 366.0 |
| Mastering Sketching | 0.9722142656744494 | distance: 0.97221variant: original 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9669717748916478 | distance: 0.96697variant: original 1000pxalg. parameter: noisy | 90.0 |
| Poly Vector | 0.8880769460337492 | distance: 0.88808variant: original 500px | 62.0 |
| Real-Time Inking | 0.9607813361616572 |  distance: 0.96078variant: original | 3.0 |
| Stroke Aggregator | 0.9758018476619869 | distance: 0.9758variant: vectorized (all layers) | 269.0 |
| Topology Driven → Stroke Aggregator | 0.9651685096475424 | distance: 0.96517variant: original | 851.0 |
| Topology Driven | 0.956648690027696 | distance: 0.95665variant: original 500px | 5.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.9931238127962858 | distance: 0.99312variant: original 1000px | 90.0 |
| Delaunay Triangulation | 0.9066206375507834 | distance: 0.90662variant: original 500px | 1.0 |
| Fidelity Simplicity | 0.7883563026733825 |  distance: 0.78836variant: originalalg. parameter: 0.6 | 329.0 |
| Mastering Sketching | 0.9867573563322092 | distance: 0.98676variant: original 1000px | 6.0 |
| Poly Vector | 0.9169433007218808 | distance: 0.91694variant: original 500px | 62.0 |
| Real-Time Inking | 0.9774563333529032 | distance: 0.97746variant: original 500px | 2.0 |
| Stroke Aggregator | 0.9898573374818792 | distance: 0.98986variant: vectorized (all layers) | 269.0 |
| Topology Driven → Stroke Aggregator | 0.9865666721959542 | distance: 0.98657variant: original | 851.0 |
| Topology Driven | 0.9788566546199838 | distance: 0.97886variant: original 500px | 5.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.9430793977227556 | distance: 0.94308variant: original 500px | 1.0 |
| Poly Vector → Stroke Aggregator | 0.9977037906983328 | distance: 0.9977variant: original 1000pxalg. parameter: noisy | 90.0 |
| Stroke Aggregator | 0.9976672593080856 | distance: 0.99767variant: vectorized (all layers) | 269.0 |
| Fidelity Simplicity | 0.8000132785814924 |  distance: 0.80001variant: originalalg. parameter: 0.25 | 245.0 |
| Mastering Sketching | 0.9971606328164486 | distance: 0.99716variant: original 1000px | 6.0 |
| Poly Vector | 0.940236888754192 | distance: 0.94024variant: original 500pxalg. parameter: noisy | 61.0 |
| Real-Time Inking | 0.9922513873724876 | distance: 0.99225variant: original 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.9931225457929499 | distance: 0.99312variant: original | 851.0 |
| Topology Driven | 0.9916068673658586 | distance: 0.99161variant: original 500px | 5.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Poly Vector → Stroke Aggregator | 0.011401754379272459 | distance: 0.0114variant: original 1000px | 90.0 |
| Delaunay Triangulation | 0.07552610540329427 | distance: 0.07553variant: original | 8.0 |
| Fidelity Simplicity | 0.10469001770019533 |  distance: 0.10469variant: original 500pxalg. parameter: 0.6 | 185.0 |
| Mastering Sketching | 0.15185519409179687 | distance: 0.15186variant: original 500px | 5.0 |
| Poly Vector | 0.01145346616093055 | distance: 0.01145variant: original | 129.0 |
| Real-Time Inking | 0.011180339813232422 | distance: 0.01118variant: original 1000px | 2.0 |
| Stroke Aggregator | 0.010573898519009466 | distance: 0.01057variant: vectorized (all layers) | 269.0 |
| Topology Driven → Stroke Aggregator | 0.011095456580194769 | distance: 0.0111variant: original | 851.0 |
| Topology Driven | 0.01145346616093055 | distance: 0.01145variant: original | 28.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
|
 |
|
 |
|
|
|
 |
|
|
||||
| original 1000px | |
|
|
|
 |
 |
 |
 |
 |
 |
 |
 |
|
|
|
| original 500px | |
|
 |
 |
 |
 |
|
|
|
|
|
||||
| vectorized (all layers) | |