A Benchmark for Rough Sketch Cleanup
Ind_architecture_baseline_05
Author: Baseline Licence: Academic PaperMessiness: 0.06628
Ambiguity (Chamfer): 0.07507
Shading: No
Scaffold: No
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Real-Time Inking | Stroke Aggregator | Poly Vector | Topology Driven | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00061 |  distance: 0.00063 |  distance: 0.00065 |  distance: 0.00069 |  distance: 0.00071 |  distance: 0.00072 |  distance: 0.00079 |  distance: 0.00252 |  distance: 0.00438 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | | |||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0025157083306133533 | distance: 0.00252variant: thresholded 1000px | 12.0 |
| Fidelity Simplicity | 0.004380380109503054 | distance: 0.00438variant: thresholdedalg. parameter: 0.25 | 364.0 |
| Mastering Sketching | 0.0006102262526050585 | distance: 0.00061variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.0007176484602004175 | distance: 0.00072variant: vectorized (all layers) 1000px | 180.0 |
| Poly Vector | 0.0006878462834415597 | distance: 0.00069variant: thresholdedalg. parameter: noisy | 1352.0 |
| Real-Time Inking | 0.0006343932551520706 | distance: 0.00063variant: original | 3.0 |
| Stroke Aggregator | 0.0006513729760535066 | distance: 0.00065variant: vectorized (all layers) | 604.0 |
| Topology Driven → Stroke Aggregator | 0.0007928164278478418 | distance: 0.00079variant: thresholded | 1407.0 |
| Topology Driven | 0.0007103672919286641 | distance: 0.00071variant: thresholded | 202.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.7818666880003246 |  distance: 0.78187variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.5943836297396432 |  distance: 0.59438variant: vectorized (all layers) 500pxalg. parameter: noisy | 37.0 |
| Poly Vector | 0.5963936801898848 |  distance: 0.59639variant: originalalg. parameter: noisy | 424.0 |
| Real-Time Inking | 0.7545618724561637 |  distance: 0.75456variant: vectorized (all layers) 500px | 6.0 |
| Stroke Aggregator | 0.7576893657547915 | distance: 0.75769variant: vectorized (all layers) | 604.0 |
| Topology Driven → Stroke Aggregator | 0.6692237976636107 |  distance: 0.66922variant: thresholded 500px | 147.0 |
| Topology Driven | 0.6262228527354158 |  distance: 0.62622variant: original | 74.0 |
| Delaunay Triangulation | 0.08734606045434598 |  distance: 0.08735variant: original | 2.0 |
| Fidelity Simplicity | 0.6548240287806162 |  distance: 0.65482variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 161.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.9248891492280596 | distance: 0.92489variant: vectorized (all layers) 1000px | 7.0 |
| Real-Time Inking | 0.8779472894871497 | distance: 0.87795variant: vectorized (all layers) 500px | 6.0 |
| Stroke Aggregator | 0.9212129847862685 | distance: 0.92121variant: vectorized (all layers) | 604.0 |
| Topology Driven → Stroke Aggregator | 0.8590274675167839 | distance: 0.85903variant: thresholded 500px | 147.0 |
| Topology Driven | 0.8209721032021452 | distance: 0.82097variant: original | 74.0 |
| Delaunay Triangulation | 0.12734443942856175 | distance: 0.12734variant: original | 2.0 |
| Fidelity Simplicity | 0.8111894719906808 | distance: 0.81119variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 161.0 |
| Poly Vector → Stroke Aggregator | 0.716011703197539 | distance: 0.71601variant: vectorized (all layers) 500pxalg. parameter: noisy | 37.0 |
| Poly Vector | 0.7220698417088843 |  distance: 0.72207variant: vectorized (all layers) 500px | 65.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.880679620450717 | distance: 0.88068variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 161.0 |
| Mastering Sketching | 0.9673192495431312 |  distance: 0.96732variant: thresholded 500px | 5.0 |
| Poly Vector → Stroke Aggregator | 0.7689071478613678 | distance: 0.76891variant: vectorized (all layers) 500pxalg. parameter: noisy | 37.0 |
| Poly Vector | 0.7751214219261798 | distance: 0.77512variant: vectorized (all layers) 500px | 65.0 |
| Real-Time Inking | 0.9302637169090071 | distance: 0.93026variant: vectorized (all layers) 500px | 6.0 |
| Stroke Aggregator | 0.9662882748616444 | distance: 0.96629variant: vectorized (all layers) | 604.0 |
| Topology Driven → Stroke Aggregator | 0.9343536356395852 | distance: 0.93435variant: thresholded 500px | 147.0 |
| Topology Driven | 0.8783963179405794 | distance: 0.8784variant: original | 74.0 |
| Delaunay Triangulation | 0.15804051832247068 | distance: 0.15804variant: original | 2.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.9061727446622412 | distance: 0.90617variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 161.0 |
| Mastering Sketching | 0.9834808552716112 | distance: 0.98348variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.7923795046821449 | distance: 0.79238variant: vectorized (all layers) 500pxalg. parameter: noisy | 37.0 |
| Poly Vector | 0.7980065266305684 |  distance: 0.79801variant: vectorized (all layers) 500pxalg. parameter: noisy | 64.0 |
| Real-Time Inking | 0.9516578655374184 | distance: 0.95166variant: vectorized (all layers) 500px | 6.0 |
| Stroke Aggregator | 0.9814074534716232 | distance: 0.98141variant: vectorized (all layers) | 604.0 |
| Topology Driven → Stroke Aggregator | 0.9561904057993732 | distance: 0.95619variant: thresholded 500px | 147.0 |
| Topology Driven | 0.9111441252029258 | distance: 0.91114variant: original | 74.0 |
| Delaunay Triangulation | 0.19230300544747206 | distance: 0.1923variant: original | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.996591995184694 | distance: 0.99659variant: thresholded 1000px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.810286958604211 | distance: 0.81029variant: vectorized (all layers) 500pxalg. parameter: noisy | 37.0 |
| Poly Vector | 0.8165523987541748 | distance: 0.81655variant: vectorized (all layers) 500px | 65.0 |
| Stroke Aggregator | 0.9948668404569884 | distance: 0.99487variant: vectorized (all layers) | 604.0 |
| Topology Driven | 0.9419678258272756 | distance: 0.94197variant: original | 74.0 |
| Delaunay Triangulation | 0.22320538278977686 | distance: 0.22321variant: original | 2.0 |
| Fidelity Simplicity | 0.9203874182470606 | distance: 0.92039variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 161.0 |
| Real-Time Inking | 0.964472575489124 | distance: 0.96447variant: vectorized (all layers) 500px | 6.0 |
| Topology Driven → Stroke Aggregator | 0.9823751148858044 | distance: 0.98238variant: thresholded 500px | 147.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.047518417358398436 |  distance: 0.04752variant: vectorized (all layers) 1000px | 9.0 |
| Mastering Sketching | 0.062032249450683585 |  distance: 0.06203variant: vectorized (all layers) 500px | 5.0 |
| Fidelity Simplicity | 0.13416407775878905 |  distance: 0.13416variant: thresholded 500pxalg. parameter: 0.6 | 131.0 |
| Poly Vector → Stroke Aggregator | 0.01555634880065918 | distance: 0.01556variant: vectorized (all layers) 1000px | 180.0 |
| Poly Vector | 0.01556311611923875 |  distance: 0.01556variant: thresholded | 1389.0 |
| Real-Time Inking | 0.016643316268920898 |  distance: 0.01664variant: thresholded 1000px | 3.0 |
| Stroke Aggregator | 0.015933804306687352 | distance: 0.01593variant: vectorized (all layers) | 604.0 |
| Topology Driven → Stroke Aggregator | 0.014866068840026857 |  distance: 0.01487variant: vectorized (all layers) 1000px | 605.0 |
| Topology Driven | 0.01555634880065918 |  distance: 0.01556variant: vectorized (all layers) 1000px | 21.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
|
|
 |
|
 |
||||
| thresholded | |
 |
 |
|
 |
 |
 |
|
|
|
 |
||||
| thresholded 1000px |  |
|
|
 |
 |
 |
 |
 |
 |
 |
 |
|
 |
||
| thresholded 500px | |
 |
|
 |
 |
 |
 |
|
 |
 |
 |
 |
|||
| vectorized (all layers) 1000px | |
 |
|
 |
 |
 |
 |
 |
|
 |
 |
|
 |
|
|
| vectorized (all layers) 500px | |
|
 |
 |
 |
|
 |
 |
|
|
 |
|
|||
| vectorized (all layers) | |