A Benchmark for Rough Sketch Cleanup
Art_freeform_DR_01
Author: David Revoy Author Homepage: https://www.davidrevoy.com/ Licence: CC-BY-4.0Messiness: 0.24125
Ambiguity (Chamfer): 0.07602
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Topology Driven | Topology Driven → Stroke Aggregator | Poly Vector | Poly Vector → Stroke Aggregator | Mastering Sketching | Fidelity Simplicity | Delaunay Triangulation | Stroke Aggregator | |||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  |  distance: 0.00122 |  distance: 0.00133 |  distance: 0.00146 |  distance: 0.00146 |  distance: 0.00155 |  distance: 0.00161 |  distance: 0.00281 |  distance: 0.00342 |  distance: 0.00432 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Jonathan Velasco |  | |  | ||||
| Santiago Rial |  | |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.0034242272882658398 | distance: 0.00342variant: thresholded | 9.0 |
| Stroke Aggregator | 0.004316171895281866 | distance: 0.00432variant: vectorized (shape strokes) | 607.0 |
| Mastering Sketching | 0.0016148731362017415 | distance: 0.00161variant: thresholded 1000px | 7.0 |
| Topology Driven | 0.0013258177472747065 | distance: 0.00133variant: thresholded | 34.0 |
| Fidelity Simplicity | 0.0028108571248472037 | distance: 0.00281variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 141.0 |
| Poly Vector → Stroke Aggregator | 0.0015541239226358572 | distance: 0.00155variant: thresholded | 172.0 |
| Poly Vector | 0.0014625971640462663 | distance: 0.00146variant: thresholded | 549.0 |
| Real-Time Inking | 0.0012219983209124374 | distance: 0.00122variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.0014602119598429242 | distance: 0.00146variant: thresholded | 812.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.2821681872285515 |  distance: 0.28217variant: vectorized (all layers) 500pxalg. parameter: 0.6 | 139.0 |
| Poly Vector → Stroke Aggregator | 0.02007074376990669 |  distance: 0.02007variant: original | 5.0 |
| Poly Vector | 0.021912421921535825 |  distance: 0.02191variant: originalalg. parameter: noisy | 72.0 |
| Topology Driven | 0.21263474048866984 |  distance: 0.21263variant: original | 4.0 |
| Delaunay Triangulation | 0.27071561284301576 |  distance: 0.27072variant: vectorized (all layers) 500px | 3.0 |
| Stroke Aggregator | 0.4323464397858707 | distance: 0.43235variant: vectorized (shape strokes) | 607.0 |
| Mastering Sketching | 0.5943503304885559 |  distance: 0.59435variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.6157985187282516 |  distance: 0.6158variant: vectorized (all layers) 500px | 2.0 |
| Topology Driven → Stroke Aggregator | 0.7564170675148756 | distance: 0.75642variant: thresholded | 812.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.416461366445218 |  distance: 0.41646variant: vectorized (all layers) 500pxalg. parameter: 0.5 | 129.0 |
| Poly Vector → Stroke Aggregator | 0.03565951159620847 | distance: 0.03566variant: original | 5.0 |
| Poly Vector | 0.040468844625220386 |  distance: 0.04047variant: original | 69.0 |
| Topology Driven | 0.3277610763907107 | distance: 0.32776variant: original | 4.0 |
| Delaunay Triangulation | 0.41964139483706375 | distance: 0.41964variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.7159909037597594 | distance: 0.71599variant: vectorized (all layers) 500px | 5.0 |
| Stroke Aggregator | 0.6633552417098365 | distance: 0.66336variant: vectorized (shape strokes) | 607.0 |
| Topology Driven → Stroke Aggregator | 0.8963735654917577 |  distance: 0.89637variant: thresholded 1000px | 1131.0 |
| Real-Time Inking | 0.7479885691395727 | distance: 0.74799variant: vectorized (all layers) 500px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.5379502073982584 |  distance: 0.53795variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 161.0 |
| Poly Vector | 0.060352517055728826 | distance: 0.06035variant: originalalg. parameter: noisy | 72.0 |
| Poly Vector → Stroke Aggregator | 0.05288698075000907 | distance: 0.05289variant: original | 5.0 |
| Topology Driven | 0.4117752301785001 | distance: 0.41178variant: original | 4.0 |
| Delaunay Triangulation | 0.5677554423946346 | distance: 0.56776variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.7929231728006093 | distance: 0.79292variant: vectorized (all layers) 500px | 5.0 |
| Stroke Aggregator | 0.7893265433643816 | distance: 0.78933variant: vectorized (shape strokes) | 607.0 |
| Topology Driven → Stroke Aggregator | 0.9441025917449986 | distance: 0.9441variant: thresholded 1000px | 1131.0 |
| Real-Time Inking | 0.8117373271912599 | distance: 0.81174variant: vectorized (all layers) 500px | 2.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.6171411552314842 | distance: 0.61714variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 161.0 |
| Poly Vector | 0.08085300490363782 | distance: 0.08085variant: originalalg. parameter: noisy | 72.0 |
| Poly Vector → Stroke Aggregator | 0.07002184817060035 | distance: 0.07002variant: original | 5.0 |
| Topology Driven | 0.4815287785940853 | distance: 0.48153variant: original | 4.0 |
| Delaunay Triangulation | 0.6684337113063268 | distance: 0.66843variant: vectorized (all layers) 500px | 3.0 |
| Mastering Sketching | 0.8331604136684628 | distance: 0.83316variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8441309745297915 | distance: 0.84413variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8484619452478358 | distance: 0.84846variant: vectorized (shape strokes) | 607.0 |
| Topology Driven → Stroke Aggregator | 0.9672668389032248 | distance: 0.96727variant: thresholded | 812.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.689910716998119 | distance: 0.68991variant: vectorized (all layers) 500pxalg. parameter: 0.75 | 161.0 |
| Poly Vector → Stroke Aggregator | 0.09208909885960097 | distance: 0.09209variant: original | 5.0 |
| Poly Vector | 0.10450987878617048 | distance: 0.10451variant: original | 69.0 |
| Topology Driven | 0.544870671206723 | distance: 0.54487variant: original | 4.0 |
| Mastering Sketching | 0.8752822762758887 | distance: 0.87528variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.8783944735537293 | distance: 0.87839variant: vectorized (all layers) 500px | 2.0 |
| Stroke Aggregator | 0.8846276421181063 | distance: 0.88463variant: vectorized (shape strokes) | 607.0 |
| Topology Driven → Stroke Aggregator | 0.9786297586474302 | distance: 0.97863variant: thresholded | 812.0 |
| Delaunay Triangulation | 0.7601137052160392 | distance: 0.76011variant: vectorized (all layers) 500px | 3.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.04440720748901368 |  distance: 0.04441variant: vectorized (shape strokes) 500px | 2.0 |
| Fidelity Simplicity | 0.03498571014404297 |  distance: 0.03499variant: vectorized (shape strokes) 1000pxalg. parameter: 0.5 | 154.0 |
| Mastering Sketching | 0.2794351501464844 | distance: 0.27944variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.022799883755770595 | distance: 0.0228variant: original | 3.0 |
| Topology Driven → Stroke Aggregator | 0.02801785087585449 | distance: 0.02802variant: thresholded 1000px | 1131.0 |
| Stroke Aggregator | 0.11202124855735084 | distance: 0.11202variant: vectorized (shape strokes) | 607.0 |
| Poly Vector → Stroke Aggregator | 0.023793185840953482 |  distance: 0.02379variant: thresholdedalg. parameter: noisy | 171.0 |
| Poly Vector | 0.02572903893210671 |  distance: 0.02573variant: thresholdedalg. parameter: noisy | 551.0 |
| Topology Driven | 0.02545584487915039 |  distance: 0.02546variant: thresholded 500px | 6.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
 |
 |
 |
 |
 |
|
|
|
|
|||||
| thresholded | |
 |
 |
 |
 |
 |
 |
|
|
|
|
|
|
||
| thresholded 1000px | |
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||
| thresholded 500px |  |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
||||
| vectorized (all layers) 1000px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||||
| vectorized (all layers) 500px | |
|
 |
 |
|
|
|
 |
 |
 |
|
 |
|||
| vectorized (shape strokes) 1000px |  |
 |
|
 |
|
 |
 |
 |
 |
 |
 |
 |
 |
||
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|
 |
 |
||
| vectorized (shape strokes) | |