A Benchmark for Rough Sketch Cleanup
Ind_product_MMX_01
Author: MQ-MX-XQ Author Homepage: https://www.deviantart.com/mq-mx-xq Licence: CC-BY-3.0Messiness: 0.18849
Ambiguity (Chamfer): 0.08116
Shading: Yes
Scaffold: Yes
Texture Strokes: No
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Real-Time Inking | Mastering Sketching | Poly Vector | Topology Driven | Fidelity Simplicity | Poly Vector → Stroke Aggregator | Delaunay Triangulation | ||
|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00115 |  distance: 0.00138 |  distance: 0.00151 |  distance: 0.00152 |  distance: 0.00202 |  distance: 0.0027 |  distance: 0.00435 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  |  | |||
| Ge Jin |  | |  |  | |||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.004352841468627289 | distance: 0.00435variant: vectorized (shape strokes) 1000px | 11.0 |
| Fidelity Simplicity | 0.0020224240845365627 | distance: 0.00202variant: vectorized (shape strokes) 1000pxalg. parameter: 0.3 | 156.0 |
| Mastering Sketching | 0.0013839197394313525 | distance: 0.00138variant: vectorized (shape strokes) 1000px | 6.0 |
| Poly Vector | 0.0015144534877076855 | distance: 0.00151variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 380.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.001517470034785662 | distance: 0.00152variant: vectorized (shape strokes) 1000px | 36.0 |
| Poly Vector → Stroke Aggregator | 0.002701506723577395 | distance: 0.0027variant: vectorized (all layers) 500pxalg. parameter: noisy | 85.0 |
| Real-Time Inking | 0.0011490788923203355 | distance: 0.00115variant: original | 5.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.7099431250122904 |  distance: 0.70994variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.6573966636573018 | distance: 0.6574variant: vectorized (all layers) 500pxalg. parameter: noisy | 85.0 |
| Poly Vector | 0.6829036202290742 |  distance: 0.6829variant: vectorized (all layers) 500pxalg. parameter: noisy | 238.0 |
| Real-Time Inking | 0.706971900574004 |  distance: 0.70697variant: thresholded 500px | 2.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Topology Driven | 0.6224629355262873 |  distance: 0.62246variant: thresholded 1000px | 150.0 |
| Delaunay Triangulation | 0.3166831486872809 |  distance: 0.31668variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.3377064971022574 |  distance: 0.33771variant: thresholded 500pxalg. parameter: 0.6 | 158.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Mastering Sketching | 0.824005978815675 | distance: 0.82401variant: vectorized (all layers) 1000px | 7.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.4674813964501505 | distance: 0.46748variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.4774502505145696 | distance: 0.47745variant: thresholded 500pxalg. parameter: 0.6 | 158.0 |
| Poly Vector → Stroke Aggregator | 0.7939686161842392 | distance: 0.79397variant: vectorized (all layers) 500pxalg. parameter: noisy | 85.0 |
| Poly Vector | 0.8066841397012606 |  distance: 0.80668variant: vectorized (all layers) 500px | 244.0 |
| Real-Time Inking | 0.8072085281967162 | distance: 0.80721variant: thresholded 500px | 2.0 |
| Topology Driven | 0.7595957093160373 | distance: 0.7596variant: thresholded 1000px | 150.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.5868571140085188 | distance: 0.58686variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.5971674722567483 |  distance: 0.59717variant: thresholded 500pxalg. parameter: 0.75 | 138.0 |
| Mastering Sketching | 0.8659914296844565 | distance: 0.86599variant: vectorized (all layers) 1000px | 7.0 |
| Poly Vector → Stroke Aggregator | 0.8600930962046855 | distance: 0.86009variant: vectorized (all layers) 500pxalg. parameter: noisy | 85.0 |
| Poly Vector | 0.8680272070386841 | distance: 0.86803variant: vectorized (all layers) 500px | 244.0 |
| Real-Time Inking | 0.8442091777089126 | distance: 0.84421variant: thresholded 500px | 2.0 |
| Topology Driven | 0.8279578051137004 | distance: 0.82796variant: thresholded 1000px | 150.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.6725556870473065 | distance: 0.67256variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.6730110447128305 |  distance: 0.67301variant: thresholded 500pxalg. parameter: 0.5 | 125.0 |
| Mastering Sketching | 0.8872127520490772 |  distance: 0.88721variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.8946189397216737 |  distance: 0.89462variant: thresholded 500px | 179.0 |
| Poly Vector | 0.8940288713910761 |  distance: 0.89403variant: vectorized (all layers) 1000pxalg. parameter: noisy | 791.0 |
| Real-Time Inking | 0.8695698147306559 | distance: 0.86957variant: thresholded 500px | 2.0 |
| Topology Driven | 0.8677313929826724 | distance: 0.86773variant: thresholded 1000px | 150.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.747963511384061 | distance: 0.74796variant: vectorized (all layers) 500px | 4.0 |
| Fidelity Simplicity | 0.7424717998380499 | distance: 0.74247variant: thresholded 500pxalg. parameter: 0.75 | 138.0 |
| Mastering Sketching | 0.901982187600784 | distance: 0.90198variant: vectorized (all layers) 500px | 6.0 |
| Poly Vector → Stroke Aggregator | 0.9135189210105918 | distance: 0.91352variant: thresholded 500px | 179.0 |
| Poly Vector | 0.9090026430767572 | distance: 0.909variant: vectorized (all layers) 1000pxalg. parameter: noisy | 791.0 |
| Real-Time Inking | 0.8928116205289436 | distance: 0.89281variant: thresholded 500px | 2.0 |
| Topology Driven | 0.8946128782235065 | distance: 0.89461variant: thresholded 1000px | 150.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.0324499626159668 |  distance: 0.03245variant: vectorized (shape strokes) 1000pxalg. parameter: 0.6 | 197.0 |
| Poly Vector | 0.03622154235839844 |  distance: 0.03622variant: vectorized (shape strokes) 500px | 109.0 |
| Stroke Aggregator | nan | ||
| Topology Driven → Stroke Aggregator | nan | ||
| Delaunay Triangulation | 0.055461696624755856 |  distance: 0.05546variant: vectorized (all layers) 1000px | 18.0 |
| Poly Vector → Stroke Aggregator | 0.042047592163085935 | distance: 0.04205variant: vectorized (all layers) 500pxalg. parameter: noisy | 85.0 |
| Real-Time Inking | 0.034176013946533204 |  distance: 0.03418variant: thresholded 1000px | 3.0 |
| Topology Driven | 0.042379241943359375 |  distance: 0.04238variant: thresholded 500px | 30.0 |
| Mastering Sketching | 0.3184525146484375 | distance: 0.31845variant: vectorized (all layers) 500px | 6.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original | |
||||||||||||||
| thresholded |  |
||||||||||||||
| thresholded 1000px | |
 |
 |
 |
 |
 |
 |
|
 |
 |
 |
||||
| thresholded 500px | |
 |
 |
 |
|
|
|
|
 |
 |
 |
|
|||
| vectorized (all layers) 1000px |  |
|
 |
 |
 |
 |
 |
 |
|
 |
|
||||
| vectorized (all layers) 500px |  |
|
 |
 |
 |
 |
 |
 |
|
|
|
|
|||
| vectorized (shape strokes) 1000px |  |
|
|
 |
 |
 |
|
|
|
 |
|
||||
| vectorized (shape strokes) 500px |  |
 |
 |
 |
 |
 |
 |
 |
 |
|
 |