A Benchmark for Rough Sketch Cleanup
Art_freeform_DV_01
Author: David Vanderhaeghe Licence: CC-BY-NC-4.0Messiness: 0.12948
Ambiguity (Chamfer): 0.09601
Shading: Yes
Scaffold: No
Texture Strokes: Yes
Background: Clean
Best automatic results (chamfer distance)
Column visibility:
Best automatic results
| Original | Ground Truth | Mastering Sketching | Topology Driven | Poly Vector | Stroke Aggregator | Real-Time Inking | Poly Vector → Stroke Aggregator | Topology Driven → Stroke Aggregator | Delaunay Triangulation | Fidelity Simplicity | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|  |  |  |  distance: 0.00112 |  distance: 0.00135 |  distance: 0.00136 |  distance: 0.00141 |  distance: 0.0015 |  distance: 0.00155 |  distance: 0.00256 |  distance: 0.0031 |  distance: 0.00357 |
Rough Sketch
Column visibility:
| original | thresholded | all layers | shape | lighting | scaffold | shading |
|---|---|---|---|---|---|---|
|  |  |  |  |  |
Ground Truth
Column visibility:
| artist | all layers | shape | scaffold | shading | color region | text | extra |
|---|---|---|---|---|---|---|---|
| Branislav Mirkovic |  | |  | ||||
| Ge Jin |  | |  | ||||
| Santiago Rial |  | |  |
Automatic results, best result per algorithm
Select metric
Column visibility:
Display labels:
Chamfer
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.003096296613690859 | distance: 0.0031variant: original | 226.0 |
| Mastering Sketching | 0.001118488947998543 | distance: 0.00112variant: thresholded 1000px | 9.0 |
| Topology Driven → Stroke Aggregator | 0.0025571301448488143 | distance: 0.00256variant: thresholded 500px | 740.0 |
| Fidelity Simplicity | 0.0035652156849473367 | distance: 0.00357variant: vectorized (shape strokes) 1000pxalg. parameter: 0.25 | 148.0 |
| Poly Vector → Stroke Aggregator | 0.0015455411436375204 | distance: 0.00155variant: vectorized (shape strokes) 1000px | 646.0 |
| Poly Vector | 0.0013648021525772438 | distance: 0.00136variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 353.0 |
| Real-Time Inking | 0.0015008560968117592 | distance: 0.0015variant: vectorized (shape strokes) 1000px | 3.0 |
| Stroke Aggregator | 0.0014096747529337868 | distance: 0.00141variant: vectorized (shape strokes) | 1288.0 |
| Topology Driven | 0.0013456953205441275 | distance: 0.00135variant: vectorized (shape strokes) 1000px | 28.0 |
F12/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Fidelity Simplicity | 0.33744391230575194 |  distance: 0.33744variant: vectorized (shape strokes) 500pxalg. parameter: 0.6 | 138.0 |
| Poly Vector → Stroke Aggregator | 0.43381049540551375 |  distance: 0.43381variant: vectorized (shape strokes) 500px | 43.0 |
| Poly Vector | 0.4634784854619674 |  distance: 0.46348variant: vectorized (shape strokes) 500px | 135.0 |
| Stroke Aggregator | 0.7605152130460047 | distance: 0.76052variant: vectorized (shape strokes) | 1288.0 |
| Topology Driven → Stroke Aggregator | 0.6728599766626122 | distance: 0.67286variant: thresholded 500px | 740.0 |
| Mastering Sketching | 0.7514770894419417 |  distance: 0.75148variant: vectorized (all layers) 1000px | 6.0 |
| Delaunay Triangulation | 0.3238750651588284 |  distance: 0.32388variant: vectorized (all layers) 500px | 3.0 |
| Real-Time Inking | 0.7317007084815907 |  distance: 0.7317variant: vectorized (all layers) 1000px | 4.0 |
| Topology Driven | 0.7084091232735291 |  distance: 0.70841variant: vectorized (all layers) 500px | 14.0 |
F14/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.5191860861634993 | distance: 0.51919variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.467662344993511 |  distance: 0.46766variant: vectorized (shape strokes) 500pxalg. parameter: 0.5 | 140.0 |
| Poly Vector → Stroke Aggregator | 0.5864614613640944 | distance: 0.58646variant: vectorized (shape strokes) 500px | 43.0 |
| Poly Vector | 0.6070246385326423 |  distance: 0.60702variant: vectorized (shape strokes) 500pxalg. parameter: noisy | 130.0 |
| Stroke Aggregator | 0.8862351313563851 | distance: 0.88624variant: vectorized (shape strokes) | 1288.0 |
| Mastering Sketching | 0.8456706271874529 | distance: 0.84567variant: vectorized (all layers) 1000px | 6.0 |
| Topology Driven → Stroke Aggregator | 0.8180277084724189 | distance: 0.81803variant: thresholded 500px | 740.0 |
| Topology Driven | 0.830042767408738 |  distance: 0.83004variant: thresholded 1000px | 112.0 |
| Real-Time Inking | 0.847303008719817 |  distance: 0.8473variant: vectorized (all layers) 500px | 2.0 |
F16/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.667533769379866 | distance: 0.66753variant: vectorized (all layers) 500px | 3.0 |
| Fidelity Simplicity | 0.5477162382935641 |  distance: 0.54772variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 163.0 |
| Poly Vector → Stroke Aggregator | 0.6892518264076695 | distance: 0.68925variant: vectorized (shape strokes) 500px | 43.0 |
| Poly Vector | 0.7112587831759899 | distance: 0.71126variant: vectorized (shape strokes) 500px | 135.0 |
| Stroke Aggregator | 0.9260745791056912 | distance: 0.92607variant: vectorized (shape strokes) | 1288.0 |
| Mastering Sketching | 0.9005121984088551 | distance: 0.90051variant: vectorized (all layers) 1000px | 6.0 |
| Topology Driven → Stroke Aggregator | 0.8953105727237777 | distance: 0.89531variant: thresholded 500px | 740.0 |
| Topology Driven | 0.8906299933473771 | distance: 0.89063variant: thresholded 1000px | 112.0 |
| Real-Time Inking | 0.8958345154532461 | distance: 0.89583variant: vectorized (all layers) 500px | 2.0 |
F18/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.7541743473479225 |  distance: 0.75417variant: vectorized (shape strokes) 500px | 2.0 |
| Fidelity Simplicity | 0.6022263288518981 | distance: 0.60223variant: vectorized (shape strokes) 500pxalg. parameter: 0.75 | 163.0 |
| Poly Vector → Stroke Aggregator | 0.7479462569349703 | distance: 0.74795variant: vectorized (shape strokes) 500px | 43.0 |
| Poly Vector | 0.7688286554108862 | distance: 0.76883variant: vectorized (shape strokes) 500px | 135.0 |
| Stroke Aggregator | 0.948840563002872 | distance: 0.94884variant: vectorized (shape strokes) | 1288.0 |
| Topology Driven → Stroke Aggregator | 0.9308825599266272 | distance: 0.93088variant: thresholded 500px | 740.0 |
| Topology Driven | 0.9206075129513251 | distance: 0.92061variant: thresholded 1000px | 112.0 |
| Mastering Sketching | 0.9283121597096188 |  distance: 0.92831variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.9232064763997062 | distance: 0.92321variant: vectorized (all layers) 500px | 2.0 |
F110/1000
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.8228352527765851 | distance: 0.82284variant: vectorized (shape strokes) 500px | 2.0 |
| Fidelity Simplicity | 0.6467053893643983 | distance: 0.64671variant: vectorized (shape strokes) 500pxalg. parameter: 0.5 | 140.0 |
| Poly Vector → Stroke Aggregator | 0.7977919963912538 | distance: 0.79779variant: vectorized (shape strokes) 500px | 43.0 |
| Poly Vector | 0.8187083888807085 | distance: 0.81871variant: vectorized (shape strokes) 500px | 135.0 |
| Stroke Aggregator | 0.96074552924047 | distance: 0.96075variant: vectorized (shape strokes) | 1288.0 |
| Topology Driven → Stroke Aggregator | 0.9559222941281124 | distance: 0.95592variant: thresholded 500px | 740.0 |
| Topology Driven | 0.9415413813518848 | distance: 0.94154variant: thresholded 1000px | 112.0 |
| Mastering Sketching | 0.9460062472110664 | distance: 0.94601variant: vectorized (all layers) 500px | 5.0 |
| Real-Time Inking | 0.9441443408664244 | distance: 0.94414variant: vectorized (all layers) 1000px | 4.0 |
Hausdorff
| algorithm | distance | result | running time |
|---|---|---|---|
| Delaunay Triangulation | 0.043037816097861836 |  distance: 0.04304variant: thresholded | 240.0 |
| Fidelity Simplicity | 0.058855754852294925 |  distance: 0.05886variant: vectorized (shape strokes) 1000pxalg. parameter: 0.5 | 161.0 |
| Mastering Sketching | 0.2562596435546875 | distance: 0.25626variant: thresholded 1000px | 9.0 |
| Poly Vector | 0.024083189010620117 |  distance: 0.02408variant: thresholded 1000px | 1224.0 |
| Real-Time Inking | 0.02830194282531738 |  distance: 0.0283variant: thresholded 1000px | 3.0 |
| Topology Driven → Stroke Aggregator | 0.035608985900878916 | distance: 0.03561variant: thresholded 500px | 740.0 |
| Topology Driven | 0.026925823211669926 | distance: 0.02693variant: thresholded 1000px | 112.0 |
| Poly Vector → Stroke Aggregator | 0.030083217620849614 |  distance: 0.03008variant: vectorized (shape strokes) 1000pxalg. parameter: noisy | 647.0 |
| Stroke Aggregator | 0.030739310266945482 | distance: 0.03074variant: vectorized (shape strokes) | 1288.0 |
Automatic results for each input variant
Column visibility:
| variant | Topology Driven → Stroke Aggregator | Real-Time Inking | Mastering Sketching | Fidelity Simplicity 0.3 | Fidelity Simplicity 0.25 | Fidelity Simplicity 0.5 | Fidelity Simplicity 0.75 | Fidelity Simplicity 0.6 | Topology Driven | Poly Vector noisy | Poly Vector | Delaunay Triangulation | Stroke Aggregator | Poly Vector → Stroke Aggregator noisy | Poly Vector → Stroke Aggregator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| original |  |
 |
 |
 |
 |
 |
|
||||||||
| thresholded |  |
 |
 |
 |
 |
 |
|
||||||||
| thresholded 1000px | |
|
 |
 |
 |
 |
 |
|
 |
|
 |
||||
| thresholded 500px | |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
|||
| vectorized (all layers) 1000px | |
|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
||
| vectorized (all layers) 500px | |
|
 |
 |
 |
 |
 |
|
 |
 |
|
 |
 |
||
| vectorized (shape strokes) 1000px | |
 |
 |
|
|
 |
 |
|
|
 |
 |
|
|
||
| vectorized (shape strokes) 500px |  |
 |
 |
 |
|
|
|
 |
|
|
|
|
|||
| vectorized (shape strokes) | |