A Benchmark for Rough Sketch Cleanup


Ind_architecture_baseline_06

Author: Baseline Licence: Academic Paper
Messiness:  -0.0
Ambiguity (Chamfer):  0.01553
Shading:  No
Scaffold:  No
Texture Strokes:  No
Background:  Clean
rough image

Best automatic results (chamfer distance)

Column visibility:

Best automatic results

OriginalGround TruthReal-Time InkingMastering SketchingPoly VectorTopology DrivenTopology Driven → Stroke AggregatorPoly Vector → Stroke AggregatorFidelity SimplicityDelaunay Triangulation
image thumbnailimage thumbnailimage thumbnailimage thumbnailimage thumbnaildistance: 0.00023image thumbnaildistance: 0.00028image thumbnaildistance: 0.00032image thumbnaildistance: 0.00034image thumbnaildistance: 0.00042image thumbnaildistance: 0.00045image thumbnaildistance: 0.00058image thumbnaildistance: 0.00732

Rough Sketch

Column visibility:

originalthresholdedall layersshapelightingscaffoldshading
image thumbnailimage thumbnailimage thumbnail

Ground Truth

Column visibility:

artistall layersshapescaffoldshadingcolor regiontextextra
Branislav Mirkovicimage thumbnailimage thumbnail
Ge Jinimage thumbnailimage thumbnail
Santiago Rialimage thumbnailimage thumbnail

Automatic results, best result per algorithm

Select metric

Column visibility:

Display labels:

Chamfer

algorithmdistanceresultrunning time
Stroke Aggregatornan
Delaunay Triangulation0.007322467466085853image thumbnaildistance: 0.00732variant: original720.0
Fidelity Simplicity0.0005772461382991158image thumbnaildistance: 0.00058variant: originalalg. parameter: 0.25653.0
Mastering Sketching0.0002822975184950851image thumbnaildistance: 0.00028variant: vectorized (all layers) 1000px6.0
Poly Vector → Stroke Aggregator0.00045200901845109353image thumbnaildistance: 0.00045variant: vectorized (all layers) 1000pxalg. parameter: noisy530.0
Poly Vector0.00031667578173958624image thumbnaildistance: 0.00032variant: vectorized (all layers) 1000px510.0
Real-Time Inking0.00023465877716506318image thumbnaildistance: 0.00023variant: original4.0
Topology Driven → Stroke Aggregator0.0004224483229544651image thumbnaildistance: 0.00042variant: vectorized (all layers) 1000px1277.0
Topology Driven0.000339636734211089image thumbnaildistance: 0.00034variant: vectorized (all layers) 1000px20.0

F12/1000

algorithmdistanceresultrunning time
Stroke Aggregatornan
Fidelity Simplicity0.5468111016553843image thumbnaildistance: 0.54681variant: thresholded 500pxalg. parameter: 0.75151.0
Mastering Sketching0.9371135266718386image thumbnaildistance: 0.93711variant: thresholded 500px6.0
Poly Vector → Stroke Aggregator0.4113243334252789image thumbnaildistance: 0.41132variant: vectorized (all layers) 500pxalg. parameter: noisy26.0
Poly Vector0.4233951823422668image thumbnaildistance: 0.4234variant: vectorized (all layers) 500pxalg. parameter: noisy89.0
Real-Time Inking0.8985753228100839image thumbnaildistance: 0.89858variant: vectorized (all layers) 500px2.0
Topology Driven → Stroke Aggregator0.801080757451316image thumbnaildistance: 0.80108variant: thresholded 500px549.0
Topology Driven0.8590630538687382image thumbnaildistance: 0.85906variant: original293.0
Delaunay Triangulation0.1655826476282672image thumbnaildistance: 0.16558variant: vectorized (all layers) 500px4.0

F14/1000

algorithmdistanceresultrunning time
Stroke Aggregatornan
Fidelity Simplicity0.6940751471515785image thumbnaildistance: 0.69408variant: thresholded 500pxalg. parameter: 0.75151.0
Mastering Sketching0.9830430100284344image thumbnaildistance: 0.98304variant: thresholded 500px6.0
Poly Vector → Stroke Aggregator0.4737763975684077image thumbnaildistance: 0.47378variant: vectorized (all layers) 500pxalg. parameter: noisy26.0
Poly Vector0.4834422041648677image thumbnaildistance: 0.48344variant: vectorized (all layers) 500px89.0
Real-Time Inking0.9426684966798256image thumbnaildistance: 0.94267variant: vectorized (all layers) 500px2.0
Topology Driven → Stroke Aggregator0.9122022151511452image thumbnaildistance: 0.9122variant: thresholded 500px549.0
Topology Driven0.9356296907672478image thumbnaildistance: 0.93563variant: original293.0
Delaunay Triangulation0.28449100234154073image thumbnaildistance: 0.28449variant: vectorized (all layers) 500px4.0

F16/1000

algorithmdistanceresultrunning time
Stroke Aggregatornan
Delaunay Triangulation0.4118270400155085image thumbnaildistance: 0.41183variant: vectorized (all layers) 500px4.0
Fidelity Simplicity0.8151080162086617image thumbnaildistance: 0.81511variant: thresholded 500pxalg. parameter: 0.75151.0
Mastering Sketching0.9896078815236288image thumbnaildistance: 0.98961variant: thresholded 1000px7.0
Poly Vector → Stroke Aggregator0.5315096116207388image thumbnaildistance: 0.53151variant: vectorized (all layers) 500pxalg. parameter: noisy26.0
Poly Vector0.5395807539036283image thumbnaildistance: 0.53958variant: vectorized (all layers) 500pxalg. parameter: noisy89.0
Real-Time Inking0.9551502775180774image thumbnaildistance: 0.95515variant: vectorized (all layers) 500px2.0
Topology Driven → Stroke Aggregator0.9535956192614959image thumbnaildistance: 0.9536variant: thresholded 500px549.0
Topology Driven0.9586257661269536image thumbnaildistance: 0.95863variant: original293.0

F18/1000

algorithmdistanceresultrunning time
Fidelity Simplicity0.8767509643626109image thumbnaildistance: 0.87675variant: thresholded 500pxalg. parameter: 0.75151.0
Stroke Aggregatornan
Delaunay Triangulation0.5075154943368637image thumbnaildistance: 0.50752variant: vectorized (all layers) 500px4.0
Mastering Sketching0.9922658552399666image thumbnaildistance: 0.99227variant: thresholded 1000px7.0
Poly Vector → Stroke Aggregator0.5863494520191944image thumbnaildistance: 0.58635variant: vectorized (all layers) 500pxalg. parameter: noisy26.0
Poly Vector0.5944371228518567image thumbnaildistance: 0.59444variant: vectorized (all layers) 500px89.0
Real-Time Inking0.9626076790827643image thumbnaildistance: 0.96261variant: vectorized (all layers) 500px2.0
Topology Driven → Stroke Aggregator0.9711918499317821image thumbnaildistance: 0.97119variant: thresholded 500px549.0
Topology Driven0.9717797956822916image thumbnaildistance: 0.97178variant: original293.0

F110/1000

algorithmdistanceresultrunning time
Delaunay Triangulation0.6096031738442116image thumbnaildistance: 0.6096variant: vectorized (all layers) 500px4.0
Stroke Aggregatornan
Mastering Sketching0.9947947279762596image thumbnaildistance: 0.99479variant: thresholded 1000px7.0
Poly Vector → Stroke Aggregator0.6425421574202294image thumbnaildistance: 0.64254variant: vectorized (all layers) 500pxalg. parameter: noisy26.0
Poly Vector0.6504939945742011image thumbnaildistance: 0.65049variant: vectorized (all layers) 500pxalg. parameter: noisy89.0
Topology Driven → Stroke Aggregator0.9814869261453498image thumbnaildistance: 0.98149variant: thresholded 500px549.0
Topology Driven0.9808697635852034image thumbnaildistance: 0.98087variant: original293.0
Fidelity Simplicity0.9130523752768038image thumbnaildistance: 0.91305variant: thresholded 500pxalg. parameter: 0.75151.0
Real-Time Inking0.968705983220038image thumbnaildistance: 0.96871variant: vectorized (all layers) 500px2.0

Hausdorff

algorithmdistanceresultrunning time
Fidelity Simplicity0.028999999999999998image thumbnaildistance: 0.029variant: thresholded 1000pxalg. parameter: 0.6221.0
Poly Vector0.013000000000000001image thumbnaildistance: 0.013variant: vectorized (all layers) 1000pxalg. parameter: noisy512.0
Real-Time Inking0.019250253292806486image thumbnaildistance: 0.01925variant: original4.0
Stroke Aggregatornan
Delaunay Triangulation0.11820934415467485image thumbnaildistance: 0.11821variant: original720.0
Mastering Sketching0.1563201904296875image thumbnaildistance: 0.15632variant: thresholded 500px6.0
Poly Vector → Stroke Aggregator0.016763053894042968image thumbnaildistance: 0.01676variant: vectorized (all layers) 1000pxalg. parameter: noisy530.0
Topology Driven → Stroke Aggregator0.005image thumbnaildistance: 0.005variant: vectorized (all layers) 1000px1277.0
Topology Driven0.006image thumbnaildistance: 0.006variant: vectorized (all layers) 1000px20.0

Automatic results for each input variant

Column visibility:

variantTopology Driven → Stroke Aggregator Real-Time Inking Mastering Sketching Fidelity Simplicity 0.3Fidelity Simplicity 0.25Fidelity Simplicity 0.5Fidelity Simplicity 0.75Fidelity Simplicity 0.6Topology Driven Poly Vector noisyPoly Vector Delaunay Triangulation Stroke Aggregator Poly Vector → Stroke Aggregator noisyPoly Vector → Stroke Aggregator
original image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail
thresholded image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail
thresholded 1000px image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail
thresholded 500px image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail
vectorized (all layers) 1000px image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail
vectorized (all layers) 500px image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail