A Benchmark for Rough Sketch Cleanup


Ind_architecture_baseline_04

Author: Baseline Licence: Academic Paper
Messiness:  0.12374
Ambiguity (Chamfer):  0.19677
Shading:  Yes
Scaffold:  No
Texture Strokes:  No
Background:  Clean (Vector)
rough image

Best automatic results (chamfer distance)

Column visibility:

Best automatic results

OriginalGround TruthMastering SketchingReal-Time InkingPoly VectorTopology DrivenStroke AggregatorDelaunay TriangulationFidelity Simplicity
image thumbnailimage thumbnailimage thumbnailimage thumbnailimage thumbnaildistance: 0.00131image thumbnaildistance: 0.0014image thumbnaildistance: 0.00142image thumbnaildistance: 0.00144image thumbnaildistance: 0.00155image thumbnaildistance: 0.0026image thumbnaildistance: 0.00861

Rough Sketch

Column visibility:

originalthresholdedall layersshapelightingscaffoldshading
image thumbnailimage thumbnail

Ground Truth

Column visibility:

artistall layersshapescaffoldshadingcolor regiontextextra
Branislav Mirkovicimage thumbnailimage thumbnailimage thumbnail
Ge Jinimage thumbnailimage thumbnailimage thumbnailimage thumbnail
Santiago Rialimage thumbnailimage thumbnailimage thumbnail

Automatic results, best result per algorithm

Select metric

Column visibility:

Display labels:

Chamfer

algorithmdistanceresultrunning time
Fidelity Simplicity0.008613722808291698image thumbnaildistance: 0.00861variant: original 500pxalg. parameter: 0.251490.0
Poly Vector → Stroke Aggregatornan
Topology Driven → Stroke Aggregatornan
Delaunay Triangulation0.0025963736323073765image thumbnaildistance: 0.0026variant: original28.0
Mastering Sketching0.0013132947064531599image thumbnaildistance: 0.00131variant: original 1000px6.0
Poly Vector0.0014174128666106295image thumbnaildistance: 0.00142variant: originalalg. parameter: noisy564.0
Real-Time Inking0.0014033009518306756image thumbnaildistance: 0.0014variant: original4.0
Stroke Aggregator0.0015519276780315274image thumbnaildistance: 0.00155variant: vectorized (all layers)1251.0
Topology Driven0.0014369100402497534image thumbnaildistance: 0.00144variant: original90.0

F12/1000

algorithmdistanceresultrunning time
Fidelity Simplicity0.3414089571893452image thumbnaildistance: 0.34141variant: original 500pxalg. parameter: 0.61752.0
Mastering Sketching0.6936418422934125image thumbnaildistance: 0.69364variant: original 1000px6.0
Poly Vector → Stroke Aggregatornan
Real-Time Inking0.5909557680069489image thumbnaildistance: 0.59096variant: original 1000px3.0
Stroke Aggregator0.6292840258907433image thumbnaildistance: 0.62928variant: vectorized (all layers)1251.0
Topology Driven → Stroke Aggregatornan
Topology Driven0.6110700116706717image thumbnaildistance: 0.61107variant: original 500px12.0
Delaunay Triangulation0.2659302368684435image thumbnaildistance: 0.26593variant: original 500px4.0
Poly Vector0.4208767996250965image thumbnaildistance: 0.42088variant: original 500pxalg. parameter: noisy160.0

F14/1000

algorithmdistanceresultrunning time
Delaunay Triangulation0.3836224601267206image thumbnaildistance: 0.38362variant: original 500px4.0
Poly Vector → Stroke Aggregatornan
Topology Driven → Stroke Aggregatornan
Fidelity Simplicity0.4961163867526536image thumbnaildistance: 0.49612variant: original 500pxalg. parameter: 0.61752.0
Mastering Sketching0.8498380472314989image thumbnaildistance: 0.84984variant: original 1000px6.0
Poly Vector0.5549199481106325image thumbnaildistance: 0.55492variant: original 500px163.0
Real-Time Inking0.7675855174254209image thumbnaildistance: 0.76759variant: original 500px3.0
Stroke Aggregator0.8239065517138421image thumbnaildistance: 0.82391variant: vectorized (all layers)1251.0
Topology Driven0.8062010781988167image thumbnaildistance: 0.8062variant: original 500px12.0

F16/1000

algorithmdistanceresultrunning time
Delaunay Triangulation0.499557381025276image thumbnaildistance: 0.49956variant: original 500px4.0
Poly Vector → Stroke Aggregatornan
Topology Driven → Stroke Aggregatornan
Fidelity Simplicity0.5711662031740385image thumbnaildistance: 0.57117variant: originalalg. parameter: 0.75262.0
Mastering Sketching0.9208524699703508image thumbnaildistance: 0.92085variant: original 1000px6.0
Poly Vector0.6690298591424749image thumbnaildistance: 0.66903variant: original 500pxalg. parameter: noisy160.0
Real-Time Inking0.8575131717705966image thumbnaildistance: 0.85751variant: original 500px3.0
Stroke Aggregator0.9049557114113698image thumbnaildistance: 0.90496variant: vectorized (all layers)1251.0
Topology Driven0.9032712354350276image thumbnaildistance: 0.90327variant: original 500px12.0

F18/1000

algorithmdistanceresultrunning time
Delaunay Triangulation0.5894609052559572image thumbnaildistance: 0.58946variant: original 500px4.0
Poly Vector → Stroke Aggregatornan
Topology Driven → Stroke Aggregatornan
Mastering Sketching0.9557242223467683image thumbnaildistance: 0.95572variant: original 500px7.0
Poly Vector0.7538006092246191image thumbnaildistance: 0.7538variant: original 500px163.0
Real-Time Inking0.9028252596744846image thumbnaildistance: 0.90283variant: original 500px3.0
Stroke Aggregator0.9513285830855108image thumbnaildistance: 0.95133variant: vectorized (all layers)1251.0
Topology Driven0.9514748607478009image thumbnaildistance: 0.95147variant: original 500px12.0
Fidelity Simplicity0.6261803286935457image thumbnaildistance: 0.62618variant: original 1000pxalg. parameter: 0.75210.0

F110/1000

algorithmdistanceresultrunning time
Poly Vector → Stroke Aggregatornan
Topology Driven → Stroke Aggregatornan
Delaunay Triangulation0.6704892074277883image thumbnaildistance: 0.67049variant: original 500px4.0
Mastering Sketching0.973836011504158image thumbnaildistance: 0.97384variant: original 500px7.0
Poly Vector0.8129894221163745image thumbnaildistance: 0.81299variant: original 500pxalg. parameter: noisy160.0
Real-Time Inking0.9338637165767693image thumbnaildistance: 0.93386variant: original 500px3.0
Stroke Aggregator0.9699638408445058image thumbnaildistance: 0.96996variant: vectorized (all layers)1251.0
Topology Driven0.9720668367991192image thumbnaildistance: 0.97207variant: original 500px12.0
Fidelity Simplicity0.6611312387312827image thumbnaildistance: 0.66113variant: original 1000pxalg. parameter: 0.3167.0

Hausdorff

algorithmdistanceresultrunning time
Fidelity Simplicity0.07375635528564453image thumbnaildistance: 0.07376variant: original 500pxalg. parameter: 0.51720.0
Mastering Sketching0.109123779296875image thumbnaildistance: 0.10912variant: original 500px7.0
Poly Vector → Stroke Aggregatornan
Topology Driven → Stroke Aggregatornan
Topology Driven0.021540658950805664image thumbnaildistance: 0.02154variant: original 500px12.0
Delaunay Triangulation0.029106300833622364image thumbnaildistance: 0.02911variant: original28.0
Poly Vector0.02121320343017578image thumbnaildistance: 0.02121variant: original 1000px323.0
Real-Time Inking0.021631004743891263image thumbnaildistance: 0.02163variant: original4.0
Stroke Aggregator0.020900214560527892image thumbnaildistance: 0.0209variant: vectorized (all layers)1251.0

Automatic results for each input variant

Column visibility:

variantTopology Driven → Stroke Aggregator Real-Time Inking Mastering Sketching Fidelity Simplicity 0.3Fidelity Simplicity 0.25Fidelity Simplicity 0.5Fidelity Simplicity 0.75Fidelity Simplicity 0.6Topology Driven Poly Vector noisyPoly Vector Delaunay Triangulation Stroke Aggregator Poly Vector → Stroke Aggregator noisyPoly Vector → Stroke Aggregator
original image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail
original 1000px image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail
original 500px image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail image thumbnail
vectorized (all layers) image thumbnail