Structured Annotations for 2D-to-3D Modeling

Yotam Gingold (NYU / JST ERATO), Takeo Igarashi (University of Tokyo / JST ERATO), Denis Zorin (NYU)
ACM Transactions on Graphics (TOG) 28(5):148:1–148:9. Also in Proceedings of SIGGRAPH Asia 2009.

Paper (8M)
User study data: figures (1M) | OBJ files (2M)
Presentation slides: Keynote '09 (45M) | PDF with notes (6M) | PDF w/o notes (6M)

Source code (3M) public domain!
OS X application (OSX, 93M) public domain!
3D models (OBJ format, 6.1M) public domain!


We present a system for 3D modeling of free-form surfaces from 2D sketches. Our system frees users to create 2D sketches from arbitrary angles using their preferred tool, which may include pencil and paper. A 3D model is created by placing primitives and annotations on the 2D image. Our primitives are based on commonly used sketching conventions and allow users to maintain a single view of the model. This eliminates the frequent view changes inherent to existing 3D modeling tools, both traditional and sketch-based, and enables users to match input to the 2D guide image. Our annotations---same-lengths and angles, alignment, mirror symmetry, and connection curves---allow the user to communicate higher-level semantic information; through them our system builds a consistent model even in cases where the original image is inconsistent. We present the results of a user study comparing our approach to a conventional ``sketch-rotate-sketch'' workflow.

Video MP4 (30M) | YouTube:

Additional modeling session movies: Making Man on Arrow (17M) | Making Kat Girl (56M)

Copyrighted images are used with permission, courtesy of Kei Acedera, Preston Blair, Björn Hurri, Satoshi Kako, Chris Onstad, Alex Rosmarin, and Glenn Vilppu. Please see the paper for specific image attributions.

BibTeX (or see ACM page)

 author    = {Yotam Gingold and Takeo Igarashi and Denis Zorin},
 title     = {Structured Annotations for 2{D}-to-3{D} Modeling},
 journal   = {ACM Transactions on Graphics (TOG)},
 volume    = {28},
 number    = {5},
 year      = {2009},
 pages     = {148},
 issn = {0730-0301},
 doi = {},
 publisher = {ACM Press},
 address   = {New York, NY, USA}