research-article

Structured annotations for 2D-to-3D modeling

Authors:

Takeo Igarashi,

Denis ZorinAuthors Info & Claims

SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers

Article No.: 148, Pages 1 - 9

https://doi.org/10.1145/1661412.1618494

Published: 01 December 2009 Publication History

Abstract

We present a system for 3D modeling of free-form surfaces from 2D sketches. Our system frees users to create 2D sketches from arbitrary angles using their preferred tool, which may include pencil and paper. A 3D model is created by placing primitives and annotations on the 2D image. Our primitives are based on commonly used sketching conventions and allow users to maintain a single view of the model. This eliminates the frequent view changes inherent to existing 3D modeling tools, both traditional and sketch-based, and enables users to match input to the 2D guide image. Our annotations---same-lengths and angles, alignment, mirror symmetry, and connection curves---allow the user to communicate higher-level semantic information; through them our system builds a consistent model even in cases where the original image is inconsistent. We present the results of a user study comparing our approach to a conventional "sketch-rotate-sketch" workflow.

Supplementary Material

Supplemental material. (148-gingold.zip)

"auxiliary_user_study_data.pdf": Additional data from our user studies. "comparison_study/subject_N_FiberMesh.obj": The model created by comparison study subject #N using FiberMesh. "comparison_study/subject_N_our-system.obj": The model created by comparison study subject #N using our system. "making_kat-girl.mov": Screen recording of the "Kat Girl" model being created in our system. "making_man-on-arrow.mov": Screen recording of the "Man on Arrow" model being created in our system.

Download
121.33 MB

References

[1]

Adobe, 2007. Illustrator. http://www.adobe.com/products/illustrator/.

[2]

Agrawala, M., Zorin, D., and Munzner, T. 2000. Artistic multiprojection rendering. In Proceedings of the Eurographics Workshop on Rendering Techniques, 125--136.

Digital Library

[3]

Andre, A., Saito, S., and Nakajima, M. 2007. CrossSketch: Freeform surface modeling with details. In Eurographics Workshop on Sketch-Based Interfaces and Modeling (SBM), 45--52.

Digital Library

[4]

Autodesk, 2009. Maya. http://www.autodesk.com/maya.

[5]

Bae, S.-H., Balakrishnan, R., and Singh, K. 2008. ILoveSketch: As-natural-as-possible sketching system for creating 3D curve models. In Proceedings of the ACM symposium on User interface software and technology (UIST), 151--160.

Digital Library

[6]

Blair, P. 1994. Cartoon Animation. Walter Foster, Laguna Hills, California.

[7]

Bloomenthal, J., Ed. 1997. Introduction to Implicit Surfaces. Morgan Kaufmann, San Francisco, California.

Digital Library

[8]

Cabral, M., Lefebvre, S., Dachsbacher, C., and Drettakis, G. 2009. Structure preserving reshape for textured architectural scenes. Computer Graphics Forum 28, 2, 469--480.

[9]

Chen, X., Kang, S. B., Xu, Y.-Q., Dorsey, J., and Shum, H.-Y. 2008. Sketching reality: Realistic interpretation of architectural designs. ACM Transactions on Graphics 27, 2, 11.

Digital Library

[10]

Cherlin, J. J., Samavati, F., Sousa, M. C., and Jorge, J. A. 2005. Sketch-based modeling with few strokes. In Proceedings of the Spring Conference on Computer Graphics, 137--145.

Digital Library

[11]

Cordier, F., and Seo, H. 2007. Free-form sketching of self-occluding objects. IEEE Computer Graphics and Applications 27, 1, 50--59.

Digital Library

[12]

Debevec, P. E., Taylor, C. J., and Malik, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In Proceedings of ACM SIGGRAPH, 11--20.

Digital Library

[13]

Dorsey, J., Xu, S., Smedresman, G., Rushmeier, H., and McMillan, L. 2007. The mental canvas: A tool for conceptual architectural design and analysis. In Proceedings of Pacific Graphics, 201--210.

Digital Library

[14]

Eggli, L., Hsu, C.-Y., Bruderlin, B. D., and Elber, G. 1997. Inferring 3D models from freehand sketches and constraints. Computer-Aided Design 29, 2 (February), 101--112.

[15]

Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: A sketching interface for 3D freeform design. In Proceedings of ACM SIGGRAPH, 409--416.

Digital Library

[16]

Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-rigid-as-possible shape manipulation. ACM Transactions on Graphics 24, 3, 1134--1141.

Digital Library

[17]

Infografica, R., 2009. MetaReyes. http://www.reyes-infografica.com/plugins/meta.php.

[18]

Kako, S. 1973. Karasu no Panya-san. Kaiseisha, Tokyo, Japan. Pages 18--19.

[19]

Kallio, K. 2005. 3D6B editor: Projective 3D sketching with line-based rendering. In Eurographics Workshop on Sketch-Based Interfaces and Modeling (SBM), 73--80.

[20]

Karpenko, O. A., and Hughes, J. F. 2006. SmoothSketch: 3D free-form shapes from complex sketches. ACM Transactions on Graphics 25, 3, 589--598.

Digital Library

[21]

Koenderink, J. J., van Doorn, A. J., and Kappers, A. M. L. 1992. Surface perception in pictures. Perception&Psychophysics 52, 5, 487--496.

[22]

Loran, E. 1943. Cezanne's Composition. University of California Press.

[23]

Microsoft, 2003. Office. http://office.microsoft.com.

[24]

Nealen, A., Igarashi, T., Sorkine, O., and Alexa, M. 2007. FiberMesh: Designing freeform surfaces with 3D curves. ACM Transactions on Graphics 26, 3, 41.

Digital Library

[25]

Olsen, L., Samavati, F. F., Costa Sousa, M., and Jorge, J. 2008. A taxonomy of modeling techniques using sketch-based interfaces. In Eurographics State of the Art Reports.

[26]

Peng, J., Kristjansson, D., and Zorin, D. 2004. Interactive modeling of topologically complex geometric detail. ACM Transactions on Graphics 23, 3, 635--643.

Digital Library

[27]

Prados, E. 2004. Application of the theory of the viscosity solutions to the Shape From Shading problem. PhD thesis, University of Nice-Sophia Antipolis.

[28]

Schmidt, R., Isenberg, T., Jepp, P., Singh, K., and Wyvill, B. 2007. Sketching, scaffolding, and inking: A visual history for interactive 3D modeling. In Proceedings of NPAR, 23--32.

Digital Library

[29]

Schmidt, R., Singh, K., and Balakrishnan, R. 2008. Sketching and composing widgets for 3D manipulation. Computer Graphics Forum 27, 2, 301--310.

[30]

Sinha, S. N., Steedly, D., Szeliski, R., Agrawala, M., and Pollefeys, M. 2008. Interactive 3D architectural modeling from unordered photo collections. ACM Transactions on Graphics 27, 5, 159.

Digital Library

[31]

Sorkine, O., Cohen-Or, D., Lipman, Y., Alexa, M., Rössl, C., and Seidel, H.-P. 2004. Laplacian surface editing. In Proceedings of Eurographics/ACM SGP, 175--184.

Digital Library

[32]

Thormählen, T., and Seidel, H.-P. 2008. 3D-modeling by ortho-image generation from image sequences. ACM Transactions on Graphics 27, 3, 86.

Digital Library

[33]

Tsang, S., Balakrishnan, R., Singh, K., and Ranjan, A. 2004. A suggestive interface for image guided 3D sketching. In Proceedings of ACM SIGCHI, 591--598.

Digital Library

[34]

van den Hengel, A., Dick, A., Thormählen, T., Ward, B., and Torr, P. H. S. 2007. VideoTrace: Rapid interactive scene modelling from video. ACM Transactions on Graphics 26, 3, 86.

Digital Library

[35]

Varley, P., and Company, P. 2007. Sketch input of 3D models: Current directions. In VISAPP 2007: 2nd International Conference on Computer Vision Theory and Applications, 85--91.

[36]

Vilppu, G. 1997. Vilppu Drawing Manual. Vilppu Studio, Acton, California.

[37]

Wu, T.-P., Tang, C.-K., Brown, M. S., and Shum, H.-Y. 2007. ShapePalettes: Interactive normal transfer via sketching. ACM Transactions on Graphics 26, 3, 44.

Digital Library

[38]

Zeleznik, R. C., Herndon, K. P., and Hughes, J. F. 1996. SKETCH: An interface for sketching 3D scenes. In Proceedings of ACM SIGGRAPH, 163--170.

Digital Library

[39]

Zhang, L., Dugas-Phocion, G., Samson, J.-S., and Seitz, S. M. 2001. Single view modeling of free-form scenes. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 990--997.

Cited By

Tojo KShamir ABickel BUmetani N(2024)Fabricable 3D Wire ArtACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657453(1-11)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657453
Luo ZDu DZhu HYu YFu HHan X(2024)SketchMetaFace: A Learning-Based Sketching Interface for High-Fidelity 3D Character Face ModelingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329170330:8(5260-5275)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3291703
Chen TDing CZhu LZang YLiao YLi ZSun L(2024)Reality3DSketch: Rapid 3D Modeling of Objects From Single Freehand SketchesIEEE Transactions on Multimedia10.1109/TMM.2023.332753326(4859-4870)Online publication date: 2024
https://doi.org/10.1109/TMM.2023.3327533
Show More Cited By

Index Terms

Structured annotations for 2D-to-3D modeling
1. Computing methodologies
  1. Computer graphics
    1. Shape modeling
2. Theory of computation
  1. Randomness, geometry and discrete structures
    1. Computational geometry

Recommendations

3D modeling with silhouettes
SIGGRAPH '10: ACM SIGGRAPH 2010 papers

We present a new sketch-based modeling approach in which models are interactively designed by drawing their 2D silhouettes from different views. The core idea of our paper is to limit the input to 2D silhouettes, removing the need to explicitly create ...
Structured annotations for 2D-to-3D modeling

We present a system for 3D modeling of free-form surfaces from 2D sketches. Our system frees users to create 2D sketches from arbitrary angles using their preferred tool, which may include pencil and paper. A 3D model is created by placing primitives ...
Shading-based surface editing

We present a system for free-form surface modeling that allows a user to modify a shape by changing its rendered, shaded image using stroke-based drawing tools. User input is translated into a set of tangent and positional constraints on the surface. A ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers

December 2009

669 pages

ISBN:9781605588582

DOI:10.1145/1661412

Conference Chair:
Masa Inakage
Keio University

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SA09

Sponsor:

SIGGRAPH

SA09: SIGGRAPH ASIA 2009

December 16 - 19, 2009

Yokohama, Japan

Acceptance Rates

SIGGRAPH Asia '09 Paper Acceptance Rate 70 of 275 submissions, 25%;

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
2,049
Total Downloads

Downloads (Last 12 months)75
Downloads (Last 6 weeks)12

Reflects downloads up to 04 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tojo KShamir ABickel BUmetani N(2024)Fabricable 3D Wire ArtACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657453(1-11)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657453
Luo ZDu DZhu HYu YFu HHan X(2024)SketchMetaFace: A Learning-Based Sketching Interface for High-Fidelity 3D Character Face ModelingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329170330:8(5260-5275)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3291703
Chen TDing CZhu LZang YLiao YLi ZSun L(2024)Reality3DSketch: Rapid 3D Modeling of Objects From Single Freehand SketchesIEEE Transactions on Multimedia10.1109/TMM.2023.332753326(4859-4870)Online publication date: 2024
https://doi.org/10.1109/TMM.2023.3327533
Xiao TKim KKrukar JSubramaniyan RKiefer PSchwering ARaubal M(2024)VResin: Externalizing spatial memory into 3D sketch mapsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103322190(103322)Online publication date: Oct-2024
https://doi.org/10.1016/j.ijhcs.2024.103322
Chen TFu CZang YZhu LZhang JMao PSun L(2023)Deep3DSketch+: Rapid 3D Modeling from Single Free-Hand SketchesMultiMedia Modeling10.1007/978-3-031-27818-1_2(16-28)Online publication date: 9-Jan-2023
https://dl.acm.org/doi/10.1007/978-3-031-27818-1_2
Hähnlein FGryaditskaya YSheffer ABousseau A(2022)Symmetry-driven 3D Reconstruction from Concept SketchesSpecial Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings10.1145/3528233.3530723(1-8)Online publication date: 7-Aug-2022
https://doi.org/10.1145/3528233.3530723
Unlu GSayed MBrostow G(2022)Interactive Sketching of Mannequin Poses2022 International Conference on 3D Vision (3DV)10.1109/3DV57658.2022.00080(700-710)Online publication date: Sep-2022
https://doi.org/10.1109/3DV57658.2022.00080
Luo ZZhou JZhu HDu DHan XFu H(2021)SimpModeling: Sketching Implicit Field to Guide Mesh Modeling for 3D Animalmorphic Head DesignThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474791(854-863)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474791
Yan GChen ZYang JWang H(2020)Interactive liquid splash modeling by user sketchesACM Transactions on Graphics10.1145/3414685.341783239:6(1-13)Online publication date: 27-Nov-2020
https://dl.acm.org/doi/10.1145/3414685.3417832
Jayaraman PFu CZheng JLiu XWong T(2018)Globally Consistent Wrinkle-Aware Shading of Line DrawingsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.270518224:7(2103-2117)Online publication date: 1-Jul-2018
https://doi.org/10.1109/TVCG.2017.2705182
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten