research-article

Structured annotations for 2D-to-3D modeling

Authors:

Takeo Igarashi,

Denis ZorinAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 28, Issue 5

Pages 1 - 9

https://doi.org/10.1145/1618452.1618494

Published: 01 December 2009 Publication History

Abstract

We present a system for 3D modeling of free-form surfaces from 2D sketches. Our system frees users to create 2D sketches from arbitrary angles using their preferred tool, which may include pencil and paper. A 3D model is created by placing primitives and annotations on the 2D image. Our primitives are based on commonly used sketching conventions and allow users to maintain a single view of the model. This eliminates the frequent view changes inherent to existing 3D modeling tools, both traditional and sketch-based, and enables users to match input to the 2D guide image. Our annotations---same-lengths and angles, alignment, mirror symmetry, and connection curves---allow the user to communicate higher-level semantic information; through them our system builds a consistent model even in cases where the original image is inconsistent. We present the results of a user study comparing our approach to a conventional "sketch-rotate-sketch" workflow.

Supplementary Material

Supplemental material. (148-gingold.zip)

"auxiliary_user_study_data.pdf": Additional data from our user studies. "comparison_study/subject_N_FiberMesh.obj": The model created by comparison study subject #N using FiberMesh. "comparison_study/subject_N_our-system.obj": The model created by comparison study subject #N using our system. "making_kat-girl.mov": Screen recording of the "Kat Girl" model being created in our system. "making_man-on-arrow.mov": Screen recording of the "Man on Arrow" model being created in our system.

Download
121.33 MB

References

[1]

Adobe, 2007. Illustrator. http://www.adobe.com/products/illustrator/.

[2]

Agrawala, M., Zorin, D., and Munzner, T. 2000. Artistic multiprojection rendering. In Proceedings of the Eurographics Workshop on Rendering Techniques, 125--136.

Digital Library

[3]

Andre, A., Saito, S., and Nakajima, M. 2007. CrossSketch: Freeform surface modeling with details. In Eurographics Workshop on Sketch-Based Interfaces and Modeling (SBM), 45--52.

Digital Library

[4]

Autodesk, 2009. Maya. http://www.autodesk.com/maya.

[5]

Bae, S.-H., Balakrishnan, R., and Singh, K. 2008. ILoveSketch: As-natural-as-possible sketching system for creating 3D curve models. In Proceedings of the ACM symposium on User interface software and technology (UIST), 151--160.

Digital Library

[6]

Blair, P. 1994. Cartoon Animation. Walter Foster, Laguna Hills, California.

[7]

Bloomenthal, J., Ed. 1997. Introduction to Implicit Surfaces. Morgan Kaufmann, San Francisco, California.

Digital Library

[8]

Cabral, M., Lefebvre, S., Dachsbacher, C., and Drettakis, G. 2009. Structure preserving reshape for textured architectural scenes. Computer Graphics Forum 28, 2, 469--480.

[9]

Chen, X., Kang, S. B., Xu, Y.-Q., Dorsey, J., and Shum, H.-Y. 2008. Sketching reality: Realistic interpretation of architectural designs. ACM Transactions on Graphics 27, 2, 11.

Digital Library

[10]

Cherlin, J. J., Samavati, F., Sousa, M. C., and Jorge, J. A. 2005. Sketch-based modeling with few strokes. In Proceedings of the Spring Conference on Computer Graphics, 137--145.

Digital Library

[11]

Cordier, F., and Seo, H. 2007. Free-form sketching of self-occluding objects. IEEE Computer Graphics and Applications 27, 1, 50--59.

Digital Library

[12]

Debevec, P. E., Taylor, C. J., and Malik, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In Proceedings of ACM SIGGRAPH, 11--20.

Digital Library

[13]

Dorsey, J., Xu, S., Smedresman, G., Rushmeier, H., and McMillan, L. 2007. The mental canvas: A tool for conceptual architectural design and analysis. In Proceedings of Pacific Graphics, 201--210.

Digital Library

[14]

Eggli, L., Hsu, C.-Y., Bruderlin, B. D., and Elber, G. 1997. Inferring 3D models from freehand sketches and constraints. Computer-Aided Design 29, 2 (February), 101--112.

[15]

Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: A sketching interface for 3D freeform design. In Proceedings of ACM SIGGRAPH, 409--416.

Digital Library

[16]

Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-rigid-as-possible shape manipulation. ACM Transactions on Graphics 24, 3, 1134--1141.

Digital Library

[17]

Infografica, R., 2009. MetaReyes. http://www.reyes-infografica.com/plugins/meta.php.

[18]

Kako, S. 1973. Karasu no Panya-san. Kaiseisha, Tokyo, Japan. Pages 18--19.

[19]

Kallio, K. 2005. 3D6B editor: Projective 3D sketching with line-based rendering. In Eurographics Workshop on Sketch-Based Interfaces and Modeling (SBM), 73--80.

[20]

Karpenko, O. A., and Hughes, J. F. 2006. SmoothSketch: 3D free-form shapes from complex sketches. ACM Transactions on Graphics 25, 3, 589--598.

Digital Library

[21]

Koenderink, J. J., van Doorn, A. J., and Kappers, A. M. L. 1992. Surface perception in pictures. Perception&Psychophysics 52, 5, 487--496.

[22]

Loran, E. 1943. Cezanne's Composition. University of California Press.

[23]

Microsoft, 2003. Office. http://office.microsoft.com.

[24]

Nealen, A., Igarashi, T., Sorkine, O., and Alexa, M. 2007. FiberMesh: Designing freeform surfaces with 3D curves. ACM Transactions on Graphics 26, 3, 41.

Digital Library

[25]

Olsen, L., Samavati, F. F., Costa Sousa, M., and Jorge, J. 2008. A taxonomy of modeling techniques using sketch-based interfaces. In Eurographics State of the Art Reports.

[26]

Peng, J., Kristjansson, D., and Zorin, D. 2004. Interactive modeling of topologically complex geometric detail. ACM Transactions on Graphics 23, 3, 635--643.

Digital Library

[27]

Prados, E. 2004. Application of the theory of the viscosity solutions to the Shape From Shading problem. PhD thesis, University of Nice-Sophia Antipolis.

[28]

Schmidt, R., Isenberg, T., Jepp, P., Singh, K., and Wyvill, B. 2007. Sketching, scaffolding, and inking: A visual history for interactive 3D modeling. In Proceedings of NPAR, 23--32.

Digital Library

[29]

Schmidt, R., Singh, K., and Balakrishnan, R. 2008. Sketching and composing widgets for 3D manipulation. Computer Graphics Forum 27, 2, 301--310.

[30]

Sinha, S. N., Steedly, D., Szeliski, R., Agrawala, M., and Pollefeys, M. 2008. Interactive 3D architectural modeling from unordered photo collections. ACM Transactions on Graphics 27, 5, 159.

Digital Library

[31]

Sorkine, O., Cohen-Or, D., Lipman, Y., Alexa, M., Rössl, C., and Seidel, H.-P. 2004. Laplacian surface editing. In Proceedings of Eurographics/ACM SGP, 175--184.

Digital Library

[32]

Thormählen, T., and Seidel, H.-P. 2008. 3D-modeling by ortho-image generation from image sequences. ACM Transactions on Graphics 27, 3, 86.

Digital Library

[33]

Tsang, S., Balakrishnan, R., Singh, K., and Ranjan, A. 2004. A suggestive interface for image guided 3D sketching. In Proceedings of ACM SIGCHI, 591--598.

Digital Library

[34]

van den Hengel, A., Dick, A., Thormählen, T., Ward, B., and Torr, P. H. S. 2007. VideoTrace: Rapid interactive scene modelling from video. ACM Transactions on Graphics 26, 3, 86.

Digital Library

[35]

Varley, P., and Company, P. 2007. Sketch input of 3D models: Current directions. In VISAPP 2007: 2nd International Conference on Computer Vision Theory and Applications, 85--91.

[36]

Vilppu, G. 1997. Vilppu Drawing Manual. Vilppu Studio, Acton, California.

[37]

Wu, T.-P., Tang, C.-K., Brown, M. S., and Shum, H.-Y. 2007. ShapePalettes: Interactive normal transfer via sketching. ACM Transactions on Graphics 26, 3, 44.

Digital Library

[38]

Zeleznik, R. C., Herndon, K. P., and Hughes, J. F. 1996. SKETCH: An interface for sketching 3D scenes. In Proceedings of ACM SIGGRAPH, 163--170.

Digital Library

[39]

Zhang, L., Dugas-Phocion, G., Samson, J.-S., and Seitz, S. M. 2001. Single view modeling of free-form scenes. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 990--997.

Cited By

Binninger AHertz ASorkine‐Hornung OCohen‐Or DGiryes R(2024)SENS: Part‐Aware Sketch‐based Implicit Neural Shape ModelingComputer Graphics Forum10.1111/cgf.1501543:2Online publication date: 23-Apr-2024
https://doi.org/10.1111/cgf.15015
Sookkaew JSukmuang RChangjaikla P(2024)A draft drawing structure tool for improve 3D modeling process in student2024 Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI DAMT & NCON)10.1109/ECTIDAMTNCON60518.2024.10480072(377-381)Online publication date: 31-Jan-2024
https://doi.org/10.1109/ECTIDAMTNCON60518.2024.10480072
Han XBrodsky A(2024) DG-ViTh : A decision guidance system for repositories of virtual things Journal of Decision Systems10.1080/12460125.2024.2359166(1-19)Online publication date: 28-May-2024
https://doi.org/10.1080/12460125.2024.2359166
Show More Cited By

Index Terms

Structured annotations for 2D-to-3D modeling
1. Computing methodologies
  1. Computer graphics
    1. Shape modeling
2. Theory of computation
  1. Randomness, geometry and discrete structures
    1. Computational geometry

Recommendations

Structured annotations for 2D-to-3D modeling
SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers

We present a system for 3D modeling of free-form surfaces from 2D sketches. Our system frees users to create 2D sketches from arbitrary angles using their preferred tool, which may include pencil and paper. A 3D model is created by placing primitives ...
Interactive 3D content modeling for Digital Earth

Digital Earth is a global reference model for integrating, processing and visualizing geospatial datasets. In this reference model, various data-types, including Digital Elevation Models (DEM) and imagery (orthophotos), are universally and openly ...
AutoCAD 2014 3D Modeling

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 28, Issue 5

December 2009

646 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1618452

Issue’s Table of Contents

Copyright © 2009 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2009

Published in TOG Volume 28, Issue 5

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

103
Total Citations
View Citations
1,821
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 21 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Binninger AHertz ASorkine‐Hornung OCohen‐Or DGiryes R(2024)SENS: Part‐Aware Sketch‐based Implicit Neural Shape ModelingComputer Graphics Forum10.1111/cgf.1501543:2Online publication date: 23-Apr-2024
https://doi.org/10.1111/cgf.15015
Sookkaew JSukmuang RChangjaikla P(2024)A draft drawing structure tool for improve 3D modeling process in student2024 Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI DAMT & NCON)10.1109/ECTIDAMTNCON60518.2024.10480072(377-381)Online publication date: 31-Jan-2024
https://doi.org/10.1109/ECTIDAMTNCON60518.2024.10480072
Han XBrodsky A(2024) DG-ViTh : A decision guidance system for repositories of virtual things Journal of Decision Systems10.1080/12460125.2024.2359166(1-19)Online publication date: 28-May-2024
https://doi.org/10.1080/12460125.2024.2359166
Puhachov IMartens CKry PBessmeltsev M(2023)Reconstruction of Machine-Made Shapes from Bitmap SketchesACM Transactions on Graphics10.1145/361836142:6(1-16)Online publication date: 5-Dec-2023
https://dl.acm.org/doi/10.1145/3618361
Zhang CYang LChen NVining NSheffer ALau FWang GWang W(2023)CreatureShop: Interactive 3D Character Modeling and Texturing From a Single Color DrawingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.319756029:12(4874-4890)Online publication date: Dec-2023
https://doi.org/10.1109/TVCG.2022.3197560
Deng ZLiu YPan HJabi WZhang JDeng B(2023)Sketch2PQ: Freeform Planar Quadrilateral Mesh Design via a Single SketchIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.317085329:9(3826-3839)Online publication date: 1-Sep-2023
https://doi.org/10.1109/TVCG.2022.3170853
Mikaeili APerel OSafaee MCohen-Or DMahdavi-Amiri A(2023)SKED: Sketch-guided Text-based 3D Editing2023 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV51070.2023.01343(14561-14573)Online publication date: 1-Oct-2023
https://doi.org/10.1109/ICCV51070.2023.01343
Han XBrodsky A(2023)OptiViTh: A Decision Guidance Framework and System for Design, Analysis and Optimization of Cloud-Manufactured Virtual ThingsEnterprise Information Systems10.1007/978-3-031-39386-0_9(175-197)Online publication date: 28-Jul-2023
https://doi.org/10.1007/978-3-031-39386-0_9
Li YWu HXie JHe TJi ZXu G(2022)An Interactive Modeling Method for Complex Hexahedral Mesh Generation with Volumetric SubdivisionJournal of Computer-Aided Design & Computer Graphics10.3724/SP.J.1089.2022.1918434:11(1647-1658)Online publication date: 29-Dec-2022
https://doi.org/10.3724/SP.J.1089.2022.19184
Li J(2022)Semantic Segmentation-Based Adaptive Mining Algorithm for Ceramic Cultural Resource DataMobile Information Systems10.1155/2022/28150772022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/2815077
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents