Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

SecondSkin: sketch-based construction of layered 3D models

Published: 27 July 2015 Publication History

Abstract

SecondSkin is a sketch-based modeling system focused on the creation of structures comprised of layered, shape interdependent 3D volumes. Our approach is built on three novel insights gleaned from an analysis of representative artist sketches. First, we observe that a closed loop of strokes typically define surface patches that bound volumes in conjunction with underlying surfaces. Second, a significant majority of these strokes map to a small set of curve-types, that describe the 3D geometric relationship between the stroke and underlying layer geometry. Third, we find that a few simple geometric features allow us to consistently classify 2D strokes to our proposed set of 3D curve-types. Our algorithm thus processes strokes as they are drawn, identifies their curve-type, and interprets them as 3D curves on and around underlying 3D geometry, using other connected 3D curves for context. Curve loops are automatically surfaced and turned into volumes bound to the underlying layer, creating additional curves and surfaces as necessary. Stroke classification by 15 viewers on a suite of ground truth sketches validates our curve-types and classification algorithm. We evaluate SecondSkin via a compelling gallery of layered 3D models that would be tedious to produce using current sketch modelers.

Supplementary Material

ZIP File (a126-de_paoli.zip)
Supplemental files
MP4 File (a126.mp4)

References

[1]
Andre, A., and Saito, S. 2011. Single-view sketch based modeling. In Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling, ACM, New York, NY, USA, SBIM '11, 133--140.
[2]
Bae, S.-H., Balakrishnan, R., and Singh, K. 2008. ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models. In Proceedings of the 21st annual ACM symposium on User interface software and technology, ACM, New York, NY, USA, UIST '08, 151--160.
[3]
Bessmeltsev, M., Wang, C., Sheffer, A., and Singh, K. 2012. Design-driven quadrangulation of closed 3d curves. ACM Trans. Graph. 31, 6 (Nov.), 178:1--178:11.
[4]
Bloomenthal, J., and Wyvill, B., Eds. 1997. Introduction to Implicit Surfaces. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
[5]
Chadwick, J. E., Haumann, D. R., and Parent, R. E. 1989. Layered construction for deformable animated characters. In SIGGRAPH '89: Proceedings of the 16th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, 243--252.
[6]
Chen, T., Zhu, Z., Shamir, A., Hu, S.-M., and Cohen-Or, D. 2013. 3sweepp: Extracting editable objects from a single photo. ACM Trans. Graph. 32, 6 (Nov.), 195:1--195:10.
[7]
Cutler, B., Dorsey, J., McMillan, L., Müller, M., and Jagnow, R. 2002. A procedural approach to authoring solid models. In Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH '02, 302--311.
[8]
Davies, P., and Scott, K. 2012. Awakening: The Art of Halo 4. Titan Books Limited.
[9]
Fan, Z., Chi, M., Kaufman, A., and Oliveira, M. M. 2004. A Sketch-Based Interface for Collaborative Design. In Sketch Based Interfaces and Modeling, The Eurographics Association, J. A. P. Jorge, E. Galin, and J. F. Hughes, Eds.
[10]
Fan, L., Wang, R., Xu, L., Deng, J., and Liu, L. 2013. Modeling by drawing with shadow guidance. Computer Graphics Forum (Proc. Pacific Graphics) 23, 7, 157--166.
[11]
Igarashi, T., and Mitani, J. 2010. Apparent layer operations for the manipulation of deformable objects. In ACM SIGGRAPH 2010 Papers, ACM, New York, NY, USA, SIGGRAPH '10, 110:1--110:7.
[12]
Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: a sketching interface for 3d freeform design. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, SIGGRAPH '99, 409--416.
[13]
kara, L. B., and Shimada, K. 2007. Sketch-based 3d-shape creation for industrial styling design. IEEE Comput. Graph. Appl. 27, 1 (Jan.), 60--71.
[14]
Nakayama, K., and Shimojo, S. 1992. Experiencing and Perceiving Visual Surfaces. Science 257, 1357--1363.
[15]
Nealen, A., Igarashi, T., Sorkine, O., and Alexa, M. 2007. FiberMesh: designing freeform surfaces with 3d curves. In ACM SIGGRAPH 2007 papers, ACM, New York, NY, USA, SIGGRAPH '07.
[16]
Ohtake, Y., Belyaev, A., and Seidel, H.-P. 2004. Ridge-valley lines on meshes via implicit surface fitting. In ACM SIGGRAPH 2004 Papers, ACM, New York, NY, USA, SIGGRAPH '04, 609--612.
[17]
Olsen, L., Samavati, F. F., Sousa, M. C., and Jorge, J. A. 2009. Sketch-based modeling: A survey. Computers and Graphics 33, 1, 85--103.
[18]
Olsen, L., Samavati, F., and Jorge, J. 2011. NaturaSketch: Modeling from images and natural sketches. IEEE Computer Graphics and Applications 31, 6, 24--34.
[19]
Pratscher, M., Coleman, P., Laszlo, J., and Singh, K. 2005. Outside-in anatomy based character rigging. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, New York, NY, USA, SCA '05, 329--338.
[20]
Rivers, A., Durand, F., and Igarashi, T. 2010. 3d modeling with silhouettes. In ACM SIGGRAPH 2010 papers, ACM, New York, NY, USA, SIGGRAPH '10, 109:1--109:8.
[21]
Robson, C., Maharik, R., Sheffer, A., and Carr, N. 2011. Context-aware garment modeling from sketches. Computers and Graphics (Proc. SMI 2011), 604--613.
[22]
Schmid, J., Senn, M. S., Gross, M., and Sumner, R. W. 2011. Overcoat: An implicit canvas for 3d painting. In ACM SIGGRAPH 2011 Papers, ACM, New York, NY, USA, SIGGRAPH '11, 28:1--28:10.
[23]
Schmidt, R., and Singh, K. 2008. Sketch-based procedural surface modeling and compositing using surface trees. Comput. Graph. Forum 27, 2, 321--330.
[24]
Schmidt, R., and Singh, K. 2010. Meshmixer: An interface for rapid mesh composition. In ACM SIGGRAPH 2010 Talks, ACM, New York, NY, USA, SIGGRAPH '10, 6:1--6:1.
[25]
Schmidt, R., Khan, A., Singh, K., and Kurtenbach, G. 2009. Analytic drawing of 3d scaffolds. ACM Trans. Graph. 28.
[26]
Shapiro, V., Farin, G., Hoschek, J., and S. Kim, M., 2001. Solid modeling.
[27]
Sutherland, I. E. 1964. Sketch pad a man-machine graphical communication system. In Proceedings of the SHARE Design Automation Workshop, ACM, New York, NY, USA, DAC '64, 6.329--6.346.
[28]
Sýkora, D., Kavan, L., Čadí K, M., Jamriška, O., Jacobson, A., Whited, B., Simmons, M., and Sorkine-Hornung, O. 2014. Ink-and-ray: Bas-relief meshes for adding global illumination effects to hand-drawn characters. ACM Transaction on Graphics 33.
[29]
Takayama, K., Panozzo, D., Sorkine-Hornung, A., and Sorkine-Hornung, O. 2013. Sketch-based generation and editing of quad meshes. ACM Trans. Graph. 32, 4 (July), 97:1--97:8.
[30]
Turquin, E., Wither, J., Boissieux, L., Cani, M.-P., and Hughes, J. F. 2007. A sketch-based interface for clothing virtual characters. IEEE Comput. Graph. Appl. 27, 1 (Jan.), 72--81.
[31]
Vaillant, R., Barthe, L., Guennebaud, G., Cani, M.-P., Rohmer, D., Wyvill, B., Gourmel, O., and Paulin, M. 2013. Implicit skinning: Real-time skin deformation with contact modeling. ACM Trans. Graph. 32, 4 (July), 125:1--125:12.
[32]
Volino, P., and Magnenat-Thalmann, N. 2000. Virtual Clothing: Theory and Practice. No. v. 1 in Virtual Clothing: Theory and Practice. Springer.
[33]
Xu, B., Chang, W., Sheffer, A., Bousseau, A., McCrae, J., and Singh, K. 2014. True2form: 3d curve networks from 2d sketches via selective regularization. Transactions on Graphics (Proc. SIGGRAPH 2014) 33, 4.
[34]
Yasseen, Z., Nasri, A., Boukaram, W., Volino, P., Magnenat-Thalmann, N., et al. 2013. Sketch-based garment design with quad meshes. Computer-Aided Design.
[35]
Zimmermann, J., Nealen, A., and Alexa, M. 2007. Silsketch: Automated sketch-based editing of surface meshes. In Proceedings of the 4th Eurographics Workshop on Sketch-based Interfaces and Modeling, ACM, New York, NY, USA, SBIM '07, 23--30.

Cited By

View all
  • (2024)iPose: Interactive Human Pose Reconstruction from VideoProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641944(1-14)Online publication date: 11-May-2024
  • (2024)Garment Animation NeRF with Color EditingProceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation10.1111/cgf.15178(1-13)Online publication date: 21-Aug-2024
  • (2024)3D sketching in immersive environmentsComputers and Graphics10.1016/j.cag.2024.103978123:COnline publication date: 1-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 34, Issue 4
August 2015
1307 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/2809654
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2015
Published in TOG Volume 34, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. layers
  2. shells
  3. sketch-based modeling

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)62
  • Downloads (Last 6 weeks)4
Reflects downloads up to 23 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)iPose: Interactive Human Pose Reconstruction from VideoProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641944(1-14)Online publication date: 11-May-2024
  • (2024)Garment Animation NeRF with Color EditingProceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation10.1111/cgf.15178(1-13)Online publication date: 21-Aug-2024
  • (2024)3D sketching in immersive environmentsComputers and Graphics10.1016/j.cag.2024.103978123:COnline publication date: 1-Oct-2024
  • (2023)Learning Assisted Interactive 3D modelling from 3D sketchesSIGGRAPH Asia 2023 Doctoral Consortium10.1145/3623053.3623370(1-4)Online publication date: 28-Nov-2023
  • (2023)WARPY: Sketching Environment-Aware 3D Curves in Mobile Augmented Reality2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00052(367-377)Online publication date: Mar-2023
  • (2022)Garment Ideation: Iterative View-Aware Sketch-Based Garment Modeling2022 International Conference on 3D Vision (3DV)10.1109/3DV57658.2022.00015(22-31)Online publication date: Sep-2022
  • (2021)Dynamic neural garmentsACM Transactions on Graphics10.1145/3478513.348049740:6(1-15)Online publication date: 10-Dec-2021
  • (2021)ScaffoldSketch: Accurate Industrial Design Drawing in VRThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474756(372-384)Online publication date: 10-Oct-2021
  • (2021)Mid-Air Drawing of Curves on 3D Surfaces in Virtual RealityACM Transactions on Graphics10.1145/345909040:3(1-17)Online publication date: 15-Jul-2021
  • (2021)Interactive modelling of volumetric musculoskeletal anatomyACM Transactions on Graphics10.1145/3450626.345976940:4(1-13)Online publication date: 19-Jul-2021
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media