Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

BendSketch: modeling freeform surfaces through 2D sketching

Published: 20 July 2017 Publication History

Abstract

Sketch-based modeling provides a powerful paradigm for geometric modeling. Recent research had shown, sketch based modeling methods are most effective when targeting a specific family of surfaces. A large and growing arsenal of sketching tools is available for different types of geometries and different target user populations. Our work augments this arsenal with a new and powerful tool for modeling complex freeform shapes by sketching sparse 2D strokes; our method complements existing approaches in enabling the generation of surfaces with complex curvature patterns that are challenging to produce with existing methods.
To model a desired surface patch with our technique, the user sketches the patch boundary as well as a small number of strokes representing the major bending directions of the shape. Our method uses this input to generate a curvature field that conforms to the user strokes and then uses this field to derive a freeform surface with the desired curvature pattern. To infer the surface from the strokes we first disambiguate the convex versus concave bending directions indicated by the strokes and estimate the surface bending magnitude along the strokes. We subsequently construct a curvature field based on these estimates, using a non-orthogonal 4-direction field coupled with a scalar magnitude field, and finally construct a surface whose curvature pattern reflects this field through an iterative sequence of simple linear optimizations.
Our framework is well suited for single-view modeling, but also supports multi-view interaction, necessary to model complex shapes portions of which can be occluded in many views. It effectively combines multi-view inputs to obtain a coherent 3D shape. It runs at interactive speed allowing for immediate user feedback. We demonstrate the effectiveness of the proposed method through a large collection of complex examples created by both artists and amateurs. Our framework provides a useful complement to the existing sketch-based modeling methods.

Supplementary Material

ZIP File (a125-li.zip)
Supplemental files.
MP4 File (papers-0238.mp4)

References

[1]
2016. CGAL, Computational Geometry Algorithms Library. http://www.cgal.org. (2016).
[2]
2016. ZBrush. http://pixologic.com/. (2016).
[3]
Nina Amenta and Marshall Bern. 1998. Surface Reconstruction by Voronoi Filtering. In SoCG. 39--48.
[4]
Alexis Andre and Suguru Saito. 2011. Single-view Sketch Based Modeling. In SBIM. 133--140.
[5]
Alexis Andre, Suguru Saito, and Masayuki Nakajima. 2007. CrossSketch: Freeform Surface Modeling with Details. In SBIM. 45--52.
[6]
Seok-Hyung Bae, Ravin Balakrishnan, and Karan Singh. 2008. ILoveSketch: As-natural-as-possible Sketching System for Creating 3D Curve Models. In UIST. 151--160.
[7]
Jonathan T Barron and Jitendra Malik. 2015. Shape, Illumination, and Reflectance from Shading. IEEE Trans. Pattern Anal. Mach. Intell. 37 (2015), 1670--1687.
[8]
Peter N. Belhumeur, David J. Kriegman, and Alan L. Yuille. 1999. The Bas-Relief Ambiguity. Int. J. Comput. Vis. 35, 1 (1999), 33--44.
[9]
Adrien Bernhardt, Adeline Pihuit, Marie-Paule Cani, and Loïc Barthe. 2008. Matisse : Painting 2D regions for Modeling Free-Form Shapes. In SBIM. 57--64.
[10]
Mikhail Bessmeltsev, Will Chang, Nicholas Vining, Alla Sheffer, and Karan Singh. 2015. Modeling Character Canvases from Cartoon Drawings. ACM Trans. Graph. 34, 5 (2015).
[11]
Mikhail Bessmeltsev, Caoyu Wang, Alla Sheffer, and Karan Singh. 2012. Design-driven Quadrangulation of Closed 3D Curves. ACM Trans. Graph. (SIGGRAPH ASIA) 31, 6 (2012), 178:1--178:11.
[12]
M. Botsch, L. Kobbelt, M. Pauly, P. Alliez, and B. Levy. 2010. Polygon Mesh Processing. Taylor & Francis.
[13]
Minh Tuan Bui, Junho Kim, and Yunjin Lee. 2015. 3D-look Shading from Contours and Hatching Strokes. Comput. Graph. 51 (2015), 167--176.
[14]
Tao Chen, Zhe Zhu, Ariel Shamir, Shi-Min Hu, and Daniel Cohen-Or. 2013. 3-Sweep: Extracting Editable Objects from a Single Photo. ACM Trans. Graph. (SIGGRAPH ASIA) 32, 6 (2013), 195:1--195:10.
[15]
Pedro Company, Ana Piquer, Manuel Contero, and Ferran Naya. 2005. A Survey on Geometrical Reconstruction As a Core Technology to Sketch-based Modeling. Comput. Graph. 29, 6 (2005), 892--904.
[16]
Frederic Cordier, Hyewon Seo, Jinho Park, and Jun Yong Noh. 2011. Sketching of Mirror-Symmetric Shapes. IEEE. T Vis. Comput. Gr. 17, 11 (2011).
[17]
Chris De Paoli and Karan Singh. 2015. SecondSkin: Sketch-based Construction of Layered 3D Models. ACM Trans. Graph. (SIGGRAPH) 34, 4, Article 126 (2015), 10 pages.
[18]
Olga Diamanti, Amir Vaxman, Daniele Panozzo, and Olga Sorkine-Hornung. 2014. Designing N-PolyVector Fields with Complex Polynomials. Comput. Graph. Forum (SGP) 33, 5 (2014), 1--11.
[19]
Chao Ding and Ligang Liu. 2016. A survey of sketch based modeling systems. Frontiers of Computer Science 10, 6 (2016), 985--999.
[20]
Even Entem, Loïc Barthe, Marie-Paule Cani, Frederic Cordier, and Michiel Van De Panne. 2014. Modeling 3D animals from a side-view sketch. Comput. Graph. 38 (2014).
[21]
Hongbo Fu, Yichen Wei, Chiew-Lan Tai, and Long Quan. 2007. Sketching Hairstyles. In SBIM. 31--36.
[22]
Yotam Gingold, Takeo Igarashi, and Denis Zorin. 2009. Structured Annotations for 2D-to-3D Modeling. ACM Trans. Graph. (SIGGRAPH ASIA) 28, 5 (2009), 148:1--148:9.
[23]
Yotam Gingold and Denis Zorin. 2008. Shading-based Surface Editing. ACM Trans. Graph. (SIGGRAPH) 27, 3 (2008), 95:1--95:9.
[24]
Aaron Hertzmann and Denis Zorin. 2000. Illustrating Smooth Surfaces. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques. 517--526.
[25]
Haibin Huang, Evangelos Kalogerakis, Ersin Yumer, and Radomir Mech. 2016. Shape Synthesis from Sketches via Procedural Models and Convolutional Networks. IEEE. T. Vis. Comput. Gr. 22, 10 (2016), 1.
[26]
Emmanuel Iarussi, David Bommes, and Adrien Bousseau. 2015. BendFields: Regularized Curvature Fields from Rough Concept Sketches. ACM Trans. Graph. (SIGGRAPH) 34, 3 (2015), 24:1--24:16.
[27]
Takeo Igarashi, Satoshi Matsuoka, and Hidehiko Tanaka. 1999. Teddy: A Sketching Interface for 3D Freeform Design. In SIGGRAPH.
[28]
Joaquim Jorge and Faramarz Samavati (Eds.). 2011. Sketch-based Interfaces and Modeling (1 ed.). Springer-Verlag London.
[29]
Pushkar Joshi and Nathan A. Carr. 2008. Repoussé: Automatic Inflation of 2D Artwork. In SBIM (SBM'08). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 49--55.
[30]
P. Joshi and C. H. Séquin. 2007. Energy Minimizers for Curvature-Based Surface Functionals. CAD Conference (2007), 607--617.
[31]
Amaury Jung, Stefanie Hahmann, Damien Rohmer, Antoine Begault, Laurence Boissieux, and Marie-Paule Cani. 2015. Sketching Folds: Developable Surfaces from Non-Planar Silhouettes. ACM Trans. Graph. 34, 5, Article 155 (2015), 12 pages.
[32]
Olga A. Karpenko and John F. Hughes. 2006. SmoothSketch: 3D Free-form Shapes from Complex Sketches. ACM Trans. Graph. (SIGGRAPH) 25, 3 (2006), 589--598.
[33]
Jan J. Koenderink and Andrea J. van Doorn. 2002. Image Processing Done Right. In ECCV. 158--172.
[34]
Vladimir Kolmogorov. 2006. Convergent Tree-Reweighted Message Passing for Energy Minimization. IEEE Trans. Pattern Anal. Mach. Intell. 28, 10 (2006), 1568--1583.
[35]
Z. Li, J. Liu, and X. Tang. 2007. A Closed-form Solution to 3D Reconstruction of Piecewise Planar Objects from Single Images. In CVPR. 1--6.
[36]
Yang Liu, Hao Pan, John Snyder, Wenping Wang, and Baining Guo. 2013. Computing Self-supporting Surfaces by Regular Triangulation. ACM Trans. Graph. 32, 4 (2013), 92:1--92:10.
[37]
Yongwei Miao, Feixia Hu, Xudong Zhang, Jiazhou Chen, and Renato Pajarola. 2015. SymmSketch: Creating symmetric 3D free-form shapes from 2D sketches. Computational Visual Media 1, 1 (2015), 3--16.
[38]
Andrew Nealen, Takeo Igarashi, Olga Sorkine, and Marc Alexa. 2007. FiberMesh: Designing Freeform Surfaces with 3D Curves. ACM Trans. Graph. (SIGGRAPH) 26, 3 (2007).
[39]
Andrew Nealen, Olga Sorkine, Marc Alexa, and Daniel Cohen-Or. 2005. A Sketch-based Interface for Detail-preserving Mesh Editing. ACM Trans. Graph. (SIGGRAPH) 24, 3 (2005), 1142--1147.
[40]
Gen Nishida, Ignacio Garcia-Dorado, Daniel G. Aliaga, Bedrich Benes, and Adrien Bousseau. 2016. Interactive Sketching of Urban Procedural Models. ACM Trans. Graph. (SIGGRAPH) 35, 4 (2016), 130:1--130:11.
[41]
L. Olsen, F. Samavati, and J. Jorge. 2011. NaturaSketch: Modeling from Images and Natural Sketches. IEEE Comput. Graph. Appl. Mag. 31, 6 (2011), 24--34.
[42]
Luke Olsen, Faramarz F. Samavati, Mario Costa Sousa, and Joaquim A. Jorge. 2009. Sketch-based modeling: A survey. Comput. Graph. 33, 1 (2009), 85 -- 103.
[43]
Hao Pan, Yang Liu, Alla Sheffer, Nicholas Vining, Chang-Jian Li, and Wenping Wang. 2015. Flow Aligned Surfacing of Curve Networks. ACM Trans. Graph. (SIGGRAPH) 34, 4 (2015), 127:1--127:10.
[44]
Helmut Pottmann and Yang Liu. 2007. Discrete Surfaces in Isotropic Geometry. In Mathematics of Surfaces XII. 341--363.
[45]
Cody Robson, Ron Maharik, Alla Sheffer, and Nathan Carr. 2011. Context-aware Garment Modeling from Sketches. Comput. Graph. 35, 3 (2011), 604--613.
[46]
Ryan Schmidt, Azam Khan, Karan Singh, and Gord Kurtenbach. 2009. Analytic Drawing of 3D Scaffolds. ACM Trans. Graph. (SIGGRAPH ASIA) 28, 5 (2009), 149:1--149:10.
[47]
Ryan Schmidt, Brian Wyvill, Mario Costa Sousa, and Joaquim A. Jorge. 2005. ShapeShop: Sketch-Based Solid Modeling with BlobTrees. In SBIM.
[48]
Cloud Shao, Adrien Bousseau, Alla Sheffer, and Karan Singh. 2012. CrossShade: Shading Concept Sketches Using Cross-section Curves. ACM Trans. Graph. (SIGGRAPH) 31, 4 (2012), 45:1--45:11.
[49]
Alex Shtof, Alexander Agathos, Yotam Gingold, Ariel Shamir, and Daniel Cohen-Or. 2013. Geosemantic Snapping for Sketch-Based Modeling. comput. Graph. Forum (EG) 32, 2 (2013), 245--253.
[50]
Olga Sorkine, Daniel Cohen-Or, Yaron Lipman, Marc Alexa, Christian Rössl, and Hans-Peter Seidel. 2004. Laplacian Surface Editing. In Symp. Geom. Proc. 179--188.
[51]
Daniel Sýkora, Ladislav Kavan, Martin Čadík, Ondřej Jamriška, Alec Jacobson, Brian Whited, Maryann Simmons, and Olga Sorkine-Hornung. 2014. Ink-and-Ray: Bas-Relief Meshes for Adding Global Illumination Effects to Hand-Drawn Characters. ACM Trans. Graph. 33, 2 (2014), 16.
[52]
Chiew-Lan Tai, Hongxin Zhang, and Jacky Chun-Kin Fong. 2004. Prototype Modeling from Sketched Silhouettes based on Convolution Surfaces. Comput. Graph. Forum 23, 1 (2004), 71--83.
[53]
Emmanuel Turquin, Marie-Paule Cani, and John F.Hughes. 2004. Sketching Garments for Virtual Characters. In SBIM. 175--182.
[54]
Etienne Vouga, Mathias Höbinger, Johannes Wallner, and Helmut Pottmann. 2012. Design of Self-supporting Surfaces. ACM Trans. Graph. (SIGGRAPH) 31, 4 (2012), 87:1--87:11.
[55]
Yingze Wang, Y. Chen, J. Liu, and X. Tang. 2009. 3D reconstruction of curved objects from single 2D line drawings. In CVPR. 1834--1841.
[56]
Xiaohua Xie, Kai Xu, Niloy J. Mitra, Daniel Cohen-Or, Wenyong Gong, Qi Su, and Baoquan Chen. 2013. Sketch-to-Design: Context-Based Part Assembly. Comput. Graph. Forum 32, 8 (2013), 233--245.
[57]
Baoxuan Xu, William Chang, Alla Sheffer, Adrien Bousseau, James McCrae, and Karan Singh. 2014. True2Form: 3D Curve Networks from 2D Sketches via Selective Regularization. ACM Trans. Graph. (SIGGRAPH) 33, 4 (2014), 131:1--131:13.
[58]
Kun Xu, Kang Chen, Hongbo Fu, Wei-Lun Sun, and Shi-Min Hu. 2013. Sketch2Scene: Sketch-based Co-retrieval and Co-placement of 3D Models. ACM Trans. Graph. (SIGGRAPH) 32, 4 (2013), 123:1--123:15.
[59]
Q. Xu, Y. Gingold, and K. Singh. 2015. Inverse Toon Shading: Interactive Normal Field Modeling with Isophotes. In SBIM. 15--25.
[60]
C. K. Yeh, S. Y. Huang, P. K. Jayaraman, C. W. Fu, and T. Y. Lee. 2016. Interactive High-Relief Reconstruction for Organic and Double-sided Objects from a Photo. IEEE. T. Vis. Comput. Gr. 99 (2016), 1--1.
[61]
Li Zhang, G. Dugas-Phocion, J. S. Samson, and S. M. Seitzt. 2001. Single view modeling of free-form scenes. In CVPR, Vol. 1. I-990--I-997.
[62]
L. Zhu, T. Igarashi, and J. Mitani. 2013. Soft Folding. Comput. Graph. Forum (PG) 32, 7 (2013), 167--176.
[63]
Yixin Zhuang, Ming Zou, Nathan Carr, and Tao Ju. 2013. A General and Efficient Method for Finding Cycles in 3D Curve Networks. ACM Trans. Graph. (SIGGRAPH ASIA) 32, 6 (2013), 180:1--180:10.

Cited By

View all
  • (2024)Get Your Hands Dirty? A Comparative Study of Tool Usage and Perceptual Engagement in Physical and Digital SculptingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656188(358-373)Online publication date: 23-Jun-2024
  • (2024)SketchMetaFace: A Learning-Based Sketching Interface for High-Fidelity 3D Character Face ModelingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329170330:8(5260-5275)Online publication date: Aug-2024
  • (2023)TreeSketchNet: From Sketch to 3D Tree Parameters GenerationACM Transactions on Intelligent Systems and Technology10.1145/357983114:3(1-29)Online publication date: 24-Mar-2023
  • Show More Cited By

Index Terms

  1. BendSketch: modeling freeform surfaces through 2D sketching

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Graphics
    ACM Transactions on Graphics  Volume 36, Issue 4
    August 2017
    2155 pages
    ISSN:0730-0301
    EISSN:1557-7368
    DOI:10.1145/3072959
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 July 2017
    Published in TOG Volume 36, Issue 4

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. curvature field
    2. freeform shape
    3. multi-view
    4. sketch

    Qualifiers

    • Research-article

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)73
    • Downloads (Last 6 weeks)13
    Reflects downloads up to 06 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Get Your Hands Dirty? A Comparative Study of Tool Usage and Perceptual Engagement in Physical and Digital SculptingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656188(358-373)Online publication date: 23-Jun-2024
    • (2024)SketchMetaFace: A Learning-Based Sketching Interface for High-Fidelity 3D Character Face ModelingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329170330:8(5260-5275)Online publication date: Aug-2024
    • (2023)TreeSketchNet: From Sketch to 3D Tree Parameters GenerationACM Transactions on Intelligent Systems and Technology10.1145/357983114:3(1-29)Online publication date: 24-Mar-2023
    • (2023)Neural Modeling of Portrait Bas-Relief From a Single PhotographIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.319735429:12(5008-5019)Online publication date: Dec-2023
    • (2023)Sketch2PQ: Freeform Planar Quadrilateral Mesh Design via a Single SketchIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.317085329:9(3826-3839)Online publication date: 1-Sep-2023
    • (2023)Fine-Tuned but Zero-Shot 3D Shape Sketch View Similarity and Retrieval2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)10.1109/ICCVW60793.2023.00193(1767-1777)Online publication date: 2-Oct-2023
    • (2023)SKED: Sketch-guided Text-based 3D Editing2023 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV51070.2023.01343(14561-14573)Online publication date: 1-Oct-2023
    • (2023)Learning Geometry-aware Representations by Sketching2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.02233(23315-23326)Online publication date: Jun-2023
    • (2023)Screen space shape manipulation by global structural optimizationComputers and Graphics10.1016/j.cag.2023.07.017115:C(246-253)Online publication date: 1-Oct-2023
    • (2023)Wrinkles Realistic Clothing Reconstruction by Combining Implicit and Explicit MethodComputer-Aided Design10.1016/j.cad.2023.103514160(103514)Online publication date: Jul-2023
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media