Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3411764.3445158acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

CASSIE: Curve and Surface Sketching in Immersive Environments

Published: 07 May 2021 Publication History

Abstract

We present CASSIE, a conceptual modeling system in VR that leverages freehand mid-air sketching, and a novel 3D optimization framework to create connected curve network armatures, predictively surfaced using patches with C0 continuity. Our system provides a judicious balance of interactivity and automation, providing a homogeneous 3D drawing interface for a mix of freehand curves, curve networks, and surface patches. Our system encourages and aids users in drawing consistent networks of curves, easing the transition from freehand ideation to concept modeling. A comprehensive user study with professional designers as well as amateurs (N=12), and a diverse gallery of 3D models, show our armature and patch functionality to offer a user experience and expressivity on par with freehand ideation, while creating sophisticated concept models for downstream applications.

Supplementary Material

VTT File (3411764.3445158_videofigurecaptions.vtt)
Supplementary Materials (3411764.3445158_supplementalmaterials.zip)
MP4 File (3411764.3445158_videofigure.mp4)
Supplemental video
MP4 File (3411764.3445158_videopreview.mp4)
Preview video

References

[1]
Fatemeh Abbasinejad, Pushkar Joshi, and Nina Amenta. 2011. Surface patches from unorganized space curves. Computer Graphics Forum 30, 5 (2011), 1379–1387. https://doi.org/10.1111/j.1467-8659.2011.02012.x
[2]
Rahul Arora, Ishan Darolia, Vinay P Namboodiri, Karan Singh, and Adrien Bousseau. 2017. Sketchsoup: Exploratory Ideation using Design Sketches. Computer Graphics Forum 36, 8 (2017), 302–312.
[3]
Rahul Arora, Rubaiat Habib Kazi, Tovi Grossman, George Fitzmaurice, and Karan Singh. 2018. Symbiosissketch: Combining 2d & 3d sketching for designing detailed 3d objects in situ. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–15.
[4]
Rahul Arora, Alec Jacobson, Timothy R. Langlois, Yijiang Huang, Caitlin Mueller, Wojciech Matusik, Ariel Shamir, Karan Singh, and David I.W. Levin. 2019. Volumetric Michell Trusses for Parametric Design & Fabrication. In Proceedings of the 3rd ACM Symposium on Computation Fabrication (Pittsburgh, PA, USA) (SCF ’19). ACM, New York, NY, USA, 13.
[5]
Rahul Arora, Rubaiat Habib Kazi, Fraser Anderson, Tovi Grossman, Karan Singh, and George W Fitzmaurice. 2017. Experimental Evaluation of Sketching on Surfaces in VR. In CHI, Vol. 17. ACM, New York, NY, USA, 5643–5654.
[6]
Robert McNeel & Associates. 2018. Rhinoceros 3D. https://www.rhino3d.com/.
[7]
Seok-Hyung Bae, Ravin Balakrishnan, and Karan Singh. 2008. ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models. In Proceedings of the 21st annual ACM symposium on User interface software and technology. ACM, New York, NY, USA, 151–160.
[8]
Ravin Balakrishnan, George Fitzmaurice, Gordon Kurtenbach, and William Buxton. 1999. Digital tape drawing. In Proceedings of the 12th annual ACM symposium on User interface software and technology. ACM, New York, NY, USA, 161–169.
[9]
Mikhail Bessmeltsev, Caoyu Wang, Alla Sheffer, and Karan Singh. 2012. Design-driven quadrangulation of closed 3D curves. ACM Transactions on Graphics (TOG) 31, 6 (2012), 1–11.
[10]
Erin Cherry and Celine Latulipe. 2014. Quantifying the Creativity Support of Digital Tools through the Creativity Support Index. ACM Trans. Comput.-Hum. Interact. 21, 4, Article 21 (June 2014), 25 pages. https://doi.org/10.1145/2617588
[11]
Paolo Cignoni, Massimiliano Corsini, and Guido Ranzuglia. 2008. MeshLab: an Open-Source 3D Mesh Processing System.ERCIM News 2008, 73 (2008), 47–48. http://dblp.uni-trier.de/db/journals/ercim/ercim2008.html#CignoniCR08
[12]
Bruno R De Araùjo, Géry Casiez, and Joaquim A Jorge. 2012. Mockup builder: direct 3D modeling on and above the surface in a continuous interaction space. In Proceedings of Graphics Interface 2012. Canadian Information Processing Society, Mississauga, ON, Canada, 173–180.
[13]
Chris De Paoli and Karan Singh. 2015. SecondSkin: sketch-based construction of layered 3D models. ACM Transactions on Graphics (TOG) 34, 4 (2015), 1–10.
[14]
Michael F Deering. 1995. HoloSketch: a virtual reality sketching/animation tool. ACM Transactions on Computer-Human Interaction (TOCHI) 2, 3(1995), 220–238.
[15]
Mathieu Desbrun, Mark Meyer, Peter Schröder, and Alan H Barr. 1999. Implicit fairing of irregular meshes using diffusion and curvature flow. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques. ACM, New York, NY, USA, 317–324.
[16]
Julie Dorsey, Songhua Xu, Gabe Smedresman, Holly Rushmeier, and Leonard McMillan. 2007. The Mental Canvas: A Tool for Conceptual Architectural Design and Analysis. In Proc. IEEE Pacific Conference on Computer Graphics and Applications. IEEE, New York, NY, USA, 201–210.
[17]
Tobias Drey, Jan Gugenheimer, Julian Karlbauer, Maximilian Milo, and Enrico Rukzio. 2020. VRSketchIn: Exploring the Design Space of Pen and Tablet Interaction for 3D Sketching in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–14.
[18]
K Eissen and R Steur. 2009. Sketching: Drawing techniques for product designers (11 ed.). BIS Publishers, AMsterdam, The Netherlands.
[19]
Facebook. 2015. Oculus Medium. https://www.oculus.com/medium/.
[20]
Facebook. 2016. Oculus Quill. https://www.oculus.com/experiences/rift/1118609381580656/.
[21]
Michele Fiorentino, Raffaele de Amicis, Giuseppe Monno, and Andre Stork. 2002. Spacedesign: A mixed reality workspace for aesthetic industrial design. In Proceedings. International Symposium on Mixed and Augmented Reality. IEEE, New York, NY, USA, 86–318. https://doi.org/10.1109/ISMAR.2002.1115077
[22]
Jakub Fišer, Paul Asente, and Daniel Sỳkora. 2015. ShipShape: a drawing beautification assistant. In Proceedings of the workshop on Sketch-Based Interfaces and Modeling. Eurographics Association, Geneve, Switzerland, 49–57.
[23]
Google. 2016. Tilt Brush. https://www.tiltbrush.com.
[24]
Google. 2017. Google Blocks. https://arvr.google.com/blocks/.
[25]
Giorgio Gori, Alla Sheffer, Nicholas Vining, Enrique Rosales, Nathan Carr, and Tao Ju. 2017. Flowrep: Descriptive curve networks for free-form design shapes. ACM Transactions on Graphics (TOG) 36, 4 (2017), 1–14.
[26]
Tovi Grossman, Ravin Balakrishnan, and Karan Singh. 2003. An Interface for Creating and Manipulating Curves Using a High Degree-of-Freedom Curve Input Device. In Proc. of the ACM SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 185–192.
[27]
Andrew J Hanson and Hui Ma. 1995. Parallel transport approach to curve framing. Indiana University, Techreports-TR425 11 (1995), 3–7.
[28]
Laura M. Herman and Stefanie Hutka. 2019. Virtual Artistry: Virtual Reality Translations of Two-Dimensional Creativity. In Proceedings of the 2019 on Creativity and Cognition (San Diego, CA, USA) (C&C ’19). Association for Computing Machinery, New York, NY, USA, 612–618. https://doi.org/10.1145/3325480.3326579
[29]
Yixin Hu, Qingnan Zhou, Xifeng Gao, Alec Jacobson, Denis Zorin, and Daniele Panozzo. 2018. Tetrahedral Meshing in the Wild. ACM Trans. Graph. 37, 4, Article 60 (July 2018), 14 pages. https://doi.org/10.1145/3197517.3201353
[30]
Emmanuel Iarussi, David Bommes, and Adrien Bousseau. 2015. BendFields: Regularized Curvature Fields from Rough Concept Sketches. ACM Trans. Graph. 34, 3, Article 24 (May 2015), 16 pages. https://doi.org/10.1145/2710026
[31]
Takeo Igarashi, Satoshi Matsuoka, Sachiko Kawachiya, and Hidehiko Tanaka. 2007. Interactive beautification: a technique for rapid geometric design. In ACM SIGGRAPH 2007 courses. ACM, New York, NY, USA, 18–es.
[32]
Bret Jackson and Daniel F Keefe. 2016. Lift-off: Using reference imagery and freehand sketching to create 3d models in VR. IEEE transactions on visualization and computer graphics 22, 4(2016), 1442–1451.
[33]
Michael Kazhdan, Jake Solomon, and Mirela Ben-Chen. 2012. Can mean-curvature flow be modified to be non-singular?Computer Graphics Forum 31, 5 (2012), 1745–1754.
[34]
Daniel Keefe, Robert Zeleznik, and David Laidlaw. 2007. Drawing on air: Input techniques for controlled 3D line illustration. IEEE Transactions on Visualization and Computer Graphics 13, 5(2007), 1067–1081.
[35]
Yongkwan Kim, Sang-Gyun An, Joon Hyub Lee, and Seok-Hyung Bae. 2018. Agile 3D sketching with air scaffolding. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12.
[36]
Jung-hoon Kwon, Han-wool Choi, Jeong-in Lee, and Young-Ho Chai. 2005. Free-Hand stroke based NURBS surface for sketching and deforming 3d contents. In Pacific-Rim Conference on Multimedia. Springer-Verlag, Heidelberg, Germany, 315–326. https://doi.org/10.1007/11581772_28
[37]
Chenxi Liu, Enrique Rosales, and Alla Sheffer. 2018. Strokeaggregator: Consolidating raw sketches into artist-intended curve drawings. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1–15.
[38]
Mayra D Barrera Machuca, Paul Asente, Wolfgang Stuerzlinger, Jingwan Lu, and Byungmoon Kim. 2018. Multiplanes: Assisted freehand VR Sketching. In Proceedings of the Symposium on Spatial User Interaction. ACM, New York, NY, USA, 36–47.
[39]
Mayra Donaji Barrera Machuca, Wolfgang Stuerzlinger, and Paul Asente. 2019. The Effect of Spatial Ability on Immersive 3D Drawing. In Proceedings of the ACM Conference on Creativity & Cognition (C&C’19). ACM, New York, NY, USA, 173–186.
[40]
GüNay Orbay and Levent Burak Kara. 2012. Sketch-based surface design using malleable curve networks. Computers & Graphics 36, 8 (2012), 916–929.
[41]
Patrick Paczkowski, Min H. Kim, Yann Morvan, Julie Dorsey, Holly Rushmeier, and Carol O’Sullivan. 2011. Insitu: Sketching Architectural Designs in Context. ACM Trans. Graph. 30, 6 (Dec. 2011), 1–10. https://doi.org/10.1145/2070781.2024216
[42]
Hao Pan, Yang Liu, Alla Sheffer, Nicholas Vining, Chang-Jian Li, and Wenping Wang. 2015. Flow aligned surfacing of curve networks. ACM Transactions on Graphics (TOG) 34, 4 (2015), 1–10.
[43]
Theo Pavlidis and Christopher J Van Wyk. 1985. An automatic beautifier for drawings and illustrations. ACM SIGGRAPH Computer Graphics 19, 3 (1985), 225–234.
[44]
A. Pipes. 2007. Drawing for Designers. Laurence King Publishing, London, UK. https://books.google.co.nz/books?id=phgfAQAAIAAJ
[45]
Pixologic. 2016. ZBrush. http://pixologic.com/features/about-zbrush.php.
[46]
Enrique Rosales, Jafet Rodriguez, and Alla Sheffer. 2019. SurfaceBrush: From Virtual Reality Drawings to Manifold Surfaces. ACM Transaction on Graphics 38, 4, Article 96(2019), 15 pages. https://doi.org/10.1145/3306346.3322970
[47]
Emanuel Sachs, Andrew Roberts, and David Stoops. 1991. 3-Draw: A tool for designing 3D shapes. IEEE Computer Graphics and Applications 11, 6 (1991), 18–26.
[48]
Bardia Sadri and Karan Singh. 2014. Flow-Complex-Based Shape Reconstruction from 3D Curves. ACM Transactions on Graphics 33, 2, Article 20(2014), 15 pages.
[49]
Steven Schkolne, Michael Pruett, and Peter Schröder. 2001. Surface drawing: creating organic 3D shapes with the hand and tangible tools. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, New York, NY, USA, 261–268.
[50]
Ryan Schmidt, Azam Khan, Karan Singh, and Gord Kurtenbach. 2009. Analytic drawing of 3D scaffolds. ACM transactions on graphics (TOG) 28, 5 (2009), 1–10.
[51]
Cloud Shao, Adrien Bousseau, Alla Sheffer, and Karan Singh. 2012. CrossShade: shading concept sketches using cross-section curves. ACM Transactions on Graphics (TOG) 31, 4, Article 45(2012), 11 pages.
[52]
Nicholas Sharp 2019. Polyscope. www.polyscope.run.
[53]
Karan Singh and Eugene Fiume. 1998. Wires: a geometric deformation technique. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques. ACM, New York, NY, USA, 405–414.
[54]
Gravity Sketch. 2017. Gravity Sketch. https://www.gravitysketch.com/.
[55]
Tibor Stanko, Stefanie Hahmann, Georges-Pierre Bonneau, and Nathalie Saguin-Sprynski. 2016. Smooth interpolation of curve networks with surface normals. In EG 2016 - Short Papers. The Eurographics Association, Geneve, Switzerland, 21–24.
[56]
Kenshi Takayama, Daniele Panozzo, Alexander Sorkine-Hornung, and Olga Sorkine-Hornung. 2013. Sketch-Based Generation and Editing of Quad Meshes. ACM Transactions on Graphics (proceedings of ACM SIGGRAPH) 32, 4(2013), 97:1–97:8.
[57]
The CGAL Project. 2020. CGAL User and Reference Manual(5.0.2 ed.). CGAL Editorial Board. https://doc.cgal.org/5.0.2/Manual/packages.html
[58]
Floor Verhoeven and Olga Sorkine-Hornung. 2019. RodMesh: Two-handed 3D Surface Modeling in Virtual Reality. In Proceedings of the Symposium on Vision, Modeling and Visualization (VMV). The Eurographics Association, Geneve, Switzerland, 10.
[59]
Gerold Wesche and Hans-Peter Seidel. 2001. FreeDrawer: a free-form sketching system on the responsive workbench. In Proceedings of the ACM symposium on Virtual reality software and technology. ACM, New York, NY, USA, 167–174.
[60]
Baoxuan Xu, William Chang, Alla Sheffer, Adrien Bousseau, James McCrae, and Karan Singh. 2014. True2Form: 3D curve networks from 2D sketches via selective regularization. ACM Transactions on Graphics 33, 4, Article 131(2014), 13 pages.
[61]
Yixin Zhuang, Ming Zou, Nathan Carr, and Tao Ju. 2013. A general and efficient method for finding cycles in 3D curve networks. ACM Transactions on Graphics (TOG) 32, 6 (2013), 1–10.
[62]
Ming Zou, Tao Ju, and Nathan Carr. 2013. An algorithm for triangulating multiple 3D polygons. Computer Graphics Forum 32, 5 (2013), 157–166.

Cited By

View all
  • (2024)PhoneCanvas: 3D Sketching System Using a Depth Camera-Equipped Smartphone as a CanvasProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682078(1-12)Online publication date: 7-Oct-2024
  • (2024)ThermalPen: Investigating the Influence of Thermal Haptic Feedback for Creativity in 3D SketchingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656191(661-673)Online publication date: 23-Jun-2024
  • (2024)Bimanual Interactions for Surfacing Curve Networks in VRExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650988(1-7)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. CASSIE: Curve and Surface Sketching in Immersive Environments
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
        May 2021
        10862 pages
        ISBN:9781450380966
        DOI:10.1145/3411764
        Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 07 May 2021

        Permissions

        Request permissions for this article.

        Check for updates

        Badges

        • Honorable Mention

        Author Tags

        1. concept modeling
        2. curve networks
        3. ideation
        4. immersive design

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Funding Sources

        Conference

        CHI '21
        Sponsor:

        Acceptance Rates

        Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

        Upcoming Conference

        CHI '25
        CHI Conference on Human Factors in Computing Systems
        April 26 - May 1, 2025
        Yokohama , Japan

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)217
        • Downloads (Last 6 weeks)41
        Reflects downloads up to 10 Nov 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)PhoneCanvas: 3D Sketching System Using a Depth Camera-Equipped Smartphone as a CanvasProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682078(1-12)Online publication date: 7-Oct-2024
        • (2024)ThermalPen: Investigating the Influence of Thermal Haptic Feedback for Creativity in 3D SketchingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656191(661-673)Online publication date: 23-Jun-2024
        • (2024)Bimanual Interactions for Surfacing Curve Networks in VRExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650988(1-7)Online publication date: 11-May-2024
        • (2024)DeepTreeSketch: Neural Graph Prediction for Faithful 3D Tree Modeling from SketchesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642125(1-19)Online publication date: 11-May-2024
        • (2024)WieldingCanvas: Interactive Sketch Canvases for Freehand Drawing in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642047(1-16)Online publication date: 11-May-2024
        • (2024)QuickCSGModeling: Quick CSG Operations Based on Fusing Signed Distance Fields for VR ModelingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/359972920:7(1-18)Online publication date: 27-Mar-2024
        • (2024)Strokes2Surface: Recovering Curve Networks From 4D Architectural Design SketchesComputer Graphics Forum10.1111/cgf.1505443:2Online publication date: 27-Apr-2024
        • (2024)SENS: Part‐Aware Sketch‐based Implicit Neural Shape ModelingComputer Graphics Forum10.1111/cgf.1501543:2Online publication date: 23-Apr-2024
        • (2024)Toward More Comprehensive Evaluations of 3D Immersive Sketching, Drawing, and PaintingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.327629130:8(4648-4664)Online publication date: Aug-2024
        • (2024)ARMedicalSketch: Exploring 3D Sketching for Medical Image Using True 2D-3D Interlinked Visualization and InteractionIEEE Transactions on Human-Machine Systems10.1109/THMS.2024.343273554:5(589-598)Online publication date: Oct-2024
        • Show More Cited By

        View Options

        Get Access

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media