Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

EasyVRModeling: Easily Create 3D Models by an Immersive VR System

Published: 04 May 2022 Publication History

Abstract

The latest innovations of VR make it possible to construct 3D models in a holographic immersive simulation environment. In this paper, we develop a user-friendly mid-air interactive modeling system named EasyVRModeling. We first prepare a dataset consisting of diverse components and precompute the discrete signed distance function (SDF) for each component. During the modeling phase, users can freely design complicated shapes with a pair of VR controllers. Based on the discrete SDF representation, any CSG-like operation (union, intersect, subtract) can be performed voxel-wise. Throughout the modeling process, we maintain one single dynamic SDF for the whole scene so that the zero-level set surface of the SDF exactly encodes the up-to-date constructed shape. Both SDF fusion and surface extraction are implemented via GPU to allow for smooth user experience. We asked 34 volunteers to create their favorite models using EasyVRModeling. With a simple training process for several minutes, most of them can create a fascinating shape or even a descriptive scene very quickly.

Supplementary Material

fu (fu.zip)
Supplemental movie, appendix, image and software files for, EasyVRModeling: Easily Create 3D Models by an Immersive VR System

References

[1]
Duncan Fraser Armin Rigo, Maciej Fijałkowski. 2020. version 16.0.0. Baroque Software. https://vrsketch.eu/
[2]
Rahul Arora. 2020. Creative Expression with Immersive 3D Interactions. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3334480.3375028
[3]
Rahul Arora and Karan Singh. 2021. Mid-Air Drawing of Curves on 3D Surfaces in Virtual Reality. ACM Transactions on Graphics (TOG) (2021).
[4]
Andreas Bærentzen, Jeppe Revall Frisvad, and Karan Singh. 2019. Signifier-Based Immersive and Interactive 3D Modeling. In 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST '19). Association for Computing Machinery, New York, NY, USA, Article 18, 5 pages. https://doi.org/10.1145/3359996.3364257
[5]
Lee Beever, Serban Pop, and Nigel W. John. 2020. LevelEd VR: A virtual reality level editor and workflow for virtual reality level design. In 2020 IEEE Conference on Games (CoG). 136--143. https://doi.org/10.1109/CoG47356.2020.9231769
[6]
Erin Cherry and Celine Latulipe. 2014. Quantifying the creativity support of digital tools through the creativity support index. ACM Transactions on Computer-Human Interaction (TOCHI) 21, 4 (2014), 1--25.
[7]
Bruno Rodrigues De Araújo, Daniel S Lopes, Pauline Jepp, Joaquim A Jorge, and Brian Wyvill. 2015. A survey on implicit surface polygonization. ACM Computing Surveys (CSUR) 47, 4 (2015), 1--39.
[8]
Josen Daniel O. De Leon, Romelio P. Tavas, Rodolfo A. Aranzanso, and Rowel O. Atienza. 2016. Genesys: A Virtual Reality scene builder. In 2016 IEEE Region 10 Conference (TENCON). 3708--3711. https://doi.org/10.1109/TENCON.2016.7848751
[9]
Tobias Drey, Jan Gugenheimer, Julian Karlbauer, Maximilian Milo, and Enrico Rukzio. 2020. VRSketchIn: Exploring the Design Space of Pen and Tablet Interaction for 3D Sketching in Virtual Reality. Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376628
[10]
Zhongxiang Duan, Qin Yang, Xianhai Meng, and Jigang Li. 2020. Detailed Voxel-Based Implicit Modeling With Local Boolean Composition of Discrete Level Sets. IEEE Access 8 (2020), 48376--48385. https://doi.org/10.1109/ACCESS.2020.2979571
[11]
Alex Evans. 2015. Learning from failure: a survey of promising, unconventional and mostly abandoned renderers for 'dreams ps4', a geometrically dense, painterly ugc game. Advances in Real-Time Rendering in Games. MediaMolecule, SIGGRAPH (2015).
[12]
Stanley Osher Ronald Fedkiw and Stanley Osher. 2002. Level set methods and dynamic implicit surfaces. Surfaces 44, 77 (2002), 685.
[13]
João Ferreira, Daniel Mendes, Rui Nóbrega, and Rui Rodrigues. 2021. Immersive Multimodal and Procedurally-Assisted Creation of VR Environments. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 30--37. https://doi.org/10.1109/VRW52623.2021.00012
[14]
Stefan Gottschalk, Ming C Lin, and Dinesh Manocha. 1996. OBBTree: A hierarchical structure for rapid interference detection. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. 171--180.
[15]
Takeo Igarashi, Satoshi Matsuoka, and Hidehiko Tanaka. 2006. Teddy: a sketching interface for 3D freeform design. In ACM SIGGRAPH 2006 Courses. 11-es.
[16]
Bret Jackson and Daniel F. Keefe. 2016. Lift-Off: Using Reference Imagery and Freehand Sketching to Create 3D Models in VR. IEEE Transactions on Visualization and Computer Graphics 22, 4 (2016), 1442--1451. https://doi.org/10.1109/TVCG.2016.2518099
[17]
Jason Jerald and Richard Marks. 2016. Human-Centered Design for VR Interactions. In ACM SIGGRAPH 2016 Courses (Anaheim, California) (SIGGRAPH '16). Association for Computing Machinery, New York, NY, USA, Article 15, 60 pages. https://doi.org/10.1145/2897826.2927320
[18]
Jason Jerald, Paul Mlyniec, Arun Yoganandan, Amir Rubin, Dan Paullus, and Simon Solotko. 2013. Makevr: A 3d world-building interface. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 197--198.
[19]
Leif P Kobbelt, Mario Botsch, Ulrich Schwanecke, and Hans-Peter Seidel. 2001. Feature sensitive surface extraction from volume data. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. 57--66.
[20]
Eric Larsen, Stefan Gottschalk, Ming C Lin, and Dinesh Manocha. 1999. Fast proximity queries with swept sphere volumes. Technical Report.
[21]
Thomas Lewiner, Hélio Lopes, Antônio Wilson Vieira, and Geovan Tavares. 2003. Efficient implementation of marching cubes' cases with topological guarantees. Journal of graphics tools 8, 2 (2003), 1--15.
[22]
Yong-Jin Liu, Cui-Xia Ma, and Dong-Liang Zhang. 2011. EasyToy: Plush Toy Design Using Editable Sketching Curves. IEEE Computer Graphics and Applications 31, 2 (2011), 49--57. https://doi.org/10.1109/MCG.2009.147
[23]
Pedro Lopes, Daniel Mendes, Bruno Araújo, and Joaquim A Jorge. 2011. Combining bimanual manipulation and pen-based input for 3d modelling. In Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling. 15--22.
[24]
William E Lorensen and Harvey E Cline. 1987. Marching cubes: A high resolution 3D surface construction algorithm. ACM siggraph computer graphics 21, 4 (1987), 163--169.
[25]
Tim McInemey and Demetri Terzopoulos. 1999. Topology adaptive deformable surfaces for medical image volume segmentation. IEEE transactions on medical imaging 18, 10 (1999), 840--850.
[26]
Daniel Mendes, Daniel Medeiros, Maurício Sousa, Ricardo Ferreira, Alberto Raposo, Alfredo Ferreira, and Joaquim Jorge. 2017. Mid-air modeling with Boolean operations in VR. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). 154--157. https://doi.org/10.1109/3DUI.2017.7893332
[27]
Timothy S Newman and Hong Yi. 2006. A survey of the marching cubes algorithm. Computers & Graphics 30, 5 (2006), 854--879.
[28]
Stanley Osher and Ronald Fedkiw. 2006. Level set methods and dynamic implicit surfaces. Vol. 153. Springer Science & Business Media.
[29]
Alexander Pasko, Valery Adzhiev, Alexei Sourin, and Vladimir Savchenko. 1995. Function representation in geometric modeling: concepts, implementation and applications. The visual computer 11, 8 (1995), 429--446.
[30]
Mengqi Peng, Jun Xing, and Li Yi Wei. 2018. Autocomplete 3D sculpting. ACM Transactions on Graphics (TOG) (2018).
[31]
Ryan Schmidt, Brian Wyvill, Mario Costa Sousa, and Joaquim A Jorge. 2007. Shapeshop: Sketch-based solid modeling with blobtrees. In ACM SIGGRAPH 2007 courses. 43-es.
[32]
The CGAL Project. 2021. CGAL User and Reference Manual (5.3 ed.). CGAL Editorial Board. https://doc.cgal.org/5.3/Manual/packages.html
[33]
Jia Wang, Owen Leach, and Robert W. Lindeman. 2013. DIY World Builder: An immersive level-editing system. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). 195--196. https://doi.org/10.1109/3DUI.2013.6550245
[34]
Yunhai Wang, Shmulik Asafi, Oliver van Kaick, Hao Zhang, Daniel Cohen-Or, and Baoquan Chen. 2012. Active Co-Analysis of a Set of Shapes. ACM Trans. Graph. 31, 6, Article 165 (nov 2012), 10 pages. https://doi.org/10.1145/2366145.2366184
[35]
Brian Wyvill, Andrew Guy, and Eric Galin. 1999. Extending the csg tree. warping, blending and boolean operations in an implicit surface modeling system. In Computer Graphics Forum, Vol. 18. Wiley Online Library, 149--158.
[36]
Emilie Yu, Rahul Arora, Tibor Stanko, J. Andreas Bærentzen, Karan Singh, and Adrien Bousseau. 2021. CASSIE: Curve and Surface Sketching in Immersive Environments. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohoma, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3411764.3445158

Cited By

View all
  • (2024)CWF: Consolidating Weak Features in High-quality Mesh SimplificationACM Transactions on Graphics10.1145/365815943:4(1-14)Online publication date: 19-Jul-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Computer Graphics and Interactive Techniques
Proceedings of the ACM on Computer Graphics and Interactive Techniques  Volume 5, Issue 1
May 2022
252 pages
EISSN:2577-6193
DOI:10.1145/3535313
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 May 2022
Published in PACMCGIT Volume 5, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. CSG-like operation
  2. SDF fusion
  3. construct 3D models
  4. user-friendly interaction
  5. virtual reality

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)99
  • Downloads (Last 6 weeks)8
Reflects downloads up to 04 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)CWF: Consolidating Weak Features in High-quality Mesh SimplificationACM Transactions on Graphics10.1145/365815943:4(1-14)Online publication date: 19-Jul-2024

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media