research-article

Interactive Physics-Based Virtual Sculpting with Haptic Feedback

Authors:

Parag Chaudhuri,

Subhasis ChaudhuriAuthors Info & Claims

Proceedings of the ACM on Computer Graphics and Interactive Techniques, Volume 5, Issue 1

Article No.: 9, Pages 1 - 20

https://doi.org/10.1145/3522611

Published: 04 May 2022 Publication History

Abstract

Sculpting is an art form that relies on both the visual and tactile senses. A faithful simulation of sculpting, therefore, requires interactive, physically accurate haptic and visual feedback. We present an interactive physics-based sculpting framework with faithful haptic feedback. We enable cutting of the material by designing a stable, remeshing-free cutting algorithm called Improved stable eXtended Finite Element Method. We present a simulation framework to enable stable visual and haptic feedback at interactive rates. We evaluate the performance of our framework quantitatively and quantitatively through an extensive user study.

Supplementary Material

mandal (mandal.zip)

Supplemental movie, appendix, image and software files for, Interactive Physics-Based Virtual Sculpting with Haptic Feedback

Download
15.46 MB

References

[1]

Pedro M. A. Areias and Ted Belytschko. 2005. Analysis of three-dimensional crack initiation and propagation using the extended finite element method. Internat. J. Numer. Methods Engrg. 63, 5 (2005), 760--788.

[2]

David Baraff, Andrew Witkin, and Michael Kass. 2003. Untangling Cloth. ACM Trans. Graph. 22, 3 (July 2003), 862--870.

Digital Library

[3]

J. Barbič and D. L. James. 2009. Six-DoF haptic rendering of contact between geometrically complex reduced deformable models: Haptic demo. In World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 393--394.

[4]

T. Belytschko and T. Black. 1999. Elastic crack growth in finite elements with minimal remeshing. Internat. J. Numer. Methods Engrg. 45, 5 (1999), 601--620.

[5]

Renaud Blanch, Eric Ferley, Marie-Paule Cani, and Jean-Dominique Gascuel. 2004. Non-Realistic Haptic Feedback for Virtual Sculpture. Technical Report RR-5090. INRIA.

[6]

Edouard Callens, Fabien Danieau, Antoine Costes, and Philippe Guillotel. 2018. A Tangible Surface for Digital Sculpting in Virtual Environments. In Haptics: Science, Technology, and Applications, Domenico Prattichizzo, Hiroyuki Shinoda, Hong Z. Tan, Emanuele Ruffaldi, and Antonio Frisoli (Eds.). Springer International Publishing, Cham, 157--168.

[7]

Hui Chen and Hanqiu Sun. 2002. Real-time Haptic Sculpting in Virtual Volume Space. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (Hong Kong, China) (VRST '02). ACM, 81--88.

Digital Library

[8]

Floyd M. Chitalu, Qinghai Miao, Kartic Subr, and Taku Komura. 2020. Displacement-Correlated XFEM for Simulating Brittle Fracture. Computer Graphics Forum 39, 2 (2020), 569--583.

[9]

Hadrien Courtecuisse, Hoeryong Jung, Jérémie Allard, Christian Duriez, Doo Yong Lee, and Stéphane Cotin. 2010. GPU-based Real-Time Soft Tissue Deformation with Cutting and Haptic Feedback. Progress in Biophysics and Molecular Biology 103, 2-3 (Dec. 2010), 159--168.

[10]

Frank Dachille, IX, Hong Qin, Arie Kaufman, and Jihad El-Sana. 1999. Haptic Sculpting of Dynamic Surfaces. In Proceedings of the 1999 Symposium on Interactive 3D Graphics (Atlanta, Georgia, USA) (I3D '99). ACM, New York, NY, USA, 103--110.

Digital Library

[11]

Fernando De Goes and Doug L. James. 2017. Regularized Kelvinlets: Sculpting Brushes Based on Fundamental Solutions of Elasticity. ACM Trans. Graph. 36, 4, Article 40 (July 2017), 11 pages.

[12]

Ronald Aylmer Fisher. 1954. Statistical methods for research workers; 20th ed. Oliver and Boyd, Edinburgh.

[13]

Zhan Gao and Ian Gibson. 2006. Haptic Sculpting of Multi-Resolution B-Spline Surfaces with Shaped Tools. Comput. Aided Des. 38, 6 (jun 2006), 661--676.

[14]

Chris Gunn. 2006. Collaborative virtual sculpting with haptic feedback. Virtual Reality 10, 2 (01 Oct 2006), 73--83.

[15]

Philip E. Gustafson and Brian A. Hagler. 1999. Gaussian quadrature rules and numerical examples for strong extensions of mass distribution functions. J. Comput. Appl. Math. 105, 1 (1999), 317 - 326.

Digital Library

[16]

Robert Jagnow and Julie Dorsey. 2002. Virtual Sculpting with Haptic Displacement Maps. In Proceedings of the Graphics Interface 2002 Conference, May 27-29, 2002, Calgary, Alberta, Canada (Calgary, Alberta). 125--132.

[17]

Lenka Jeřábková and Torsten Kuhlen. 2009. Stable Cutting of Deformable Objects in Virtual Environments Using XFEM. IEEE Computer Graphics and Applications 29, 2 (2009), 61--71.

Digital Library

[18]

Dan Koschier, Jan Bender, and Nils Thuerey. 2017. Robust eXtended Finite Elements for Complex Cutting of Deformables. ACM Trans. Graph. 36, 4 (July 2017), 55:1-55:13.

Digital Library

[19]

Avirup Mandal, Parag Chaudhuri, and Subhasis Chaudhuri. 2021a. Physics-based Mesh Deformation with Haptic Feedback and Material Anisotropy. arXiv:2112.04362 [cs.GR]

[20]

Avirup Mandal, Parag Chaudhuri, and Subhasis Chaudhuri. 2021b. Remeshing-Free Graph-Based Finite Element Method for Ductile and Brittle Fracture. CoRR abs/2103.14870 (2021). arXiv:2103.14870 https://arxiv.org/abs/2103.14870

[21]

William A. McNeely, Kevin D. Puterbaugh, and James J. Troy. 1999. Six Degree-of-freedom Haptic Rendering Using Voxel Sampling. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '99). ACM Press/Addison-Wesley Publishing Co., 401--408.

[22]

Nicolas Moës, John Dolbow, and Ted Belytschko. 1999. A finite element method for crack growth without remeshing. Internat. J. Numer. Methods Engrg. 46, 1 (1999), 131--150.

[23]

Tomas Möller. 1997. A Fast Triangle-triangle Intersection Test. J. Graph. Tools 2, 2 (Nov. 1997), 25--30.

[24]

B. Müller, F. Kummer, and M. Oberlack. 2013. Highly accurate surface and volume integration on implicit domains by means of moment-fitting. Internat. J. Numer. Methods Engrg. 96, 8 (2013), 512--528.

[25]

Matthias Müller and Markus Gross. 2004. Interactive Virtual Materials. In Proceedings of Graphics Interface 2004 (London, Ontario, Canada) (GI '04). Canadian Human-Computer Communications Society, 239--246.

Digital Library

[26]

M. Ortega, S. Redon, and S. Coquillart. 2007. A Six Degree-of-Freedom God-Object Method for Haptic Display of Rigid Bodies with Surface Properties. IEEE Transactions on Visualization and Computer Graphics 13, 3 (May 2007), 458--469.

Digital Library

[27]

M. A. Otaduy and M. C. Lin. 2005. Stable and responsive six-degree-of-freedom haptic manipulation using implicit integration. In First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference. 247--256.

[28]

Min Tang, Dinesh Manocha, Miguel A. Otaduy, and Ruofeng Tong. 2012. Continuous Penalty Forces. ACM Trans. Graph. 31, 4 (July 2012), 107:1-107:9.

Digital Library

[29]

Min Tang, Dinesh Manocha, and Ruofeng Tong. 2010. Fast Continuous Collision Detection Using Deforming Non-penetration Filters. In Proceedings of the 2010 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D). ACM, 7--13.

Digital Library

[30]

Sri Harsha Turlapati, Dino Accoto, and Domenico Campolo. 2021. Haptic Manipulation of 3D Scans for Geometric Feature Enhancement. Sensors 21, 8 (2021).

[31]

International Telecommunication Union. 2013. ITU-R The double-stimulus continuous quality-scale. https://www.itu.int/dms_pubrec/itu-r/rec/bt/R-REC-BT.500-13-201201-I!!PDF-E.pdf. Accessed: 2021-04-17.

[32]

Jian-Ying Wu and Feng-Bo Li. 2015. An improved stable XFEM (Is-XFEM) with a novel enrichment function for the computational modeling of cohesive cracks. Computer Methods in Applied Mechanics and Engineering 295 (2015), 77 - 107.

[33]

H. Xu and J. Barbič. 2017. 6-DoF Haptic Rendering Using Continuous Collision Detection between Points and Signed Distance Fields. IEEE Transactions on Haptics 10, 2 (April 2017), 151--161.

Digital Library

[34]

Linbo Zhang, Tao Cui, and Hui Liu. 2009. A Set of Symmetric Quadrature Rules on Triangles and Tetrahedra. Journal of Computational Mathematics 27, 1 (2009), 89--96.

[35]

Qi-Zhi Zhu. 2012. On enrichment functions in the extended finite element method. Internat. J. Numer. Methods Engrg. 91, 2 (2012), 186--217.

[36]

Goangseup Zi and Ted Belytschko. 2003. New crack-tip elements for XFEM and applications to cohesive cracks. Internat. J. Numer. Methods Engrg. 57, 15 (2003), 2221--2240.

[37]

C. B. Zilles and J. K. Salisbury. 1995. A constraint-based god-object method for haptic display. In Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots, Vol. 3. 146--151.

Cited By

Mandal A(2023)Fast Remeshing-Free Methods for Complex Cutting and Fracture SimulationSIGGRAPH Asia 2023 Doctoral Consortium10.1145/3623053.3623366(1-5)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3623053.3623366
Zhang YWang ZZhao ZXu RChen SXin SWang WTu C(2023)A Hessian-Based Field Deformer for Real-Time Topology-Aware Shape EditingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618191(1-11)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618191
Mandal AChaudhuri PChaudhuri S(2022)Simulating Fracture in Anisotropic Materials Containing ImpuritiesProceedings of the 15th ACM SIGGRAPH Conference on Motion, Interaction and Games10.1145/3561975.3562956(1-10)Online publication date: 3-Nov-2022
https://dl.acm.org/doi/10.1145/3561975.3562956

Index Terms

Interactive Physics-Based Virtual Sculpting with Haptic Feedback
1. Computing methodologies
  1. Computer graphics
    1. Animation
      1. Physical simulation
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
    2. Interaction devices
      1. Haptic devices

Recommendations

Haptic Fidelity Framework: Defining the Factors of Realistic Haptic Feedback for Virtual Reality
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Providing haptic feedback in virtual reality to make the experience more realistic has become a strong focus of research in recent years. The resulting haptic feedback systems differ greatly in their technologies, feedback possibilities, and overall ...
Interactive Virtual-Reality Fire Extinguisher with Haptic Feedback
VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology

We present an interactive virtual-reality (VR) fire extinguisher that provides both realistic viewing using a head-mounted display (HMD) and kinesthetic experiences using a pneumatic muscle and vibrotactile transducer. The VR fire extinguisher is ...
Haptic and Auditory Feedback on Immersive Media in Virtual Reality
VRST '24: Proceedings of the 30th ACM Symposium on Virtual Reality Software and Technology

In Virtual Reality (VR), visual and auditory sensations are effectively leveraged to create immersive experiences. However, touch is significantly underutilized in immersive media. We enhance the VR image viewing experience by integrating haptic and ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Computer Graphics and Interactive Techniques

Proceedings of the ACM on Computer Graphics and Interactive Techniques Volume 5, Issue 1

May 2022

252 pages

EISSN:2577-6193

DOI:10.1145/3535313

Issue’s Table of Contents

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 May 2022

Published in PACMCGIT Volume 5, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
260
Total Downloads

Downloads (Last 12 months)66
Downloads (Last 6 weeks)15

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mandal A(2023)Fast Remeshing-Free Methods for Complex Cutting and Fracture SimulationSIGGRAPH Asia 2023 Doctoral Consortium10.1145/3623053.3623366(1-5)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3623053.3623366
Zhang YWang ZZhao ZXu RChen SXin SWang WTu C(2023)A Hessian-Based Field Deformer for Real-Time Topology-Aware Shape EditingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618191(1-11)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618191
Mandal AChaudhuri PChaudhuri S(2022)Simulating Fracture in Anisotropic Materials Containing ImpuritiesProceedings of the 15th ACM SIGGRAPH Conference on Motion, Interaction and Games10.1145/3561975.3562956(1-10)Online publication date: 3-Nov-2022
https://dl.acm.org/doi/10.1145/3561975.3562956

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents