Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3139131.3139160acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
research-article

Computational design of hand-held VR controllers using haptic shape illusion

Published: 08 November 2017 Publication History

Abstract

Humans are capable of haptically perceiving the shape of an object by simply wielding it, even without seeing it. On the other hand, typical hand-held controllers for virtual reality (VR) applications are pre-designed for general applications, and thus not capable of providing appropriate haptic shape perception when wielding specific virtual objects. Contradiction between haptic and visual shape perception causes a lack of immersion and leads to inappropriate object handling in VR. To solve this problem, we propose a novel method for designing hand-held VR controllers which illusorily represent haptic equivalent of visual shape in VR. In ecological psychology, it has been suggested that the perceived shape can be modeled using the limited mass properties of wielded objects. Based on this suggestion, we built a shape perception model using a data-driven approach; we aggregated data of perceived shapes against various hand-held VR controllers with different mass properties, and derived the model using regression techniques. We implemented a design system which enables automatic design of hand-held VR controllers whose actual shapes are smaller than target shapes while maintaining their haptic shape perception. We verified that controllers designed with our system can present aimed shape perception irrespective of their actual shapes.

Supplementary Material

ZIP File (a28-fujinawa.zip)
Supplemental material.
MP4 File (a28-fujinawa.mp4)

References

[1]
Tomohiro Amemiya, Hideyuki Ando, and Taro Maeda. 2008. Lead-me Interface for a Pulling Sensation from Hand-held Devices. ACM Trans. Appl. Percept. 5, 3, Article 15 (Sept. 2008), 17 pages.
[2]
Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2016. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proc. CHI '16. 1968--1979.
[3]
Moritz Bächer, Emily Whiting, Bernd Bickel, and Olga Sorkine-Hornung. 2014. Spin-it: Optimizing Moment of Inertia for Spinnable Objects. ACM Trans. Graph. 33, 4 (2014), 96:1--96:10.
[4]
Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proc. UIST '16. 717--728.
[5]
Gregory Burton, M. T. Turvey, and H. Yosef Solomon. 1990. Can shape be perceived by dynamic touch? Perception & Psychophysics 48, 5 (01 Sep 1990), 477--487.
[6]
James Jerome Gibson. 1966. The Senses Considered as Perceptual Systems. Houghton Mifflin.
[7]
Alec Jacobson, Ilya Baran, Jovan Popović, and Olga Sorkine. 2011. Bounded Biharmonic Weights for Real-time Deformation. ACM Trans. Graph. 30, 4, Article 78 (July 2011), 8 pages.
[8]
Idsart Kingma, Rolf van de Langenberg, and Peter J Beek. 2004. Which mechanical invariants are associated with the perception of length and heaviness of a nonvisible handheld rod? Testing the inertia tensor hypothesis. Journal of Experimental Psychology: Human Perception and Performance 30, 2 (2004), 346--54.
[9]
Manfred Lau, Kapil Dev, Weiqi Shi, Julie Dorsey, and Holly Rushmeier. 2016. Tactile Mesh Saliency. ACM Trans. Graph. 35, 4, Article 52 (July 2016), 11 pages.
[10]
D. C. Liu and J. Nocedal. 1989. On the Limited Memory BFGS Method for Large Scale Optimization. Math. Program. 45, 3 (Dec. 1989), 503--528.
[11]
Lin Lu, Andrei Sharf, Haisen Zhao, Yuan Wei, Qingnan Fan, Xuelin Chen, Yann Savoye, Changhe Tu, Daniel Cohen-Or, and Baoquan Chen. 2014. Build-to-last: Strength to Weight 3D Printed Objects. ACM Trans. Graph. 33, 4, Article 97 (July 2014), 10 pages.
[12]
Thomas H Massie and J Kenneth Salisbury. 1994. The phantom haptic interface: A device for probing virtual objects. In Proceedings of the ASME winter annual meeting, symposium on haptic interfaces for virtual environment and teleoperator systems, Vol. 55. Chicago, IL, 295--300.
[13]
Kouta Minamizawa, Souichiro Fukamachi, Hiroyuki Kajimoto, Naoki Kawakami, and Susumu Tachi. 2007. Gravity Grabber: Wearable Haptic Display to Present Virtual Mass Sensation. In ACM SIGGRAPH 2007 Emerging Technologies. Article 8.
[14]
S. Nakagawara, H. Kajimoto, N. Kawakami, S. Tachi, and I. Kawabuchi. 2005. An Encounter-Type Multi-Fingered Master Hand Using Circuitous Joints. In Proc. ICRA '05. 2667--2672.
[15]
H. Omosako, A. Kimura, F. Shibata, and H. Tamura. 2012. Shape-COG Illusion: Psychophysical influence on center-of-gravity perception by mixed-reality visual stimulation. In 2012 IEEE Virtual Reality Workshops (VRW). 65--66.
[16]
Christopher C. Pagano, Paula Fitzpatrick, and M. T Turvey. 1993. Tensorial basis to the constancy of perceived object extent over variations of dynamic touch. Perception & Psychophysics 54, 1 (01 Jan 1993), 43--54.
[17]
Michal Piovarči, David I. W. Levin, Jason Rebello, Desai Chen, Roman Ďurikovič, Hanspeter Pfister, Wojciech Matusik, and Piotr Didyk. 2016. An Interaction-aware, Perceptual Model for Non-linear Elastic Objects. ACM Trans. Graph. 35, 4, Article 55 (July 2016), 13 pages.
[18]
Romain Prévost, Emily Whiting, Sylvain Lefebvre, and Olga Sorkine-Hornung. 2013. Make It Stand: Balancing Shapes for 3D Fabrication. ACM Trans. Graph. 32, 4, Article 81 (July 2013), 10 pages.
[19]
Carl Edward Rasmussen and Christopher K. I. Williams. 2006. Gaussian Processes for Machine Learning. MIT Press.
[20]
Jun Rekimoto. 2013. Traxion: A Tactile Interaction Device with Virtual Force Sensation. In Proc. UIST '13. 427--432.
[21]
Christian Schumacher, Bernd Bickel, Jan Rys, Steve Marschner, Chiara Daraio, and Markus Gross. 2015. Microstructures to Control Elasticity in 3D Printing. ACM Trans. Graph. 34, 4, Article 136 (July 2015), 13 pages.
[22]
Ondrej Stava,Juraj Vanek, Bedrich Benes, Nathan Carr, and Radomír Měch. 2012. Stress Relief: Improving Structural Strength of 3D Printable Objects. ACM Trans. Graph. 31, 4, Article 48 (July 2012), 11 pages.
[23]
M. T Turvey. 1996. Dynamic Touch. American Psychologist 51, 11 (November 1996), 1134--1152.
[24]
M. T. Turvey, Gregory Burton, Eric L. Amazeen, Matthew Butwill, and Claudia Carello. 1998. Perceiving the width and height of a hand-held object by dynamic touch. Journal of Experimental Psychology: Human Perception and Performance 24, 1 (1998), 35--48.
[25]
Nobuyuki Umetani, Yuki Koyama, Ryan Schmidt, and Takeo Igarashi. 2014. Pteromys: Interactive Design and Optimization of Free-formed Free-flight Model Airplanes. ACM Trans. Graph. 33, 4, Article 65 (July 2014), 10 pages.
[26]
André Zenner and Antonio Krüger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (2017), 1285--1294.

Cited By

View all
  • (2024)Simulating Object Weight in Virtual Reality: The Role of Absolute Mass and Weight DistributionsProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687732(1-11)Online publication date: 9-Oct-2024
  • (2024)Augmenting Perceived Length of Handheld Controllers: Effects of Object Handle PropertiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642251(1-11)Online publication date: 11-May-2024
  • (2024)Learning Visual Affordance Grounding From Demonstration VideosIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.329863835:11(16857-16871)Online publication date: Nov-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology
November 2017
437 pages
ISBN:9781450355483
DOI:10.1145/3139131
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. computational design
  2. data-driven
  3. perception
  4. virtual reality

Qualifiers

  • Research-article

Conference

VRST '17

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)83
  • Downloads (Last 6 weeks)9
Reflects downloads up to 23 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Simulating Object Weight in Virtual Reality: The Role of Absolute Mass and Weight DistributionsProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687732(1-11)Online publication date: 9-Oct-2024
  • (2024)Augmenting Perceived Length of Handheld Controllers: Effects of Object Handle PropertiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642251(1-11)Online publication date: 11-May-2024
  • (2024)Learning Visual Affordance Grounding From Demonstration VideosIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.329863835:11(16857-16871)Online publication date: Nov-2024
  • (2023)WeightMorphy: A Dynamic Weight-Shifting Method to Enhance the Virtual Experience with Body DeformationProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611367(71-75)Online publication date: 8-Oct-2023
  • (2023)When XR and AI Meet - A Scoping Review on Extended Reality and Artificial IntelligenceProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581072(1-45)Online publication date: 19-Apr-2023
  • (2023)Visuo-haptic Crossmodal Shape Perception Model for Shape-Changing Handheld Controllers Bridged by Inertial TensorProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580724(1-18)Online publication date: 19-Apr-2023
  • (2023)Presenting Morphing Shape Illusion: Enhanced Sense of Morphing Virtual Object With Weight Shifting VR Controller by Computational Perception ModelIEEE Computer Graphics and Applications10.1109/MCG.2022.322901843:4(81-89)Online publication date: 1-Jul-2023
  • (2023)Robot-enabled tangible virtual assembly with coordinated midair object placementRobotics and Computer-Integrated Manufacturing10.1016/j.rcim.2022.10243479(102434)Online publication date: Feb-2023
  • (2022)GravityPack: Exploring a Wearable Gravity Display for Immersive Interaction Using Liquid-based SystemACM SIGGRAPH 2022 Posters10.1145/3532719.3543218(1-2)Online publication date: 27-Jul-2022
  • (2021)Adaptic: A Shape Changing Prop with Haptic RetargetingProceedings of the 2021 ACM Symposium on Spatial User Interaction10.1145/3485279.3485293(1-13)Online publication date: 9-Nov-2021
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media