Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3290605.3300241acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model

Published: 02 May 2019 Publication History

Abstract

Humans can estimate the shape of a wielded object through the illusory feeling of the mass properties of the object obtained using their hands. Even though the shape of hand-held objects influences immersion and realism in virtual reality (VR), it is difficult to design VR controllers for rendering desired shapes according to the perceptions derived from the illusory effects of mass properties and shape perception. We propose Transcalibur, which is a hand-held VR controller that can render a 2D shape by changing its mass properties on a 2D planar area. We built a computational perception model using a data-driven approach from the collected data pairs of mass properties and perceived shapes. This enables Transcalibur to easily and effectively provide convincing shape perception based on complex illusory effects. Our user study showed that the system succeeded in providing the perception of various desired shapes in a virtual environment.

Supplementary Material

ZIP File (paper011.zip)
# jpg files - supp_angle.jpg A picture of a moving angular mechanism of Transcalibur - supp_weight.jpg A picture of a moving weight shifting mechanism of Transcalibur - supp_whole.jpg A picture of entire Transcalibur working # GIF files - supp_angle.gif A footage of a moving angular mechanism of Transcalibur - supp_weight.gif A footage of a moving weight shifting mechanism of Transcalibur - supp_whole.gif A footage of entire Transcalibur working - supp_app.gif A footage of a uesr wielding Transcalibur in an actual VR experience.
MP4 File (paper011.mp4)
Supplemental video
MP4 File (paper011p.mp4)
Preview video

References

[1]
Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology - UIST '16. 717-- 728.
[2]
Inrak Choi and Sean Follmer. 2016. Wolverine: A Wearable Haptic Interface for Grasping in VR. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16 Adjunct). ACM, New York, NY, USA, 117--119.
[3]
Inrak Choi, Eyal Ofek, Hrvoje Benko, Mike Sinclair, and Christian Holz. 2018. CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 (2018), 1--13.
[4]
Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13. 417-- 426.
[5]
Eisuke Fujinawa, Shigeo Yoshida, Yuki Koyama, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2017. Computational design of hand-held VR controllers using haptic shape illusion. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology VRST '17. 1--10.
[6]
Young Min Han, Chan Jung Kim, and Seung Bok Choi. 2009. A magnetorheological fluid-based multifunctional haptic device for vehicular instrument controls. Smart Materials and Structures 18, 1 (2009).
[7]
Fabian Hemmert, Susann Hamann, Matthias Löwe, Josefine Zeipelt, and Gesche Joost. 2010. Weight-shifting Mobiles: Two-dimensional Gravitational Displays in Mobile Phones. In CHI '10 Extended Abstracts on Human Factors in Computing Systems (CHI EA '10). ACM, New York, NY, USA, 3087--3092.
[8]
Seongkook Heo, Christina Chung, Geehyuk Lee, and Daniel Wigdor. 2018. Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force. Chi 2018 (2018), 1--11.
[9]
Koichi Hirota and Michitaka Hirose. 1998. Implementation of partial surface display. Presence: Teleoperators and Virtual Environments 7, 6 (1998), 638--649.
[10]
Hiroo Iwata, Hiroaki Yano, Fumitaka Nakaizumi, and Ryo Kawamura. 2001. Project FEELEX. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques - SIGGRAPH '01. 469--476.
[11]
Seungwoo Je, Hyelip Lee, Myung Jin Kim, and Andrea Bianchi. 2018. Wind-blaster: A Wearable Propeller-based Prototype That Provides Ungrounded Force-feedback. In ACM SIGGRAPH 2018 Emerging Technologies (SIGGRAPH '18). ACM, New York, NY, USA, Article 23, 2 pages.
[12]
Hwan Kim, HyeonBeom Yi, Richard Chulwoo Park, and Woohun Lee. 2018. Hapcube: A Tactile Actuator Providing Tangential and Normal Pseudo-force Feedback on a Fingertip. In ACM SIGGRAPH 2018 Emerging Technologies (SIGGRAPH '18). ACM, New York, NY, USA, Article 9, 2 pages.
[13]
Idsart Kingma, Rolf Van De Langenberg, and Peter J. Beek. 2004. Which Mechanical Invariants Are Associated With the Perception of Length and Heaviness of a Nonvisible Handheld Rod? Testing the Inertia Tensor Hypothesis. Journal of Experimental Psychology: Human Perception and Performance 30, 2 (2004), 346--354.
[14]
Pedro Lopes, Alexandra Ion, and Patrick Baudisch. 2015. Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 11--19.
[15]
Pedro Lopes, Alexandra Ion, Sijing You, and Patrick Baudisch. 2018. Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 c (2018), 1--13.
[16]
Kouta Minamizawa and Souichiro Fukamachi. 2007. Gravity grabber: wearable haptic display to present virtual mass sensation. ACM SIGGRAPH 2007 emerging technologies (2007), 8.
[17]
Ryuma Niiyama, Lining Yao, and Hiroshi Ishii. 2013. Weight and Volume Changing Device with Liquid Metal Transfer. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). ACM, New York, NY, USA, 49--52.
[18]
Victor Adriel Oliveira, Luca Brayda, Luciana Nedel, and Anderson Maciel. 2017. Experiencing guidance in 3D spaces with a vibrotactile head-mounted display. 453--454.
[19]
Christopher C. Pagano, Paula Fitzpatrick, and M. T. Turvey. 1993. Tensorial basis to the constancy of perceived object extent over variations of dynamic touch. Perception & Psychophysics 54, 1 (1993), 43--54.
[20]
Jun Rekimoto. 2013. Traxion: A Tactile Interaction Device with Virtual Force Sensation. In Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST '13). 427--431.
[21]
Tomoya Sasaki, Richard Sahala Hartanto, Kao-Hua Liu, Keitarou Tsuchiya, Atsushi Hiyama, and Masahiko Inami. 2018. Leviopole: Mid-air Haptic Interactions Using Multirotor. In ACM SIGGRAPH 2018 Emerging Technologies (SIGGRAPH '18). ACM, New York, NY, USA, Article 12, 2 pages.
[22]
Samuel B. Schorr and Allison M. Okamura. 2017. Fingertip Tactile Devices for Virtual Object Manipulation and Exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems CHI '17. 3115--3119.
[23]
Jongman Seo, Sunung Mun, Jaebong Lee, and Seungmoon Choi. 2018. Substituting Motion Effects with Vibrotactile Effects for 4D Experiences. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 428, 6 pages.
[24]
H. Yosef Solomon and M. T. Turvey. 1988. Haptically Perceiving the Distances Reachable With Hand-Held Objects. Journal of Experimental Psychology: Human Perception and Performance 14, 3 (1988), 404--427.
[25]
Evan Strasnick, Christian Holz, Eyal Ofek, Mike Sinclair, and Hrvoje Benko. 2018. Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 (2018), 1--12.
[26]
M. T. Turvey. 1996. Dynamic Touch. American Psychologist 51, 11 (1996), 1134--1152.
[27]
M. T. Turvey, Gregory Burton, Eric L. Amazeen, Matthew Butwill, and Claudia Carello. 1998. Perceiving the Width and Height of a HandHeld Object by Dynamic Touch. Journal of Experimental Psychology: Human Perception and Performance 24, 1 (1998), 35--48.
[28]
UploadVR. 2018. This VR Controller Mod Shifts Weight To Simulate Objects. Retrieved January 3, 2018 from https://uploadvr.com/ vr-controller-mod-shifts-weight-simulate-objects/
[29]
Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, and Mike Sinclair. 2018. Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems CHI '18 (2018), 1--12.
[30]
Vibol Yem, Ryuta Okazaki, and Hiroyuki Kajimoto. 2016. FinGAR: Combination of Electrical and Mechanical Stimulation for High-Fidelity Tactile Presentation. In ACM SIGGRAPH 2016 Emerging Technologies on - SIGGRAPH '16. 1--2.
[31]
Andre Zenner and Antonio Kruger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (2017), 1312--1321.
[32]
Yiwei Zhao, Lawrence H. Kim, Ye Wang, Mathieu Le Goc, and Sean Follmer. 2017. Robotic Assembly of Haptic Proxy Objects for Tangible Interaction and Virtual Reality. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, New York, NY, USA, 82--91.

Cited By

View all
  • (2024)3D Hand Motion Generation for VR Interactions Using a Haptic Data GloveMultimodal Technologies and Interaction10.3390/mti80700628:7(62)Online publication date: 15-Jul-2024
  • (2024)TorqueCapsules: Fully-Encapsulated Flywheel Actuation Modules for Designing and Prototyping Movement-Based and Kinesthetic InteractionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676364(1-15)Online publication date: 13-Oct-2024
  • (2024)Stick-To-XR: Understanding Stick-Based User Interface Design for Extended RealityProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661627(168-179)Online publication date: 1-Jul-2024
  • Show More Cited By

Index Terms

  1. Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
        May 2019
        9077 pages
        ISBN:9781450359702
        DOI:10.1145/3290605
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 02 May 2019

        Permissions

        Request permissions for this article.

        Check for updates

        Badges

        • Honorable Mention

        Author Tags

        1. computational interaction
        2. haptic display
        3. shape perception
        4. virtual reality

        Qualifiers

        • Research-article

        Funding Sources

        • JST PRESTO

        Conference

        CHI '19
        Sponsor:

        Acceptance Rates

        CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;
        Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

        Upcoming Conference

        CHI 2025
        ACM CHI Conference on Human Factors in Computing Systems
        April 26 - May 1, 2025
        Yokohama , Japan

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)251
        • Downloads (Last 6 weeks)16
        Reflects downloads up to 23 Feb 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)3D Hand Motion Generation for VR Interactions Using a Haptic Data GloveMultimodal Technologies and Interaction10.3390/mti80700628:7(62)Online publication date: 15-Jul-2024
        • (2024)TorqueCapsules: Fully-Encapsulated Flywheel Actuation Modules for Designing and Prototyping Movement-Based and Kinesthetic InteractionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676364(1-15)Online publication date: 13-Oct-2024
        • (2024)Stick-To-XR: Understanding Stick-Based User Interface Design for Extended RealityProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661627(168-179)Online publication date: 1-Jul-2024
        • (2024)Simulating Object Weight in Virtual Reality: The Role of Absolute Mass and Weight DistributionsProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687732(1-11)Online publication date: 9-Oct-2024
        • (2024)Designing Stick-Based Extended Reality Controllers: A Participatory ApproachExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650925(1-6)Online publication date: 11-May-2024
        • (2024)MobileGravity: Mobile Simulation of a High Range of Weight in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642658(1-13)Online publication date: 11-May-2024
        • (2024)Experiencing Dynamic Weight Changes in Virtual Reality Through Pseudo-Haptics and Vibrotactile FeedbackProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642552(1-13)Online publication date: 11-May-2024
        • (2024)Augmenting Perceived Length of Handheld Controllers: Effects of Object Handle PropertiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642251(1-11)Online publication date: 11-May-2024
        • (2024)Does Multi-Actuator Vibrotactile Feedback Within Tangible Objects Enrich VR Manipulation?IEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.327939830:8(4767-4779)Online publication date: Aug-2024
        • (2023)CReST: Design and Evaluation of the Cross-Reality Study ToolProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3627803(409-419)Online publication date: 3-Dec-2023
        • Show More Cited By

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media