research-article

Tangible VR: Diegetic Tangible Objects for Virtual Reality Narratives

Authors:

Aneesh P. Tarun,

Daniel Germinario,

Ali MazalekAuthors Info & Claims

DIS '17: Proceedings of the 2017 Conference on Designing Interactive Systems

Pages 1253 - 1263

https://doi.org/10.1145/3064663.3064680

Published: 10 June 2017 Publication History

Abstract

We present a system for diegetic tangible objects in virtual reality (VR) narratives. The system integrates a custom-designed sensor unit, built with low-cost off-the-shelf hardware, to track objects in VR and to support a variety of custom-made and found tangibles. In its current form, the sensor unit tracks the objects' orientation and supports the authoring of specifically designed interactions for each tangible object. We contribute our design rationale, sensor unit, and four proof of concept prototypes, including a cube, a stuffed animal, a treasure chest, and a wooden boat, demonstrating how we leverage passive and active haptics to create a closer link between real and virtual worlds. For developers and users of VR, we expand interaction possibilities to include the physical characteristics of tangible objects. For the field of tangible narratives, we expand the current use of diegetic objects.

Supplementary Material

suppl.mov (disfp0186-file3.mp4)

Supplemental video

Download
27.53 MB

References

[1]

Thomas Bible. 2016. Audio for Narrative VR. Retrieved July 25, 2016 from https://www.youtube.com/watch?v=k_bQeDUZS04

[2]

Bruno de Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, New York, NY, USA, 218--226.

Digital Library

[3]

Aaron F. Bobick, Stephen S. Intille, James W. Davis, Freedom Baird, Claudio S. Pinhanez, Lee W. Campbell, Yuri A. Ivanov, Arjan Schütte, and Andrew Wilson. 1999. The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment. Presence: Teleoper. Virtual Environ. 8, 4, 369--393.

Digital Library

[4]

Sylvain Chagué and Caecilia Charbonnier. 2016. Real Virtuality: A Multi-User Immersive Platform Connecting Real and Virtual Worlds, VRIC 2016 Virtual Reality International Conference - Laval Virtual, Laval, France, ACM New York, NY, USA.

Digital Library

[5]

Jean Ho Chu, Paul Clifton, Hank Blumenthal, Abhishek Nandakumar, Balasubramanium Ganapathi, Janet Murray, and Ali Mazalek. 2015. Universal Threshold Object: Designing Haptic Interaction for Televised Interactive Narratives. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI 15), 285292.

Digital Library

[6]

Anna Flagg and Karon MacLean. 2013. Affective touch gesture recognition for a furry zoomorphic machine. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, New York, NY, USA, 2532.

Digital Library

[7]

James Paul Gee. 2014. An introduction to discourse analysis: Theory and method. Routledge.

[8]

Matthew G. Gorbet, Maggie Orth, and Hiroshi Ishii. 1998. Triangles: tangible interface for manipulation and exploration of digital information topography. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 98), 49--56.

Digital Library

[9]

Daniel Harley, Jean Ho Chu, Jamie Kwan, and Ali Mazalek. 2016. Towards a Framework for Tangible Narratives. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, New York, NY, USA, 62--69.

Digital Library

[10]

Vincent Hamm, Ben Padget. 2016. Pillars of Presence: Amplifying VR Immersion. Retrieved July 25, 2016 from https://www.youtube.com/watch?v=TdJf3X5tBvU

[11]

Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, pp. 139--183.

[12]

Anuruddha Hettiarachchi and Daniel Wigdor. 2016. Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1957--1967.

Digital Library

[13]

Michael Patrick Johnson, Andrew Wilson, Bruce Blumberg, Christopher Kline, and Aaron Bobick. 1999. Sympathetic interfaces: using a plush toy to direct synthetic characters. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '99). ACM, New York, NY, USA, 152158.

Digital Library

[14]

Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G. Lilienthal. "Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness." The international journal of aviation psychology 3, no. 3 (1993): 203220.

[15]

Ben Lewis-Evans. 2015. Designing to Minimize Simulation Sickness in VR Games. Retrieved July 25, 2016 from https://www.youtube.com/watch?v=2UF7BVf1zs

[16]

Pedro Lopes, Alexandra Ion, and Patrick Baudisch. 2015. Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 11--19.

Digital Library

[17]

Pedro Lopes, Patrik Jonell, and Patrick Baudisch. 2015. Affordance++: Allowing Objects to Communicate Dynamic Use. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2515--2524.

Digital Library

[18]

Yasser Malaika. 2015. Interaction Design in VR: Valve's Lessons. Retrieved July 25, 2016 from https://www.youtube.com/watch?v=_vQo0ApkAtI

[19]

Ali Mazalek, Glorianna Davenport, and Hiroshi Ishii. 2002. Tangible viewpoints: a physical approach to multimedia stories. In Proceedings of the tenth ACM international conference on Multimedia (MULTIMEDIA 02), 153--160.

Digital Library

[20]

Michael Meehan, Brent Insko, Mary Whitton, and Frederick P. Brooks, Jr. 2002. Physiological measures of presence in stressful virtual environments. In Proceedings of the 29th annual conference on Computer graphics and interactive techniques (SIGGRAPH '02). ACM, New York, NY, USA, 645--652.

Digital Library

[21]

Jack Menhorn, Todd Baker. 2016. Audio Design for VR - Ustwo's Land's End. Retrieved July 25, 2016 from http://designingsound.org/2016/03/audio-designfor-vr-ustwos-lands-end/

[22]

Janet Murray. 2005. Did it make you cry? creating dramatic agency in immersive environments. In Virtual Storytelling. Using Virtual Reality Technologies for Storytelling (pp. 83--94). Springer Berlin Heidelberg.

Digital Library

[23]

Colin Northway. 2016. Fantastic Contraption and why VR Menus Suck. Retrieved July 25, 2016 from https://www.youtube.com/watch?v=ASXST_iyhl4

[24]

Dan O'Sullivan and Tom Igoe. 2004. Physical Computing: Sensing and Controlling the Physical World with Computers. Course Technology Press, Boston, MA, USA.

Digital Library

[25]

Adalberto L. Simeone, Eduardo Velloso, and Hans Gellersen. 2015. Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 33073316.

Digital Library

[26]

Pejman Sajjadi, Edgar Omar Cebolledo Gutierrez, Sandra Trullemans, and Olga De Troyer. 2014. Maze commander: a collaborative asynchronous game using the oculus rift & the sifteo cubes. InProceedings of the first ACM SIGCHI annual symposium on Computerhuman interaction in play (CHI PLAY '14). ACM, New York, NY, USA, 227--236.

Digital Library

[27]

Misha Sra, and Chris Schmandt. 2015. MetaSpace II: Object and Full-body Tracking for Interaction and Navigation in Social VR. arXiv preprint arXiv:1512.02922.

[28]

Joshua Tanenbaum, Karen Tanenbaum, and Alissa Antle. The Reading Glove: designing interactions for object-based tangible storytelling, Proceedings of the 1st Augmented Human International Conference, p.19, April 02-03, 2010, Megève, France.

Digital Library

[29]

Nicolas Tsingos. 2016. Audio Challenges in Virtual Reality. Retrieved July 25, 2016 from https://www.youtube.com/watch?v=z9P4JbKj7mk

[30]

Kimberly Voll. 2016. This is Your Brain on VR: A Look at the Psychology of Doing VR Right. Retrieved July 25, 2016 from https://www.youtube.com/watch?v=-owQfn-iYQw

Cited By

Althoff LSilva ACarvalho MFarias M(2024)360Align: An Open Dataset and Software for Investigating QoE and Head Motion in 360° Videos with Alignment EditsProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656311(41-55)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3656311
Kerr WJicol CHaines TLi W(2024)Camera Chameleon — The Creative Impact of Tracked Tangible Interfaces for Virtual Film Pre-Production2024 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME57554.2024.10687756(1-6)Online publication date: 15-Jul-2024
https://doi.org/10.1109/ICME57554.2024.10687756
Xiao RZhang RBuruk OHamari JVirkki J(2024)Toward next generation mixed reality games: a research through design approachVirtual Reality10.1007/s10055-024-01041-928:3Online publication date: 27-Jul-2024
https://dl.acm.org/doi/10.1007/s10055-024-01041-9
Show More Cited By

Index Terms

Tangible VR: Diegetic Tangible Objects for Virtual Reality Narratives

Recommendations

Sensory VR: Smelling, Touching, and Eating Virtual Reality
TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction

We present two proof of concept sensory experiences designed for virtual reality (VR). Our experiences bring together smell, sound, taste, touch, and sight, focusing on low-cost, non-digital materials and on passive interactions. We also contribute a ...
Tangible VR: Traversing Space in XR to Grow a Virtual Butterfly
SUI '20: Proceedings of the 2020 ACM Symposium on Spatial User Interaction

Immersive reality technologies have been widely utilized in the area of cultural heritage, also known as Virtual Heritage. We present a tangible Virtual Reality (VR) interaction demo that allows users to freely walk in the physical space while engaging ...
Tangible 3D tabletops: combining tangible tabletop interaction and 3D projection
NordiCHI '12: Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design

In this paper we present the tangible 3D tabletop and discuss the design potential of this novel interface. The tangible 3D tabletop combines tangible tabletop interaction with 3D projection in such a way that the tangible objects may be augmented with ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '17: Proceedings of the 2017 Conference on Designing Interactive Systems

June 2017

1444 pages

ISBN:9781450349222

DOI:10.1145/3064663

General Chair:
Oli Mival
Edinburgh Napier University, UK
,
Program Chairs:
Michael Smyth
Edinburgh Napier University, UK
,
Peter Dalsgaard
Aarhus University, Denmark

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 June 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Canada Research Chairs
Canada Foundation for Innovation
Ontario Ministry of Research and Innovation

Conference

DIS '17

Sponsor:

SIGCHI

DIS '17: Designing Interactive Systems Conference 2017

June 10 - 14, 2017

Edinburgh, United Kingdom

Acceptance Rates

DIS '17 Paper Acceptance Rate 107 of 487 submissions, 22%;

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
1,428
Total Downloads

Downloads (Last 12 months)148
Downloads (Last 6 weeks)26

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Althoff LSilva ACarvalho MFarias M(2024)360Align: An Open Dataset and Software for Investigating QoE and Head Motion in 360° Videos with Alignment EditsProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656311(41-55)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3656311
Kerr WJicol CHaines TLi W(2024)Camera Chameleon — The Creative Impact of Tracked Tangible Interfaces for Virtual Film Pre-Production2024 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME57554.2024.10687756(1-6)Online publication date: 15-Jul-2024
https://doi.org/10.1109/ICME57554.2024.10687756
Xiao RZhang RBuruk OHamari JVirkki J(2024)Toward next generation mixed reality games: a research through design approachVirtual Reality10.1007/s10055-024-01041-928:3Online publication date: 27-Jul-2024
https://dl.acm.org/doi/10.1007/s10055-024-01041-9
Pedersen BLyk PAlexander Auerbach D(2024)Augmented Virtuality–A Simplified, Scalable, and Modular Open-Source Unity Development System for Tangible VR with the Meta Quest 2Virtual, Augmented and Mixed Reality10.1007/978-3-031-61044-8_18(241-262)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-61044-8_18
Rieger S(2023) Neues Lesen . Unikalität und Multisensorik als Strategien der Literaturvermittlung Journal of Literary Theory10.1515/jlt-2023-200717:1(143-166)Online publication date: 20-Jul-2023
https://doi.org/10.1515/jlt-2023-2007
Gong WSantosa SGrossman TGlueck MClarke DLai F(2023)Affordance-Based and User-Defined Gestures for Spatial Tangible InteractionProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596032(1500-1514)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596032
Harley DMacArthur C(2023)Sharing Play Spaces: Design Lessons from Reddit Posts Showing Virtual Reality in the HomeProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596005(509-522)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596005
Zhou YPopescu V(2023)Dynamic Redirection for VR Haptics with a Handheld StickIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324704729:5(2753-2762)Online publication date: May-2023
https://doi.org/10.1109/TVCG.2023.3247047
Zhang YHuang Z(2023)A Board Game Hootopia: Biodiversity Education Through Tangible and Interactive NarrativeInteractive Storytelling10.1007/978-3-031-47655-6_25(410-421)Online publication date: 31-Oct-2023
https://doi.org/10.1007/978-3-031-47655-6_25
Bellucci ADíaz PAedo I(2023)Exploring Visual Languages for Prototyping Interactive Behaviors for Tangible Virtual RealityEnd-User Development10.1007/978-3-031-34433-6_13(203-219)Online publication date: 6-Jun-2023
https://dl.acm.org/doi/10.1007/978-3-031-34433-6_13
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents