poster

Implications of Audio and Narration in the User Experience Design of Virtual Reality

Authors:

Chelsea Kelling,

Heli Väätäjä,

Markku Turunen,

Vesa LindqvistAuthors Info & Claims

Mindtrek '18: Proceedings of the 22nd International Academic Mindtrek Conference

Pages 258 - 261

https://doi.org/10.1145/3275116.3275153

Published: 10 October 2018 Publication History

Abstract

Virtual reality (VR) is quickly gaining momentum as an immersive medium; however, there is much to learn about the design elements needed to create a positive experience. In this paper, we present the second wave of user testing of a journalistic and cultural VR experience that tells the story of a well-known artist through his art. The storytelling elements narration and ambient music were added to the initial prototype and tested in the field with 32 participants. Our results showed that the improvements produced a mostly positive user experience and shed light on what could be further improved in the case of our prototype, the field of immersive journalism, and VR used in the cultural context.

References

[1]

Palombini, Augusto. 2017. Storytelling and telling history. Towards a grammar of narratives for cultural heritage dissemination in the digital era. Journal of Cultural Heritage 24, 134--139.

[2]

C. Kelling, H. Väätäjä, and O. Kauhanen. 2017. Impact of device, context of use, and content on viewing experience of 360-degree tourism video. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia. ACM, New York, NY, USA, 211--222.

Digital Library

[3]

Diana Fonseca and Martin Kraus. 2016. A comparison of head-mounted and hand-held displays for 360° videos with focus on attitude and behavior change. In Proceedings of the 20th International Academic Mindtrek Conference, 287--296.

Digital Library

[4]

Sirkkunen, E. Väätäjä, H. Uskali, T. and Pour Rezaei, P. 2016. Journalism in virtual reality: opportunities and future research challenges. In Proceedings of the 20th International Academic Mindtrek Conference. ACM, New York, NY, USA, 297--303.

Digital Library

[5]

Guan Wang, Wenying Gu, and Ayoung Suh. 2018. The effects of 360-degree VR videos on audience engagement: Evidence from the New York Times. In International Conference on HCI in Business, Government, and Organizations, 217--235.

Digital Library

[6]

Kauhanen, O. Väätäjä, H. Turunen, Keskinen, T. Sirkkunen, E. Uskali, T. Lindqvist, V. Kelling, C. and Karhu, J. 2017. Assisting immersive virtual reality development with user experience design approach. In Proceedings of the 21st International Academic Mindtrek Conference. 127--136. ACM.

Digital Library

[7]

T. Aitamurto, S. Zhou, S. Sakshuwong, J. Saldivar, Y. Sadeghi, and A. Tran. 2018. Sense of presence, attitude change, perspective-taking and usability in first-person split-sphere 360° video. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, Paper 545, 12 pages.

Digital Library

[8]

Donghee Shin. 2018. Empathy and embodied experience in virtual environment: To what extent can virtual reality stimulate empathy and embodied experience?. Computers in Human Behavior 78, 64--73.

Digital Library

[9]

G. Schofield, G. Beale, N. Beale, M. Fell, D. Hadley, J. Hook, D. Murphy, J. Richards, and L. Thresh. 2018. Viking VR: Designing a virtual reality experience for a museum. In Proceedings of the Designing Interactive Systems Conference, pp. 805--815.

Digital Library

[10]

Hakulinen, Jaakko, Tuuli Keskinen, Ville Mäkelä, Santeri Saarinen, and Markku Turunen. 2017. Omnidirectional video in museums-authentic, immersive and entertaining. In International Conference on Advances in Computer Entertainment, pp. 567--587.

[11]

N. P De la Peña, Weil, J.L., Giannopoulos, E., Pomés, A., Spanlang, B., Friedman, D., Sanchez-Vives, M.V., and Slater, M. 2010. Immersive journalism: Immersive virtual reality for the first-person experience of news. Presence: Teleoperators and Virtual Environments, 19, 4, 291--301.

Digital Library

[12]

Donghee Shin and Frank Biocca. 2017. Exploring immersive experience in journalism. New Media & Society.

[13]

Laura Klein, 2013. UX for lean startups: Faster, smarter user experience research and design. O'Reilly Media Inc. 31--32.

[14]

T. Schubert, F. Friedmann, and H. Regenbrecht. 2001. The experience of presence: Factor analytic insights. Presence: Teleoperators and Virtual Environments, 10, 3, 266--281.

Digital Library

[15]

J. S. Ahuja and J. Webster. 2001. Perceived disorientation: an examination of a new measure to assess web design effectiveness, Interacting with Computers, 14 (1), 15--29.

[16]

N. David, A. Newen, and K. Vogeley. 2008. The "sense of agency" and its underlying cognitive and neural mechanisms. Consciousness and Cognition, 17, 2, 523--534.

[17]

P. Desmet and P. Hekkert. 2007. Framework of Product Experience, International Journal of Design, 1 (1).

[18]

M. Slater, M. Usoh, and A. Steed. 1995. Taking steps: the influence of a walking technique on presence in virtual reality. ACM Transactions on Computer-Human Interaction, Special issue on virtual reality software and technology, 2, 3, 201--219.

Digital Library

[19]

R. S. Kennedy, N. E. Lane, K.S. Berbaum, and M.G. Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The International Journal of Aviation Psychology, 3, 3, 203--220.

[20]

S. Kujala, V. Roto, K. Väänänen-Vainio-Mattila, E. Karapanos, and A. Sinnelä. 2011. UX Curve: A method for evaluating long-term user experience. Interacting with Computers 23, 5, 473--483.

Digital Library

[21]

M., Thüring and S. Mahlke. 2007. Usability, aesthetics and emotions in human-technology interaction. International Journal of Psychology, 42, 4, 253--264.

Cited By

Privitera AFontana FGeronazzo M(2024)The Role of Audio in Immersive Storytelling: a Systematic Review in Cultural HeritageMultimedia Tools and Applications10.1007/s11042-024-19288-4Online publication date: 26-Jun-2024
https://doi.org/10.1007/s11042-024-19288-4
Bosman IBuruk OJørgensen KHamari J(2023)The effect of audio on the experience in virtual reality: a scoping reviewBehaviour & Information Technology10.1080/0144929X.2022.215837143:1(165-199)Online publication date: 2-Jan-2023
https://doi.org/10.1080/0144929X.2022.2158371
Tepsa THaavikko MLi ORuismaki VKangas SKattelus JVaataja H(2022)A Digital Twin of a Heat Pump with a Game Engine for Educational Use2022 45th Jubilee International Convention on Information, Communication and Electronic Technology (MIPRO)10.23919/MIPRO55190.2022.9803694(1341-1346)Online publication date: 23-May-2022
https://doi.org/10.23919/MIPRO55190.2022.9803694
Show More Cited By

Index Terms

Implications of Audio and Narration in the User Experience Design of Virtual Reality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies

Recommendations

Narrative Approaches to Design Multi-screen Augmented Reality Experiences
EVA London 2014: Proceedings of the EVA London 2014 on Electronic Visualisation and the Arts

Augmented Reality (AR) represents the future of the digital integrated museum experience. There is considerable scope for providing engaging and interactive experiences when using AR combined with traditional museum practices, particularly relative to ...
Journalism in virtual reality: opportunities and future research challenges
AcademicMindtrek '16: Proceedings of the 20th International Academic Mindtrek Conference

This paper presents a state-of-the-art overview of journalism and its opportunities and challenges in virtual reality (VR). First, we examine what kind of real-life journalistic experiments have been made in this field thus far, and then we analyze the ...
Interactive Narrative in Virtual Reality
MUM '18: Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia

Interactive fiction is a literary genre that is rapidly gaining popularity. In this genre, readers are able to explicitly take actions in order to guide the course of the story. With the recent popularity of narrative focused games, we propose to design ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

Mindtrek '18: Proceedings of the 22nd International Academic Mindtrek Conference

October 2018

282 pages

ISBN:9781450365895

DOI:10.1145/3275116

Copyright © 2018 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

Tampere University of Technology
UTA: The University of Tampere
SIGCHI Finland: ACM SIGCHI Finland
Tampere University of Applied Sciences

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2018

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

Tekes

Conference

Mindtrek 2018

Mindtrek 2018: Academic Mindtrek 2018

October 10 - 11, 2018

Tampere, Finland

Acceptance Rates

Mindtrek '18 Paper Acceptance Rate 34 of 68 submissions, 50%;

Overall Acceptance Rate 110 of 207 submissions, 53%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
424
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)5

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Privitera AFontana FGeronazzo M(2024)The Role of Audio in Immersive Storytelling: a Systematic Review in Cultural HeritageMultimedia Tools and Applications10.1007/s11042-024-19288-4Online publication date: 26-Jun-2024
https://doi.org/10.1007/s11042-024-19288-4
Bosman IBuruk OJørgensen KHamari J(2023)The effect of audio on the experience in virtual reality: a scoping reviewBehaviour & Information Technology10.1080/0144929X.2022.215837143:1(165-199)Online publication date: 2-Jan-2023
https://doi.org/10.1080/0144929X.2022.2158371
Tepsa THaavikko MLi ORuismaki VKangas SKattelus JVaataja H(2022)A Digital Twin of a Heat Pump with a Game Engine for Educational Use2022 45th Jubilee International Convention on Information, Communication and Electronic Technology (MIPRO)10.23919/MIPRO55190.2022.9803694(1341-1346)Online publication date: 23-May-2022
https://doi.org/10.23919/MIPRO55190.2022.9803694
Prakash MKang WLi WLi K(2021)Embodying a Narrative: Spatializing Abstract Narrative Themes for Forensic ExplorationExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451593(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451593
Cooney S(2021)Riding the Bus in Los Angeles: Creating Cultural Micro-Exposures via TechnologyExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3450392(1-9)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3450392
Assaf RRodrigues R(2019)The Feeling of PresenceProceedings of the 9th International Conference on Digital and Interactive Arts10.1145/3359852.3359861(1-6)Online publication date: 23-Oct-2019
https://dl.acm.org/doi/10.1145/3359852.3359861
Che XMa SYu QYue C(2019)An Event-Based User Experience Evaluation Method for Virtual Reality Applications2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI)10.1109/SmartWorld-UIC-ATC-SCALCOM-IOP-SCI.2019.00164(767-774)Online publication date: Aug-2019
https://doi.org/10.1109/SmartWorld-UIC-ATC-SCALCOM-IOP-SCI.2019.00164

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten