research-article

Comparative Study of HMD-based Virtual and Augmented Realities for Immersive Museums: User Acceptance, Medium, and Learning

Authors:

Yun LiuAuthors Info & Claims

ACM Journal on Computing and Cultural Heritage, Volume 17, Issue 1

Article No.: 13, Pages 1 - 17

https://doi.org/10.1145/3627164

Published: 23 February 2024 Publication History

Abstract

Technologies like Head Mounted Display (HMD)-based Virtual Reality (VR) and Augmented Reality (AR) have made HMD-based immersive museums possible. To investigate the user acceptance, medium, and interaction experience for HMD-based immersive museums, an app entitled The Extended Journey has been designed, developed, and deployed on both VR headsets and AR headsets. Subsequently, a between-subjects design experiment with 62 participants was conducted to measure the user experience and learning outcome in HMD VR and HMD AR conditions. Quantitative results revealed that HMD VR museums had statistically significantly better immersion and empathy compared to HMD AR museums. Qualitative data indicated HMD-based immersive museums were embraced by most young participants while HMD VR had better user acceptance than HMD AR for immersive museums. The interview also demonstrated that the advantage of the HMD-based immersive museum over the traditional online museum is not only the sensory immersion from the medium itself but also the interactive narrative experience that the HMD medium facilitates, especially the natural interaction with the CG characters and the environment in the story.

References

[1]

P. Tišliar. 2017. The development of informal learning and museum pedagogy in museums. Eur. J. Contemp. Edu. 6, 3 (2017), 586–592.

[2]

L. Vyotsky. 1978. Mind in Society: The Development of Higher Psychological Processes. Harvard University Press, Cambridge, MA.

[3]

D. H. Jonassen and L. Rohrer-Murphy. 1999. Activity theory as a framework for designing constructivist learning environments. Edu. Technol. Res. Dev. 47, 1 (1999), 61–79.

[4]

B. Biedermann. 2021. Virtual museums as an extended museum experience: Challenges and impacts for museology, digital humanities, museums, and visitors in times of (Coronavirus) crisis. Dig. Human. Quart. 15, 3 (2021).

[5]

J. Kidd. 2018. “Immersive” heritage encounters. Museum Rev. 3, 1 (2018).

[6]

U. Spierling and A. Kampa. 2014. Structuring location-aware interactive narratives for mobile augmented reality. In Proceedings of the International Conference on Interactive Digital Storytelling. Springer.

[7]

R. Wojciechowski et al. 2004. Building Virtual and Augmented Reality museum exhibitions. In Proceedings of the 9th International Conference on 3D Web Technology. Association for Computing Machinery, 135–144.

Digital Library

[8]

I. Giangreco et al. 2019. VIRTUE: A virtual reality museum Experience. In Proceedings of the 24th International Conference on Intelligent User Interfaces. Association for Computing Machinery, 119–120.

[9]

L. Barbieri, F. Bruno, and M. Muzzupappa. 2018. User-centered design of a virtual reality exhibit for archaeological museums. Int. J. Interact. Design Manufact. 12, 2 (2018), 561–571.

[10]

Y.-C. Huang and S. R. Han. 2014. An Immersive Virtual Reality Museum via Second Life. Springer International Publishing, Cham.

[11]

G. Schofield et al. 2018. Viking VR: Designing a virtual reality experience for a museum. In Proceedings of the Designing Interactive Systems Conference. Association for Computing Machinery, 805–815.

Digital Library

[12]

T. Museum. 2022. Modigliani VR: The Ochre Atelier. Retrieved from https://www.tate.org.uk/whats-on/tate-modern/modigliani/modigliani-vr-ochre-atelier

[13]

F. F. Entertainment. 2019. Anne Frank House VR. Retrieved from https://annefrankhousevr.com/

[14]

F. Bruno et al. 2010. From 3D reconstruction to virtual reality: A complete methodology for digital archaeological exhibition. J. Cultur. Herit. 11, 1 (2010), 42–49.

[15]

M. Carrozzino and M. Bergamasco. 2010. Beyond virtual museums: Experiencing immersive virtual reality in real museums. J. Cultur. Herit. 11, 4 (2010), 452–458.

[16]

K. Beale. 2011. Museums at Play: Games, Interaction and Learning. Museums Etc.

[17]

S. Sylaiou et al. 2009. Virtual museums, a survey on methods and tools. J. Cultur. Herit. 10, 4 (2009) 520–528.

[18]

M. L. Ryan. 2001. Narrative as Virtual Reality: Immersion and Interactivity in Literature and Electronic Media. Johns Hopkins University Press.

[19]

H. McBride, B. Haas, and M. Berson. 2014. Teaching the Holocaust at a distance: Reflections from the field. Ohio Soc. Stud. Rev. 51, 1 (2014), 18–30.

[20]

J. L. Endacott. 2014. Negotiating the process of historical empathy. Theory Res. Soc. Edu. 42, 1 (2014) 4–34.

[21]

M. L. Hoffman. 1984. Interaction of affect and cognition in empathy. In Emotions, Cognition, and Behavior, C. E. Izard, J. Kagan, and R. B. Zajonc (Eds.). Cambridge University Press, 103–131.

[22]

C. Saarni and M. Crowley. 1990. The development of emotion regulation: Effects on emotional state and expression. Emotions and Family: For Better or for Worse. Routledge, 53–73.

[23]

Y. Jin et al. 2017. Games for mental and moral development of youth: A review of empirical studies. In Proceedings of the Joint International Conference on Serious Games. Springer.

[24]

L. Shen. 2010. On a scale of state empathy during message processing. West. J. Commun. 74, 5 (2010), 504–524.

[25]

J. Cohen. 2001. Defining identification: A theoretical look at the identification of audiences with media characters. Mass Commun. Soc. 4, 3 (2001), 245–264.

[26]

S. Onega and J. A. G. Landa. 2014. Narratology: An Introduction. Routledge.

[27]

F. J. Varela, E. Thompson, and E. Rosch. 2017. The Embodied Mind, Revised Edition: Cognitive Science and Human Experience. MIT Press.

[28]

F. Herrera et al. 2018. Building long-term empathy: A large-scale comparison of traditional and virtual reality perspective-taking. PloS One 13, 10 (2018), e0204494.

[29]

D. Fonseca and M. Kraus. 2016. A comparison of head-mounted and hand-held displays for 360 videos with focus on attitude and behavior change. In Proceedings of the 20th International Academic Mindtrek Conference.

Digital Library

[30]

N. S. Schutte and E. J. Stilinović. 2017. Facilitating empathy through virtual reality. Motivat. Emot. 41, 6 (2017), 708–712.

[31]

E. Ch'Ng et al. 2020. The effects of VR environments on the acceptance, experience, and expectations of cultural heritage learning. J. Comput. Cult. Herit. 13, 1 (2020), 1–21.

Digital Library

[32]

D.-I. Han, M. C. tom Dieck, and T. Jung. 2018. User experience model for augmented reality applications in urban heritage tourism. J. Herit. Tour. 13, 1 (2018), 46–61.

[33]

M. C. tom Dieck and T. Jung. 2018. A theoretical model of mobile augmented reality acceptance in urban heritage tourism. Curr. Iss. Tour. 21, 2 (2018), 154–174.

[34]

M. Trunfio and S. Campana. 2020. A visitors’ experience model for mixed reality in the museum. Curr. Iss. Tour. 23, 9 (2020), 1053–1058.

[35]

Y. Jin, M. Ma, and Y. Zhu. 2022. A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality. Multimedia Tools Appl. 81, 4 (2022), 5795–5826.

Digital Library

[36]

D. A. Bowman and R. P. McMahan. 2007. Virtual reality: How much immersion is enough? Computer 40, 7 (2007), 36–43.

Digital Library

[37]

M. Slater. 2003. A note on presence terminology. Presence Connect 3, 3 (2003), 1–5.

[38]

M. B. Donnelly. 2006. Educating students about the Holocaust: A survey of teaching practices. Soc. Edu. 70, 1 (2006), 51–55.

[39]

L. Mosaker. 2001. Visualising historical knowledge using virtual reality technology. Dig. Creat. 12, 1 (2001), 15–25.

[40]

B. G. Witmer and M. J. Singer. 1998. Measuring presence in virtual environments: A presence questionnaire. Presence: Teleop. Virtual Environ. 7, 3 (1998), 225–240.

Digital Library

[41]

M. S. Cole, S. G. Harris, and H. S. Feild. 2004. Stages of learning motivation: Development and validation of a measure 1. J. Appl. Soc. Psychol. 34, 7 (2004), 1421–1456.

[42]

H. Qin, P. L. Patrick Rau, and G. Salvendy. 2009. Measuring player immersion in the computer game narrative. Int. J. Hum.-Comput. Interact. 25, 2 (2009), 107–133.

[43]

A. Bartsch. 2012. Emotional gratification in entertainment experience. Why viewers of movies and television series find it rewarding to experience emotions. Media Psychol. 15, 3 (2012), 267–302.

[44]

J. Saldaña. 2015. The Coding Manual for Qualitative Researchers. Sage.

[45]

M. Freeth, T. Foulsham, and A. Kingstone. 2013. What affects social attention? Social presence, eye contact, and autistic traits. PloS One 8, 1 (2013), e53286.

[46]

M. L. Yuan et al. 2010. Eye contact with a virtual character using a vision-based head tracker. In Lecture Notes in Electrical Engineering.

[47]

R. Hodhod. 2010. Interactive Narrative for Adaptive Educational Games: Architecture and an Application to Character Education. University of York.

[48]

N. Tancred et al. 2018. Player choices, game endings, and the design of moral dilemmas in games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (CHI-PLAY’18). 2018.

Digital Library

[49]

E. Game. 2022. Unreal 5 Overview. Retrieved from https://www.unrealengine.com/en-US/unreal-engine-5

[50]

G. Makransky and L. Lilleholt. 2018. A structural equation modeling investigation of the emotional value of immersive virtual reality in education. Edu. Technol. Res. Dev. 66, 5 (2018), 1141–1164.

[51]

P. Vishwakarma, S. Mukherjee, and B. Datta. 2020. Antecedents of adoption of virtual reality in experiencing destination: A study on the Indian consumers. Tour. Rec. Res. 45, 1 (2020), 42–56.

[52]

News 9. 2022. Mark Zuckerberg reveals Meta's next-gen VR display prototypes—Hollowcake 2 and Mirror Lake. Retrieved from https://www.news9live.com/technology/gadgets/mark-zuckerberg-reveals-hollowcake-2-mirrorlake-metas-next-gen-vr-display-prototypes-177682

[53]

J. Challenor and M. Ma. 2019. Augmented Reality in Holocaust Museums and Memorials. Multimodal Technol. Interact. (2019).

Cited By

Mamee WChuenchaichon C(2024)The Design of Souvenir Products Presented Through Augmented Reality for the King Naresuan Exhibition and Convention CenterAsian Health, Science and Technology Reports10.69650/ahstr.2024.227332:2(28-45)Online publication date: 12-Jun-2024
https://doi.org/10.69650/ahstr.2024.2273

Index Terms

Comparative Study of HMD-based Virtual and Augmented Realities for Immersive Museums: User Acceptance, Medium, and Learning
1. Applied computing
  1. Arts and humanities
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
  2. Interaction design
    1. Systems and tools for interaction design

Recommendations

A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality
Abstract
Over the years, the various mediums available for storytelling have progressively expanded, from spoken to written word, then to film, and now to Virtual Reality (VR) and Augmented Reality (AR). In 2016, the cutting-edge Head-Mounted Display (HMD) ...
Stepping off a ledge in an HMD-based immersive virtual environment
SAP '13: Proceedings of the ACM Symposium on Applied Perception

We explore whether a gender-matched, calibrated self-avatar affects the perception of the affordance of stepping off of a ledge, or visual cliff, in an immersive virtual environment. Visual cliffs form demonstrations in many immersive virtual ...
Augmented Winter Ski with AR HMD
AH '16: Proceedings of the 7th Augmented Human International Conference 2016

At time of writing, several affordable Head-Mounted Displays (HMD) are going to be released to the mass market, most of them for Virtual Reality (VR with Oculus Rift, Samsung Gear...) but also for indoor Augmented Reality (AR) with Hololens. We have ...

Comments

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage

Journal on Computing and Cultural Heritage Volume 17, Issue 1

March 2024

312 pages

EISSN:1556-4711

DOI:10.1145/3613493

Editor:
Franco Niccolucci
VAST-LAB at PIN, University of Florence, Italy

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 February 2024

Online AM: 06 November 2023

Accepted: 02 July 2023

Revised: 04 May 2023

Received: 17 July 2022

Published in JOCCH Volume 17, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Soft Science Research Project of Shanghai Science and Technology Innovation Project
Art Science Planning of Shanghai

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
773
Total Downloads

Downloads (Last 12 months)773
Downloads (Last 6 weeks)142

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mamee WChuenchaichon C(2024)The Design of Souvenir Products Presented Through Augmented Reality for the King Naresuan Exhibition and Convention CenterAsian Health, Science and Technology Reports10.69650/ahstr.2024.227332:2(28-45)Online publication date: 12-Jun-2024
https://doi.org/10.69650/ahstr.2024.2273

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

Media

Figures

Other

Tables

View full text|Download PDF

View Issue’s Table of Contents