Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

User Experience Research, Experience Design, and Evaluation Methods for Museum Mixed Reality Experience

Published: 29 September 2021 Publication History

Abstract

Wearable Mixed Reality (MR) technology is a tool that gives people a new enhanced experience that they have not encountered before. This study shows the process of designing new museum experiences while considering how this technology changes previous museum experiences, what those experiences are, and what people should feel through these experiences. This process was systematically conducted according to the UX design process of analysis, synthesis, and evaluation. In the analysis step, six types of museum artifact viewing experiences were defined: knowing, restoring, exploring, expanded scale, encountering, and sharing experience through research and user surveys related to the museum experience. In addition, through research analysis related to MR technology, presence, flow, and natural interaction were defined as three essential factors that users should feel in the MR experience. In the synthesis stage, optimized wearable MR experiences were designed and implemented by applying the necessary experience types and essential factors according to the characteristics of each artifact. In the evaluation stage, user experience evaluations such as user experience tests for essential factors in the MR experience, User Experience Questionnaire (UEQ) tests for interaction products, and the Visual Aesthetics of Websites Inventory (VisAWI) test for visual experiences from various perspectives were conducted on the developed results. Through these evaluations, users gave positive scores to the design results based on the experience types and essential factors defined in this study. When applying new media technologies such as wearable MR technology, improved technology implementation is important, but an understanding of the applied field must first be obtained, and user analysis must first be thoroughly conducted. This study will be a guide to the systematic development process to be followed when applying wearable MR technology to other fields.

References

[1]
M. K. Bekele, R. Pierdicca, E. Frontoni, E. S. Malinverni, and J. Gain. 2018. A survey of augmented, virtual, and mixed reality for cultural heritage. Journal on Computing and Cultural Heritage (JOCCH) 11, 2 (2018), 1–36.
[2]
C. Pollalis, W. Fahnbulleh, J. Tynes, and O. Shaer. 2017. HoloMuse: Enhancing engagement with archaeological artifacts through gesture-based interaction with holograms. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (565–570).
[3]
R. Hammady. 2019. Virtual Guidance using Mixed Reality in Historical Places and Museums (Doctoral dissertation, Staffordshire University).
[4]
G. Papagiannakis, E. Geronikolakis, M. Pateraki, V. M. López-Menchero, M. Tsioumas, S. Sylaiou, and N. Partarakis. 2018. Mixed reality, gamified presence, and storytelling for virtual museums. Encyclopedia of Computer Graphics and Games 1–13.
[5]
J. C. Jones. 1963. A method of systematic design. In Conference on Design Methods (53-73). Pergamon Press, Oxford/New York.
[6]
Z. D. Doering. 1999. Strangers, guests, or clients? Visitor experiences in museums. Curator: The Museum Journal 42, 2 (1999), 74–87.
[7]
A. J. Pekarik, Z. D. Doering, and D. A. Karns. 1999. Exploring satisfying experiences in museums. Curator: The Museum Journal 42, 2 (1999), 152–173.
[8]
Yi Ji Hyun, Kim Hae Sun, Hur Wirin. 2019. A study on mixed reality content user experience strategies for development of museum docent service using wearable mixed reality technology, proceedings of HCIK 2019. The HCI Society of Korea 351–356
[9]
Concrete Storm, Virtual Museum, New York's Armory Show. 2017. https://fortune.com/2017/03/02/microsoft-hololens-art-show/.
[10]
Holomuseum. 2017. Bottino et al., https://vimeo.com/221132999.
[11]
LBJ and The Six Day War. 2017. LBJ Presidential Library, Cortina Productions March 13-15, https://segd.org/experimenting-microsoft-mixed-reality-museums.
[12]
Labelle. 2017. Bullock Texas State History Museum, Cortina Productions, March 13-15, https://segd.org/experimenting-microsoft-mixed-reality-museums.
[13]
HoloMuse, C. Pollalis, W. Fahnbulleh, J. Tynes, and O. Shaer. 2017. HoloMuse: Enhancing engagement with archaeological artifacts through gesture-based interaction with holograms. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (565–570).
[14]
Mont-Saint-Michel. 2018. Musée des Plans-Reliefs
[15]
Pieter Bruegel the Elder's Children's Games. 2018. Kunsthistorisches Museum, Fluxguide, https://www.fluxguide.com/en/puls/behind-the-scenes/experience-art-in-augmented-reality/.
[16]
R. Hammady, M. Ma, C. Strathern, and M. Mohamad. 2020. Design and development of a spatial mixed reality touring guide to the Egyptian museum. Multimedia Tools and Applications 79, 5 (2020), 3465–3494.
[17]
R. Hammady. 2019. Virtual Guidance using Mixed Reality in Historical Places and Museums (Doctoral dissertation, Staffordshire University).
[18]
Praxiteles' Resting Satyr statue. 2018. Eskenazi Art Museum at Indiana University http://www.andyhunsucker.com/augmented-reality-museum-exhibit.
[19]
The Folding Screen of Fujin and Raijin, holographic Kennin-ji monk. 2018. Kyoto's Kennin-ji, the oldest Zen temple in Japan, https://news.microsoft.com/apac/features/mixed-reality-museum-kyoto-unique-insight-centuries-old-japanese-artwork/.
[20]
Defying Gravity, Air & Space Museum in New York City. 2018. Visitors to the museum could put on a HoloLens headset for an encounter with a life-size hologram of astronaut Dr. Mae Jemison (the first woman of color in space). https://www.youtube.com/watch?v=kkIVhkHsV6I&feature=emb_logo.
[21]
Leonardo da Vinci and Perpetual Motion: Visualising Impossible Machines. 2019∼2020. The Peltz Gallery, Birkbeck University of London, N. Lambert, M. Smith, and J. Rasool. (2020). Designing an augmented reality exhibition: Leonardo's Impossible Machines.
[22]
Microsoft HoloLens. 2015. https://www.youtube.com/watch?v=tUcNVFVg4Zw.
[23]
P. Milgram and F. Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems 77, 12 (1994), 1321–1329.
[24]
O. I. Heimo, T. Mäkilä, T. Korkalainen, L. Viinikkala, and T. Lehtonen. 2016. B2C business models for museum and cultural travel mixed reality solutions. In Proceedings of the 20th International Academic Mindtrek Conference (253–261).
[25]
G. Drossis, C. Birliraki, and C. Stephanidis. 2018. Interaction with immersive cultural heritage environments using virtual reality technologies. In International Conference on Human-Computer Interaction (177–183). Springer, Cham.
[26]
A. N. Jayawardena and I. Perera. 2016. A framework for mixed reality application development: a case study on Yapahuwa archaeological site. In 2016 Sixteenth International Conference on Advances in ICT for Emerging Regions (ICTer) (186–192). IEEE.
[27]
M. Billinghurst and H. Kato. 2002. Collaborative augmented reality. Communications of the ACM 45, 7 (2002), 64–70.
[28]
W. Barfield, D. Zeltzer, T. Sheridan, and M. Slater. 1995. Presence and performance within virtual environments. Virtual Environments and Advanced Interface Design 473–513.
[29]
U.--> Bernardet, SB i Badia, A. Duff, M. Inderbitzin, S. Le Groux, J. Manzolli, and PFMJ Verschure. 2010. The eXperience induction machine: a new paradigm for mixed-reality interaction design and psychological experimentation. In The Engineering of Mixed Reality Systems (357–379). Springer, London.
[30]
A. Dasgupta, N. Buckingham, D. Gračanin, M. Handosa, and R. Tasooji. 2018. A mixed reality based social interactions testbed: A game theory approach. In International Conference on Virtual, Augmented and Mixed reality (40–56). Springer, Cham.
[31]
G. Papagiannakis, G. Singh, and N. Magnenat-Thalmann. 2008. A survey of mobile and wireless technologies for augmented reality systems. Computer Animation and Virtual Worlds 19, 1 (2008), 3–22.
[32]
H. J. Lee. 2018. Case study - My first year on the Hololens design team. https://docs.microsoft.com/en-us/windows/mixed-reality/case-study-my-first-year-on-the-Hololens-design-team.
[33]
O. I. Heimo, T. Mäkilä, T. Korkalainen, L. Viinikkala, and T. Lehtonen. 2016. B2C business models for museum and cultural travel mixed reality solutions. In Proceedings of the 20th International Academic Mindtrek Conference (253–261).
[34]
R. T. Azuma. 1997. A survey of augmented reality. Presence: Teleoperators & Virtual Environments 6, 4 (1997), 355–385.
[35]
R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. MacIntyre. 2001. Recent advances in augmented reality. IEEE Computer Graphics and Applications 21, 6 (2001), 34–47.
[36]
P. Calvo and T. Gomila. (Eds.). 2008. Handbook of cognitive science: An embodied approach. Elsevier.
[37]
M. Csíkszentmihályi, S. Abuhamdeh, and J. Nakamura. 2005. Flow. In A. J. Elliot, C. S. Dweck (Eds.), Handbook of Competence and Motivation (pp. 598-608). New York: Guilford Publications.
[38]
T. Magyaródi, H. Nagy, P. Soltész, T. Mózes, and A. Oláh. 2013. Psychometric properties of a newly established flow state questionnaire. The Journal of Happiness & Well-Being 1, 2 (2013), 85–96.
[39]
P. Dourish. 2004. Where the action is: the foundations of embodied interaction. MIT press.
[40]
L. Tan and K. K. Chow. 2018. An embodied approach to designing meaningful experiences with ambient media. Multimodal Technologies and Interaction 2, 2 (2018), 13.
[41]
J. J. Gibson. 2014. The ecological approach to visual perception: classic edition. Psychology Press.
[42]
M. Wilson. 2002. Six views of embodied cognition. Psychonomic Bulletin & Review 9, 4 (2002), 625–636.
[43]
R. A. Brooks. 1991. Intelligence without representation. Artificial Intelligence 47, 1–3 (1991), 139–159.
[44]
R. A. Brooks. 2014. The role of learning in autonomous robots. In Proceedings of the Fourth Annual Workshop on Computational Learning Theory (5-10)
[45]
N. Lavroff. 1994. Virtual Reality Playhouse. NY: Waite Group Press
[46]
M. Schrepp, A. Hinderks, and J. Thomaschewski. 2014. Applying the user experience questionnaire (UEQ) in different evaluation scenarios. In International Conference of Design, User Experience, and Usability (383-392). Springer, Cham.
[47]
M. Moshagenand and M. T. Thielsch. 2010. Facets of visual aesthetics. International Journal of Human-Computer Studies 68, 10 (2010), 689–709.

Cited By

View all
  • (2024)ZoAM GameBot: a Journey to the Lost Computational World in the AmazoniaJournal on Computing and Cultural Heritage 10.1145/3657303Online publication date: 11-May-2024
  • (2024)CulturAI: Exploring Mixed Reality Art Exhibitions with Large Language Models for Personalized Immersive ExperiencesAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664874(102-105)Online publication date: 27-Jun-2024
  • (2024)EmojiChat: Toward Designing Emoji-Driven Social Interaction in VR MuseumsInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2387902(1-17)Online publication date: 16-Aug-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage
Journal on Computing and Cultural Heritage   Volume 14, Issue 4
December 2021
328 pages
ISSN:1556-4673
EISSN:1556-4711
DOI:10.1145/3476246
Issue’s Table of Contents
Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 September 2021
Accepted: 01 April 2021
Revised: 01 February 2021
Received: 01 July 2020
Published in JOCCH Volume 14, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Museum content
  2. design strategies for mixed reality
  3. mixed reality
  4. mixed reality design
  5. mixed reality evaluation method
  6. museum experience
  7. museum mixed reality experience
  8. user experience design
  9. user experience research

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • Ministry of Culture, Sports and Tourism (MCST)
  • Korea Creative Content Agency (KOCCA) in the Culture Technology (CT) Research & Development Program 2021

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)602
  • Downloads (Last 6 weeks)38
Reflects downloads up to 01 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)ZoAM GameBot: a Journey to the Lost Computational World in the AmazoniaJournal on Computing and Cultural Heritage 10.1145/3657303Online publication date: 11-May-2024
  • (2024)CulturAI: Exploring Mixed Reality Art Exhibitions with Large Language Models for Personalized Immersive ExperiencesAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664874(102-105)Online publication date: 27-Jun-2024
  • (2024)EmojiChat: Toward Designing Emoji-Driven Social Interaction in VR MuseumsInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2387902(1-17)Online publication date: 16-Aug-2024
  • (2024)User experience model and design strategies for virtual reality-based cultural heritage exhibitionVirtual Reality10.1007/s10055-024-00942-z28:2Online publication date: 8-Mar-2024
  • (2023)Digital Interaction with Physical Museum ArtifactsTechnologies10.3390/technologies1103006511:3(65)Online publication date: 25-Apr-2023
  • (2023)System for the Synchronisation of Position, Motion and Audio Between MR and VRProceedings of the 13th International Conference on the Internet of Things10.1145/3627050.3631567(276-280)Online publication date: 7-Nov-2023
  • (2023)Digital Restoration of Cultural Heritage With Data-Driven Computing: A SurveyIEEE Access10.1109/ACCESS.2023.328063911(53939-53977)Online publication date: 2023
  • (2023)QoE enhancement of the industrial metaverse based on Mixed Reality application optimizationDisplays10.1016/j.displa.2023.10246379(102463)Online publication date: Sep-2023
  • (2022)Research hotspots and trends analysis of user experience: Knowledge maps visualization and theoretical framework constructionFrontiers in Psychology10.3389/fpsyg.2022.99066313Online publication date: 28-Sep-2022

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media