Cited By
View all- Tian FLi KHuang XZhang XWang NSong YZhu QLi Y(2024)An empirical study of virtual museum based on dual-mode mixed visualization: the Sanxingdui bronzesHeritage Science10.1186/s40494-024-01241-112:1Online publication date: 7-May-2024
Social Augmented Reality: Communicating via Cultural Heritage
Article No.: 29, Pages 1 - 26
Abstract
Social communication around art and cultural heritage objects occurs mostly on location in the museums and between in-group acquaintances. Such discussions are often brief as competing array of displays and time constraints propel the social arrangement of groups of visitors forward to the next object. Discussions are more often than not fleeting and superficial, and rarely expand beyond the boundary of the group. We postulate that the interactivity afforded by augmented reality that allows the inspection of cultural heritage objects projected onto the real environment of users can be a better experience in terms of depth of viewing. We developed a mobile augmented reality application that allows multiuser interaction and propose that discussions that occur around cultural heritage objects can be replicated and that such discussions can be expanded beyond in-groups. We conducted hypotheses testing across 10 groups of 30 participants to investigate if aspects of social communication can be facilitated or impeded by the perceived realism or artificiality of objects and explore which features of Social AR are more important for communication. The research aims to understand how social communication would work for AR when co-viewing heritage objects. The results have implications for necessitating cross-border and cross-cultural exchanges in an increasingly virtually connected world.
References
[1]
Network of European Museum Organisations. 2020. NEMO report on the impact of covid-19 on museums in europe. Retrieved from https://www.ne-mo.org/fileadmin/Dateien/public/NEMO_documents/NEMO_COVID19_Report_12.05.2020.pdf.
[2]
D. Alison and Tom Gwaltney. 1991. How people use electonic interactives in information age - people, information & tecnology. In Hypermedia and Interactivitv in Museums: Proceedines of an International Conference, David Bearman (Ed.). Pittsburgh PA, Archives & Museums Informatics, San Francisco, 62–73.
[3]
Tim Berners–Lee, Robert Cailliau, Jean-François Groff, and Bernd Pollermann. 2010. World-wide web: the information universe. Internet Research 20, 4 (2010), 461–471.
[4]
Minda Borun, Margaret B. Chambers, Jennifer Dritsas, and Julie I. Johnson. 1997. Enhancing family learning through exhibits. Curator Museum J. 40, 4 (1997), 279–295.
[5]
John Brooke. 1995. SUS: A “Quick and dirty” usability scale. Usabil. Eval. Industr. (1995), 207–212. DOI:
[6]
Shengdan Cai, Eugene Ch’ng, and Yue Li. 2018. A comparison of the capacities of VR and 360-degree video for coordinating memory in the experience of cultural heritage. In Proceedings of the Digital Heritage International Congress (DigitalHERITAGE’18). IEEE, Los Alamitos, CA.
[7]
Niall Caldwell. 2002. (Rethinking) the measurement of service quality in museums and galleries. Int. J. Nonprofit Volunt. Sector Market. 7, 2 (2002), 161–171.
[8]
Marcello Carrozzino and Massimo Bergamasco. 2010. Beyond virtual museums: Experiencing immersive virtual reality in real museums. J. Cult. Herit. 11, 4 (2010), 452–458. DOI:
[9]
Omar Choudary, Vincent Charvillat, Romulus Grigoras, and Pierre Gurdjos. 2009. MARCH: Mobile augmented reality for cultural heritage. In Proceedings of the 17th ACM International Conference on Multimedia. 1023–1024.
[10]
Eugene Ch’ng. 2009. Experiential archaeology: Is virtual time travel possible? J. Cult. Herit. 20 (2009), 458–470.
[11]
Eugene Ch’ng. 2012. New ways of accessing information spaces using 3D multitouch tables. In Proceedings of the Art, Design and Virtual Worlds Conference (Cyberworlds’12). Darmstadt.
[12]
Eugene Ch’ng. 2013. The mirror between two worlds: 3D surface computing for objects and environments. In Digital Media and Technologies for Virtual Artistic Spaces. IGI Global, 166–185.
[13]
Eugene Ch’ng. 2015. Guest editor’s introduction, special issue on virtual heritage: Cultural agents, environments, and objects. PRESENCE: Teleoperat. Virt. Environ. 24, 3 (2015), iii–vii. http://www.scopus.com/inward/record.url?eid=2-s2.0-84951118884andpartnerID=MN8TOARS.
[14]
Eugene Ch’ng, Shengdan Cai, Fui-Theng Leow, and Tong Zhang. 2019. Adoption and use of emerging cultural technologies in China’s museums. J. Cult. Herit. 37 (2019). DOI:
[15]
Eugene Ch’ng, Yiyu Cai, and Harold Thwaites. 2018. Guest editor’s introduction, special issue on VR for culture and heritage: The experience of cultural heritage with virtual reality. Presence: Teleoperat. Virt. Environ. 26, 3 (2018).
[16]
Eugene Ch’ng, Yue Li, Shengdan Cai, and Fui-Theng Leow. 2019. The effects of VR Environments on the acceptance, experience and expectations of cultural heritage learning. J. Comput. Cult. Herit. (2019).
[17]
Kevin Crowley and Maureen Callanan. 1998. Describing and supporting collaborative scientific thinking in parent-child interactions. J. Mus. Educ. 23, 1 (1998), 12–17.
[18]
Giacomo Del Chiappa, Maria Gabriela Ladu, Marta Meleddu, and Manuela Pulina. 2013. Investigating the degree of visitors’ satisfaction at a museum. Anatolia 24, 1 (2013), 52–62.
[19]
Arindam Dey, Mark Billinghurst, Robert W. Lindeman, and J. Edward Swan. 2018. A systematic review of 10 years of augmented reality usability studies: 2005 to 2014. Front. Robot. AI 5 (2018), 37.
[20]
Arindam Dey, Thammathip Piumsomboon, Youngho Lee, and Mark Billinghurst. 2017. Effects of sharing physiological states of players in a collaborative virtual reality gameplay. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 4045–4056.
[21]
Caroline Dunmore. 2016. Museums and the Web. Routledge, 115–136.
[22]
Kirsten M. Ellenbogen. 2002. Museums in family life: An ethnographic case study. Learn. Convers. Mus. (2002), 81–101.
[23]
Barrett Ens, Joel Lanir, Anthony Tang, Scott Bateman, Gun Lee, Thammathip Piumsomboon, and Mark Billinghurst. 2019. Revisiting collaboration through mixed reality: The evolution of groupware. Int. J. Hum.-Comput. Stud. 131 (2019), 81–98.
[24]
James A. Evans and Pat Sterry. 1999. Portable computers and interactive multimedia: A new paradigm for interpreting museum collections. Arch. Mus. Inf. 13, 2 (1999), 113–126.
[25]
J. H. Falk. 2016. Identity and the Museum Visitor Experience. Routledge.
[26]
J. H. Falk. 1993. Factors Influencing Leisure Decisions: The Use of Museums by African Americans. American Association of Museums, Washington, DC.
[27]
John H. Falk and Lynn D. Dierking. 2018. Learning from Museums. Rowman & Littlefield.
[28]
I. Greif. 1988. Computer-Supported Cooperative Work: A Book of Readings. Morgan Kaufmann, San Mateo, CA.
[29]
Jonathan Grudin. 1994. Computer-supported cooperative work: History and focus. Computer 27, 5 (1994), 19–26.
[30]
De Gruyter, Thomas Luhmann, Stuart Robson, Stephen Kyle, and Jan Boehm. 2014. Close-Range Photogrammetry and 3D Imaging.
[31]
Anne-Cecilie Haugstvedt and John Krogstie. 2012. Mobile augmented reality for cultural heritage: A technology acceptance study. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR’12). IEEE, 247–255. DOI:
[32]
Eva Hornecker. 2008. “I don’t understand it either, but it is cool—Visitor interactions with a multi-touch table in a museum. In Proceedings of the 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems. IEEE, 113–120.
[33]
Jonna Häkkilä, Petri Hannula, Elina Luiro, Emilia Launne, Sanni Mustonen, Toni Westerlund, and Ashley Colley. 2019. Visiting a virtual graveyard: Designing virtual reality cultural heritage experiences. In Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia. 1–4.
[34]
David Richard Johnson and James C. Creech. 1983. Ordinal measures in multiple indicator models: A simulation study of categorization error. Am. Sociol. Rev. (1983), 398–407.
[35]
Akrivi Katifori, Sara Perry, Maria Vayanou, Angeliki Antoniou, Ioannis-Panagiotis Ioannidis, Sierra McKinney, Angeliki Chrysanthi, and Yannis Ioannidis. 2020. “Let them talk!” exploring guided group interaction in digital storytelling experiences. J. Comput. Cult. Herit. 13, 3 (2020), 1–30.
[36]
Seungwon Kim, Gun Lee, Weidong Huang, Hayun Kim, Woontack Woo, and Mark Billinghurst. 2019. Evaluating the combination of visual communication cues for HMD-based mixed reality remote collaboration. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.
[37]
Neil Kotler and Philip Kotler. 2000. Can museums be all things to all people?: Missions, goals, and marketing’s role. Mus. Manage. Curator. 18, 3 (2000), 271–287.
[38]
Robert E. Kraut. 2003. Applying social psychological theory to the problems of group work. In HCI Models, Theories and Frameworks: Toward a Multidisciplinary Science (2003), 325–356.
[39]
Gun A. Lee, Theophilus Teo, Seungwon Kim, and Mark Billinghurst. 2018. A user study on mr remote collaboration using live 360 video. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR’18). IEEE, 153–164.
[40]
Yue Li, Eugene Ch’ng, Sue Cobb, and Simon See. 2021. Presence and communication in hybrid virtual and augmented reality environments. Presence: Virt. Augment. Real. (2021), 1–40.
[41]
Seth Lloyd. 2006. Programming the Universe: A Quantum Computer Scientist Takes on the Cosmos. Vintage.
[42]
Joyce Ma, Lisa Sindorf, Isaac Liao, and Jennifer Frazier. 2015. Using a tangible versus a multi-touch graphical user interface to support data exploration at a museum exhibit. In Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction. 33–40.
[43]
George F. MacDonald and Stephen Alsford. 2013. The Museum as Information Utility. Routledge, 87–94.
[44]
Paul F. Marty. 2007. Museum websites and museum visitors: Before and after the museum visit. Mus. Manage. Curator. 22, 4 (2007), 337–360.
[45]
David Martín-Ruiz, Mario Castellanos-Verdugo, and Ma de los Ángeles Oviedo-García. 2010. A visitors’ evaluation index for a visit to an archaeological site. Tour. Manage. 31, 5 (2010), 590–596.
[46]
Paulette M. McManus. 1987. It’s the company you keep...: The social determination of learning-related behaviour in a science museum. Mus. Manage. Curator. 6, 3 (1987), 263–270.
[47]
Paulette M. McManus. 1993. Memories as indicators of the impact of museum visits. Mus. Manage. Curator. 12, 4 (1993), 367–380.
[48]
Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77, 12 (1994), 1321–1329.
[49]
Charles William Morris. 1938. Foundations of the theory of signs. In International Encyclopedia of Unified Science. Chicago University Press, 1–59.
[50]
Michela Mortara, Chiara Eva Catalano, Francesco Bellotti, Giusy Fiucci, Minica Houry-Panchetti, and Panagiotis Petridis. 2014. Learning cultural heritage by serious games. J. Cult. Herit. 15, 3 (2014), 318–325.
[51]
Nicholas Negroponte. 1996. Being Digital. Vintage.
[52]
Eslam Nofal, M. Reffat, Andrew Vande Moere, Dennis Beck, Colin Allison, Leonel Morgado, Johanna Pirker, Foaad Khosmood, Jonathon Richter, and Christian Gütl. 2017. Phygital heritage: An approach for heritage communication. In Immersive Learning Research Network Conference. Verlag der Technischen Universität Graz; Graz, Austria.
[53]
Geoff Norman. 2010. Likert scales, levels of measurement and the “laws” of statistics. Adv. Health Sci. Educ. 15, 5 (2010), 625–632.
[54]
Jan Packer and Roy Ballantyne. 2005. Solitary vs. shared: Exploring the social dimension of museum learning. Curator: Mus. J. 48, 2 (2005), 177–192.
[55]
Ari Palitz and Gabo Arora. 2017. The Last gGoodbye. Retrieved from https://www.moving-picture.com/what-we-do/ar-vr/usc-shoah-the-last-goodbye.
[56]
Gitte Pedersen and Konstantinos Koumaditis. 2020. Virtual reality (VR) in the computer supported cooperative work (CSCW) domain: A mapping and a pre-study on functionality and immersion. In Proceedings of the International Conference on Human-Computer Interaction. Springer, 136–153.
[57]
Thammathip Piumsomboon, Gun A. Lee, Andrew Irlitti, Barrett Ens, Bruce H. Thomas, and Mark Billinghurst. 2019. On the shoulder of the giant: A multi-scale mixed reality collaboration with 360 video sharing and tangible interaction. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–17.
[58]
Marshall Scott Poole, Dennis S. Gouran, and Lawrence R. Frey. 1999. The Handbook of Group Communication Theory and Research. Sage.
[59]
Richard Prentice, Sinéad Guerin, and Stuart McGugan. 1998. Visitor learning at a heritage attraction: A case study of discovery as a media product. Tour. Manage. 19, 1 (1998), 5–23.
[60]
Scot Thrane Refsland, Takeo Ojika, Alonzo C. Addison, and Robert Stone. 2000. Guest editors’ introduction: Virtual heritage-breathing new life into our ancient past. IEEE MultiMedia 2 (2000), 20–21.
[61]
Holger Regenbrecht and Thomas Schubert. 2002. Real and illusory interactions enhance presence in virtual environments. Presence: Teleoperat. Virt. Environ. 11, 4 (August 2002), 425–434. DOI:
[62]
Holger Regenbrecht and Thomas Schubert. 2021. Measuring presence in augmented reality environments: Design and a first test of a questionnaire. arXiv:2103.02831. Retrieved from https://arxiv.org/abs/2103.02831.
[63]
Jacob Rigby and Shamus P. Smith. 2013. Augmented reality challenges for cultural heritage. Newcastle: Applied Informatics Research Group. University of Newcastle.
[64]
Maurizio Rossi, Daniele Marini, and Alessandro Rizzi. 2004. Methods and application for photorealistic rendering and lighting of ancient buildings. J. Cult. Herit. 5, 3 (2004), 291–300.
[65]
Jennifer Rowley. 1999. Measuring total customer experience in museums. Int. J. Contemp. Hosp. Manage. (1999).
[66]
Leona Schauble, DeAnna Banks Beane, Grace Davila Coates, Laura M. W. Martin, and Peter V. Sterling. 2013. Outside the Classroom Walls: Learning in Informal Environments. Routledge, 17–36.
[67]
John Stevenson. 1991. The long–term impact of interactive exhibits. Int. J. Sci. Educ. 13, 5 (1991), 521–531.
[68]
Sylaiou Styliani, Liarokapis Fotis, Kotsakis Kostas, and Patias Petros. 2009. Virtual museums, a survey and some issues for consideration. J. Cult. Herit. 10, 4 (2009), 520–528.
[69]
Gail M. Sullivan and Anthony R. Artino Jr. 2013. Analyzing and interpreting data from likert-type scales. J. Grad. Med. Educ. 5, 4 (2013), 541–542.
[70]
Stella Sylaiou, Katerina Mania, Athanasis Karoulis, and Martin White. 2010. Exploring the relationship between presence and enjoyment in a virtual museum. Int. J. Hum.-Comput. Stud. 68, 5 (May 2010), 243–253. DOI:
[71]
Arthur Tang, Frank Biocca, and Lynette Lim. 2004. Comparing differences in presence during social interaction in augmented reality versus virtual reality environments: An exploratory study. In Proceedings of the 17th Annual International Workshop “Presence 2004,” Valencia, 1 January.
[72]
Garry Thomson. 2018. The Museum Environment. Routledge.
[73]
Maree Thyne. 2001. The importance of values research for nonprofit organisations: The motivation–based values of museum visitors. Int. J. Nonprofit Volunt. Sector Market. 6, 2 (2001), 116–130.
[74]
M. Claudia tom Dieck and Timothy Hyungsoo Jung. 2017. Value of augmented reality at cultural heritage sites: A stakeholder approach. J. Destin. Market. Manage. 6, 2 (2017), 110–117.
[75]
Maria Vayanou, Akrivi Katifori, Angeliki Antoniou, and Angeliki Chrysanthi. 2016. Collocated interaction in cultural storytelling experiences: How to coordinate visitor actions. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work and Social Computing, Vol. 27. San Francisco.
[76]
Maria Vayanou, Akrivi Katifori, Angeliki Chrysanthi, and Angeliki Antoniou. 2020. Cultural heritage and social experiences in the times of COVID 19. In Proceedings of AVI2CH 2020: Workshop on Advanced Visual Interfaces and Interactions in Cultural Heritage (AVI2CH). ACM, New York, NY, 4 pages.
[77]
Vlatko Vedral. 2018. Decoding Reality: The Universe as Quantum Information. Oxford University Press.
[78]
Vassilios Vlahakis, John Karigiannis, Manolis Tsotros, Michael Gounaris, Luis Almeida, Didier Stricker, Tim Gleue, Ioannis T. Christou, Renzo Carlucci, and Nikos Ioannidis. 2001. Archeoguide: First results of an augmented reality, mobile computing system in cultural heritage sites. Virt. Real. Archeol. Cult. Herit. 9, 10.1145 (2001), 584993–585015.
[79]
Lev Semenovich Vygotsky and Michael Cole. 1978. Mind in Society: Development of Higher Psychological Processes. Harvard University Press.
[80]
Paul Watzlawick, Janet Beavin Bavelas, and Don D. Jackson. 2011. Pragmatics of Human Communication: A Study of Interactional Patterns, Pathologies and Paradoxes. W. W. Norton & Company.
[81]
James V. Wertsch. 1985. Vygotsky and the Social Formation of Mind. Harvard University Press.
[82]
Panagiotis Zaharias, Despina Michael, and Yiorgos Chrysanthou. 2013. Learning through multi-touch interfaces in museum exhibits: An empirical investigation. J. Educ. Technol. Soc. 16, 3 (2013), 374–384.
[83]
Bruno D. Zumbo and Donald W. Zimmerman. 1993. Is the selection of statistical methods governed by level of measurement? Can. Psychol. 34, 4 (1993), 390.
Index Terms
- Social Augmented Reality: Communicating via Cultural Heritage
Recommendations
A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage
A multimedia approach to the diffusion, communication, and exploitation of Cultural Heritage (CH) is a well-established trend worldwide. Several studies demonstrate that the use of new and combined media enhances how culture is experienced. The benefit ...
Virtual and augmented reality for cultural computing and heritage: a case study of virtual exploration of underwater archaeological sites (preprint)
The paper presents different issues dealing with both the preservation of cultural heritage using virtual reality (VR) and augmented reality (AR) technologies in a cultural context. While the VR/AR technologies are mentioned, the attention is paid to ...
Augmented Reality Applications to Support the Promotion of Cultural Heritage: The Case of the Basilica of Saint Catherine of Alexandria in Galatina
The intent of this study is to promote and raise awareness of the Basilica of Saint Catherina of Alexandria in Galatina, a church endowed with such beauty as to be defined as astounding.
In this article two technologies were used: Spatial Augmented ...
Comments
Information & Contributors
Information
Published In
June 2023
312 pages
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 20 April 2023
Online AM: 25 January 2023
Accepted: 06 January 2023
Revised: 05 January 2023
Received: 05 August 2022
Published in JOCCH Volume 16, Issue 2
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- Shaping the Connected Museum II AHRC (Arts and Humanities Research Council)
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 1,199Total Downloads
- Downloads (Last 12 months)696
- Downloads (Last 6 weeks)77
Reflects downloads up to 16 Oct 2024
Other Metrics
Citations
Cited By
View all- Tian FLi KHuang XZhang XWang NSong YZhu QLi Y(2024)An empirical study of virtual museum based on dual-mode mixed visualization: the Sanxingdui bronzesHeritage Science10.1186/s40494-024-01241-112:1Online publication date: 7-May-2024
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format