Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

The Balance of Attention: The Challenges of Creating Locative Cultural Storytelling Experiences

Published: 03 December 2020 Publication History

Abstract

There is a long history of research exploring how augmented and mixed reality systems can be used to support visitors to cultural heritage locations, but the technological or application specific focus of much of this research means that our understanding of how these experiences work is more of a collection of insights, rather than a coherent theory about how the elements of the experience come together. There is a danger that without developing this knowledge further, our systems will be technologically complex, but experientially simplistic. In this article, we explore how one form of mixed reality experience, digital locative storytelling, can impact the experience of place, and in turn how place impacts the experience of story. We have analyzed 33 interviews, and 25 participant observations from 12 story deployments at 2 different sites. Our findings confirm that locative storytelling experiences not only impart information to readers, but also help them to rediscover familiar places and see hidden relationships—especially through time. But our findings also show how the success of the experience is reliant on the balance of attention between the virtual and real (the story and the place), and that issues with navigation, social interactions, and technology are problematic because they can disrupt this balance. Digital locative experiences therefore need to be designed carefully in order to create a balance of attention (e.g., by aligning the elements of the story with the topology and character of place). We call this a state of Loco-Narrative Harmony, in which place and story are working together and reader attention is balanced, creating an effect that is greater than the sum of its parts.

References

[1]
Roberto Andreoli, Angela Corolla, Armando Faggiano, Delfina Malandrino, Donato Pirozzi, Mirta Ranaldi, Gianluca Santangelo, and Vittorio Scarano. 2016. Immersivity and Playability Evaluation of a Game Experience in Cultural Heritage. Springer International Publishing, Cham, 814--824.
[2]
Kevin Baker and Steven Verstockt. 2017. Cultural heritage routing: A recreational navigation-based approach in exploring cultural heritage. Journal on Computing and Cultural Heritage 10, 4 (July 2017), Article 24, 20 pages.
[3]
John F. Barber. 2016. Digital storytelling: New opportunities for humanities scholarship and pedagogy. Cogent Arts 8 Humanities 3, 1 (2016), 1181037.
[4]
Ilaria Bartolini, Vincenzo Moscato, Ruggero G. Pensa, Antonio Penta, Antonio Picariello, Carlo Sansone, and Maria Luisa Sapino. 2016. Recommending multimedia visiting paths in cultural heritage applications. Multimedia Tools and Applications (2016).
[5]
Steve Benford, Gabriella Giannachi, Boriana Koleva, and Tom Rodden. 2009. From interaction to trajectories: Designing coherent journeys through user experiences. In ACM CHI2009, Vols 1--4. ACM Press, New York, 709--718.
[6]
David Benyon, Oli Mival, and Serkan Ayan. 2012. Designing blended spaces. In Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers (BCS-HCI’12). 398--403.
[7]
Letizia Bollini and Daniele Begotti. 2017. The time machine. Cultural heritage and the geo-referenced storytelling of urban historical metamorphose. In International Conference on Computational Science and Its Applications. Springer, 239--251.
[8]
Anne E. Bowser, Derek L. Hansen, Jocelyn Raphael, Matthew Reid, Ryan J. Gamett, Yurong R. He, Dana Rotman, and Jenny J. Preece. 2013. Prototyping in PLACE: A scalable approach to developing location-based apps and games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, New York, NY, 1519--1528.
[9]
Jonathan Broadbent and Patrizia Marti. 1997. Location aware mobile interactive guides: Usability issues. In ICHIM, Vol. 97. 88--98.
[10]
Fabio Bruno, Antonio Lagudi, Loris Barbieri, Maurizio Muzzupappa, Gerardo Ritacco, Alessandro Cozza, Marco Cozza, Raffaele Peluso, Marco Lupia, and Gianni Cario. 2016. Virtual and augmented reality tools to improve the exploitation of underwater archaeological sites by diver and non-diver tourists. In Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection. Springer International Publishing, Cham, 269--280.
[11]
Ben S. Bunting, Jacob Hughes, and Tim Hetland. 2012. The player as author: Exploring the effects of mobile gaming and the location-aware interface on storytelling. Future Internet 4, 1 (2012), 142--160.
[12]
M. Coverley. 2006. Psychogeography. Pocket Essentials.
[13]
Daniela D’Auria, Dario Di Mauro, Davide Calandra, and Francesco Cutugno. 2015. A 3D audio augmented reality system for a cultural heritage management and fruition. Journal of Digital Information Management 13, 4 (Aug. 2015), 203--209.
[14]
N. Davies, K. Cheverst, K. Mitchell, and A. Efrat. 2001. Using and determining location in a context-sensitive tour guide. Computer 34, 8 (Aug. 2001), 35--41.
[15]
Paloma Díaz, Ignacio Aedo, and Merel van der Vaart. 2015. Engineering the creative co-design of augmented digital experiences with cultural heritage. In End-User Development. Springer International Publishing, Cham, 42--57.
[16]
Mara Dionisio, Valentina Nisi, and Jos P. Van Leeuwen. 2010. The iLand of Madeira location aware multimedia stories. In ICIDS 2010. Springer, 147--152.
[17]
Jonathan Dovey. 2016. Ambient literature: Writing probability. Ubiquitous Computing, Complexity and Culture (2016), 141--154.
[18]
Mihai Duguleana, Raffaello Brodi, Florin Girbacia, Cristian Postelnicu, Octavian Machidon, and Marcello Carrozzino. 2016. Time-travelling with mobile augmented reality: A case study on the Piazza dei Miracoli. In Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection. Springer International Publishing, Cham, 902--912.
[19]
John H. Falk and Lynn D. Dierking. 2008. Enhancing visitor interaction and learning with mobile technologies. In Digital Technologies and the Museum Experience: Handheld Guides and Other Media, K. Tallon, L. Walker (Ed.). AltaMira Press, Plymouth, UK, 19--34.
[20]
J. Floch and S. Jiang. 2015. One place, many stories digital storytelling for cultural heritage discovery in the landscape. In 2015 Digital Heritage, Vol. 2. 503--510.
[21]
Lesley Fosh, Steve Benford, Stuart Reeves, Boriana Koleva, and Patrick Brundell. 2013. See me, feel me, touch me, hear me: Trajectories and interpretation in a sculpture garden. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). Association for Computing Machinery, New York, NY, 149--158.
[22]
Areti Galani and Jenny Kidd. 2019. Evaluating digital cultural heritage in the wild: The case for reflexivity. Journal on Computing and Cultural Heritage 12, 1 (Feb. 2019), Article 5, 15 pages.
[23]
Chiara Garau. 2014. From territory to smartphone: Smart fruition of cultural heritage for dynamic tourism development. Planning Practice 8 Research 29, 3 (2014), 238--255.
[24]
Chiara Garau and Emiliano Ilardi. 2014. The “non-place” meet the “places:” Virtual tours on smartphones for the enhancement of cultural heritage. Journal of Urban Technology 21, 1 (2014), 79--91.
[25]
Charlie Hargood, Verity Hunt, Mark J. Weal, and David E. Millard. 2016. Patterns of sculptural hypertext in location based narratives. In ACM Hypertext 2016. ACM, 61--70.
[26]
Charlie Hargood, Mark Weal, and David Millard. 2018. The storyplaces platform: Building a web-based locative hypertext system. In HT’18 Proceedings of the 29th ACM Conference on Hypertext and Social Media. ACM, 128--135. https://eprints.soton.ac.uk/421122/.
[27]
Clint Hocking. 2009. Ludonarrative Dissonance in Bioshock. The problem of what the game is about, Well Played 1.0: Video Games, Value and Meaning. ETC Press, Carnegie Mellon, Pittsburgh, PA (originally self-published in 2007).
[28]
Eva Hornecker. 2016. The to-and-fro of sense making: Supporting users’ active indexing in museums. ACM Transactions on Computer-Human Interaction 23, 2, Article 10 (May 2016), 10:1--10:48.
[29]
Aki Härmä, Julia Jakka, Miikka Tikander, Matti Karjalainen, Tapio Lokki, Jarmo Hiipakka, and Gaëtan Lorho. 2004. Augmented reality audio for mobile and wearable appliances. Journal of the Audio Engneering Society 52, 6 (2004), 618--639.
[30]
S. F. Fantonio and J. P. Bowe. 2004. Personalization and the web from a museum perspective. In International Conference on Museums and the Web, Arlington VA. http://www.archimuse.com/mw2004/papers/bowen/bowen.html.
[31]
Evangelos Karapanos, Mary Barreto, Valentina Nisi, and Evangelos Niforatos. 2013. Does locality make a difference? Assessing the effectiveness of location-aware narratives. Interacting with Computers 24, 4 (May 2013), 273--279. arXiv:https://academic.oup.com/iwc/article-pdf/24/4/273/2008797/iwc24-0273.pdf.
[32]
Tsvi Kuflik, Oliviero Stock, Massimo Zancanaro, Ariel Gorfinkel, Sadek Jbara, Shahar Kats, Julia Sheidin, and Nadav Kashtan. 2011. A visitor’s guide in an active museum: Presentations, communications, and reflection. Journal on Computing and Cultural Heritage 3, 3, Article 11 (Feb. 2011), 11:1--11:25.
[33]
Fotis Liarokapis, Panagiotis Petridis, Daniel Andrews, and Sara de Freitas. 2017. Multimodal Serious Games Technologies for Cultural Heritage. Springer International Publishing, Cham, 371--392.
[34]
Sue Long, Rob Kooper, Gregory D. Abowd, and Christopher G. Atkeson. 1996. Rapid prototyping of mobile context-aware applications: The cyberguide case study. In Proceedings of MobiCom’96. ACM, New York, NY, 97--107.
[35]
Anders Sundnes Løvlie. 2009. Poetic augmented reality: Place-bound literature in locative media. In Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era (MindTrek’09). ACM, New York, NY, 19--28.
[36]
Jacob B. Madsen and Claus B. Madsen. 2015. Handheld visual representation of a castle chapel ruin. Journal on Computing and Cultural Heritage 9, 1 (Nov. 2015), Article 6, 18 pages.
[37]
Rainer Malaka, Kerstin Schneider, and Ursula Kretschmer. 2004. Stage-based augmented edutainment. In International Symposium on Smart Graphics. Springer, 54--65.
[38]
David E. Millard, Charlie Hargood, Michael O. Jewell, and Mark J. Weal. 2013. Canyons, deltas and plains: Towards a unified sculptural model of location-based hypertext. In Proceedings of the ACM Hypertext 2013. ACM, New York, NY, 109--118.
[39]
Michela Mortara, Chiara Eva Catalano, Francesco Bellotti, Giusy Fiucci, Minica Houry-Panchetti, and Panagiotis Petridis. 2014. Learning cultural heritage by serious games. Journal of Cultural Heritage 15, 3 (2014), 318--325.
[40]
Theano Moussouri and George Roussos. 2015. Conducting visitor studies using smartphone-based location sensing. Journal on Computng and Cultural Heritage 8, 3 (March 2015), Article 12, 16 pages.
[41]
Niels Nilsson, Rolf Nordahl, and Stefania Serafin. 2016. Immersion revisited: A review of existing definitions of immersion and their relation to different theories of presence. Human Technology 12 (Nov. 2016), 108--134.
[42]
Valentina Nisi, Enrico Costanza, and Mara Dionisio. 2016. Placing location-based narratives in context through a narrator and visual markers. Interacting with Computers 29, 3 (07 2016), 287--305. arXiv:https://academic.oup.com/iwc/article-pdf/29/3/287/11149005/iww020.pdf.
[43]
Valentina Nisi, Alison Wood, Glorianna Davenport, and Ian Oakley. 2004. Hopstory: An interactive, location-based narrative distributed in space and time. In Technologies for Interactive Digital Storytelling and Entertainment, Stefan Göbel, Ulrike Spierling, Anja Hoffmann, Ido Iurgel, Oliver Schneider, Johanna Dechau, and Axel Feix (Eds.). Springer, Berlin, 132--141.
[44]
Brian O’Keefe, David Benyon, Gaurav Chandwani, Madhav Menon, and Randy Duke, II. 2014. A blended space for heritage storytelling. In Proceedings of the BCS Human Computer Interaction Conference on HCI 2014. BCS, UK, 90--99.
[45]
Brett Oppegaard and D. Grigar. 2014. The interrelationships of mobile storytelling: Merging the physical and the digital at a national historic site. The Mobile Story: Narrative Practices with Locative Technologies, 17--33.
[46]
Heather Packer, Charlie Hargood, Yvonne Howard, Petros Papadopoulos, and David Millard. 2017. Developing a writer’s toolkit for interactive locative storytelling. In Proceedings of ICIDS’17. Springer. https://eprints.soton.ac.uk/414262/.
[47]
G. Papagiannakis, E. Geronikolakis, M. Pateraki, V. M. Lopez-Menchero, M. Tsioumas, S. Sylaiou, F. Liarokapis, A. Grammatikopoulou, K. Dimitropoulos, N. Grammalidis, N. Partarakis, G. Margetis, G. Drossis, M. Vassiliadi, A. Chalmers, C. Stephanidis, and N. Magnenat-Thalmann. 2018. Mixed reality, gamified presence, and storytelling for virtual museums. In Encyclopedia of Computer Graphics and Games, N. Lee (Ed.). Springer, Cham.
[48]
Natasa Paterson, Gavin Kearney, Katsiaryna Naliuka, Tara Carrigy, Mads Haahr, and Fionnuala Conway. 2012. Viking ghost hunt: Creating engaging sound design for location--aware applications. International Journal of Arts and Technology 6, 1 (2012), 61--82.
[49]
Fabio Pittarello. 2011. Designing a context-aware architecture for emotionally engaging mobile storytelling. INTERACT 2011, 144--151.
[50]
Alessandro Pozzebon, Francesca Biliotti, and Silvia Calamai. 2016. Places Speaking with Their Own Voices. A Case Study from the Gra.fo Archives. Springer International Publishing, Cham, 232--239.
[51]
Travis Pynenburg. 2012. Games Worth a Thousand Words: Critical Approaches and Ludonarrative Harmony in Interactive Narratives. Master’s thesis. University of New Hampshire. Honors Theses and Capstones. 70. https://scholars.unh.edu/honors/70.
[52]
Josephine Reid, Richard Hull, Kirsten Cater, and Constance Fleuriot. 2005. Magic moments in situated mediascapes. In Proceedings of ACM Conference on Advances in Computer Entertainment Technology (ACE’05). ACM, New York, NY, 290--293.
[53]
S. Rennick-egglestone, P. Brundell, B. Koleva, S. Benford, M. Roussou, and C. Chaffardon. 2016. Families and mobile devices in museums: Designing for integrated experiences. Journal on Computng and Cultural Heritage 9, 2 (May 2016), Article 11, 13 pages.
[54]
Markku Reunanen, Lily Díaz, and Tommi Horttana. 2015. A holistic user-centered approach to immersive digital cultural heritage installations: Case vrouw maria. Journal on Computing and Cultural Heritage 7, 4 (Feb. 2015), Article 24, 16 pages.
[55]
J. Ritchie. 2014. The affordances and constraints of mobile locative narratives. In The Mobile Story: Narrative Practices with Locative Technologies, Jason Farman (Ed.). Routledge Press, New York, NY, 65--79.
[56]
Irene Rubino, Claudia Barberis, Jetmir Xhembulla, and Giovanni Malnati. 2015. Integrating a location-based mobile game in the museum visit: Evaluating visitors’ behaviour and learning. Journal on Computing and Cultural Heritage 8, 3, Article 15 (May 2015), 15:1--15:18.
[57]
Cody Sandifer. 2003. Technological novelty and open-endedness: Two characteristics of interactive exhibits that contribute to the holding of visitor attention in a science museum. Journal of Research in Science Teaching 40, 2 (2003), 121--137.
[58]
Holger Schnädelbach, Boriana Koleva, Martin Flintham, Mike Fraser, Shahram Izadi, Paul Chandler, Malcolm Foster, Steve Benford, Chris Greenhalgh, and Tom Rodden. 2002. The augurscope: A mixed reality interface for outdoors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’02). ACM, New York, NY, 9--16.
[59]
Callum Spawforth, Nicholas Gibbins, and David Millard. 2018. StoryMINE: A system for multiplayer interactive narrative experiences. In Proceedings of ICIDS 2018, Vol. 11318. Springer, 534--543. https://eprints.soton.ac.uk/424131/.
[60]
Ulrike Spierling, Peter Winzer, and Erik Massarczyk. 2017. Experiencing the presence of historical stories with location-based augmented reality. In Interactive Storytelling. Springer International Publishing, Cham, 49--62.
[61]
Stella Sylaiou and Panagiotis Dafiotis. 2020. Storytelling in Virtual Museums: Engaging A Multitude of Voices. Springer International Publishing, Cham, 369--388.
[62]
Mark J. Weal, Don Cruickshank, Danius T. Michaelides, David E. Millard, David C. De Roure, Katherine Howland, and Geraldine Fitzpatrick. 2007. A card based metaphor for organising pervasive educational experiences. In PerCom Workshops’07. IEEE, 165--170.
[63]
A. Wong. 2015. The whole story, and then some: Digital storytelling in evolving museum practice. In MW2015: Museums and the Web 2015. https://mw2015.museumsandtheweb.com/paper/the-whole-story-and-then-some-digital-storytelling-in-evolving-museum-practice/.
[64]
V. W. Zue and J. R. Glass. 2000. Conversational interfaces: Advances and challenges. Proceedings of the IEEE 88, 8 (Aug. 2000), 1166--1180.

Cited By

View all
  • (2024)The Ethics of Mixed Reality GamesGames: Research and Practice10.1145/36758062:3(1-26)Online publication date: 30-Aug-2024
  • (2024)Comfortable Mobility vs. Attractive Scenery: The Key to Augmenting Narrative Worlds in Outdoor Locative Augmented Reality StorytellingProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642431(1-19)Online publication date: 11-May-2024
  • (2023)The Genarrator Authoring Experience: A UX Evaluation ApproachACM SIGWEB Newsletter10.1145/3631358.36313602023:Autumn(1-8)Online publication date: 11-Dec-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage
Journal on Computing and Cultural Heritage   Volume 13, Issue 4
Special Issue on Culture Games and Regular Papers
December 2020
208 pages
ISSN:1556-4673
EISSN:1556-4711
DOI:10.1145/3441387
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 December 2020
Accepted: 01 May 2020
Revised: 01 March 2020
Received: 01 October 2019
Published in JOCCH Volume 13, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Locative literature
  2. augmented reality
  3. digital visitor experiences
  4. mixed reality

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • The Leverhulme Trust

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)100
  • Downloads (Last 6 weeks)8
Reflects downloads up to 01 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)The Ethics of Mixed Reality GamesGames: Research and Practice10.1145/36758062:3(1-26)Online publication date: 30-Aug-2024
  • (2024)Comfortable Mobility vs. Attractive Scenery: The Key to Augmenting Narrative Worlds in Outdoor Locative Augmented Reality StorytellingProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642431(1-19)Online publication date: 11-May-2024
  • (2023)The Genarrator Authoring Experience: A UX Evaluation ApproachACM SIGWEB Newsletter10.1145/3631358.36313602023:Autumn(1-8)Online publication date: 11-Dec-2023
  • (2023)Seven HypertextsProceedings of the 34th ACM Conference on Hypertext and Social Media10.1145/3603163.3609048(1-15)Online publication date: 4-Sep-2023
  • (2023)Cultural Content of Independent Creative Spaces During the COVID-19 PandemicThe Professional Geographer10.1080/00330124.2022.214659475:4(562-576)Online publication date: 13-Jan-2023
  • (2023)The Authoring Tool Evaluation ProblemThe Authoring Problem10.1007/978-3-031-05214-9_19(303-320)Online publication date: 2-Jan-2023
  • (2022)Impact of Location, Gender and Previous Experience on User Evaluation of Augmented Reality in Cultural Heritage: The Mjällby Crucifix Case StudyHeritage10.3390/heritage50301045:3(1988-2006)Online publication date: 1-Aug-2022
  • (2022)Embedded AR Storytelling Supports Active Indexing at Historical PlacesProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501328(1-12)Online publication date: 13-Feb-2022
  • (2022)Locative Authoring: Evaluating the StoryPlaces Authoring ToolInteractive Storytelling10.1007/978-3-031-22298-6_31(483-498)Online publication date: 2-Dec-2022
  • (2022)Embodied Locative Storytelling of African American HistoriesInteractive Storytelling10.1007/978-3-031-22298-6_11(171-192)Online publication date: 4-Dec-2022

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media