research-article

Digital Augmentation of Historical Objects Through Tangible Interaction

Authors:

Adriano VenturiniAuthors Info & Claims

Journal on Computing and Cultural Heritage (JOCCH), Volume 12, Issue 3

Article No.: 18, Pages 1 - 19

https://doi.org/10.1145/3297764

Published: 13 June 2019 Publication History

Abstract

The technological advances brought about by the Internet of Things enable new opportunities for a more direct interaction among users, objects, and places. This is an extremely valuable innovation for the cultural heritage sector, as it allows a more transparent use of technology in the digital augmentation of museums and cultural heritage sites. The possibility to augment physical objects with sensors detecting when they are moved and manipulated enables scenarios where descriptive information about objects is presented to users at the very exact time they are looking at them, stimulating engagement. This article describes a collaborative research effort among cultural heritage professionals, human--computer interaction experts, and developers that was aimed at investigating the goals and constraints curators consider for a physical encounter between visitors and historic relics. In a case study, we co-designed an interactive plinth centred on tangible interaction and evaluated the impact on the user experience of combining digital information with a hands-on experience of relics of World War I. Our findings show that visitors value this type of tangible interaction with collection objects positively, as it allows the discovery of details and the learning of aspects that normally go unnoticed. The synergy between physical and digital aspects stimulates empathy with the original users of the object and fosters social interaction.

References

[1]

Liliana Ardissono, Tsvika Kuflik, and Daniela Petrelli. 2012. Personalization in cultural heritage: The road travelled and the one ahead. User Model User-Adap Inter. 22, 1--2 (2012), 73--99.

Digital Library

[2]

Luigi Atzori, Antonio Iera, and Giacomo Morabito. 2010. The Internet of things: A survey. Comput. Netw. 54 (15), 2787--2805.

Digital Library

[3]

Inna Belinky, Tsvi Kuflik, and Joel Lanir. 2011. Group interaction with situated displays in cultural heritage. In Proceedings of the Workshop on Personal Access to Cultural Heritage (PATCH’11).

[4]

Dorothy Lozowski Boisvert and Brenda Jochums Slez. 1995. The relationship between exhibit characteristics and learning-associated behaviors in a science museum discovery space. Sci. Ed. 79, 5 (1995), 503--518.

[5]

Dario Cavada, Mehdi Elahi, David Massimo, Stefano Maule, Elena Not, Francesco Ricci, and Adriano Venturini. 2018. Tangible tourism with the internet of things. In Information and Communication Technologies in Tourism 2018. Springer, Cham, 349--361.

[6]

Luigina Ciolfi, Daniela Petrelli, Robin Goldberg, Nick Dulake, Matt Willox, Mark Marshall, and Fabio Caparrelli. 2013. Exploring historical, social and natural heritage: Challenges for tangible interaction design at Sheffield General Cemetery. In Proceedings of NODEM 2013: Beyond control—The Collaborative Museum and its Challenges. Stockholm, Sweden.

[7]

Luigina Ciolfi, Liam J. Bannon, and Mikael Fernström. 2008. Including visitor contributions in cultural heritage installations: Designing for participation. Mus. Manage. Curat. 23, 4 (2008), 353--365.

[8]

Luigina Ciolfi and Liam J. Bannon. 2005. Space, place and the design of technologically-enhanced physical environments. In Spaces, Spatiality and Technology. The Kluwer International Series on Computer Supported Cooperative Work, P. Turner, E. Davenport (Eds.). Vol. 5. Springer, Dordrecht.

[9]

Luigina Ciolfi and Liam J. Bannon. 2002. Designing interactive museum exhibits: Enhancing visitor curiosity through augmented artifacts. In Proceedings of the European Conference on Cognitive Ergonomics. 311--317.

[10]

Caroline Claisse, Luigina Ciolfi, and Daniela Petrelli. 2017. Containers of Stories: using co-design and digital augmentation to empower the museum community and create novel experiences of heritage at a house museum. Des. J. 20, 1 (2017), S2906--S2918.

[11]

Areti Damala, Merel van derVaart, Loraine Clarke, Eva Hornecker, Gabriela Avram, Hub Kockelkorn, and Ian Ruthven. 2016. Evaluating tangible and multisensory museum visiting experiences: Lessons learned from the meSch project. In Proceedings of the Annual Conference on Museums and the Web 2016 (MW’16).

[12]

Eyal Dim and Tsvi Kuflik. 2014. Automatic detection of social behavior of museum visitor pairs. ACM Trans. Interact. Intell. Syst. 4, 4, Article 17 (2014), 30.

Digital Library

[13]

Sandra Dudley (Ed.). 2010. Museum Materialities: Objects, Engagements, Interpretations. Routledge.

[14]

John Falk. 2009. Identity and the Museum Visitor Experience. Left Coast Press.

[15]

Kieran Ferris, Liam Bannon, Luigina Ciolfi, Paul Gallagher, Tony Hall, and Marilyn Lennon. 2004. Shaping experiences in the hunt museum: a design case study. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS’04). ACM, New York, NY, 205--214.

Digital Library

[16]

Mike Fraser, Danaë Stanton, Kher Hui Ng, Steve Benford, Claire O'Malley, John Bowers, Gustav Taxén, Kieran Ferris, and Jon Hindmarsh. 2003. Assembling history. In Proceedings of the European Conference on Computer-Supported Cooperative Work (ECSCW’03), K. Kuutti, E. H. Karsten, G. Fitzpatrick, P. Dourish, and K. Schmidt (Eds.). Springer, Dordrecht.

[17]

Christian Heath, Paul Luff, Dirk Vom Lehn, Jon Hindmarsh, and Jason Cleverly. 2002. Crafting participation: Designing ecologies, configuring experiences. Vis. Commun. 1, 1 (2002), 9--33.

[18]

Christian Heath and Dirk vom Lehn. 2008. Construing interactivity: Enhancing engagement with new technologies in science centres and museums. In Social Studies of Science 38 (2008), 63--96.

[19]

Michael S. Horn, Erin Treacy Solovey, and Robert J. K. Jacob. 2008. Tangible programming and informal science learning: making TUIs work for museums. In Proceedings of the 7th International Conference on Interaction Design and Children (IDC’08). ACM, New York, NY, 194--201.

Digital Library

[20]

Eva Hornecker. 2010. Interactions around a contextually embedded system. In Proceedings of the ACM International Conference on Tangible, Embedded and Embodied Interaction (TEI’10). ACM, 169--176.

Digital Library

[21]

Eva Hornecker and Matthias Stifter. 2006. Learning from interactive museum installations about interaction design for public settings. In Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments (OZCHI’06), Jesper Kjeldskov and Jeni Paay (Eds.). ACM, New York, NY, 135--142.

Digital Library

[22]

Eva Hornecker and Jacob Buur. 2006. Getting a grip on tangible interaction: A framework on physical space and social interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’06), Rebecca Grinter, Thomas Rodden, Paul Aoki, Ed Cutrell, Robin Jeffries, and Gary Olson (Eds.). ACM, New York, NY, 437--446.

Digital Library

[23]

Matthias Kranz, Paul Holleis, and Albrecht Schmidt. 2010. Embedded interaction: Interacting with the internet of things. IEEE Internet Comput. 14, 2 (2010), 46--53.

Digital Library

[24]

Thomas Kubitza and Albrecht Schmidt. 2016. Rapid interweaving of smart things with the meSchup IoT platform. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp’16). ACM, New York, NY, 313--316.

Digital Library

[25]

Joel Lanir, Tsvi Kuflik, Eyal Dim, Alan J. Wecker, and Oliviero Stock. 2013. The influence of a location-aware mobile guide on museum visitors’ behavior. Interact. Comput. 25, 6, 1 (2013), 443--460.

[26]

Mark T. Marshall, Nick Dulake, Daniela Petrelli, and Hub Kockelkorn. 2015. From the deposit to the exhibit floor: An exploration on giving museum objects personality and social life. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA’15). ACM, New York, NY, 1917--1922.

Digital Library

[27]

Mark T. Marshall, Nick Dulake, Luigina Ciolfi, Daniele Duranti, Hub Kockelkorn, and Daniela Petrelli. 2016a. Using tangible smart replicas as controls for an interactive museum exhibition. In Proceedings of the 10th International Conference on Tangible, Embedded, and Embodied Interaction (TEI’16). ACM, New York, NY, 159--167.

Digital Library

[28]

Mark T. Marshall, Daniela Petrelli, Nick Dulake, Elena Not, Michele Marchesoni, Elisa Trenti, and Anna Pisetti. 2016b. Audio-based narratives for the trenches of world war I: Intertwining stories, places and interaction for an evocative experience. Int. J. Hum.-Comput. Stud. 85 (2016), 27--39.

Digital Library

[29]

Paul Marshall, Yvonne Rogers, and Nadia Pantidi. 2011. Using F-formations to analyse spatial patterns of interaction in physical environments. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (CSCW’11). ACM, New York, NY, USA, 445--454.

Digital Library

[30]

Robin Meisner, Dirk vom Lehn, Christian Heath, Alex Burch, Ben Gammon, and Molly Reisman. 2007. Participation at exhibits: Creating engagement with new technologies in science centres. Int. J. Sci. Educ. 29, 12 (2007), 1531--1555.

[31]

Kher Hui Ng, Hai Huang, and Claire O'Malley. 2018. Treasure codes: Augmenting learning from physical museum exhibits through treasure hunting. Pers. Ubiquit. Comput. 22, 4 (2018).

[32]

Donald A. Norman. 2013. The Design of Everyday Things: Revised and Expanded. Basic Books, New York, NY.

[33]

Elena Not and Daniela Petrelli. 2019. Empowering Cultural Heritage Professionals with Tools for Authoring and Deploying Personalised Visitor Experiences. User Modeling and User-Adapted Interaction 29, 1 (2019), 67--120.

Digital Library

[34]

Elena Not and Daniela Petrelli. 2018. Blending customisation, context-awareness and adaptivity for personalised tangible interaction in cultural heritage. Int. J. Huma.-Comput. Stud. 114 (2018), 3--19.

[35]

Daniela Petrelli. 2017. Industry 4.0: Is it time for interaction design craftsmanship? Des. J. 20, 1 (2017), S2735--S2745.

[36]

Daniela Petrelli, Luigina Ciolfi, Dick van Dijk, Eva Hornecker, Elena Not, and Albrecht Schmidt. 2013. Integrating material and digital: A new way for cultural heritage. Interactions 20, 4 (2013), 58--63.

Digital Library

[37]

Daniela Petrelli and Sinead O'Brien. 2016. Mobiles for museum visit should be abolished: A comparison of smart replicas, smart cards, and phones. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp’16). ACM, New York, NY, 1513--1519.

Digital Library

[38]

Anna Pisetti, Elena Not, and Daniela Petrelli. 2018. War at your doorstep: Supporting communities discovering their local history via interactive technology. In Cultural Heritage Communities: Technologies and Challenges, L. Ciolfi, A. Damala, E. Hornecker, M. Lechner, and L. Maye (Eds.). Routledge.

[39]

Brett Ridel, Patrick Reuter, Jeremy Laviole, Nicolas Mellado, Nadine Couture, and Xavier Granier. 2014. The revealing flashlight: Interactive spatial augmented reality for detail exploration of cultural heritage artifacts. J. Comput. Cult. Herit. 7, 2, Article 6 (2014), 18.

Digital Library

[40]

Martin Risseeuw, Dario Cavada, Elena Not, Massimo Zancanaro, Mark T. Marshall, Daniela Petrelli, and Thomas Kubitza. 2016. An authoring environment for smart objects in museums: The meSch approach. In Proceedings of the 1st International Workshop on Smart Ecosystems cReation by Visual dEsign co-located with the International Working Conference on Advanced Visual Interfaces (AVI’16). CEUR, Vol. 1602. 25--3.

[41]

Orit Shaer and Eva Hornecker. 2010. Tangible user interfaces: Past, present, and future directions. Found. Trends Hum.-Comput. Interact. 3, 1--2 (2010), 1--137.

Digital Library

[42]

Oliviero Stock, Antonio Krüger, Tsvika Kuflik, and Massimo Zancanaro. 2007. Intelligent interfaces for groups in a museum. In PEACH—Intelligent Interfaces for Museum Visits, Stock and Zancanaro (Eds.). Springer, 269--288.

[43]

Oliviero Stock, Massimo Zancanaro, Daniel Tomasini, and Fabio Pianesi. 2011. A socially aware persuasive systems for supporting conversations at the museum café. In Proceedings of the International Conference on Intelligent User Interfaces (IUI’11).

[44]

Karen Tanenbaum, Marek Hatala, Joshua Tanenbaum, Ron Wakkary, and Alissa Antle. 2014. A case study of intended versus actual experience of adaptivity in a tangible storytelling system. User Model. User-Adapt. Interact. 24, 3 (2014), 175--217.

Digital Library

[45]

Peter Tolmie, Steve Benford, Chris Greenhalgh, Tom Rodden, and Stuart Reeves. 2014. Supporting group interactions in museum visiting. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work 8 Social Computing (CSCW’14). ACM, New York, NY, 1049--1059.

Digital Library

[46]

Stefan J. Rennick-Egglestone, Patrick Brundell, Boriana Koleva, Steve Benford, Maria Roussou, and Christophe Chaffardon. 2016. Families and mobile devices in museums: Designing for integrated experiences. J. Comput. Cult. Herit. 9, 2, Article 11 (2016), 13.

Digital Library

[47]

Merel van der Vaart and Areti Damala. 2015. Through the loupe: Visitor engagement with a primarily text-based handheld AR application. In Proceedings of the Conference on Digital Heritage 2015, 565--572.

[48]

Dirk vom Lehn and Christian Heath. 2003. Displacing the object: Mobile technology and interpretive resources. In --Proceedings of the International Cultural Heritage Informatics Meeting (ICHIM’03).

[49]

Ron Wakkary and Marek Hatala. 2007. Situated play in a tangible interface and adaptive audio museum guide. Pers. Ubiq. Comput. 11, 3 (2007), 171--191.

Digital Library

[50]

Ron Wakkary, Marek Hatala, Kevin Muise, Karen Tanenbaum, Greg Corness, Bardia Mohabbati, and Jim Budd. 2009. Kurio: A museum guide for families. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction (TEI’09). ACM, New York, NY, 215--222.

Digital Library

[51]

Katrin Wolf, Essam Abdelhady, Yomna Abdelrahman, Thomas Kubitza, and Albrecht Schmidt. 2015. MeSch: Tools for interactive exhibitions. In Proceedings of the Conference on Electronic Visualisation and the Arts (EVA’15). BCS Learning 8 Development Ltd., Swindon, UK, 261--269.

Digital Library

Cited By

Kunt SPamuk CJamanov S(2024)Rethinking about Tangible Cultural Heritage Like Architect Sinan in The Digital Age: A Synthesis between The AgesIğdır Üniversitesi Sosyal Bilimler Dergisi10.54600/igdirsosbilder.1436307Online publication date: 22-Mar-2024
https://doi.org/10.54600/igdirsosbilder.1436307
Huang YHe XLian ZYang Z(2024)Mapping the landscape of digital cultural heritage research: a quantitative and visual bibliometric studyLibrary Hi Tech10.1108/LHT-09-2023-0465Online publication date: 20-Jun-2024
https://doi.org/10.1108/LHT-09-2023-0465
Pei Y(2024)The value of technology and interactive systems in cultural heritage interpretation: a study based on existing empirical researchMuseum Management and Curatorship10.1080/09647775.2024.2408240(1-19)Online publication date: 26-Sep-2024
https://doi.org/10.1080/09647775.2024.2408240
Show More Cited By

Index Terms

Digital Augmentation of Historical Objects Through Tangible Interaction
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

From Delivering Facts to Generating Emotions: The Complex Relationship between Museums and Information
CHIIR '19: Proceedings of the 2019 Conference on Human Information Interaction and Retrieval

Motivation : The past 25 years have seen a constant increase in the use of information technology to deliver digital content in cultural heritage settings. Museums have experimented with multimedia PCs, PDAs and phones, table-tops, Google Glass and now ...
Authoring Augmented Digital Experiences in Museums
AVI '16: Proceedings of the International Working Conference on Advanced Visual Interfaces

It is of paramount importance that cultural heritage professionals are directly involved in the design of digitally augmented experiences in their museum spaces. We propose an approach based on a catalogue of reusable narrative and interaction strategies ...
Designing the Interaction with the Internet of Tangible Things: A Card Set
TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction

Current interactions for the Internet of Things are often constrained behind a screen. With the Internet of Tangible Things (IoTT) we aim at promoting the design of richer interactions, embodied in physical IoT objects. To this purpose, we propose a ...

Comments

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage

Journal on Computing and Cultural Heritage Volume 12, Issue 3

October 2019

158 pages

ISSN:1556-4673

EISSN:1556-4711

DOI:10.1145/3340676

Editor:
Franco Niccolucci
VAST-LAB at PIN, University of Florence, Italy

Issue’s Table of Contents

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2019

Accepted: 01 December 2018

Revised: 01 September 2018

Received: 01 April 2018

Published in JOCCH Volume 12, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
822
Total Downloads

Downloads (Last 12 months)129
Downloads (Last 6 weeks)12

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kunt SPamuk CJamanov S(2024)Rethinking about Tangible Cultural Heritage Like Architect Sinan in The Digital Age: A Synthesis between The AgesIğdır Üniversitesi Sosyal Bilimler Dergisi10.54600/igdirsosbilder.1436307Online publication date: 22-Mar-2024
https://doi.org/10.54600/igdirsosbilder.1436307
Huang YHe XLian ZYang Z(2024)Mapping the landscape of digital cultural heritage research: a quantitative and visual bibliometric studyLibrary Hi Tech10.1108/LHT-09-2023-0465Online publication date: 20-Jun-2024
https://doi.org/10.1108/LHT-09-2023-0465
Pei Y(2024)The value of technology and interactive systems in cultural heritage interpretation: a study based on existing empirical researchMuseum Management and Curatorship10.1080/09647775.2024.2408240(1-19)Online publication date: 26-Sep-2024
https://doi.org/10.1080/09647775.2024.2408240
Pedroso JGicole CSarches A(2023)Learning Local History and Culture Through Museum VisitsEIKI Journal of Effective Teaching Methods10.59652/jetm.v1i3.361:3Online publication date: 20-Aug-2023
https://doi.org/10.59652/jetm.v1i3.36
Chen HSun Y(2023)Applying War Heritage in the National World War II History Course for College Students in China: An Exploration of Digitization StrategiesSustainability10.3390/su1503241715:3(2417)Online publication date: 29-Jan-2023
https://doi.org/10.3390/su15032417
Duranti DSpallazzo DPetrelli D(2023)Smart Objects and Replicas: A Survey of Tangible and Embodied Interactions in Museums and Cultural Heritage SitesJournal on Computing and Cultural Heritage 10.1145/3631132Online publication date: 2-Nov-2023
https://dl.acm.org/doi/10.1145/3631132
Kobeisse SHolmquist L(2023)Moving Inside the Box: Interacting with Interpretation of Historical Artefacts Through Tangible Augmented RealityProceedings of the 5th ACM International Conference on Multimedia in Asia10.1145/3595916.3626408(1-7)Online publication date: 6-Dec-2023
https://dl.acm.org/doi/10.1145/3595916.3626408
Murphy CCarew PStapleton L(2023)A human-centred systems manifesto for smart digital immersion in Industry 5.0: a case study of cultural heritageAI & SOCIETY10.1007/s00146-023-01693-239:5(2401-2416)Online publication date: 30-May-2023
https://doi.org/10.1007/s00146-023-01693-2
Zhao YLian JZhang YSong SYao X(2023)Value co‐creation in cultural heritage information practices: Literature review and future agendaJournal of the Association for Information Science and Technology10.1002/asi.24862Online publication date: 26-Dec-2023
https://doi.org/10.1002/asi.24862
Nikolakopoulou VVosinakis SNikopoulos GStavrakis MPolitopoulos NFragkedis LKoutsabasis P(2022)Design and User Experience of a Hybrid Mixed Reality Installation that Promotes Tinian Marble Crafts HeritageJournal on Computing and Cultural Heritage 10.1145/352274315:4(1-21)Online publication date: 6-Dec-2022
https://dl.acm.org/doi/10.1145/3522743
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents