research-article

Soundscape of an Archaeological Site Recreated with Audio Augmented Reality

Authors:

Ante JurčevićAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 14, Issue 3

Article No.: 74, Pages 1 - 22

https://doi.org/10.1145/3230652

Published: 24 July 2018 Publication History

Abstract

This article investigates the use of an audio augmented reality (AAR) system to recreate the soundscape of a medieval archaeological site. The aim of our work was to explore whether it is possible to enhance a tourist's archaeological experience, which is often derived from only scarce remains. We developed a smartphone-based AAR system, which uses location and orientation sensors to synthesize the soundscape of a site and plays it to the user via headphones. We recreated the ancient soundscape of a medieval archaeological site in Croatia and tested it in situ on two groups of participants using the soundwalk method. One test group performed the soundwalk while listening to the recreated soundscape using the AAR system, while the second control group did not use the AAR equipment. We measured the experiences of the participants using two methods: the standard soundwalk questionnaire and affective computing equipment for detecting the emotional state of participants. The results of both test methods show that participants who were listening to the ancient soundscape using our AAR system experienced higher arousal than those visiting the site without AAR.

References

[1]

B. C. Pijanowski. 2011. What is soundscape ecology? An introduction and overview of an emerging new science. Landscape Ecology 26, 9 (November 2011), 1213--1232.

[2]

L. Brown. 2011. Advancing the concepts of soundscapes and soundscape planning. In Proceedings of the Annual Conference of the Australian Acoustical Society. Article 115.

[3]

R. Xinxin and K. Jian. 2015. Effects of soundscape on rural landscape perception. In Proceedings of Euronoise. 2399--2404.

[4]

V. P. Romero. 2015. The influence of the soundscape on the tourists. In Proceedings of Euronoise. 1535--1540.

[5]

D. Botteldooren et al. 2011. Understanding urban and natural soundscapes. In Proceedings of the Forum Acusticum (EAA’11). 2047--2052.

[6]

C. Guastavino et al. 2005. Ecological validity of soundscape reproduction. Acta Acustica United with Acustica 91 (March 2005), 333--341.

[7]

W. J. Davies, N. S. Bruce, and J. E. Murphy. 2014. Soundscape reproduction and synthesis. Acta Acustica United with Acustica 100 (March 2014), 285--292.

[8]

S. Harriet and D. T. Murphy. 2015. Auralisation of an urban soundscape. Acta Acustica United with Acustica 101 (August 2015), 798--810.

[9]

G. Kinayouglu. 2009. Using audio-augmented reality to access the role of soundscape in environmental perception. In Proceedings of Conference on Education and Research in Computer Aided Architectural Design in Europe.

[10]

E. M. Wenzel. 1991. Three-dimensional virtual acoustic displays. NASA Technical Memorandum #103835. National Aeronautics and Space Administration, Washington, DC.

[11]

S. Feiner et al. A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Personal and Ubiquitous Computing 1, 4 (December 1997), 74--81.

[12]

Y. Vazquez-Alvarez et al. 2016. Designing interactions with multilevel auditory displays in mobile audio-augmented reality. ACM Transactions on Computer-Human Interactio, 23, 1 (February 2016), 3:1--3:30.

Digital Library

[13]

T. Chatzidimitris, D. Gavalas, and D. Michael. 2016. SoundPacman: Audio augmented reality in location-based games. In Proceedings of 18th Mediterranean Electrotechnical Conference. 1--6.

[14]

N. S. Bruce and W. J. Davies. 2009. Development of a soundscape simulator tool. In Proceedings of Internoise.

[15]

D. Kalogianni and W. Thomas. 2014. The city soundscape and the brain. In Proceedings of Invisible Places 2014.

[16]

R. M. Schafer. 1977. The Tuning of the World. Random House, New York, NY.

[17]

International Organization for Standardization. 2014. Acoustics—Soundscape—Part. 1: Definition and Conceptual Framework ISO 12913-1:2014, Geneva, Switzerland.

[18]

M. Raimbault. 2006. Qualitative judgements of urban soundscapes: Questionning questionnaires and semantic scales. Acta Acustica United with Acustica 92, 6 (November 2011), 929--937.

[19]

F. Aletta et al. 2017. Urban soundscapes: Characterization of a pedestrian tourist route in Sorrento (Italy). Urban Science 1, 1, Article 4 (January 2017).

[20]

C. Scarre and G. Lawson. 2006. Archaeoacustics. McDonald Institute for Archaeological Research, University of Cambridge, United Kingdom.

[21]

S. Modica. 2014. Soundscape, landscape and cultural heritage: A case study in proto-historic Italy. In Proceedings of Landscape Archaeology Conference (LAC’14).

[22]

P. Debertolis, F. Coimbra, and L. Eneix. 2015. Archaeoacoustic analysis of the Hal Saflieni Hypogeum in Malta. Journal of Anthropology and Archaeology 3, 1 (June 2015), 59--79.

[23]

M. Suhanek. 2012. Perception and evaluation of sudden loudness changes in familiar soundscapes. In Proceedings of 5th Congress of Alps-Adria Acoustics Association.

[24]

C. Semidor. 2006. Listening to a city with the soundwalk method. Acta Acustica United with Acustica 92, 6 (November 2006), 959--964.

[25]

S. Makeig et al. 2011. First demonstration of a musical emotion BCI. In Proceedings of the 4th International Conference of Affective Computing and Intelligent Interaction.

Digital Library

[26]

G. Udovičić, J. &Dstrok;erek, M. Russo, and M. Sikora. 2017. Wearable emotion recognition system based on GSR and PPG signals. In Proceedings of the 2nd International Workshop on Multimedia for Personal Health and Health Care (MMHealth'17). ACM, New York, NY, USA, 53--59.

Digital Library

[27]

J. A. Russell. 1980. A circumplex model of affect. Journal of Personality and Social Psychology 39, 6 (1980), 1161--1178.

[28]

D. W. F. van Krevelen and R. Poelman. 2010. A survey of augmented reality technologies, applications and limitations. The International Journal of Virtual Reality 9, 2 (June 2010), 1--20.

[29]

W. Barfield (ed.). 2015. Applications of audio augmented reality. In Fundamentals of Wearable Computers and Augmented Reality (1st ed.), 309--330. CRC Press, Boca Raton, FL.

[30]

J. M. Loomis et al. 1994. Personal guidance system for the visually impaired. In Proceedings of the 1st Annual ACM Conference on Assistive Technologies. 85--91.

Digital Library

[31]

L. Seidenari et al. Deep artwork detection and retrieval for automatic context-aware audio guides. ACM Transactions on Multimedia Computing, Communications, and Applications, 13, 3 (August 2017), Article 35.

Digital Library

[32]

R. Wakkary et al. 2004. Interactive audio content. In Proceedings of Museums and the Web 2004, 55--60.

[33]

F. Z. Kaghat and P. Cubaud. 2010. Fluid interaction in audio-guided museum visit. In Proceedings of the 11th International Conference on Virtual Reality, Archaeology and Cultural Heritage, 163--170.

Digital Library

[34]

K. Salo, D. Giova, and T. Mikkonen. 2016. Backend infrastructure supporting audio augmented reality and storytelling. Lecture Notes in Computer Science, 9735, (June 2016).

[35]

Y. T. Zheng et al. 2013. GPSView: A scenic driving route planner. ACM Trans. Multimedia Comput. Commun. Appl. 9, 1 (February 2013), Article 3, 18 pages.

Digital Library

[36]

P. Franti, R. Mariescu-Istodor, and L. Sengupta. 2017. O-Mopsi: Mobile orienteering game for sightseeing, exercising, and education. ACM Transactions on Multimedia Computing, Communications, and Applications, 13, 4 (August 2017), Article 56.

Digital Library

[37]

F. Heller, A. Kramer, and J. Borchers. 2014. Simplifying orientation measurement for mobile audio augmented reality applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 615--624.

Digital Library

[38]

M. Sikora, Đ. Grčić, and M. Russo. 2016. A tool for soundscape auralization of ancient archaeological sites. In Proceedings of the 7th Congress of Alps Adria Acoustic Association (AAAA’16).

[39]

M. Vicelja-Matijašić. 2015. Biskupija: Insights into the chronology of the site from late 8<sup>th</sup> to 15<sup>th</sup> century. In Swords, Crowns, Censers and Books. Faculty of Humanities and Social Sciences, Rijeka, Croatia, 328--372.

[40]

H. N. Boone Jr and D. A. Boone. 2012. Analyzing Likert data. J. Extension 50, 2 (2012), 1--5.

[41]

A. Burns, E. P. Doheny, and B. R. Greene. 2010. SHIMMER™: An extensible platform for physiological signal capture. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]

G. Karafotias et al. 2017. Intensifying emotional reactions via tactile gestures in immersive films. ACM Transactions on Multimedia Computing, Communications, and Applications 13, 3 (August 2017), Article 29.

Digital Library

Cited By

Calisto MSarkar S(2024)A systematic review of virtual reality in tourism and hospitality: The known and the paths to followInternational Journal of Hospitality Management10.1016/j.ijhm.2023.103623116(103623)Online publication date: Jan-2024
https://doi.org/10.1016/j.ijhm.2023.103623
Dam ASiddiqui ALeclercq CJeon M(2024)Taxonomy and definition of audio augmented reality (AAR)International Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103179182:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103179
Pamparău C(2023)Dare We Define Olfactory Augmented Reality?Proceedings of the 2023 ACM International Conference on Interactive Media Experiences Workshops10.1145/3604321.3604376(52-55)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3604321.3604376
Show More Cited By

Index Terms

Soundscape of an Archaeological Site Recreated with Audio Augmented Reality
1. Applied computing
  1. Arts and humanities
    1. Sound and music computing
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
    2. Interaction techniques
      1. Auditory feedback

Recommendations

A mobile augmented reality audio system with binaural microphones
IwS '11: Proceedings of Interacting with Sound Workshop: Exploring Context-Aware, Local and Social Audio Applications

This paper presents a microphone-hear-through augmented reality hardware system, consisting of insert headphones with binaural microphones, i.e., a microphone at each ear, together with a separate mixer and equalizer unit. The equalizer compensates for ...
Creation and calibration method of acoustical models for historic virtual reality auralizations

Virtual reality provides the possibility for interactive visits to historic buildings and sites. The majority of current virtual reconstructions have focused on creating realistic virtual environments, by concentrating on the visual component. However, ...
The Design Methods of Augmented Reality in a Historical Site
ICVARS '23: Proceedings of the 2023 7th International Conference on Virtual and Augmented Reality Simulations

Augmented reality (AR) technology has the potential to enhance the visitor experience at historical and cultural sites by providing rich, interactive information about the site's history and culture. In our project to develop an AR guide app for a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 14, Issue 3

August 2018

249 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/3241977

Editor:
Alberto Del Bimbo
University of Firenze, Italy

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 July 2018

Accepted: 01 May 2018

Revised: 01 April 2018

Received: 01 September 2017

Published in TOMM Volume 14, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Croatian Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
654
Total Downloads

Downloads (Last 12 months)64
Downloads (Last 6 weeks)6

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Calisto MSarkar S(2024)A systematic review of virtual reality in tourism and hospitality: The known and the paths to followInternational Journal of Hospitality Management10.1016/j.ijhm.2023.103623116(103623)Online publication date: Jan-2024
https://doi.org/10.1016/j.ijhm.2023.103623
Dam ASiddiqui ALeclercq CJeon M(2024)Taxonomy and definition of audio augmented reality (AAR)International Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103179182:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103179
Pamparău C(2023)Dare We Define Olfactory Augmented Reality?Proceedings of the 2023 ACM International Conference on Interactive Media Experiences Workshops10.1145/3604321.3604376(52-55)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3604321.3604376
Zorea MKushi K(2023)Audible Imagery: Creative Contemplations on the Sounds of HomeProceedings of the 15th Conference on Creativity and Cognition10.1145/3591196.3593366(150-161)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3591196.3593366
Kritikos YGiariskanis FProtopapadaki EPapanastasiou APapadopoulou EMania K(2023)Audio Augmented Reality OutdoorsProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3597028(199-204)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3597028
Siriaraya PKiriu TShe WMittal MKawai YNakajima S(2023)Investigating the use of Spatialized Audio Augmented Reality to enhance the outdoor running experienceEntertainment Computing10.1016/j.entcom.2022.10053444(100534)Online publication date: Jan-2023
https://doi.org/10.1016/j.entcom.2022.100534
Botteldooren DDe Coensel BAletta FKang J(2023)Triangulation as a Tool in Soundscape ResearchSoundscapes: Humans and Their Acoustic Environment10.1007/978-3-031-22779-0_8(215-241)Online publication date: 25-Apr-2023
https://doi.org/10.1007/978-3-031-22779-0_8
Mu JWang TZhang Z(2022)Research on the Acoustic Environment of Heritage Buildings: A Systematic ReviewBuildings10.3390/buildings1211196312:11(1963)Online publication date: 11-Nov-2022
https://doi.org/10.3390/buildings12111963
Schrapel MHappe JRohs M(2022)EnvironZen: Immersive Soundscapes via Augmented Footstep Sounds in Urban Areasi-com10.1515/icom-2022-002021:2(219-237)Online publication date: 19-Jul-2022
https://doi.org/10.1515/icom-2022-0020
Dam ASiddiqui ALeclerq CJeon M(2022)Extracting a Definition and Taxonomy for Audio Augmented Reality (AAR) Using Grounded TheoryProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118132266143466:1(1220-1224)Online publication date: 27-Oct-2022
https://doi.org/10.1177/1071181322661434
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents