article

An experimental study of spatial sound usefulness in searching and navigating through AR environments

Author:

Dariusz RumińskiAuthors Info & Claims

Virtual Reality, Volume 19, Issue 3-4

Pages 223 - 233

https://doi.org/10.1007/s10055-015-0274-4

Published: 01 November 2015 Publication History

Abstract

This paper presents an experimental study of spatial sound usefulness in searching and navigating through augmented reality environments. Participants were asked to find three objects hidden within no-sound and spatial sound AR environments. The experiment showed that the participants of the spatialized sound group performed faster and more efficiently than working in no-sound configuration. What is more, 3D sound was a valuable cue for navigation in AR environment. The collected data suggest that the use of spatial sound in AR environments can be a significant factor in searching and navigating for hidden objects within indoor AR scenes. To conduct the experiment, the CARE approach was applied, while its CARL language was extended with new elements responsible for controlling audio in 3D space.

References

[1]

Android (2015) Android Platform Home Page. http://www.android.com/

[2]

Apache (2015) Apache CXF Home Page. http://cxf.apache.org/

[3]

Billinghurst M, Bowskill J, Dyer N, Morphett J (1998) An evaluation of wearable information spaces. In: Virtual Reality Annual International Symposium, Proceedings, IEEE 1998, pp 20-27.

[4]

Cohen M, Villegas J (2011) From whereware to whence- and whitherware: augmented audio reality for position-aware services. In: VR Innovation (ISVRI), 2011 IEEE International Symposium on, pp 273-280.

[5]

Cohen M, Wenzel EM (1995) Virtual environments and advanced interface design. In: The Design of Multidimensional Sound Interfaces. Oxford University Press, Inc., New York, NY, USA, pp 291-346. http://dl.acm.org/citation.cfm?id=216164.216180

[6]

Floty¿ski J, Walczak K (2014) Conceptual knowledge-based modeling of interactive 3d content. Vis Comput.

[7]

Hatala M, Wakkary R, Kalantari L (2005) Rules and ontologies in support of real-time ubiquitous application. Web Semant 3(1):5-22.

Digital Library

[8]

Jones M, Jones S, Bradley G, Warren N, Bainbridge D, Holmes G (2008) Ontrack: dynamically adapting music playback to support navigation. Pers Ubiquitous Comput 12(7):513-525.

Digital Library

[9]

Mariette N (2013) Human factors research in audio augmented reality. Springer, New York.

[10]

Murphy D, Neff F (2011) Spatial sound for computer games and virtual reality. IGI Global, Hershey

[11]

Poeschl S, Wall K, Doering N (2013) Integration of spatial sound in immersive virtual environments an experimental study on effects of spatial sound on presence. In: Virtual Reality (VR), 2013 IEEE, pp 129-130.

[12]

Qualcomm (2015) Vuforia. https://www.qualcomm.com/products/vuforia

[13]

Regenbrecht H, Lum T, Kohler P, Ott C, Wagner M, Wilke W, Mueller E (2004) Using augmented virtuality for remote collaboration. Presence 13(3):338-354.

Digital Library

[14]

Rumi¿ski D, Walczak K (2014) Carl: a language for modelling contextual augmented reality environments. In: Camarinha-Matos LM, Barrento NS, Mendonça R (eds) Technological innovation for collective awareness systems, vol 432., IFIP advances in information and communication technology Springer, Berlin, pp 183-190.

[15]

Rumi¿ski D, Walczak K (2014a) Dynamic composition of interactive ar scenes with the carl language. In: The 5th International Conference on Information, Intelligence, Systems and Applications, IEEE, pp 329-334.

[16]

Rumi¿ski D, Walczak K (2014b) Semantic contextual augmented reality environments. In: The 13th IEEE International Symp. on Mixed and Augmented Reality (ISMAR 2014), IEEE, pp 401-404.

[17]

Sodnik J, Tomazic S, Grasset R, Duenser A, Billinghurst M (2006) Spatial sound localization in an augmented reality environment. In: Proceedings of the 18th Australia Conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments, ACM, New York, NY, USA, OZCHI '06, pp 111-118.

[18]

Spring (2015) Spring home page. http://www.spring.io/

[19]

Stampfl P (2003) Augmented reality disk jockey: Ar/dj. In: ACM SIGGRAPH 2003 Sketches and Amp; Applications, ACM, New York, NY, USA, SIGGRAPH '03, pp 1.

[20]

Villegas J, Cohen M (2010) Hrir : modulating range in headphone-reproduced spatial audio. In: Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, ACM, New York, NY, USA, VRCAI '10, pp 89-94.

[21]

Walczak K, Rumi¿ski D, Floty¿ski J (2014) Building contextual augmented reality environments with semantics. In: Virtual Systems Multimedia (VSMM), pp 353-361.

[22]

Zhou Z, Cheok AD, Yang X, Qiu Y (2004) An experimental study on the role of 3d sound in augmented reality environment. Interact Comput 16(6):1043-1068.

Cited By

Su XKoh EXiao C(2024)SonifyAR: Context-Aware Sound Effect Generation in Augmented RealityExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650927(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650927
Dam ASiddiqui ALeclercq CJeon M(2024)Taxonomy and definition of audio augmented reality (AAR)International Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103179182:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103179
Kim HRemaggi LDourado ACampos TJackson PHilton A(2022)Immersive audio-visual scene reproduction using semantic scene reconstruction from 360 camerasVirtual Reality10.1007/s10055-021-00594-326:3(823-838)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1007/s10055-021-00594-3
Show More Cited By

Index Terms

An experimental study of spatial sound usefulness in searching and navigating through AR environments
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Index terms have been assigned to the content through auto-classification.

Recommendations

Spatial sound localization in an augmented reality environment
OZCHI '06: Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments

Augmented Reality (AR), the overlay of virtual images onto the real world, is an increasingly popular technique for developing new human-computer interfaces. As human navigation and orientation in different environments depend on both visual and ...
Spatial Sound and Multimodal Interaction in Immersive Environments
AM '15: Proceedings of the Audio Mostly 2015 on Interaction With Sound

Spatial sound and interactivity are key elements of investigation at the Sound And Music Computing master program at Aalborg University Copenhagen.

We present a collection of research directions and recent results from work in these areas, with the ...
Journalism in virtual reality: opportunities and future research challenges
AcademicMindtrek '16: Proceedings of the 20th International Academic Mindtrek Conference

This paper presents a state-of-the-art overview of journalism and its opportunities and challenges in virtual reality (VR). First, we examine what kind of real-life journalistic experiments have been made in this field thus far, and then we analyze the ...

Comments

Information & Contributors

Information

Published In

cover image Virtual Reality

Virtual Reality Volume 19, Issue 3-4

November 2015

155 pages

ISSN:1359-4338

EISSN:1434-9957

Issue’s Table of Contents

Copyright © Copyright © 2015 Springer-Verlag London.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 November 2015

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Su XKoh EXiao C(2024)SonifyAR: Context-Aware Sound Effect Generation in Augmented RealityExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650927(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650927
Dam ASiddiqui ALeclercq CJeon M(2024)Taxonomy and definition of audio augmented reality (AAR)International Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103179182:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103179
Kim HRemaggi LDourado ACampos TJackson PHilton A(2022)Immersive audio-visual scene reproduction using semantic scene reconstruction from 360 camerasVirtual Reality10.1007/s10055-021-00594-326:3(823-838)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1007/s10055-021-00594-3
Beck TRothe S(2021)Applying diegetic cues to an interactive virtual reality experience2021 IEEE Conference on Games (CoG)10.1109/CoG52621.2021.9619025(1-8)Online publication date: 17-Aug-2021
https://dl.acm.org/doi/10.1109/CoG52621.2021.9619025
Pollard KOiknine AFiles BSinatra APatton DEricson MThomas JKhooshabeh P(2020)Level of immersion affects spatial learning in virtual environments: results of a three-condition within-subjects study with long intersession intervalsVirtual Reality10.1007/s10055-019-00411-y24:4(783-796)Online publication date: 1-Dec-2020
https://dl.acm.org/doi/10.1007/s10055-019-00411-y
Rumiński DWalczak KAdcock MBednarz T(2017)Semantic model for distributed augmented reality servicesProceedings of the 22nd International Conference on 3D Web Technology10.1145/3055624.3077121(1-9)Online publication date: 5-Jun-2017
https://dl.acm.org/doi/10.1145/3055624.3077121
Flotyński JKrzyszkowski MWalczak K(2017)Semantic Composition of 3D Content Behavior for Explorable Virtual Reality ApplicationsVirtual Reality and Augmented Reality10.1007/978-3-319-72323-5_1(3-23)Online publication date: 12-Dec-2017
https://dl.acm.org/doi/10.1007/978-3-319-72323-5_1

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents