Measuring the Just Noticeable Difference for Audio Latency
Pages 325 - 331
Abstract
All parts of an audio processing chain introduce latency. Previous studies have shown that high audio latency may negatively impact human performance in different scenarios, e.g., when performing live music or when interacting with real-time human-computer systems. However, is not yet known where the human perception threshold for audio latency lies, i.e., what the lowest amount of latency is that musicians might notice. Therefore, we conducted a user study (n=37) using the PEST method to estimate the just noticeable difference (JND) for audio latency under different base latency settings. Our results suggest that base latency influences the perception threshold in a non-linear manner: Participants achieved a mean JND of 49 ms for a base latency of 0 ms, 27 ms for a base latency of 64 ms, and 77 ms for a base latency of 512 ms. Furthermore, the JND was lower for participants with high musical sophistication.
References
[1]
Andrew P. McPherson, Robert H. Jack, and Giulio Moro. 2016. Action-Sound Latency: Are Our Tools Fast Enough?. In Proceedings of the International Conference on New Interfaces for Musical Expression. http://www.nime.org/proceedings/2016/nime2016_paper0005.pdf
[2]
Christopher Bartlette, Dave Headlam, Mark Bocko, and Gordana Velikic. 2006. Effect of Network Latency on Interactive Musical Performance. Music Perception 24, 1 (Sept. 2006), 49–62. https://doi.org/10.1525/mp.2006.24.1.49
[3]
Chris Chafe, Michael Gurevich, Grace Leslie, and Sean Tyan. 2004. Effect of Time Delay on Ensemble Accuracy. (April 2004), 4.
[4]
E. Chew, R. Zimmermann, A. Sawchuk, C. Kyriakakis, C. Papadopoulos, A. François, G. Kim, A. Rizzo, and A. Volk. 2004. Musical Interaction at a Distance : Distributed Immersive Performance. https://www.semanticscholar.org/paper/Musical-Interaction-at-a-Distance-%3A-Distributed-Chew-Zimmermann/375b168675cdaebe8394f7d0cb06bb504338a874
[5]
Jacob Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences (2 ed.). Routledge, New York. https://doi.org/10.4324/9780203771587
[6]
Sofia Dahl. 2000. The Playing of an Accent - Preliminary Observations from Temporal and Kinematic Analysis of Percussionists. Journal of New Music Research 29, 3 (Sept. 2000), 225. https://doi.org/10.1076/jnmr.29.3.225.3090
[7]
Jonathan Deber, Ricardo Jota, Clifton Forlines, and Daniel Wigdor. 2015. How Much Faster is Fast Enough? User Perception of Latency & Latency Improvements in Direct and Indirect Touch. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, New York, NY, USA, 1827–1836. https://doi.org/10.1145/2702123.2702300
[8]
Nathalie Ehrlé and Séverine Samson. 2005. Auditory discrimination of anisochrony: Influence of the tempo and musical backgrounds of listeners. Brain and Cognition 58, 1 (June 2005), 133–147. https://doi.org/10.1016/j.bandc.2004.09.014
[9]
Gustav Theodor Fechner. 1860. Elemente der Psychophysik. Vol. 2. Breitkopf und Härtel.
[10]
Daniel Fiedler and Daniel Müllensiefen. 2015. Validierung des Gold-MSI-Fragebogens zur Messung Musikalischer Erfahrenheit von Schülerinnen und Schülern der Sekundarstufen an allgemeinbildenden Schulen. In Theoretische Rahmung und Theoriebildung in der musikpädagogischen Forschung, Anne Niessen and Jens Knigge (Eds.). Number 36 in Musikpädagogische Forschung. Waxmann, Münster; New York, 199–219. https://www.pedocs.de/frontdoor.php?source_opus=12622
[11]
Steven A. Finney. 1997. Auditory Feedback and Musical Keyboard Performance. Music Perception: An Interdisciplinary Journal 15, 2 (1997), 153–174. https://doi.org/10.2307/40285747
[12]
Adrian Freed, Amar Chaudhary, and Brian Davila. 1997. Operating Systems Latency Measurement and Analysis for Sound Synthesis and Processing Applications. International Computer Music Association, Thessaloniki, Greece, 479–481.
[13]
Simon Grondin. 2008. Psychology of Time. Emerald Group Publishing. Google-Books-ID: oWf2OqH3aJYC.
[14]
David Halbhuber, Annika Köhler, Markus Schmidbauer, Jannik Wiese, and Niels Henze. 2022. The Effects of Auditory Latency on Experienced First-Person Shooter Players. In Proceedings of Mensch und Computer 2022(MuC ’22). Association for Computing Machinery, New York, NY, USA, 286–296. https://doi.org/10.1145/3543758.3543760
[15]
David Halbhuber, Valentin Schwind, and Niels Henze. 2022. Don’t Break my Flow: Effects of Switching Latency in Shooting Video Games. Proceedings of the ACM on Human-Computer Interaction 6, CHI PLAY (2022), 229:1–229:20. https://doi.org/10.1145/3549492
[16]
A. J. Houtsma and J. Smurzynski. 1990. Pitch identification and discrimination for complex tones with many harmonics. Journal of the Acoustical Society of America 87, 1 (1990), 304–310. https://doi.org/10.1121/1.399297
[17]
Perttu Hämäläinen and Teemu Mäki-Patola. 2004. Latency Tolerance for Gesture Controlled Continuous Sound Instrument without Tactile Feedback. In Proceedings of the International Computer Music Conference (ICMC2004). The International Computer Music Association, Coral Gables, Florida, USA, 8.
[18]
Robert H. Jack, Adib Mehrabi, Tony Stockman, and Andrew McPherson. 2018. Action-sound Latency and the Perceived Quality of Digital Musical Instruments - Comparing Professional Percussionists and Amateur Musicians. Music Perception 36, 1 (Sept. 2018), 109–128. https://doi.org/10.1525/mp.2018.36.1.109
[19]
Robert H. Jack, Tony Stockman, and Andrew McPherson. 2016. Effect of latency on performer interaction and subjective quality assessment of a digital musical instrument. In Proceedings of the Audio Mostly 2016. ACM, Norrköping Sweden, 116–123. https://doi.org/10.1145/2986416.2986428
[20]
Ricardo Jota, Albert Ng, Paul Dietz, and Daniel Wigdor. 2013. How fast is fast enough? a study of the effects of latency in direct-touch pointing tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’13). Association for Computing Machinery, New York, NY, USA, 2291–2300. https://doi.org/10.1145/2470654.2481317
[21]
Topi Kaaresoja, Stephen Brewster, and Vuokko Lantz. 2014. Towards the Temporally Perfect Virtual Button: Touch-Feedback Simultaneity and Perceived Quality in Mobile Touchscreen Press Interactions. ACM Transactions on Applied Perception 11, 2 (July 2014), 1–25. https://doi.org/10.1145/2611387
[22]
Nelson Posse Lago and Fabio Kon. 2004. The Quest for Low Latency: 30th International Computer Music Conference, ICMC 2004. International Computer Music Conference, ICMC Proceedings (2004). http://www.scopus.com/inward/record.url?scp=85105778604&partnerID=8YFLogxK
[23]
Michael Lester and Jon Boley. 2007. The Effects of Latency on Live Sound Monitoring. Audio Engineering Society. https://www.aes.org/e-lib/browse.cfm?elib=14256
[24]
A. W. Mills. 1960. Lateralization of High‐Frequency Tones. The Journal of the Acoustical Society of America 32, 1 (Jan. 1960), 132–134. https://doi.org/10.1121/1.1907864
[25]
Teemu Mäki-Patola. 2005. Musical Effects of Latency. Musical Effects of Latency Suomen musiikintutkijoiden symposiumin satoa (2005), 82–85.
[26]
Daniel Müllensiefen, Bruno Gingras, Jason Musil, and Lauren Stewart. 2014. The Musicality of Non-Musicians: An Index for Assessing Musical Sophistication in the General Population. PLOS ONE 9, 2 (Feb. 2014), e89642. https://doi.org/10.1371/journal.pone.0089642 Publisher: Public Library of Science.
[27]
Ruijing Ning, Samuel J. Trosman, Andrew T. Sabin, and Beverly A. Wright. 2019. Perceptual-learning evidence for inter-onset-interval- and frequency-specific processing of fast rhythms. Attention, Perception, & Psychophysics 81, 2 (Feb. 2019), 533–542. https://doi.org/10.3758/s13414-018-1631-7
[28]
R. A. Rasch. 1979. Synchronization in Performed Ensemble Music. Acta Acustica united with Acustica 43, 2 (Sept. 1979), 121–131.
[29]
A. A. Sawchuk, E. Chew, R. Zimmermann, C. Papadopoulos, and C. Kyriakakis. 2003. From remote media immersion to Distributed Immersive Performance. In Proceedings of the 2003 ACM SIGMM workshop on Experiential telepresence(ETP ’03). Association for Computing Machinery, New York, NY, USA, 110–120. https://doi.org/10.1145/982484.982506
[30]
Andreas Schmid, David Halbhuber, Thomas Fischer, Raphael Wimmer, and Niels Henze. 2023. Small Latency Variations Do Not Affect Player Performance in First-Person Shooters. Proceedings of the ACM on Human-Computer Interaction 7, CHI PLAY (Oct. 2023), 381:197–381:216. https://doi.org/10.1145/3611027
[31]
Nathan Schuett. 2002. The Effects of Latency on Ensemble Performance. (May 2002), 56.
[32]
Laurent S. Simon, Arthur Vimond, and Emmanuel Vincent. 2013. Effects of audio latency in a disc jockey interface. Montreal, Canada, 035037. https://doi.org/10.1121/1.4800187
[33]
Martin Taylor and Douglas Creelman. 1967. PEST: Efficient Estimates on Probability Functions. The Journal of the Acoustical Society of America 41 (April 1967), 782–787. https://doi.org/10.1121/1.1910407
[34]
Pekcan Ungan and Suha Yagcioglu. 2014. Significant variations in Weber fraction for changes in inter-onset interval of a click train over the range of intervals between 5 and 300 ms. Frontiers in Psychology 5 (Dec. 2014). https://doi.org/10.3389/fpsyg.2014.01453
[35]
Raphael Wimmer, Andreas Schmid, and Florian Bockes. 2019. On the Latency of USB-Connected Input Devices. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300650
Index Terms
- Measuring the Just Noticeable Difference for Audio Latency
Recommendations
Survey of visual just noticeable difference estimation
The concept of just noticeable difference (JND), which accounts for the visibility threshold (visual redundancy) of the human visual system, is useful in perception-oriented signal processing systems. In this work, we present a comprehensive review of ...
Fine-grained latency and loss measurements in the presence of reordering
SIGMETRICS '11: Proceedings of the ACM SIGMETRICS joint international conference on Measurement and modeling of computer systemsModern trading and cluster applications require microsecond latencies and almost no losses in data centers. This paper introduces an algorithm called FineComb that can estimate fine-grain end-to-end loss and latency measurements between edge routers in ...
Fine-grained latency and loss measurements in the presence of reordering
Performance evaluation reviewModern trading and cluster applications require microsecond latencies and almost no losses in data centers. This paper introduces an algorithm called FineComb that can estimate fine-grain end-to-end loss and latency measurements between edge routers in ...
Comments
Information & Contributors
Information
Published In
September 2024
565 pages
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 18 September 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
AM '24
Acceptance Rates
Overall Acceptance Rate 177 of 275 submissions, 64%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 347Total Downloads
- Downloads (Last 12 months)347
- Downloads (Last 6 weeks)160
Reflects downloads up to 11 Feb 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in