Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3136755.3136804acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

The relationship between task-induced stress, vocal changes, and physiological state during a dyadic team task

Published: 03 November 2017 Publication History

Abstract

It is commonly known that a relationship exists between the human voice and various emotional states. Past studies have demonstrated changes in a number of vocal features, such as fundamental frequency f0 and peakSlope, as a result of varying emotional state. These voice characteristics have been shown to relate to emotional load, vocal tension, and, in particular, stress. Although much research exists in the domain of voice analysis, few studies have assessed the relationship between stress and changes in the voice during a dyadic team interaction. The aim of the present study was to investigate the multimodal interplay between speech and physiology during a high-workload, high-stress team task. Specifically, we studied task-induced effects on participants' vocal signals, specifically, the f0 and peakSlope features, as well as participants' physiology, through cardiovascular measures. Further, we assessed the relationship between physiological states related to stress and changes in the speaker's voice. We recruited participants with the specific goal of working together to diffuse a simulated bomb. Half of our sample participated in an "Ice Breaker" scenario, during which they were allowed to converse and familiarize themselves with their teammate prior to the task, while the other half of the sample served as our "Control". Fundamental frequency (f0), peakSlope, physiological state, and subjective stress were measured during the task. Results indicated that f0 and peakSlope significantly increased from the beginning to the end of each task trial, and were highest in the last trial, which indicates an increase in emotional load and vocal tension. Finally, cardiovascular measures of stress indicated that the vocal and emotional load of speakers towards the end of the task mirrored a physiological state of psychological "threat".

References

[1]
Miriam Rose Bonner. 1943. Changes in the speech pattern under emotional tension. The American Journal of Psychology 56, 2 (1943), 262–273.
[2]
Joyce E Bono, Theresa M Glomb, Winny Shen, Eugene Kim, and Amanda J Koch. 2013. Building positive resources: Effects of positive events and positive reflection on work stress and health. Academy of Management Journal 56, 6 (2013), 1601–1627.
[3]
G. Degottex, J. Kane, T. Drugman, T. Raitio, and S. Scherer. 2014. COVAREP - A collaborative voice analysis repository for speech technologies. In Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. 960–964.
[4]
Paul Ekman, Wallach V Friesen, and Klaus R Scherer. 1976. Body movement and voice pitch in deceptive interaction. Semiotica 16, 1 (1976), 23–28.
[5]
Christer Gobl, Ailbhe NıÌĄ, et al. 2003. The role of voice quality in communicating emotion, mood and attitude. Speech communication 40, 1 (2003), 189–212.
[6]
Michael HL Hecker, Kenneth N Stevens, Gottfried von Bismarck, and Carl E Williams. 1968. Manifestations of Task-Induced Stress in the Acoustic Speech Signal. The Journal of the Acoustical Society of America 44, 4 (1968), 993–1001.
[7]
J. Kane and C. Gobl. 2011. Identifying Regions of Non-Modal Phonation Using Features of the Wavelet Transform. In INTERSPEECH. 177–180.
[8]
I Kuroda, O Fujiwara, N Okamura, and N Utsuki. 1976. Method for determining pilot stress through analysis of voice communication. Aviation, Space, and Environmental Medicine (1976).
[9]
Anne-Maria Laukkanen, Erkki Vilkman, Paavo Alku, and Hanna Oksanen. 1996. Physical variations related to stress and emotional state: a preliminary study. Journal of Phonetics 24, 3 (1996), 313–335.
[10]
Gerald Matthews. 2000. Human performance: Cognition, stress, and individual differences. Psychology Press.
[11]
Gerald Matthews, Sian E Campbell, Shona Falconer, Lucy A Joyner, Jane Huggins, Kirby Gilliland, Rebecca Grier, and Joel S Warm. 2002. Fundamental dimensions of subjective state in performance settings: task engagement, distress, and worry. Emotion 2, 4 (2002), 315.
[12]
Catherine Neubauer, Joshua Woolley, Peter Khooshabeh, and Stefan Scherer. 2016. Getting to know you: a multimodal investigation of team behavior and resilience to stress. In Proceedings of the 18th ACM International Conference on Multimodal Interaction. ACM, 193–200.
[13]
Robert Orlikoff. The relationship of age and cardiovascular health to certain acoustic characteristics of male voices. 33 (????), 450–457.
[14]
Leonard Rubenstein. 1966. Electro-acoustical measurement of vocal responses to limited stress. Behaviour research and therapy 4, 1 (1966), 135–138.
[15]
Klaus R Scherer. 1979. Nonlinguistic Vocal Indicators of Emotion. in Emotions in Personality and Psychopathology (1979).
[16]
Klaus R Scherer. 1981. Vocal indicators of stress. Speech evaluation in psychiatry (1981), 171–187.
[17]
Klaus R Scherer, D Robert Ladd, and Kim EA Silverman. 1984. Vocal cues to speaker affect: Testing two models. The Journal of the Acoustical Society of America 76, 5 (1984), 1346–1356.
[18]
KN Stevens and CE Williams. 1969. On determining the emotional state of pilots during flight-An exploratory study(Pilot emotional state during stressful situations from tape recorded vocal utterances of air to ground radio communications using spectrographic analysis). Aerospace Medicine 40 (1969), 1369–1372.
[19]
Lynn A Streeter, Robert M Krauss, Valerie Geller, Christopher Olson, and William Apple. 1977. Pitch changes during attempted deception. Journal of personality and social psychology 35, 5 (1977), 345.
[20]
Kathleen M Sutcliffe and Timothy J Vogus. 2003. Organizing for resilience. Positive organizational scholarship (2003), 94–110.
[21]
Joe Tomaka, Jim Blascovich, Jeffrey Kibler, and John M Ernst. 1997. Cognitive and physiological antecedents of threat and challenge appraisal. Journal of personality and social psychology 73, 1 (1997), 63.
[22]
Carl E Williams and Kenneth N Stevens. 1972. Emotions and speech: Some acoustical correlates. The Journal of the Acoustical Society of America 52, 4B (1972), 1238–1250.

Cited By

View all
  • (2021)Using Recurrence Quantification Analysis to Quantify the Physiological Synchrony in Dyadic ECG Data2021 IEEE International Systems Conference (SysCon)10.1109/SysCon48628.2021.9447059(1-8)Online publication date: 15-Apr-2021
  • (2021)Approaches for assessing communication in human-autonomy teamsHuman-Intelligent Systems Integration10.1007/s42454-021-00026-23:2(99-128)Online publication date: 18-Mar-2021
  • (2021)Development of a Neural Network Algorithm to Detect Soldier Load from Environmental SpeechAdvances in Simulation and Digital Human Modeling10.1007/978-3-030-79763-8_7(54-62)Online publication date: 27-Jun-2021
  • Show More Cited By

Index Terms

  1. The relationship between task-induced stress, vocal changes, and physiological state during a dyadic team task

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction
    November 2017
    676 pages
    ISBN:9781450355438
    DOI:10.1145/3136755
    © 2017 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the United States Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 03 November 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Physiological features
    2. Small Group Interaction
    3. Stress
    4. Voice Quality

    Qualifiers

    • Research-article

    Conference

    ICMI '17
    Sponsor:

    Acceptance Rates

    ICMI '17 Paper Acceptance Rate 65 of 149 submissions, 44%;
    Overall Acceptance Rate 453 of 1,080 submissions, 42%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)38
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 30 Aug 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)Using Recurrence Quantification Analysis to Quantify the Physiological Synchrony in Dyadic ECG Data2021 IEEE International Systems Conference (SysCon)10.1109/SysCon48628.2021.9447059(1-8)Online publication date: 15-Apr-2021
    • (2021)Approaches for assessing communication in human-autonomy teamsHuman-Intelligent Systems Integration10.1007/s42454-021-00026-23:2(99-128)Online publication date: 18-Mar-2021
    • (2021)Development of a Neural Network Algorithm to Detect Soldier Load from Environmental SpeechAdvances in Simulation and Digital Human Modeling10.1007/978-3-030-79763-8_7(54-62)Online publication date: 27-Jun-2021
    • (2020)See with Your Eyes, Hear with Your Ears and Listen to Your Heart: Moving from Dyadic Teamwork Interaction towards a More Effective Team Cohesion and Collaboration in Long-Term Spaceflights under Stressful ConditionsBig Data and Cognitive Computing10.3390/bdcc40300184:3(18)Online publication date: 28-Jul-2020
    • (2018)The Multimodal Dataset of Negative Affect and AggressionProceedings of the 20th ACM International Conference on Multimodal Interaction10.1145/3242969.3243013(376-383)Online publication date: 2-Oct-2018

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media