Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3534086.3534337acmconferencesArticle/Chapter ViewAbstractPublication PagesmmsysConference Proceedingsconference-collections
short-paper

Exploring non-verbal cues and user attention in IVR with eye tracking technologies

Published: 11 July 2022 Publication History

Abstract

This study is a between-groups preliminary evaluation of how Non-Verbal Cues (NVCs) impact participant attention and degree of social presence with an NPC. Participants are divided in two groups and witness an agent's monologue who features high-fidelity NVCs (motion-captured gaze, blinking, and lower facial expressions) in one group, but who has those "turned off" for the other. This study aims at establishing appropriate data collection methodology and scenario-related guidelines for follow-up experimentation with a higher volume of interaction variables, particularly real-time interaction between remotely located users. Initial results indicate that real-time tracked NVCs enhance engagement and social presence to variant degrees compared to low-fidelity automated cues.

References

[1]
Roth, D., G. Bente, P. Kullmann, D. Mal, C.F. Purps, K. Vogeley, and M.E. Latoschik. Technologies for social augmentations in user-embodied virtual reality. in 25th ACM Symposium on Virtual Reality Software and Technology. 2019.
[2]
Dzardanova, E., V. Kasapakis, D. Gavalas, and S. Sylaiou, Virtual reality as a communication medium: a comparative study of forced compliance in virtual reality versus physical world. Virtual Reality, 2021: p. 1--21.
[3]
Geraets, C., S.K. Tuente, B. Lestestuiver, M. van Beilen, S. Nijman, J. Marsman, and W. Veling, Virtual reality facial emotion recognition in social environments: An eye-tracking study. Internet interventions, 2021. 25: p. 100432.
[4]
Dong, Y., S. Jörg, and E. Jain, Is the avatar scared? Pupil as a perceptual cue. Computer Animation and Virtual Worlds, 2022: p. e2040.
[5]
Rivu, R., K. Pfeuffer, P. Muller, Y. Abdelrahman, A. Bulling, and F. Alt. Altering Non-verbal Cues to Implicitly Direct Attention in Social VR. in Symposium on Spatial User Interaction. 2021.
[6]
Volonte, M., Y.-C. Hsu, K.-Y. Liu, J.P. Mazer, S.-K. Wong, and S.V. Babu. Effects of interacting with a crowd of emotional virtual humans on users' affective and non-verbal behaviors. in 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 2020. IEEE.
[7]
Koskela, T., M. Mazouzi, P. Alavesa, M. Pakanen, I. Minyaev, E. Paavola, and J. Tuliniemi. Avatarex: telexistence system based on virtual avatars. in Proceedings of the 9th Augmented Human International Conference. 2018.
[8]
Short, J., E. Williams, and B. Christie, The social psychology of telecommunications. 1976: Toronto; London; New York: Wiley.

Cited By

View all
  • (2023)Depressed Virtual AgentsProceedings of the 23rd ACM International Conference on Intelligent Virtual Agents10.1145/3570945.3607306(1-3)Online publication date: 19-Sep-2023
  • (2022)Nonverbal Communication in Immersive Virtual Reality through the Lens of Presence: A Critical ReviewPRESENCE: Virtual and Augmented Reality10.1162/pres_a_0038731(147-187)Online publication date: 1-Dec-2022

Index Terms

  1. Exploring non-verbal cues and user attention in IVR with eye tracking technologies

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MMVE '22: Proceedings of the 14th International Workshop on Immersive Mixed and Virtual Environment Systems
    June 2022
    59 pages
    ISBN:9781450393829
    DOI:10.1145/3534086
    • General Chair:
    • Conor Keighrey
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 July 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. attention
    2. eye-tracking
    3. non-verbal cues
    4. virtual reality

    Qualifiers

    • Short-paper

    Funding Sources

    Conference

    MMSys '22

    Acceptance Rates

    Overall Acceptance Rate 26 of 44 submissions, 59%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)33
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 13 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Depressed Virtual AgentsProceedings of the 23rd ACM International Conference on Intelligent Virtual Agents10.1145/3570945.3607306(1-3)Online publication date: 19-Sep-2023
    • (2022)Nonverbal Communication in Immersive Virtual Reality through the Lens of Presence: A Critical ReviewPRESENCE: Virtual and Augmented Reality10.1162/pres_a_0038731(147-187)Online publication date: 1-Dec-2022

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media