poster

Near-Gaze Visualisations of Empathic Communication Cues in Mixed Reality Collaboration

Authors:

Allison Jing,

Kunal Gupta,

Jeremy McDade,

Gun Lee,

Mark BillinghurstAuthors Info & Claims

SIGGRAPH '22: ACM SIGGRAPH 2022 Posters

Article No.: 29, Pages 1 - 2

https://doi.org/10.1145/3532719.3543213

Published: 25 July 2022 Publication History

Get Access

Abstract

In this poster, we present a live 360° panoramic-video based empathic Mixed Reality (MR) collaboration system that shares various Near-Gaze non-verbal communication cues including gaze, hand pointing, gesturing, and heart rate visualisations in real-time. The preliminary results indicate that the interface with the partner’s communication cues visualised close to the gaze point allows users to focus without dividing attention to the collaborator’s physical body movements yet still effectively communicate. Shared gaze visualisations coupled with deictic languages are primarily used to affirm joint attention and mutual understanding, while hand pointing and gesturing are used as secondary. Our approach provides a new way to help enable effective remote collaboration through varied empathic communication visualisations and modalities which covers different task properties and spatial setups.

References

[1]

Allison Jing, Brandon Matthews, Mark Billinghurst, Kieran May, Thomas Clarke, Gun Lee, and Mark Billinghurst. 2021a. EyemR-Talk: Using Speech to Visualise Shared MR Gaze Cues. In SIGGRAPH Asia 2021 Posters(SA ’21 Posters). Association for Computing Machinery, New York, NY, USA, 6–7. https://doi.org/10.1145/3476124.3488618

Digital Library

Google Scholar

[2]

Allison Jing, Kieran William May, Mahnoor Naeem, Gun Lee, Mark Billinghurst, Mahnoor Naeem, Gun Lee, and Mark Billinghurst. 2021b. EyemR-Vis: Using Bi-Directional Gaze Behavioural Cues to Improve Mixed Reality Remote Collaboration. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems(CHI EA ’21). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3411763.3451844

Digital Library

Google Scholar

Cited By

View all

Lee SKim JLee J(2023)Effects of Reward Schedule and Avatar Visibility on Joint Agency During VR CollaborationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332022129:11(4372-4382)Online publication date: 3-Oct-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320221
Jing AFrederick MSewell MKarlson ASimpson BSmith M(2023)How Visualising Emotions Affects Interpersonal Trust and Task Collaboration in a Shared Virtual Space2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00100(849-858)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00100
Jing AGupta KMcDade JLee GBillinghurst M(2022)Comparing Gaze-Supported Modalities with Empathic Mixed Reality Interfaces in Remote Collaboration2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00102(837-846)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00102

Recommendations

eyemR-Vis: A Mixed Reality System to Visualise Bi-Directional Gaze Behavioural Cues Between Remote Collaborators
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

This demonstration shows eyemR-Vis, a 360 panoramic Mixed Reality collaboration system that translates gaze behavioural cues to bi-directional visualisations between a local host (AR) and a remote collaborator (VR). The system is designed to share ...
eyemR-Vis: Using Bi-Directional Gaze Behavioural Cues to Improve Mixed Reality Remote Collaboration
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

Gaze is one of the most important communication cues in face-to-face collaboration. However, in remote collaboration, sharing dynamic gaze information is more difficult. In this research, we investigate how sharing gaze behavioural cues can improve ...
A User Study on Mixed Reality Remote Collaboration with Eye Gaze and Hand Gesture Sharing
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Supporting natural communication cues is critical for people to work together remotely and face-to-face. In this paper we present a Mixed Reality (MR) remote collaboration system that enables a local worker to share a live 3D panorama of his/her ...

Comments

Information & Contributors

Information

Published In

SIGGRAPH '22: ACM SIGGRAPH 2022 Posters

July 2022

132 pages

ISBN:9781450393614

DOI:10.1145/3532719

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 July 2022

Check for updates

Qualifiers

Poster
Research
Refereed limited

Conference

SIGGRAPH '22

Sponsor:

SIGGRAPH

SIGGRAPH '22: Special Interest Group on Computer Graphics and Interactive Techniques Conference

August 7 - 11, 2022

BC, Vancouver, Canada

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
281
Total Downloads

Downloads (Last 12 months)92
Downloads (Last 6 weeks)8

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Lee SKim JLee J(2023)Effects of Reward Schedule and Avatar Visibility on Joint Agency During VR CollaborationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332022129:11(4372-4382)Online publication date: 3-Oct-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320221
Jing AFrederick MSewell MKarlson ASimpson BSmith M(2023)How Visualising Emotions Affects Interpersonal Trust and Task Collaboration in a Shared Virtual Space2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00100(849-858)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00100
Jing AGupta KMcDade JLee GBillinghurst M(2022)Comparing Gaze-Supported Modalities with Empathic Mixed Reality Interfaces in Remote Collaboration2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00102(837-846)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00102

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Recommendations

eyemR-Vis: A Mixed Reality System to Visualise Bi-Directional Gaze Behavioural Cues Between Remote Collaborators

eyemR-Vis: Using Bi-Directional Gaze Behavioural Cues to Improve Mixed Reality Remote Collaboration

A User Study on Mixed Reality Remote Collaboration with Eye Gaze and Hand Gesture Sharing

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations