abstract

Empathy Glasses

Authors:

Katsutoshi Masai,

Mark BillinghurstAuthors Info & Claims

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Pages 1257 - 1263

https://doi.org/10.1145/2851581.2892370

Published: 07 May 2016 Publication History

Abstract

In this paper, we describe Empathy Glasses, a head worn prototype designed to create an empathic connection between remote collaborators. The main novelty of our system is that it is the first to combine the following technologies together: (1) wearable facial expression capture hardware, (2) eye tracking, (3) a head worn camera, and (4) a see-through head mounted display, with a focus on remote collaboration. Using the system, a local user can send their information and a view of their environment to a remote helper who can send back visual cues on the local user's see-through display to help them perform a real world task. A pilot user study was conducted to explore how effective the Empathy Glasses were at supporting remote collaboration. We describe the implications that can be drawn from this user study.

References

[1]

Heinz L Ansbacher and Rowena R Ansbacher. 1956. The individual psychology of Alfred Adler. (1956).

[2]

Martin Bauer, Gerd Kortuem, and Zary Segall. 1999. "Where Are You Pointing At?" A Study of Remote Collaboration in a Wearable Video conference System. In Proceedings of the 3rd IEEE International Symposium on Wearable Computers (ISWC '99). IEEE Computer Society, Washington, DC, USA, 151-. http://dl.acm.org/citation.cfm?id=519309.856501

Digital Library

[3]

R.A. Calvo and S. D'Mello. 2010. Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications. Affective Computing, IEEE Transactions on 1, 1 (Jan 2010), 18-37.

Digital Library

[4]

EPSON. 2014. Moverio BT-200. Website. (2014). http://www.epson.com/moverio

[5]

Susan R. Fussell, Robert E. Kraut, and Jane Siegel. 2000. Coordination of Communication: Effects of Shared Visual Context on Collaborative Work. In Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work (CSCW '00). ACM, New York, NY, USA, 21-30.

Digital Library

[6]

Susan R. Fussell, Leslie D. Setlock, and Robert E. Kraut. 2003. Effects of Head-mounted and Scene-oriented Video Systems on Remote Collaboration on Physical Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 513-520.

Digital Library

[7]

Anders Henrysson, Mark Billinghurst, and Mark Ollila. 2005. Face to Face Collaborative AR on Mobile Phones. In Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR '05). IEEE Computer Society, Washington, DC, USA, 80-89.

Digital Library

[8]

Moritz Kassner, William Patera, and Andreas Bulling. 2014. Pupil: An Open Source Platform for Pervasive Eye Tracking and Mobile Gaze-based Interaction. (April 2014). http://arxiv.org/abs/1405.0006

Digital Library

[9]

Katsutoshi Masai, Yuta Sugiura, Masa Ogata, Katsuhiro Suzuki, Fumihiko Nakamura, Sho Shimamura, Kai Kunze, Masahiko Inami, and Maki Sugimoto. 2015. Affective Wear: Toward Recognizing Facial Expression. In ACM SIGGRAPH 2015 Emerging Technologies (SIGGRAPH '15). ACM, New York, NY, USA, Article 4, 1 pages.

Digital Library

[10]

G Molinari, G Chanel, M Bétrancourt, T Pun, and C Bozelle. 2013. Emotion Feedback during Computer-Mediated Collaboration: Effects on Self-Reported Emotions and Perceived Interaction. In 10th International Conference on Computer Supported Collaborative Learning. Madison, Wisconsin, USA.

[11]

Rosalind W. Picard. 1997. Affective Computing. MIT Press, Cambridge, MA, USA.

[12]

Eva-Lotta Sallnäs. 2005. Effects of communication mode on social presence, virtual presence, and performance in collaborative virtual environments. Presence - Teleoperators and Virtual Environments 14, 4 (2005), 434-449. QC 20100630.

Digital Library

[13]

Splashtop. 2015. Splashtop. Website. (2015). http://www.splashtop.com/personal

[14]

Chiew Seng Sean Tan, Kris Luyten, Jan Van Den Bergh, Johannes Schöning, and Karin Coninx. 2014. The Role of Physiological Cues During Remote Collaboration. Presence: Teleoper. Virtual Environ. 23, 1 (Feb. 2014), 90-107.

Digital Library

[15]

Ulises Xolocotzin Eligio, Shaaron E. Ainsworth, and Charles K. Crook. 2012. Emotion Understanding and Performance During Computer-supported Collaboration. Comput. Hum. Behav. 28, 6 (Nov. 2012), 2046- 2054.

Digital Library

Cited By

Assaf RMendes DRodrigues R(2024)Cues to fast‐forward collaboration: A Survey of Workspace Awareness and Visual Cues in XR Collaborative SystemsComputer Graphics Forum10.1111/cgf.1506643:2Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15066
Huang WBillinghurst MAlem LXiao CRasmussen T(2024)Communicating Eye Gaze Cues in Remote Collaboration on Physical TasksComputer‐Supported Collaboration10.1002/9781119719830.ch5(115-142)Online publication date: 24-May-2024
https://doi.org/10.1002/9781119719830.ch5
Huang WBillinghurst MAlem LXiao CRasmussen T(2024)Communication Cues in Augmented Remote CollaborationComputer‐Supported Collaboration10.1002/9781119719830.ch3(41-80)Online publication date: 24-May-2024
https://doi.org/10.1002/9781119719830.ch3
Show More Cited By

Index Terms

Empathy Glasses
1. Human-centered computing

Recommendations

A User Study on Mixed Reality Remote Collaboration with Eye Gaze and Hand Gesture Sharing
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Supporting natural communication cues is critical for people to work together remotely and face-to-face. In this paper we present a Mixed Reality (MR) remote collaboration system that enables a local worker to share a live 3D panorama of his/her ...
Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

We present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures ...
CoVAR: a collaborative virtual and augmented reality system for remote collaboration
SA '17: SIGGRAPH Asia 2017 Emerging Technologies

We present CoVAR, a novel remote collaborative system combining Augmented Reality (AR), Virtual Reality (VR) and natural communication cues to create new types of collaboration. AR user can capture and share their local environment with a remote user in ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

May 2016

3954 pages

ISBN:9781450340823

DOI:10.1145/2851581

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Check for updates

Author Tags

Qualifiers

Abstract

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI EA '16 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
974
Total Downloads

Downloads (Last 12 months)49
Downloads (Last 6 weeks)7

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Assaf RMendes DRodrigues R(2024)Cues to fast‐forward collaboration: A Survey of Workspace Awareness and Visual Cues in XR Collaborative SystemsComputer Graphics Forum10.1111/cgf.1506643:2Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15066
Huang WBillinghurst MAlem LXiao CRasmussen T(2024)Communicating Eye Gaze Cues in Remote Collaboration on Physical TasksComputer‐Supported Collaboration10.1002/9781119719830.ch5(115-142)Online publication date: 24-May-2024
https://doi.org/10.1002/9781119719830.ch5
Huang WBillinghurst MAlem LXiao CRasmussen T(2024)Communication Cues in Augmented Remote CollaborationComputer‐Supported Collaboration10.1002/9781119719830.ch3(41-80)Online publication date: 24-May-2024
https://doi.org/10.1002/9781119719830.ch3
Alrimawi FNuseibeh B(2023)Requirements for Designing Kind Spaces2023 IEEE 31st International Requirements Engineering Conference Workshops (REW)10.1109/REW57809.2023.00013(36-41)Online publication date: Sep-2023
https://doi.org/10.1109/REW57809.2023.00013
Jing AFrederick MSewell MKarlson ASimpson BSmith M(2023)How Visualising Emotions Affects Interpersonal Trust and Task Collaboration in a Shared Virtual Space2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00100(849-858)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00100
Bataille GLammini AChardonnet J(2023)ARPuzzle: Evaluating the Effectiveness of Collaborative Augmented Reality2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00079(642-651)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00079
Daher KSaad DMugellini ELalanne DAbou Khaled O(2022)Empathic and Empathetic Systematic Review to Standardize the Development of Reliable and Sustainable Empathic SystemsSensors10.3390/s2208304622:8(3046)Online publication date: 15-Apr-2022
https://doi.org/10.3390/s22083046
Schäfer AReis GStricker D(2022)A Survey on Synchronous Augmented, Virtual, andMixed Reality Remote Collaboration SystemsACM Computing Surveys10.1145/353337655:6(1-27)Online publication date: 7-Dec-2022
https://dl.acm.org/doi/10.1145/3533376
Nicholas MSmith BVaish R(2022)Friendscope: Exploring In-the-Moment Experience Sharing on Camera Glasses via a Shared CameraProceedings of the ACM on Human-Computer Interaction10.1145/35129036:CSCW1(1-25)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512903
Plopski AHirzle TNorouzi NQian LBruder GLanglotz T(2022)The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended RealityACM Computing Surveys10.1145/349120755:3(1-39)Online publication date: 25-Mar-2022
https://dl.acm.org/doi/10.1145/3491207
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents