PokerFace Mask: Exploring Augmenting Masks with Captions through an Interactive, Mixed-Reality Prototype
PokerFace Mask: Exploring Augmenting Masks with Captions through an Interactive, Mixed-Reality Prototype
Files
Date
2022-01-04
Authors
Davis, Josh
Contributor
Advisor
Department
Instructor
Depositor
Speaker
Researcher
Consultant
Interviewer
Annotator
Journal Title
Journal ISSN
Volume Title
Publisher
Volume
Number/Issue
Starting Page
Ending Page
Alternative Title
Abstract
The COVID-19 pandemic in early 2020 made masks a daily wearable for personal protective equipment as a public health precaution. Traditional mask designs obscure communication by obstructing the face and muffling the voice which can make communication especially difficult for users who are deaf or hard of hearing (DHH). PokerFace uses a commodity smartphone and recycled materials to display a live-stream of a user’s mouth and nose on the mask surface. This maintains the safety precautions afforded by the mask, while mitigating the obfuscation of traditional mask designs. To compare PokerFace’s ability to facilitate communication with traditional masks, we conducted a user study with 18 participants, who played a collaborative communication game similar to charades. Participants performed better at this collaborative communication task with our prototype than with traditional masks, and even non-DHH users became aware of the importance of lip-reading and facial cues in communication due to study participation.
Description
Keywords
Mediated Conversation,
accessibility,
collaborative and social computing devices,
human-centered computing,
masks,
mixed-reality
Citation
Extent
11 pages
Format
Geographic Location
Time Period
Related To
Proceedings of the 55th Hawaii International Conference on System Sciences
Table of Contents
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International
Rights Holder
Local Contexts
Collections
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.