research-article

Supporting medical conversations between deaf and hearing individuals with tabletop displays

Authors:

Anne Marie Piper,

James D. HollanAuthors Info & Claims

CSCW '08: Proceedings of the 2008 ACM conference on Computer supported cooperative work

Pages 147 - 156

https://doi.org/10.1145/1460563.1460587

Published: 08 November 2008 Publication History

Abstract

This paper describes the design and evaluation of Shared Speech Interface (SSI), an application for an interactive multitouch tabletop display designed to facilitate medical conversations between a deaf patient and a hearing, non-signing physician. We employ a participatory design process involving members of the deaf community as well as medical and communication experts. We report results from an evaluation that compares conversation when facilitated by: (1) a digital table, (2) a human sign language interpreter, and (3) both a digital table and an interpreter. Our research reveals that tabletop displays have valuable properties for facilitating discussion between deaf and hearing individuals as well as enhancing privacy and independence. The contributions of this work include initial guidelines for cooperative group work technology for users with varying hearing abilities, discussion of benefits of participatory design with the deaf community, and lessons about using dictated speech on shared displays.

References

[1]

Cavender, A., Ladner, R., Riskin, E. MobileASL: intelligibility of sign language video as constrained by mobile phone technology. Proceedings of ASSETS 2006, 71--78.

Digital Library

[2]

Clark, H. (2003). Pointing and Placing. In "Pointing: Where Language, Culture, and Cognition Meet." Edited by Sotaro Kita. Mihwah, NJ: Lawrence Erlbaum Associates, pp. 243--68.

[3]

CloudGarden. 2008. http://www.cloudgarden.com/

[4]

Dietz, P. and Leigh, D. DiamondTouch: A Multi-User Touch Technology. Proceedings of UIST 2001, 219--226.

Digital Library

[5]

Dragon NaturallySpeaking Medical. 2008. www.nuance.com/dictaphone/emr

[6]

Fischer, G. and Sullivan, J. Human-centered public transportation systems for persons with cognitive disabilities -- Challenges and insights for participatory design. Proceedings of the Participatory Design Conference 2002, 194--198.

[7]

iCommunicator. 2008. www.myicommunicator.com

[8]

Java Speech API. 2008. java.sun.com/products/java-media/speech

[9]

Jefferson, G. (2004). Glossary of Transcript Symbols with an Introduction. In "Conversation Analysis: Studies from the First Generation." Jesse Benjamins Publishing Company, pp. 13--32.

[10]

Matthews, T., Carter, S., Pai, C., Fong, J., Mankoff, J. Scribe4Me: Evaluating a mobile sound transcription tool for the deaf. Proceedings of UbiComp 2006, 159--176.

Digital Library

[11]

Matthews, M., Fong, J, Mankoff, J. Visualizing non-speech sounds for the deaf. Proceedings of ASSETS 2005, 52--59.

Digital Library

[12]

McNeill, D. (1992). Hand & Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.

[13]

Miller, D., Gyllstrom, K., Stotts, D., Culp, J. Semi-transparent video interfaces to assist deaf persons in meetings. ACM Southeast Regional Conference 2007: 501--506.

Digital Library

[14]

Moffatt, K., McGrenere, J., Purves, B., Klawe, M., The participatory design of a sound and image enhanced daily planner for people with aphasia. Proceedings of CHI 2004, 407--414.

Digital Library

[15]

Morris, M. R., Morris, D., and Winograd, T. Individual Audio Channels with Single Display Groupware: Effects on Communication and Task Strategy. Proceedings of CSCW 2004, 242--251.

Digital Library

[16]

Morris, M. R., Ryall, K., Shen, C., Forlines, C., and Vernier, F. Beyond "Social Protocols": Multi-User Coordination Policies for Co-located Groupware. Proceedings of CSCW 2004, 262--265.

Digital Library

[17]

NIDCD. 2008. www.nidcd.nih.gov/health/hearing

[18]

Piper, A. M., O'Brien, E., Morris, M. R., and Winograd, T. SIDES: A Cooperative Tabletop Computer Game for Social Skills Development. Proceedings of CSCW 2006, 1--10.

Digital Library

[19]

Ringel, M., Ryall, K., Shen, C., Forlines, C., and Vernier, F. Release, Relocate, Reorient, Resize: Fluid Techniques for Document Sharing on Multi-User Interactive Tables. Proceedings of CHI 2004, 1441--1444.

Digital Library

[20]

Schuler, D., and Namioka, A. (Eds.) (1993). Participatory Design: Principles and Practices. Hillsdale, NJ: Lawrence Erlbaum Assoc.

Digital Library

[21]

Schull, J. An extensible, scalable browser-based architecture for synchronous and asynchronous communication and collaboration systems for deaf and hearing individuals. Proceedings of ASSETS 2006, 285--286.

Digital Library

[22]

Scott, S. D., Carpendale, M. S. T., and Inkpen, K. Territoriality in Collaborative Tabletop Workspaces. Proceedings of CSCW 2004, 294--303.

Digital Library

[23]

Shen, C., Vernier, F., Forlines, C., and Ringel, M. DiamondSpin: An Extensible Toolkit for Around-the-Table Interaction. Proceedings of CHI 2004, 167--174.

Digital Library

[24]

Starner, T., J. Weaver, and A. Pentland, A Wearable Computing Based American Sign Language Recognizer. In Personal and Ubiquitous Computing, Volume 1 (4), 1997.

[25]

Tse, E., Greenberg, S., Shen, C. and Forlines, C. Multimodal Multiplayer Tabletop Gaming. Proceedings of PerGames 2006, 139--148

[26]

Tse, E., Shen, C., Greenberg, S. and Forlines, C. Enabling Interaction with Single User Applications through Speech and Gestures on a Multi-User Tabletop. Proceedings of AVI 2006, 336--343.

Digital Library

[27]

Turoff, M. 1975. Computerized Conferencing for the Deaf and Handicapped. ACM SIGCAPH Newsletter, Number 16, 1975, pp. 4--11.

Digital Library

Cited By

Choi YLee CChung SCho EYoo SHong J(2025)Enhancing collaborative signing songwriting experience of the d/Deaf individualsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103382193:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103382
Sánchez JFlores-Rivera JPrietch S(2023)Designing a sign language training platform for hearing healthcare personnelProceedings of the XI Latin American Conference on Human Computer Interaction10.1145/3630970.3631057(1-9)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3630970.3631057
Albert SHamann MStokoe E(2023)Conversational User Interfaces in Smart Homecare Interactions: A Conversation Analytic Case StudyProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3597140(1-12)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3597140
Show More Cited By

Index Terms

Supporting medical conversations between deaf and hearing individuals with tabletop displays
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing theory, concepts and paradigms
      1. Computer supported cooperative work
2. Social and professional topics
  1. Professional topics
    1. Computing and business
      1. Computer supported cooperative work

Recommendations

The Impact of Assistive Technology on Communication Quality Between Deaf and Hearing Individuals
CSCW '17: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing

Deaf individuals often experience communication difficulties in face-to-face interactions with hearing people. In order to support deaf individuals in such situations, an active stream of assistive technology (AT) research focuses on real-time ...
An extensible, scalable browser-based architecture for synchronous and asynchronous communication and collaboration systems for deaf and hearing individuals
Assets '06: Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility

To facilitate face-to-face conversation between deaf and hearing team-members, we created a cross-platform, browser-based, persistent-content text-as-you-type system that aggregates each individual's utterances in revisable personal notes on a ...
Is Deafness a Disability?: Designing Hearing Aids Beyond Functionality
C&C '19: Proceedings of the 2019 Conference on Creativity and Cognition

The question whether deafness is a disability causes controversial and emotionally charged debates. The experience of hearing loss is different from the experience of being born deaf, as well as the need and willingness of using hearing aids. Following ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '08: Proceedings of the 2008 ACM conference on Computer supported cooperative work

November 2008

752 pages

ISBN:9781605580074

DOI:10.1145/1460563

General Chairs:
Bo Begole
PARC, USA
,
David W. McDonald
University of Washington, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CSCW08

Sponsor:

CSCW08: Computer Supported Cooperative Work

November 8 - 12, 2008

CA, San Diego, USA

Acceptance Rates

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

CSCW '25

Sponsor:
sigchi

Computer-Supported Cooperative Work and Social Computing

October 18 - 22, 2025

Bergen , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

50
Total Citations
View Citations
1,147
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)4

Reflects downloads up to 20 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Choi YLee CChung SCho EYoo SHong J(2025)Enhancing collaborative signing songwriting experience of the d/Deaf individualsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103382193:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103382
Sánchez JFlores-Rivera JPrietch S(2023)Designing a sign language training platform for hearing healthcare personnelProceedings of the XI Latin American Conference on Human Computer Interaction10.1145/3630970.3631057(1-9)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3630970.3631057
Albert SHamann MStokoe E(2023)Conversational User Interfaces in Smart Homecare Interactions: A Conversation Analytic Case StudyProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3597140(1-12)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3597140
Tang XChang XChen NNi YLC RTong X(2023)Community-Driven Information Accessibility: Online Sign Language Content Creation within d/Deaf CommunitiesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581286(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581286
Mathew RDannels WParker A(2023)An Augmented Reality Based Approach for Optimization of Language Access Services in Healthcare for Deaf PatientsUniversal Access in Human-Computer Interaction10.1007/978-3-031-35897-5_3(29-52)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35897-5_3
Wu YDing XDai XZhang PLu TGu N(2022)Alignment Work for Urban Accessibility: A Study of How Wheelchair Users Travel in Urban SpacesProceedings of the ACM on Human-Computer Interaction10.1145/35551656:CSCW2(1-22)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555165
Bleakley ARough DRoper ALindsay SPorcheron MLee MNicholson SCowan BClark L(2022)Exploring Smart Speaker User Experience for People Who StammerProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3544823(1-10)Online publication date: 23-Oct-2022
https://dl.acm.org/doi/10.1145/3517428.3544823
Chang PTucker R(2022)Assistive Communication Technologies and Stigma: How Perceived Visibility of Cochlear Implants Affects Self-Stigma and Social Interaction AnxietyProceedings of the ACM on Human-Computer Interaction10.1145/35129246:CSCW1(1-16)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512924
Bai ZCodick ETenesaca AHu WYu XHao PKurumada CHall W(2022)Signing-on-the-Fly: Technology Preferences to Reduce Communication Gap between Hearing Parents and Deaf ChildrenProceedings of the 21st Annual ACM Interaction Design and Children Conference10.1145/3501712.3529741(26-36)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3501712.3529741
Seita MLee SAndrew SShinohara KHuenerfauth M(2022)Remotely Co-Designing Features for Communication Applications using Automatic Captioning with Deaf and Hearing PairsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501843(1-13)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501843
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten