short-paper

Towards one-pixel-displays for sound information visualization

Authors:

Priya Kamlesh Sridhar,

Benjamin Petry,

Pavithren V. S. Pakianathan,

Ardy Samsir Kartolo,

Suranga NanayakkaraAuthors Info & Claims

OzCHI '16: Proceedings of the 28th Australian Conference on Computer-Human Interaction

Pages 91 - 95

https://doi.org/10.1145/3010915.3010980

Published: 29 November 2016 Publication History

Get Access

Abstract

Deaf people or people with a situational auditory disability (e.g. wearing headphones) have limited access to surrounding sounds, such as fire alarms or people approaching them from behind. Prior work has applied sensory substitution to provide information about sound presence, type and direction to deaf people. However, there are many ways to present sound information through an alternative modality. In this paper, we investigated whether a relationship between light behaviour and sound types exists for one-pixel-displays among deaf and hearing persons. We found the Staircase Blink pattern to be strongly preferred for Alarm Sounds and the Blink Slow pattern for Notification Sounds. We believe that the preliminary findings of our work will inform future design of one-pixel-displays for sound information visualization.

References

[1]

Ellis, D. Detecting alarm sounds. In Proc. Workshop on Consistent and Reliable Acoustic Cues CRAC-2000 (2001).

Google Scholar

[2]

Gorman, B.M. VisAural:: A Wearable Sound-localisation Device for People with Impaired Hearing. In Proc. ASSETS 2014, 337--338.

Digital Library

Google Scholar

[3]

Harrison, C., Horstman, J., Hsieh, G., and Hudson, S. Unlocking the Expressivity of Point Lights. In Proc. CHI 2012, 1683--1692.

Digital Library

Google Scholar

[4]

Ho-Ching, F.W., Mankoff, J., and Landay, J.A. Can You See What I Hear?: The Design and Evaluation of a Peripheral Sound Display for the Deaf. In Proc. CHI 2003, 161--168.

Digital Library

Google Scholar

[5]

Honda, T. and Okamoto, M. User Interface Design of Sound Tactile. In: Computers Helping People with Special Needs. Springer International Publishing, (2014), 382--385.

Crossref

Google Scholar

[6]

Jain, D., Findlater, L., Gilkeson, J., et al. Head-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of Hearing. In Proc. CHI 2015, 241--250.

Digital Library

Google Scholar

[7]

Matthews, T., Fong, J., and Mankoff, J. Visualizing Non-speech Sounds for the Deaf. In Proc. ASSETS 2005, 52--59.

Digital Library

Google Scholar

[8]

Shinohara, K. and Tenenberg, J. A Blind Person's Interactions with Technology. Commun. ACM 52, 8, (2009), 58--66.

Digital Library

Google Scholar

[9]

Tan, H.Z., Gray, R., Young, J.J., and Traylor, R. A haptic back display for attentional and directional cueing. Haptics-e 3, 1, (2003), 1--20.

Google Scholar

[10]

Yeo, K.P., Nanayakkara, S., and Ransiri, S. StickEar: Making Everyday Objects Respond to Sound. In Proc. UIST 2013, 221--226.

Digital Library

Google Scholar

Cited By

View all

Wimer BSouth LWu KSzafir DBorkin MMetoyer R(2024)Beyond Vision Impairments: Redefining the Scope of Accessible Data RepresentationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.335656630:12(7619-7636)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3356566
Carvalho DBarroso JRocha T(2022)Multisensory Experience for People with Hearing Loss: A Preliminary Study Using Haptic Interfaces to Sense MusicHCI International 2022 – Late Breaking Papers: HCI for Health, Well-being, Universal Access and Healthy Aging10.1007/978-3-031-17902-0_21(292-306)Online publication date: 16-Oct-2022
https://doi.org/10.1007/978-3-031-17902-0_21
Elvitigala DMatthies DWeerasinghe CNanayakkara SMakedon F(2021)GymSoles++: Combining Google Glass with Smart Insoles to Improve Body Posture when Performing SquatsProceedings of the 14th PErvasive Technologies Related to Assistive Environments Conference10.1145/3453892.3453898(48-54)Online publication date: 29-Jun-2021
https://dl.acm.org/doi/10.1145/3453892.3453898
Show More Cited By

Index Terms

Towards one-pixel-displays for sound information visualization
1. Human-centered computing

Recommendations

Head-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of Hearing
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Persons with hearing loss use visual signals such as gestures and lip movement to interpret speech. While hearing aids and cochlear implants can improve sound recognition, they generally do not help the wearer localize sound necessary to leverage these ...
Visualizing non-speech sounds for the deaf
Assets '05: Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility

Sounds constantly occur around us, keeping us aware of our surroundings. People who are deaf have difficulty maintaining an awareness of these ambient sounds. We present an investigation of peripheral, visual displays to help people who are deaf ...
Can you see what i hear?: the design and evaluation of a peripheral sound display for the deaf
CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We developed two visual displays for providing awareness of environmental audio to deaf individuals. Based on fieldwork with deaf and hearing participants, we focused on supporting awareness of non-speech audio sounds such as ringing phones and knocking ...

Comments

Information & Contributors

Information

Published In

OzCHI '16: Proceedings of the 28th Australian Conference on Computer-Human Interaction

November 2016

706 pages

ISBN:9781450346184

DOI:10.1145/3010915

Conference Chairs:
Henry Duh
University of Tasmania Christopher Lueg, University of Tasmania
,
Christopher Lueg
University of Tasmania
,
Program Chairs:
Mark Billinghust
University of South Australia
,
Weidong Huang
University of Tasmania

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

ACM: Association for Computing Machinery

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

OzCHI '16

Sponsor:

IEEE-SMCS
Australian Comp Soc
Data61
ICACHI
Infoxchange
HITLab AU
James Boag
Tourism Tasmania
HFESA
IEEEVIC
UTAS

OzCHI '16: The 28th Australian Conference on Human-Computer Interaction

November 29 - December 2, 2016

Tasmania, Launceston, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
186
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wimer BSouth LWu KSzafir DBorkin MMetoyer R(2024)Beyond Vision Impairments: Redefining the Scope of Accessible Data RepresentationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.335656630:12(7619-7636)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3356566
Carvalho DBarroso JRocha T(2022)Multisensory Experience for People with Hearing Loss: A Preliminary Study Using Haptic Interfaces to Sense MusicHCI International 2022 – Late Breaking Papers: HCI for Health, Well-being, Universal Access and Healthy Aging10.1007/978-3-031-17902-0_21(292-306)Online publication date: 16-Oct-2022
https://doi.org/10.1007/978-3-031-17902-0_21
Elvitigala DMatthies DWeerasinghe CNanayakkara SMakedon F(2021)GymSoles++: Combining Google Glass with Smart Insoles to Improve Body Posture when Performing SquatsProceedings of the 14th PErvasive Technologies Related to Assistive Environments Conference10.1145/3453892.3453898(48-54)Online publication date: 29-Jun-2021
https://dl.acm.org/doi/10.1145/3453892.3453898
Marti PIacono ITittarelli M(2018)Experiencing Sound Through Interactive Jewellery and Fashion AccessoriesProceedings of the 20th Congress of the International Ergonomics Association (IEA 2018)10.1007/978-3-319-96071-5_140(1382-1391)Online publication date: 11-Aug-2018
https://doi.org/10.1007/978-3-319-96071-5_140

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Head-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of Hearing

Visualizing non-speech sounds for the deaf

Can you see what i hear?: the design and evaluation of a peripheral sound display for the deaf

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations