research-article

An interactive and intuitive stem accessibility system for the blind and visually impaired

Authors:

PETRA '15: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Article No.: 20, Pages 1 - 7

https://doi.org/10.1145/2769493.2769502

Published: 01 July 2015 Publication History

Get Access

Abstract

We present an intuitive and interactive platform to make complex STEM (Science Technology Engineering and Mathematics) educational materials accessible to blind and visually impaired people using a mini-hyperbraille device with almost no loss of information as compared to printed materials.

We have come up with a novel way to increase the effective resolution of the braille device by adding a mechanical XY gantry. Using this XY gantry enables us to create an ultrahigh resolution, larger surface braille device without paying the prohibitive price charged for the bigger hyper Braille displays available in the market. In addition to that, to further augment usability and intuitiveness of our system, we have integrated a nod-ring, which is a tiny finger-worn device for supporting additional hand gestures such as zoom in and out.

Previous studies have shown that the use of zoom and pan can increase usability and improve the understanding of tactile graphics. Along with zooming and panning, our system uses vibrating patterns, rhythmic motions, synthetic voice and synchronized voiced-vibrations to convey information to blind users in an intuitive way. We also implemented a touch gesture recognition framework on our touch enabled braille device. Using these touch gestures and a high quality synthetic voice, we have developed a highly responsive system for providing voice annotations of the graphics content.

An important contribution of this work is the implementation of a high-quality system for automatic transcription of STEM (including difficult math Nemeth translations) books into braille. Learning resources for blind people are quite sparse and transcription of STEM material is a very expensive and time consuming process. Using our automated transcription platform it is easy, fast and inexpensive for publishers to transcribe STEM books into braille books. The scope of this automated transcription platform is not only limited to STEM books but it can be used for transcription of any content/book/web-page available on-line.

References

[1]

http://www.hyperbraille.de/?lang=en.

Abstract

References

Cited By

Index Terms

Recommendations

Interactive audio-tactile maps for visually impaired people

Survey design for visually impaired and blind people

Perceptions of accessibility and usability by blind or visually impaired persons: a pilot study

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations