poster

FingerReader: a wearable device to support text reading on the go

Authors:

Suranga Chandima NanayakkaraAuthors Info & Claims

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Pages 2359 - 2364

https://doi.org/10.1145/2559206.2581220

Published: 26 April 2014 Publication History

Abstract

Visually impaired people report numerous difficulties with accessing printed text using existing technology, including problems with alignment, focus, accuracy, mobility and efficiency. We present a finger worn device that assists the visually impaired with effectively and efficiently reading paper-printed text. We introduce a novel, local-sequential manner for scanning text which enables reading single lines, blocks of text or skimming the text for important sections while providing real-time auditory and tactile feedback. The design is motivated by preliminary studies with visually impaired people, and it is small-scale and mobile, which enables a more manageable operation with little setup.

Supplementary Material

ZIP File (wip0317-file3.zip)

Zip file containing a PDF of the Accompanying Poster

Download
12.10 MB

References

[1]

KNFB kReader mobile, 2010. http://www.knfbreader.com/products-kreadermobile.php.

[2]

OrCam, 2013. http://www.orcam.com/.

[3]

ABiSee. EyePal ROL, 2013. http://www.abisee.com/products/eye-pal-rol.html.

[4]

Black, A. W., and Lenzo, K. A. Flite: a small fast run-time synthesis engine. In ITRW on Speech Synthesis (2001).

[5]

Blindsight. Text detective, 2013. http://blindsight.com/textdetective/.

[6]

d'Albe, E. F. On a type-reading optophone. Proc. of the Royal Society of London. Series A 90, 619 (1914), 373375.

[7]

Ezaki, N., Bulacu, M., and Schomaker, L. Text detection from natural scene images: towards a system for visually impaired persons. In ICPR (2004).

Digital Library

[8]

Hanif, S. M., and Prevost, L. Texture based text detection in natural scene images-a help to blind and visually impaired persons. In CVHI (2007).

[9]

Kane, S. K., Frey, B., and Wobbrock, J. O. Access lens: a gesture-based screen reader for real-world documents. In Proc. of CHI, ACM (2013), 347--350.

Digital Library

[10]

Linvill, J. G., and Bliss, J. C. A direct translation reading aid for the blind. Proc. of the IEEE 54, 1 (1966).

[11]

Mattar, M. A., Hanson, A. R., and Learned-Miller, E. G. Sign classification for the visually impaired. UMASS-Amherst Technical Report 5, 14 (2005).

[12]

Nanayakkara, S., Shilkrot, R., Yeo, K. P., and Maes, P. EyeRing: a finger-worn input device for seamless interactions with our surroundings. In Augmented Human (2013).

Digital Library

[13]

Pazio, M., Niedzwiecki, M., Kowalik, R., and Lebiedz, J. Text detection system for the blind. In EUSIPCO (2007), 272--276.

[14]

Peters, J.-P., Thillou, C., and Ferreira, S. Embedded reading device for blind people: a user-centered design. In ISIT (2004).

[15]

Rissanen, M. J., Vu, S., Fernando, O. N. N., Pang, N., and Foo, S. Subtle, natural and socially acceptable interaction techniques for ringterfaces: Finger-ring shaped user interfaces. In Distributed, Ambient, and Pervasive Interactions. Springer, 2013, 52--61.

[16]

Shen, H., and Coughlan, J. M. Towards a real-time system for finding and reading signs for visually impaired users. In Computers Helping People with Special Needs. Springer, 2012, 41--47.

Digital Library

[17]

Smith, R. An overview of the tesseract OCR engine. In ICDAR (2007), 629--633.

Digital Library

[18]

Yi, C., and Tian, Y. Assistive text reading from complex background for blind persons. In Camera-Based Document Analysis and Recognition. Springer, 2012, 15--28.

Digital Library

Cited By

Langlotz TSutton JRegenbrecht H(2024)A Design Space for Vision Augmentations and Augmented Human Perception using Digital EyewearProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642380(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642380
Prakash R. VTaduri S(2023)Elderly and Visually Impaired People Mobility in Home Environment Using Adhesive Tactile Walking Surface IndicatorsComputer Assistive Technologies for Physically and Cognitively Challenged Users10.2174/9789815079159123020010(164-182)Online publication date: 21-Mar-2023
https://doi.org/10.2174/9789815079159123020010
Rieger S(2023) Neues Lesen . Unikalität und Multisensorik als Strategien der Literaturvermittlung Journal of Literary Theory10.1515/jlt-2023-200717:1(143-166)Online publication date: 20-Jul-2023
https://doi.org/10.1515/jlt-2023-2007
Show More Cited By

Index Terms

FingerReader: a wearable device to support text reading on the go

Recommendations

FingerReader: A Wearable Device to Explore Printed Text on the Go
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Accessing printed text in a mobile context is a major challenge for the blind. A preliminary study with blind people reveals numerous difficulties with existing state-of-the-art technologies including problems with alignment, focus, accuracy, mobility ...
A wearable text-reading device for the visually-impaired
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Visually impaired people report numerous difficulties with accessing printed text using existing technology, including problems with alignment, focus, accuracy, mobility and efficiency. We present a finger worn device, which contains a camera, vibration ...
Chinese FingerReader: a wearable device to explore Chinese printed text
SIGGRAPH '17: ACM SIGGRAPH 2017 Posters

Reading is an essential part of daily life. When reading books, drug information, textual icons on electronic devices (e.g., microwave), and information on signs and maps (e.g., location and floor level), people must be able to recognize the words to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

April 2014

2620 pages

ISBN:9781450324748

DOI:10.1145/2559206

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Check for updates

Author Tags

Qualifiers

Poster

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI EA '14 Paper Acceptance Rate 1,000 of 3,200 submissions, 31%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
546
Total Downloads

Downloads (Last 12 months)31
Downloads (Last 6 weeks)3

Reflects downloads up to 10 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Langlotz TSutton JRegenbrecht H(2024)A Design Space for Vision Augmentations and Augmented Human Perception using Digital EyewearProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642380(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642380
Prakash R. VTaduri S(2023)Elderly and Visually Impaired People Mobility in Home Environment Using Adhesive Tactile Walking Surface IndicatorsComputer Assistive Technologies for Physically and Cognitively Challenged Users10.2174/9789815079159123020010(164-182)Online publication date: 21-Mar-2023
https://doi.org/10.2174/9789815079159123020010
Rieger S(2023) Neues Lesen . Unikalität und Multisensorik als Strategien der Literaturvermittlung Journal of Literary Theory10.1515/jlt-2023-200717:1(143-166)Online publication date: 20-Jul-2023
https://doi.org/10.1515/jlt-2023-2007
Waghmare ABoldu RWhitmire EKienzle W(2023)OptiRing: Low-Resolution Optical Sensing for Subtle Thumb-to-Index Micro-InteractionsProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614538(1-13)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614538
Jain GHindi BCourtien CXu XWyrick CMalcolm MSmith B(2023)Front Row: Automatically Generating Immersive Audio Representations of Tennis Broadcasts for Blind ViewersProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606830(1-17)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606830
Singh IMisra AMaurya AVerma A(2023)Technical Review of Smart Assistive Devices for Visually Impaired People2023 4th International Conference for Emerging Technology (INCET)10.1109/INCET57972.2023.10170619(1-12)Online publication date: 26-May-2023
https://doi.org/10.1109/INCET57972.2023.10170619
Busaeed SKatib IAlbeshri ACorchado JYigitcanlar TMehmood R(2022)LidSonic V2.0: A LiDAR and Deep-Learning-Based Green Assistive Edge Device to Enhance Mobility for the Visually ImpairedSensors10.3390/s2219743522:19(7435)Online publication date: 30-Sep-2022
https://doi.org/10.3390/s22197435
Xie JReddie MLee SBillah SZhou ZTsai CCarroll J(2022)Iterative Design and Prototyping of Computer Vision Mediated Remote Sighted AssistanceACM Transactions on Computer-Human Interaction10.1145/350129829:4(1-40)Online publication date: 31-Mar-2022
https://dl.acm.org/doi/10.1145/3501298
Gao WWei THuang HChen XLi Q(2022)Toward a Systematic Survey on Wearable Computing for Education ApplicationsIEEE Internet of Things Journal10.1109/JIOT.2022.31683249:15(12901-12915)Online publication date: 1-Aug-2022
https://doi.org/10.1109/JIOT.2022.3168324
Ashiq FAsif MAhmad MZafar SMasood KMahmood TMahmood MLee I(2022)CNN-Based Object Recognition and Tracking System to Assist Visually Impaired PeopleIEEE Access10.1109/ACCESS.2022.314803610(14819-14834)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3148036
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten