research-article

Wearable computing for image-based indoor navigation of the visually impaired

Authors:

Ani NahapetianAuthors Info & Claims

WH '15: Proceedings of the conference on Wireless Health

Article No.: 17, Pages 1 - 6

https://doi.org/10.1145/2811780.2811959

Published: 14 October 2015 Publication History

Abstract

In this paper, an image-based non-obtrusive indoor navigation system for the visually impaired is presented. The system makes use of image processing algorithms to extract floor regions from images captured from a wearable eye-mounted heads-up display device. A prototype system called VirtualEyes is presented, where floor regions are analyzed to provide the user with voiced guidance for navigation. The floor detection algorithm was tested against over 200 images captured from indoor corridors of various lighting conditions and achieved up to 81.8% accuracy.

References

[1]

WHO Visual impairment and blindness http://www.who.int/mediacentre/factsheets/fs282/en/ Accessed on April 7, 2015.

[2]

Faria, J.; Lopes, S.; Fernandes, H.; Martins, P.; Barroso, J., "Electronic white cane for blind people navigation assistance," World Automation Congress (WAC), 2010, vol., no., pp.1,7, 19-23 Sept. 2010.

[3]

Pablo Vera, Daniel Zenteno, and Joaquín Salas. 2014. A smartphone-based virtual white cane. Pattern Anal. Appl. 17, 3 (August 2014), 623--632.

Digital Library

[4]

Tapu, R.; Mocanu, B.; Zaharia, T., "A computer vision system that ensure the autonomous navigation of blind people," E-Health and Bioengineering Conference (EHB), 2013, vol., no., pp.1,4, 21-23 Nov. 2013.

[5]

Zenteno Jiménez, Enrique Daniel, and Joaquín Salas Rodríguez. Electronic Travel Aids With Personalized Haptic Feedback for Visually Impaired People. Instituto Politécnico Nacional (IPN), 2014.

[6]

Shang Wenqin; Jiang Wei; Chu Jian, "A machine vision based navigation system for the blind," Computer Science and Automation Engineering (CSAE), 2011 IEEE International Conference on, vol.3, no., pp.81,85, 10-12 June 2011.

[7]

Fernandes, H.; Costa, P.; Filipe, V.; Hadjileontiadis, L.; Barroso, J., "Stereo vision in blind navigation assistance," World Automation Congress (WAC), 2010, vol., no., pp.1,6, 19-23 Sept. 2010.

[8]

Okada, K.; Inaba, M.; Inoue, H., "Walking navigation system of humanoid robot using stereo vision based floor recognition and path planning with multi-layered body image," Intelligent Robots and Systems, 2003. (IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, vol.3, no., pp.2155,2160 vol.3, 27-31 Oct. 2003.

[9]

Young-geun Kim; Hakil Kim, "Layered ground floor detection for vision-based mobile robot navigation," Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 IEEE International Conference on, vol.1, no., pp.13,18 Vol.1, 26 April-1 May 2004

[10]

Pears, N.; Bojian Liang, "Ground plane segmentation for mobile robot visual navigation," Intelligent Robots and Systems, 2001. Proceedings. 2001 IEEE/RSJ International Conference on, vol.3, no., pp.1513,1518 vol.3, 2001

[11]

Changhwan Chun; Dongjin Park; Wonjun Kim; Changick Kim, "Floor detection based depth estimation from a single indoor scene," Image Processing (ICIP), 2013 20th IEEE International Conference on, vol., no., pp.3358,3362, 15-18 Sept. 2013

[12]

Yinxiao Li; Birchfield, S. T., "Image-based segmentation of indoor corridor floors for a mobile robot," Intelligent Robots and Systems (IROS), 2010 IEEE/RSJ International Conference on, vol., no., pp.837,843, 18-22 Oct. 2010

[13]

Barcelo, G. C.; Panahandeh, G.; Jansson, M., "Image-based floor segmentation in visual inertial navigation," Instrumentation and Measurement Technology Conference (I2MTC), 2013 IEEE International, vol., no., pp.1402,1407, 6-9 May 2013.

[14]

Google Glass - Tech Specs. https://support.google.com/glass/answer/3064128?hl=en Accessed on February 24, 2015.

[15]

OpenCV http://opencv.org/ Accessed on March 8, 2015

[16]

Canny Edge Detector - OpenCV 2.4.9.0 Documentation http://docs.opencv.org/doc/tutorials/imgproc/imgtrans/canny_detector/canny_detector.html Accessed on March 1, 2015.

[17]

Hough Line Transform - OpenCV 2.4.9.0 Documentation http://docs.opencv.org/doc/tutorials/imgproc/imgtrans/hough_lines/hough_lines.html Accessed on March 1, 2015.

[18]

Convex Hull -- OpenCV 2.4.11.0 Documentation http://docs.opencv.org/doc/tutorials/imgproc/shapedescriptors/hull/hull.html Accessed on April 20, 2015.

[19]

Dina Najeeb, Antonio Grass, Gladys Garcia, Ryan Debbiny, and Ani Nahapetian. 2014. MindLogger: a brain-computer interface for word building using brainwaves. In Proceedings of the 1st Workshop on Mobile Medical Applications (MMA '14). ACM, New York, NY, USA, 6--11.

Digital Library

[20]

Costante, G.; Porzi, L.; Lanz, O.; Valigi, P.; Ricci, E., "Personalizing a smartwatch-based gesture interface with transfer learning," Signal Processing Conference (EUSIPCO), 2014 Proceedings of the 22nd European, vol., no., pp.2530,2534, 1-5 Sept. 2014.

[21]

Altwaijry, H.; Moghimi, M.; Belongie, S., "Recognizing locations with Google Glass: A case study," Applications of Computer Vision (WACV), 2014 IEEE Winter Conference on, vol., no., pp.167,174, 24-26 March 2014.

[22]

Arsen Papisyan, Ani Nahapetian. LightVest: A Wearable Body Position Monitor Using Ambient and Infrared Light. ACM International Conference on Body Area Networks (BodyNets), September 2014.

Digital Library

Cited By

Tripathi SSingh STanya TKapoor SKirti Saini A(2023)Analysis of Obstruction Avoidance Assistants to Enhance the Mobility of Visually Impaired Person: A Systematic Review2023 International Conference on Artificial Intelligence and Smart Communication (AISC)10.1109/AISC56616.2023.10085416(134-142)Online publication date: 27-Jan-2023
https://doi.org/10.1109/AISC56616.2023.10085416
Kwok TKiefer PRaubal M(2023)Unobtrusive interaction: a systematic literature review and expert surveyHuman–Computer Interaction10.1080/07370024.2022.216240439:5-6(380-416)Online publication date: Feb-2023
https://doi.org/10.1080/07370024.2022.2162404
Brar SJindal N(2023)Camera Based Wearable Devices: A Strategic Survey from 2010 to 2021Wireless Personal Communications: An International Journal10.1007/s11277-023-10787-5133:1(667-681)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1007/s11277-023-10787-5
Show More Cited By

Index Terms

Wearable computing for image-based indoor navigation of the visually impaired
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Signal processing systems

Recommendations

Vibrotactile Navigation for Visually Impaired People
ASSETS '22: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility

One of the largest impediments to autonomous grocery shopping for blind people is navigation. In a still ongoing multi-year research process we followed a user centred approach to explore how visually impaired people can be supported in indoor ...
Computer Vision based Assistive Technology for Blind and Visually Impaired People
ICCCNT '16: Proceedings of the 7th International Conference on Computing Communication and Networking Technologies

The computer vision based assistive technology for the blind and visually impaired is a developing area. The assistive technology helps the visually impaired by providing them with a greater independence. By enabling them with their day-to-day ...
Egocentric Landmark-Based Indoor Guidance System for the Visually Impaired

In this paper, we introduce an egocentric landmark-based guidance system that enables visually impaired users to interact with indoor environments. The user who wears Google Glasses will capture his surroundings within his field of view. Using this ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

WH '15: Proceedings of the conference on Wireless Health

October 2015

157 pages

ISBN:9781450338516

DOI:10.1145/2811780

General Chairs:
Wendy Nilsen
National Institutes of Health
,
Jack Stankovic
University of Virginia

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 October 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

WH '15

WH '15: Wireless Health 2015 Conference

October 14 - 16, 2015

Maryland, Bethesda

Acceptance Rates

WH '15 Paper Acceptance Rate 28 of 106 submissions, 26%;

Overall Acceptance Rate 35 of 139 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
222
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)2

Reflects downloads up to 18 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tripathi SSingh STanya TKapoor SKirti Saini A(2023)Analysis of Obstruction Avoidance Assistants to Enhance the Mobility of Visually Impaired Person: A Systematic Review2023 International Conference on Artificial Intelligence and Smart Communication (AISC)10.1109/AISC56616.2023.10085416(134-142)Online publication date: 27-Jan-2023
https://doi.org/10.1109/AISC56616.2023.10085416
Kwok TKiefer PRaubal M(2023)Unobtrusive interaction: a systematic literature review and expert surveyHuman–Computer Interaction10.1080/07370024.2022.216240439:5-6(380-416)Online publication date: Feb-2023
https://doi.org/10.1080/07370024.2022.2162404
Brar SJindal N(2023)Camera Based Wearable Devices: A Strategic Survey from 2010 to 2021Wireless Personal Communications: An International Journal10.1007/s11277-023-10787-5133:1(667-681)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1007/s11277-023-10787-5
Franco MGiacomazzi PPalazzi C(2022)A Mobile App to Pin Media to the Real World2022 IEEE 19th Annual Consumer Communications & Networking Conference (CCNC)10.1109/CCNC49033.2022.9700689(671-674)Online publication date: 8-Jan-2022
https://doi.org/10.1109/CCNC49033.2022.9700689
Wang XCalderon JKhoshavi NJaimes L(2022)Path and Floor Detection in Outdoor Environments for Fall Prevention of the Visually Impaired Population2022 IEEE 19th Annual Consumer Communications & Networking Conference (CCNC)10.1109/CCNC49033.2022.9700646(1-6)Online publication date: 8-Jan-2022
https://doi.org/10.1109/CCNC49033.2022.9700646
Yamanaka YKayukawa STakagi HNagaoka YHiratsuka YKurihara S(2022)One-Shot Wayfinding Method for Blind People via OCR and Arrow Analysis with a 360-Degree Smartphone CameraMobile and Ubiquitous Systems: Computing, Networking and Services10.1007/978-3-030-94822-1_9(150-168)Online publication date: 8-Feb-2022
https://doi.org/10.1007/978-3-030-94822-1_9
Thakur NHan C(2021)Indoor Localization for Personalized Ambient Assisted Living of Multiple Users in Multi-Floor Smart EnvironmentsBig Data and Cognitive Computing10.3390/bdcc50300425:3(42)Online publication date: 8-Sep-2021
https://doi.org/10.3390/bdcc5030042
Karkar AAl-Maadeed SKunhoth JBouridane A(2021)CamNav: a computer-vision indoor navigation systemThe Journal of Supercomputing10.1007/s11227-020-03568-5Online publication date: 8-Jan-2021
https://doi.org/10.1007/s11227-020-03568-5
Kunhoth JKarkar AAl-Maadeed SAl-Ali A(2020)Indoor positioning and wayfinding systems: a surveyHuman-centric Computing and Information Sciences10.1186/s13673-020-00222-010:1Online publication date: 2-May-2020
https://doi.org/10.1186/s13673-020-00222-0
Plikynas DZvironas AGudauskis MBudrionis ADaniusis PSliesoraityte I(2020)Research advances of indoor navigation for blind people: A brief review of technological instrumentationIEEE Instrumentation & Measurement Magazine10.1109/MIM.2020.912606823:4(22-32)Online publication date: Jun-2020
https://doi.org/10.1109/MIM.2020.9126068
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents