Matia Application: An AI Multi-Lingual Assistant For Visually Impaired And Blind People
Article No.: 6, Pages 1 - 7
Abstract
The World Health Organization (WHO) estimates that at least 2.2 billion people suffer from some form of vision impairment. This widespread problem has resulted in a staggering $411 billion loss of productivity per year. To tackle this issue, researchers have employed IoT devices to aid visually impaired individuals in navigating their environments, but these solutions can be both inconvenient and costly. Mobile technology, on the other hand, has the potential to provide a more cost-effective and user-friendly solution. However, current mobile applications for the visually impaired only support English or French and require an internet connection to use. To address these limitations, a new mobile application named "Matia" has been developed to offer a solution in three languages: Arabic, French, and English, without the need for IoT devices or an internet connection. This paper describes the design and implementation of Matia application. The application's accuracy in recognizing five datasets (clothes, fruits, house equipment, pets, and banknotes) ranges from 74% to 90%, which is higher than existing literature. Further functionalities, such as guidance assistance and danger recognition, are under development to make the application even more useful in various situations.
References
[1]
Abayomi-Alli, O., Misra, S., Abayomi-Alli, A. and Odusami, M. 2019. A review of soft techniques for SMS spam classification: Methods, approaches and applications. Engineering Applications of Artificial Intelligence. 86, (Nov. 2019), 197–212.
[2]
Albayrak, N.E. 2020. Object Recognition using TensorFlow. 2020 IEEE Integrated STEM Education Conference (ISEC) (Aug. 2020), 1–1.
[3]
Awad, M., Haddad, J.E., Khneisser, E., Mahmoud, T., Yaacoub, E. and Malli, M. 2018. Intelligent eye: A mobile application for assisting blind people. 2018 IEEE Middle East and North Africa Communications Conference (MENACOMM) (Jounieh, Apr. 2018), 1–6.
[4]
Felix, S.M., Kumar, S. and Veeramuthu, A. 2018. A Smart Personal AI Assistant for Visually Impaired People. 2018 2nd International Conference on Trends in Electronics and Informatics (ICOEI) (Tirunelveli, May 2018), 1245–1250.
[5]
Fruits 360: https://www.kaggle.com/datasets/moltean/fruits. Accessed: 2023-01-13.
[6]
Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M. and Adam, H. 2017. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv.
[7]
Ismail, A. 2020. MyNursingHome. 1, (Jul. 2020).
[8]
Khan, S., Nazir, S. and Khan, H.U. 2021. Analysis of Navigation Assistants for Blind and Visually Impaired People: A Systematic Review. IEEE Access. 9, (2021), 26712–26734.
[9]
Kuriakose, B., Shrestha, R. and Sandnes, F.E. 2023. DeepNAVI: A deep learning based smartphone navigation assistant for people with visual impairments. Expert Systems with Applications. 212, (Feb. 2023), 118720.
[10]
Mallikarjuna, G.C.P., Hajare, R. and Pavan, P.S.S. 2022. Cognitive IoT System for visually impaired: Machine Learning Approach. Materials Today: Proceedings. 49, (2022), 529–535.
[11]
Matei, M., Alboaie, L. and Iftene, A. 2022. Safety Navigation using a Conversational User Interface For Visually Impaired People. Procedia Computer Science. 207, (2022), 1164–1173.
[12]
Ouali, I., Hadj Sassi, M.S., Halima, M.B. and Wali, A. 2020. A New Architecture based AR for Detection and Recognition of Objects and Text to Enhance Navigation of Visually Impaired People. Procedia Computer Science. 176, (2020), 602–611.
[13]
Rahman, Md.A. and Sadi, M.S. 2021. IoT Enabled Automated Object Recognition for the Visually Impaired. Computer Methods and Programs in Biomedicine Update. 1, (2021), 100015.
[14]
Rahman, Md.W., Tashfia, S.S., Islam, R., Hasan, Md.M., Sultan, S.I., Mia, S. and Rahman, M.M. 2021. The architectural design of smart blind assistant using IoT with deep learning paradigm. Internet of Things. 13, (Mar. 2021), 100344.
[15]
Seeing Assistant: https://seeingassistant.tt.com.pl/. Accessed: 2023-02-13.
[16]
Study Info for Pew Research Center: Spring 2018 Global Attitudes Survey (Roper #31115445) | Roper iPoll - Roper Center For Public Opinion Research: https://ropercenter.cornell.edu/ipoll/study/31115445. Accessed: 2023-01-10.
[17]
TapTapSee - Blind and Visually Impaired Assistive Technology - powered by CloudSight.ai Image Recognition API: https://taptapseeapp.com/. Accessed: 2023-02-13.
[18]
Tapu, R., Mocanu, B. and Zaharia, T. 2020. Wearable assistive devices for visually impaired: A state of the art survey. Pattern Recognition Letters. 137, (Sep. 2020), 37–52.
[19]
Teachable Machine: https://teachablemachine.withgoogle.com/. Accessed: 2023-01-17.
[20]
Vision impairment and blindness: https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment. Accessed: 2023-01-10.
[21]
Wu, J., Sheng, V.S., Zhang, J., Zhao, P. and Cui, Z. 2014. Multi-label active learning for image classification. 2014 IEEE International Conference on Image Processing (ICIP) (Oct. 2014), 5227–5231.
Index Terms
- Matia Application: An AI Multi-Lingual Assistant For Visually Impaired And Blind People
Index terms have been assigned to the content through auto-classification.
Recommendations
What Makes Videos Accessible to Blind and Visually Impaired People?
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsUser-generated videos are an increasingly important source of information online, yet most online videos are inaccessible to blind and visually impaired (BVI) people. To find videos that are accessible, or understandable without additional description ...
Computer Vision based Assistive Technology for Blind and Visually Impaired People
ICCCNT '16: Proceedings of the 7th International Conference on Computing Communication and Networking TechnologiesThe computer vision based assistive technology for the blind and visually impaired is a developing area. The assistive technology helps the visually impaired by providing them with a greater independence. By enabling them with their day-to-day ...
Interactive audio-tactile maps for visually impaired people
Visually impaired people face important challenges related to orientation and mobility. Indeed, 56% of visually impaired people in France declared having problems concerning autonomous mobility [10]. These problems often mean that visually impaired ...
Comments
Information & Contributors
Information
Published In
May 2023
451 pages
ISBN:9798400700194
DOI:10.1145/3607720
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 November 2023
Check for updates
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
NISS 2023
NISS 2023: The 6th International Conference on Networking, Intelligent Systems & Security
May 24 - 26, 2023
Larache, Morocco
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 34Total Downloads
- Downloads (Last 12 months)34
- Downloads (Last 6 weeks)4
Reflects downloads up to 10 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format