research-article

Fall Prevention and Detection in Smart Homes Using Monocular Cameras and an Interactive Social Robot

Authors:

Lachaux Killian,

Bouchard Kevin,

Lussier Maxime,

Bottari Carolina,

Couture Mélanie,

Giroux Sylvain,

Gaboury SebastienAuthors Info & Claims

GoodIT '21: Proceedings of the Conference on Information Technology for Social Good

Pages 7 - 12

https://doi.org/10.1145/3462203.3475892

Published: 09 September 2021 Publication History

Abstract

Falls are one of the greatest risks for older adults living at home. They are also one of the biggest factors impacting independence and quality of life. Falling and even the fear of falling can lead to serious physical and mental health issues. Moreover, some afflictions like the self-neglect syndrome make this risk even greater. In this paper, we introduce a system to manage the fall risk before and after it happens, using monocular cameras and an humanoid robot. The proposed system achieves a 75% detection of trip-hazard objects in a heavily cluttered environment, and an 86.11% accuracy in detecting falls after they happened.

References

[1]

Jordan Abdi, Ahmed Al-Hindawi, Tiffany Ng, and Marcela P Vizcaychipi. 2018. Scoping review on the use of socially assistive robot technology in elderly care. BMJ Open 8, 2 (Feb. 2018), e018815. https://doi.org/10.1136/bmjopen-2017-018815

[2]

Dario Albani, Ali Youssef, Vincenzo Suriani, Daniele Nardi, and Domenico Daniele Bloisi. 2017. A Deep Learning Approach for Object Recognition with NAO Soccer Robots. In RoboCup 2016: Robot World Cup XX (Lecture Notes in Computer Science), Sven Behnke, Raymond Sheh, Sanem Sarıel, and Daniel D. Lee (Eds.). Springer International Publishing, Cham, 392--403. https://doi.org/10.1007/978-3-319-68792-6_33

[3]

Zhen-Peng Bian, Junhui Hou, Lap-Pui Chau, and Nadia Magnenat-Thalmann. 2015. Fall Detection Based on Body Part Tracking Using a Depth Camera. IEEE Journal of Biomedical and Health Informatics 19, 2 (March 2015), 430--439. https://doi.org/10.1109/JBHI.2014.2319372

[4]

XinQi Dong. 2017. Elder self-neglect: research and practice. Clinical Interventions in Aging 12 (June 2017), 949--954. https://doi.org/10.2147/CIA.S103359

[5]

XinQi Dong, Melissa A. Simon, Laura Mosqueda, and Denis A. Evans. 2012. The Prevalence of Elder Self-Neglect in a Community-Dwelling Population: Hoarding, Hygiene, and Environmental Hazards. Journal of Aging and Health 24, 3 (April 2012), 507--524. https://doi.org/10.1177/0898264311425597 Publisher: SAGE Publications Inc.

[6]

Amandine Dubois and Francois Charpillet. 2014. A gait analysis method based on a depth camera for fall prevention. In 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 4515--4518. https://doi.org/10.1109/EMBC.2014.6944627 ISSN: 1558-4615.

[7]

Laurent George and Alexandre Mazel. 2013. Humanoid robot indoor navigation based on 2D bar codes: application to the NAO robot. In 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids). IEEE, Atlanta, GA, 329--335. https://doi.org/10.1109/HUMANOIDS.2013.7029995

[8]

Francisco Gomez-Donoso, Félix Escalona, Francisco Miguel Rivas, Jose Maria Cañas, and Miguel Cazorla. 2019. Enhancing the Ambient Assisted Living Capabilities with a Mobile Robot. Computational Intelligence and Neuroscience 2019 (April 2019), 1--15. https://doi.org/10.1155/2019/9412384

[9]

Jesús Gutiérrez, Víctor Rodríguez, and Sergio Martin. 2021. Comprehensive Review of Vision-Based Fall Detection Systems. Sensors 21, 3 (Jan. 2021), 947. https://doi.org/10.3390/s21030947 Number: 3 Publisher: Multidisciplinary Digital Publishing Institute.

[10]

Tzung-Han Lin, Chi-Yun Yang, and Wen-Pin Shih. 2017. Fall Prevention Shoes Using Camera-Based Line-Laser Obstacle Detection System. Journal of Healthcare Engineering 2017 (May 2017), e8264071. https://doi.org/10.1155/2017/8264071 Publisher: Hindawi.

[11]

Ahmad Lotfi, Suad Albawendi, Heather Powell, Kofi Appiah, and Caroline Langensiepen. 2018. Supporting Independent Living for Older Adults; Employing a Visual Based Fall Detection Through Analysing the Motion and Shape of the Human Body. IEEE Access 6 (2018), 70272--70282. https://doi.org/10.1109/ACCESS.2018.2881237 Conference Name: IEEE Access.

[12]

Julien Maitre, Kevin Bouchard, and Sebastien Gaboury. 2021. Fall Detection With UWB Radars and CNN-LSTM Architecture. IEEE Journal of Biomedical and Health Informatics 25, 4 (April 2021), 1273--1283. https://doi.org/10.1109/JBHI.2020.3027967

[13]

Ashutosh Natraj, Stephen Cameron, Chris Melhuish, and Mark Witkowski (Eds.). 2014. Towards Autonomous Robotic Systems: 14th Annual Conference, TAROS 2013, Oxford, UK, August 28-30, 2013, Revised Selected Papers. Lecture Notes in Computer Science, Vol. 8069. Springer Berlin Heidelberg, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-43645-5

[14]

World Health Organization. 2016. World Health Statistics 2016: Monitoring Health for the SDGs Sustainable Development Goals. World Health Organization.

[15]

S. Oßwald, A. Hornung, and M. Bennewitz. 2010. Learning reliable and efficient navigation with a humanoid. In 2010 IEEE International Conference on Robotics and Automation. 2375--2380. https://doi.org/10.1109/ROBOT.2010.5509420 ISSN: 1050-4729.

[16]

Christopher Pereyda, Nisha Raghunath, Bryan Minor, Garrett Wilson, Maureen Schmitter-Edgecombe, and Diane J. Cook. 2019. Cyber-physical Support of Daily Activities: A Robot/Smart Home Partnership. ACM Transactions on Cyber-Physical Systems 4, 2 (Dec. 2019), 21:1--21:24. https://doi.org/10.1145/3365225

[17]

Paola Pierleoni, Alberto Belli, Lorenzo Palma, Marco Pellegrini, Luca Pernini, and Simone Valenti. 2015. A High Reliability Wearable Device for Elderly Fall Detection. IEEE Sensors Journal (2015), 10. https://doi.org/10.1109/JSEN.2015.2423562

[18]

Stephen M. Pizer, E. Philip Amburn, John D. Austin, Robert Cromartie, Ari Geselowitz, Trey Greer, Bart ter Haar Romeny, John B. Zimmerman, and Karel Zuiderveld. 1987. Adaptive histogram equalization and its variations. Computer Vision, Graphics, and Image Processing 39, 3 (Sept. 1987), 355--368. https://doi.org/10.1016/S0734-189X(87)80186-X

Digital Library

[19]

Joseph Redmon and Ali Farhadi. 2018. YOLOv3: An Incremental Improvement. arXiv:1804.02767 [cs] (April 2018). http://arxiv.org/abs/1804.02767 arXiv:1804.02767.

[20]

Adam Robaczewski, Julie Bouchard, Kevin Bouchard, and Sébastien Gaboury. 2020. Socially Assistive Robots: The Specific Case of the NAO. International Journal of Social Robotics (June 2020). https://doi.org/10.1007/s12369-020-00664-7

[21]

United Nations, Department of Economic and Social Affairs, and Population Division. 2020. World population ageing, 2019 highlights. OCLC: 1134853628.

[22]

Shuhuan Wen, Xiao Chen, Chunli Ma, H.K. Lam, and Shaoyang Hua. 2015. The Q-learning obstacle avoidance algorithm based on EKF-SLAM for NAO autonomous walking under unknown environments. Robotics and Autonomous Systems 72 (Oct. 2015), 29--36. https://doi.org/10.1016/j.robot.2015.04.003

[23]

Zhou Wang and A.C. Bovik. 2009. Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures. IEEE Signal Processing Magazine 26, 1 (Jan. 2009), 98--117. https://doi.org/10.1109/MSP.2008.930649

Cited By

Story MAit-Belaid KCamp NVagnetti RMagistro DZecca MDi Nuovo A(2024) Pilot Study for a Robot-Assisted Timed Up and Go Assessment * 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS58592.2024.10801568(4763-4768)Online publication date: 14-Oct-2024
https://doi.org/10.1109/IROS58592.2024.10801568
Sykes E(2024)Next-generation fall detection: harnessing human pose estimation and transformer technologyHealth Systems10.1080/20476965.2024.2395574(1-19)Online publication date: 26-Oct-2024
https://doi.org/10.1080/20476965.2024.2395574
Gaya-Morey FManresa-Yee CBuades-Rubio J(2024)Deep learning for computer vision based activity recognition and fall detection of the elderly: a systematic reviewApplied Intelligence10.1007/s10489-024-05645-154:19(8982-9007)Online publication date: 8-Jul-2024
https://doi.org/10.1007/s10489-024-05645-1
Show More Cited By

Index Terms

Fall Prevention and Detection in Smart Homes Using Monocular Cameras and an Interactive Social Robot

Recommendations

Elderly Assistance Using Wearable Sensors by Detecting Fall and Recognizing Fall Patterns
UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers

Falling is a serious threat to the elderly people. One severe fall can cause hazardous problems like bone fracture or may lead to some permanent disability or even death. Thus, it has become the need of the hour to continuously monitor the activities of ...
Fall Risk Assessment and Prevention Using Wearables
IWAAL 2015: Proceedings of the 7th International Work-Conference on Ambient Assisted Living. ICT-based Solutions in Real Life Situations - Volume 9455

Each year about 1/3 of elderly aged 65 or older experience a fall. Many of these falls may have been avoided if fall risk assessment and prevention tools where available in a daily living situation. We identify what kind of information is relevant to do ...
Increasing fall risk awareness using wearables

Display Omitted A survey of wearables used in fall risk assessment and prevention.Separating fall risk into prospective and context-aware.A Fall Risk Awareness Protocol is proposed is built upon ta Fall Risk Probability Engine.Combining data from ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

GoodIT '21: Proceedings of the Conference on Information Technology for Social Good

September 2021

345 pages

ISBN:9781450384780

DOI:10.1145/3462203

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCAS: ACM Special Interest Group on Computers and Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 September 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

GoodIT '21

Sponsor:

SIGCAS

GoodIT '21: Conference on Information Technology for Social Good

September 9 - 11, 2021

Roma, Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
212
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)3

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Story MAit-Belaid KCamp NVagnetti RMagistro DZecca MDi Nuovo A(2024) Pilot Study for a Robot-Assisted Timed Up and Go Assessment * 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS58592.2024.10801568(4763-4768)Online publication date: 14-Oct-2024
https://doi.org/10.1109/IROS58592.2024.10801568
Sykes E(2024)Next-generation fall detection: harnessing human pose estimation and transformer technologyHealth Systems10.1080/20476965.2024.2395574(1-19)Online publication date: 26-Oct-2024
https://doi.org/10.1080/20476965.2024.2395574
Gaya-Morey FManresa-Yee CBuades-Rubio J(2024)Deep learning for computer vision based activity recognition and fall detection of the elderly: a systematic reviewApplied Intelligence10.1007/s10489-024-05645-154:19(8982-9007)Online publication date: 8-Jul-2024
https://doi.org/10.1007/s10489-024-05645-1
Abudalfa SBouchard K(2024)Filtering Data from Motion Sensors with Rich Features for Monitoring Brushing BehaviorsProceedings of the International Conference on Ubiquitous Computing and Ambient Intelligence (UCAmI 2024)10.1007/978-3-031-77571-0_12(112-117)Online publication date: 21-Dec-2024
https://doi.org/10.1007/978-3-031-77571-0_12
Gallo SPaterno FMalizia A(2023)Conversational Interfaces in IoT Ecosystems: Where We Are, What Is Still MissingProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3627775(279-293)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1145/3626705.3627775
Lachaux KMaitre JBouchard KLussier MBottari CCouture MBier NGiroux SGaboury S(2022)Managing the Fall Risk in Smart Homes Using Monocular Cameras, Ambient Sensors and an Interactive Social Robot2022 IEEE International Conference on Blockchain, Smart Healthcare and Emerging Technologies (SmartBlock4Health)10.1109/SmartBlock4Health56071.2022.10034526(1-10)Online publication date: 24-Oct-2022
https://doi.org/10.1109/SmartBlock4Health56071.2022.10034526
Yoshino DWatanobe YNaruse K(2021)A Highly Reliable Communication System for Internet of Robotic Things and Implementation in RT-Middleware With AMQP Communication InterfacesIEEE Access10.1109/ACCESS.2021.31368559(167229-167241)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3136855

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten