research-article

dWatch: A Reliable and Low-Power Drowsiness Detection System for Drivers Based on Mobile Devices

Authors:

Tianzhang Xing,

Xiaojiang ChenAuthors Info & Claims

ACM Transactions on Sensor Networks (TOSN), Volume 16, Issue 4

Article No.: 37, Pages 1 - 22

https://doi.org/10.1145/3407899

Published: 16 September 2020 Publication History

Abstract

Drowsiness detection is critical to driver safety, considering thousands of deaths caused by drowsy driving annually. Professional equipment is capable of providing high detection accuracy, but the high cost limits their applications in practice. The use of mobile devices such as smart watches and smart phones holds the promise of providing a more convenient, practical, non-invasive method for drowsiness detection. In this article, we propose a real-time driver drowsiness detection system based on mobile devices, referred to as dWatch, which combines physiological measurements with motion states of a driver to achieve high detection accuracy and low power consumption. Specifically, based on heart rate measurements, we design different methods for calculating heart rate variability (HRV) and sensing yawn actions, respectively, which are combined with steering wheel motion features extracted from motion sensors for drowsiness detection. We also design a driving posture detection algorithm to control the operation of the heart rate sensor to reduce system power consumption. Extensive experimental results show that the proposed system achieves a detection accuracy up to 97.1% and reduces energy consumption by 33%.

References

[1]

Erika Abe, Koichi Fujiwara, Toshihiro Hiraoka, Toshitaka Yamakawa, and Manabu Kano. 2014. Development of drowsy driving accident prediction by heart rate variability analysis. In Proceedings of the Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA 2014). IEEE, 1--4.

[2]

Kofi Sarpong Adu-Manu, Nadir Adam, Cristiano Tapparello, Hoda Ayatollahi, and Wendi Heinzelman. 2018. Energy-harvesting wireless sensor networks (EH-WSNs): A review. ACM Trans. Sen. Netw. 6, 2, Article 10 (4 2018), 50 pages.

[3]

Muhammad Awais, Nasreen Badruddin, and Micheal Drieberg. 2017. A hybrid approach to detect driver drowsiness utilizing physiological signals to improve system performance and wearability. Sensors 17 (08 2017), 1991. https://doi.org/10.3390/s17091991

[4]

Anda Baharav, Suresh Kotagal, Vincent Gibbons, Bruce Rubin, G. Pratt, J. Karin, and S. Akselrod. 1995. Fluctuation in autonomic nervous activity during sleep displayed by power spectrum analysis of heart rate variability. Neurology 45, 6 (07 1995), 1183--1187.

[5]

Chongguang Bi, Jun Huang, Guoliang Xing, Landu Jiang, Xue Liu, and Minghua Chen. 2017. SafeWatch: A wearable hand motion tracking system for improving driving safety. In Proceedings of the 2nd International Conference on Internet-of-Things Design and Implementation (IoTDI’17). ACM, New York, 223--232.

Digital Library

[6]

Roman Bittner, Pavel Smrcka, Miroslav Pavelka, Petr Vysoky, and Lubomir Pousek. 2001. Fatigue indicators of drowsy drivers based on analysis of physiological signals. In Proceedings of the 2nd International Symposium on Medical Data Analysis (ISMDA’01). Springer-Verlag, London, UK, 62--68. http://dl.acm.org/citation.cfm?id=646351.691016

[7]

Dongyao Chen, Kyong-Tak Cho, Sihui Han, Zhizhuo Jin, and Kang G. Shin. 2015. Invisible sensing of vehicle steering with smartphones. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys’15). ACM, New York, 1--13.

[8]

Timothy P. Corey, Elana B. Gordis Melanie L. Shoup-Knox, and Gordon G. Gallup Jr. 2012. Changes in physiology before, during, and after yawning. Frontiers in Evolutionary Neuroscience 3, 7 (2012).

[9]

Taner Danisman, Ian Marius Bilasco, Chabane Djeraba, and Nacim Ihaddadene. 2010. Drowsy driver detection system using eye blink patterns. In Proceedings of the 2010 International Conference on Machine and Web Intelligence. IEEE, 230--233.

[10]

Ioanna Chouvarda Emmanouil Michail, Athina Kokonozi and Nicos Maglaveras. 2008. EEG and HRV markers of sleepiness and loss of control during car driving. In Proceedings of the IEEE 2008 30th Annual International Conference of Engineering in Medicine and Biology Society. IEEE, 2566--2569.

[11]

Ruijia Feng, Guangyuan Zhang, and Bo Cheng. 2009. An on-board system for detecting driver drowsiness based on multi-sensor data fusion using Dempster-Shafer theory. In Proceedings of the 2009 International Conference on Networking, Sensing and Control. 897--902.

[12]

Gabriela Dorfman Furman, Armanda Baharav, and C. Cahanand Solange Akselrod. 2008. Early detection of falling asleep at the wheel: A heart rate variability approach. In Proceedings of the 2008 Conference on Computers in Cardiology. IEEE, 1109--1112.

[13]

Vrushali B. Ghule and S. S. Katariya. 2015. Drowsiness detection methods for drivers: A review. International Journal of Computer Applications 122, 19 (7 2015), 36--38. https://doi.org/10.5120/21812-5141

[14]

Adrian G. Guggisberg, Johannes Mathis, Armin Schnider, and Christian W. Hess. 2011. Why do we yawn? The importance of evidence for specific yawn-induced effects. Neuroence and Biobehavioral Reviews 35, 5 (2011), 1302--1304.

[15]

Sinh Huynh, Rajesh Krishna Balan, JeongGil Ko, and Youngki Lee. 2019. VitaMon: Measuring heart rate variability using smartphone front camera. 1--14. In Proceedings of the 17th Conference on Embedded Networked Sensor Systems (SenSys'19). ACM, New York.

Digital Library

[16]

Masrullizam Mat Ibrahim, John J. Soraghan, Lykourgos Petropoulakis, and Gaetano Di Caterina. 2015. Yawn analysis with mouth occlusion detection. Biomedical Signal Processing and Control 18 (2015), 360--369.

[17]

Mahdi Ilbeygi and Hamed Shah-Hosseini. 2012. A novel fuzzy facial expression recognition system based on facial feature extraction from color face images. Eng. Appl. Artif. Intell. 25, 1 (2 2012), 130--146.

[18]

Samuel Lawoyin, Ding-Yu Fei, and Ou Bai. 2015. Accelerometer-based steering-wheel movement monitoring for drowsy-driving detection. In Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering 229, 2 (2015), 163--173. http://dx.doi.org/10.1177/0954407014536148

[19]

Samuel Lawoyin, Xin Liu, Ding-Yu Fei, and Ou Bai. 2014. Detection methods for a low-cost accelerometer-based approach for driver drowsiness detection. In Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 1636--1641.

[20]

Boon-Giin Lee, Boon-Leng Lee, and Wan-Young Chung. 2015. Smartwatch-based driver alertness monitoring with wearable motion and physiological sensor. In Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 6126--6129.

[21]

Gang Li and Wan-Young Chung. 2013. Detection of driver drowsiness using wavelet analysis of heart rate variability and a support vector machine classifier. Sensors 13, 12 (2013), 16494--16511.

[22]

Gang Li, Boon Leng Lee, and Wan-Young Chung. 2015. Smartwatch-based wearable EEG system for driver drowsiness detection. IEEE Sensors Journal 15, 12 (12 2015), 7169--7180.

[23]

Zuojin Li, Shengbo Li, Renjie Li, Bo Cheng, and Jinliang Shi. [n.d.]. Online detection of driver fatigue using steering wheel angles for real driving conditions. Sensors 17, 3 ([n.d.]), 495.

[24]

Zhenjiang Li, Yunhao Liu, Mo Li, Jiliang Wang, and Zhichao Cao. 2013. Exploiting ubiquitous data collection for mobile users in wireless sensor networks. IEEE Transactions on Parallel and Distributed Systems 24, 2 (2 2013), 312--326.

Digital Library

[25]

Yufeng Lu and Zengcai Wang. 2007. Detecting driver yawning in successive images. In Proceedings of the 2007 1st International Conference on Bioinformatics and Biomedical Engineering. IEEE, 581--583.

[26]

Yu lung Chang, Yen cheng Feng, and Oscal T. C. Chen. 2016. Real-time physiological and facial monitoring for safe driving. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 4849--4852.

[27]

Mehrdad Sabet, Reza Aghaeizadeh Zoroofi, Khosro Sadeghniiat Haghighi, and Maryam Sabbaghian. 2012. A new system for driver drowsiness and distraction detection. In Proceedings of the 20th Iranian Conference on Electrical Engineering (ICEE'12). IEEE, 1247--1251.

[28]

Ahmad Shahin Nermine Munla, Mohamad Khalil, and Azzam Mourad. 2015. Driver stress level detection using HRV analysis. In Proceedings of the 2015 International Conference on Advances in Biomedical Engineering (ICABME). 61--64.

[29]

Rau Paul Stephen. 2005. Drowsy driver detection and warning system for commercial vehicle drivers. In Field Operational Test Design, Data Analyses and Progress, National Highway Traffic Safety Administration of USA (NHTSA). 5--192.

[30]

Arun Sahayadhas, Kenneth Sundaraj, and Murugappan Murugappan. 2012. Detecting driver drowsiness based on sensors: A review. Sensors 12, 12 (12 2012), 16937--16953.

[31]

Chao Sun, Jian Li, Yang Song, and Lai Jin. 2013. Real-time driver fatigue detection based on eye state recognition. Applied Mechanics and Materials 457-458 (10 2013), 944--952.

[32]

Jose Vicente, Pablo Laguna, Ariadna Bartra, and Raquel Bailon. 2011. Detection of driver’s drowsiness by means of HRV analysis. In Proceedings of the 2011 Conference on Computing in Cardiology. IEEE, 89--92.

[33]

Zheng Yang, Lirong Jian, Chenshu Wu, and Yunhao Liu. 2013. Beyond triangle inequality: Sifting noisy and outlier distance measurements for localization. ACM Trans. Sen. Netw. 9, 2, Article 26 (4 2013), 20 pages.

Digital Library

Cited By

Liu HZhang YChen XZhang DLi RQin T(2024)Self-Supervised EEG Representation Learning for Robust Emotion RecognitionACM Transactions on Sensor Networks10.1145/367497520:5(1-22)Online publication date: 5-Jul-2024
https://dl.acm.org/doi/10.1145/3674975
Gauri Sawarkar Maithali Kulkarni Sayali Marathe Sayali Marathe Prof. Sagar Padiya (2023)Analysis of Accelerometer ApplicationsInternational Journal of Advanced Research in Science, Communication and Technology10.48175/IJARSCT-9439(426-430)Online publication date: 25-Apr-2023
https://doi.org/10.48175/IJARSCT-9439
Takamatsu SSato SItoh T(2022)Urethane-Foam-Embedded Silicon Pressure Sensors including Stress-Concentration Packaging Structure for Driver Posture MonitoringSensors10.3390/s2212449522:12(4495)Online publication date: 14-Jun-2022
https://doi.org/10.3390/s22124495
Show More Cited By

Index Terms

dWatch: A Reliable and Low-Power Drowsiness Detection System for Drivers Based on Mobile Devices
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile devices

Recommendations

Real-time driver drowsiness detection using wearable technology
SCA '19: Proceedings of the 4th International Conference on Smart City Applications

Road accidents are a worldwide problem, consequences of which can lead to death. One of the reasons drivers experience near-miss or real accidents is because of drowsy driving. Drowsy driving is considered as a major problem that not only affects the ...
Real-Time V2V Communication With a Machine Learning-Based System for Detecting Drowsiness of Drivers

This article applies machine learning to detect whether a driver is drowsy and alert the driver. The drowsiness of a driver can lead to accidents resulting in severe physical injuries, including deaths, and significant economic losses. Driver fatigue ...
Drowsy driving detection based on human pulse wave by photoplethysmography signal processing
IUCS '09: Proceedings of the 3rd International Universal Communication Symposium

Drowsiness of driver while driving is one major factor of traffic accident. Therefore, there are many researches to prevent and detect drowsy driving. Recent researches have focused on motion detection using cameras to determine drowsy driving. However, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Sensor Networks

ACM Transactions on Sensor Networks Volume 16, Issue 4

November 2020

311 pages

ISSN:1550-4859

EISSN:1550-4867

DOI:10.1145/3414039

Editor:
Yunhao Liu
Tsinghua University, China

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 16 September 2020

Accepted: 01 June 2020

Revised: 01 May 2020

Received: 01 December 2019

Published in TOSN Volume 16, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

China Postdoctoral Science Foundation
Shaanxi Science and Technology Innovation Team
China NSFC
International Cooperation Project of Shaanxi Province

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
303
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)10

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Liu HZhang YChen XZhang DLi RQin T(2024)Self-Supervised EEG Representation Learning for Robust Emotion RecognitionACM Transactions on Sensor Networks10.1145/367497520:5(1-22)Online publication date: 5-Jul-2024
https://dl.acm.org/doi/10.1145/3674975
Gauri Sawarkar Maithali Kulkarni Sayali Marathe Sayali Marathe Prof. Sagar Padiya (2023)Analysis of Accelerometer ApplicationsInternational Journal of Advanced Research in Science, Communication and Technology10.48175/IJARSCT-9439(426-430)Online publication date: 25-Apr-2023
https://doi.org/10.48175/IJARSCT-9439
Takamatsu SSato SItoh T(2022)Urethane-Foam-Embedded Silicon Pressure Sensors including Stress-Concentration Packaging Structure for Driver Posture MonitoringSensors10.3390/s2212449522:12(4495)Online publication date: 14-Jun-2022
https://doi.org/10.3390/s22124495
Xing TYang QJiang ZFu XWang JWu CChen X(2022)WiFine: Real-Time Gesture Recognition Using Wi-Fi with Edge IntelligenceACM Transactions on Sensor Networks10.1145/353209419:1(1-24)Online publication date: 8-Dec-2022
https://dl.acm.org/doi/10.1145/3532094
Fan YGu FWang JWang JLu KNiu J(2022)SafeDriving: An Effective Abnormal Driving Behavior Detection System Based on EMG SignalsIEEE Internet of Things Journal10.1109/JIOT.2021.31355129:14(12338-12350)Online publication date: 15-Jul-2022
https://doi.org/10.1109/JIOT.2021.3135512
Elmalaki S(2022)MAConAuto: Framework for Mobile-Assisted Human-in-the-Loop Automotive System2022 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV51971.2022.9827415(740-749)Online publication date: 4-Jun-2022
https://dl.acm.org/doi/10.1109/IV51971.2022.9827415
El hafidy ARachad TIdri AZellou A(2021)Gamified Mobile Applications for Improving Driving BehaviorMobile Information Systems10.1155/2021/66770752021Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.1155/2021/6677075
Xu HZhou PTan RLi MShen G(2021)LIMU-BERTProceedings of the 19th ACM Conference on Embedded Networked Sensor Systems10.1145/3485730.3485937(220-233)Online publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1145/3485730.3485937
Yang QXing TJiang ZFu XHe J(2021)WiRN: Real-Time and Lightweight Gesture Detection System on Edge Device2021 IEEE 27th International Conference on Parallel and Distributed Systems (ICPADS)10.1109/ICPADS53394.2021.00026(161-168)Online publication date: Dec-2021
https://doi.org/10.1109/ICPADS53394.2021.00026

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents