Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Public Access

SafeDrive: Detecting Distracted Driving Behaviors Using Wrist-Worn Devices

Published: 08 January 2018 Publication History

Abstract

Distracted driving causes a large number of fatalities every year and is now becoming an important issue in the traffic safety study. In this paper, we present SafeDrive, a driving safety system that leverages wearable wrist sensing techniques to detect and analyze driver distracted behaviors. Existing wrist-worn sensing approaches, however, do not address challenges under real driving environments, such as less distinguishable gesture patterns due to in-vehicle physical constraints, various gesture hallmarks produced by different drivers and significant noise introduced by various driving conditions. In response, SafeDrive adopts a semi-supervised machine learning model for in-vehicle distracting activity detection. To improve the detection accuracy, we provide online updated classifiers by collecting real-time gesture data, while at the same time utilize smartphone sensing to generate soft hints filtering out anomalies and non-distracted hand movements. In the evaluation, we conduct extensive real-road experiments involving 20 participants (10 males and 10 females) and 5 vehicles (a sedan, a minivan and three SUVs). Our approach can achieve an average classification accuracy of over 90% with a error rate of a few percent, which demonstrate that SafeDrive is robust to real driving environments, and has great potential to help drivers shape safe driving habits.

References

[1]
Fadel Adib and Dina Katabi. 2013. See through walls with wifi! Vol. 43. ACM.
[2]
Brojeshwar Bhowmick and KS Chidanand Kumar. 2009. Detection and classification of eye state in IR camera for driver drowsiness identification. In Signal and Image Processing Applications (ICSIPA), 2009 IEEE International Conference on. IEEE, 340--345.
[3]
Tadeusz Caliński and Jerzy Harabasz. 1974. A dendrite method for cluster analysis. Communications in Statistics-theory and Methods 3, 1 (1974), 1--27.
[4]
Dongyao Chen, Kyong-Tak Cho, Sihui Han, Zhizhuo Jin, and Kang G Shin. 2015. Invisible sensing of vehicle steering with smartphones. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 1--13.
[5]
Bi Chongguang, Huang Jun, Xing Guoliang, Jiang Landu, Liu Xue, and Chen Minghua. 2017. SafeWatch: A Wearable Hand Motion Tracking System for Improving Driving Safety. In Internet-of-Things Design and Implementation (IoTDI), 2017 IEEE. IEEE.
[6]
Hon Chu, Vasumathi Raman, Jianbing Shen, Apoorv Kansal, Victor Bahl, and Romit Roy Choudhury. 1991. I am a smartphone and I know my user is driving. In Communication Systems and Networks (COMSNETS), 2014 Sixth International Conference on. 1--8.
[7]
Hon Lung Chu, Vijay Raman, Jeffrey Shen, Romit Roy Choudhury, Aman Kansal, and Victor Bahl. 2011. Poster: you driving? talk to you later. In MobiSys. 397--398.
[8]
T Cover. 1968. Estimation by the nearest neighbor rule. IEEE Transactions on Information Theory 14, 1 (1968), 50--55.
[9]
Desjardins. 2017. Ajusto program. (2017). https://www.desjardins.com/ca/personal/insurance/car-insurance/ajusto/.
[10]
Honda Car Forum. 2016. Vehicle interior. (2016). http://www.hondacarforum.com/honda-pilot/46956-2009-honda-pilot-interior.html.
[11]
Hang Gao, Xiangyu Xu, Jiadi Yu, Yingying Chen, Yanmin Zhu, Guangtao Xue, and Minglu Li. 2017. ER: Early Recognition of Inattentive Driving Leveraging Audio Devices on Smartphones. In INFOCOM, 2017 Proceedings IEEE. IEEE.
[12]
Haofu Han, Jiadi Yu, Hongzi Zhu, Yingying Chen, Jie Yang, Yanmin Zhu, Guangtao Xue, and Minglu Li. 2014. Senspeed: Sensing driving conditions to estimate vehicle speed in urban environments. In INFOCOM, 2014 Proceedings IEEE. IEEE, 727--735.
[13]
Hoffmann-Krippner. 2015. Smart steering wheel detects driver drowsiness. (2015). http://www.hoffmann-krippner.com/news.html.
[14]
Derick A Johnson and Mohan M Trivedi. 2011. Driving style recognition using a smartphone as a sensor platform. In Intelligent Transportation Systems (ITSC), 2011 14th International IEEE Conference on. IEEE, 1609--1615.
[15]
Cagdas Karatas, Luyang Liu, Hongyu Li, Jian Liu, Yan Wang, Sheng Tan, Jie Yang, Yingying Chen, Marco Gruteser, and Richard Martin. 2016. Leveraging wearables for steering and driver tracking. In Computer Communications, IEEE INFOCOM 2016-The 35th Annual IEEE International Conference on. IEEE, 1--9.
[16]
Heli Koskimaki, Ville Huikari, Pekka Siirtola, Perttu Laurinen, and Juha Roning. 2009. Activity recognition using a wrist-worn inertial measurement unit: A case study for industrial assembly lines. In Control and Automation, 2009. MED‘09. 17th Mediterranean Conference on. IEEE, 401--405.
[17]
Jiang Landu, Chen Xi, and He Wenbo. 2016. SafeCam: Analyzing intersection-related driver behaviors using multi-sensor smartphones. In 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom). 1--9.
[18]
Charles C Liu, Simon G Hosking, and Michael G Lenné. 2009. Predicting driver drowsiness using vehicle measures: Recent insights and future challenges. Journal of safety research 40, 4 (2009), 239--245.
[19]
Pavlo Molchanov, Shalini Gupta, Kihwan Kim, and Kari Pulli. 2015. Multi-sensor system for driver's hand-gesture recognition. In Automatic Face and Gesture Recognition (FG), 2015 11th IEEE International Conference and Workshops on, Vol. 1. IEEE, 1--8.
[20]
NHTSA. 2002. Engaging in Potentially Distracting Behaviors While Driving. (2002). http://www.nhtsa.gov/people/injury/drowsy_driving1/survey-distractive03/summary.htm.
[21]
NHTSA. 2006. Breakthrough Research on Real-World Driver Behavior Released. (2006). http://www.nhtsa.gov/Driving+Safety/Distracted+Driving+at+Distraction.gov/Breakthrough+Research+on+Real-World+Driver+Behavior+Released.
[22]
NHTSA. 2016. Distracted Driving. (2016). https://www.nhtsa.gov/risky-driving/distracted-driving.
[23]
NTSB. 2011. No call, no text, no update behind the wheel: NTSB calls for nationwide ban on PEDs while driving. (2011). https://www.ntsb.gov/news/press-releases/Pages/No_call_no_text_no_update_behind_the_wheel_NTSB_calls_for_nationwide_ban_on_PEDs_while_driving.aspx.
[24]
Eshed Ohn-Bar and Mohan Manubhai Trivedi. 2014. Hand gesture recognition in real time for automotive interfaces: A multimodal vision-based approach and evaluations. Intelligent Transportation Systems, IEEE Transactions on 15, 6 (2014), 2368--2377.
[25]
Ryuichi Oka. 1998. Spotting method for classification of real world data. Comput. J. 41, 8 (1998), 559--565.
[26]
Francisco Parada-Loira, Elisardo González-Agulla, and José L Alba-Castro. 2014. Hand gestures to control infotainment equipment in cars. In 2014 IEEE Intelligent Vehicles Symposium Proceedings. IEEE, 1--6.
[27]
Taiwoo Park, Jinwon Lee, Inseok Hwang, Chungkuk Yoo, Lama Nachman, and Junehwa Song. 2011. E-gesture: a collaborative architecture for energy-efficient gesture recognition with hand-worn sensor and mobile devices. In Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems. ACM, 260--273.
[28]
Bastian Pfleging and Albrecht Schmidt. 2015. driving-related activities in the car: Defining driver activities for manual and automated driving. In Workshop on Experiencing Autonomous Vehicles: Crossing the Boundaries between a Drive and a Ride at CHI, Vol. 15.
[29]
Aditya Ramamoorthy, Namrata Vaswani, Santanu Chaudhury, and Subhashis Banerjee. 2003. Recognition of dynamic hand gestures. Pattern Recognition 36, 9 (2003), 2069--2081.
[30]
Juhi Ranjan and Kamin Whitehouse. 2015. Object hallmarks: Identifying object users using wearable wrist sensors. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 51--61.
[31]
Michael A Regan, Charlene Hallett, and Craig P Gordon. 2011. Driver distraction and driver inattention: Definition, relationship and taxonomy. Accident Analysis 8 Prevention 43, 5 (2011), 1771--1781.
[32]
Sheng Shen, He Wang, and Romit Roy Choudhury. 2016. I am a Smartwatch and I can Track my User's Arm. In Proceedings of the 14th annual international conference on Mobile systems, applications, and services.
[33]
SMARTwheel. 2016. The first intelligent steering wheel cover. (2016). https://smartwheelusa.com/.
[34]
Lina Tong, Quanjun Song, Yunjian Ge, and Ming Liu. 2013. HMM-based human fall detection and prediction method using tri-axial accelerometer. IEEE Sensors Journal 13, 5 (2013), 1849--1856.
[35]
txtBlocker. 2016. txtBlocker. (2016). http://www.txtblocker.com.
[36]
Esra Vural, Mujdat Cetin, Aytul Ercil, Gwen Littlewort, Marian Bartlett, and Javier Movellan. 2007. Drowsy driver detection through facial movement analysis. Human--computer interaction (2007), 6--18.
[37]
He Wang, Ted Tsung-Te Lai, and Romit Roy Choudhury. 2015. Mole: Motion leaks through smartwatch sensors. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 155--166.
[38]
Yan Wang, Jie Yang, Hongbo Liu, Yingying Chen, Marco Gruteser, and Richard P Martin. 2013. Sensing vehicle dynamics for determining driver phone use. In Proceeding of the 11th annual international conference on Mobile systems, applications, and services. ACM, 41--54.
[39]
Wikipedia. 2016. Distracted driving. (2016). https://en.wikipedia.org/wiki/Distracted_driving.
[40]
Chuang-Wen You, Martha Montes-de Oca, Thomas J Bao, Nicholas D Lane, Hong Lu, Giuseppe Cardone, Lorenzo Torresani, and Andrew T Campbell. 2012. CarSafe: a driver safety app that detects dangerous driving behavior using dual-cameras on smartphones. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing. ACM, 671--672.
[41]
Chun Zhu and Weihua Sheng. 2011. Wearable sensor-based hand gesture and daily activity recognition for robot-assisted living. Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on 41, 3 (2011), 569--573.
[42]
Martin Zobl, Michael Geiger, Bjorn Schuller, Manfred Lang, and Gerhard Rigoll. 2003. A real-time system for hand gesture controlled operation of in-car devices. In Multimedia and Expo, 2003. ICME‘03. Proceedings. 2003 International Conference on, Vol. 3. IEEE, III--541.

Cited By

View all
  • (2024)TimelyTale: A Multimodal Dataset Approach to Assessing Passengers' Explanation Demands in Highly Automated VehiclesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785448:3(1-60)Online publication date: 9-Sep-2024
  • (2024)RFDrive: Tagged Human-Vehicle Interaction for AllACM Journal on Computing and Sustainable Societies10.1145/36485332:2(1-19)Online publication date: 15-Feb-2024
  • (2024)EVLeSen: In-Vehicle Sensing with EV-Leaked SignalProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649389(679-693)Online publication date: 29-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 1, Issue 4
December 2017
1298 pages
EISSN:2474-9567
DOI:10.1145/3178157
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 January 2018
Accepted: 01 October 2017
Revised: 01 August 2017
Received: 01 May 2017
Published in IMWUT Volume 1, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Activity Recognition
  2. Driving Safety
  3. Mobile Sensing
  4. Wrist-Worn Sensing

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • Mitacs
  • National Science Foundation
  • NSERC Collaborative Research and Development Grant
  • NSERC Discovery Grant
  • Canada Foundation for Innovation's John R. Evans Leaders Fund

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)178
  • Downloads (Last 6 weeks)23
Reflects downloads up to 15 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)TimelyTale: A Multimodal Dataset Approach to Assessing Passengers' Explanation Demands in Highly Automated VehiclesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785448:3(1-60)Online publication date: 9-Sep-2024
  • (2024)RFDrive: Tagged Human-Vehicle Interaction for AllACM Journal on Computing and Sustainable Societies10.1145/36485332:2(1-19)Online publication date: 15-Feb-2024
  • (2024)EVLeSen: In-Vehicle Sensing with EV-Leaked SignalProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649389(679-693)Online publication date: 29-May-2024
  • (2024)LGD-FCOS: driver distraction detection using improved FCOS based on local and global knowledge distillationJournal of Electronic Imaging10.1117/1.JEI.33.4.04304633:04Online publication date: 1-Jul-2024
  • (2024)SmartDetect: Safe Driving by Detecting Steering-Wheel Handling With a Single SmartwatchIEEE Sensors Journal10.1109/JSEN.2024.337948624:10(16325-16335)Online publication date: 15-May-2024
  • (2024)Is Driver on Phone Call? Mobile Device Localization Using Cellular SignalIEEE Journal on Selected Areas in Communications10.1109/JSAC.2024.341396342:9(2339-2353)Online publication date: 13-Jun-2024
  • (2024)RideGuard: Micro-Mobility Steering Maneuver Prediction with Smartphones2024 IEEE 44th International Conference on Distributed Computing Systems (ICDCS)10.1109/ICDCS60910.2024.00100(1039-1049)Online publication date: 23-Jul-2024
  • (2024)AIMSafe: EEG-Based Driver Behavior Understanding via Attention and Incremental Learning MechanismsMobile and Ubiquitous Systems: Computing, Networking and Services10.1007/978-3-031-63992-0_16(244-255)Online publication date: 19-Jul-2024
  • (2024)Driver Distraction Detection Using Artificial Intelligence and Smart DevicesIntelligent Secure Trustable Things10.1007/978-3-031-54049-3_16(285-308)Online publication date: 20-Jun-2024
  • (2023)HeadSense: Visual Search Monitoring and Distracted Behavior Detection for Bicycle Riders2023 IEEE 24th International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM)10.1109/WoWMoM57956.2023.00043(281-289)Online publication date: Jun-2023
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media