Continuous-time feedback device to enhance situation awareness during take-over requests in automated driving conditions
Pages 319 - 323
Abstract
Conditional automation may require drivers of Autonomous Vehicles (AVs) to turn their attention away from the roads by taking part, for instance, in Non-Driving Related Tasks (NDRTs). That might cause them a lack of Situation Awareness (SA) when resuming to manual control. Consequently, Take-Over Requests (TORs) are system events intended to inform drivers when the vehicle is unable to handle an upcoming situation that is outside its Operational Design Domain (ODD) and the automated system might get disengaged, requiring driver's attention. The short time frame of time-critical TOR events impacts on the performance of the machine-to-human transition, especially when the driver is engaged with NDRTs. This can lead to dangerous driving conditions. In that context, this work proposes the demonstration of a device called Adaptive Tactile Device (ATD), capable of continuously adjust itself according to the driving conditions and smooth control transition by constantly informing the driver about road and system state based on force haptic feedback. The Continuous-Time (CT) nature of the proposed device is intended to provide adaptive feedback during automated vehicle conditions, promoting a feeling of control and possibly improving driver's Situation Awareness (SA) during TOR events. Future work will consider implementing this device on the steering wheel or driver's seat and collect the user's Quality of Experience (QoE) when using it in Virtual Reality (VR) simulations, to be compared with the user's objective and subjective metrics when receiving Discrete-Time (DT) feedback warnings previously applied in TOR research.
References
[1]
Amazon Echo 2020 review: the best-sounding smart speaker under £100: 2022. https://www.theguardian.com/technology/2020/dec/07/amazon-echo-2020-review-the-best-sounding-smart-speaker-under-100. Accessed: 2022- 02- 25.
[2]
Electric Cars, Solar & Clean Energy | Tesla: 2022. https://www.tesla.com/. Accessed: 2022- 02- 25.
[3]
Rahman, M. 2016. Driver acceptance of advanced driver assistance systems and semi-autonomous driving systems.
[4]
Najm, W. et al. 2006. Evaluation of an Automotive Rear-End Collision Avoidance System. U.S. Department of Transportation National Highway Traffic Safety Administration.
[5]
Bengler, K. et al. 2014. Three Decades of Driver Assistance Systems. IEEE Intelligent Transportation Systems Magazine. 6, 4, 6--22.
[6]
Adell, E. 2009. Acceptance of driver support systems. Lund University, Sweden.
[7]
Lee, J., & See, K. A. 2004. Trust in Automation: Designing for Appropriate Reliance. Human Factors, 46, 1, 50--80;
[8]
Körber, M. et al. 2018. Why Do I Have to Drive Now? Post Hoc Explanations of Takeover Requests Human Factors The Journal of the Human Factors and Ergonomics Society, 60, 3, 305--323.
[9]
Take-over request: 2020. https://www.nature.com/articles/s41928-020-0440-x#citeas. Accessed: 2022-02-25.
[10]
Petermeijer, S. et al. 2017. Driver response times to auditory, visual and tactile take-over requests: a simulator study with 101 participants. IEEE International Conference on Systems, Man and Cybernetics (SMC).
[11]
Melcher, V. et al. 2015 Take-Over Requests for automated driving. 6th International Conference on Applied Human Factors and Ergonomics (AHFE 2015), Procedia Manufacturing, 3, 2867 -- 2873.
[12]
Geitner, C. et al. 2019. The comparison of auditory, tactile, and multimodal warnings for the effective communication of unexpected events during an automated driving scenario. Transportation Research Part F: Traffic Psychology and Behaviour, 65, 23--33.
[13]
Beggiato, M. et al. 2013. The evolution of mental model, trust and acceptance of adaptive cruise control in relation to initial information. Transportation Research Part F - Traffic Psychology and Behaviour.
[14]
Yang, Y. et al. 2017. A method to improve driver's situation awareness in automated driving. Proceedings of the Human Factors and Ergonomics Society Europe Chapter, 29--47.
[15]
Spence, C. et al. 2008. Tactile and multisensory spatial warning signals for drivers. IEEE Transactions on Haptics, 1, 2, 121--129.
[16]
Morales-Alvarez, W. et al. 2020. Automated Driving: A Literature Review of the Take Over Request in Conditional Automation. MDPI electronics, 9, 2087.
[17]
Rezvani, T. et al. 2016. Towards Trustworthy Automation: User Interfaces that Convey Internal and External Awareness. IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).
[18]
Naujoks, F. et al. 2016. Speech improves human-automation cooperation in automated driving. Aachen: workshop Automotive HMI.
[19]
Gold, C. et al. 2013. Take over! How long does it take to get the driver back into the loop? Proceedings of the Human Factors an Ergonomics Society 57th Annual Meeting 2013.
[20]
Telpaz, A. et al. 2017. Using a Vibrotactile Seat for Facilitating the Handover of Control during Automated Driving. International Journal of Mobile Human Computer Interaction 9,3,17--33.
[21]
Shakeri, G. et al. 2016. Evaluating Haptic Feedback on a Steering Wheel in a Simulated Driving Scenario. 1744--1751.
[22]
Seppelt, B. et al. 2019. Keeping the driver in the loop: Dynamic feedback to support appropriate use of imperfect vehicle control automation. International Journal of Human-Computer Studies, 125, 66--80.
[23]
Bazilinskyy, P. et al. 2015. Auditory interfaces in automated driving: an international survey. PeerJ Computer Science 1:e13.
[24]
Helldin, T. et al. 2013. Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving. AutomotiveUI: Proceedings of the 5th International Conference on Automotive User, 210--217.
[25]
Lee, Y. et al. 2020. An Evaluation of the Effectiveness of Virtual Reality in Air Traffic Control. 7--17.
[26]
Liu, X. et al. 2018. Virtual Reality and Its Application in Military. IOP Conf. Ser.: Earth Environ. Sci. 170 032155
[27]
Psotka, J. 1995. Immersive training systems: Virtual Reality and education and training, Instructional Science, 23, 405--431.
[28]
NVIDIA: World Leader in Artificial Intelligence Computing: 2022. http://www.nvidia.com/page/home.html. Accessed: 2022- 02- 25.
[29]
Ford. 2022. https://corporate.ford.com/. Accessed: 2022- 02- 25.
[30]
Nascimento, A. et al. 2019. The Role of Virtual Reality in Autonomous Vehicles Safety. 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR).
[31]
Petersen, G. et al. 2021. A study of how immersion and interactivity drive VR learning. Computers & Education, 179.
[32]
Brookes, J. et al. 2019. Studying human behaviour with virtual reality: the Unity Experiment Framework. Behaviour Research Methods 52, 455--463.
[33]
Yeung, A. et al. 2021. Virtual and Augmented Reality Applications in Medicine: Analysis of the Scientific Literature. Journal of Medical Internet Research (JMIR).
[34]
How NASA uses virtual reality to train astronauts: 2022. https://spacecenter.org/how-nasa-uses-virtual-reality-to-train-astronauts/. Accessed: 2022- 02- 21.
[35]
Möller, S. and Raake, A. 2016. Quality of Experience Advanced Concepts, Applications and Methods. SPRINGER.
[36]
Carruth, G. et al. 1980. Oxford American Dictionary. Oxford University Press.
[37]
Dzindolet, T. et al. 2003. The role of trust in automation reliance. International Journal of Human-Computer Studies.
[38]
Chen, W. et al. 2019. Measurement of Driver's Mental Workload in Partial Autonomous Driving. IFAC-PapersOnLine, 52,19,347--352.
[39]
Stanton, N. et al. 1997. Drive-by-wire: The case of driver workload and reclaiming control with adaptive cruise control. Safety Science, 27,2-3,149--159.
[40]
Young, M. and Stanton, N. 2007. What's skill got to do with it? Vehicle Automation and driver mental workload. Ergonomics 50,8.
[41]
Bainbridge, L. 1983. Ironies of automation. Automatica, 19,6,775--779.
[42]
Rodríguez, J. et al. 2019. Active and Passive haptic Perception of Shape: Passive Haptics Can Support Navigation. Electronics MDPI, 8,3.
[43]
Cabrall, C. et al. 2020. Redesigning Today's Driving Automation Toward Adaptive Backup Control With Context-Based and Invisible Interfaces. Human Factors, 62, 2, 211--228.
[44]
Risk Solutions 2012. Contributory factors analysis for road traffic collisions. Transport Infrastructure Ireland.
Recommendations
Evaluating Effects of Cognitive Load, Takeover Request Lead Time, and Traffic Density on Drivers’ Takeover Performance in Conditionally Automated Driving
AutomotiveUI '20: 12th International Conference on Automotive User Interfaces and Interactive Vehicular ApplicationsIn conditionally automated driving, drivers engaged in non-driving related tasks (NDRTs) have difficulty taking over control of the vehicle when requested. This study aimed to examine the relationships between takeover performance and drivers’ ...
Investigating the Design of Information Presentation in Take-Over Requests in Automated Vehicles
MobileHCI '21: Proceedings of the 23rd International Conference on Mobile Human-Computer InteractionIn (partially) automated vehicles, users will sometimes have to take over control due to system failure or reach of an operational driving domain end. In such scenarios, the user becomes the driver and has to quickly gain situational awareness. With ...
HEDGEHOG: A Steering Wheel Prototype to Continuously Enhance Driver's Situation Awareness During Conditional Vehicle Automation
AutomotiveUI '22: Adjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular ApplicationsIn the Automated Driving Systems domain, conditional automation requires the driver to be ready to resume vehicle control if a Take-Over Request is triggered. Keeping a constant alert cognitive state, however, is one of the biggest challenges for ...
Comments
Information & Contributors
Information
Published In
June 2022
432 pages
ISBN:9781450392839
DOI:10.1145/3524273
- General Chairs:
- Niall Murray,
- Gwendal Simon,
- Mylene Farias,
- Program Chairs:
- Irene Viola,
- Mario Montagud
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 August 2022
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- AIT President Seed Fund
Conference
MMSys '22
Sponsor:
Acceptance Rates
Overall Acceptance Rate 176 of 530 submissions, 33%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 158Total Downloads
- Downloads (Last 12 months)36
- Downloads (Last 6 weeks)3
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in