Visual alerts for operator cognitive flexibility improvement: a neuroergonomic approach
Pages 326 - 328
Abstract
This study investigates the mitigation of cognitive flexibility decrements during long-endurance Uncrewed Aerial Systems (UAS) missions through visual alerts. UAS mishaps are likely partially attributable to decreased cognitive flexibility caused by mental fatigue. Two groups of participants performed a 2-hour UAS simulation. One group was supported by visual alerts when switching between tasks, while the other was not. To further investigate the effect of visual alerts, the participant’s cerebral and cardiac activity during the task was recorded using electroencephalography (EEG) and electrocardiography (ECG). Results showed a weaker subjective increase of mental fatigue across time with visual alerts than the control group. Furthermore, behavioural results showed improved reaction time and accuracy in some performance metrics. Future work may improve this system’s efficacy by implementing it with an adaptive interface.
References
[1]
Austin. 2011. Unmanned Aircraft Systems: UAVS Design, Development and Deployment. John Wiley & Sons. Google-Books-ID: 03gdqhU61C0C.
[2]
Frédéric Dehais, Alex Lafont, Raphaëlle Roy, and Stephen Fairclough. 2020. A neuroergonomics approach to mental workload, engagement and human performance. Frontiers in neuroscience 14 (2020), 268. https://doi.org/10.3389/fnins.2020.00268 Publisher: Frontiers Media SA.
[3]
Alexandre Défossez, Charlotte Caucheteux, Jérémy Rapin, Ori Kabeli, and Jean-Rémi King. 2023. Decoding speech perception from non-invasive brain recordings. Nature Machine Intelligence 5, 10 (Oct. 2023), 1097–1107. https://doi.org/10.1038/s42256-023-00714-5 Number: 10 Publisher: Nature Publishing Group.
[4]
Andre Haider. 2021. Introduction - Joint Air Power Competence Centre. https://www.japcc.org/chapters/c-uas-introduction/
[5]
Marcel F. Hinss, Anke M. Brock, and Raphaëlle N. Roy. 2023. The double task-switching protocol: An investigation into the effects of similarity and conflict on cognitive flexibility in the context of mental fatigue. PLOS ONE 18, 2 (Feb. 2023), e0279021. https://doi.org/10.1371/journal.pone.0279021
[6]
Marcel F. Hinss, Vincenzo M. Vitale, Anke M. Brock, and Raphaelle N. Roy. 2024. EEG-based performance estimation during a realistic drone piloting task. Graz, Austria. https://doi.org/hal-04596992v1
[7]
Marcel F. Hinss, Vincenzo M. Vitale, N. Tien Phan, Raphaelle N. Roy, and Anke M. Brock. 2024. UASOS: An Experimental Environment For Assessing Mental Fatigue & Cognitive Flexibility During Drone Operations. ACM, Boulder Colorad, USA. https://doi.org/10.1145/3610977.3637484
[8]
Kosuke Kaida, Masaya Takahashi, Torbjörn Åkerstedt, Akinori Nakata, Yasumasa Otsuka, Takashi Haratani, and Kenji Fukasawa. 2006. Validation of the Karolinska sleepiness scale against performance and EEG variables. Clinical Neurophysiology 117, 7 (July 2006), 1574–1581. https://doi.org/10.1016/j.clinph.2006.03.011
[9]
Andrea Kiesel, Marco Steinhauser, Mike Wendt, Michael Falkenstein, Kerstin Jost, Andrea M. Philipp, and Iring Koch. 2010. Control and interference in task switching—A review.Psychological Bulletin 136, 5 (2010), 849–874. https://doi.org/10.1037/a0019842
[10]
Iring Koch, Edita Poljac, Hermann Müller, and Andrea Kiesel. 2018. Cognitive structure, flexibility, and plasticity in human multitasking—An integrative review of dual-task and task-switching research.Psychological Bulletin 144, 6 (June 2018), 557–583. https://doi.org/10.1037/bul0000144
[11]
Julie Saint-Lot, Jean-Paul Imbert, and Frédéric Dehais. 2020. Red Alert: A Cognitive Countermeasure to Mitigate Attentional Tunneling. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–6. https://doi.org/10.1145/3313831.3376709
[12]
Sherwood W. Samn and Layne P. Perelli. 1982. Estimating Aircrew Fatigue: A Technique with Application to Airlift Operations. Technical Report SAM-TR-82-21. Brooks AFB, TX: USAF School of Aerospace Medicine.
[13]
Teresa Scheiman, Wayne Chappelle, and Elizabeth Sanford. 2017. U.S. Air Force Special Operations Command Remotely Piloted Aircraft Operator Fatigue Levels and Compensatory Strategies. (2017), 49.
[14]
P. N. Squire and R. Parasuraman. 2010. Effects of automation and task load on task switching during human supervision of multiple semi-autonomous robots in a dynamic environment. Ergonomics 53, 8 (Aug. 2010), 951–961. https://doi.org/10.1080/00140139.2010.489969
[15]
Jaimie F. Veale. 2014. Edinburgh Handedness Inventory - Short Form: a revised version based on confirmatory factor analysis. Laterality 19, 2 (2014), 164–177. https://doi.org/10.1080/1357650X.2013.783045
[16]
Qaisar R. (“Raza”) Waraich, Thomas A. Mazzuchi, Shahram Sarkani, and David F. Rico. 2013. Minimizing Human Factors Mishaps in Unmanned Aircraft Systems. Ergonomics in Design: The Quarterly of Human Factors Applications 21, 1 (Jan. 2013), 25–32. https://doi.org/10.1177/1064804612463215
[17]
Edmund Wascher, Björn Rasch, Jessica Sänger, Sven Hoffmann, Daniel Schneider, Gerhard Rinkenauer, Herbert Heuer, and Ingmar Gutberlet. 2014. Frontal theta activity reflects distinct aspects of mental fatigue. Biological Psychology 96 (2014), 57–65. https://doi.org/10.1016/j.biopsycho.2013.11.010
Index Terms
- Visual alerts for operator cognitive flexibility improvement: a neuroergonomic approach
Recommendations
Depart and approach procedures for UAS in a VFR environment
ATACCS '11: Proceedings of the 1st International Conference on Application and Theory of Automation in Command and Control SystemsThis paper assesses the depart and approach operations of Unmanned Aircraft Systems (UAS) in one of the most challenging scenarios: when flying under Visual Flight Rules (VFR). Inspired by some existing procedures for (manned) general aviation, some ...
Net-Centric Communication and Control for a Heterogeneous Unmanned Aircraft System
This paper presents a net-centric communication, command, and control architecture for a heterogeneous unmanned aircraft system comprised of small and miniature unmanned aircraft. An integrated system was developed using a bottom-up design approach to ...
Controlled Emergency Landing of an Unpowered Unmanned Aerial System
The ability to perform autonomous emergency (forced) landings is one of the key technology enablers identified for UAS. This paper presents the flight test results of forced landings involving a UAS, in a controlled environment, and which was conducted ...
Comments
Information & Contributors
Information
Published In
November 2024
502 pages
ISBN:9798400711787
DOI:10.1145/3687272
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 24 November 2024
Check for updates
Author Tags
Qualifiers
- Poster
- Research
- Refereed limited
Conference
HAI '24
Sponsor:
HAI '24: International Conference on Human-Agent Interaction
November 24 - 27, 2024
Swansea, United Kingdom
Acceptance Rates
Overall Acceptance Rate 121 of 404 submissions, 30%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 9Total Downloads
- Downloads (Last 12 months)9
- Downloads (Last 6 weeks)9
Reflects downloads up to 03 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format