Abstract
Pilot training is crucial for learning and practicing operations and safety procedures. The sooner pilots become acquainted with flight deck instrumentation and actions, the faster, safer, and cost-effective the training. Active learning with pilot training includes searching tasks and memorization ability. These aspects then need to be incorporated into the flight simulator training. The use of virtual reality (VR) technologies can in principle take pilot training to the next level. VR technologies such as head-mounted displays can provide a higher sense of presence in the observed sceneries and a more natural interaction than traditional (non-immersive) display systems (e.g. 2D monitors). There is, however, some reluctance towards using immersive VR systems in aviation training and a lack of knowledge on its effectiveness, which results in slow take-up of VR solutions and the dominant use of 2D monitors. This paper aims to assess the performance advantage an immersive system such as a head-mounted display (HMD) brings to pilot training. The focus is on presence, search tasks and memorization. We experiment with actions of learning instrumentation and procedures in the cockpit. We run the same activities on both a HMD and 2D monitor. We gather data on users’ performance in terms of accuracy, the success of actions, completion time and memorization through objective measurements. We also acquire data on presence and comfort through subjective rating.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Lutte, B.: Pilot supply at the regional airlines: airline response to the changing environment and the impact on pilot hiring. J. Aviat. Educ. Res. 27, 1–22 (2018). https://doi.org/10.15394/jaaer.2018.1749
Losey, S.: The Air Force is revolutionizing the way airmen learn to be aviators. https://www.airforcetimes.com/news/your-air-force/2018/09/30/the-air-force-is-revolutionizing-the-way-airmen-learn-to-be-aviators/. Accessed 25 Apr 2022
Walters, W.T., Walton, J.: Efficacy of virtual reality training for pilots: a review of links between user presence, search task performance, and collaboration within virtual reality. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 65, 919–922 (2021). https://doi.org/10.1177/1071181321651347
Pritchett, A.R., Nix, D.C., Ockerman, J.J.: Empirical evaluations of pilot planning behavior in emergency situations. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 45, 6–10 (2001). https://doi.org/10.1177/154193120104500201
Slater, M., Wilbur, S.: A framework for immersive virtual environments (FIVE): speculations on the role of presence in virtual environments. Presence Teleoper. Virtual Environ. 6, 603–616 (1997). https://doi.org/10.1162/pres.1997.6.6.603
Dymora, P., Kowal, B., Mazurek, M., Romana, S.: The effects of virtual reality technology application in the aircraft pilot training process. IOP Conf. Ser. Mater. Sci. Eng. 1024, 012099 (2021). https://doi.org/10.1088/1757-899X/1024/1/012099
Hight, M., Fussell, S., Kurkchubasche, M., Hummell, I.: Effectiveness of virtual reality simulations for civilian, Ab Initio pilot training. J. Aviat. Educ. Res. 31, 1 (2022). https://doi.org/10.15394/jaaer.2022.1903
The Air Force’s Virtual Reality Fighter Training Is Working Best for 5th-Gen Pilots | Military.com. https://www.military.com/daily-news/2021/03/26/air-forces-virtual-reality-fighter-training-working-best-5th-gen-pilots.html. Accessed 25 Apr 2022
US Air Force trials virtual reality for crew chief course - Airforce Technology. https://www.airforce-technology.com/analysis/us-air-force-trials-virtual-reality-for-crew-chief-course/. Accessed 25 Apr 2022
Are VR flight simulators the future of pilot training? https://www.aircharterservice.com/about-us/news-features/blog/are-vr-flight-simulators-the-future-of-pilot-training. Accessed 25 Apr 2022
Jaakola, M.: Current Virtual Reality Solutions and Possibilities for Training Within Aviation 58
Nilsson, N., Nordahl, R., Serafin, S.: Immersion revisited: a review of existing definitions of immersion and their relation to different theories of presence. Hum. Technol. 12, 108–134 (2016). https://doi.org/10.17011/ht/urn.201611174652
Baceviciute, S., Cordoba, A.L., Wismer, P., Jensen, T.V., Klausen, M., Makransky, G.: Investigating the value of immersive virtual reality tools for organizational training: an applied international study in the biotech industry. J. Comput. Assist. Learn. 38, 470–487 (2022). https://doi.org/10.1111/jcal.12630
Nash, E., Edwards, G., Thompson, J., Barfield, W.: A review of presence and performance in virtual environments. Int. J. Hum. Comput. Interact. 12, 1–41 (2000). https://doi.org/10.1207/S15327590IJHC1201_1
Emami, Z., Chau, T.: The effects of visual distractors on cognitive load in a motor imagery brain-computer interface. Behav. Brain Res. 378, 112240 (2020). https://doi.org/10.1016/j.bbr.2019.112240
Olk, B., Dinu, A., Zielinski, D.J., Kopper, R.: Measuring visual search and distraction in immersive virtual reality. R. Soc. Open Sci. 5, 172331 (2018). https://doi.org/10.1098/rsos.172331
Marquardt, A., Trepkowski, C., Eibich, T.D., Maiero, J., Kruijff, E., Schöning, J.: Comparing non-visual and visual guidance methods for narrow field of view augmented reality displays. IEEE Trans. Vis. Comput. Graph. 26, 3389–3401 (2020). https://doi.org/10.1109/TVCG.2020.3023605
Lleras, A., Wang, Z., Madison, A., Buetti, S.: Predicting search performance in heterogeneous scenes: quantifying the impact of homogeneity effects in efficient search. Collabra Psychol. 5, 2 (2019). https://doi.org/10.1525/collabra.151
Makransky, G., Petersen, G.B.: The cognitive affective model of immersive learning (CAMIL): a theoretical research-based model of learning in immersive virtual reality. Educ. Psychol. Rev. 33(3), 937–958 (2021). https://doi.org/10.1007/s10648-020-09586-2
Krokos, E., Plaisant, C., Varshney, A.: Virtual memory palaces: immersion aids recall. Virtual Real. 23(1), 1–15 (2018). https://doi.org/10.1007/s10055-018-0346-3
Stanton, N.A., Salmon, P.M., Walker, G.H.: Let the reader decide: a paradigm shift for situation awareness in sociotechnical systems. J. Cogn. Eng. Decis. Mak. 9, 44–50 (2015). https://doi.org/10.1177/1555343414552297
JohnsonGlenberg, M.C., Bartolomea, H., Kalina, E.: Platform is not destiny: embodied learning effects comparing 2D desktop to 3D virtual reality STEM experiences. J. Comput. Assist. Learn. 37, 1263–1284 (2021). https://doi.org/10.1111/jcal.12567
Cooper, N., Milella, F., Pinto, C., Cant, I., White, M., Meyer, G.: The effects of substitute multisensory feedback on task performance and the sense of presence in a virtual reality environment. PLoS ONE 13, e0191846 (2018). https://doi.org/10.1371/journal.pone.0191846
Livatino, S., et al.: Stereoscopic visualization and 3-D technologies in medical endoscopic teleoperation. IEEE Trans. Ind. Electron. 62, 525–535 (2015). https://doi.org/10.1109/TIE.2014.2334675
Pomplun, M., Garaas, T.W., Carrasco, M.: The effects of task difficulty on visual search strategy in virtual 3D displays. J. Vis. 13, 24 (2013). https://doi.org/10.1167/13.3.24
Wallet, G., Sauzéon, H., Pala, P., Florian, L., Zheng, X., Bernard, N.: Virtual/real transfer of spatial knowledge: benefit from visual fidelity provided in a virtual environment and impact of active navigation. Cyberpsychol. Behav. Soc. Netw. 14, 417–423 (2011). https://doi.org/10.1089/cyber.2009.0187
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Livatino, S. et al. (2022). Are We Ready for Take-Off ? Learning Cockpit Actions with VR Headsets. In: De Paolis, L.T., Arpaia, P., Sacco, M. (eds) Extended Reality. XR Salento 2022. Lecture Notes in Computer Science, vol 13445. Springer, Cham. https://doi.org/10.1007/978-3-031-15546-8_13
Download citation
DOI: https://doi.org/10.1007/978-3-031-15546-8_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15545-1
Online ISBN: 978-3-031-15546-8
eBook Packages: Computer ScienceComputer Science (R0)