Cognitive Workload Assessment of Aircraft Pilots
- 1 Departement d’Informatique et de Recherche Operationnelle, Universite de Montreal, Montreal, Canada
- 2 Departement d’Informatique et de Recherche Operationnelle, Universite de Montreal, Montreal, Canada
- 3 Departement d’Informatique et de Recherche Operationnelle, Universite de Montreal, Montreal, Canada
Abstract
In this research, we study the cognitive workload of aircraft pilots during a simulated takeoff procedure. We propose a proof-of-concept setup environment to gather heart rate, pupil dilation, and brain cognitive workload data during an A320 takeoff within a simulator. Experiments were performed during which we collected 136 takeoffs across 13 pilots for more than 9 hours of time-series data. Moreover, this paper investigates the correlations between heart rate, pupil dilation, and cognitive workload during such exercise and found that a spike in cognitive load during a critical moment, such as an engine failure, augments a pilot’s heart rate and pupil dilation. Results show that a critical moment within a takeoff procedure increases a pilot’s cognitive load. Next, we used a stacked-LSTM model to predict cognitive workload 5 seconds into the future. The model was able to produce accurate predictions.
- Hart, S.G. and Staveland, L.E. (1988) Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In: Hancock, P.A. and Meshkati, N., Eds., Advances in Psychology, Vol. 52, North-Holland, 139-183. https://doi.org/10.1016/S0166-4115(08)62386-9
- Panish, Boyle, Ravipudi and Shea. Aviation and Plane Crash Statistics. https://www.psbr.law/aviation_accident_statistics.html
- Sevcenko, N., Ninaus, M., Wortha, F., Moeller, K. and Gerjets, P. (2021) Measuring Cognitive Load Using In-Game Metrics of a Serious Simulation Game. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.572437
- Sosnowski, T., Krzywosz-Rynkiewicz, B. and Roguska, J. (2004) Program Running versus Problem Solving: Mental Task Effect on Tonic Heart Rate. Psychophysiology, 41, 467-475. https://doi.org/10.1111/j.1469-8986.2004.00171.x
- Jerčić, P., Sennersten, C. and Lindley, C. (2020) Modeling Cognitive Load and Physiological Arousal through Pupil Diameter and Heart Rate. Multimedia Tools and Applications, 79, 3145-3159. https://doi.org/10.1007/s11042-018-6518-z
- Lang, P.J., Greenwald, M.K., Bradley, M.M. and Hamm, A.O. (1993) Looking at Pictures: Affective, Facial, Visceral, and Behavioral Reactions. Psychophysiology, 30, 261-273. https://doi.org/10.1111/j.1469-8986.1993.tb03352.x
- Zekveld, A.A., Kramer, S.E. and Festen, J.M. (2011) Cognitive Load during Speech Perception in Noise: The Influence of Age, Hearing Loss, and Cognition on the Pupil Response. Ear and Hearing, 32, 498-510. https://doi.org/10.1097/AUD.0b013e31820512bb
- Palinko, O., Kun, A.L., Shyrokov, A. and Heeman, P. (2010) Estimating Cognitive Load Using Remote Eye Tracking in a Driving Simulator. Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, 141-144. https://doi.org/10.1145/1743666.1743701
- Chaouachi, M., Jraidi, I. and Frasson, C. (2011) Modeling Mental Workload Using EEG Features for Intelligent Systems. In: Konstan, J., Conejo, R., Marzo, J.L. and Oliver, N., Eds., UMAP, Springer, Berlin Heidelberg, Vol. 6787, 50-61. https://doi.org/10.1007/978-3-642-22362-4_5
- Chaouachi, M., Jraidi, I. and Frasson, C. (2015) MENTOR: A Physiologically Controlled Tutoring System. In: Ricci, F., Bontcheva, K., Conlan, O. and Lawless, S., Eds., User Modeling, Adaptation and Personalization, Springer International Publishing, 56-67. https://doi.org/10.1007/978-3-319-20267-9_5
- Benlamine, M.S., Chaouachi, M., Frasson, C. and Dufresne, A. (2016) Physiology-Based Recognition of Facial Micro-Expressions Using EEG and Identification of the Relevant Sensors by Emotion. Proceedings of the 3rd International Conference on Physiological Computing Systems, 130-137. https://doi.org/10.5220/0006002701300137