Aircraft Pilot Workload Assessment Based on Non-contact Sensors: A Review
DOI:
https://doi.org/10.54097/hhzrf702Keywords:
Flight Safety, Pilot Fatigue, Non-contact TechnologiesAbstract
Pilot fatigue and cognitive overload are caused by long flights, irregular circadian rhythms, and complex cockpit environments, posing a significant threat to flight safety. This review explores non-contact sensor technologies used to assess the workload of aircraft pilots to enhance aviation safety and performance. Firstly, the limitations of traditional methods (such as subjective questionnaires (e.g., NASA-TLX, SART) and invasive sensors) were examined, which are affected by subjectivity, latency effects, and operational interference. Secondly, Emphasis is placed on the advantages of non-contact technologies (including computer vision, ballistocardiography (BCG), and infrared thermal imaging (IRT)), which allow for the real-time and objective monitoring of physiological and behavioral indicators such as facial expressions, heart rate variability, and facial temperature changes. Finally, a discussion is presented on future development directions, focusing on the combined use of artificial intelligence, machine learning, and edge computing for developing adaptive cockpit systems, and the requirement for validation in long-haul and extreme scenarios to optimize pilot performance and flight safety. It is provided that theoretical support and specific guidance are essential for the practice of aviation human factors engineering, with the goal of optimizing the aviation human-machine system.
Downloads
References
[1] Wingelaar-Jagt Y Q, Wingelaar T T, Riedel W J, et al. Fatigue in Aviation: Safety Risks, Preventive Strategies and Pharmacological Interventions[J]. Frontiers in Physiology, 2021, 12: 712628. doi: 10.3389/ fphys. 2021.712628.
[2] Lee Y H, Jeon J D, Choi Y C. Air Traffic Controllers’ Situation Awareness and Workload under Dynamic Air Traffic Situations[J]. https:// dx.doi.org/10.5325/transportationj. 51.3.0338. doi: 10.5325/ transportationj. 51.3.0338.
[3] Alaimo A, Esposito A, Milazzo A, et al. An Aircraft Pilot Workload Sensing System[M]//Rizzo P, Milazzo A. European Workshop on Structural Health Monitoring: Vol. 127. Cham: Springer International Publishing, 2021: 883-892. http://link.springer.com/10.1007/978-3-030-64594-6_85. doi: 10.1007/978-3- 030-64594-6_85.
[4] Carlsen V, Manzi R, Dellinger S, et al. Predicting Pilot Workloads Using Physiological Measures[J]. Industrial and Systems Engineering Review, 2025, 12(1): 1-6. doi: 10.37266/ISER.2025v12i1.pp1-6.
[5] Lim Y, Bassien-Capsa V, Ramasamy S, et al. Commercial airline single-pilot operations: System design and pathways to certification[J]. IEEE Aerospace and Electronic Systems Magazine, 2017, 32(7): 4-21. doi: 10.1109/MAES.2017.160175.
[6] Luo S, Zhang C, Zhu W, et al. Noncontact perception for assessing pilot mental workload during the approach and landing under various weather conditions[J]. Signal, Image and Video Processing, 2025, 19(2): 98. doi: 10.1007/s11760-024-03619-x.
[7] Chen N, Ma T, Han Y, et al. A Pilot Approach and Landing Workload Assessment Method for Flight Crew Workload Airworthiness Certification[M]//Harris D, Li W C, Krömker H. HCI International 2024 – Late Breaking Papers: Vol. 15381. Cham: Springer Nature Switzerland, 2025: 225-240. https:// link. springer. com/10.1007/978-3-031-76824-8_16. doi: 10.1007/978-3-031-76824-8_16.
[8] Kutilek P, Kacer J, Cicmanec L, et al. Non-contact Measurement Systems for Physiological Data Monitoring of Military Pilots During Training on Simulators: Review and Application[C]//2019 International Conference on Military Technologies (ICMT). Brno, Czech Republic: IEEE, 2019: 1-6. https://ieeexplore.ieee.org/document/8870115/. doi: 10.1109/MILTECHS.2019.8870115.
[9] Vicente-Rodríguez M, Iglesias Gallego D, Fuentes-García J P, et al. Portable Biosensors for Psychophysiological Stress Monitoring of a Helicopter Crew[J]. Sensors, 2020, 20(23): 6849. doi: 10. 3390/ s20236849.
[10] Workload assessment of computer gaming using a single-stimulus event-related potential paradigm[J]. Biological Psychology, 2008, 77(3): 277-283. doi: 10.1016/j.biopsycho.2007.10.014.
[11] Taylor R M. Situational Awareness Rating Technique (Sart): The Development of a Tool for Aircrew Systems Design[M]//Situational Awareness. Routledge, 2011.
[12] Veltman J A, Gaillard A W K. Physiological indices of workload in a simulated flight task[J]. Biological Psychology, 1996, 42(3): 323-342. doi: 10.1016/0301-0511(95)05165-1.
[13] Alaimo A, Esposito A, Orlando C, et al. Aircraft Pilots Workload Analysis: Heart Rate Variability Objective Measures and NASA-Task Load Index Subjective Evaluation[J]. Aerospace, 2020, 7(9): 137. doi: 10.3390/aerospace7090137.
[14] Wang P, Houghton R, Majumdar A. Detecting and Predicting Pilot Mental Workload Using Heart Rate Variability: A Systematic Review[J]. Sensors, 2024, 24(12): 3723. doi: 10.3390/s24123723.
[15] Hu X, Lodewijks G. Detecting fatigue in car drivers and aircraft pilots by using non-invasive measures: The value of differentiation of sleepiness and mental fatigue[J]. Journal of Safety Research, 2020, 72: 173-187. doi: 10.1016/j.jsr.2019.12.015.
[16] Wingelaar-Jagt Y Q, Wingelaar T T, Riedel W J, et al. Fatigue in Aviation: Safety Risks, Preventive Strategies and Pharmacological Interventions[J]. Frontiers in Physiology, 2021, 12. https://www. frontiersin.org/journals/physiology/articles/10.3389/fphys.2021.712628/full. doi: 10.3389/ fphys. 2021. 712628.
[17] Göker Z. Fatigue in The Aviation: An Overview of The Measurements and Countermeasures[J]. Journal of Aviation, 2018, 2(2): 185-194. doi: 10.30518/jav.451741.
[18] Liu Y, Gao Y, Yue L, et al. A Real-Time Detection of Pilot Workload Using Low-Interference Devices[J]. Applied Sciences, 2024, 14(15): 6521. doi: 10.3390/app14156521.
[19] Deliere Q, Migeotte P F, Neyt X, et al. Cardiovascular changes in parabolic flights assessed by ballistocardiography [C]//2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Osaka: IEEE, 2013: 3801-3804. http://ieeexplore. ieee.org/ document/ 6610372/. doi: 10.1109/EMBC.2013.6610372.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Academic Journal of Science and Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
