Abstract
Increased mental workload is often associated with increased risk of pilots’ operational errors. Mental workload is a multifactor problem. The paper aims at defining an appropriate indicator for pilot mental workload, under the assumption that vision is the single most important source of information for the pilot. We design a series of experiments about the task difficulty, which have different visibility, taxiing length and turns. The results showed that the fixation frequency did not increase with the task difficulty. Fixation frequency is not sensitive with the mental workload. This study concludes that the Fixation frequency cannot be used as the evaluation criteria of mental workload. But the results may be caused by small sample sizes (three pilots).
You have full access to this open access chapter, Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
Pilots need to perform various visually demanding tasks in flight, such as monitoring various displays in the cockpit, navigating, and cockpit reconfiguration [1]. The culmination of the required tasks, the difficult operating environment, and the lack of aiding technologies result in a very high-workload of their visual system, which is very likely to induce operational errors [2]. According to the statistical summary of commercial jet airplane accidents reported by Boeing, human errors due to the overloaded visual system accounted for nearly 90% aviation accidents [3]. Thus, there is an urgent need to control pilots’ operational errors induced by the overloaded visual system.
Subjective-ratings and Physiological measurements are two traditional methods used to assess inflight pilot workload. Notable Subjective-ratings currently employed are NASA-TLX (subject demand assessment) [4, 5], a Bedford workload scale, SART (a situational awareness assessment analysis questionnaire), and the Modified Cooper-Harper Rating Scale is four generally used subjective method [5]. But Subjective measures have some limitations. The probes of questionnaires confused pilots easily, and they always require a conscious, subjective response from the pilots to ensure the accuracy [6]. Ahlstrom et al. concluded that eye movement activity can provide a sensitive measure of controller workload, but subjective ratings might not capture more transient fluctuations in workload levels during system or display interactions [7]. Therefore, objective, physiological measures would be preferable and become a key issue. Results from previous studies report that eye movement activity, heart parameters, and respiration, EEG signals are all sensitive to mental workload.
The blink of the eye is believed to be a good indicator of both fatigue and workload [7,8,9]. Blink Rate (BR) increases as a function of time on task (TOT), and blink duration (BD) decrease as visual workload increases. Besides eye blink activity, some researchers found that pupil size can also be used to assess workload. Pupil dilates most because of mental effort. Pupil dilation has been successfully used for distinguishing different levels of difficulty of various cognitive tasks.
The paper aims at defining an appropriate indicator for driver visual workload, under the assumption that vision is the single most important source of information for the pilot. Fixation frequency had been proposed to assess mental workload of pilot during taxiing. We design a series of experiments about the task difficulty, which have different visibility, taxiing length and turns. During the experiment, the eye movement data had been collected, and analyzed.
2 Methods
2.1 Subject
Three aircrews, each consisting of one captain and one FO (the First Officer) from Shanghai Eastern Flight Training CO., LTD. who flew the Airbus320, participated in the study. The participants are all male. The information of the three captains executing the experiment are given in Table 1.
2.2 Tasks
The trial is conducted in Airbus 320 simulator (shown in Fig. 1) in Shanghai Eastern Flight Training CO., LTD. In all scenarios, the pilot is asked to land from the last approach point and taxiing to the gate successfully according to the flight plan established before. Two variables of interest were investigated in the study: visibility and taxiing way.
Visibility.
Trials were conducted in three different visibilities shown in Fig. 2. First is clear day. Pilot has unlimited visibility and the trial conducted in Visual Meteorological Condition (VMC). Second is night. The airport is under night mode and pilot should flight in Instrument meteorological Condition (IMC). To investigate the visual performance under low visibility, the runway visibility is 200 m, which is the lowest visibility according to the flight rules, and pilot should flight in IMC.
Taxiing Way.
There are two different difficulty taxiing ways from Beijing international airport shown in Fig. 3. The two has different number of turns and length. Besides, the difficult taxiing way will across runway, which needs the pilot to wait for a runway clearance from ATC (Air Traffic Control). The two different taxiing ways are shown in Table 2.
2.3 Variable Design
The experiment is in-subject design, and each group should flight six times. The order of the blocks were clear day & simple way(CS)- clear day & difficulty way(CD) -night & simple way (NS)-night & difficulty way (ND)- low visibility & simple way(LS) - low visibility & difficulty way (LD).
2.4 Experimental Procedure
In all scenarios, the participants were asked to land from the last approach point and taxiing to the gate successfully according to the flight plan established before.
At the beginning, the flying instructor communicated the flight plan including landing airport, runway, taxiing plan and airport gate with the aircrews as given. And then the instructor set the airplane to the last approach point. The participant’s task, then, was to arm the autopilots, set the altitude, and engage landing gear, and altitude settings. After all the configurations done, eye tracker (SMI iView X HED) would be took on by the captain. A five-point calibration was made for each participant. Then the flight instructor activates the simulator, and the trial begins. Pilots should take full manual control during the trial.
2.5 Eye Tracker
The eye movement data had been collected by SMI head- mounted eye tracker shown in Fig. 4. The sample frequency is 240 Hz, and accuracy is 0.01.
2.6 AoI Designs
The definition of Area of Interests (AoIs) was directly connected to the pilot fixation pattern. AoIs were defined throughout the cockpit, namely electronic centralized aircraft monitoring display (EVAM), the navigation display (ND), primary flight display (PFD), and the centerline of taxiing way out of the window (OTWM), the left signs besides the taxiing way (OTWL) and the right signs besides the taxiing way (OTWR). The division of AoI is shown in Fig. 5.
3 Results
The Ff (Fixation frequency) of different pilots in the experiment is shown in Tables 3, 4 and 5.
A significant effect was found between scenes by different flight experience pilots, F(5,17) = 5.365, P < 0.05. However, there is not significant effect between different flight experience pilots. The Ff didn’t changed regularly with the difficulty of taxiing way or the visibility.
4 Discussion
The aim of this paper was to contribute to understanding the pilot’s fixation frequency is an effective indicator of mental workload. Due to the difficulty in recruiting professional pilots, the sample size of the present study was relatively small. This could explain why we did not find many significant differences between the experience conditions and visibility conditions.
Besides the statistical significant difference discussed above, we also found some interesting trends for the factors of interests shown in Fig. 6. The result showed that the Ff is significant different among different scenes. But the result can not be used as the evidence that Ff can be used to assess the workload since Ff is not changed regularly. Ff is higher in simple taxiing way than in difficult one, while it is smaller in worse visibility than in better one. Environment factors were also found to have effects on mental workload. McCann et al. (1997) reported that the low-visibility and night conditions contributed to increased workload [9]. Foyle (1996) also reported that a variety of environmental conditions (airport complexity, and visibility) could affect the workload [10]. But Ff did not changed regularly with the environment changed. Besides, experience is one of the factors that may affect mental workload. Some researchers reported that expert and non-expert pilots have different physiological responses to tasks at different difficulty levels [9, 12,13,14,15,16,17,18]. The value of Ff has no significant effect among different pilots.
5 Conclusions
Interestingly, there was no significate effect found in expertise level and visibility condition in fixation frequency. We did not confirmed that the fixation frequency of pilots was an effective method to assess pilot mental workload. Although a significant effect had been found among different scenes, but it changed irregularly. The change of fixation frequency can neither indicate the change of mental workload influencing by the task difficult nor by the pilot experience. The lack of significance in this main effect could be due to small sample sizes (three pilots). For the future study, we should recruit more pilots to validate that whether fixation frequency could be an effective indicator to evaluate mental workload among different pilots or different visibilities.
References
Haslbeck, A., Bengler, K.: Pilots’ gaze strategies and manual control performance using occlusion as a measurement technique during a simulated manual flight task. Cogn. Technol. Work 18, 529–540 (2016)
Borghini, G., Isabella, R., Vecchiato, G., Toppi, J., Astolfi, L., Caltagirone, C., Babiloni, F.: Brainshield HREEG study of perceived pilot mental workload. Ital. J. Aerosp. Med. 5, 34–47 (2011)
Statistical Summary of Commercial Jet Aircraft Accidents. Boeing, Seattle (2003)
Hart, S.G., Staveland, L.E.: Development of NASA task load index (TLX): results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload, pp. 239–250. North Holland Press, Amsterdam (1988)
O’Brien, T.G., Charlton, S.G.: Handbook of Human Factors Testing and Evaluation. Hillsdale, England (1996)
Cain, B.: A review of the mental workload literature. English 35 (2007)
Ahlstroma, U., Friedman-Bergb, F.J.: Using eye movement activity as a correlate of cognitive workload. Int. J. Ind. Ergon. 36, 623–636 (2006)
Gaetan, S., Dousset, E., Marqueste, T., Bringoux, L., Bourdin, C., Vercher, J.-L., Besson, P.: Cognitive workload and psychophysiological parameters during multitask activity in helicopter pilots. Aerosp. Med. Hum. Perform. 86(12), 1–6 (2015)
Mccann, R.S., Andre, A.D., Begault, D., et al.: Enhancing taxi performance under low visibility: are moving maps enough? Proc. Hum. Factors Ergon. Soc. Ann. Meet. 41, 37–41 (1997)
Foyle, D.C., Andre, A.D., Battiste, V.: Advanced navigation aids in the flight deck: effects on ground taxi performance under low visibility conditions. In: Proceedings of the 41st Annual Meeting of the Human Factors and Ergonomics Society (HFES) (1996)
Parasuraman, R., Jiang, Y.: Individual differences in cognition, affect, and performance: behavioral, neuroimaging, and molecular genetic approaches. NeuroImage 59(1), 70–82 (2012)
Ottati, W.L., Hickox, J.C., Richter, J.: Eye scan patterns of experienced and novice pilots during visual flight rules (VFR) navigation. In: Proceedings of the Human Factors and Ergonomics Society, 43rd Annual Meeting, pp. 66–70. Human Factors and Ergonomics Society, Santa Monica (1999)
Doppelmayr, M., Finkenzeller, T., Sauseng, P.: Frontal midline theta in the pre-shot phase of rifle shooting: differences between experts and novices. Neuro Psychologia 46(5), 1463–1467 (2008)
Benbassat, D., Abramson, C.I., Williams, K.W.: Comparative approach to pilot error and effective landing flare instructions. Int. J. Comp. Psychol. 15(2–3), 249–255 (2016)
Benlic, U., Brownlee, A.E.I., Burke, E.K.: Heuristic search for the coupled runway sequencing and taxiway routing problem. Transp. Res. Part C Emerg. Technol. 71, 333–355 (2016)
Haslbeck, A., Bengler, K.: Pilots’ gaze strategies and manual control performance using occlusion as a measurement technique during a simulated manual flight task. Cogn. Technol. Work 18(3), 529–540 (2016)
Itan, L., Yitzhaky, Y.: Performance of visual search tasks from various types of contour information. J. Opt. Soc. Am. Opt. Image Sci. Vis. 30(3), 392–402 (2013)
Johnson, M.E., Zhao, X., Faulkner, B.: Statistical models of runway incursions based on runway intersections and taxiways. J. Aviat. Technol. Eng. 5(2), 15–26 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Zhang, X., Xue, H., Qu, X., Li, T. (2017). Can Fixation Frequency Be Used to Assess Pilots’ Mental Workload During Taxiing?. In: Harris, D. (eds) Engineering Psychology and Cognitive Ergonomics: Performance, Emotion and Situation Awareness. EPCE 2017. Lecture Notes in Computer Science(), vol 10275. Springer, Cham. https://doi.org/10.1007/978-3-319-58472-0_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-58472-0_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-58471-3
Online ISBN: 978-3-319-58472-0
eBook Packages: Computer ScienceComputer Science (R0)