Keywords

1 Introduction

Brain-computer interface (BCI) is a technology that provides a direct communication pathway between the brain and an external device which is independent of normal peripheral nervous and muscular systems [1]. Visual stimulation is the most commonly used input for practical BCI systems. However, the user of visual stimulated BCI usually claims vision fatigue. For example, steady-state visual evoked potential (SSVEP) requires the user to gaze at flashing stimuli, resulting in discomfort and tiredness, and consequently reduce the performance. Especially for stimuli with high brightness and contrast, users will easily feel extremely drowsy and have difficulty in concentration. SSVEP-based BCI, as an attention dependent system, requires significant effort to focus on the flashing stimuli to produce sufficiently strong SSVEP signals, and the users may easily get fatigue. The cognitive neurodynamics process of the visual system responding to an SSVEP signal is easily affected by various mental states, attention, fatigue and so on [2, 3]. Loss of attention caused by fatigue will reduce the cognitive performance, consequently reduce the SSVEP quality and system performance. There is a real demand to establish an objective and online assessment to evaluate the fatigue during cognitive process in SSVEP-based BCIs.

Previous studies proposed several questionnaires or subjects’ description to indicate the fatigue degree [47]. However, they are quit raw, subjective, inaccurate and difficult in on-line measurement. Cognitive neurodynamics measured by EEG activity are related to generalized performance on cognitive tasks and mental efforts. More specifically, the low cognitive capacity and decreased arousal level are associated with global increase in θ and α [810]. Therefore, the dynamic change of EEG activity would be an indicator for fatigue. Time varying EEG spectral in theta and alpha activity is proposed as an objective method to evaluate fatigue during cognitive process in SSVEP-based BCIs.

2 Methods

An LCD monitor was used as the visual stimulator (ViewSonic 22″, refresh rate 120 Hz, 1,680 × 1,050 pixel resolution) and the stimulus was programmed under Microsoft Visual Studio 2010 using Microsoft DirectX SDK (June 2010). There was a symbol “+” in the center of the flashing stimulus to keep the subjects focusing on the target. The stimulus was flashing for 3 s for 30 trials, and 2 s pause was set between each trial. EEG was collected from Oz channel by an amplifier (g.USBamp, Guger Technologies, Graz, Austria) and were filtered by a 50 Hz notch filter and a 0.5–60 Hz band-pass filter. The amplitude of frequency bands δ, θ, α and β were calculated in each trial by using fast Fourier transforms (FFT). The average amplitude of each frequency band was selected as an index of this frequency band, and was used to calculate the EEG ratio indices θ/α and (θ + α)/β. Eleven subjects (aged from 22 to 28 years old, six males and five females) participated in the experiments and were asked to complete a validate self-reported fatigue questionnaire before and after the task work, which was called the Chalder Fatigue Scale (CFS) [11]. The CFS had high reliability and validity, and it was used in this study as a standard reference for fatigue levels. A linear regression analysis was employed to compare the association of EEG indices and fatigue states.

3 Results

The CFS score was significantly increased (p < 0.001) with pre-mean CFS score = 14.91, standard deviation (SD) = 1.22; post-mean CFS score = 25.73, SD = 4.98; which indicated the fatigue level was significantly increased after SSVEP-based BCI experiments. For the EEG evaluation of fatigue, it would find the strong association between CFS and the EEG indices θ and α, as well as ratio indices θ/α and (θ + α)/β. Figure 1 presented the average value over all subjects for time varying EEG indices θ and α, as well as ratio indices θ/α and (θ + α)/β, which demonstrated the dynamic prediction for fatigue during cognitive process. The results indicated significant correlations between EEG indices in θ, α and the number of trials, with the R 2 values equal to 0.68 (p < 0.001) and 0.77 (p < 0.001), respectively. Both the ratio indices θ/α and (θ + α)/β were found significantly correlated with the number of trials, with the R2 values equal to 0.60 (p < 0.001) and 0.78 (p < 0.001) respectively. Therefore, these results suggest that the increase in θ, α and (θ + α)/β, as well as the decrease in θ/α are associated with the increasing fatigue level during cognitive process.

Fig. 1
figure 1

Time-varying EEG features during cognitive process. Vertical axis amplitude (μV), horizontal axis number of trials. Blue curve time-varying EEG features, black straight line linear fitting line

4 Conclusion

The time varying EEG spectral analysis is proposed as an objective approach to evaluate fatigue during cognitive process in SSVEP-based BCIs. The proposed approach can provide a real-time evaluation of the fatigue with objective and quantitative measurement. The promising result suggests the potential of objective evaluation of fatigue by dynamic measurement in EEG indices θ and α, as well as ratio indices θ/α, (θ + α)/β. The time varying EEG activity would predict the fatigue immediately, which may provide a useful online assessment of fatigue. The increase in θ, α and (θ + α)/β, as well as the decrease in θ/α are associated with the increasing fatigue level during cognitive process. In addition, this method can be used for optimal selection of visual stimuli parameters (e.g., visual stimulus frequency, duty cycle, color, etc.) to design a user-friendly BCI system, which cause less fatigue in further study.