Abstract
The nonverbal content of speech carries information about the physiological and psychological condition of the speaker. Psychological stress is a pathological element of this condition, of which the cause is accepted to be “workload”. Objective, quantifiable correlates of stress are searched for by means of measuring the acoustic modifications of the voice brought about by workload. Different voice features from the speech signal to be influenced by stress are: loudness, fundamental frequency, jitter, zero-crossing rate, speech rate and high-energy frequency ratio. To examine the effect of workload on speech production an experiment was designed. 108 native speakers of Dutch were recruited to participate in a stress test (Stroop test). The experiment and the analysis of the test results will be reported in this paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Banse, R., Scherer, K.R.: Acoustic profiles in vocal emotion expression. J. Personality Social Psychol. 70(3), 614–636 (1996)
Brenner, M., Branscomb, H.H., Schwartz, G.E.: Psychological stress evaluator: Two tests of a vocal measure. Psychophysiology (1979)
Brenner, M., Shipp, T.: Voice stress analysis: Mental state estimation. In: Construck, J.R. (ed.) NASA conf. pub., vol. 2504 (1987)
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., Taylor, J.G.: Emotion recognition in Human-computer interaction. IEEE Signal Processing Mag. 18, 32–80 (2001)
Griffin, G.R., Williams, C.E.: The effects of different levels of task complexity on three vocal measures. Aviation, Space and Environmental Medicine 58, 1165–1170 (1987)
Hecker, M.H.L., von Bismarck, G., Williams, C.E.: Manifestations of task induced stress in the acoustical speech signal. Journal of the Acoustical Society of America 44, 993–1001 (1968)
Jones, W.A.: An evaluation of voice stress analysis techniques in a simulated AWACS environment. Master’s thesis Texas A.& M. University (1990)
Kuroda, I., Fujiwara, O., Okamura, N., Utsuki, N.: Method for determining pilot stress through analysis of voice communication. Aviation, Space and Environmental Medicine 47, 528–533 (1976)
Pantic, M., Rothkrantz, L.J.M.: Towards an Affect-Sensitive Multimodal Human-Computer Interaction. Proc. of the IEEE 91(9), 1370–1390 (2003)
Pinto, N.B., Titze, I.R.: Unification of pertubation measures in speech signals. Journal of the Acoustical Society of America 87, 1278–1289 (1990)
Roesller, R., Lester, J.W.: Vocal patterns in anxiety. In: Fann, W.E. (ed.) Phenomenology and treatment of anxiety (1979)
Scherer, K.R.: The effects of stress on the fundamental frequency of the voice. Journal of the Acoustical Society of America (1977)
Scherer, K.R., Tolkmitt, F.: The effect of stress and task variation on formant location. Journal of the Acoustical Society of America (1979)
Sheridan, T.B., Stassen, H.G.: Definitions, models and measures of human workload. In: Moray, N. (ed.) Mental Workload: Its Theory and Measurement, Plenum, New York (1979)
Siegmann, A.W.: Paraverbal and non-verbal indicators of stress. In: Goldberger, L. (ed.) Handbook of Stress (1992)
Simonov, P.V., Frolov, M.V.: Utilization of human voice for estimation of man’s emotional stress and state of attention. Aerospace Medicine (1973)
Streeter, L.A., et al.: Pitch change during attempted deception. Journal of Personality and Social Psychology (1977)
Stroop, J.R.: Studies of interference in serial verbal reactions. Journal of Experimental Psychology 28, 643–662 (1935)
Titze, I.R., Liang, H.: Comparison of F0 extraction methods for high-precision voice pertubation measurements. Journal of Speech and Hearing Research 36 (1993)
van Vark, R.J.: Knowledge based behaviour feedback system using physiological data, TU Delft graduation thesis (1993)
Williams, C.E., Stevens, K.N.: On determining the emotional state of pilots during flight. An exploratory study, Aerospace Medicine (1969)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rothkrantz, L.J.M., Wiggers, P., van Wees, JW.A., van Vark, R.J. (2004). Voice Stress Analysis. In: Sojka, P., Kopeček, I., Pala, K. (eds) Text, Speech and Dialogue. TSD 2004. Lecture Notes in Computer Science(), vol 3206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30120-2_57
Download citation
DOI: https://doi.org/10.1007/978-3-540-30120-2_57
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23049-6
Online ISBN: 978-3-540-30120-2
eBook Packages: Springer Book Archive