Abstract
Model diagnostics for normal and non-normal state space models are based on recursive residuals which are defined from the one-step ahead predictive distribution. Routine calculation of these residuals is discussed in detail. Various diagnostic tools are suggested to check, for example, for wrong observation distributions and for autocorrelation. The paper also discusses such topics as model diagnostics for discrete time series and model discrimination via Bayes factors. The case studies cover environmental applications such as analysing a time series of the number of daily rainfall occurrences and a time series of daily sulfur dioxide emissions.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Abramowitz, M. and Stegun, I. (1970) Handbook of Mathematical Functions. Dover, New York.
Aitkin, M., Anderson D., Francis, B. and Hinde, J. (1989) Statistical Modelling in GLIM. Clarendon Press, Oxford.
Atkinson, A.C. (1981) Two graphical displays for outlying and influential observations in regression. Biometrika, 68, 13–20.
Atkinson, A.C. (1982) Regression diagnostics, transformations and constructed variables. Journal of the Royal Statistical Society B, 44, 1–36.
Berger, J. and Delambady, M. (1987) Testing precise hypothesis (with discussion). Statistical Science, 2, 317–35.
Bowman, K.O. and Shenton, L.R. (1975) Omnibus contours for departures from normality based on √b 1 and √b 2 Biometrika, 62, 243–50.
Box, G.E.P. (1980) Sampling and Bayes′ inference in scientific modelling and robustness. Journal of the Royal Statistical Society A, 143, 383–430.
Brown, R.L., Durbin, J. and Evans, J.M. (1975) Techniques of testing the constancy of regression relationships over time. Journal of the Royal Statistical Society B, 37, 141–92.
Chatfield, C. (1989) The Analysis of Time Series. Chapman & Hall, London.
Cox, D.R. (1970) The Analysis of Binary Data. Chapman & Hall, London.
Davison, A.C. and Gigli, A. (1989) Deviance residuals and normal score plots. Biometrika, 76, 211–21.
Dawid, A.P. (1984) Statistical theory — the prequential approach. Journal of the Royal Statistical Society A, 147, 278–92.
Fahrmeir, L. (1992) Posterior mode estimation by extended Kalman filtering for multivariate dynamic generalized linear models. Journal of the American Statistical Association, 87, 501–9.
Fahrmeir, L. and Kaufmann, H. (1987) Regression models for non-stationary categorical time series. Journal of Time Series Analysis, 8, 147–60.
Fahrmeir, L., Hennevogel, W. and Klemme, K. (1992) Smoothing in dynamic generalized linear models by Gibbs sampling. In Advances in GLIM and Statistical Modelling, Fahrmeir, L., Francis, B., Gilchrist, R. and Tutz, G. (eds), Lecture Notes in Statistics, 78, Springer-Verlag, Berlin pp. 85–90.
Frühwirth-Schnatter, S. (1991) Monitoring von ökologischen und biometrischen Prozessen mit statistischen Filtern. In Multivariate Modelle. Neue Ansätze für biometrische Anwendungen, Seeber, G.U.H. and Minder, Ch.E. (eds), Springer-Verlag, Berlin, pp. 89–122.
Frühwirth-Schnatter, S. (1994) Applied state space modelling of non-Gaussian time series using integrationbased Kalman-filtering. Statistics and Computing, 4, 259–69.
Fruhwirth-Schnatter, S. (1995) Bayesian model discrimination and Bayes factors for linear Gaussian state space models. Journal of the Royal Statistical Society, B, 57, 237–46.
Geisser, S. and Eddy, W.F. (1979) A predictive approach to model selection. Journal of the American Statistical Association, 74, 153–60.
Harrison, P.J. and Stevens, C.F. (1976) Bayesian forecasting (with discussion). Journal of the Royal Statistical Society B, 38, 205–47.
Harvey, A. (1989) Forecasting, Structural Time Series Models, and the Kalman Filter. Cambridge University Press, Cambridge.
Harvey, A. and Fernandes, C. (1989) Time series models for count or qualitative observations (with discussion). Journal of Business and Economic Statistics, 7, 407–22.
Hatzinger, R. and Panny, W. (1993) Single and twin-heaps as natural data structures for percentile point simulation algorithm. Statistics and Computing, 3, 163–70.
Hedayat, A. and Robson, D.S. (1970) Independent stepwise residuals for testing homoscedasticity. Journal of the American Statistical Association, 65, 1573–81.
Kitagawa, G. (1987) Non-Gaussian state space modelling of nonstationary time series (with comments). Journal of the American Statistical Association, 82, 1032–63.
O'Hagan, A. (1980) Discussion of Professor Box's paper. Journal of the Royal Statistical Society A, 143, 408.
Pearson, E.S., D'Agostino, R.B. and Bowman, K.O. (1977) Tests for departure from normality: comparison of powers. Biometrika, 64, 231–46.
Pregibon, D. (1981) Logistic regression diagnostics. Annals of Statistics, 9, 705–24.
Rosenblatt, M. (1952) Remarks on a multivariate transformation. Annals of Mathematical Statistics, 23, 470–2.
Schnatter, S. (1992) Integration-based Kalman-filtering for a dynamic generalized linear trend model. Computational Statistics and Data Analysis, 13, 447–59.
Schneider, W. (1986) Der Kalmanfilter als Instrument zur Diagnose und Schätzung variabler Parameter in ökonometrischen Modellen. Physica, Heidelberg.
Sharefkin, M. (1983) Reflections of an Ignorant Bayesian. In Uncertainty and Forecasting of Water Quality, Beck, M.B. and van Straten, G. (eds), Springer-Verlag, Berlin, pp. 373–9.
Smith, J.Q. (1985) Diagnostic check of non-standard time series models. Journal of Forecasting, 4, 283–91.
Smith, A.F.M. and Spiegelhalter, D.J. (1980) Bayes factors and choice criteria for linear models. Journal of the Royal Statistical Society B, 42, 213–20.
Spiegelhalter, D.J. and Smith, A.F.M. (1982) Bayes factors for linear and log-linear models with vague prior information. Journal of the Royal Statistical Society B, 44, 377–87.
Stuart, A. and Ord, J.K. (1987) Kendall's Advanced Theory of Statistics, Volume 1: Distribution Theory. Griffin, London.
West, M., Harrison, P.J. and Migon, H. (1985) Dynamic generalized linear models and Bayesian forecasting. Journal of the American Statistical Association, 80, 741–50.
Zeger, S.L. and Qaqish, B. (1988) Markov regression models for time series: a quasi-likelihood approach. Biometrics, 44, 1019–31.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Früiiwirth-Schnatter, S. Recursive residuals and model diagnostics for normal and non-normal state space models. Environ Ecol Stat 3, 291–309 (1996). https://doi.org/10.1007/BF00539368
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF00539368