Abstract
This paper presents an analysis, based on simulation, of the stability of principal components. Stability is measured by the expectation of the absolute inner product of the sample principal component with the corresponding population component. A multiple regression model to predict stability is devised, calibrated, and tested using simulated Normal data. Results show that the model can provide useful predictions of individual principal component stability when working with correlation matrices. Further, the predictive validity of the model is tested against data simulated from three non-Normal distributions. The model predicted very well even when the data departed from normality, thus giving robustness to the proposed measure. Used in conjunction with other existing rules this measure will help the user in determining interpretability of principal components.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Anderson, T. W. (1951). The asymptotic distribution of certain characteristic roots and vectors.Proceedings of the Second Berkeley Symposium on Mathematical Statistics and Probability (pp. 103–130). Berkeley and Los Angeles: University of California Press.
Anderson, T. W. (1963). Asymptotic theory for principal component analysis.Annals of Mathematical Statistics, 34, 122–148.
Daudin, J. J., Duby, C., & Trecourt, P. (1988). Stability of principal component analysis studied by the bootstrap method.Statistics, 19, 241–258.
Diaconis, P., & Efron, B. (1983). Computer intensive methods in statistics.Scientific American, 248(5), 116–130.
Girschik, M. A. (1936). Principal components.Journal of the American Statistical Association, 31, 519–528.
Girschik, M. A. (1939). On the sampling theory of roots of determinantal equations.Annals of Mathematical Statistics, 10, 203–224.
Green, B. F. (1977). Parameter sensitivity in multivariate methods.Journal of Multivariate Behavioral Research, 12, 263–287.
Guadagnoli, E., & Velicer, W. F. (1988). Relation of sample size to the stability of component patterns.Psychological Bulletin, 103(2), 265–275.
Jackson, J. E. (1991).A user's guide to principal components. New York: Wiley.
Krzanowski, W. J. (1984). Sensitivity of principal components.Journal of the Royal Statistical Society, Series B, 46(3), 558–563.
Lambert, Z. V., Wildt, A. R. & Durand, R. M. (1991). Approximating confidence intervals for factor loadings.Journal of Multivariate Behavioral Research, 26(3), 421–434.
Morrison, D. F. (1976).Multivariate Statistical Methods (2nd ed.). New York: McGraw-Hill.
Pack, P., Jolliffe, I. T., & Morgan, B. J. T. (1988). Influential observations in principal components analysis: A case study.Journal of Applied Statistics, 15(1), 39–52.
Srivastava, M. S., & Khatri, C. G. (1979).An Introduction to Multivariate Statistics. New York: North Holland.
Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain.Psychological Bulletin, 99(3), 432–442.
Author information
Authors and Affiliations
Additional information
The authors would like to thank the four anonymous reviewers and the two editors for their valuable comments. Atanu R. Sinha gratefully acknowledges the research support received from the Marketing Studies Center, AGSM, UCLA. Send requests for reprints to Atanu R. Sinha, B418 Gold Hall, 110 Westwood Plaza, Los Angeles, CA 90095.
Rights and permissions
About this article
Cite this article
Sinha, A.R., Buchanan, B.S. Assessing the stability of principal components using regression. Psychometrika 60, 355–369 (1995). https://doi.org/10.1007/BF02294380
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02294380