Abstract
The purpose of this study was to investigate and compare the performance of a stepwise variable selection algorithm to traditional exploratory factor analysis. The Monte Carlo study included six factors in the design; the number of common factors; the number of variables explained by the common factors; the magnitude of factor loadings; the number of variables not explained by the common factors; the type of anomaly evidenced by the poorly explained variables; and sample size. The performance of the methods was evaluated in terms of selection and pattern accuracy, and bias and root mean squared error of the structure coefficients. Results indicate that the stepwise algorithm was generally ineffective at excluding anomalous variables from the factor model. The poor selection accuracy of the stepwise approach suggests that it should be avoided.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Bentler, P.M. (1990). Comparative fit indexes in structural models.Psychological Bulletin, 107, 238–246.
Browne, M.W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K.A. Bollen & J.S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage.
Cattell, R.B. (1978).The scientific use of factor analysis in behavioral and life sciences. New York: Plenum.
Cliff, N., & Hamburger, C.D. (1967). The study of sampling errors in factor analysis by means of artificial experiments.Psychological Bulletin, 68, 430–445.
Comrey, A.L. (1973).A first courses in factor analysis. New York: Academic Press.
Cudeck, R., & O'Dell, L. (1994). Applications of standard error estimates in unrestricted factor analysis: Significance tests for factor loadings and correlations.Psychological Bulletin, 115, 475–487.
Everitt, B.S. (1975). Multivariate analysis: The need for data, and other problems.British Journal of Psychiatry, 126, 237–240.
Fabrigar, L.R., Wegener, D.T., MacCallum, R.C., & Strahan, E.J. (1999). Evaluating the use of exploratory factor analysis in psychological research.Psychological Methods, 4, 272–299.
Finch, J.F., & West, S.G. (1997). The investigation of personality structure: Statistical models.Journal of Research in Personality, 31, 439–485.
Gorsuch, R.L. (1973). Using Bartlett's significance test to determine the number of factors to extract.Educational and Psychological Measurement, 33, 361–364.
Gorsuch, R.L. (1988). Exploratory factor analysis. In J.R. Nesselroade & R.B. Cattell (Eds.),Handbook of multivariate experimental psychology (2nd ed., pp. 231–258.) New York: Plenum.
Huberty, C.J. (1989). Problems with stepwise methods—better alternatives. In B. Thompson (Ed.),Advances in social science methodology (Vol. 1, pp. 43–70). Greenwich, CT: JAI Press.
Kano, Y., & Harada, A. (2000). Stepwise variable selection in factor analysis.Psychometrika, 65, 7–22.
Knapp, T.R. (1978). Canonical correlation analysis: A general parametric significance testing system.Psychological Bulletin, 85, 410–416.
Little, T.D., Lindenberger, U., & Nesselroade, J.R. (1999). On selecting indicators for multivariate measurement and modeling with latent variables: When “good” indicators are bad and “bad” indicators are good.Psychological Methods, 4, 192–211.
MacCallum, R.C., Roznowski, M., & Necowitz, L.B. (1992). Model modifications in covariance structure analysis: The problem of capitalization on chance.Psychological Bulletin, 111, 490–504.
MacCallum, R.C., Widaman, K.F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis.Psychological Methods, 4, 84–89.
Nunnally, J.C. (1994).Psychometric Theory (3rd ed.). New York: McGraw-Hill.
Robey, R.R., & Barcikowski, R.S. (1992). Type I error and the number of iterations in Monte Carlo studies of robustness.British Journal of Mathematical and Statistical Psychology, 45, 283–288.
Snyder, P. (1991). Three reasons why stepwise regression methods should not be used by researchers. In B. Thompson (Ed.),Advances in educational research: Substantive findings, methodological developments (Vol. 1, pp. 99–106). Greenwich, CT: JAI Press.
Tabachnick, B.G., & Fidell, L.S. (1983).Using multivariate statistics (2nd ed.). New York: Harper & Row.
Thompson, B. (1988a, April).Canonical correlation analysis: An explanation with comments on correct practice. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA. (ERIC Document Reproduction Service No. ED 295 957).
Thompson, B. (1988b, November).Common methodology mistakes in dissertations: Improving dissertation quality. Paper presented at the annual meeting of the Mid-South Educational Research Association, Louisville, KY. (ERIC Document Reproduction Service No. ED 301 595).
Thompson, B. (1989). Why won't stepwise methods die?Measurement and Evaluation in Counseling and Development, 21, 146–148.
Thompson, B. (1991, January).Stepwise methods lead to bad interpretations: Better alternatives. Paper presented at the annual meeting of the Southwest Educational Research Association, San Antonio, TX. (ERIC Document Reproduction Service No. ED 327 573).
Thompson, B. (1995). Stepwise regression and stepwise discriminant analysis need not apply here: A guidelines editorial.Educational and Psychological Measurement, 55, 525–534.
Thurstone, L.L. (1947).Multiple factor analysis. Chicago: University of Chicago Press.
Velicer, W.F., & Fava, J.L. (1998). Effects of variable and subject sampling on factor pattern recovery.Psychological Methods, 3, 231–251.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hogarty, K.Y., Kromrey, J.D., Ferron, J.M. et al. Selection of variables in exploratory factor analysis: An empirical comparison of a stepwise and traditional approach. Psychometrika 69, 593–611 (2004). https://doi.org/10.1007/BF02289857
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02289857