Abstract
Assessing the contributions of individual components in multi-component interventions poses complex challenges for prevention researchers. We review the strengths and weaknesses of designs and analyses that may be useful in answering three questions: (1) Is each of the individual components contributing to the outcome? (2) Is the program optimal? and (3), Through what processes are the components of the program achieving their effects? Factorial and fractional factorial designs in which a systematically selected portion of all possible treatment combinations is implemented are used to address question 1. Response surface designs in which each component is quantitatively scaled are explored in relation to question 2. Mediational analysis, a hybrid of experimental and correlational approaches, is considered in relation to question 3. Design enhancements are offered that may further strengthen some of these techniques. These techniques offer promise of enhancing both the basic science and applied science contributions of prevention research.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Aiken, L. S., & West, S. G. (1991).Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
Aiken, L. S., & West, S. G. (April 1993). Outcome evaluation of community based programs to increase mammography screening. In L. S. Aiken and S. G. West (Chairs), Development, Implementation, and Evaluation of Interventions to Increase Mammography Screening: A Symposium. Western Psychological Association, Phoenix, AZ.
Aiken, L. S., West, S. G., Sechrest, L., & Reno, R. R. (1990). Graduate training in statistics, methodology, and measurement in psychology: A survey of PhD programs in North America.American Psychologist, 43, 721–734.
Aiken, L. S., West, S. G., Woodward, C. K., Reno, R. R., & Reynolds, K. R. (1993).Increasing screening mammography in asymptomatic women: Evaluation of a second generation, theory-based program. Manuscript submitted for publication.
Anderson, V. L., & McLean, R. A. (1984).Applied factorial and fractional designs. New York: Marcel Dekker.
Atkinson, A. C. (1985). An introduction to the optimum design of experiments. In A. C. Atkinson and S. E. Fienberg (Eds.),A celebration of statistics: The ISI centenary volume. New York: Springer-Verlag, pp. 465–473.
Baron, R. M., & Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic and statistical considerations.Journal of Personality and Social Psychology, 51, 1173–1182.
Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures.Psychological Bulletin, 88, 588–606.
Borenstein, M., & Cohen, J. (1988).Statistical power analysis: A computer program. Hillsdale, NJ: Erlbaum.
Box, G. E. P., & Draper, N. R. (1987).Empirical model-building and response surfaces. New York: Wiley.
Box, G. E. P., Hunter, W. G., & Hunter, J. S. (1978).Statistics for experimenters: An introduction to design, data analysis, and model building. New York: Wiley.
Bryk, A. S., & Raudenbush, S. W. (1992).Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: Sage.
Caplan, R. D., Vinokur, A. D., Price, R. H., & Van Ryn, M. (1989). Job seeking, reemployment and mental health.Journal of Applied Psychology, 74, 759–769.
Cohen, J. (1988).Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
Coie, J. D., Watt, N., West, S. G., Hawkins, D., Asarnow, J., Markman, H., Ramey, S., Shure, M., & Long, B. (1993). The science of prevention: A conceptual framework and some directions for a national research program.American Psychologist, 48, 1013–1022.
Cook, T. D., & Campbell, D. T. (1979).Quasi-experimentation: Design and analysis issues for field settings. Boston: Houghton-Mifflin.
Cooper, W. H., & Richardson, A. J. (1986). Unfair comparisons.Journal of Applied Psychology, 71, 179–184.
Duncan, O. D. (1975).Introduction to structural equation models. New York: Academic.
Durlak, J., Wells, A., Gotten, J., & Lampmann, C. (June 1993). A review of primary prevention programs for children and adolescents. In J. Durlak (Chair), Evaluating Primary Prevention: Programs, Outcomes, and Issues. Symposium presented at the Fourth Biennial Conference on Community Research and Action, Williamsburg, VA.
Fienberg, S. E., Singer, B., & Tanur, J. M. (1985). Large-scale social experimentation in the United States. In A. C. Atkinson and S. E. Fienberg (Eds.),A celebration of statistics: The ISI centenary volume, New York: Springer-Verlag, pp. 287–326.
Flay, B. R. (1985). Psychosocial approaches to smoking prevention: A review of findings.Health Psychology, 4, 449–488.
Greenwald, A. G. (1976). Within-subject designs: To use or not to use?Psychological Bulletin, 83, 314–320.
Hansen, W. B., Johnson, C. A., Flay, B. R., Graham, J. W., & Sobel, J. (1988). Affective and social influences approaches to the prevention of multiple substance abuse among seventh grade students: Results from Project SMART.Preventive Medicine, 17, 135–154.
Harackiewicz, J. M., Sansone, C., Blair, L. W., Epstein, J. A., & Manderlink, G. (1987). Attributional processes in behavior change and maintenance: Smoking cessation and continued abstinence.Journal of Consulting and Clinical Psychology, 55, 372–378.
Hawkins, J. D., Catalano, R. F., & Miller, J. Y. (1992). Risk and protective factors for alcohol and other drug problems in adolescence and early adulthood: Implications for substance abuse prevention.Psychological Bulletin, 112, 64–105.
Higginbotham, H. N., West, S. G., & Forsyth, D. R. (1988).Psychotherapy and behavior change: Social, cultural, and methodological perspectives. New York: Pergaraon.
James, L. R., & Brett, J. M. (1984). Mediators, moderators, and tests for mediation.Journal of Applied Psychology, 69, 307–321.
Judd, C. M., & Kenny, D. A. (1981a).Estimating the effects of social interventions. New York: Cambridge University Press.
Judd, C. M., & Kenny, D. A. (1981b). Process analysis: Estimating mediation in treatment evaluations.Evaluation Review, 5, 602–619.
Kazdin, A. E. (1980).Research design in clinical psychology. New York: Harper & Row.
Kazdin, A. E. (1986). The evaluation of psychotherapy: Research design and methodology. In S. L. Garfield and A. E. Bergin (Eds.),Handbook of psychotherapy and behavior change (3rd ed.), New York: Wiley, pp. 23–68.
Kenny, D. A. (1979).Correlation and causality. New York: Wiley.
Kreft, I. (August 1992). Hierarchical Linear Models: Potential Applications in Psychological Research. Invited Address at the meeting of the American Psychological Association, Washington, D.C.
Lipsey, M. W. (1992). Theory as method: Small theories of treatments. In L. B. Sechrest and A. G. Scott (Eds.),New directions for program evaluation (No. 57). San Francisco: Jossey-Bass, pp. 5–38.
Maccoby, N., & Farquhar, J. W. (1975). Communication for health: Unselling heart disease.Journal of Communication, 25, 114–126.
MacKinnon, D. P., & Dwyer, J. H. (1993). Estimating mediating effects in prevention studies.Evaluation Review, 17, 144–158.
MacKinnon, D. P., Johnson, C. A., Pentz, M. A., Dwyer, J. H., Hansen, W. B., Flay, B. R., & Wang, E. (1991). Mediating mechanisms in a school-based drug prevention program: First year effects of the Midwestern Prevention Project.Health Psychology, 10, 164–172.
Mason, R. L., Gunst, R. F., & Hess, J. L (1987).Statistical design and analysis of experiments: With applications to engineering and science. New York: Wiley.
Mead, R. (1988).The design of experiments: Statistical principles for practical application. Cambridge: Cambridge University Press.
Myers, R. H., Khuri, A. I., & Carter, W. H., Jr. (1989). Response surface methodology: 1966–1988.Technometrics, 31, 137–157.
Pentz, M. A., Dwyer, J. H. MacKinnon, D. P., Flay, B. R., Hansen, W. B., Wang, E. Y. I., & Johnson, C. A. (1989). A multi-community trial for primary prevention of adolescent drug abuse: Effects on drug use prevalence.Journal of the American Medical Association, 261, 3259–3266.
Perri, M. G., McAllister, D. A., Gange, J. J., Jordan, R. C., McAdoo, W. G., & Nezu, A. M. (1988). Effects of four maintenance programs on the long-term management of obesity.Journal of Consulting and Clinical Psychology, 56, 529–534.
Pilz, J. (1983).Bayesian estimation and experimental design in linear regression models. Leibzig: Teubner-Texte.
Reynolds, K. D., West, S. G., & Aiken, L. S. (1990). Increasing the use of mammography: A pilot program.Health Education Quarterly, 17, 429–441.
Rossi, J. S. (1990). Statistical power of psychological research: What have we gained in 20 years?Journal of Consulting and Clinical Psychology, 58, 646–656.
Sandler, I. N., West, S. G., Baca, L., Pillow, D. R., Gersten, J. C., Rogosch, F., Virdin, L., Beals, J., Reynolds, K. D., Kallgren, C., Tein, J.-Y., Kriege, G., Cole, E., & Ramirez, R. (1992). Linking empirically-based theory and evaluation: The Family Bereavement Program.American Journal of Community Psychology, 20, 491–521.
Sechrest, L., West, S. G., Phillips, M. A., Redner, R., & Yeaton, W. (1979). Some neglected problems in evaluation research: Strength and integrity of treatments. In L. Sechrest and associates (Eds.),Evaluation studies review annual (Vol. 4), Beverly Hills, CA: Sage, pp. 15–35.
Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect of the power of studies?Psychological Bulletin, 105, 309–316.
Shadish, W. R. (1992). The logic and design of randomized experiments. Department of Psychology, Memphis State University, Unpublished manuscript; (chapter to appear). In T. D. Cook, W. R. Shadish, and D. T. Campbell (Eds.),Quasi-experimentation: Design and analysis issues for field settings (2nd Ed.). Boston: Houghton-Mifflin.
Shaffer, D., Philips, I., & Enzer, N. B. (Eds.) (1989). Prevention of Mental Disorders, Alcohol and Other Drug Use in Children and Adolescents. U.S. Department of Health and Human Services, Office for Substance Abuse Prevention, Rockville, MD, DHHS Publication No. (ADM) 90-1646.
Shure, M. B. (1988). How to think, not what to think: A cognitive approach to prevention. In L. A. Bond and B. M. Wagner (Eds.),Families in transition: Primary prevention programs that work. Newbury Park, CA: Sage, pp. 170–199.
Silvey, S. D. (1980).Optimal design. New York: Chapman & Hall.
Steinberg, D. M., & Hunter, W. G. (1984). Experimental design: Review and comment (with discussion).Technometrics, 26, 71–130.
Stone, A. A., Kessler, R. C., & Haythornthwaite, J. A. (1991). Measuring daily events and experiences: Decisions for researchers.Journal of Personality, 59, 575–608.
Tharp, R. G., & Gallimore, R. (1979). The ecology of program research and evaluation: A model of evaluation succession. In L. Sechrest and Associates (Eds.), Evaluation studies review annual (Vol. 4). Beverly Hills, CA: Sage, pp. 39–60.
Webster-Stratton, C., Kolpacoff, M., & Hollinsworth, T. (1988). Self-administered videotape therapy for families with conduct-problem children.Journal of Consulting and Clinical Psychology, 56, 558–566.
Weissberg, R. P., Caplan, M. Z., & Sivo, P. J. (1989). A new conceptual framework for establishing school-based social competence promotion programs. In L. A. Bond and B. E. Compas (Eds.),Primary prevention and promotion in the schools, Newbury Park, CA: Sage, pp. 255–296.
West, S. G., & Hepworth, J. T. (1991). Statistical issues in the study of temporal data: Daily experiences.Journal of Personality, 59, 609–662.
West, S. G., Newsom, J. T., & Fenaughty, A. M. (1992). Publication trends in JPSP: Stability and change in the topics, methods, and theories across two decades.Personality and Social Psychology Bulletin, 18, 473–484.
Whalen, C. K., Henker, B. Swanson, J. M., Granger, D., Kliewer, W., & Spencer, J. (1987). Natural social behaviors in hyperactive children: Dose effects of methylphenidate.Journal of Consulting and Clinical Psychology, 55, 187–193.
Wolchik, S. A., West, S. G., Westover, S., Sandler, I. N., Martin, A., Lustig, J., Tein, J.-Y., & Fisher, J. (1993). The children of divorce intervention project: Outcome evaluation of an empirically based parenting program.American Journal of Community Psychology, 21, 293–331.
Woodward, J. A., Bonett, D. G., & Brecht, M.-L. (1990).Introduction to linear models and experimental design. San Diego, CA: Harcourt Brace Jovanovich.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
West, S.G., Aiken, L.S. & Todd, M. Probing the effects of individual components in multiple component prevention programs. Am J Commun Psychol 21, 571–605 (1993). https://doi.org/10.1007/BF00942173
Issue Date:
DOI: https://doi.org/10.1007/BF00942173