Abstract
The goal of this study was to learn more about clinicians' experiences with, and perceptions of the utility, validity, and feasibility of standardized outcome measures in practice. Fifty randomly selected clinicians from multiple disciplines and multiple service agencies in a large children's public mental health service system were interviewed individually (n=30) or in focus groups (n=20) using semistructured interviews. There was great variability across clinicians in attitudes about empirical methods of treatment evaluation. There was consensus regarding feasibility challenges of administering standardized measures, including time burden and literacy barriers. Although all participants had received scored assessment profiles for their clients, the vast majority reported that they did not use the scores in treatment planning or monitoring. Their suggestions for improved clinical utility of outcome measurement are included. With increased attention and resources devoted to performance outcome assessment, it is concerning that most clinicians perceive little clinical utility of outcome measurement.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Koch JR, Lewis A, McCall D. A multistakeholder-driven model for developing an outcome management system.The Journal of Behavioral Health Services & Research. 1998;25:151–162.
Cesare-Murphy M, McMahill C, Schyve P. Joint commission evaluation of behavioral health care organizations.Evaluation Review: Measuring Quality in Mental Health Services. 1997;21:322–329.
Bickman L, Rosof J, Salzer MS, et al. What information do clinicians value for monitoring adolescent client progress?Professional Psychology: Research and Practice. 2000;31:70–74.
Addis ME, Krasnow AD. A national survey of practicing psychologists' attitudes toward psychotherapy treatment manuals.Journal of Consulting and Clinical Psychology. 2000;68:331–339.
Lueger RJ, Howard KI, Martinovich Z, et al. Assessing treatment progress of individual patients using expected treatment response models.Journal of Consulting and Clinical Psychology. 2001;69:150–158.
Burnam MA. Measuring outcomes of care for substance use and mental disorders. In: Steinwachs DM, Flynn LM, Norquist GS, et al, eds.New Directions for Mental Health Services, No. 71: Using Client Outcomes Information to Improve Mental Health and Substance Abuse Treatment. San Francisco, Calif: Jossey-Bass; 1996:3–18.
Smith RG. State of the science of mental health and substance abuse patient outcomes assessment. In: Steinwachs DM, Flynn LM, Norquist GS, et al, eds.New Directions for Mental Health Services, No. 71: Using Client Outcomes Information to Improve Mental Health and Substance Abuse Treatment. San Francisco, Calif: Jossey-Bass; 1996:59–67.
Goebel L. A peer review of feedback method of promoting compliance with preventive care guidelines in a resident ambulatory care clinic.Joint Commission Journal on Quality Improvement. 1997;23:196–202.
Dawes RM.House of Cards: Psychology and Psychotherapy Built on Myth. New York: Free Press; 1994.
Garb HN.Studying the Clinician: Judgment Research and Psychological Assessment. Washington, DC: American Psychological Association; 1998.
Meehl PE.Clinical Versus Statistical Prediction: A Theoretical Analysis and a Review of the Evidence. Minneapolis, Minn: University of Minnesota Press; 1954.
California Mental Health Planning Council (CMHPC).Adult Performance Outcome Study: Wave 1 to Wave 2. Sacramento, Calif: CMHPC; 1997.
Achenbach TM.Manual for the Child Behavior Checklist/4–18 and 1991 Profile. Burlington, VT: University of Vermont Department of Psychiatry; 1991.
Achenbach TM.Manual for the Youth Self-Report and 1991 Profile. Burlington: University of Vermont, Department of Psychiatry; 1991.
Hodges K. Child and Adolescent Functional Assessment Scale (CAFAS). In: Maruish ME, ed.The Use of Psychological Testing for Treatment Planning and Outcomes Assessment. 2nd ed. Mahwah, NJ: Erlbaum; 1999:631–664.
Attkisson CC, Zwick R. The Client Satisfaction Questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome.Evaluation and Program Planning. 1982;5:233–237.
Breda CS. Methodological issues in evaluating mental health outcomes of a children's mental health managed care demonstration.The Journal Of Mental Health Administration. 1996;23:40–50.
Hoagwood K, Burns BJ, Kiser L, et al. Evidence-based practice in child and adolescent mental health services.Psychiatric Services. 2001;52:1179–1189.
National Advisory Mental Health Council (NAMHC).Blueprint for Change: Research on Child and Adolescent Mental Health. A Report by the National Advisory Mental Health Council's Workgroup on Child and Adolescent Mental Health Intervention Development and Deployment. Bethesda, Md: National Institutes of Health/National Institute of Mental Health; 2001.
Abrahamson DJ. Outcomes, guidelines, and manuals: on leading horses to water.Clinical Psychology: Science and Practice. 1999;6:467–471.
Addis ME, Wade WA, Hatgis C. Barriers to dissemination of evidence-based practices: addressing practitioners' concerns about manual-based psychotherapies.Clinical Psychology: Science and Practice. 1999;6:430–441.
Aarons GA. Clinician personality and attitudes toward adoption of empirically supported treatments. Presented at the 15th International Conference on Mental Health Services Research. Evidence in Mental Health Services Research: What Types, How Much, and Then What? National Institute of Mental Health; April 2002; Washington, DC.
Hoagwood K, Jensen PS, Petti T, et al. Outcomes of mental health care for children and adolescents, I: A comprehensive conceptual model.Journal of the American Academy of Child and Adolescent Psychiatry. 1996;35:1055–1062.
QSR Nudist Vivo 1.0 [computer software]. Melbourne, Australia: Qualitative Solutions & Research Pty Ltd; 1999.
Beutler LE. David and Goliath: when empirical and clinical standards of practice meet.American Psychologist. 2000;55:997–1007.
Achenbach TM.Manual for the CBCL/4–18 and Profile. Burlington: University of Vermont Department of Psychiatry; 1991.
Beutler LE. Comparisons among quality assurance systems: from outcome assessment to clinical utility.Journal of Consulting and Clinical Psychology. 2001;69:197–204.
Persons JB. Conducting effectiveness studies in the context of evidence-based clinical practice.Clinical Psychology: Science and Practice. 2001;8:168–172.
Lambert MJ, Hansen NB, Finch AE. Patient-focused research: using patient outcome data to enhance treatment effects.Journal of Consulting and Clinical Psychology. 2001;69:159–172.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Garland, A.F., Kruse, M. & Aarons, G.A. Clinicians and outcome measurement: What's the use?. The Journal of Behavioral Health Services & Research 30, 393–405 (2003). https://doi.org/10.1007/BF02287427
Issue Date:
DOI: https://doi.org/10.1007/BF02287427