Abstract
BACKGROUND: Improved educational and evaluation methods are needed in continuing professional development programs.
OBJECTIVE: To evaluate the long-term impact of a faculty development program in palliative care education and practice.
DESIGN: Longitudinal self-report surveys administered from April 2000 to April 2005.
PARTICIPANTS: Physician and nurse educators from North America and Europe. All program graduates (n=156) were invited to participate.
INTERVENTION: Two-week program offered annually (2000 to 2003) with 2 on-site sessions and 6-month distance-learning period. Learner-centered training addressed teaching methods, clinical skill development, and organizational and professional development.
MEASURES: Self-administered survey items assessing behaviors and attitudes related to palliative care teaching, clinical care, and organizational and professional development at pre-, postprogram, and long-term (6, 12, or 18 months) follow-up.
RESULTS: Response rates: 96% (n=149) preprogram, 73% (n=114) follow-up. Participants reported increases in: time spent in palliative care practice (38% preprogram, 47% follow-up,P<.01); use of learner-centered teaching approaches (sum of 8 approaches used “a lot”: preprogram 0.7 ± 1.1, follow-up 3.1 ± 2.0,P<.0001); and palliative care topics taught (sum of 11 topics taught “a lot”: preprogram 1.6 ± 2.0, follow-up 4.9 ± 2.9,P<.0001). Reported clinical practices in psychosocial dimensions of care improved (e.g., assessed psychosocial needs of patient who most recently died: 68% preprogram, 85% follow-up,P=.01). Nearly all (90%) reported launching palliative care initiatives, and attributed their success to program participation. Respondents reported major improvements in confidence, commitment to palliative care, and enthusiasm for teaching. Eighty-two percent reported the experience as “transformative.”
CONCLUSIONS: This evidence of enduring change provides support for the potential of this educational model to have measurable impact on practices and professional development of physician and nurse educators.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Sohn W, Ismail AI, Tellez M. Efficacy of educational interventions targeting primary care providers’ practice behaviors: an overview of published systematic reviews. J Public Health Dent. 2004;64:164–72.
Wartman SA. Revisiting the idea of a national center for health professions education research. Acad Med. 2004;79:910–17.
Stanford Faculty Development Program in End-of-Life Care. Available at: http://sfdc.stanford.edu. Accessed February 14, 2006.
Armstrong EG, Doyle J, Bennett NL. Transformative professional development of physicians as educators: assessment of a model. Acad Med. 2003;78:702–8.
Cantillon P, Jones R. Does continuing medical education in general practice make a difference? BMJ. 1999;318:1276–9.
Davis D, Thomson O’Brien MA, Freemantle N, Wolf FM, Mazmanian P, Taylor-Vaisey A. Impact of formal continuing medical education: do conferences, workshops. rounds, and other traditional continuing education activities change physician behavior or health care outcomes? JAMA. 1999;282:867–74.
Davis DA, Thomson O’Brien MA, Oxman AD, Haynes RB. Evidence for the effectiveness of CME. A review of 50-randomized-controlled trials. JAMA. 1992;268:1111–7.
Davis DA, Thomson O’Brien MA, Oxman AD, Haynes RB. Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA. 1995;274:700–5.
Oxman AD, Thomson O’Brien MA, Davis DA, Haynes RB. No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. Canadian Medical Association J. 1995;153:1423–31.
Lim JK, Golub RM. Graduate medical education research in the 21st century and JAMA on call. JAMA. 2004;292:2913–5.
Carney PA, Nierenberg DW, Pipas CF, Brooks WB, Stukel TA, Keller AM. Educational epidemiology: applying population-based design and analytic approaches to study medical education. JAMA. 2004;292:1044–50.
Lurie SJ. Raising the passing grade for studies of medical education [comment]. JAMA. 2003;290:1210–12.
Block SD. Medical education in end-of-life care: the status of reform. J Palliat Med. 2002;5:243–8.
Sullivan AM, Warren AG, Lakoma MD, Liaw KR, Hwang D, Block SD. End-of-life care in the curriculum: a national study of medical education deans. Acad Med. 2004;79:760–8.
World Health Organization. Building nursing competency in pain control and palliative care. Cancer Pain Release. Available at: http://www.whocancerpain.wisc.edu/eng/12_3/competency.html. Accessed February 9, 2006.
American Medical Association EPEC™ (Education in Palliative and End-of-life Care) Project. Available at: http://www.epec.net/EPEC/webpages/index.cfm. Accessed February 14, 2006.
Center to Advance Palliative Care (CAPC). Listing of current palliative care training. Available at: http://www.capc.org/palliative-care-professional-development/Training/. Accessed February 14, 2006.
Emanuel LL, von Gunten CF, Ferris FD. Gaps in end-of-life care. Arch Fam Med. 2000;9:1176–80.
Franks PJ, Salisbury C, Bosanquet N, et al. The level of need for palliative care: a systematic review of the literature. Palliat Med. 2000;14:93–104.
Meraviglia MG, McGuire C, Chesley DA. Nurses’ needs for education on cancer and end-of-life care. J Contin Educ Nurs. 2003;34:122–7.
The American College of Surgeons. Statement on principles guiding care at the end of life. J Am Coll Surg. 2002;194:664.
Center to Advance Palliative Care. National consensus project releases clinical practice guidelines for palliative care. Available at: http://www.capc.org/Documents/NCPPalliativeCareGuidelines. Accessed May 24, 2004.
American Geriatrics Society Ethics Committee. The care of dying patients: a position statement from the American Geriatrics Society. Journal of the American Geriatrics Society. 2002. Available at: http://www.aacn.nche.edu/Publications/deathfin.htm. Accessed May 13, 2004.
American Board of Internal Medicine Committee on the Evaluation of Clinical Competence. Caring for the Dying: Identification and Promotion of Physician Competency. Philadelphia: American Board of Internal Medicine; 1998.
Council on Scientific Affairs AMA. Good care of the dying patient. N Engl JMed. 1996;275:474–8.
American Association of Colleges of Nursing. Peaceful death. Recommended competencies and curricular guidelines for end-of-life nursing care. American Association of Colleges of Nursing. Accessed May 13, 2004.
American Society of Clinical Oncology. Cancer care during the last phase of life. J Clin Oncol. 1998;16:1986–96.
Field MJ, Cassel CK, eds. Approaching Death: Improving Care at the End of Life. Washington, DC: Institute of Medicine, National Academy Press; 1997.
Foley K, Gelband H, eds. National Cancer Policy Board, Improving Palliative Care for Cancer: Summary and Recommendations. Washington, DC: The National Academies Press; 2001.
Sullivan A, Lakoma MD, Peters AS, Billings JA, Block SD, the PCEP Core Faculty. Teaching and learning end-of-life care: evaluation of a faculty development program in palliative care. Acad Med. 2005;80:657–68.
Merriam SB, Caffarella RS. Learning in Adulthood: A Comprehensive Guide. 2nd edn. San Franscisco, CA: Jossey-Bass Inc; 1999.
Schon DA. Educating the Reflective Practitioner: Toward a New Design for Teaching and Learning in the Professions. San Francisco, CA: Jossey-Bass Publishers; 1990.
Skeff KM, Stratos GA, Bergen MR, Regula DP Jr. A pilot study of faculty development for basic science teachers. Acad Med. 1998;73:701–4.
Skeff KM, Stratos GA, Berman J, Bergen MR. Improving clinical teaching. Evaluation of a national dissemination program. Arch Intern Med. 1992;152:1156–61.
Skeff KM, Stratos GA, Mygdal W, et al. Faculty development. A resource for clinical teachers. J Gen Intern Med. 1997;12(suppl 2):S56-S63.
Green ML, Gross CP, Kernan WN, Wong JG, Holmboe ES. Integrating teaching skills and clinical content in a faculty development workshop. J Gen Intern Med. 2003;18:468–74.
Peters AS, Ladden MD, Kotch JB, Fletcher RH. Evaluation of a faculty development program in managing care. Acad Med. 2002;77:1121–7.
Skeff KM, Bergen MR, Stratos GA. Evaluation of a medical faculty development program: a comparison of traditional pre/post and retrospective pre/post self assessment ratings. Eval Health Prof. 1992;15:350–66.
Levinson W, Gordon G, Skeff K. Retrospective versus actual pre-course self-assessments. Eval Health Prof. 1990;13:445–52.
Pratt CC, Mc guigan WM, Katzev AR. Measuring program outcomes: using retrospective pretest methodology. Am J Eval. 2000;21:341–50.
Howard G, Dailey PR. Response-shift bias: a source of contamination of self-report measures. J Appl Psychol. 1979;4:93–106.
Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd edn. Hillsdale, NJ: Lawrence Earlbaum Associates; 1988.
Stevens J. Applied Multivariate Statistics for the Social Sciences. Hillsdale, NJ: Lawrence Erlbaum Associates; 1992.
Neter J, Wasserman W, Kutner MH. Applied Linear Statistical Models: Regression. Analysis of Variance, and Experimental Designs. 3rd edn. Boston: Irwin; 1990.
Mazmanian PE, Davis DA. Continuing medical education and the physician as a learner: guide to the evidence. JAMA. 2002;288:1057–60.
Cauffman JG, Forsyth RA, Clark VA, et al. Randomized controlled trials of continuing medical education: what makes them most effective? J Contin Educ Health Prof. 2002;22:214–21.
Fallowfield L, Jenkins V. Communicating sad, bad, and difficult news in medicine. Lancet. 2004;363:312–19.
Accreditation Council for Graduate Medical Education. General Competencies: minimum program requirements language. Available at: http://www.acgme.org/outcome/comp/compMin.asp. Accessed April 28, 2005.
Schon D. The reflective Practitioner: How Professionals Think in Action. London: Temple Smith; 1983.
Chapman DM, Hayden S, Sanders AB, et al. Integrating the accreditation council for graduate medical education core competencies into the model of the clinical practice of emergency medicine. Ann Emerg Med. 2004;43:756–69.
Carraccio C, Englander R, Wolfsthal S, Martin C, Ferentz K. Educating the pediatrician of the 21st century: defining and implementing a competency based system. Pediatrics. 2004;113:252–8.
Wass V, Van der Vleuten C, Shatzer J, Jones R. Assessment of clinical competence. Lancet. 2001;357:945–9.
Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;65(suppl):S63-S7.
Accreditation Council for Graduate Medical Education and American Board of Medical Specialties. Toolbox of Assessment Methods. Available at: http;://www.acgme.org/outcome/assess/Toolbox.pfd. Chicago, IL: 2000.
Leach DC. Competence is a habit. JAMA. 2002;287:243–4.
Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA. 2002;287:226–35.
Landon BE, Normand SL, Blumenthal D, Daley J. Physician clinical performance assessment: prospects and barriers. JAMA. 2003;290:1183–9.
Lipsey MW, Wilson DB. The efficacy of psychological, educational, and behavioral treatment. Confirmation from meta-analysis. Am Psychol. 1993;48:1181–209.
Author information
Authors and Affiliations
Consortia
Corresponding author
Additional information
None of the authors have any conflicts of interest to declare.
PCEP Core faculty: Janet Abrahm, MD, Dana-Farber Cancer Institute, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA; Loring Conant, Jr., MD, Cambridge Hospital, Cambridge, MA, USA, and Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Constance Dahlin, RNCS, MSN, OCNS, CHPN, Massachusetts General Hospital, Boston, MA, USA; Marshall Forstein, MD, Cambridge Hospital, Cambridge, MA, USA, and Harvard Medical School, Boston, MA, USA; Paul Montgomery, PhD, Massachusetts General Hospital, Boston, MA, USA; Joanne Wolfe, MD, Dana-Farber Cancer Institute, and Children’s Hospital, Harvard Medical School, Boston, MA, USA.
This program and evaluation were made possible by a grant from the Robert Wood Johnson Foundation. We are grateful to the PCEP participants for their participation in this study.
Rights and permissions
About this article
Cite this article
Sullivan, A.M., Lakoma, M.D., Billings, J.A. et al. Creating enduring change. J GEN INTERN MED 21, 907–914 (2006). https://doi.org/10.1007/BF02743136
Received:
Revised:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF02743136