Abstract
Educational interventions to support Primary Care Provider (PCP) performance of skin cancer examinations typically train PCPs to “triage and refer,” an approach that may result in diagnostic delays in regions without appropriate access to dermatology care. To address the needs of PCPs and patients in regions without appropriate access to dermatology care, we developed a multi-faceted pilot intervention, including a curriculum and telementoring, designed to support PCP performance of skin cancer detection examinations. Our intervention offers two levels of proficiency: “triage and refer” and “diagnose and manage.” The pilot intervention was conducted in collaboration with the Texas Tech University of Health Sciences Center El Paso, TX Family and Community Medicine Department (TTUHSC-El Paso). Participation in the intervention was voluntary, and 18–22 family medicine resident physicians completed the intervention tests. The participating family medicine resident physicians demonstrated statistically significant gains in knowledge and self-efficacy at the immediate post-intervention time points. Further adaption of the pilot intervention is needed to meet the needs of practicing PCPs. The pilot tests require further adaption and validation. Translating education delivery from live/synchronous to interactive virtual/asynchronous modules will support greater educational dissemination, and telementoring support is essential to address challenging cases encountered during patient care.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Examinations to detect skin cancer are cited as one of the most cost-effective and lowest-risk cancer screening interventions in modern medicine [1]. When considering skin cancer as a whole, keratinocytic carcinomas (basal cell carcinoma and squamous cell carcinoma) are more common than melanoma, but melanoma has a higher mortality rate. In the USA, an estimated 106,110 patients will be diagnosed with melanoma and 7180 patients will die from melanoma in 2021 [2], and by 2040 cutaneous melanoma is projected to be the second most common cancer [3]. In addition to the risks of morbidity and mortality, skin cancer represents a significant health care expenditure: in 2011, the US population spent approximately $8.1 billion on skin cancer–related procedures. Of the $8.1 billion in 2011 annual skin cancer expenditures, $4.8 billion were attributed to keratinocytic carcinomas and $3.3 billion dollars were attributed to melanoma [4]. Early melanoma detection, or secondary prevention, supports diagnosis at stages where straightforward therapeutic options are potentially curative. Melanoma diagnosed at advanced stages carries a significantly greater risk of therapeutic morbidity, financial toxicity [5, 6], and potentially irreversible adverse events to immune checkpoint inhibitors [7].
Early detection of skin cancers is an integral part of dermatologists’ practice, yet there are many regions of the USA without dermatologists [8]. In these regions, Primary Care Providers (PCPs) may provide essential skin cancer detection services, but there are significant training barriers to supporting early diagnosis. Eight to 25% of primary care encounters address a patient’s skin concern [9, 10], and the Family Medicine Accreditation Council for Graduate Medical Education (ACGME) recognizes the diagnosis of skin cancer as a core competency [11]. Among PCPs, performance of skin cancer examinations is variable: in 2010, 80% of respondents to National Health Interview Surveys (NHIS) reported never receiving a total body skin examination [12]. While some PCPs regularly perform skin cancer diagnostic examinations and procedures, many cite the need for additional training as a key barrier to incorporating skin examinations into clinical care [13]. Telementoring, specifically Project ECHO (Extension for Community Healthcare Outcomes), supports PCP incorporation of dermoscopy into practice [14].
There is no consensus statement reflecting the specific skin cancer–related competencies appropriate for physician, Physician Assistant/Associate or Nurse Practitioner PCPs, and there is no standard or standardized skin cancer educational curriculum. In the absence of a consensus statement and a standard educational curriculum, most PCP graduate medical training programs offer no formal skin cancer education [15], representing a key cancer control training gap.
The current spectrum of educational curricula seeking to support skin cancer diagnosis by PCPs varies widely; one of the most rigorous curricula, the Internet curriculum FOR Melanoma Early Detection (INFORMED), recently became unavailable as Adobe officially discontinued Adobe Flash Player support on December 31, 2020 [16]. But even this rigorously created educational curriculum illustrates the need for a new educational approach: PCPs who completed the INFORMED curriculum demonstrated improved knowledge and confidence [17], but in post-completion focus groups, most PCPs reported no intent to change practice, citing two specific barriers: (1) the need for more detailed instruction; and (2) the need for assistance with challenging cases encountered during patient care, or telementoring [18].
To overcome practice change barriers, we designed a multi-faceted pilot intervention which includes a curriculum and telementoring [19] to support PCP performance of skin cancer examinations. We conducted a single-site intervention pilot to test program feasibility.
Methods
The pilot intervention was conducted in collaboration with Texas Tech University Health Center – El Paso (TTUHSC-El Paso) Department of Family and Community Medicine and was approved by The University of Texas MD Anderson Cancer Center Institutional Review Board. Family medicine resident physicians reviewed a statement of consent and agreed to study participation. Participation in the intervention was voluntary and was included as part of the scheduled graduate medical education didactics.
Our intervention provides training to two levels of proficiency (Table 1). Level 1, for providers and patients with access to dermatology consultation, trains providers to “triage and refer,” with recognition of melanoma risk factors and performance of an examination to identify clinical outliers and distinguish melanoma from benign pigmented lesions. Level 2, for providers and patients without access to dermatology consultation, trains providers to “diagnose and manage,” with the addition of algorithm-based dermoscopic image analysis, performing diagnostic biopsies, interpreting pathology results, and developing appropriate plans of care. The family medicine resident physicians at TTUHSC-El Paso were given the option to participate either in one, both, or neither of the Level 1 and Level 2 interventions.
The Level 1 curriculum includes didactic content from the Visual Perception Learning [20] and INFORMED [17] evidence-based interventions. The Visual Perception Learning intervention includes four educational modules addressing how to differentiate specific subtypes of melanoma from similar appearing benign skin growths based on the clinical examination alone [20]. INFORMED is an approximately 3-h online evidence-based curriculum which addresses clinical diagnosis of the three most common skin cancers: melanoma, basal cell carcinoma, and squamous cell carcinoma along with benign lesions. Performing a clinical examination and identification of melanoma risk factors were also addressed. Sections representing similar content between the two evidence-based interventions were grouped and presented in the live (synchronous) Level 1 curriculum lecture.
The Level 2 curriculum provided instruction on algorithm-based dermoscopic image analysis through the Triage Amalgamated Diagnostic Algorithm [21]. The Triage Amalgamated Diagnostic Algorithm uses a two-step process to interpret dermoscopic images to differentiate between common benign and malignant skin neoplasms. In the first step, providers determine if the lesion in question matches the prototypical pattern for one of three common benign skin growths: angioma, dermatofibroma, or seborrheic keratosis. If the growth does not match one of those three benign diagnoses, then it is evaluated for an architectural disorder, or the presence of six additional diagnostic criteria: starburst, blue-black or gray color, shiny white structures, negative network, ulcer/erosion, vessels. If the lesion has any of the above criteria, then it should be biopsied or referred for further evaluation and management [21]. The Level 2 curriculum was divided into five 30-min live lectures delivered via Zoom, followed by 15–30 min of case-based discussion using the Project ECHO (Extension for Community Healthcare Outcomes) telementoring framework [19].
Pilot tests were developed to assess gains in knowledge (including interpretation of clinical images) and self-efficacy (or confidence). The tests were developed through a collaborative interdisciplinary process and reflected the key learning constructs of the corresponding curricula. The pilot Level 1 test included 9 multiple-choice knowledge and 12 self-efficacy items (utilizing a 10 point Likert scale), delivered via Qualtrics [22]. The Level 2 pilot test included 32 knowledge and 23 self-efficacy items. Testing was integrated into the curriculum timeline. Level 1 tests were delivered at three time points: pre-intervention, immediate post-intervention (both month 0), and 7 months after the Level 1 lecture delivery (Table 1). The 7-month post-lecture timeline was selected as a matter of convenience to align with the academic year-end. Level 2 tests were delivered at three time points: pre-intervention (month 1), intervention mid-point (month 3), and post-intervention (month 7). While the same cohort of family medicine resident physicians had the opportunity to participate in the intervention, as participation was voluntary, not all resident physicians completed all intervention curriculum lectures or tests (Table 1).
Results
Physicians completing Level 1 tests demonstrated statistically significant gains in average knowledge (p < 0.001, Fig. 1a) and self-efficacy from pre- to immediate post-educational intervention (p < 0.001, Fig. 1b/c). While gains in self-efficacy remained at statistically significant levels at the month 7 (m07) time point levels (p < 0.001), knowledge change was not statistically significant (p = 0.195).
Physicians completing the Level 2 tests demonstrated statistically significant gains in knowledge (p = 0.035, Fig. 2a) and self-efficacy (p < 0.001, Fig. 2b/c) from pre- to post-intervention time points, with significant gains in knowledge (p = 0.014) and self-efficacy (p < 0.001) reached the mid-point assessment.
Discussion
When evaluating existing interventions to support PCP performance of skin cancer examinations, three key gaps exist: (1) training PCPs to “triage and refer” may generate diagnostic delays in regions without dermatologists; (2) educational intervention studies should ideally include the intent to change practice as an outcome, as without practice change patients derive no benefit from the educational intervention; and (3) without standardized and validated knowledge and self-efficacy instruments, comparing educational interventions to determine which intervention works best is challenging. We considered these gaps and opportunities when designing our pilot intervention and tests.
The resident physician participants demonstrated a measurable change in knowledge and self-efficacy for the Levels 1 and 2 interventions. Of note, the m07 assessment of Level 1 knowledge and self-efficacy demonstrated persistent gains in self-efficacy but returned to pre-intervention knowledge levels. There are two potential explanations for this finding. First, this may reflect the exposure to the Level 2 intervention, which emphasizes dermoscopic image interpretation for benign and malignant skin growths. This exposure may have prompted a heightened recognition of subtle skin cancer presentations and changed the threshold for malignant tumor categorization. Second, this may reflect general attrition of learning and time from the educational intervention exposure.
The strengths of our pilot include the multidisciplinary team development of learning constructs and tests, utilization of existing evidence-based interventions, and the creation of proficiency levels to help match the level of education with participants’ needs. Pilot study challenges include limited data analysis given a single-site educational cohort, the sequential delivery of the intervention content which may have influenced the level 1 m07 follow-up data, and the need for future intervention adaption from the graduate medical education environment to real-world PCP practice. Given the resident physician educational cohort, intent to change practice and actual practice change were not included in our pilot test outcomes, as resident physician practice is integrated within the faculty supervision model. In addition, the pilot tests require further analysis, development, and validation.
Future research includes developing a consensus statement regarding key learning constructs and appropriate evaluative instrument items for educational interventions supporting PCP performance of skin cancer examinations. We anticipate adaptions to the intervention, tests, and implementation methods based on the outcomes of the consensus process and the transition of the intervention from resident physician to practicing PCP target audiences. Outcomes reflecting an intent to change practice, practice change, and patient-based outcomes will need to be developed and validated with future studies. Finally, to support intervention scalability, we anticipate translation of the educational intervention from live to interactive, web-based asynchronous modules complemented by geographically appropriate telementoring to address patient care challenges that may arise in practice.
Presentations
None.
References
Losina E, Walensky RP, Geller A, Beddingfield FC 3rd, Wolf LL, Gilchrest BA, Freedberg KA (2007) Visual screening for malignant melanoma: a cost-effectiveness analysis. Arch Dermatol 143(1):21–28. https://doi.org/10.1001/archderm.143.1.21
Siegel RL, Miller KD, Fuchs HE, Jemal A (2021) Cancer Statistics, 2021. CA: a cancer journal for clinicians, 71(1), 7–33. https://doi.org/10.3322/caac.21654
Rahib L, Wehner MR, Matrisian LM, Nead KT (2021) Estimated projection of US cancer incidence and death to 2040. JAMA Netw Open 4(4):e214708. https://doi.org/10.1001/jamanetworkopen.2021.4708
Guy GP, Jr, Machlin SR, Ekwueme DU, Yabroff KR (2015) Prevalence and costs of skin cancer treatment in the U.S., 2002–2006 and 2007–2011. American journal of preventive medicine, 48(2), 183–187. https://doi.org/10.1016/j.amepre.2014.08.036
Thom B, Mamoor M, Lavery JA, Baxi SS, Khan N, Rogak LJ, Sidlow R, Korenstein D (2021) The experience of financial toxicity among advanced melanoma patients treated with immunotherapy. J Psychosoc Oncol 39(2):285–293. https://doi.org/10.1080/07347332.2020.1836547
Gogebakan KC, Mukherjee K, Berry EG, Sonmez K, Leachman SA, Etzioni R (2021) Impact of novel systemic therapies on the first-year costs of care for melanoma among Medicare beneficiaries. Cancer 127(16):2926–2933. https://doi.org/10.1002/cncr.33515
Palmieri DJ, Carlino MS (2018) Immune checkpoint inhibitor toxicity. Curr Oncol Rep 20(9):72. https://doi.org/10.1007/s11912-018-0718-6
Glazer AM, Farberg AS, Winkelmann RR, Rigel DS (2017) Analysis of trends in geographic distribution and density of US dermatologists. JAMA Dermatol 153(4):322–325. https://doi.org/10.1001/jamadermatol.2016.5411
Perera E, Xu C, Manoharan S. Chapter 15: Real-Life Teledermatology, Cases, Editors: Soyer P, Binder M, Smith A, Wurm E, Telemedicine in Dermatology., Springer-Verlag. 2011, Edition 1, 123–29. https://doi.org/10.1007/978-3-642-20801-0_15
Verhoeven EW, Kraaimaat FW, van Weel C, van de Kerkhof PC, Duller P, van der Valk PG, van den Hoogen HJ, Bor JH, Schers HJ, Evers AW (2008) Skin diseases in family medicine: prevalence and health care use. Ann Fam Med 6(4):349–354. https://doi.org/10.1370/afm.861
Recommended curriculum guidelines for family ... - AAFP home (n.d.) Retrieved March 24, 2021, from https://www.aafp.org/dam/AAFP/documents/medical_education_residency/program_directors/Reprint271_Skin.pdf. Accessed 10 Jan 2022
Lakhani NA, Saraiya M, Thompson TD, King SC, Guy GP Jr (2014) Total body skin examination for skin cancer screening among U.S. adults from 2000 to 2010. Prev Med 61:75–80. https://doi.org/10.1016/j.ypmed.2014.01.003
Najmi M, Brown AE, Harrington SR, Farris D, Sepulveda S, Nelson KC. (Accepted/In press). A systematic review and synthesis of qualitative and quantitative studies evaluating provider, patient, and health care system-related barriers to diagnostic skin cancer examinations. Arch Dermatol Res. https://doi.org/10.1007/s00403-021-02224-z
Seiverling EV, Li D, Stevens K, Cyr P, Dorr G, Ahrns H (2021) Distance learning and spaced review to complement dermoscopy training for primary care. Dermatol Pract Concept 11(2):e2021030. https://doi.org/10.5826/dpc.1102a30
Moore MM, Geller AC, Zhang Z, Hayes BB, Bergstrom K, Graves JE, Kim A, Martinez JC, Shahabi L, Miller DR, Gilchrest BA (2006) Skin cancer examination teaching in US medical education. Arch Dermatol 142(4):439–444. https://doi.org/10.1001/archderm.142.4.439
Adobe Flash Player Enterprise End of Life (n.d.) Retrieved March 22, 2021, from https://www.adobe.com/products/flashplayer/enterprise-end-of-life.html. Accessed 10 Jan 2022
Eide MJ et al (2013) Effects on skills and practice from a web-based skin cancer course for primary care providers. J Am Board Fam Med 26(6):648–657
Jiang AJ, Eide MJ, Alexander GL, Altschuler A, Asgari MM, Geller AC, Fletcher SW, Halpern AC, Weinstock MA (2017) Providers’ experiences with a melanoma web-based course: a discussion on barriers and intentions. J Cancer Educ 32(2):272–279. https://doi.org/10.1007/s13187-015-0910-4
Arora S, Thornton K, Murata G, Deming P, Kalishman S, Dion D, Parish B, Burke T, Pak W, Dunkelberg J, Kistin M, Brown J, Jenkusky S, Komaromy M, Qualls C (2011) Outcomes of treatment for hepatitis C virus infection by primary care providers. N Engl J Med 364(23):2199–2207. https://doi.org/10.1056/NEJMoa1009370
Choi AW, Xu RS, Jacob S, Dulmage BO, Colavincenzo ML, Robinson JK, Xu S (2019) Visual perception training: a prospective cohort trial of a novel, technology-based method to teach melanoma recognition. Postgrad Med J 95(1124):350–352. https://doi.org/10.1136/postgradmedj-2018-136379
Seiverling EV, Ahrns HT, Greene A, Butt M, Yélamos O, Dusza SW, Marghoob AA (2019) Teaching benign skin lesions as a strategy to improve the triage amalgamated dermoscopic algorithm (TADA). J Am Board Fam Med : JABFM 32(1):96–102. https://doi.org/10.3122/jabfm.2019.01.180049
Nelson KC, Gershenwald JE, Savory SA, Wilson JM, Simon JM, Burton EM, Haydu LE (2019) Telementoring and smartphone-based answering systems to optimize dermatology resident dermoscopy education. J Am Acad Dermatol 81(2):e27–e28. https://doi.org/10.1016/j.jaad.2019.01.045
Funding
This project was supported by the generous philanthropic contributions of the Lyda Hill Foundation to the University of Texas MD Anderson Cancer Center Moon Shots Program.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics Approval
The University of Texas MD Anderson Cancer Center Institutional Review Board, protocol PA19-0536.
Conflict of Interest
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Nelson, K.C., Seiverling, E.V., Gonna, N. et al. A Pilot Educational Intervention to Support Primary Care Provider Performance of Skin Cancer Examinations. J Canc Educ 38, 364–369 (2023). https://doi.org/10.1007/s13187-021-02126-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13187-021-02126-8