Summary
Background
Intimate knowledge of the materials used in endovascular aortic interventions is essential for trainees and supporting staff taking part in an endovascular intervention. Training courses can help to familiarize trainees with the equipment. However, the pandemic has changed the landscape of hands-on training courses significantly. Therefore, we developed a training course including an educational recording of the procedure to transfer knowledge about the materials used during endovascular interventions and radiation exposure reduction.
Methods
We produced a video depicting cannulation of the left renal artery in a silicon cast of an aorta and its major side branches under C‑arm fluoroscopy. A presentation using the video was given to the trainees. The trainees were randomized into a control and an intervention group. Their performance was filmed and rated on a standardized five-point scale in the style of the OSATS global rating scale. The intervention group was remeasured after additional training time.
Results
In total, 23 trainees participated in the training and agreed to have their performance recorded. The control and intervention groups showed no difference in the assessed performance metrics during their initial attempt. However, after receiving additional training, the intervention group significantly improved in all evaluated metrics.
Conclusion
Our data add to the growing evidence that simulator-based training can help to increase trainees’ understanding and performance of relevant skills. A standardized and evidence-based validation process for simulators could improve their acceptance in the medical field.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Endovascular aortic interventions require an in-depth knowledge of the materials used, such as the various catheters, sheaths, wires, stents, and other devices. The workspace during endovascular interventions extends away from the patient and all the way to the end of the wire, and most of the team will touch the equipment travelling up and down the line. This contrasts with open surgery, where the operating surgeon handles most of the instruments that come into contact with the patient. An intimate knowledge of these materials is essential for trainees and supporting staff taking part in an endovascular intervention.
Training courses can help to familiarize trainees with the equipment and simulator-based training can provide an opportunity to handle the equipment before taking part in surgery [1].
Endovascular surgery not only includes significant risks for the patient, but for the operation team as well. Long-term radiation damage in surgical teams is a reality we must face and an area in which our knowledge will most likely increase over the coming years [2].
For these reasons, we developed a training course and video designed to transfer knowledge about the materials used during endovascular interventions, the handling of the materials, and radiation exposure reduction.
Methods
Institutional review board approval
The ethics committee of the City of Vienna approved the collection of the participants data during a live radiation training under the identifier EK 18-075-0618. All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki declaration of 1975, as revised in 2008.
Participants
The participants consisted of surgical residents, medical students, and scrub nurses who were expected to participate in real-life endovascular procedures. Before participating in the training, they received a standardized refresher on X‑ray exposure, radiation safety, and handling of the C‑arm.
Materials
Central to our simulation was a negative cast of a 3D print of a patient’s aorta made from silicone. When placed under a Ziehm Vision RFD (Ziehm Imaging GmbH, Nuremberg, Germany) and primed with silicone spray and water, the image rendered resembles an overlay after angiography (Figs. 1 and 2).
We filmed and cut a video depicting cannulation of the left renal artery. The goal of the training was to cannulate the left renal artery using a soft wire and an appropriate catheter and to switch to a semi-stiff wire. A standardized layout of different wires and catheters was available to the trainees.
Study design
The trainees received the training video before the training date and were asked to study it (Video 1). A standardized presentation using the video was given to each group of trainees directly before the training session. The trainees were randomized to a control and an intervention group. Both groups participated in an inaugural training session. Their performance was rated on a standardized five-point scale in the style of the Objective Structured Assessment of Technical Skills (OSATS) global rating scale ([3]; Fig. 3). Because multiple tasks, e.g., exact handling of the wires and catheters, fluoroscopy, collimation, and C‑arm setting had to be observed simultaneously, we filmed the trainees’ performance from multiple angles to allow the observer to review the performance of the trainees after each session. Additionally, we recorded the total time of each session and the radiation time and dose. After the first training session, the intervention group had the opportunity to train using the simulator for another 30 min and to review the instructional video. Afterwards, they were asked to perform another training session, which was observed and rated.
Trainees were responsible for operating the C‑arm and choosing the collimation and settings. The key switch was kept in an X‑ray off position until appropriate settings were chosen by the trainees to ensure minimal radiation exposure.
Statistical analysis
Descriptive statistics of the collected data include means, medians, and standard deviations (SD). Wilcoxon signed-rank and rank sum tests were used to compare group means. A p-value < 0.05 was considered statistically significant. Statistical analyses were performed in R using RStudio (Posit PBC, Boston, MA, USA).
Results
Participants characteristics
In total, 23 trainees participated in the training and agreed to have their performance recorded and rated. The trainees were continuously randomized to the control group (n = 9) or to the intervention group (n = 14). The intervention group consisted of 5 residents, 2 nurses, and 7 medical students, while the control group included 3 residents, 3 nurses, and 3 medical students. The mean age did not differ significantly between the two groups (29.9 in the control group vs. 26.3 in the intervention group, p = 0.20).
Performance assessment
The performance of the two groups during the first training session did not differ significantly as measured by total time needed to complete the task (intervention 13:48 min SD 9:38 vs. control 13:54 min SD 8:07, p = 0.829), grading on the five-point performance scale (intervention 22.2 SD 4.13 vs. control 22.8 SD 4.44, p = 0.899), or total radiation exposure (intervention 93.2 cGy/cm2 SD 76.19 vs. control 112.0 cGy/cm2 SD 77.8, p = 0.201).
After the intervention group had undergone additional training and had the opportunity to review the instructional video, they performed significantly better when compared to the control group (Fig. 3) or their own first attempts (Fig. 4). The total time to complete the task after the intervention was 6:16 min SD 2:01 vs. 13:53 min SD 8:07 in the controls (p = 0.001), the overall score was 26.7 SD 2.55 vs. 22.2 SD 4.13 (p = 0.002), and the radiation dose was 52.1 cGy/cm2 SD 18.6 vs. 93.2 cGy/cm2 SD 76.2 (p = 0.003; Tables 1 and 2).
Conclusion
German-speaking countries have traditionally used an apprenticeship-based training to educate their surgical staff. The quality measurement of the training is based on the number of operations performed and the absolute time spent working in a clinical role. The non-clinical part of a surgeon’s education is subsumed under hours spent on certified external courses or symposia. There are few legal requirements for standardized communication training and team training in the curriculum or as part of the ongoing education as a senior healthcare provider.
Patient safety and quality of care increase when healthcare providers train together to become a more efficient team [4, 5]. While training and evaluation tools for surgical education exist, their everyday use is limited by a combination of the growing scarcity of healthcare resources and a lack of legal requirements [1].
Our data add to the growing evidence that simulator-based training can help to increase trainees’ understanding and performance of relevant skills [6,7,8]. Our simulator-centered training course provides trainees with the opportunity to experience the tasks and challenges faced by other members of an endovascular intervention team, a requirement for cross-training.
Recruitment of participants into this study began at the outbreak of the COVID-19 pandemic in Europe. Further enrolment of participants was planned, but ended due to the rising incidence of COVID-19 and subsequent contact restrictions in Austria. The resulting sample size is therefore smaller than initially planned and represents a limitation of this study.
Observer bias is one of the limitations of this study, since we were unable to blind the observer in our setup. For future studies, we plan to bypass this by filming the gloved hands of participants and directly recording the C‑arm interface, allowing for a blinded observation of the tasks by multiple observers. The inter- and intra-observer reliability of the setup could be evaluated using this improved study design. This design could allow us to perform remote training sessions with the experienced observer physically absent from the individual training session. It would also enable us to perform longitudinal skill assessments spanning months or years to document the trainee’s progress.
Our study design is limited by the fact that we did not collect data on real-life team performance. It remains to be investigated whether training on this simulator improves patient safety and outcomes. Testing for these parameters would be resource intensive and possibly prohibitive for future simulator development.
However, it has been previously discussed that effective training enhances team performance [9]. A standardized and evidence-based validation process for simulators and simulator-based courses could improve their acceptance in the medical field.
Simulator-based courses have the potential to enhance the learning curve of surgical trainees and provide a safe opportunity for team training.
References
Fritz T, Stachel N, Braun BJ. Evidence in surgical training—a review. Innov Surg Sci. 2019;4(1):7–13.
Stahl CM, Meisinger QC, Andre MP, Kinney TB, Newton IG. Radiation risk to the fluoroscopy operator and staff. AJR Am J Roentgenol. 2016;207(4):737–44.
Martin JA, Regehr G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84(2):273–8.
Weaver SJ, Dy SM, Rosen MA. Team-training in healthcare: a narrative synthesis of the literature. BMJ Qual Saf. 2014;23(5):359–72.
Rosen MA, DiazGranados D, Dietz AS, et al. Teamwork in healthcare: key discoveries enabling safer, high-quality care. Am Psychol. 2018;73(4):433–50.
Alaker M, Wynn GR, Arulampalam T. Virtual reality training in laparoscopic surgery: a systematic review & meta-analysis. Int J Surg. 2016;29:85–94.
Taher F, Plimon M, Isaak A, et al. Ultrasound-guided percutaneous arterial puncture and closure device training in a pulsatile model. J Surg Educ. 2020;77(5):1271–8.
Isaak A, Wolff T, Zdoroveac A, et al. Ultrasound-guided percutaneous arteriovenous fistula creation simulation training in a lifelike flow model. Bioengineering (Basel). 2022;9(11):659. https://doi.org/10.3390/bioengineering9110659.
Bearman M, O’Brien R, Anthony A, et al. Learning surgical communication, leadership and teamwork through simulation. J Surg Educ. 2012;69(2):201–7.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
M. Plimon, J. Falkensammer, F. Taher, A. Hofmann and A. Assadian declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Video 1
The training video used in this study. https://www.youtube.com/watch?v=1Bcz_fMy7yE
Rights and permissions
About this article
Cite this article
Plimon, M., Falkensammer, J., Taher, F. et al. Remote training and evaluation of a simulator-based training course for complex endovascular procedures. Eur Surg 55, 84–88 (2023). https://doi.org/10.1007/s10353-023-00799-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10353-023-00799-7