Abstract
To establish a safer and more efficient treatment strategy with mini-endoscopic combined intrarenal surgery (ECIRS), the present study aimed to develop models to predict the outcomes of mini-ECIRS in patients with renal and/or ureteral stones. We retrospectively analysed consecutive patients with renal and/or ureteral stones who underwent mini-ECIRS at three Japanese tertiary institutions. Final treatment outcome was evaluated by CT imaging at 1 month postoperatively and stone free (SF) was defined as completely no residual stone or residual stone fragments ≤ 2 mm. Three prognostic models (multiple logistic regression, classification tree analysis, and machine learning-based random forest) were developed to predict surgical outcomes using preoperative clinical factors. Clinical data from 1432 ECIRS were pooled from a database registered at three institutions, and 996 single sessions of mini-ECIRS were analysed in this study. The overall SF rate was 62.3%. The multiple logistic regression model consisted of stone burden (P < 0.001), number of involved calyces (P < 0.001), nephrostomy prior to mini-ECIRS (P = 0.091), and ECOG-PS (P = 0.110), wherein the area under the curve (AUC) was 70.7%. The classification tree analysis consisted of the number of involved calyces with an AUC of 61.7%. The random forest model showed that the top predictive variable was the number of calyces involved, with an AUC of 91.9%. Internal validation revealed that the AUCs for the multiple logistic regression model, classification tree analysis and random forest models were 70.4, 69.6 and 85.9%, respectively. The number of involved calyces, and a smaller stone burden implied a SF outcome. The machine learning-based model showed remarkably high accuracy and may be a promising tool for physicians and patients to obtain proper consent, avoid inefficient surgery, and decide preoperatively on the most efficient treatment strategies, including staged mini-ECIRS.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Introduction
Endoscopic combined intrarenal surgery (ECIRS) is a combination of endoscopic surgery with percutaneous nephroscopic access and retrograde ureteroscopic access, and is now recognised as one of the standard endoscopic treatment options for renal and ureteral stone1,2,3,4. Achieving stone free (SF) status rates are 65.3–81.9%2,5,6 and perioperative complication rates are 7.3–38.6%2,7,8 indicating higher efficacy and a safer procedure than percutaneous nephrolithotripsy (PCNL) alone1,4,9,10,11. In the last decade, ECIRS has become a less invasive procedure, and mini-ECIRS has emerged with a smaller percutaneous access tract and nephroscopy, demonstrating the advantages of less postoperative pain and potentially less bleeding than conventional ECIRS12.
However, ECIRS requires at least two experienced endoscopic surgeons and is generally challenging to perform safely because of the learning curve13, which is reported to cause perioperative complications, including fever, sepsis, and other organ injuries2,7,8. There is a clear demand for accurate prediction of ECIRS outcomes based on preoperative factors, allowing the allocation of reasonable and feasible treatment strategies. However, there is scarce literature reporting on and investigating mini-ECIRS, leading to a lack of clinical evidence for ECIRS.
To address some clinical issues in ECIRS, we created the largest cohort of ECIRS data from three high-volume centres in Japan and developed three prediction models of mini-ECIRS outcomes based on clinical parameters, followed by internal validation. To the best of our knowledge, this is the first study to develop prediction models of mini-ECIRS outcome including machine learning model utilizing the largest cohort of the database. Those our proposed prediction model will lead to a safer and more efficient treatment strategy with mini-ECIRS and will be beneficial for surgeons and patients who undergo mini-ECIRS.
Materials and methods
The clinical information of consecutive patients who underwent conventional or mini-ECIRS for urinary stone disease between 2015 and 2021 at three high-volume centres in Japan (Yokosuka Kyosai Hospital, Ohguchi East General Hospital, and Hara Genitourinary Hospital) was collected and pooled for analysis. The inclusion criterion was single-session mini-ECIRS for the treatment of renal and/or ureteral stones. There were no restrictions on patient age, Eastern Cooperative Oncology Group Performance Status (ECOG-PS), and position setup during mini-ECIRS. Both modified Valdivia and prone positions were included, as previous work has shown ECIRS in both positions with comparable results14. The exclusion criteria were as follows: preoperatively intended staged procedures, no available postoperative CT, and no available preoperative clinical information. Patients with urinary tract abnormalities, including horseshoe kidney, ileal conduit, neobladder, severe ureteral stricture, and ureteropelvic junction (UPJ) obstruction that did not allow ureteroscopy (URS) to be used during mini-ECIRS were also excluded. The study protocol (IRB number 20-90 at Yokosuka Kyosai Hospital, 202201 at Ohguchi East General Hospital, and 2021-05-06 at Hara Genitourinary Hospital) waiving the requirement for written informed consent was approved by the institutional ethics committee of each hospital. Informed consent was obtained from participants as an opt-out on each hospital website. The study was conducted in accordance with the principles of the Declaration of Helsinki and all local regulations.
Non-contrast CT imaging was utilised to evaluate surgical outcomes at 1 month postoperatively, following the same protocol in the three institutions. SF was defined by CT imaging 1 month postoperatively as completely no residual stone or residual stone fragments ≤ 2 mm. Residual stone fragments > 2 mm was defined as non-SF.
The ECIRS technique was similar to previously reported methods in modified Valdivia or prone position15. All enrolled procedures were performed by 2–3 urologists, with at least one surgeon with more than 50 ECIRS procedures as a supervisor. In brief, two urologists worked simultaneously to fragment the kidney stones: one performed PCNL and the other performed URS. A ureteral access sheath (10/12 or 12/14Fr B-Flex, Rocamed, Monaco, Italy) was placed to facilitate frequent insertion of fURS (URF-V2 or P-6™; Olympus, Tokyo, Japan or Flex-X2™, Karl Storz, Tuttlingen, Germany). A 9.5Fr ureteral access sheath (Flexor, Cook Medical LLC, Bloomington, USA) was used for difficult ureters16. Percutaneous renal access was performed under ultrasound guidance with or without fURS monitoring. The choice of puncture calyx was at the discretion of the PCNL surgeon for efficient treatment. The percutaneous operating sheath (13Fr or 17.5F) was inserted using a one-step dilator. We utilized a Holmium‐YAG laser (Lumenis Pulse™ 120H; Yokne’am Illit, Israel or Dornier MedTech; Munich, Germany) through a fURS (commonly used laser settings were 0.5–1.0 J at 5–10 Hz) and a pneumatic lithotripsy (Swiss LithoClast® Master J; Electro Medical Systems, Nyon, Switzerland) through a mini-nephroscope (Olympus or Karl Storz). The stone burdens were crashed into tiny fragments and washed out through the PCNL sheath using manual or automated retrograde irrigation (UROMAT E.A.S.I.®; Karl Storz). Finally, a 6F ureteral stent tube and/or a 14F urinary nephrostomy tube were placed for 2–4 weeks and/or a few days, respectively, in cases of risk of postoperative infection or bleeding.
Three prognostic models (multiple logistic regression, classification tree analysis, and machine learning-based random forest) were used to predict SF using preoperative clinical factors17. The models were developed using age, sex, body mass index (BMI), ECOG-PS, stone laterality (left or right), number of stones, stone burden (sum of the largest stone diameters), number of involved calyces, stone position (presence or absence of R2 stone), presence of hydronephrosis, indwelling preoperative stenting, and preoperative nephrostomy. To summarise the crude relationship, a univariate logistic regression was initially performed. In multiple logistic regression, variables were selected by stepwise selection using the Akaike Information Criteria18. The area under the receiver operating characteristic curve (AUC) was used to evaluate the predictive ability. The random forest model is a supervised machine learning algorithm that grows multiple classification trees, wherein variables are evaluated for more accurate prediction using the mean decrease in the Gini coefficient value (a larger mean decrease indicates stronger predictive potential)17,19,20. Classification tree analysis enables the selection of predominant factors and determines the significance thresholds of these parameters17,21. Internal validation was performed to evaluate overfitting and optimism using the bootstrap method22, wherein 1000 bootstrap samples were repeatedly generated from an original dataset. All analyses were performed using R 4.2.3, using the rpart, randomForest, and pROC packages.
Informed consent
Informed consent was obtained from participants as an opt-out on each hospital website. The study protocol (IRB number 20-90 at Yokosuka Kyosai Hospital, 202201 at Ohguchi East General Hospital, and 2021-05-06 at Hara Genitourinary Hospital) waiving the requirement for written informed consent was approved by the institutional ethics committee of each hospital.
Results
Clinical data from 1432 ECIRS were pooled in a database registered from three institutions and 1374 of 1432 were identified as mini-ECIRSs. Finally, 996 single sessions of mini-ECIRS were analysed in this study after 378 cases were excluded, mainly due to intended preoperative staged ECIRS (Fig. 1). The overall SF rate (complete no residual stone or residual stone fragments ≤ 2 mm) was 62.3%. Only three cases were performed in the prone position and remained in the modified Valdivia position. The stone burden, number of stones, and involved calyces were significantly lower in the SF group than in the non-SF group (P < 0.001, Table 1).
Surgical treatment outcomes are summarised in Table 2. The most common postoperative complications (Clavien–Dindo ≥ 2) were fever, sepsis, renal vascular complications, and other organ injuries. Fever (P = 0.0021) and sepsis (P = 0.001) were more frequent in the non-SF cases than in the SF cases.
Univariate logistic regression analysis revealed that the significant predictive variables were the number of stones, stone burden, number of calyces involved, and stone position (P < 0.001 in all four, Table 3). The multiple logistic regression model consisted of stone burden (P < 0.001), number of involved calyces (P < 0.001), presence of nephrostomy prior to mini-ECIRS (P = 0.091), and ECOG-PS (P = 0.110). The AUC was 70.7% (Table 3 and Fig. 2A).
The classification tree analysis consisted of the number of calyces involved, with an AUC of 61.7% (Fig. 2B). The threshold value for the number of involved calyces was four (Fig. 3). The random forest model showed that the top predictive variable was the number of involved calyces, followed by BMI, stone burden, age, and number of stones (Table 4). The model involving all clinical variables showed an AUC of 91.9% (Fig. 2C). Internal validation using the bootstrap method showed that the AUCs of the logistic regression model, classification tree analysis, and random forest model were 70.4% (95% confidential interval (CI) [0.695–0.711]), 69.6% (95% CI [0.612–0.743]), and 85.9% (95% CI [0.840–0.876]), respectively (Table 5).
Discussion
The current study developed three different statistical models to predict SF in mini-ECIRS. The multiple logistic regression model consisted of four clinical parameters: stone burden, number of involved calyces, and presence of nephrostomy before mini-ECIRS, and ECOG-PS. Classification tree analysis showed that the number of calyces involved, in particular when less than four, was significantly associated with SF. Random forest analysis, a machine learning-based model, showed remarkably high accuracy of outcome prediction based on preoperative parameters in both real and internal validation datasets. To our knowledge, this multicentre cohort is the largest in the mini-ECIRS database.
A key finding of the study was that all three prediction models consistently demonstrated that the number of involved calyces was the most important predictor of mini-ECIRS outcomes. In particular, if the number of involved calyces is < 4, the outcome seems to be favourable, and a single session of mini-ECIRS should be recommended as first-line treatment. Otherwise, multiple staged sessions of the mini-ECIRS might be better. Enrolled mini-ECIRSs were mostly single tract surgery and multi-tract ECIRS might be reasonable options in case the number of involved calyces was ≥ 4. The number of calyces involved has been reported to be an independent predictor of PCNL23 and conventional ECIRS outcome6. Another study showed that the number of calyces involved was an independent predictor of postoperative complications in ECIRS8. Interestingly, those papers consistently indicated that a clinically significant cut-off causing worse outcomes were ≥ 4 involved calyces. These findings might suggest that ≥ 4 involved calyces is the limit for retrograde assistant during ECIRS, such as reposition and dusting with URS.
In addition to the number of calyces involved, stone burden was a strong predictor of mini-ECIRS in this study. Stone burden was identified as a long-term treatment outcome predictor in stone surgeries, including ECIRS24, PCNL23,25 and retrograde URS26,27. However, the current study showed that stone burden was the predominant factor in the prediction model of mini-ECIRS outcomes.
Before this investigation, we considered the presence of hydronephrosis as a possible successful predictor, due to hydronephrosis allowing us easier, safer, and more appropriate percutaneous access. However, the three statistical models currently used did not identify hydronephrosis as a successful indicator. These findings may suggest that easier development of access did not always indicate complete stone removal, wherein hydronephrosis was possibly a confounder of other variables, or the current analysis of mixed renal and ureteral stones may have caused heterogeneity in this cohort, resulting in hydronephrosis having less impact. Another interesting finding was that multivariate analysis showed that BMI was not a significant predictor of mini-ECIRS outcomes; however, random forest analysis indicated that BMI was one of the best predictors as well as number of involved calyces and stone burden. The possible reason for these discrepancies in BMI was the statistical character of the random forest analysis, which counts continuous values as more significant than categorical values19,20,21. Indeed, no previous studies have shown that high BMI contributes to worse outcomes of PCNL or ECIRS, despite some speculation that high BMI results in difficulties in setting patient positioning during surgery and decreased visibility of the pelvis when puncturing.
In other clinical areas, machine learning and deep learning techniques show outstanding performance28, with recent machine learning models demonstrating high accuracy in disease detection and prediction of surgical outcomes29,30. Our random forest model, based on machine learning techniques, showed remarkably high accuracy of more than 90% for real data and more than 85% for internal validation, which is better than the other two models, suggesting that the model is effective.
The limitations of this study are its retrospective data analysis and the inclusion of surgeries performed by multiple surgeons. However, we were of the opinion that this study was a good reflection of the real-world practice. CT value could not be assessed in this study because of different CT imaging facilities among multi-centre. External validation of prediction models is warranted to determine whether the current model is consistent and reliable.
In conclusions, the three models predicted the successful outcomes of single session mini-ECIRS using preoperative parameters from the largest mini-ECIRS database. Less than four involved calyces and a smaller stone burden implied a successful outcome. The machine learning-based model showed remarkably high accuracy and may be a promising tool for physicians and patients to obtain proper consent, avoid inefficient surgery, and decide preoperatively on the most efficient treatment strategies, including staged mini-ECIRS.
Data availability
Statistical codes were available and attached as a Supplementary data to this article. The datasets generated and analyzed during the current study is not publicly available but are available from the corresponding author on reasonable request.
References
Gauhar, V. et al. Evolution and current applications of endoscopic combined intrarenal surgery: A scoping review from back to the future. Curr. Opin. Urol. https://doi.org/10.1097/MOU.0000000000001106 (2023).
Scoffone, C. M. et al. Endoscopic combined intrarenal surgery in Galdakao-modified supine Valdivia position: A new standard for percutaneous nephrolithotomy?. Eur. Urol. 54(6), 1393–1403. https://doi.org/10.1016/j.eururo.2008.07.073 (2008).
Scoffone, C. M. & Cracco, C. M. Invited review: The tale of ECIRS (Endoscopic Combined IntraRenal Surgery) in the Galdakao-modified supine Valdivia position. Urolithiasis 46(1), 115–123. https://doi.org/10.1007/s00240-017-1015-9 (2018).
Cracco, C. M. & Scoffone, C. M. ECIRS (Endoscopic Combined Intrarenal Surgery) in the Galdakao-modified supine Valdivia position: a new life for percutaneous surgery?. World J. Urol. 29(6), 821–827. https://doi.org/10.1007/s00345-011-0790-0 (2011).
Schulster, M., Small, A. C., Silva, M. V., Abbott, J. E. & Davalos, J. G. Endoscopic combined intrarenal surgery can accurately predict high stone clearance rates on postoperative CT. Urology 133, 46–49. https://doi.org/10.1016/j.urology.2019.08.026 (2019).
Kuroda, S. et al. Development and internal validation of a classification system for predicting success rates after endoscopic combined intrarenal surgery in the modified Valdivia position for large renal stones. Urology 86(4), 697–702. https://doi.org/10.1016/j.urology.2015.07.002 (2015).
Inoue, T. et al. Wideband Doppler ultrasound-guided mini-endoscopic combined intrarenal surgery as an effective and safe procedure for management of large renal stones: A preliminary report. Urology 95, 60–66. https://doi.org/10.1016/j.urology.2016.05.038 (2016).
Tabei, T. et al. Risk factors of systemic inflammation response syndrome after endoscopic combined intrarenal surgery in the modified Valdivia position. Int. J. Urol. 23(8), 687–692. https://doi.org/10.1111/iju.13124 (2016).
Hamamoto, S. et al. Endoscopic combined intrarenal surgery for large calculi: simultaneous use of flexible ureteroscopy and mini-percutaneous nephrolithotomy overcomes the disadvantageous of percutaneous nephrolithotomy monotherapy. J. Endourol. Endourol. Soc. 28(1), 28–33. https://doi.org/10.1089/end.2013.0361 (2014).
Wen, J., Xu, G., Du, C. & Wang, B. Minimally invasive percutaneous nephrolithotomy versus endoscopic combined intrarenal surgery with flexible ureteroscope for partial staghorn calculi: A randomised controlled trial. Int. J. Surg. 28, 22–27. https://doi.org/10.1016/j.ijsu.2016.02.056 (2016).
Abdullatif, V. A., Sur, R. L., Abdullatif, Z. A., Szabo, S. R. & Abbott, J. E. The safety and efficacy of endoscopic combined intrarenal surgery (ECIRS) versus percutaneous nephrolithotomy (PCNL): A systematic review and meta-analysis. Adv. Urol. 2022, 1716554. https://doi.org/10.1155/2022/1716554 (2022).
Usui, K. et al. Minimally invasive versus standard endoscopic combined intrarenal surgery for renal stones: A retrospective pilot study analysis. Int. Urol. Nephrol. 52(7), 1219–1225. https://doi.org/10.1007/s11255-020-02433-x (2020).
Mazzon, G. et al. Learning curve for endoscopic combined intra-renal surgery using vacuum-assisted device. Urol. Int. 1, 1–9. https://doi.org/10.1159/000528785 (2023).
Abouelgreed, T. A. et al. Endoscopic combined intrarenal surgery in the prone split-leg position versus Galdakao-modified supine Valdivia position for the management of partial staghorn calculi. BMC Urol. 22(1), 163. https://doi.org/10.1186/s12894-022-01115-3 (2022).
Kawase, K. et al. Impact of pelvicalyceal anatomical variation on surgical outcomes of endoscopic combined intrarenal surgery. BJUI Compass 4(2), 173–180. https://doi.org/10.1002/bco2.209 (2023).
Imano, M., Tabei, T., Ito, H., Ota, J. & Kobayashi, K. Clinical factors to predict difficult ureter during ureteroscopic lithotripsy. Minim. Invasive Surg. 2023, 2584499. https://doi.org/10.1155/2023/2584499 (2023).
Ito, H. et al. Predicting prostate surgery outcomes from standard clinical assessments of lower urinary tract symptoms to derive prognostic symptom and flowmetry criteria. Eur. Urol. Focus https://doi.org/10.1016/j.euf.2023.06.013 (2023).
Akaike, H. Information Theory and an Extension of the Maximum Likelihood Principle (Springer, 1998).
Han, H., Guo, X., & Yu, H. Variable selection using mean decrease accuracy and mean decrease Gini based on random forest. In 2016 7th IEEE International Conference on Software Engineering and Service Science (ICSESS) (2016).
Breiman, L. Random forests. Mach. Learn. 45(1), 5–32 (2001).
Breiman, L. F. J. H., Olshen, R. A. & Stone, C. J. Classification and Regression Trees (Wadsworth Statistics/Probability) (Routledge, 1984).
Moons, K. G. et al. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): Explanation and elaboration. Ann. Intern. Med. 162(1), W1-73. https://doi.org/10.7326/M14-0698 (2015).
Okhunov, Z. et al. S.T.O.N.E. nephrolithometry: Novel surgical classification system for kidney calculi. Urology 81(6), 1154–1159. https://doi.org/10.1016/j.urology.2012.10.083 (2013).
Yamashita, S., Kohjimoto, Y., Iba, A., Kikkawa, K. & Hara, I. Stone size is a predictor for residual stone and multiple procedures of endoscopic combined intrarenal surgery. Scand. J. Urol. 51(2), 159–164. https://doi.org/10.1080/21681805.2017.1284897 (2017).
Smith, A. et al. A nephrolithometric nomogram to predict treatment success of percutaneous nephrolithotomy. J. Urol. 190(1), 149–156. https://doi.org/10.1016/j.juro.2013.01.047 (2013).
Ito, H. et al. Development and internal validation of a nomogram for predicting stone-free status after flexible ureteroscopy for renal stones. BJU Int. https://doi.org/10.1111/bju.12775 (2014).
Ito, H. et al. The most reliable preoperative assessment of renal stone burden as a predictor of stone-free status after flexible ureteroscopy with holmium laser lithotripsy: A single-center experience. Urology 80(3), 524–528. https://doi.org/10.1016/j.urology.2012.04.001 (2012).
Huang, J. C. et al. Predictive modeling of blood pressure during hemodialysis: A comparison of linear model, random forest, support vector regression, XGBoost, LASSO regression and ensemble method. Comput. Methods Programs Biomed. 195, 105536. https://doi.org/10.1016/j.cmpb.2020.105536 (2020).
Maki, S. et al. Machine learning approach in predicting clinically significant improvements after surgery in patients with cervical ossification of the posterior longitudinal ligament. Spine 46(24), 1683–1689. https://doi.org/10.1097/BRS.0000000000004125 (2021).
Kawakami, E. et al. Application of artificial intelligence for preoperative diagnostic and prognostic prediction in epithelial ovarian cancer based on blood biomarkers. Clin. Cancer Res. 25(10), 3006–3015. https://doi.org/10.1158/1078-0432.CCR-18-3378 (2019).
Author information
Authors and Affiliations
Contributions
H.I.: protocol/project development, data collection or management, data analysis, manuscript writing/editing. K.S: Data analysis, manuscript writing/editing. T.F.: data collection or management. F.Y.: data collection or management. T.W.: data collection or management. T.T.: data analysis. T.I.: protocol/project development. J.M.: protocol/project development. K.K.: protocol/project development. All authors have read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Ito, H., Sakamaki, K., Fukuda, T. et al. Models to predict the surgical outcome of mini-ECIRS (endoscopic combined intrarenal surgery) for renal and/or ureteral stones. Sci Rep 13, 22848 (2023). https://doi.org/10.1038/s41598-023-50022-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-023-50022-6
- Springer Nature Limited