Abstract
Background
The aim of the present study was to create a unique risk adjustment model for surgical site infection (SSI) in patients who underwent colorectal surgery (CRS) at the Cleveland Clinic (CC) with inherent high risk factors by using a nationwide database.
Methods
The American College of Surgeons National Surgical Quality Improvement Program database was queried to identify patients who underwent CRS between 2005 and 2010. Initially, CC cases were identified from all NSQIP data according to case identifier and separated from the other NSQIP centers. Demographics, comorbidities, and outcomes were compared. Logistic regression analyses were used to assess the association between SSI and center-related factors.
Results
A total of 70,536 patients met the inclusion criteria and underwent CRS, 1090 patients (1.5%) at the CC and 69,446 patients (98.5%) at other centers. Male gender, work-relative value unit, diagnosis of inflammatory bowel disease, pouch formation, open surgery, steroid use, and preoperative radiotherapy rates were significantly higher in the CC cases. Overall morbidity and individual postoperative complication rates were found to be similar in the CC and other centers except for the following: organ-space SSI and sepsis rates (higher in the CC cases); and pneumonia and ventilator dependency rates (higher in the other centers). After covariate adjustment, the estimated degree of difference between the CC and other institutions with respect to organ-space SSI was reduced (OR 1.38, 95% CI 1.08–1.77).
Conclusions
The unique risk adjustment strategy may provide center-specific comprehensive analysis, especially for hospitals that perform inherently high-risk procedures. Higher surgical complexity may be the reason for increased SSI rates in the NSQIP at tertiary care centers.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Postoperative surgical site infection (SSI) is the most common nosocomial infection among surgical patients, and colorectal surgery (CRS) is a major contributor to institutional SSI rates due to its inherent risk factors [1, 2]. The delineation of both SSI incidence and associated risk factors is important because SSI increases the cost of surgical practice by prolonging hospital stay and reducing efficiency [3]. A number of studies have reported the incidence of SSI after CRS to range between 5 and 30% [4, 5]. This discrepancy may be related to differences in clinical practice between hospital centers, how SSI is defined, the nature of the different disease types, and differences in surgical complexity (tertiary referral centers tend to perform more complex procedures, which carry a higher risk of SSI even with standard prevention protocols) [6,7,8].
The American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) is a nationally validated, risk-adjusted, outcome-based database intended to measure and improve the quality of surgical care. With this nationwide platform, we can study SSI rates after colorectal procedures in a hospital setting by adjusting important preoperative and intraoperative factors. It is important to adjust risk for patient characteristics, case mix, and underlying diagnosis in order to make valid comparisons between hospitals and/or individuals surgeons [9].
No study to date has focused on the inherent risk factors for SSI after CRS in a tertiary care center. In this study, we aimed to evaluate independent risk factors associated with increased SSI rates after CRS in tertiary care settings and create a unique risk adjustment model for SSI in patients who underwent colorectal surgery at the Cleveland Clinic (CC) with inherent high risk factors.
Materials and methods
Data collection and variables
After obtaining institutional review board approval, we queried the ACS-NSQIP Participant Use Data File to identify all patients who underwent CRS according to their primary procedure Current Procedural Terminology (CPT) codes between 2005 and 2010. Patients with secondary procedures related to other specialties were excluded. Subsequently, CC cases were identified from all NSQIP data according to case identifier and separated from the other NSQIP centers. Patient demographics, characteristics, and preoperative comorbidities were analyzed by comparing the CC data with that from other NSQIP centers. Diagnosis was categorized as: colon cancer, rectal cancer, inflammatory bowel disease (IBD), and other benign diseases.
Outcomes
Intraoperative and postoperative outcomes were compared between the two groups (CC vs Other). The primary outcomes of this study were rates of SSI among the centers, which were categorized separately as superficial SSI, deep SSI, organ-space SSI, and wound disruption in the ACS-NSQIP database. Postoperative complications included superficial SSI, deep SSI, organ-space SSI, wound disruption, bleeding requiring transfusion, reoperation, pulmonary embolism, unplanned intubation, progressive renal insufficiency, pneumonia, acute renal failure, urinary tract infection, coma longer than 24 h, ventilator support for more than 48 h (ventilator dependency), cerebrovascular accident, cardiac arrest, deep venous thrombosis, sepsis, septic shock, and myocardial infarction.
Definitions for SSI in the NSQIP are as follows: Superficial incisional SSI is an infection that occurs within 30 days of surgery, and the infection involves only skin or subcutaneous tissue of the surgical incision. Deep incisional SSI is an infection that occurs within 30 days of surgery, involves deep soft tissues (e.g., fascial and muscle layers) of the surgical incision, and appears related to the operation. Organ-space SSI is an infection that occurs within 30 days of surgery and involves any part of the anatomy (e.g., organs or spaces) other than the incision site. Wound disruption describes the separation of the wound layers created by the operation, which could be partial or complete, with disruption of the fascia.
Statistical analysis
Categorical variables are reported as frequency (%) and quantitative variables are reported as mean ± standard deviation (SD) except where noted. Categorical variables were analyzed with the Chi-square or Fisher’s exact test and the quantitative variables were analyzed with a Wilcoxon rank-sum test. p < 0.05 was considered statistically significant. Univariate analysis was done to define the risk factors for each SSI among all patients. Subsequently, further multivariate logistic regression analysis was conducted to assess the associations between SSI and center-related factors with further covariate adjustments for the variables that were significantly associated with SSI. In the current study, the odds ratio (OR) with 95% confidence interval (CI) was also calculated after univariate analysis for each related outcome based on the ratio between the groups.
Results
A total of 70,536 patients met the inclusion criteria and underwent CRS. In particular, 1090 patients (1.5%) underwent surgery at the CC and 69,446 (98.5%) were treated at the other NSQIP centers. Table 1 compares patient demographics and comorbidities between CC and other NSQIP centers. Male gender, work-relative value unit (RVU), diagnosis of IBD, ileal pouch formation, open surgery, steroid use, and preoperative radiotherapy (RT) rates were significantly higher in the CC cases.
Overall morbidity and specific postoperative complication rates were similar in the CC and other NSQIP centers except for the following: organ-space SSI and sepsis rates were higher in CC cases, and pneumonia and ventilator dependency rates were higher in the other NSQIP centers. Mean operative times were significantly longer in the CC cases (Table 2). Table 3 shows the results of multivariate logistic regression analysis for SSI outcomes for the CC patients compared to the patients from the other NSQIP centers. Adjustment for the covariates reduced the OR between the CC and other NSQIP centers with respect to organ-space SSI from 1.80 (CI 1.41–2.30; p < 0.001) to 1.45 (CI 1.12–1.84; p = 0.004).
Results of univariate analysis of patient characteristics and operative factors associated with organ-space SSI among all patients are shown in Table 4. The factors, which were significantly higher in the CC cases, including male gender, higher work RVU, diagnoses of rectal cancer and IBD, pouch formation, open surgery, steroid use, and preoperative RT, were significantly higher in the patients with organ-space SSI.
Univariate analysis of patient characteristics and operative factors for patients who had organ-space SSI comparing the CC and other NSQIP centers is shown in Table 5. Pouch formation, diagnosis of IBD and rectal cancer, and preoperative steroid use were significantly higher in the CC cases. Subsequently, multivariate risk adjustment was performed with those factors, which were different between the groups (Table 6). The OR between the CC and other institutions with respect to organ-space SSI decreased from 1.80 (CI 1.41–2.30; p < 0.001) to 1.36 (CI 1.05–1.73; p = 0.016).
Discussion
The current study demonstrates the impact hospital settings have on SSI rates and identifies independent risk factors associated with organ-space SSI after CRS using a nationwide cohort. Our findings confirmed that a large proportion of the CC patient population were IBD and pouch cases. Our patients who had IBD and pouch surgery used steroids preoperatively and had more organ-space SSI than patients from other centers.
Since 2005, our institution has been an active participant of the NSQIP, and our SSI rates have been compared with NSQIP data. In 2006, we were found to be a high outlier institution for SSI, with an observed-to-expected ratio of 1.27 [7]. This was due to the high proportion of colorectal procedures we perform compared to other centers, which carries an inherent risk of SSI [10]. Colorectal procedures represented 17% of all surgical cases at our institution compared to a nationally reported average of 9% in 2006. Indeed, for colorectal procedures, the reported SSI rate was 14.3%—higher than the SSI rate of 9.4% for general and vascular procedures. This previously published report [7] from our institution comparing SSIs in our department and all other NSQIP centers motivated us to perform further analysis to develop a unique risk-adjusted SSI model that is specific to CRS in a tertiary care center.
Our study showed that pouch creation, diagnosis of IBD, and preoperative steroid use were significantly higher in the CC cases. In fact, these findings clearly demonstrate that our surgical patient population is derived mainly from our referral center for IBD and pouch surgery. Patients who had IBD and pouch surgery used steroids preoperatively and had more organ-space SSI in our institution [11] than such patients at other centers. It is also important to consider that not all IBD and pouch patients have the same surgical complexity. Due to our referral pattern, a substantial proportion of patients had redo surgery at our institution having had the primary procedure elsewhere, which further increased the complexity of their cases [12].
Surgical infections are the major factors that increase hospital expenses; SSI rates are commonly used for quality parameters [13]. SSI varies widely among different hospitals in the NSQIP [14]. Higher rates may be due to increased surgical complexity, especially in tertiary referral centers. It has been suggested that the current quality improvement programs do not accurately reflect risks associated with CRS. Rather, they tend to focus on risk factors associated with patient comorbidities. Less focus has been placed on variables within the surgical procedure and underlying diagnosis itself. A novel approach is needed to calculate risk-adjusted quality assessments using the current NSQIP dataset variables to predict outcomes specifically in colorectal surgery [15].
Risk adjustment is the key component of the NSQIP dataset [16]. Most variables included in risk adjustment models focus on patient-related factors and comorbidities [17]. Less attention has been given to surgical complexity and center-related inherent risk factors [18]. The role of the underlying disease process and its impact on SSI rates has been evaluated, and it was shown that diagnosis is a confounding factor for different types of SSI and that it is also important for comparisons of SSI rates in institutions that perform CRS [19, 20].
Different risk adjustment models should be considered for superficial, deep and organ-space SSI based on different pathologies [6, 21]. This is because some operative factors may affect organ-space SSI rates with more complex mechanisms [11, 22]. For example, anastomotic leak, an unavoidable cause of organ-space SSI, can be influenced by tissue perfusion, apposition, tension and local spillage and may mask the potential effects of preventative measures on all SSI types, particularly organ-space. In addition, the method of conflating different SSIs weakens the significance of SSI assessment by combining distinct forms of infectious complications which have quite different potential effects on care.
On the other hand, the ACS-NSQIP helped us to better understand why our organ-space SSI rates were higher than the national average as well as the patient profile that is associated with high postoperative risk and how we can make improvements. By understanding our targeted patient population, our department initiated an SSI reduction strategy program called the “CORS SSI Prevention Bundle Project” in 2014. ACS-NSQIP posts semiannual reports for all participating hospitals in 6-month intervals. Using this information, we were able to monitor our success and change our CORS SSI status to “low outlier–exemplary performance.”
The present study has some limitations, most of which arise from the nature of the NSQIP database. Unfortunately, the ACS-NSQIP does not allow users to separate the centers specifically. Also, the NSQIP does not provide information by subspecialty, including CRS, and level of care center (primary, secondary and tertiary). Additionally, the retrospective nature of the study did not allow us to perform a comprehensive analysis of other evidence-based interventions that can be used to target SSI rates after CRS. Previously described independent risk factors associated with SSI by single institution studies of CRS could not be investigated because the NSQIP does not provide them. However, the high case volume, our strict selection criteria, and unique adjustment analysis strengthen the clinical value of this study.
Conclusions
The unique risk adjustment strategy may provide center-specific comprehensive analysis, especially for hospitals that perform inherently high-risk procedures. Greater surgical complexity may be the reason for increased SSI rates in the NSQIP at the tertiary care centers.
References
Mangram AJ, Horan TC, Pearson ML et al (1999) Guideline for prevention of surgical site infection. Am J Infect Control 27(2):97–134
Umscheid CA, Mitchell MD, Doshi JA et al (2011) Estimating the proportion of healthcare-associated infections that are reasonably preventable and the related mortality and costs. Infect Control Hosp Epidemiol 32(2):101–114
de Lissovoy G, Fraeman K, Hutchins V et al (2009) Surgical site infection: incidence and impact on hospital utilization and treatment costs. Am J Infect Control 37(5):387–397
Cima R, Dankbar E, Lovely J et al (2013) Colorectal surgery surgical site infection reduction program: a national surgical quality improvement program–driven multidisciplinary single-institution experience. J Am Coll Surg 216(1):23–33
Tang R, Chen HH, Wang YL et al (2001) Risk factors for surgical site infection after elective resection of the colon and rectum: a single-center prospective study of 2809 consecutive patients. Ann Surg 234(2):181
Blumetti J, Luu M, Sarosi G et al (2007) Surgical site infections after colorectal surgery: do risk factors vary depending on the type of infection considered? Surgery 142(5):704–711
Wick EC, Vogel JD, Church JM et al (2009) Surgical site infections in a “high outlier” institution: are colorectal surgeons to blame? Dis Colon Rectum 52(3):374–379
Hedrick TL, Sawyer RG, Hennessy SA et al (2014) Can we define surgical site infection accurately in colorectal surgery? Surg Infect 15(4):372–376
Raval MV, Cohen ME, Ingraham AM et al (2010) Improving American College of Surgeons National Surgical Quality Improvement Program risk adjustment: incorporation of a novel procedure risk score. J Am Coll Surg 211(6):715–723
Tang R, Chen HH, Wang YL et al (2001) Risk factors for surgical site infection after elective resection of the colon and rectum: a single-center prospective study of 2809 consecutive patients. Ann Surg 234(2):181–189
Campos-Lobato LF, Wells B, Wick E et al (2009) Predicting organ space surgical site infection with a nomogram. J Gastrointest Surg 13(11):1986–1992
Fazio VW, Kiran RP, Remzi FH et al (2013) Ileal pouch anal anastomosis: analysis of outcome and quality of life in 3707 patients. Ann Surg 257(4):679–685
Broex E, Van Asselt A, Bruggeman C et al (2009) Surgical site infections: how high are the costs? J Hosp Infect 72(3):193–201
Berenguer CM, Ochsner MG, Lord SA et al (2010) Improving surgical site infections: using National Surgical Quality Improvement Program data to institute Surgical Care Improvement Project protocols in improving surgical outcomes. J Am Coll Surg 210(5):737–741
O’Brien BS, McNally MP, Duncan JE (2014) Controversies surrounding quality measurement in colon and rectal surgery. Clin Colon Rectal Surg 27(1):26–31
Cohen ME, Ko CY, Bilimoria KY et al (2013) Optimizing ACS NSQIP modeling for evaluation of surgical quality and risk: patient risk adjustment, procedure mix adjustment, shrinkage adjustment, and surgical focus. J Am Coll Surg 217(2):336. e1–346. e1
Dimick JB, Osborne NH, Hall BL et al (2010) Risk adjustment for comparing hospital quality with surgery: how many variables are needed? J Am Coll Surg 210(4):503–508
Dimick JB, Staiger DO, Hall BL et al (2013) Composite measures for profiling hospitals on surgical morbidity. Ann Surg 257(1):67–72
Pendlimari R, Cima RR, Wolff BG et al (2012) Diagnoses influence surgical site infections (SSI) in colorectal surgery: a must consideration for SSI reporting programs? J Am Coll Surg 214(4):574–580
Lawson EH, Ko CY, Adams JL et al (2013) Reliability of evaluating hospital quality by colorectal surgical site infection type. Ann Surg 258(6):994–1000
Ho VP, Stein SL, Trencheva K et al (2011) Differing risk factors for incisional and organ/space surgical site infections following abdominal colorectal surgery. Dis Colon Rectum 54(7):818–825
Lawson EH, Hall BL, Ko CY (2013) Risk factors for superficial vs deep/organ-space surgical site infections: implications for quality improvement initiatives. JAMA Surg 148(9):849–858
Acknowledgements
American College of Surgeons National Surgical Quality Improvement Program and the hospitals participating in the ACS-NSQIP are the source of the data used herein; they have not verified and are not responsible for the statistical validity of the data analysis or the conclusions derived by the authors. Accepted as podium presentation for the American College of Surgeons National Surgical Quality Improvement Program National Conference, July 26–29, 2014, New York City, NY.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
The Cleveland Clinic Institutional Review Board, Cleveland, OH approved this study (IRB#14-094).
Informed consent
As this is a study based on data from nationwide dataset, informed consent statements for patient enrollment is not applicable.
Rights and permissions
About this article
Cite this article
Gorgun, E., Benlice, C., Hammel, J. et al. The need for unique risk adjustment for surgical site infections at a high-volume, tertiary care center with inherent high-risk colorectal procedures. Tech Coloproctol 21, 649–656 (2017). https://doi.org/10.1007/s10151-017-1671-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10151-017-1671-3