Abstract
Background
The World Health Organization Surgical Safety Checklist (SSC) has been widely implemented in an effort to decrease surgical adverse events.
Method
This systematic literature review examined the effects of the SSC on postoperative outcomes. The review included 25 studies: two randomised controlled trials, 13 prospective and ten retrospective cohort trials. A meta-analysis was not conducted as combining observational studies of heterogeneous quality may be highly biased.
Results
The quality of the studies was largely suboptimal; only four studies had a concurrent control group, many studies were underpowered to examine specific postoperative outcomes and teamwork-training initiatives were often combined with the implementation of the checklist, confounding the results. The effects of the checklist were largely inconsistent. Postoperative complications were examined in 20 studies; complication rates significantly decreased in ten and increased in one. Eighteen studies examined postoperative mortality. Rates significantly decreased in four and increased in one. Postoperative mortality rates were not significantly decreased in any studies in developed nations, whereas they were significantly decreased in 75 % of studies conducted in developing nations.
Conclusions
The checklist may be associated with a decrease in surgical adverse events and this effect seems to be greater in developing nations. With the observed incongruence between specific postoperative outcomes and the overall poor study designs, it is possible that many of the positive changes associated with the use of the checklist were due to temporal changes, confounding factors and publication bias.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
One in 25 people undergo a surgical procedure every year [1]. Surgery is intended to save lives but unsafe surgical care can cause substantial harm; complications after inpatient operations occur in 25 % of patients and the reported crude mortality rate after major surgery is 0.5–5 % [2]. At least half of the cases in which surgery leads to harm are considered preventable [3]. Most surgical errors are caused by failures of non-technical skills such as communication, leadership and teamwork [4].
In 2008 the World Health Organization (WHO) developed a surgical safety checklist (SSC), in an attempt to minimise surgical adverse events [2]. The three phase 19-item checklist comprises various perioperative items directly targeted to assure execution of specific safety measures. The mechanism by which the checklist is said to improve surgical outcomes involves both direct and indirect means. Direct factors such as ensuring timely administration of prophylactic antibiotics may result in decreased rates of postoperative infections. Indirectly, the checklist is reported to increase the ‘safety culture’ in operating theatres and thus decrease non-technical surgical errors, resulting in a positive effect on all postoperative adverse events [5–9].
The checklist has been implemented as a standard of care into thousands of operating rooms worldwide as it is relatively easy to implement and unlikely to cause harm [10]. However, there is emerging evidence that for the checklist to be effective it requires a deliberate implementation process, continual monitoring and learning within frontline teams [11]. It is thus necessary to determine the effects of the checklist on postoperative outcomes to validate this continued effort. Furthermore, the checklist may become a routine activity of checking of boxes without actually driving behavioural change thus giving staff a false sense of security [12–14].
Previous literature reviews have all suggested an apparent reduction in postoperative adverse events following the implementation of the checklist; however, all have concluded that higher quality studies are needed [15–21]. Since the last published review, many large-scale studies have been published, including two randomised controlled trials (RCT) [22–26]. Hence there is a need for an updated systematic review of the SSC. This systematic literature review examines the effects of the implementation of the WHO SSC on postoperative complications and mortality.
Methods
Protocol and registration
This systematic review is reported using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines [27]. The review focuses on studies with primary quantitative data on the effects of the implementation of the WHO SSC on postoperative adverse events. The review was registered in the PROSPERO database, reference number: CRD42015024373.
Search criteria
A literature search of publications published from 2007 to June 2015 was conducted. Two investigators (EdJ and CM) searched MEDLINE, CINAHL, Scopus, Cochrane and ProQuest databases using the following search strategy; (WHO OR World Health Organisation OR World Health Organization) AND checklist AND (surgery OR surgical OR operative). The date last searched was June 4th 2015. Reference lists of relevant studies were searched by hand to identify additional publications. Authors of select studies were contacted to find additional information. The two investigators screened the titles and abstracts of potential studies, and full text potential studies were reviewed where necessary.
Eligibility criteria
Included studies incorporated a population of patients undergoing surgical procedures, in which the WHO SSC was implemented, compared to a control group where the checklist was not used or a control group with low compliance to the checklist. The outcomes were quantitative data on postoperative complications or mortality, however defined by the authors. Postoperative pain, urinary tract infections, nausea and vomiting were not considered significant postoperative complications.
Studies were excluded if they were not written in English or did not use the WHO SSC or an adaption of the WHO SSC. Studies were also excluded if the intervention concurrently consisted of a bundle of action such that the sole effect of the safety checklist could not be isolated, for example, where pulse oximetry was introduced alongside the implementation of the checklist.
Data extraction and analysis
The two investigators used a standardised data sheet to extract data from included studies. Data were extracted for study setting, design and duration, sample size, surgical procedures included and quantitative patient outcomes. Postoperative complication and mortality rates were extracted. Two authors independently performed data extraction and a third review author adjudicated any discrepancies (LB). The included studies were deemed unsuitable for Meta-analysis since they were too heterogeneous and mostly observational studies.
Quality
Randomised controlled trials were assessed using the Cochrane RevMan Risk of Bias tool [28]. Non-randomised controlled trials were assessed using a modified version of the previously validated Methodological Index for Non-Randomised Studies (MINORS) [29]. The original 12-item index had two items removed by authors, item six and seven. A similar modification has previously been reported [16]. These items relate to an adequate duration of follow-up after the implementation of the checklist. There is currently no consensus about the most appropriate duration of follow-up. There may be an increased emphasis of surgical safety and higher levels of compliance to checklist use early after the intervention, resulting in falsely encouraging outcomes in studies with short follow-up periods. Alternatively, the checklist-induced cultural change may take time to develop and thus studies with a short follow-up period may not show the full effects of the checklists' use. As such, an appropriate length of follow-up could not be defined.
Results
Search results
Database and reference list searches yielded 509 articles, of which full text of 109 articles were examined. Based on the inclusion and exclusion criteria, 25 studies were included (Fig. 1; Table 1) [27].
Quality assessment
Two studies were RCTs, 13 were prospective observational studies and 10 were retrospective cohort studies. The mean Cochrane RevMan score for the two RCTs was nine out of a possible 14. The mean score on the modified MINORS tool was 14 (SD 3.6) out of a possible 20. Each item assessed by these scores may not be equally important. Hence, we refrained from presenting a sum score for individual publications and instead demonstrate the individual components of the scores in a Cochrane risk of bias figure (Figs. 2, 3) [28]. Four studies had a concurrent control group; the remaining studies were largely a pre- and post-implementation group comparison. Several studies did not have adequately matched cohort groups, with differences in the emergency status of the surgery, surgical specialty and patient characteristics.
Many studies did not report doing a sample size calculation. Studies that did do a sample size calculation often calculated these to report significant total pooled complication rates rather than specific postoperative complications. This contributed to many studies being reported underpowered to reach statistical significance for specific postoperative outcomes.
Risk of bias of included studies
Some generalised potential sources of bias and confounding included that various implementation approaches were used; teamwork-training initiatives themselves may have confounded the post-checklist data [30, 31]. High levels of communication and collaboration are associated with overall lower rates of morbidity [32]. Bliss and colleagues reported a statistically significant decrease in postoperative complications from 23.9 to 15.9 % after three teamwork-training sessions; this was further reduced to 8.2 % after the checklist was adopted [33].
The WHO recommends that local stakeholders alter the checklists. Hence the specific checklists used often vary. This may impact rates of specific postoperative complications and make it difficult to compare studies. The definition of postoperative complications and specific postoperative outcomes also varied between studies making comparison between studies difficult.
Many studies used direct observation to evaluate compliance, potentially leading to a Hawthorne effect where non-technical skills such as communications and leadership increased with the intervention not because of the intervention.
Surgical adverse events rates are influenced by many factors; whilst studies attempted to adjust for known confounders it is likely that there are unknown confounding factors that were not adjusted for. Most of the reviewed studies did not have a concurrent control group and unknown confounding factors likely impacted the interpretation of their results. As the use of the checklist is seen as best practice, it may be unethical to withhold its use in a clinical setting. In addition to this when concurrent control groups are used the contamination effect must be considered, especially for indirect effects of the checklist such as enhanced leadership, teamwork and the resultant improvement in ‘safety culture’.
Two randomised controlled trials
Chaudhary et al. randomised 700 patients to checklist use or omission in a hospital in India. Patients were blinded to the study whilst the treating teams were not and as such contamination effects may significantly affect the study’s results. Mortality, bleeding, abdominal and wound-related complication rates decreased significantly with the use of the checklist. The total complication rates, number of complications per patient, length of hospital stay, rates of sepsis, respiratory, renal and cardiac complications did not change [26].
A larger stepped wedge cluster randomised control trial with a sample size of 4475 was conducted in two hospitals in Norway. In this study, the checklist intervention was sequentially rolled out across five surgical specialties in a randomised order. As such the cohorts were not adequately controlled; there was a discrepancy in surgical specialty and type of anaesthesia used between cohorts and the intervention group was more likely to undergo emergency surgery. In addition to this, 25.6 % of the procedures allocated to the intervention step were not compliant with the checklist and results of these surgeries were excluded. The reasons for non-compliance were not assessed and this is a likely source of bias. The rates of total complications, unplanned readmission to theatre, infectious complications, pneumonia, haemorrhage, respiratory and cardiac complications significantly decreased, whilst mortality, sepsis, surgical site infections and thromboembolic complications did not significantly change [23].
When results of the two randomised control trials were compared, the only outcome that was significantly decreased in both studies was postoperative bleeding rates.
Developed vs. developing countries
A sub-analysis was done whereby studies were divided into developing and developed nations as classified by the World Bank classification [34]. Multinational studies that did not differentiate between high- and low-income countries were not included in the sub-analysis. In developed countries, 36 % of studies (5 [23, 33, 35–37] out of 14 studies [6, 22–25, 33, 35–42]) showed a significant decrease in total complication rates compared to 83 % of studies (5 [38, 43–46] out of 6 studies [26, 38, 43–46]) conducted in developing nations. Mortality was not decreased in any of the 13 studies in developed nations [6, 22–25, 35, 37, 38, 41, 42, 47–49], whereas it was decreased in 75 % of studies (3 [26, 38, 45] out of 4 studies [26, 38, 45, 46]) in developing nations. Two studies reported an increase in mortality or complications; both of these studies were in developed nations [35, 39]. Thus in reviewed studies, the effect of the checklist seems to be greater in developing nations.
Total complications
The total complication rate was reported in 20 studies [6, 22–26, 33, 35–41, 43–46, 49, 50], ten reported significantly decreased rates (range 34–67 %) [23, 33, 35, 37, 38, 43–46, 50] and one reported increased complication rates (25 %) [39].
Mortality rates were reported in 18 studies [6, 22–26, 35, 37, 38, 41, 42, 45–51]; four reported a significant decrease in rates (range 43–100 %) [26, 38, 45, 50], whilst one reported an increase following the implementation of the checklist (238 %) [35].
Length of admission was examined in four studies [22, 26, 39, 40]; one reported a statistically significant but clinically insignificant decrease in length of stay by 0.04 days (p = 0.003) [22].
Unplanned return to the operating room was examined in eight studies [6, 22–24, 36, 38, 44, 47]; four found a significant decrease in rates (range 8–67 %) [22, 23, 38, 44].
Wound related complications
Surgical site infections were examined by 14 studies [6, 22–24, 33, 35, 36, 38, 43–46, 48, 50], four showed a statistically significant decrease (range 41–85 %) [38, 45, 46, 50]. Wound dehiscence was examined by five studies; no significant changes were found [22, 24, 25, 33, 36]. Combined wound complications were examined by two studies; both found a decrease (46 and 61 %) [26, 36].
Haematological studies
Rates of deep vein thrombosis (DVT) and/or pulmonary embolism (PE) were examined by five studies [22–24, 33, 36]; the only significant change was that one study reported an increase in DVT rates by 133 % [22].
Postoperative bleeding rates were examined by eight studies [22–24, 26, 33, 36, 45, 50]; three found a significant decrease (range 34–82 %) [23, 26, 50].
Miscellaneous other
Total infection rates were examined in five studies [23–25, 33, 36], rates decreased in two studies [23, 24]. Rates of sepsis were examined in six studies [22–24, 26, 33, 35], rates decreased in one study [24]. Ten studies examined respiratory complications [22–26, 33, 36, 38, 43, 44], one study found a decrease in rates of pneumonia and in total respiratory complication rates [23]. Another study found an increase in ventilation use [22]. Renal complications were examined in five studies [22, 24, 26, 33, 43], one found a decrease in acute renal failure [33], no other results reached significance. Cardiac complications were reported in five studies [22–24, 26, 33], one found a significant decrease in total rates [23]. One study examined total abdominal complications, which showed a reduction in complication rates [26].
Wrong-sided surgery
Two studies reported rates of wrong-sided procedures [45, 52]. One study found a statistically significant decrease; one patient had a wrong-sided surgery before the implementation, and no patients after the checklist was implemented (1.38 to 0 %, p < 0.05) [45].
Studies with increased rates of adverse outcomes
Two studies showed an increase in postoperative complications and mortality after the implementation of the checklist. In both studies, the comparisons were unadjusted, precluding meaningful conclusions.
Morgan et al. examined the effect of checklist compliance improvement initiatives on surgical outcomes with using a concurrent control group for comparison. In the intervention group, postoperative complications significantly increased, whist in the concurrent control group complications decreased (21.5 to 26.8 and 27.1 to 25.7 %, p = 0.05). The study was limited by a small sample size which prevented risk adjustment for differing patient characteristics between the groups. Another limitation was that a direct observational model was used; this is vulnerable to the Hawthorne effect and contamination [39].
Boaz et al. conducted a retrospective review of surgical outcomes before and after implementation of the checklist. It included 760 orthopaedic surgery patients and found an increase in postoperative mortality (0.8 to 2.7 %, p = 0.049) following the checklists implementation. The study reported that the composite postoperative complication rates decreased (25.9 to 18.9 %, p = 0.02), this was not significant after controlling for confounding variables. The study's conclusion and discussion focussed on a significant decrease in postoperative fever after implementation of the checklist [35].
Discussion
A surgical safety initiative, which has been implemented into thousands of operating rooms around the world, in an attempt to decrease preventable postoperative complications, should have a strong body of evidence supporting its use. This systematic review found that the effects of the checklist on postoperative outcomes were inconsistent. There may be some benefit to the implementation of the WHO SSC, with this benefit appearing to be greater in developing countries.
There is a lack of significant evidence to explain this phenomenon; that the checklist is more beneficial in developing compared to developed nations. Contributing theories are largely speculative with a lack of significant evidence. Developing countries may have an inherently higher rate of baseline complications and thus have a larger latitude for improvement initiatives to have an effect. Another point to consider is that the checklist partially works by improving non-technical skills such as teamwork, leadership and communication. These factors have a large societal and cultural aspect which may differ between sites. It is also possible that facets of the checklist were already a standard of care in developed countries prior to adoption of the checklist, reducing the effects of the checklist.
Rates of surgical adverse event outcomes are not independent. Postoperative complication rates are associated with postoperative mortality rates [53]. The checklist aims to reduce preventable surgical error and should decrease rates of specific postoperative complications, total surgical complications and postoperative mortality. Outcomes such as the length of stay should also decrease, as these are indirect measures of the postoperative complication rates [54]. The reviewed literature did not show congruency amongst outcomes of surgical adverse event rates. For example, Chaudhary et al. reported that postoperative mortality reduced significantly (by 43 %), whilst there was no significant change in total postoperative complication rates [26]. This phenomenon was observed both within some studies, and when all significant results from the reviewed literature were compared.
An effective safety improvement initiative should have consistent effects on outcomes. The effects of the checklist were inconsistent; this was evident within multicentre studies where the effect of the checklist often varied dramatically between sites. For example, Hayes et al., found significant decreases in postoperative adverse event rates in three of eight sites; the remaining five sites did not have any significant changes in outcomes [38]. The reported benefits of the checklist were from pooled data of all sites. Similarly Urbach et al., examined the effects of the checklist at 101 hospitals, of these six had a significant decrease in adverse event rates, three had a significant increase in adverse event rates and 92 sites had no significant changes in outcomes [22]. Individual sites may not have been sufficiently powered to detect changes, leading to a type two error. Regardless of this factor the effect of the checklist on postoperative outcomes appears to be most variable.
Reviewed studies tended to report substantial improvements in complication rates (range 34–67 %), or show no significant change. Half of surgical complications are reported to be preventable [3]. Hence even if the checklist stopped all preventable errors, postoperative complications would only reduce by 50 %. A change larger than this is likely to have contributing confounding factors or be biased by a poor study design.
Another factor to consider is publication bias. An under-representation of studies showing negative or no effects is well documented; studies with results supporting a hypothesis have a 50 % higher likelihood of publication compared to studies with a negative or neutral outcome [55]. The focus on statistically significant findings was also observed within reviewed studies; with some authors emphasising specific postoperative outcomes that were improved by the checklist, neglecting to comment on the many outcomes that were not altered or increased with the use of the checklist [35].
The checklist may be too generalised as it is intended to be applied to all surgical disciplines. Some specialties have called for their own specific checklists to be created whilst others have proposed a checklist tailored to each specific operation [25, 56–58]. Further studies are needed to determine the effects of specialty-wide surgical safety checklists.
Many of the studies excluded patients below the age of 16 or 18; there is thus a lack of literature reporting the effects of the checklist on a paediatric population. Younger patients may not be able to confirm identity, site or procedure and may lack the ability to give consent. Further studies on the effects of the checklist on a paediatric population are warranted.
A limitation of this review is that reported compliance to the checklist was not scrutinised. Measures of compliance are largely based on specific aspects of care embedded in the checklist. This may be an inappropriate measure of the ‘safety culture’, which the checklist is said to promote. Ticking all the boxes does not mean that the actions the checklist calls for have been completed. Some studies did not report compliance, when it was described there was marked variability in compliance between checklist items [16]. Many studies used data from administrative databases that may report higher rates of compliance than those reported by auditing observers [59, 60]. This heterogeneity makes it difficult to compare compliance rates between studies, and even more so to relate these to adverse event outcome measures in an attempt to draw any meaningful conclusions.
A further limitation is that a meta-analysis was not conducted. Combining observational studies of heterogeneous quality may be highly biased. Included studies had a very diverse patient population and sample size. One study had a larger sample size than all other studies combined, because of this results of a meta-analysis would invariably be skewed to this study’s outcomes.
Conclusion
The WHO SSC has been widely implemented in an attempt to decrease preventable postoperative complications. This systematic literature review examined the effects of the implementation of the WHO SSC on postoperative adverse events. The review included results of three times as many studies as previously reviewed. The effects of the checklist on postoperative outcomes were inconsistent. With the observed lack of congruency between specific postoperative outcomes and the widespread lack of concurrent control groups, it is possible that many of the positive changes of the checklist were due to temporal changes, rather than the checklist itself. This is likely compounded by publication bias where studies reporting insignificant results are less likely to be published. There may be some benefit to the implementation of the WHO SSC and the benefit appears to be larger in developing countries. Further studies are needed to support the implementation and continued use of the checklist in thousands of operating rooms around the world.
References
Weiser TG, Regenbogen SE, Thompson KD et al (2008) An estimation of the global volume of surgery: a modelling strategy based on available data. Lancet 372:139–144
World Health Organization Patient safety (2014) Safe Surgery Saves Lives Frequently Asked Questions (updated September 2014) http://www.who.int/patientsafety/safesurgery/faq_introduction/en/
Kable AK, Gibberd RW, Spigelman AD (2002) Adverse events in surgical patients in Australia. International journal for quality in health care : journal of the International Society for Quality in Health Care/ISQua 14:269–276
Alnaib M, Al Samaraee A, Bhattacharya V (2012) The WHO surgical safety checklist. J Perioper Pract 22:289–292
Böhmer AB, Wappler F, Tinschmann T et al (2012) The implementation of a perioperative checklist increases patients perioperative safety and staff satisfaction. Acta Anaesthesiol Scand 56:332–338
Sewell M, Adebibe M, Jayakumar P et al (2011) Use of the WHO surgical safety checklist in trauma and orthopaedic patients. Int Orthop 35:897–901
Kearns RJ, Uppal V, Bonner J et al (2011) The introduction of a surgical safety checklist in a tertiary referral obstetric centre. BMJ Qual Saf 20:818–822
Kawano T, Taniwaki M, Ogata K et al (2014) Improvement of teamwork and safety climate following implementation of the WHO surgical safety checklist at a university hospital in Japan. J Anesth 28:467–470
Haynes AB, Weiser TG, Berry WR et al (2011) Changes in safety attitude and relationship to decreased postoperative morbidity and mortality following implementation of a checklist-based surgical safety intervention. BMJ Qual Saf 20:102–107
Center for Geographic Analysis, Harvard University (2014) WHO Patient safety: Surgical Safety Web map (updated September 2014). http://maps.cga.harvard.edu/surgical_safety/index.html
Conley DM, Singer SJ, Edmondson L et al (2011) Effective surgical safety checklist implementation. J Am Coll Surg 212:873–879
Russ SJ, Sevdalis N, Moorthy K et al (2015) A qualitative evaluation of the barriers and facilitators toward implementation of the who surgical safety checklist across hospitals in England. Ann Surg 261:81–91
Russ S, Rout S, Sevdalis N et al (2013) Do safety checklists improve teamwork and communication in the operating room? A systematic review. Ann Surg 258:856–871
Sarah Whyte LL, Sherry Espin G, Baker Ross, Bohnen John, Orser Beverley A, Doran Diane, Reznick Richard, Regehr Glenn (2008) Paradoxical effects of interprofessional briefings on OR team performance. Cogn Technol Work 10:287–294
Bergs J, Hellings J, Cleemput I et al (2014) Systematic review and meta-analysis of the effect of the World Health Organization surgical safety checklist on postoperative complications. Br J Surg 101:150–158
Gillespie BM, Chaboyer W, Thalib L et al (2014) Effect of using a safety checklist on patient complications after surgery: a systematic review and meta-analysis. Anesthesiology 120:1380–1389
Lyons VE, Popejoy LL (2014) Meta-analysis of surgical safety checklist effects on teamwork, communication, morbidity, mortality, and safety. West J Nurs Res 36:245–261
Patel J, Ahmed K, Guru KA et al (2014) An overview of the use and implementation of checklists in surgical specialities—a systematic review. Int J Surg 12:1317–1323
Tang R, Ranmuthugala G, Cunningham F (2014) Surgical safety checklists: a review. ANZ J Surg 84:148–154
Thomassen O, Storesund A, Softeland E et al (2014) The effects of safety checklists in medicine: a systematic review. Acta Anaesthesiol Scand 58:5–18
Treadwell JR, Lucas S, Tsou AY (2014) Surgical checklists: a systematic review of impacts and implementation. BMJ Qual Saf 23:299–318
Urbach DR, Govindarajan A, Saskin R et al (2014) Introduction of surgical safety checklists in Ontario, Canada. N Engl J Med 370:1029–1038
Haugen AS, Softeland E, Almeland SK et al (2015) Effect of the World Health Organization checklist on patient outcomes: a stepped wedge cluster randomized controlled trial. Ann Surg 261:821–828
Rodrigo-Rincon I, Martin-Vizcaino MP, Tirapu-Leon B et al (2015) The effects of surgical checklists on morbidity and mortality: a pre- and post-intervention study. Acta Anaesthesiol Scand 59:205–214
Biskup N, Workman AD, Kutzner E, et al. (2015) Perioperative safety in plastic surgery: is the World Health Organization Checklist useful in a broad practice? Ann Plast Surg
Chaudhary N, Varma V, Kapoor S et al (2015) Implementation of a surgical safety checklist and postoperative outcomes: a prospective randomized controlled study. Journal of Gastrointestinal Surgery 19:935–942
Moher D, Liberati A, Tetzlaff J et al (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 151(264–269):W264
Higgins JP, Altman DG, Gotzsche PC et al (2011) The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 343:d5928
Slim K, Nini E, Forestier D et al (2003) Methodological index for non-randomized studies (minors): development and validation of a new instrument. ANZ J Surg 73:712–716
Catchpole K, Mishra A, Handa A et al (2008) Teamwork and error in the operating room: analysis of skills and roles. Ann Surg 247:699–706
Wiegmann DA, ElBardissi AW, Dearani JA et al (2007) Disruptions in surgical flow and their relationship to surgical errors: an exploratory investigation. Surgery 142:658–665
Davenport DL, Henderson WG, Mosca CL et al (2007) Risk-adjusted morbidity in teaching hospitals correlates with reported levels of communication and collaboration on surgical teams but not with scale measures of teamwork climate, safety climate, or working conditions. J Am Coll Surg 205:778–784
Bliss LA, Ross-Richardson CB, Sanzari LJ et al (2012) Thirty-day outcomes support implementation of a surgical safety checklist. J Am Coll Surg 215:766–776
The World Bank Group (2015). http://data.worldbank.org/country
Boaz M, Bermant A, Ezri T et al (2014) Effect of surgical safety checklist implementation on the occurrence of postoperative complications in orthopedic patients. Israel Med Assoc J 16:20–25
Lepänluoma M, Takala R, Kotkansalo A et al (2014) Surgical safety checklist is associated with improved operating room safety culture, reduced wound complications, and unplanned readmissions in a pilot study in neurosurgery. Scand J Surg 103:66–72
Mayer EK, Sevdalis N, Rout S, et al. (2015) Surgical Checklist Implementation Project: The Impact of Variable WHO Checklist Compliance on Risk-adjusted Clinical Outcomes After National Implementation: A Longitudinal Study. Ann Surg
Haynes AB, Weiser TG, Berry WR et al (2009) A surgical safety checklist to reduce morbidity and mortality in a global population. The New England journal of medicine 360:491–499
Morgan L, Hadi M, Pickering S, et al. (2015) The effect of teamwork training on team performance and clinical outcome in elective orthopaedic surgery: A controlled interrupted time series study. BMJ Open 5
Morgan L, Pickering SP, Hadi M et al (2015) A combined teamwork training and work standardisation intervention in operating theatres: controlled interrupted time series study. BMJ Qual Saf 24:111–119
Nelson MF, Merriman CS, Magnusson PT et al (2014) Creating a physician-led quality imperative. Am J Med Qual 29:508–516
van Klei WA, Hoff RG, van Aarnhem EE et al (2012) Effects of the introduction of the WHO “Surgical Safety Checklist” on in-hospital mortality: a cohort study. Ann Surg 255:44–49
Askarian M, Kouchak F, Palenik CJ (2011) Effect of surgical safety checklists on postoperative morbidity and mortality rates, Shiraz, Faghihy hospital, a 1-year study. Qual Manag Health Care 20:293–297
Baradaran Binazir M, Alizadeh M, Jabbari Bayrami H et al (2015) The effect of a modified world health organization surgical safety checklist on postoperative complications in a tertiary hospital in iran. Iran J Public Health 44:292–294
Prakash P, Baduni N, Sanwal MK, Sinha SR, Shekhar C (2014) Effect of World Health Organization surgical safety checklist on patient outcomes in a Tertiary Care Hospital of Delhi. Int Med J 21:376–378
Yuan CT, Walsh D, Tomarken JL et al (2012) Incorporating the World Health Organization Surgical Safety Checklist into practice at two hospitals in Liberia. Joint Commission J Qual Patient Saf 38:254–260
Lubbeke A, Hovaguimian F, Wickboldt N et al (2013) Effectiveness of the surgical safety checklist in a high standard care environment. Med Care 51:425–429
Tillman M, Wehbe-Janek H, Hodges B et al (2013) Surgical care improvement project and surgical site infections: can integration in the surgical safety checklist improve quality performance and clinical outcomes? J Surg Res 184:150–156
Vats A, Vincent CA, Nagpal K et al (2010) Practical challenges of introducing WHO surgical checklist: UK pilot experience. BMJ 340:133–135
Weiser TG, Haynes AB, Dziekan G et al (2010) Effect of a 19-item surgical safety checklist during urgent operations in a global patient population. Ann Surg 251:976–980
Jammer I, Ahmad T, Aldecoa C et al (2015) Point prevalence of surgical checklist use in Europe: relationship with hospital mortality. Br J Anaesth 114:801–807
Oszvald A, Vatter H, Byhahn C et al (2012) “Team time-out” and surgical safety-experiences in 12,390 neurosurgical patients. Neurosurg Focus 33:E6
Borgi J, Rubinfeld I, Ritz J et al (2013) The differential effects of intermediate complications with postoperative mortality. Am Surg 79:261–266
Khan NA, Quan H, Bugar JM et al (2006) Association of postoperative complications with hospital costs and length of stay in a tertiary care center. J Gen Intern Med 21:177–180
Krzyzanowska MK, Pintilie M, Tannock IF (2003) Factors associated with failure to publish large randomized trials presented at an oncology meeting. JAMA 290:495–501
Helmiö P, Takala A, Aaltonen LM et al (2012) WHO Surgical Safety Checklist in otorhinolaryngology-head and neck surgery: specialty-related aspects of check items. Acta Otolaryngol 132:1334–1341
Kelly SP, Steeples LR, Smith R et al (2013) Surgical checklist for cataract surgery: progress with the initiative by the Royal College of Ophthalmologists to improve patient safety. Eye (Basingstoke) 27:878–882
Joshi S, Gorin MA, Ayyathurai R et al (2012) Development of a surgical safety checklist for the performance of radical nephrectomy and tumor thrombectomy. Patient Saf Surg 6:27
Levy SM, Senter CE, Hawkins RB et al (2012) Implementing a surgical checklist: more than checking a box. Surgery 152:331–336
Rydenfalt C, Johansson G, Odenrick P et al (2013) Compliance with the WHO Surgical Safety Checklist: deviations and possible improvements. Int J Qual Health Care 25:182–187
Acknowledgments
We thank Madeleine Nowak for reviewing the manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
de Jager, E., McKenna, C., Bartlett, L. et al. Postoperative Adverse Events Inconsistently Improved by the World Health Organization Surgical Safety Checklist: A Systematic Literature Review of 25 Studies. World J Surg 40, 1842–1858 (2016). https://doi.org/10.1007/s00268-016-3519-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00268-016-3519-9