Abstract
Systematic reviews are difficult to keep up to date, but failure to do so leads to poor review currency and accuracy. “Living systematic review” (LSR) is an approach that aims to continually update a review, incorporating relevant new evidence as it becomes available. LSRs may be particularly important in fields where research evidence is emerging rapidly, current evidence is uncertain, and new research may change policy or practice decisions.
This chapter describes the concept and processes of living systematic reviews. It describes the general principles of LSRs, when they might be of particular value, and how their procedures differ from conventional systematic reviews. The chapter focuses particularly on two methods of sequential meta-analysis that may be particularly useful for LSRs: Trial Sequential Analysis and Sequential Meta-Analysis, which both control for Type I error, Type II error (failing to detect a genuine effect) and take account of heterogeneity.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Garner P, Hopewell S, Chandler J, MacLehose H, Schunemann HJ, Akl EA, Beyene J, Chang S, Churchill R, Dearness K, Guyatt G, Lefebvre C, Liles B, Marshall R, Martinez Garcia L, Mavergames C, Nasser M, Qaseem A, Sampson M, Soares-Weiser K, Takwoingi Y, Thabane L, Trivella M, Tugwell P, Welsh E, Wilson EC (2016) When and how to update systematic reviews: consensus and checklist. BMJ 354:i3507. https://doi.org/10.1136/bmj.i3507
Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D (2007) How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med 147(4):224–233. https://doi.org/10.7326/0003-4819-147-4-200708210-00179
Crequit P, Trinquart L, Yavchitz A, Ravaud P (2016) Wasted research when systematic reviews fail to provide a complete and up-to-date evidence synthesis: the example of lung cancer. BMC Med 14:8. https://doi.org/10.1186/s12916-016-0555-0
Tricco AC, Antony J, Zarin W, Strifler L, Ghassemi M, Ivory J, Perrier L, Hutton B, Moher D, Straus SE (2015) A scoping review of rapid review methods. BMC Med 13:224. https://doi.org/10.1186/s12916-015-0465-6
Tricco AC, Zarin W, Antony J, Hutton B, Moher D, Sherifali D, Straus SE (2016) An international survey and modified Delphi approach revealed numerous rapid review methods. J Clin Epidemiol 70:61–67. https://doi.org/10.1016/j.jclinepi.2015.08.012
Collaboration TC (2011) Cochrane handbook for systematic reviews of interventions version 5.1.0
Akl EA, Meerpohl JJ, Elliott J, Kahale LA, Schuenemann HJ (2017) Living systematic reviews: 4. Living guideline recommendations. J Clin Epidemiol 91:47–53. https://doi.org/10.1016/j.jclinepi.2017.08.009
Elliott JH, Synnot A, Turner T, Simmonds M, Akl EA, McDonald S, Salanti G, Meerpohl J, MacLehose H, Hilton J, Tovey D, Shemilt I, Thomas J (2017) Living systematic review: 1. Introduction-the why, what, when, and how. J Clin Epidemiol 91:23–30. https://doi.org/10.1016/j.jclinepi.2017.08.010
Thomas J, Noel-Storr A, Marshall F, Wallace B, McDonald S, Mavergames C, Glasziou P, Shemilt I, Synnot A, Turner T, Elliott J (2017) Living systematic reviews: 2. Combining human and machine effort. J Clin Epidemiol 91:31–37. https://doi.org/10.1016/j.jclinepi.2017.08.011
Ioannidis JPA, Contopoulos-Ioannidis DG, Lau J (1999) Recursive cumulative meta-analysis: a diagnostic for the evolution of total randomized evidence from group and individual patient data. J Clin Epidemiol 52(4):281–291. https://doi.org/10.1016/S0895-4356(98)00159-0
Borm GF, Donders ART (2009) Updating meta-analyses leads to larger type I errors than publication bias. J Clin Epidemiol 62(8):825–830. https://doi.org/10.1016/j.jclinepi.2008.08.010
Sutton AJ, Cooper NJ, Jones DR, Lambert PC, Thompson JR, Abrams KR (2007) Evidence-based sample size calculations based upon updated meta-analysis. Stat Med 26(12):2479–2500. https://doi.org/10.1002/sim.2704
Turner RM, Bird SM, Higgins JPT (2013) The impact of study size on meta-analyses: examination of underpowered studies in Cochrane reviews. PLoS One 8(3):e59202. https://doi.org/10.1371/journal.pone.0059202
Lan KKG, Demets DL (1983) Discrete sequential boundaries for clinical-trials. Biometrika 70(3):659–663. https://doi.org/10.2307/2336502
Whitehead J (1999) A unified theory for sequential clinical trials. Stat Med 18(17–18):2271–2286
Pogue JM, Yusuf S (1997) Cumulating evidence from randomized trials: utilizing sequential monitoring boundaries for cumulative meta-analysis. Control Clin Trials 18(6):580–593. https://doi.org/10.1016/S0197-2456(97)00051-2
Simmonds M, Salanti G, McKenzie J, Elliott J (2017) Living systematic reviews: 3. Statistical methods for updating meta-analyses. J Clin Epidemiol 91:38–46. https://doi.org/10.1016/j.jclinepi.2017.08.008
Brok J, Thorlund K, Wetterslev J, Gluud C (2009) Apparently conclusive meta-analyses may be inconclusive-trial sequential analysis adjustment of random error risk due to repetitive testing of accumulating data in apparently conclusive neonatal meta-analyses. Int J Epidemiol 38(1):287–298. https://doi.org/10.1093/ije/dyn188
Wetterslev J, Thorlund K, Brok J, Gluud C (2008) Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J Clin Epidemiol 61(1):64–75. https://doi.org/10.1016/j.jclinepi.2007.03.013
O’Brien PC, Fleming TR (1979) A multiple testing procedure for clinical trials. Biometrics 35(3):549–556
Cook JA, Hislop J, Altman DG, Fayers P, Briggs AH, Ramsay CR, Norrie JD, Harvey IM, Buckley B, Fergusson D, Ford I, Vale LD, Group D (2015) Specifying the target difference in the primary outcome for a randomised controlled trial: guidance for researchers. Trials 16:12. https://doi.org/10.1186/s13063-014-0526-8
Wetterslev J, Thorlund K, Brok J, Gluud C (2009) Estimating required information size by quantifying diversity in random-effects model meta-analyses. BMC Med Res Methodol 9:86. https://doi.org/10.1186/1471-2288-9-86
Higgins JPT, Whitehead A, Simmonds M (2011) Sequential methods for random-effects meta-analysis. Stat Med 30(9):903–921. https://doi.org/10.1002/sim.4088
Whitehead A (1997) A prospectively planned cumulative meta-analysis applied to a series of concurrent clinical trials. Stat Med 16(24):2901–2913. https://doi.org/10.1002/(SICI)1097-0258(19971230)16:24<2901::AID-SIM700>3.3.CO;2-X
Sacks HS, Chalmers TC, Blum AL, Berrier J, Pagano D (1990) Endoscopic hemostasis—an effective therapy for bleeding peptic-ulcers. JAMA 264(4):494–499. https://doi.org/10.1001/jama.264.4.494
Trial Sequential Analysis (2017). http://www.ctu.dk/tools-and-links/trial-sequential-analysis.aspx. Accessed 24 July 2017
Nikolakopoulou A, Mavridis D, Egger M, Salanti G (2016) Continuously updated network meta-analysis and statistical monitoring for timely decision-making. Stat Methods Med Res 27(5):1312–1330. https://doi.org/10.1177/0962280216659896
Veroniki AA, Straus SE, Soobiah C, Elliott MJ, Tricco AC (2016) A scoping review of indirect comparison methods and applications using individual patient data. BMC Med Res Methodol 16:47. https://doi.org/10.1186/s12874-016-0146-y
Berkey CS, Mosteller F, Lau J, Antman EM (1996) Uncertainty of the time of first significance in random effects cumulative meta-analysis. Control Clin Trials 17(5):357–371. https://doi.org/10.1016/S0197-2456(96)00014-1
Greenland S, Senn SJ, Rothman KJ, Carlin JB, Poole C, Goodman SN, Altman DG (2016) Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations. Eur J Epidemiol 31(4):337–350. https://doi.org/10.1007/s10654-016-0149-3
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Science+Business Media, LLC, part of Springer Nature
About this protocol
Cite this protocol
Simmonds, M., Elliott, J.H., Synnot, A., Turner, T. (2022). Living Systematic Reviews. In: Evangelou, E., Veroniki, A.A. (eds) Meta-Research. Methods in Molecular Biology, vol 2345. Humana, New York, NY. https://doi.org/10.1007/978-1-0716-1566-9_7
Download citation
DOI: https://doi.org/10.1007/978-1-0716-1566-9_7
Published:
Publisher Name: Humana, New York, NY
Print ISBN: 978-1-0716-1565-2
Online ISBN: 978-1-0716-1566-9
eBook Packages: Springer Protocols