Abstract
Background
Numerous studies examine simulation modelling in healthcare. These studies present a bewildering array of simulation techniques and applications, making it challenging to characterise the literature.
Objective
The aim of this paper is to provide an overview of the level of activity of simulation modelling in healthcare and the key themes.
Methods
We performed an umbrella review of systematic literature reviews of simulation modelling in healthcare. Searches were conducted of academic databases (JSTOR, Scopus, PubMed, IEEE, SAGE, ACM, Wiley Online Library, ScienceDirect) and grey literature sources, enhanced by citation searches. The articles were included if they performed a systematic review of simulation modelling techniques in healthcare. After quality assessment of all included articles, data were extracted on numbers of studies included in each review, types of applications, techniques used for simulation modelling, data sources and simulation software.
Results
The search strategy yielded a total of 117 potential articles. Following sifting, 37 heterogeneous reviews were included. Most reviews achieved moderate quality rating on a modified AMSTAR (A Measurement Tool used to Assess systematic Reviews) checklist. All the review articles described the types of applications used for simulation modelling; 15 reviews described techniques used for simulation modelling; three reviews described data sources used for simulation modelling; and six reviews described software used for simulation modelling. The remaining reviews either did not report or did not provide enough detail for the data to be extracted.
Conclusion
Simulation modelling techniques have been used for a wide range of applications in healthcare, with a variety of software tools and data sources. The number of reviews published in recent years suggest an increased interest in simulation modelling in healthcare.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
This umbrella review provides a centralised repository of information for readers to understand the current state of knowledge regarding the use of simulation modelling in healthcare. |
Simulation modelling techniques have been used to support a wide range of healthcare decision problems, and the number of reviews published recently suggests an increased interest in the use of these techniques. |
Readers can identify the systematic reviews that are best suited for their particular research questions, either based on problem type or simulation modelling technique. |
1 Background
There is a large amount of literature on simulation modelling in healthcare and the number of studies has increased over the last 20 years. These studies present a bewildering array of simulation techniques and applications in healthcare, which may cause confusion among individuals who are new to this literature (e.g. policy makers, early career operational researchers and healthcare professionals). The substantial time and resources required to conduct a systematic review of this diffuse literature is unlikely to represent an optimal approach to sensitisation to this literature.
Umbrella approaches can be used to review and compile evidence from multiple systematic literature reviews into a sole review. First, the umbrella approach allows the reader to get an overview of the literature relevant to the topic at hand [1], rather than analysing every individual study that has been published on the topic of interest. For example, Mahdavi et al. [2] conducted a preliminary search of systematic review studies to assess the volume of relevant papers using generic models in healthcare. Secondly, this approach enables the reader to assess and consider different reviews efficiently when similar research questions need to be addressed [3]. Thus, we used the umbrella approach as it represents a powerful and appropriate tool for our review purpose. In this review, our aim was to provide an overview of simulation modelling in healthcare and assess the quality of the reviewed studies.
2 Methods
2.1 Literature Searches
A systematic literature search was conducted in academic databases (JSTOR, Scopus, PubMed, IEEE, SAGE, ACM, Wiley Online Library, ScienceDirect) and other sources for grey literature [Google Scholar, the FreeFullPDF website (http://www.freefullpdf.com), Winter Simulation Conference Archive]. Pearl growing techniques [4] were used to identify list of keywords related to simulation modelling in healthcare and to develop the search strategies. The searches focused on reviews that have been published between January 1990 and May 2017. These searches were also supplemented with manual searches of references from the included studies.
2.2 Study Selection
Articles found using the search strategy, after removing duplicates, were screened at the title and abstract level by two reviewers (SS and PT). Full texts for the remaining articles were assessed in detail and included if both reviewers found them relevant. Reviews were included if the article is considered a systematic review or systematic literature review; clearly presents the review purpose, the search strategy, and the inclusion criteria; reviewed the applications of simulation modelling in healthcare; and included a detailed description (e.g. at least a paragraph, figure, table or lists of references) of the applied simulation techniques and its application areas from individual studies. Studies were excluded if they were not literature reviews, not in healthcare, not in English or not a journal article.
2.3 Data Extraction and Quality Assessment
A data extraction form was used to assess the following characteristics of the reviews: the total number of simulation studies assessed, range of years reviewed, types of healthcare applications, techniques used for simulation modelling, sources of input data and software tools used for simulation modelling.
We selected the AMSTAR (A Measurement Tool used to Assess systematic Reviews) checklist from Shea et al. [5], which is widely recognised as a way of evaluating reviews [6]. The AMSTAR tool consists of 11 key questions that have adequate face and content validity to measure quality of systematic reviews effectively [6]. However, no instrument currently exists to assess the quality of methodology reviews. This study therefore used AMSTAR as the basis to develop a method for evaluating the quality of reviews, while reinterpreting some of the questions in the context of simulation studies. Minor modifications were made with the aim of preserving the original intent of checklist items while making the tool applicable for assessing the quality of simulation reviews. The AMSTAR checklist with its additional purpose-specific prompts, to address issues specific to simulation modelling reviews, is presented in Electronic Supplementary Material (ESM) Appendix 1.
2.4 Analysis
The data extracted from the reviews were synthesised and the information gathered was discussed in detail to identify common themes. A quantitative, qualitative and narrative summary of the results from the systematic reviews was presented. The analysis also incorporated insights gathered during the full-text reading of the included reviews.
3 Results
3.1 Searches, Sifting, Data Extraction Categories and Quality Assessment
The search strategies to identify systematic literature reviews of simulation modelling in healthcare, developed using pearl growing techniques, are presented in ESM Appendix 2. The search strategies yielded a total of 117 potential articles. After elimination of duplicates, 105 articles remained. The first stage of screening (i.e. abstract and title level) conducted using the inclusion and exclusion criteria led to a total of 46 articles being excluded: 14 articles as they were not a systematic literature review, nine for not being in healthcare and 23 for using a different definition of simulation (e.g. simulation techniques used for medical training, integration testing, comparative study). The second stage of screening included a detailed assessment (i.e. a full-text reading) of 59 articles, which resulted in 22 further articles being excluded: ten articles as they were not a systematic literature review, six for not being in healthcare, five for using a different definition of simulation and one was not a journal article (i.e. University of Twente discussion paper). The results from the two stage sifting process are presented visually as a PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) diagram in Fig. 1.
The synthesis and the discussion in this paper relates to the 37 review articles included. Each review article was read carefully to absorb the detail provided. Key themes were then identified by examining the type of information presented on the simulation studies included within each review. Each of the review articles varied in terms of the type of information presented, as observed in ESM Appendix 3. However, the categories of information that were included in most of the reviews were journal type, year of publication, country, objectives, methods, applications, tools, data used, outputs and critical appraisal of the studies.
The next steps were to choose the categories for data extraction and then extract the data from the reviews that included these categories. Among the categories that were identified, journal type, year of publication and country were excluded from data extraction stage, as this was beyond the scope of the current paper. Furthermore, objectives, outputs and critical appraisal of the studies were also excluded from the data extraction stage due to the qualitative nature of the information. The readers are encouraged to refer to ESM Appendix 3 and the corresponding reviews for more detailed information on the categories excluded.
The four categories chosen and extracted from the reviews were the types of applications, techniques used for simulation modelling, data sources and simulation software used for modelling.
Furthermore, the full text of articles that met the inclusion criteria was subjected to quality assessment using the modified AMSTAR checklist and was allocated quality ratings of high, moderate or low. Of the 37 included reviews, most achieved a rating of moderate (30 review articles), while the rest exhibited high (three review articles) or low (four review articles) quality ratings. The four articles that achieved low ratings were also included for data extraction and synthesis, as they offered valuable insights into simulation modelling in healthcare. The detail of the quality assessment results for all the included studies are presented in ESM Appendix 4.
3.2 Overview of the Reviews Included
Table 1 provides a general overview of the 37 reviews, which includes the type of review, years covered, the number of studies identified and categories extracted in each review. There are a few key themes that can be identified from this high-level overview of the reviews. First, there is an increase in number of reviews being published with time. There are only two studies published prior to 2005, with five published in years 2005–2009 and 30 since 2010. This indicates that the level of activity and interest in simulation modelling for healthcare is increasing.
The second column of Table 1 highlights the diversity of topics that are considered within the reviews. Two broad classifications emerge: reviews of certain types of simulation modelling techniques and reviews of certain types of healthcare applications, i.e. whilst some of the studies are broad reviews (i.e. reviews of studies that use simulation modelling in healthcare), some reviews are either limited to certain simulation modelling techniques [e.g. discrete-event simulation (DES)] or certain healthcare applications (e.g. emergency departments). For example, reviews by Günal and Pidd [20] and Kammoun et al. [32] look only at studies using DES; Atkinson et al. [34] look at system dynamics (SD); Lakshmi and Sivakumar [31] look at queueing models, while the rest of the reviews are not restricted by specific techniques, i.e. they consider all simulation modelling techniques. On the other hand, as seen in Table 1, the majority of the reviews solely focus on simulation studies related to healthcare operations and system design [2, 9,10,11, 13, 15, 17, 19, 21, 23, 24, 26, 29,30,31,32, 35, 38, 40,41,42], with the remaining 16 reviews [7, 8, 12, 14, 16, 18, 20, 22, 25, 27, 28, 33, 34, 36, 37, 39] assessing multiple types of applications.
The third and fourth columns of Table 1 present the years covered and the number studies included in each review. As expected, the number of studies included depend on the scope of the review and when it was conducted. For example, there are more studies included in broader reviews (i.e. reviews of simulation modelling in healthcare) than reviews that were limited to specific simulation modelling techniques or healthcare applications. Similarly, as the amount of literature is increasing each year, there are more studies included in reviews that were conducted later.
Columns 5–8 of Table 1 present the reviews eligible for data extraction based on the four chosen categories. All 37 reviews described category 1, the types of applications used for simulation modelling; 15 described category 2, techniques used for simulation modelling [11, 13, 14, 16,17,18, 22, 27, 34,35,36,37, 39, 41, 42]; three described category 3, data sources used for simulation modelling [9, 15, 37]; and six described category 4, software used for simulation modelling [14, 18, 22, 35, 37, 42]. The remaining reviews either did not report these categories or did not provide enough detail for the data to be extracted.
3.3 Data Extraction
3.3.1 Types of Applications
To differentiate the heterogeneity of studies assessed within these articles identified in the umbrella review, the applications were classified into four major groups:
-
1.
Healthcare operations and system design: use of simulation modelling for resource management or system design with the aim of optimising healthcare service flow (e.g. reducing queue or waiting time within healthcare department) or forecast resource demands (e.g. predicting the number of beds required to meet the expected patient demand).
-
2.
Medical decision-making applications: use of simulation modelling to gain information regarding the implication of short- or long-term effects of a particular program for effective decision making (e.g. using cost-effectiveness analysis for selection of interventions or policy).
-
3.
Infectious disease modelling: use of simulation modelling to predict the rate of spreading epidemics, assessing the economic consequences or estimating future resources required to treat the growing number of infected population (e.g. cost needed to manage influenza disease).
-
4.
Miscellaneous studies: simulation studies used for mass casualty event planning (e.g. terrorist attacks) or a review (e.g. reviewing the development, improvement or comparison of simulation techniques as a feasibility study).
These classifications were identified by carefully reviewing the applications presented in the 16 included articles, and combining into groups that best fit all application areas. This decision was made by discussion and consensus of two reviewers (SS and PT).
As presented in Table 1, 21 of the reviews solely focus on simulation studies related to healthcare operations and system design [2, 9,10,11, 13, 15, 17, 19, 21, 23, 24, 26, 29,30,31,32, 35, 38, 40,41,42].
Table 2 presents the remaining 16 reviews, which present multiple types of applications and the classification of the applications of simulation studies within those articles [7, 8, 12, 14, 16, 18, 20, 22, 25, 27, 28, 33, 34, 36, 37, 39]. The numbers of simulation studies relating to the different application groups were identified and extracted from the 16 reviews. It should be noted that the data included in the reviews by Mustafee et al. [16] and Katsaliaki and Mustafee [18] were the same and hence are presented only once in Table 2. As observed, most of the studies relate to healthcare operations and system design, with medical decision-making applications second, whilst infectious disease modelling and other miscellaneous studies make up the rest of the studies.
3.3.2 Simulation Techniques Used
Of the 37 reviews identified, only 15 [11, 13, 14, 16,17,18, 22, 27, 34,35,36,37, 39, 41, 42] presented the details of the types of techniques used for simulation modelling among the studies identified in their reviews. Table 3 presents the results of simulation techniques used in the studies identified within these 15 reviews. DES is the most widely used technique, with Monte-Carlo simulation and SD models also commonly used. Agent-based modelling techniques appear to be relatively rare but seem to be coming into more frequent usage recently. It is apparent that hybrid modelling is new to this field and there has not been a significant amount of research conducted on it, with only one review reporting on hybrid models. Interestingly, only two reviews [11, 23] presented studies using the Markov model or cohort simulation techniques. The possible reason for this is that these techniques are commonly combined (e.g. alongside DES or SD techniques) and were not reviewed separately in other reviews.
3.3.3 Data Sources
Out of the 37 simulation articles identified in the umbrella review, only three [9, 15, 37] discussed the model data sources. Table 4 presents the results of data sources used as inputs in the studies identified within these three articles. The data used for modelling ranged from primary data collection (e.g. hospital databases, observation and time studies), secondary data (e.g. literature, questionnaires) as well as expert opinion (e.g. interviews, workshops).
3.3.4 Software Used for Simulation Modelling
Only six articles [14, 18, 22, 35, 37, 42] discussed the software tools used for model development. Table 5 presents the results of simulation tools used for modelling, split by technique [DES, SD, Monte-Carlo simulation, agent-based simulation (ABM)], in the studies identified within these six articles. A wide variety of software tools were used for simulation modelling but no clear recommendations were made about software within these reviews.
4 Discussion
This umbrella review set out to provide a review of reviews of simulation modelling articles in healthcare. Simulation modelling in healthcare is a diffuse topic, with reviews covering diverse topics and application areas in healthcare. The readers could use this paper as a reference to identify which of these key reviews are best for their research question.
The increase in the number of reviews (and the number of studies included within each review) over time points towards increased interest in the use of these simulation modelling techniques in healthcare. Also apparent from these reviews is the wide variety of applications, techniques used for simulation modelling, data sources and simulation software used for modelling. Whilst the review is focused on healthcare in general, many of the questions faced in health technology assessment (HTA) can be addressed using these approaches. These advanced simulation modelling techniques are becoming more popular within HTA and our umbrella review provides a quick introduction to this field.
However, it should be pointed out that there are some limitations to our approach as it is based on including articles that are considered to be a systematic review. Whilst there could be encyclopaedias, book chapters, discussion papers, etc. that might be useful, we felt peer-reviewed articles provided the most robust form of evidence. Similarly, whilst there could be useful opinion pieces, editorials or reviews that handpick a set of relevant articles, we felt they were not as robust as systematically conducted literature reviews. Reviews were only included if they clearly present the review purpose, the search strategy and the inclusion criteria; and if the article included a detailed description (e.g. at least a paragraph, figure, table or lists of references) of the applied simulation techniques and its application areas from individual studies.
It is possible that there may be studies that are related to simulation modelling in healthcare that were not included in any of the reviews. Simulation studies are published continuously and it is possible that some of them may have been missed depending on the time of publication, the scope of healthcare applications and the simulation methods considered in the reviews. On the other hand, studies that were reviewed and synthesised within several of the reviewed articles may skew the total numbers. These issues need to be kept in mind when drawing conclusions regarding the state of the art of simulation modelling in healthcare.
It is possible that there may be other reviews that did not meet our inclusion criteria but may be relevant to simulation modelling in healthcare. There were ten articles that were excluded at the full-text review stage as they did not provide information on search strategy because they were surveys and narrative reviews, not a journal article or reviewed multiple areas (e.g. transportation and retailing alongside healthcare). One of these articles reviewed the use of DES for single- and multi-facility healthcare clinics [43], with the other nine articles looked at healthcare systems in general (e.g. hospitals, emergency rooms, clinics) [44,45,46,47,48,49,50,51,52]. As no data were extracted from these reviews, the readers may wish to refer to these studies for further information on these topics.
There are other articles that did not meet our inclusion criteria but nevertheless provide an excellent overview of simulation modelling techniques in healthcare. For example, Dangerfield [53] and Wolstenholme [54] present an overview of SD models for healthcare in the UK and Europe. Similarly, there are also application-specific review articles such as the review on complex systems modelling for obesity research by Hammon [55], complex systems thinking in health disparities research by Diez Roux [56], systems science methods (SD, DES and ABM) for public health by Luke and Stamatakis [57], use of mathematical modelling for infectious diseases by Heesterbeek et al. [58] and comparison of different modelling techniques for HIV treatment by Eaton et al. [59]. Brennan et al. [60] present a taxonomy of the different modelling approaches, which is very useful for understanding how the techniques relate to each other. There is also guidance by the AHRQ (Agency for Healthcare Research and Quality) regarding model validity assessment [61].
We acknowledge that we were unable to identify an existing tool that is specific to quality assessment of methodology reviews. Nevertheless, we considered that it is important to follow recognised systematic review practice and thus to perform some form of quality assessment to differentiate between the quality of included reviews. We therefore added purpose-specific prompts, in order to address issues specific to simulation modelling reviews, to the AMSTAR instrument while seeking to continue to harness the utility of this previously validated tool. Further evaluation, in terms of the utility and validity of these minor modifications, is therefore required.
The aim of our review was to provide an overview and understanding of the techniques used for simulation modelling in healthcare, not to provide a synthesis of any specific recommendations. The reader is referred to the individual reviews for specific recommendations regarding methods or applications. However, it is widely acknowledged that it is difficult to make any blanket recommendation as the choice of the most appropriate methods (e.g. modelling technique) is highly dependent on the decision problem. Nevertheless, it should be noted that there is guidance on some general principles that need to be considered when selecting a simulation modelling technique for a given healthcare application [62, 63].
5 Conclusions
This paper highlights that simulation modelling has been applied in a wide range of applications in healthcare. The number of reviews being published has grown over the years, which points towards increased interest in simulation modelling in healthcare. The studies identified in the reviews use a variety of modelling approaches (DES, SD, ABM), with a variety of software tools and data sources. This umbrella review provides a centralised repository of information for readers to understand the current state of the knowledge for the use of simulation modelling in healthcare, and to identify reviews that best suit any given decision problem.
Data Availability Statement
All data generated or analysed during this study are included in this published article and its Electronic Supplementary Material.
References
Grant M, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26(2):91–108.
Mahdavi M, Malmström T, Van De Klundert J, Elkhuizen S, Vissers J. Generic operational models in health service operations management: a systematic review. Socioecon Plann Sci. 2013;47(4):271–80.
Aromataris E, Fernandez R, Godfrey C, Holl C, Khalil H, Tungpunkom P. Methodology for JBI umbrella reviews. Adelaide: Joanna Brigs Institute; 2013. p. 2. http://joannabriggs.org/assets/docs/sumari/ReviewersManual-Methodology-JBI_Umbrella%20Reviews-2014.pdf. Accessed 8 Nov 2014.
Holly C, Salmond S, Saimbert M. Comprehensive systematic review for advanced nursing practice. New York: Springer; 2012. p. 86.
Shea B, Grimshaw J, Wells G, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7(1):10.
Wegewitz U, Weikert B, Fishta A, Jacobs A, Pieper D. Resuming the discussion of AMSTAR: what can (should) be made better? BMC Med Res Methodol. 2016;16(1):111.
Klein R, Dittus R, Roberts S, Wilson J. Simulation modeling and health-care decision making. Med Decis Making. 1993;13(4):347–54.
Fone D, Hollinghurst S, Temple M, Round A, Lester N, Weightman A, et al. Systematic review of the use and value of computer simulation modelling in population health and health care delivery. J Public Health Med. 2003;25(4):325–35.
White K. A survey of data resources for simulating patient flows in healthcare delivery systems. In: Proceedings of the winter simulation conference. IEEE; 2005. p. 926–34. http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=1574341. Accessed 31 Dec 2014.
Hoot N, Aronsky D. Systematic review of emergency department crowding: causes, effects, and solutions. Ann Emerg Med. 2008;52(2):126–136.e1.
Sobolev B, Sanchez V, Vasilakis C. Systematic review of the use of computer simulation modeling of patient flow in surgical care. J Med Syst. 2009;35(1):1–16.
Jack E, Powers T. A review and synthesis of demand management, capacity management and performance in health-care services. Int J Manag Rev. 2009;11(2):149–74.
Brailsford S, Harper P, Patel B, Pitt M. An analysis of the academic literature on simulation and modelling in health care. J Simul. 2009;3(3):130–40.
Mielczarek B, Uzialko-Mydlikowska J. Application of computer simulation modeling in the health care sector: a survey. Simulation. 2010;88(2):197–216.
Paul S, Reddy M, DeFlitch C. A systematic review of simulation studies investigating emergency department overcrowding. Simulation. 2010;86(8–9):559–71.
Mustafee N, Katsaliaki K, Taylor S. Profiling literature in healthcare simulation. Simulation. 2010;86(8–9):543–58.
Cardoen B, Demeulemeester E, Belien J. Operating room planning and scheduling: a literature review. Eur J Oper Res. 2010;201(3):921–32.
Katsaliaki K, Mustafee N. Applications of simulation within the healthcare context. J Oper Res Soc. 2010;62(8):1431–51.
Guerriero F, Guido R. Operational research in the management of the operating theatre: a survey. Health Care Manag Sci. 2010;14(1):89–114.
Günal M, Pidd M. Discrete event simulation for performance modelling in health care: a review of the literature. J Simulat. 2010;4(1):42–51.
Van Sambeek J, Cornelissen F, Bakker P, Krabbendam J. Models as instruments for optimizing hospital processes: a systematic review. Int J Health Care Qual Assur. 2010;23(4):356–77.
Fakhimi M, Mustafee N. Application of Operations Research within the UK Healthcare Context. Operational Research Society Simulation Workshop. The Operational Research Society; 2012. p. 66-82. http://www.theorsociety.com/Pages/ImagesAndDocuments/documents/Conferences/SW12/Papers/FakhimiMustafee.pdf. Accessed 22 Apr 2017.
Hulshof P, Kortbeek N, Boucherie R, Hans E, Bakker P. Taxonomic classification of planning decisions in health care: a structured review of the state of the art in OR/MS. Health Syst. 2012;1(2):129–75.
Van Lent W, VanBerkel P, Van Harten W. A review on the relation between simulation and improvement in hospitals. BMC Med Inform Decis Making. 2012;12(18):1–8.
Beliën J, Forcé H. Supply chain management of blood products: a literature review. Eur J Oper Res. 2012;217(1):1–16.
Aboueljinane L, Sahin E, Jemai Z. A review on simulation models applied to emergency medical service operations. Comput Ind Eng. 2013;66(4):734–50.
Fakhimi M, Probert J. Operations research within UK healthcare: a review. J Enterprise Inf Manag. 2013;26(1/2):21–49.
Timbie J, Ringel J, Fox D, Pillemer F, Waxman D, Moore M, et al. Systematic review of strategies to manage and allocate scarce resources during mass casualty events. Ann Emerg Med. 2013;61(6):677–689.e101.
Pomey M, Forest P, Sanmartin C, DeCoster C, Clavel N, Warren E, et al. Toward systematic reviews to understand the determinants of wait time management success to help decision-makers and managers better manage wait times. Implement Sci. 2013;8(1):61.
Verbano C, Crema M. Guidelines for overcoming hospital managerial challenges: a systematic literature review. Ther Clin Risk Manag. 2013;9:427–41.
Lakshmi C, Sivakumar A. Application of queueing theory in health care: a literature review. Oper Res Health Care. 2013;2(1–2):25–39.
Kammoun A, Loukil T, Hachicha W. The use of discrete event simulation in hospital supply chain management. In: 2014 International conferences on advanced logistics and transport (ICALT), Hammamet. IEEE; 2014. p. 143–8. doi:10.1109/ICAdLT.2014.6864108. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6864108&isnumber=6864062. Accessed 26 May 2017.
Carey G, Malbon E, Carey N, Joyce A, Crammond B, Carey A. Systems science and systems thinking for public health: a systematic review of the field. BMJ Open. 2015;5(12):e009002.
Atkinson J, Wells R, Page A, Dominello A, Haines M, Wilson A. Applications of system dynamics modelling to support health policy. Public Health Res Pract. 2015;25(3):e2531531.
Baru R, Cudney E, Guardiola I. Systematic review of operations research and simulation methods for bed management. In: Proceedings of the 2015 industrial and systems engineering research conference. ResearchGate; 2015. p. 298–306. https://www.researchgate.net/publication/308971444_Systematic_Review_of_Operations_Research_and_Simulation_Methods_for_Bed_Management. Accessed 26 May 2017.
Isern D, Moreno A. A systematic literature review of agents applied in healthcare. J Med Syst. 2015;40(2):43.
Gul M, Guneri A. A comprehensive review of emergency department simulation applications for normal and disaster conditions. Comput Ind Eng. 2015;83:327–44.
Vieira B, Hans E, Van Vliet-Vroegindeweij C, Van de Kamer J, van Harten W. Operations research for resource planning and -use in radiotherapy: a literature review. BMC Med Inform Decis Making. 2016;16(1):3–11.
Mielczarek B. Review of modelling approaches for healthcare simulation. Oper Res Decis. 2016;26(1):55–72.
Palmer R, Fulop N, Utley M. A systematic literature review of operational research methods for modelling patient flow and outcomes within community healthcare and other settings. Health Syst. 2017;6(15):1–21.
Soh K, Walker C, O’Sullivan M. A literature review on validated simulations of the surgical services. J Med Syst. 2017;41(4):61.
Mohiuddin S, Busby J, Savovi J, Richards A, Northstone K, Hollingworth W, et al. Patient flow within UK emergency departments: a systematic review of the use of computer simulation modelling methods. BMJ Open. 2017;7(5):1–14.
Jun J, Jacobson S, Swisher J. Application of discrete-event simulation in health care clinics: a survey. J Oper Res Soc. 1999;50(2):109.
Lehaney B, Hlupic V. Simulation modelling for resource allocation and planning in the health sector. J R Soc Promot Health. 1995;115(6):382–5.
Jacobson SH, Hall SN, Swisher JR. Discrete-event simulation of health care systems. In: Hall R, editor. Patient flow: reducing delay in healthcare delivery. New York: Springer; 2006. p. 211–52.
Thorwarth M, Arisha A. Application of discrete-event simulation in health care: a review. Reports. Paper 3. Dublin Institute of Technology; 2009. p. 1–32. http://arrow.dit.ie/buschmanrep/3/?utm_source=arrow.dit.ie%2Fbuschmanrep%2F3&utm_medium=PDF&utm_campaign=PDFCoverPages. Accessed 6 Nov 2015.
Vanberkel P, Boucherie R, Hans E, Hurink J, Litvak N. A survey of health care models that encompass multiple departments. University of Twente; 2009. p. 1–49. http://doc.utwente.nl/67545/1/memo1903.pdf. Accessed 2 Jan 2016.
Soni K, Saxena K. A study of applicability of waiting line model in health care: a systematic review. Int J Mark Technol. 2011;19(1):75–91.
Atuahene I, Kubi P, Acosta-Amando R, Lacera-Cortes I, Sawhney R, Atuahene E, et al. Towards an operations research sustainable healthcare: an overview of recent applications of OR in healthcare. In: Industrial and systems engineering research conference. ResearchGate; 2014. p. 1–12. https://www.researchgate.net/publication/287394488_Towards_an_operations_research_sustainable_healthcare_An_overview_of_recent_applications_of_or_in_healthcare. Accessed 26 May 2017.
White L, Smith H, Currie C. OR in developing countries: a review. Eur J Oper Res. 2011;208(1):1–11.
Van den Bergh J, Beliën J, De Bruecker P, Demeulemeester E, De Boeck L. Personnel scheduling: a literature review. Eur J Oper Res. 2013;226(3):367–85.
Xing Y, Li L, Bi Z, Wilamowska-Korsak M, Zhang L. Operations research (OR) in service industries: a comprehensive review. Syst Res. 2013;30(3):300–353. http://onlinelibrary.wiley.com/doi/10.1002/sres.2185/abstract. Accessed 26 May 2017.
Dangerfield B. System dynamics applications to European health care issues. J Oper Res Soc. 1999;50(4):345–53.
Wolstenholme E. Health care in the United Kingdom and Europe, system dynamics applications to. In: Meyers RA, editor. Encyclopedia of complexity and systems science. New York: Springer Science + Business Media, LLC; 2009. p. 4561–76.
Hammond R. Complex systems modeling for obesity research. Prev Chronic Dis. 2009;6(3):1–10.
Diez Roux A. Complex systems thinking and current impasses in health disparities research. Am J Public Health. 2011;101(9):1627–34.
Luke D, Stamatakis K. Systems science methods in public health: dynamics, networks, and agents. Annu Rev Public Health. 2012;33(1):357–76.
Heesterbeek H, Anderson R, Andreasen V, Bansal S, De Angelis D, Dye C, et al. Modeling infectious disease dynamics in the complex landscape of global health. Science. 2015;347(6227):1–24.
Eaton J, Johnson L, Salomon J, Bärnighausen T, Bendavid E, Bershteyn A, et al. HIV treatment as prevention: systematic comparison of mathematical models of the potential impact of antiretroviral therapy on HIV incidence in South Africa. PLoS Med. 2012;9(7):1–20.
Brennan A, Chick S, Davies R. A taxonomy of model structures for economic evaluation of health technologies. Health Econ. 2006;15(12):1295–310.
AHRQ. Decision and simulation modeling: review of existing guidance, future research needs, and validity assessment. Maryland: AHRQ; 2014. p. 1–54. https://effectivehealthcare.ahrq.gov/index.cfm/search-for-guides-reviews-and-reports/?pageaction=displayproduct&productid=1965. Accessed 12 May 2017.
Marshall D, Burgos-Liz L, IJzerman M, Crown W, Padula W, Wong P, et al. Selecting a dynamic simulation modeling method for health care delivery research—part 2: report of the ISPOR Dynamic Simulation Modeling Emerging Good Practices Task Force. Value Health. 2015;18(2):147–60.
Marshall D, Burgos-Liz L, IJzerman M, Osgood N, Padula W, Higashi M, et al. Applying dynamic simulation modeling methods in health care delivery research—the SIMULATE checklist: report of the ISPOR Simulation Modeling Emerging Good Practices Task Force. Value Health. 2015;18(1):5–16.
Acknowledgements
We thank all of those who contributed to this work. In addition, the corresponding author (SS) would like to thank Majlis Amanah Rakyat (MARA) for sponsoring this project.
Author information
Authors and Affiliations
Contributions
The study idea originated from PT and was further developed in discussions with SS, and finalised in communication with all authors. SS coordinated the data collection and interpretation, which was agreed among all authors. SS and PT wrote the initial draft, with all authors contributing to the submitted version and also revising the manuscript based on reviewers’ comments. SS is the overall guarantor for the manuscript.
Corresponding author
Ethics declarations
Funding
This work was supported by the Majlis Amanah Rakyat (MARA).
Conflict of interest
Syed Salleh, Praveen Thokala, Alan Brennan, Ruby Hughes and Andrew Booth declare that they have no conflicts of interest.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Salleh, S., Thokala, P., Brennan, A. et al. Simulation Modelling in Healthcare: An Umbrella Review of Systematic Literature Reviews. PharmacoEconomics 35, 937–949 (2017). https://doi.org/10.1007/s40273-017-0523-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40273-017-0523-3