Abstract
This chapter advocates for a greater uptake of two underused approached in the security field, realistic evaluation and the 5Is framework, to support more robust and systematic approaches to evaluating security interventions. It contends that a combination of these two complimentary approaches affords a methodical approach to support the design of security interventions, enables a systematic approach for the evaluation of security interventions, offers a greater understanding by the mechanisms which a security intervention has or has not worked in a particular setting or place, facilitates replication and future adaption of security interventions in different contexts, and provides a user-friendly structure for disseminating and communicating the evaluation results of interventions to security practitioners. This chapter examines the strengths and limitations of each approach, the merits of combining the two, and uses a hypothetical scenario to guide the reader through how to carry out a combined realistic evaluation and 5Is evaluation of a security intervention.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Blamey A, Mackenzie M. Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges? Evaluation. 2007;13(4):439–455
Brown J, Belur J, Tompson L, McDowall A, Hunter G, May T (2018). Extending the remit of evidence-based policing. International Journal of Police Science & Management. 20(1):38–51.
Bullock, K. and Ekblom, P. (2010) ‘Richness, retrievability and reliability—issues in a working knowledge base for good practice in crime prevention’. European Journal on Criminal Policy and Research, 16, 29–47.
Bullock, K., & Tilley, N. (2009). Evidence-based policing and crime reduction. Policing, 3(4), 381–387.
Burns-Howell, T. and Pascoe, T. (2004). Crime Prevention Evaluation: A Realistic Framework Based on Experience and Reality. Criminology & Public Policy, 3: 527–534.
Clarke, R. (1995). Situational Crime Prevention. Crime and Justice, 19, 91–150.
Dezember, A., Stoltz, M., Marmolejo, L., Kanewske, L., Feingold, D, Wire, S., Duhaime, L. and Maupin, C. (2020). The lack of experimental research in criminology—evidence from Criminology and Justice Quarterly. Journal of Experimental Criminology https://doi.org/https://doi.org/10.1007/s11292-020-09425-y
Ekblom, P (2006) ‘Good practice? Invest in a Framework!’ Network News, Spring 2006. Chester: National Community Safety Network.
Ekblom, P. (2011) Crime Prevention, Security and Community Safety Using the 5Is Framework. Basingstoke: Palgrave Macmillan.
Ekblom, P. (2018). ‘From threat to debt… or, there is mechanism in my madness’. In G. Farrell and A. Sidebottom (Eds) Realist Evaluation for Crime Science: Essays in Honour of Nick Tilley. Milton Park: Taylor and Francis. 58–75.
Ekblom, P. (2014). ‘Securing the knowledge’ in M. Gill (ed.) The Handbook of Security (2nd Edn). Basingstoke: Palgrave Macmillan
Ekblom, P., and Pease, K. (1995). Evaluating crime prevention. In: M. Tonry, D. Farrington (eds.), Building a Safer Society: Strategic Approaches to Crime Prevention London/Chicago, University of Chicago Press, pp. 585–662 Crime and Justice: A Review of Research, vol. 19
Ekblom, P and Sidebottom, A. (2008) ‘What do you mean, ‘Is it secure?’ Redesigning language to be fit for the task of assessing the security of domestic and personal electronic goods.’ European Journal on Criminal Policy and Research, 14:61–87
Gill, M., & Turbin, V. (1999). Evaluating ‘realistic evaluation’: Evidence from a study of CCTV. In R. V. Clarke (Ed.), Crime Prevention Studies: Vol. 10 (pp. 179–199). Monsey.
Gilmore B (2019). Realist evaluations in low- and middle-income countries: reflections and recommendations from the experiences of a foreign researcher. BMJ Global Health; 4:e001638
Goldstein, H. (2018) On problem-oriented policing: the Stockholm lecture. Crime Science 7, 13.
HM Treasury (2020a) The Magenta Book: HM Treasury guidance on what to consider when designing an evaluation.
HM Treasury (2020b). Magenta Book 2020. Supplementary Guide: Realist Evaluation. [Available online: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/879435/Magenta_Book_supplementary_guide._Realist_Evaluation.pdf]. Last Accessed: 5th May 2021
Hinkle, JC, Weisburd, D, Telep, CW, Petersen, K. Problem-oriented policing for reducing crime and disorder: An updated systematic review and meta-analysis. Campbell Syst Rev. 2020; 16:e1089.
Johnson, S.D., Tilley, N. & Bowers, K.J. (2015). Introducing EMMIE: an evidence rating scale to encourage mixed-method crime prevention synthesis reviews. Journal of Experimental Criminology 11, 459–473
Leone L. (2008) Realistic Evaluation of an Illicit Drug Deterrence Programme: Analysis of a Case Study. Evaluation. 14(1):9–28.
Marchal B, van Belle S, van Olmen J, Hoerée T, Kegels G (2012). Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research. Evaluation. 18(2):192–212
Mirzoev T, Cronin de Chavez A, Manzano A, et al (2021) Protocol for a realist synthesis of health systems responsiveness in low-income and middle-income countries. BMJ; 11:e046992
Pawson, R. and Tilley, N. (1994). What works in evaluation research? British Journal of Criminology, 34(3), pp.291–306.
Pawson, R., and Tilley, N. (1997). Realistic Evaluation. London: Sage.
Quintans, J. R., Yonekura, T., Trapé, C. A., & Soares, C. B. (2020). Realist evaluation for programs and services in the health area: an integrative review of the theoretical and methodological literature. Revista latino-americana de enfermagem, 28, e3255.
Ranisavljević, D. and Hadžić, M. (2016) “Realistic Evaluation of the Ratio: Loan-To-value—The Key to Minimising the Credit Risk” Economic Themes, vol. 54, no. 3, pp. 449–468.
Ratcliffe, J. H. (2008). Intelligence-led policing. Cullompton, Devon: Willan
Salter, K.L., Kothari, A. (2014) Using realist evaluation to open the black box of knowledge translation: a state-of-the-art review. Implementation Science 9, 115
Serrat O. (2017) Theories of Change. In: Knowledge Solutions. Springer, Singapore
Smith, J., Li, D. & Rafferty, M. (2020) The Implementation Research Logic Model: a method for planning, executing, reporting, and synthesizing implementation projects. Implementation Science 15, 84
Solymosi, R., Cella, K. & Newton, A (2018). Did they report it to stop it? A realist evaluation of the effect of an advertising campaign on victims’ willingness to report unwanted sexual behaviour. Security Journal 31, 570–590.
Taylor-Dunn H. (2016). The impact of victim advocacy on the prosecution of domestic violence offences: Lessons from a Realistic Evaluation. Criminology & Criminal Justice. 16(1): 21–39.
Tompson, L. Belur, J., Thornton, A., Bowers, K.J., Johnson, S.D., Sidebottom, A., Tilley, N. & Laycock, G. (2020). How Strong is the Evidence-Base for Crime Reduction Professionals? Justice Evaluation Journal. 4:1, 68–97
Weiss C (1997). How Can Theory-Based Evaluation Make Greater Headway? Evaluation Review. 21(4): 501–524.
Wiebe, D. (2021). How can paths be risky. Paper Presented to International Seminar Series: Risky Places for Crime. [Available online]. https://play.kth.se/media/Risky+PlacesA+How+paths+can+be+risky.+Professor,+Douglas+Wiebe./0_21glhmqe Last accessed 8th May 2021.
Zelle, R. Rieke, C. Plappert, C. Krauß, D. Levshun and A. Chechulin, (2020). SEPAD—Security Evaluation Platform for Autonomous Driving, 28th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), pp. 413–420.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Newton, A. (2022). Realistic Evaluation and the 5Is: A Systematic Approach for Evaluating Security Interventions. In: Gill, M. (eds) The Handbook of Security. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-91735-7_24
Download citation
DOI: https://doi.org/10.1007/978-3-030-91735-7_24
Published:
Publisher Name: Palgrave Macmillan, Cham
Print ISBN: 978-3-030-91734-0
Online ISBN: 978-3-030-91735-7
eBook Packages: Law and CriminologyLaw and Criminology (R0)