A Qualitative Study into the Success and Challenges in Embedding Evidence-Based Research Methods in Operational Policing Interventions

Authors: Ahmed Kadry, Gwyn Dodd

Abstract:

There has been a growing call globally for police forces to embed evidence-based policing research methods into police interventions in order to better understand and evaluate their impact. This research study highlights the success and challenges that police forces may encounter when trying to embed evidence-based research methods within their organisation. Ten in-depth qualitative interviews were conducted with police officers and staff at Greater Manchester Police (GMP) who were tasked with integrating evidence-based research methods into their operational interventions. The findings of the study indicate that with adequate resources and individual expertise, evidence-based research methods can be applied to operational work, including the testing of initiatives with strict controls in order to fully evaluate the impact of an intervention. However, the findings also indicate that this may only be possible where an operational intervention is heavily resourced with police officers and staff who have a strong understanding of evidence-based policing research methods, attained for example through their own graduate studies. In addition, the findings reveal that ample planning time was needed to trial operational interventions that would require strict parameters for what would be tested and how it would be evaluated. In contrast, interviewees underscored that operational interventions with the need for a speedy implementation were less likely to have evidence-based research methods applied. The study contributes to the wider literature on evidence-based policing by providing considerations for police forces globally wishing to apply evidence-based research methods to more of their operational work in order to understand their impact. The study also provides considerations for academics who work closely with police forces in assisting them to embed evidence-based policing. This includes how academics can provide their expertise to police decision makers wanting to underpin their work through evidence-based research methods, such as providing guidance on how to evaluate the impact of their work with varying research methods that they may otherwise be unaware of.

Keywords: evidence based policing, evidence-based practice, operational policing, organisational change

References:

[1] Adams, E. (2010). ‘The Joys and Challenges of Semi-structured Interviewing.’ Community Practitioner, 83 (7): 18-21.
[2] Bedford, L. and Mazerolle, L. (2014). ‘Beyond the Evidence: Organizational Learning from RCTs in Policing.’ Policing: A Journal of Policy and Practice, 8 (4): 402–416.
[3] Belur, J. and Johnson, S. (2016). ‘Is Crime Analysis at the Heart of Policing Practice? A Case Study’. Policing and Society, 1–19.
[4] Boulton, L., Phythian, R., Kirby, S. and Dawson, I. (2020). Taking an Evidence-Based Approach to Evidence-Based Policing Research.’ Policing: A Journal of Policy and Practice.
[5] Bowers, K., Tompson, L. and Johnson, S.D. (2014). ‘Implementing Information Science in Policing: Mapping the Evidence Base.’ Policing: A Journal of Policy and Practice, 8 (4): 1–14
[6] Braga, A. (2016). ‘The Value of “Pracademics” in Enhancing Crime Analysis in Police Departments’. Policing 10(3): 208–314.
[7] Braun, V. and Clarke, V. (2006). ‘Using Thematic Analysis in Psychology’. Qualitative Research in Psychology, 3 (2): 77-101.
[8] Brown, J., Belur, J., Tompson, L. et al. (2018). ‘Extending the Remit of Evidence-based Policing.’ International Journal of Police Science and Management, 20(1): 38–51.
[9] Bullock, K. and Tilley, N. (2009). ‘Evidence-Based Policing and Crime Reduction’, Policing: A Journal of Policy and Practice, 3 (4): 381–387.
[10] Chainey, S. (2012). ‘Improving the Explanatory Content of Analysis Products Using Hypothesis Testing’. Policing, 6(2): 108–121.
[11] Clough, G., Adams, A., and Halford, E. (2017). ‘Evidence cafe´s and practitioner cafe´s supported by online resources: a route to innovative training in practice based approaches.’ https://bulletin.cepol.europa.eu/index.php/bulletin/article/view/287 (Accessed 15th May 2021).
[12] College of Policing (2014). ‘Five Year Strategy.’ https://www.college.police.uk/About/Documents/Five-Year_Strategy.pdf (Accessed 20th May 2022).
[13] College of Policing (n.d.). ‘What is evidence-based policing’. https://whatworks.college.police.uk/About/Pages/What-is-EBP.aspx (Accessed 26th May 2022).
[14] Crawford, A. (2017). Research Co-production and Knowledge Mobilisation in Policing. In Knutsson, J. and Tompson, L. (eds), Advances in Evidence-Based Policing. Oxon: Routledge, pp. 195–213.
[15] Diefenbach, T. (2009). ‘Are case studies more than sophisticated storytelling? Methodological problems of qualitative empirical research mainly based on semi-structured interview.’ Quality and Quantity, vol 43, 875-894.
[16] Fleming, J. and Wingrove, J. (2017). ‘We would if we could . . . but not sure if we can: Implementing Evidence-Based Practice.’ Policing: A Journal of Policy and Practice, 11 (2): 202–213.
[17] Fleming, J. and Rhodes, R. (2018). ‘Can experience be evidence? Craft knowledge and evidence-based policing.’ Policy & Politics, vol 46, no 1, 3–26.
[18] Greater Manchester Police (2017). Evidence Based Policing Board Terms of Reference. Unpublished.
[19] Goldstein, H. (2003). ‘On Further Developing Problem - Oriented Policing.’ In Knutsson, J. (ed.), Problem-Oriented policing: From Innovation to Mainstream. Crime Prevention Studies, Vol. 15.
[20] Hartley, J. (2017). ‘Optimism of the will in the cocreation and use of research by academics and practitioners.’ Public Money & Management, 37 (4): 236-239.
[21] Hope, T. (2004). ‘Pretend it Works: Evidence and Governance in the Evaluation of the Reducing Burglary Initiative.’ Criminal Justice, 4(3): 287–308.
[22] Heaton, R. and Tong, S. (2015). ‘Evidence-Based Policing: From Effectiveness to Cost-Effectiveness.’ Policing: A Journal of Policy and Practice, 10 (1): 60–70.
[23] HMIC. (2000). ‘Report of Her Majesty’s Chief Inspector of Constabulary 2000/2001.’ https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/250982/hmcreport.pdf (Accessed 27th May 2022).
[24] Her Majesty’s Inspectorate of Constabulary and Fire and Rescue Service (2017). ‘PEEL: Police Effectiveness 2016 – Greater Manchester Police.’ https://www.justiceinspectorates.gov.uk/hmicfrs/publications/peel-police-effectiveness-2016-greater-manchester/ (Accessed 22nd May 2022).
[25] Her Majesty’s Inspectorate of Constabulary and Fire and Rescue Service. (2019). ‘The Poor Relation: The police and CPS response to crimes against older people.’ https://www.justiceinspectorates.gov.uk/hmicfrs (Accessed 26th May 2021).
[26] Hough, M. (2010). ‘Gold Standard or Fool’s Gold? The Pursuit of Certainty in Experimental Criminology.’ Criminology and Criminal Justice, 10 (1): 11–22.
[27] Huey, L. and Ricciardelli, R. J. (2016). ‘From Seeds to Orchards: Using Evidence-based Policing to Address Canada’s Policing Research Needs.’ Canadian Journal of Criminology and Criminal Justice 58(1): 119–132.
[28] Innes, M., Fielding, N., and Cope, N. (2005). ‘The Appliance of Science? The Theory and Practice of Criminal Intelligence Analysis’. The British Journal of Criminology, 45 (1): 39–57.
[29] Kadry, A (2019). ‘Practical considerations for implementing an evidence-based policing approach in police operations: a case study.’ Policing and Society, 31 (2): 148-160.
[30] Keay, S. and Kirby, S. (2018). ‘The Evolution of the Police Analyst and the Influence of Evidence-Based Policing.’ Policing: A Journal of Policy and Practice, 12 (3): 265–276.
[31] Lumsden, K. (2016). ‘Police Officer and Civilian Staff Receptivity to Research and Evidence-Based Policing in the UK: Providing a Contextual Understanding through Qualitative Interviews.’ Policing: A Journal of Policy and Practice, 11 (2): 157–167.
[32] Moore, M. H. (2006). ‘Improving police through expertise, experience, and experiments.’ in D., Weisburd and A. A., Braga (eds) Police Innovation: Contrasting Perspectives. Cambridge: Cambridge University Press, 332–338.
[33] Morgan, J. (1991). ‘Safer Communities: The local delivery of crime prevention through the partnership approach.’ London: Home Office.
[34] Myhill, A. and Quinton, P. (2010). ‘Confidence, Neighbourhood Policing, and Contact: Drawing Together the Evidence.’ Policing: A Journal of Policy and Practice, 4 (3): 273–281.
[35] National Police Chief’s Council (2015). ‘Policing Vision 2025’. Policing Vision.pdf (npcc.police.uk) (Accessed 25th May 2022).
[36] N8 Research Partnership. (2017). ‘Innovating by Collaborating: Forward Strategy 2017 – 2020.’ https://www.n8research.org.uk/view/7134/Strategy-2017.pdf (Accessed 17th May 2022).
[37] Pearce, W. and Raman, S. (2014). ‘The new randomised trials (RCT) movement in public policy: Challenges of epistemic governance.’ Policy Sciences, vol 47, pp 387–402.
[38] Smith, Justin J, Santos, Rachel B and Santos, Roberto G (2018). ‘Evidence-Based Policing and the Stratified Integration of Crime Analysis in Police Agencies: National Survey Results’, Policing: A Journal of Policy and Practice. Oxford University Press, 12(3), pp. 303–315.
[39] Snilstveit, B., Vojtkova, M., Bhavsar, A., Stevenson, J., and Gaarder, M. (2016). ‘Evidence and Gap Maps: A Tool for Promoting Evidence Informed Policy and Strategic Research Agendas.’ Journal of Clinical Epidemiology, 79: 120–129.
[40] Sherman, L. W. (1998). ‘Evidence-Based Policing’, Ideas in American Policing Series. Washington, DC: The Police Foundation.
[41] Veigas, H. and Lum, C. (2013). ‘Assessing the Evidence Base of a Police Service Patrol Portfolio.’ Policing: A Journal of Policy and Practice, 7 (3): 248–262.
[42] Watkinson-Miley, C.; Cox, C. and Deshpande, M. (2022). ‘A New Generation of Police Officers: Experiences of Student Officers Undertaking the Police Constable Degree Apprenticeship in One UK Police Force’. Policing: A Journal of Policy and Practice, 16 (1): 122–134.
[43] Weisburd, D. and Neyroud, P. (2011). ‘Police Science: Toward a New Paradigm.’ Journal of Current Issues in Crime, Issues, and Law Enforcement, 7 (2): 227-246.