How hard can it be to include research evidence and evaluation in local health policy implementation? Results from a mixed methods study
Tóm tắt
Although an evidence-based approach is the ideal model for planning and delivering healthcare, barriers exist to using research evidence to implement and evaluate service change. This paper aims to inform policy implementation and evaluation by understanding the role of research evidence at the local level through implementation of a national chronic conditions management policy. We conducted a national email survey of health service commissioners at the most devolved level of decision-making in Wales (Local Health Boards – LHBs) followed by in-depth interviews with representatives of LHBs, purposively selecting five to reflect geographic and economic characteristics. Survey data were analysed descriptively; we used thematic analysis for interview data. All LHBs (n = 22) completed questionnaires. All reported they routinely assessed the research literature before implementing interventions, but free-text answers revealed wide variation in approach. Most commonly reported information sources included personal contacts, needs assessments, information or research databases. No consistent approach to evaluation was reported. Frequently reported challenges were: insufficient staff capacity (17/22); limited skills, cost, limited time, competing priorities (16/22); availability and quality of routine data (15/22). Respondents reported they would value central guidance on evaluation. Five interviews were held with managers from the five LHBs contacted. Service delivery decisions were informed by Welsh Government initiatives and priorities, budgets, perceived good practice, personal knowledge, and local needs, but did not include formal research evidence, they reported. Decision making was a collaborative process including clinical staff, patient representatives, and partner organization managers with varying levels of research experience. Robust evaluation data were required, but they were constrained by a lack of skills, time, and resources. They viewed evaluation as a means of demonstrating that targets had been met. There is a gap between evidence-based aims of national health policy and how health services are commissioned, implemented, and evaluated at local level. Commissioners and managers are unable to routinely incorporate research evidence. If health services research is to identify most effective ways to implement high quality care, it should be incorporated into commissioning and service delivery. Local commissioners and managers need to build the critical use of research evidence and evaluation into health policy implementation at local level in order to provide consistent and effective healthcare services.
Tài liệu tham khảo
Ham C, Hunter DJ, Robinson R: Evidence based policymaking. Br Med J. 1995, 310: 71-72. 10.1136/bmj.310.6972.71.
Bjorndal A: Improving social policy and practice: knowledge matters. Lancet. 2009, 373: 1829-1831. 10.1016/S0140-6736(09)60783-2.
Sibbald B, Walshe K: Research that is both rigorous and useful. J Health Serv Res Policy. 2010, 15 (Suppl 2): 1-2.
Muir Gray JA: Evidence based policy making. Br Med J. 2004, 329: 988-989. 10.1136/bmj.329.7473.988.
Black N: Evidence-based policy: proceed with care. Br Med J. 2001, 323: 275-278. 10.1136/bmj.323.7307.275.
Donald A: Commentary: research must be taken seriously. Br Med J. 2001, 323: 278-279.
Cooksey DA: A review of UK heath research funding. 2006, HMSO: London
Innvaer S: Health policy-makers' perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002, 7 (4): 239-244. 10.1258/135581902320432778.
Eccles MP: An implementation research agenda. Implement Sci. 2009, 4 (18):
Majeed FA: Equity in the NHS. Monitoring and promoting equity in primary and secondary care. Br Med J. 1994, 308 (6941): 1426-9. 10.1136/bmj.308.6941.1426.
Merino GA, Lema LV: Health technology assessment and health policy-making in Europe. Edited by: Garrido VM. 2008, World Health Organisation on behalf of the European Observatory on Health Systems and Policies
Hamilton S: Mind the gap between policy imperatives and service provision: a qualitative study of the process of respiratory service development in England and Wales. BMC Heal Serv Res. 2008, 8 (248):
Glasby J, Beresford P: Who knows best? Evidence-based practice and the service user contribution. Critical Social Policy. 2006, 26: 268-284. 10.1177/0261018306059775.
Petticrew M, Roberts H: Evidence, hierarchies and typologies: horses for courses. JECH. 2003, 57 (7): 527-529.
Sheldon TA: Making evidence synthesis more useful for management and policy-making. J Health Serv Res Policy. 2005, 10 (Suppl): S1:1-S1:4.
MacFarlane A: The e-health implementation toolkit: qualitative evaluation across four European countries. Implement Sci. 2011, 6 (122):
El-Jardali F: Use of health systems and policy research in the health policymaking in eastern Mediterranean countries: views and practices of researchers. Implement Sci. 2012, 7 (2):
Pearce C, Hall S, Phillips C: When policy meets the personal: general practice nurses in australia. J Health Serv Res Policy. 2010, 15 (Suppl 2): 26-34.
Forsetlund L, Bjorndal A: The potential for research-based information in public health: identifying unrecognised information needs. BMC Publ Health. 2001, 1:
Ross S: Partnership experiences: involving decision-makers in the research process. J Health Serv Res Policy. 2003, 8 (Suppl 2): p. S2:26-34.
Lourenco T: Local decision-makers views' of national guidance on interventional procedures in the UK. J Health Serv Res Policy. 2010, 15: 3-10.
Muir Gray JA, Porter T: Opportunity value. J Health Serv Res Policy. 2009, 14 (3): p 129-130.
Klein R: Evidence and policy: interpreting the delphin oracle. J Royal Soc Med. 2003, 96: 429-431. 10.1258/jrsm.96.9.429.
World Health Organisation: Global health risks: mortality and burden of disease attributable to selected major risks. 2009, Geneva: World Health Organisation
Welsh Assembly Government: A profile of long-term and chronic conditions in Wales. 2006, Cardiff: Welsh Assembly Government
Welsh Assembly Government: Improving health and the management of chronic conditions in Wales: an integrated model and framework for action. 2007, Cardiff: Welsh Assembly Government
Welsh Assembly Government: Designed to improve health and the management of chronic conditions in Wales: service improvement plan 2008–2011. 2008, Cardiff: Welsh Assembly Government
HSR-Europe: Health service research: helping tackle Europe's health care challenges. 2011, Utrecht: HSR-Europe
Robson C: Real world research. 1993, Oxford: Blackwell
Bryman A: Social research methods. 2001, Oxford, UK: OUP
Silverman D: Doing qualitative research. 2010, London, UK: Sage Publications Ltd, 3rd
Ritchie J, Spencer L: Qualitative data analysis for applied policy research. The qualitative researcher's companion. Edited by: Huberman AM. 2002, Thousand Oaks, California: Sage Publications
Srivastava A, Thomson SB: Framework analysis: a qualitative methodology for applied policy research. JOAAG. 2009, 4 (2): 72-79.
Arney FM: Integrating strategies for delivering evidence-informed practice. Evidence & Policy. 2009, 5 (2): 179-191. 10.1332/174426409X437928.
Bayliss HR: Does research information meet the needs of stakeholders? exploring evidence selection in the global management of invasive species. Evidence & Policy. 2012, 8 (1): 37-56. 10.1332/174426412X620128.
Meyer M: The rise of the knowledge broker. Sci Commun. 2010, 32: 118-127. 10.1177/1075547009359797.
Macintyre S: Using evidence to inform health policy: case study. Br Med J. 2001, 322: 222-5. 10.1136/bmj.322.7280.222.
Ward V: Planning for knowledge translation: a researcher's guide. Evidence & Policy. 2010, 6 (4): 527-541. 10.1332/174426410X535882.
Gough D, Boaz A: Complexities of making use of research. Evidence & Policy. 2011, 7 (3): 247-249. 10.1332/174426411X591717.
Lomas J: Using ‘linkage and Exchange’ to move research into policy at a Canadian foundation. Health Aff. 2000, 19 (3): p 236-240.
Lavis JN: How Can research organizations more effectively transfer research knowledge to decision makers?. The Millbank Quarterly. 2003, 81 (2): 221-248. 10.1111/1468-0009.t01-1-00052.
Moore G: What works to increase the use of research in population health policy and programmes: a review. Evidence & Policy. 2011, 7 (3): 277-305. 10.1332/174426411X579199.
Gold M: Pathways to the use of health services research in policy. Health Serv Res Policy. 2009, 44 (4): 1111-1136. 10.1111/j.1475-6773.2009.00958.x.
Greenhalgh T: Chronic illness: beyond the expert patient. Br Med J. 2009, 338: 629-631.
McDonnell A, Wilson R, Goodacre S: Evaluating and implementing new services British medical journal 332, 109–112. Br Med J. 2006, 332: 109-112. 10.1136/bmj.332.7533.109.
Appleby J: Variations in healthcare: the good, the bad and the inexplicable. 2011, Kings Fund: London
Porter A: Equity and service innovation: the implementation of a bibliotherapy scheme in Wales. J Health Serv Res Policy. 2008, 13 (Suppl 2): 26-31.
Richards DA: Delivering stepped care: an analysis of implementation in routine practice. Implement Sci. 2012, 7 (3):
Agency for healthcare research and quality.http://archive.ahrq.gov/about/whatis.htm,