The dark side of coproduction: do the costs outweigh the benefits for health research?
Tóm tắt
Coproduction, a collaborative model of research that includes stakeholders in the research process, has been widely advocated as a means of facilitating research use and impact. We summarise the arguments in favour of coproduction, the different approaches to establishing coproductive work and their costs, and offer some advice as to when and how to consider coproduction. Despite the multiplicity of reasons and incentives to coproduce, there is little consensus about what coproduction is, why we do it, what effects we are trying to achieve, or the best coproduction techniques to achieve policy, practice or population health change. Furthermore, coproduction is not free risk or cost. Tensions can arise throughout coproduced research processes between the different interests involved. We identify five types of costs associated with coproduced research affecting the research itself, the research process, professional risks for researchers and stakeholders, personal risks for researchers and stakeholders, and risks to the wider cause of scholarship. Yet, these costs are rarely referred to in the literature, which generally calls for greater inclusion of stakeholders in research processes, focusing exclusively on potential positives. There are few tools to help researchers avoid or alleviate risks to themselves and their stakeholders. First, we recommend identifying specific motivations for coproduction and clarifying exactly which outcomes are required for whom for any particular piece of research. Second, we suggest selecting strategies specifically designed to enable these outcomes to be achieved, and properly evaluated. Finally, in the absence of strong evidence about the impact and process of coproduction, we advise a cautious approach to coproduction. This would involve conscious and reflective research practice, evaluation of how coproduced research practices change outcomes, and exploration of the costs and benefits of coproduction. We propose some preliminary advice to help decide when coproduction is likely to be more or less useful.
Tài liệu tham khảo
Traynor R, DeCorby K, Dobbins M. Knowledge brokering in public health: a tale of two studies. Public Health. 2014;128(6):533–44.
Connelly S, Vanderhoven D. Translation across borders: exploring the use, relevance and impact of Academic Research in the Policy Process: Policy Press; 2015. p. 181–98.
Lane JP, Rogers JD. Engaging national organizations for knowledge translation: comparative case studies in knowledge value mapping. Implement Sci. 2011;6(1):106.
Boaz A, Baeza J, Fraser A. Effective implementation of research into practice: an overview of systematic reviews of the health literature. BMC Research Notes. 2011;4:212.
Cairney P. The Politics of Evidence-Based Policy Making. London: Palgrave Macmillan UK; 2015.
Oliver K, Lorenc T, Innvær S. New directions in evidence-based policy research: a critical analysis of the literature. Health Res Policy Syst. 2014;12(1):34.
Fre Z. Knowledge Sovereignty among African Cattle Herders. London: UCL Press; 2018.
Elliott H, Popay J. How are policy makers using evidence? Models of research utilisation and local NHS policy making. J Epidemiol Community Health. 2000;54(6):461–8.
Russ LW, Takahashi LM, Ho W, Tseng W, Ponce NA. Bridging academic-legislative divides: models of policy-relevant health research and practice by the university of california. Prog Community Heal Partnerships Res Educ Action. 2012;6(1):95–102.
Wieringa S, Greenhalgh T. 10 years of mindlines: a systematic review and commentary. Implement Sci. 2015;10:45.
Greenhalgh T. Narrative based medicine: narrative based medicine in an evidence based world. BMJ. 1999;318(7179):323–5.
Oliver S, Duncan S. Editorial: The challenges of sharing different ways of knowing. Res All. 2018;2(1):1–5.
Langley J, Wolstenholme D, Cooke J. ‘Collective making’ as knowledge mobilisation: the contribution of participatory design in the co-creation of knowledge in healthcare. BMC Health Serv Res. 2018;18(1):585.
Sabine M, Peter W, Maasen S, Weingart P. Democratization of Expertise? - Exploring novel forms of scientific advice in political decision-making: Springer; 2005. p. 238.
Carrozza C. Democratizing Expertise and Environmental Governance: Different Approaches to the Politics of Science and their Relevance for Policy Analysis. J Environ Policy Plan. 2015;17(1):108–26.
Stewart R. Terminology and tensions within evidence- informed decision-making in South Africa over a 15-year period. Res All. 2017;1(2):252–64.
Oliver K, Cairney P. The dos and don’ts of influencing policy: a systematic review of advice to academics. Palgrave Commun. 2019;5(1):21.
Durose C, Mangan C, Needham C, Rees J, Hilton M. Transforming local public services through co-production. Swindon: Arts and Humanities Research Council; 2013.
Filipe A, Renedo A, Marston C. The co-production of what? Knowledge, values, and social relations in health care. PLoS Biol. 2017;15(5):e2001403.
Traynor R, Dobbins M, DeCorby K. Challenges of partnership research: insights from a collaborative partnership in evidence-informed public health decision making. Evid Policy A J Res Debate Pract. 2015;11(1):99–109.
Shippee ND, Domecq Garces JP, Prutsky Lopez GJ, Wang Z, Elraiyah TA, Nabhan M, et al. Patient and service user engagement in research: A systematic review and synthesized framework. Health Expect. 2015;18(5):1151–66.
Boivin A, L’Espérance A, Gauvin F-P, Dumez V, Macaulay AC, Lehoux P, et al. Patient and public engagement in research and health system decision making: A systematic review of evaluation tools. Heal Expect. 2018;21(6):1075–84.
Oliver S, Liabo K, Stewart R, Rees R. Public involvement in research: making sense of the diversity. J Health Serv Res Policy. 2015;20(1):45–51.
Barber R, Beresford P, Boote J, Cooper C, Faulkner A. Evaluating the impact of service user involvement on research: a prospective case study. Int J Consum Stud. 2011;35(6):609–15.
Fransman J. Charting a course to an emerging field of ‘research engagement studies’: A conceptual meta-synthesis. Res All. 2018;2(2):1–49.
Flinders M, Wood M, Cunningham M. The politics of co-production: risks, limits and pollution. Evid Policy A J Res Debate Pract. 2016;12(2):261–79.
Ostrom E. Crossing the great divide: coproduction, synergy, and development. World Dev. 1996;24(6):1073–87.
Durose C, Needham C, Mangan C, Rees J. Generating “good enough” evidence for co-production. Evid Policy. 2017;13:135–51.
Iedema R, Carroll K. The “clinalyst.”. J Organ Chang Manag. 2011;24(2):175–90.
Gagliardi A, Kothari A, Graham I, Gagliardi AR, Kothari A, Graham ID. Research agenda for integrated knowledge translation (IKT) in healthcare: What we know and do not yet know. J Epidemiol Community Health. 2017;71(2):105–6.
Duncan S, Oliver S. Editorial: Motivations for engagement. Res All. 2017;1(2):229–33.
Walter I, Nutley S, Davies H. Research impact: a cross sector literature review. St. Andrews: Research Unit for Research Utilisation, Department of Management University of St. Andrews; 2003.
Oliver K, Rees R, Brady LM, Kavanagh J, Oliver S, Thomas J. Broadening public participation in systematic reviews: a case example involving young people in two configurative reviews. Res Synth Methods. 2015;6(2):206–17.
Liabo K, Stewart R. Involvement in research without compromising research quality. J Health Serv Res Policy. 2012;17:248–51.
Goodyear-Smith F, Jackson C, Greenhalgh T. Co-design and implementation research: challenges and solutions for ethics committees. BMC Med Ethics. 2015;16:78.
Maybin J. How proximity and trust are key factors in getting research to feed into policymaking. LSE Impact Blog. 2016; http://blogs.lse.ac.uk/impactofsocialsciences/2016/09/12/how-proximity-and-trust-are-key-factors-in-getting-research-to-feed-into-policymaking/. Accessed 1 Aug 2018.
Nesta. Seven Principles for Public Engagement in Research and Innovation Policymaking: Nesta; 2018. https://www.nesta.org.uk/report/seven-principles-public-engagement-research-and-innovation-policymaking/. Accessed 15 Dec 2018.
Rycroft-Malone J, Burton C, Wilkinson J, Harvey G, McCormack B, Baker R. Collective action for knowledge mobilisation: a realist evaluation of the Collaborations for Leadership in Applied Health Research and Care. Health Services Delivery Research. Southampton: NIHR Journals Library; 2015.
Ghate D. Developing theories of change for social programmes: co-producing evidence-supported quality improvement. Palgrave Commun. 2018;4(1):90.
Dobbins M, Robeson P, Ciliska D, Hanna S, Cameron R, O’Mara L, et al. A description of a knowledge broker role implemented as part of a randomized controlled trial evaluating three knowledge translation strategies. Implement Sci. 2009;4:23.
Armstrong R, Waters E, Roberts H, Oliver S, Popay J. The role and theoretical evolution of knowledge translation and exchange in public health. J Public Health. 2006;28:384–9.
Bowen S, Martens P. Demystifying knowledge translation: learning from the community. J Health Serv Res Policy. 2005;10(4):203–11.
Gagliardi A, Dobrow MJ. Identifying the conditions needed for integrated knowledge translation (IKT) in health care organizations: qualitative interviews with researchers and research users. BMC Health Serv Res. 2016;16:256.
Conklin A, Morris Z, Nolte E. What is the evidence base for public involvement in health-care policy?: Results of a systematic scoping review. Health Expect. 2015;18(2):153–65.
Doubleday RRR, Wynne B. Despotism and Democracy in the United Kingdom. In: Jasanoff S, Caplan A, editors. Reframing Rights: Bioconstitutionalism in the Genetic Age; 2011. p. 239–61.
Gluckman P. The art of science advice to the government. Nature. 2014;507:163–5.
Sutherland WJ, Burgman MA. Policy advice: use experts wisely. Nature. 2015;526:317–8.
Muir Gray JA. Evidence based policy making. BMJ. 2004;329(7473):988–9.
Beresford P. Developing the Theoretical Basis for Service User/Survivor-Led Research. Epidemiol Psychiatr Sci. 2005;14(1):4–9.
Kothari A, McCutcheon C, Graham I. Defining integrated knowledge translation and moving forward: a response to recent commentaries. Int J Heal Policy Manag. 2017;6(x):1–2.
Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014;14(1):–2.
Boaz A, Hanney S, Borst R, O’Shea A, Kok M. How to engage stakeholders in research: design principles to support improvement. Health Res Policy Syst. 2018;16(1):60.
Cash DW, Clark WC, Alcock F, Dickson NM, Eckley N, Guston DH, et al. Knowledge systems for sustainable development. Proc Natl Acad Sci U S A. 2003;100(14):8086–91.
Di Giulio A, Defila R. Lessons from “Real-world Laboratories” about Transdisciplinary Projects, Transformative Research and Participation. https://i2insights.org/2018/03/22/lessons-from-real-world-laboratories/. Accessed 15 Dec 2018.
Iedema R, Merrick E, Piper D, Britton K, Gray J, Verma R, et al. Codesigning as a discursive practice in emergency health services: the architecture of deliberation. J Appl Behav Sci. 2010;46(1):73–91.
Martin S. Co-production of social research: strategies for engaged scholarship. Public Money Manag. 2010;30(4):211–8.
Oliver K, Faul MV. Networks and network analysis in evidence, policy and practice. Evid Policy. 2018;14(3):369–79.
Rycroft-Malone J, Seers K, Chandler J, Hawkes CA, Crichton N, Allen C, et al. The role of evidence, context, and facilitation in an implementation trial: Implications for the development of the PARIHS framework. Implement Sci. 2013;8(1):28.
Kislov R, Wilson PM, Knowles S, Boaden R. Learning from the emergence of NIHR Collaborations for Leadership in Applied Health Research and Care (CLAHRCs): a systematic review of evaluations. Implement Sci. 2018;13(1):111.
Oborn E, Barrett M, Prince K, Racko G. Balancing exploration and exploitation in transferring research into practice: A comparison of five knowledge translation entity archetypes. Implement Sci. 2013;8(1):104.
Rushmer R, Shucksmith J. AskFuse origins: system barriers to providing the research that public health practice and policy partners say they need. Evid Policy. 2018;14(1):81–101.
Canadian Institutes of Health Reseacrh. Evaluation of the Strategy for Patient-Oriented Research. http://www.cihr-irsc.gc.ca/e/49937.html. Accessed 18 Mar 2019
Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, et al. A systematic review of the impact of patient and public involvement on service users, researchers and communities. Patient. 2014;7(4):387–95.
Watermeyer R. Challenges for university engagement in the UK: towards a public academe? High Educ Q. 2011;65(4):386–410.
Camden C, Shikako-Thomas K, Nguyen T, Al E. Engaging stakeholders in rehabilitation research: a scoping review of strategies used in partnerships and evaluation of impacts. Disabil Rehabil. 2015;37(15):1390–400.
Gagliardi A, Berta W, Kothari A, Boyko J, Urquhart R. Integrated knowledge translation (IKT) in health care: a scoping review. Implement Sci. 2016;11:38.
Graffy EA. Enhancing policy-relevance without burning up or burning out: A strategy for scientists. In: Science into Policy: Water in the Public Realm: Proceedings, Specialty Conference, June 30-July 2, 1999, Bozeman, Montana. Herndon: American Water Resources Association; 1999. p. 293–8.
Behrens TR, Gray DO. Unintended consequences of cooperative research: impact of industry sponsorship on climate for academic freedom and other graduate student outcome. Res Policy. 2001;30(2):179–99.
Lidskog R, Sundqvist G. From consensus to credibility: new challenges for policy-relevant science. Innovation. 2004;17(3):205–26.
Himmrich J. How should academics interact with policy makers? Lessons on building a long-term advocacy strategy. LSE Impact Blog. 2016; http://blogs.lse.ac.uk/impactofsocialsciences/2016/06/20/how-should-academics-interact-with-policy-makers-lessons-on-building-a-longterm-advocacy-strategy/. Accessed 10 Jul 2018.
Zevallos Z. Protecting Activist Academics Against Public Harassment. Other Sociologist. 2017; https://othersociologist.com/2017/07/06/activist-academics-public-harassment/. Accessed 18 Mar 2019.
Davey Smith G, Ebrahim S, Frankel S. How policy informs the evidence. BMJ. 2001;322(7280):184–5.
Maynard A. Is public engagement really career limiting? Times High Education. 2015; https://www.timeshighereducation.com/blog/public-engagement-really-career-limiting. Accessed 18 Mar 2019.
Kothari Uma. “Power, Knowledge and Social Control in Participatory Development”. In: Bill Cooke and Uma Kothari. Participation: The New Tyranny? London: Zed Books; 2001. pp. 142-143
Spano R. Potential sources of observer bias in police observational data. Soc Sci Res. 2005;34(3):591–617.
Kanuha VK. “Being” native versus “going native”: conducting social work research as an insider. Soc Work. 2000;45(5):439–47.
Bell C, Encel S. Inside the Whale: Ten Personal Accounts of Social Research. Oxford: Pergamon Press; 1978.
Aarts N, Leeuwis C. Participation and power: reflections on the role of government in land use planning and rural development. J Agric Educ Ext. 2010;16(2):131–45.
Cooke B, Kothari U. Participation: The New Tyranny? London: Zed Books; 2001.
Gluckman P. Policy: the art of science advice to government. Nature. 2014;507(7491):163–5.
DuMont K. Reframing Evidence-Based Policy to Align with the Evidence: William T. Grant Foundation; 2019. http://wtgrantfoundation.org/digest/reframing-evidence-based-policy-to-align-with-the-evidence. Accessed 28 Jan 2019.
Prainsack B. The “we” in the “me”: solidarity and health care in the era of personalized medicine. Sci Technol Hum Values. 2018;43(1):21–44.
Callard F, Rose D, Wykes T. Close to the bench as well as at the bedside: involving service users in all phases of translational research. Health Expect. 2012;15(4):389–400.
Callard F, Fitzgerald D. Rethinking Interdisciplinarity Across the Social Sciences and Neurosciences. Wellcome Trust–Funded Monographs and Book Chapters. Basingstoke: Palgrave Macmillan; 2015.