Evaluating research co-production: protocol for the Research Quality Plus for Co-Production (RQ+ 4 Co-Pro) framework
Tóm tắt
Research co-production is an umbrella term used to describe research users and researchers working together to generate knowledge. Research co-production is used to create knowledge that is relevant to current challenges and to increase uptake of that knowledge into practice, programs, products, and/or policy. Yet, rigorous theories and methods to assess the quality of co-production are limited. Here we describe a framework for assessing the quality of research co-production—Research Quality Plus for Co-Production (RQ+ 4 Co-Pro)—and outline our field test of this approach. Using a co-production approach, we aim to field test the relevance and utility of the RQ+ 4 Co-Pro framework. To do so, we will recruit participants who have led research co-production projects from the international Integrated Knowledge Translation Research Network. We aim to sample 16 to 20 co-production project leads, assign these participants to dyadic groups (8 to 10 dyads), train each participant in the RQ+ 4 Co-Pro framework using deliberative workshops and oversee a simulation assessment exercise using RQ+ 4 Co-Pro within dyadic groups. To study this experience, we use a qualitative design to collect participant demographic information and project demographic information and will use in-depth semi-structured interviews to collect data related to the experience each participant has using the RQ+ 4 Co-Pro framework. This study will yield knowledge about a new way to assess research co-production. Specifically, it will address the relevance and utility of using RQ+ 4 Co-Pro, a framework that includes context as an inseparable component of research, identifies dimensions of quality matched to the aims of co-production, and applies a systematic and transferable evaluative method for reaching conclusions. This is a needed area of innovation for research co-production to reach its full potential. The findings may benefit co-producers interested in understanding the quality of their work, but also other stewards of research co-production. Accordingly, we undertake this study as a co-production team representing multiple perspectives from across the research enterprise, such as funders, journal editors, university administrators, and government and health organization leaders.
Tài liệu tham khảo
Lavery JV. Building an evidence base for stakeholder engagement. Science. 2018;6361(6402):554–5.
Eccles MP, Mittman BS. Welcome to implementation science. Implement Sci. 2006;1(1):1. https://doi.org/10.1186/1748-5908-1-1.
Barwick M, Dubrowski R, Petricca K. Knowledge Translation: The Rise of Implementation.; 2020. https://ktdrr.org/products/kt-implementation/KT-Implementation-508.pdf
Davis R, D’Lima D. Building capacity in dissemination and implementation science: a systematic review of the academic literature on teaching and training initiatives. Implement Sci. 2020;15(1). https://doi.org/10.1186/s13012-020-01051-6.
Harries S. Bridging policy and delivery with knowledge: the case for intervention. In: Records Management and Knowledge Mobilisation. Oxford: Elsevier; 2012. p. 145–68. https://doi.org/10.1016/b978-1-84334-653-1.50007-x.
Ivankova NV, Creswell JW, Stick SL. Using mixed-methods sequential explanatory design: from theory to practice. Field Methods. 2006;18(1):3–20. https://doi.org/10.1177/1525822X05282260.
Duncan s, Oliver s. Editorial: motivations for engagement. Sci All. 2017;1(2). https://doi.org/10.18546/RFA.01.2.01.
Canadian Institutes of Health Research. Evaluation of CIHR’s knowledge translation funding program. Ottawa: CIHR; 2013. [online]. Available at: https://cihr-irsc.gc.ca/e/47332.html [Accessed 30 Aug 2021]
McLean R, Gargani J. Scaling impact: innovation for the public good. London, New York and Ottawa: Routledge and International Development Research Centre; 2019. Available at: https://www.idrc.ca/en/book/scaling-impact-innovation-public-good [Accessed 30 Aug. 2021]
Mancuso A, Malm SA, Sharkey A, Shahabuddin ASM, Shroff ZC. Cross-cutting lessons from the decision-maker led implementation research initiative. Health Res Policy Sys. 2021;10(Suppl 2):83. https://doi.org/10.1186/s12961-021-00706-0.
Drahota A, Meza RD, Brikho B, Naaf M, Estabillo JA, Gomez ED, et al. Community-academic partnerships: a systematic review of the state of the literature and recommendations for future research. Milbank Q. 2016. https://doi.org/10.1111/1468-0009.12184.
Jull J, Giles A, Graham ID. Community-based participatory research and integrated knowledge translation: advancing the co-creation of knowledge. Implement Sci. 2017;12:150. https://doi.org/10.1186/s13012-017-0696-3.
Greenhalgh T, Hinton L, Finlay T, Macfarlane A, Fahy N, Clyde B, et al. Frameworks for supporting patient and public involvement in research: systematic review and co-design pilot. Health Expect. 2019;22(4):785–801.
Gagliardi AR, Berta W, Kothari A, et al. Integrated knowledge translation (IKT) in health care: a scoping review. Implement Sci. 2015;11:38. https://doi.org/10.1186/s13012-016-0399-1.
Kothari A, Mccutcheon C, Graham ID. Defining integrated knowledge translation and moving forward: a response to recent commentaries. Int J Health Policy Manag. 2017;6(5):299–300. https://doi.org/10.15171/ijhpm.2017.15.
Graham I, Tetroe J, Pearson A. Turning knowledge into action: practical guidance on how to do integrated knowledge translation, vol. 21. Adelaide: Lippincott-Joanna Briggs Institute Synthesis Science in Healthcare Series; 2014.
Nguyen T, Graham ID, Mrklas KJ, Bowen S, Cargo M, Estabrooks CA, et al. How does integrated knowledge translation (IKT) compare to other collaborative research approaches to generating and translating knowledge? Learning from experts in the field. Health Res Policy Syst. 2020;18:35. https://doi.org/10.1186/s12961-020-0539-6.
Jason LA, Keys CB, Suarez-Balcazar Y, Taylor RR, Davis MI. Participatory community research: theories and methods in action. Washington D.C.: American Psychological Association; 2004. https://doi.org/10.1037/10726-000.
Integrated Knowledge Translation Research Network site. https://iktrn.ohri.ca/aboutus/what-is-ikt/. Accessed 30 Aug 2021.
Beaulieu M, Breton M, Brousselle A. Conceptualizing 20 years of engaged scholarship: a scoping review. PLoS One. 2018;13(2). https://doi.org/10.1371/journal.pone.0193201.
Gibbons M, Limoges C, Nowotny H, Schwartzman S, Scott P, Trow M. The new production of knowledge: the dynamics of science and research in contemporary societies. London: Sage Publications; 1994.
Mitchell AS. Mode-2 knowledge production within community-based sustainability projects: applying textual and thematic analytics to action research conversations. Adm Sci. 2020. https://doi.org/10.3390/admsci10040090.
Noel L, Phillips F, Tossas-Milligan K, Spear K, Vanderford NL, Winn RA, et al. Community-academic partnerships: approaches to engagement. Am Soc Clin Oncol. 2019. https://doi.org/10.1200/EDBK_246229.
Graham ID, Rycroft-Malone J, Kothari A, McCutcheon C. Research Coproduction in Healthcare. 2022. Hoboken: Wiley.
McLean RKD, Graham ID, Carden F. Evaluating Research Coproduction. In Graham ID, Rycroft-Malone J, Kothari A, Mccutcheon C. Research Coproduction in Healthcare. 2022. Hoboken: Wiley.
McLean RKD, Graham ID, Bosompra K, Choudhry Y, Coen SE, MacLeod M, et al. Understanding the performance and impact of public knowledge translation funding interventions: Protocol for an evaluation of Canadian Institutes of Health Research knowledge translation funding programs. Implement Sci. 2012;7:57. https://doi.org/10.1186/1748-5908-7-57.
Russell J, Fudge N, Greenhalgh T. The impact of public involvement in health research: what are we measuring? Why are we measuring it? Should we stop measuring it? Res Involv Engage. 2020;6(1).
Greenhalgh T, Fahy N. Research impact in the community-based health sciences: an analysis of 162 case studies from the 2014 UK Research Excellence Framework. BMC Med. 2015;13:232. https://doi.org/10.1186/s12916-015-0467-4.
McLean R, Ofir Z, Etherington E, Acevedo M, Feinstein O. Research Quality Plus (RQ+): evaluating research differently. Ottawa: International Development Research Centre; 2022. Available at https://www.idrc.ca/en/rqplus.
Lebel J, McLean RKD. A better measure of research from the Global South. Nature. 2018;559(7712):23–6. https://doi.org/10.1038/d41586-018-05581-4.
Kreindler SA. Advancing the evaluation of integrated knowledge translation. Health Res Policy Syst. 2018;16(1).
Ward M, Schulz AJ, Israel BA, Rice K, Martenies SE, Markarian E. A conceptual framework for evaluating health equity promotion within community-based participatory research partnerships. Eval Program Plann. 2018;70:25–34.
Beckett K, Farr M, Kothari A, Wye L, Le May A. Embracing complexity and uncertainty to create impact: exploring the processes and transformative potential of co-produced research through development of a social impact model. Health Res Policy Syst. 2018;16(1).
Boivin A, L’Espérance A, Gauvin F-P, Dumez V, Macaulay AC, Lehoux P, et al. Patient and public engagement in research and health system decision making: a systematic review of evaluation tools. Health Expect. 2018b;21(6).
Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.
Phillippi J, Lauderdale J. A guide to field notes for qualitative research: context and conversation. Qual Health Res. 2017. https://doi.org/10.1177/1049732317697182.
Guest G, Bunce A, Johnson L. How many interviews are enough?: an experiment with data saturation and variability. Field Methods. 2006;18(1):59–82. https://doi.org/10.1177/1525822X05279903.
Morgan DL, Ataie J, Carder P, Hoffman K. Introducing dyadic interviews as a method for collecting qualitative data. Qual Health Res. 2013;23(9):1276–84. https://doi.org/10.1177/1049732313501889.
Nowell LS, Norris JM, White DE, Moules NJ. Thematic analysis: striving to meet the trustworthiness criteria. Int J Qual Methods. 2017;16(1):1609406917733847. https://doi.org/10.1177/1609406917733847.