Linking transdisciplinary research characteristics and quality to effectiveness: A comparative analysis of five research-for-development projects

Abson, 2017, Leverage points for sustainability transformation, Ambio, 46, 30, 10.1007/s13280-016-0800-y Belcher, 2019 Belcher, 2016, Defining and assessing research quality in a transdisciplinary context, Res. Eval., 25, 1, 10.1093/reseval/rvv025 Belcher, 2018, Outcomes and impacts of development interventions: toward conceptual clarity, Am. J. Eval., 39, 478, 10.1177/1098214018765698 Belcher, 2017, Evaluating policy-relevant research: lessons from a series of theory-based outcomes assessments, Palgrave Commun., 3, 1, 10.1057/palcomms.2017.17 Bergmann, 2012 Blackstock, 2007, Developing and applying a framework to evaluate participatory research for sustainability, Ecol. Econ., 60, 726, 10.1016/j.ecolecon.2006.05.014 Boaz, 2009, Assessing the impact of research on policy: a literature review, Sci. Public Policy, 36, 255, 10.3152/030234209X436545 Bornmann, 2013, What is societal impact of research and how can it be assessed? A literature survey, J. Am. Soc. Inf. Sci., 64, 217, 10.1002/asi.22803 Brandt, 2013, A review of transdisciplinary research in sustainability science, Ecol. Econ., 92, 1, 10.1016/j.ecolecon.2013.04.008 Burkhardt-Holm, 2018, Fischnetz: assessing outcomes and impacts of a project at the interface of science and public policy, Environ. Sci. Policy, 82, 52, 10.1016/j.envsci.2018.01.010 Carew, 2010, The TD Wheel: a heuristic to shape, support and evaluate transdisciplinary research, Futures, 42, 1146, 10.1016/j.futures.2010.04.025 Cash, 2002, Salience , credibility, legitimacy and boundaries: linking research assessment and decision making CGIAR, 2016 CGIAR, 2017 CIFOR, 2019 CIFOR, 2019 CIFOR, 2019 Clark, 2003, Sustainability science: the emerging research program, Proc. Natl. Acad. Sci. U. S. A., 100, 8086, 10.1073/pnas.1231333100 Cook, 2018, Accessing participatory research impact and legacy: developing the evidence base for participatory approaches in health research, Educ. Action Res., 24, 473, 10.1080/09650792.2017.1326964 Court, 2005, Policy entrepreneurship for poverty reduction: bridging research and policy in international development, J. Int. Dev., 17, 713, 10.1002/jid.1234 Donovan, 2011, The “Payback Framework” explained, Res. Eval., 20, 181, 10.3152/095820211X13118583635756 Earl, 2001 ESRC, 2009 Flint, 2019, Socio-scientific research and practice: evaluating outcomes from a transdisciplinary urban water systems project, Socio-Ecol. Pract. Res., 1, 55, 10.1007/s42532-019-00007-5 FTA, 2019 Funtowicz, 1993, Science for the post-normal age, Futures, 25, 739, 10.1016/0016-3287(93)90022-L Gaziulusoy, 2016, Identifying and addressing challenges faced by transdisciplinary research teams in climate change research, J. Clean. Prod., 123, 55, 10.1016/j.jclepro.2015.08.049 Gehlert, 2014, Advancing transdisciplinary research: the transdisciplinary research on energetics and Cancer initiative, J. Transl. Med. Epidemiol., 2, 1032 Gibbons, 1994 Halimanjaya, 2018, Getting forest science to policy discourse : a theory-based outcome assessment of a global research programme, Int. For. Rev., 20, 469 Hanberger, 2001, What is the policy problem? Methodological challenges in policy evaluation, Evaluation, 7, 45, 10.1177/13563890122209513 2016 ICRAF, 2019 ISPC, 2015 Jahn, 2012, Transdisciplinarity: between mainstreaming and marginalization, Ecol. Econ., 79, 1, 10.1016/j.ecolecon.2012.04.017 Kates, 2017, Sustainability science, 1 Kates, 2001, Sustainability science, Science, 641, 10.1126/science.1059386 Kauffman, 2014, New directions in sustainability science: promoting integration and cooperation, Sustain. Sci., 9, 413, 10.1007/s11625-014-0259-3 Klein, 2006, Afterword: the emergent literature on interdisciplinary and transdisciplinary research evaluation, Res. Eval., 15, 75, 10.3152/147154406781776011 Komiyama, 2006, Sustainability science: building a new discipline, Sustain. Sci., 1, 1, 10.1007/s11625-006-0007-4 Lang, 2012, Transdisciplinary research in sustainability science: practice, principles, and challenges, Sustain. Sci., 7, 25, 10.1007/s11625-011-0149-x Mayne, 2012, Contribution analysis: Coming of age?, Evaluation, 18, 270, 10.1177/1356389012451663 Mayne, 2013 Mayne, 2013 Mitchell, 2015, Beginning at the end: the outcome spaces framework to guide purposive transdisciplinary research, Futures, 65, 86, 10.1016/j.futures.2014.10.007 ODI, Overseas Development Institute, 2012 Ozanne, 2017, Assessing the societal impact of research: the relational engagement approach, J. Public Policy Mark., 36, 1, 10.1509/jppm.14.121 Phillips, 2018, Developing and testing a method to measure academic societal impact, Higher Educ. Quart., 72, 121, 10.1111/hequ.12154 Pielke, 2007 Pohl, 2011, What is progress in transdisciplinary research?, Futures, 43, 618, 10.1016/j.futures.2011.03.001 Pohl, 2007 Pohl, 2010, Researchers’ roles in knowledge co-production: experience from sustainability research in Kenya, Switzerland, Bolivia and Nepal, Sci. Public Policy, 37, 267, 10.3152/030234210X496628 Polk, 2014, Achieving the promise of transdisciplinarity: a critical exploration of the relationship between transdisciplinary research and societal problem solving, Sustain. Sci., 9, 439, 10.1007/s11625-014-0247-7 Ramirez, 2018, Crossing the science-policy interface: lessons from a research project on Brazil nut management in Peru, For. Policy Econ. Ramirez, 2019, Stakeholder perceptions of scientific knowledge in policy processes: a Peruvian case-study of forestry policy development, Sci. Public Policy, 10.1093/scipol/scz003 Reale, 2017, A review of literature on evaluating the scientific, social and political impact of social sciences and humanities research, Res. Eval., 27, 298, 10.1093/reseval/rvx025 Renkow, 2010, The impacts of CGIAR research: a review of recent evidence, Food Policy, 35, 391, 10.1016/j.foodpol.2010.04.006 Rockwell, 2015, Nut production in Bertholletia excelsa across a logged forest mosaic: implications for multiple forest use, PLoS One, 10, 10.1371/journal.pone.0135464 Roux, 2017, Transdisciplinary research for systemic change: who to learn with, what to learn about and how to learn, Sustain. Sci., 12, 711, 10.1007/s11625-017-0446-0 Sarewitz, 1996 Sarkki, 2014, Balancing credibility, relevance and legitimacy: a critical assessment of trade-offs in science-policy interfaces, Sci. Public Policy, 41, 194, 10.1093/scipol/sct046 Savedoff, 2005, When will we ever learn? Recommendations to improve social development through enhanced impact evaluation, Center Glob. Dev. Stern, 2012 Stokes, 1997 Talwar, 2011, User engagement in sustainability research, Sci. Public Policy, 38, 379, 10.3152/030234211X12960315267615 Walter, 2007, Measuring societal effects of transdisciplinary research projects: design and application of an evaluation method, Eval. Program Plann., 30, 325, 10.1016/j.evalprogplan.2007.08.002 White, 2012 Wiek, 2014, Toward a methodological scheme for capturing societal effects of participatory sustainability research, Res. Eval., 117, 10.1093/reseval/rvt031 Wiek, 2011, Key competencies in sustainability: a reference framework for academic program development, Sustain. Sci., 6, 203, 10.1007/s11625-011-0132-6 Wiek, 2011, Moving forward on competence in sustainability research and problem solving, Environment, 53, 3 Wilsdon, 2015 Wolf, 2013, Evaluating research beyond scientific impact: how to include criteria for productive interactions and impact on practice and society, Gaia, 22, 104, 10.14512/gaia.22.2.9