Developing implementation research capacity: longitudinal evaluation of the King’s College London Implementation Science Masterclass, 2014–2019
Tóm tắt
Despite an increasing number of training opportunities in implementation science becoming available, the demand for training amongst researchers and practitioners is unmet. To address this training shortfall, we developed the King’s College London ‘Implementation Science Masterclass’ (ISM), an innovative 2-day programme (and currently the largest of its kind in Europe), developed and delivered by an international faculty of implementation experts.
This paper describes the ISM and provides delegates’ quantitative and qualitative evaluations (gathered through a survey at the end of the ISM) and faculty reflections over the period it has been running (2014–2019).
Across the 6-year evaluation, a total of 501 delegates have attended the ISM, with numbers increasing yearly from 40 (in 2014) to 147 (in 2019). Delegates represent a diversity of backgrounds and 29 countries from across the world. The overall response rate for the delegate survey was 64.5% (323/501). Annually, the ISM has been rated ‘highly’ in terms of delegates’ overall impression (92%), clear and relevant learning objectives (90% and 94%, respectively), the course duration (85%), pace (86%) and academic level 87%), and the support provided on the day (92%). Seventy-one percent of delegates reported the ISM would have an impact on how they approached their future work. Qualitative feedback revealed key strengths include the opportunities to meet with an international and diverse pool of experts and individuals working in the field, the interactive nature of the workshops and training sessions, and the breadth of topics and contexts covered.
Yearly, the UK ISM has grown, both in size and in its international reach. Rated consistently favourably by delegates, the ISM helps to tackle current training demands from all those interested in learning and building their skills in implementation science. Evaluation of the ISM will continue to be an annual iterative process, reflective of changes in the evidence base and delegates changing needs as the field evolves.
Từ khóa
Tài liệu tham khảo
Norton W, Lungeanu A, Chamber DA, Contractor N. Mapping the growing discipline of dissemination and implementation science in health. Scientometrics. 2017;12:1367–90.
Chambers DA, Pintello D, Juliano-Bult J. Capacity-building and training opportunities for implementation science in mental health. Psychol Res. 2020;283:112511.
Norton W. Advancing the science and practice of dissemination and implementation in health: a novel course for public health students and academic researchers. Public Health Rep. 2014;129(6):536–42.
Balas E, Boren S. Managing clinical knowledge for health care improvement. In: van Bemmel JH, McCray AT, editors. Yearbook of medical informatics. Stuttgart: Schattauer Verlagsgesellschaft mbH; 2000. p. 65–70.
Grant J, Green L, Mason B. Basic research and health: a reassessment of the scientific basis for the support of biomedical science. Res Eval. 2003;12:217–24.
Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. J Roy Soc Med. 2011;104:510–20.
Wensing M. Implementation science in healthcare: introduction and perspective. Z Evid Fortbild Qual Gesundnwes. 2015;109(2):97–102.
Rapport F, Clay-Williams R, Churruca K, Shih P, Hogden A, Braithwaite J. The struggle of translating science into action: foundational concepts of implementation science. J Eval Clin Pract. 2018;24(1):117–26.
Bauer MS, Damschroder L, Hagedorn H, Smith J, Kilbourne AM. An introduction to implementation science for the non-specialist. BMC Psychol. 2015;16(3):32.
Burton DL, Lubotsky Levin B, Massey T, Baldwin J, Williamson H. Innovative graduate research education for advancement of implementation science in adolescent behavioral health. J Behav Health Serv Res. 2016;43:172–86.
Grol R. Successes and failures in the implementation of evidence-based guidelines for clinical practice. Med Care. 2001;39:46–54.
McGlynn EA, Asch SM, Adams J, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635–45.
Seddon ME, Marshall MN, Campbell SM, Roland MO. Systematic review of studies of quality of clinical care in general practice in the UK, Australia and New Zealand. Qual Health Care. 2001;10:152–8.
Mallonee S, Fowler C, Istre GR. Bridging the gap between research and practice: a continuing challenge. Inj Prev. 2016;12(6):357–9.
Ginossar T, Heckman KJ, Cragun D, et al. Bridging the chasm: challenges, opportunities, and resources for integrating a dissemination and implementation science curriculum into medical education. J Med Ed Curr Dev. 2018;5:1–11.
Sales AE, Wilson PM, Wensing M, et al. Implementation science and implementation communications: our aims, scope and reporting expectations. Implement Sci. 2019;14:77.
Brownson RC, Proctor EK, Luke DA, et al. Building capacity for dissemination and implementation research: one university’s experience. Implement Sci. 2017;12:104.
Proctor EK, Chambers DA. Training in dissemination and implementation research: a field-wide perspective. Transl Behav Med. 2017;7(3):624–35.
Tabak R, Padek MM, Kerner JF. Dissemination and implementation science training needs: insights from practitioners and researchers. Am J Prev Med. 2017;52(3):S322–9.
Chambers DA, Proctor EK, Brownson RC, Straus SE. Mapping training needs for dissemination and implementation research: lessons from a synthesis of existing D&I research training programs. Transl Behav Med. 2017;7(3):593–601.
Carlfjord S, Roback K, Nilsen P. Five years’ experience of an annual course on implementation science: an evaluation among course participants. Implement Sci. 2017;12:101.
Ford BS, Rabin B, Morrato EH, Glasgow RE. Online resources for dissemination and implementation science: meeting the demand and lessons learned. J Clin Transl Sci. 2018;2(5):259–66.
Straus S, Sales A, Wensing M, Michie M, Kent B, Fiy R. Education and training for implementation science: our interest in manuscripts describing education and training materials. Implement Sci. 2015;1:136.
Smits PA, Denis JL. How research funding agencies support science integration into policy and practice: an international overview. Implement Sci. 2014;9:28.
Straus SE, Brouwers M, Johnson D, et al. Core competencies in the science and practice of knowledge translation: description of a Canadian strategic training initiative. Implement Sci. 2011;6:127.
Meissner H, Glasgow RE, Vinson CA, et al. The US training institute for dissemination and implementation research in health. Implement Sci. 2013;8:12.
Proctor EK, Landsverk J, Baumann AA, et al. The implementation research institute: training mental health implementation researchers in the United States. Implement Sci. 2013;8:105.
Proctor E, Ramsey AT, Brown MT, Malone S, Hooley C, McKay V. Training in Implementation Practice Leadership (TRIPLE): evaluation of a novel practice change strategy in behavioural health organisations. Implement Sci. 2019;14:66.
Goodenough B, Fleming R, Young M, Burns K, Jones C, Forbes F. Raising awareness of research evidence among professionals delivering dementia care: are knowledge translation workshops useful? Gerontology Geriat Ed. 2017;38(4):392–406.
Jones K, Armstrong R, Pettman T, Waters E. Cochrane Update. Knowledge translation for researchers: developing training to support public health researchers KTE efforts. J Public Health. 2015;37(2):364–6.
Marriott BR, Rodriguez AL, Landes SJ, Lewis CC, Comtois KA. A methodology for enhancing implementation science proposals: comparison of face-to-face versus virtual workshops. Implement Sci. 2016;11:62.
Moore JE, Rashid S, Park JS, Khan S, Straus SE. Longitudinal evaluation of a course to build core competencies in implementation practice. Implement Sci. 2018;13:106.
Morrato EH, Rabin B, Proctor J, et al. Bringing it home: expanding the local reach of dissemination and implementation training via a university-based workshop. Implement Sci. 2015;10:94.
Ramaswamy R, Mosnier J, Reed K, Powell BJ, Schenck AP. Building capacity for Public Health 3.0: introducing implementation science into a MPH curriculum. Implement Sci. 2019;14:18.
Means AR, Phillips DE, Lurton G, et al. The role of implementation science training in global health: from the perspective of graduates of the field’s first dedicated doctoral program. Glob Health Action. 2016;9(1):31899.
Ackerman S, Boscardin C, Karliner L, et al. The Action Research Program: experiential learning in systems-based practice for first year medical students. Teach Learn Med. 2016;28(20):183–91.
Ulrich C, Mahler C, Forstner J, Szecsenyi J, Wensing M. Teaching implementation science in a new Master of Science program in Germany: a survey of stakeholder expectations. Implement Sci. 2017;12:55.
Padek M, Mir N, Jacob RR, et al. Training scholars in dissemination and implementation research for cancer prevention and control: a mentored approach. Implement Sci. 2018;13:18.
‘Public Health Implementation Science’ Virginia Tech. https://www.tbmh.vt.edu/focus-areas/health-implement.html (accessed 9/1/2019).
‘Fundamentals of Implementation Science’, University of Washington https://edgh.washington.edu/courses/fundamentals-implementation-science (accessed 9/1/2019).
Gonzalez R, Handley MA, Ackerman S, O’Sullivan PS. Increasing the translation of evidence into practice, policy and public health improvements: a framework for training health professionals in implementation and dissemination science. Acad Med. 2012;87(3):271–8.
‘Introduction to implementation science, theory and design’ University of California, San Francisco. https://epibiostat.ucsf.edu/introduction-implementation-science-theory-and-design (accessed 12/1/2019).
‘Implementation science certificate’ University of California, San Francisco. https://epibiostat.ucsf.edu/faqs-implementation-science-certificate (accessed 12/1/2019).
‘Implementation and dissemination science’ University of Maryland https://www.graduate.umaryland.edu/research/ (accessed 12/1/2019).
‘Implementation Science Seminar Series’. Quality Enhancement Research Initiative (QUERI) Implementation Seminar Series’, U.S Department of Veterans Affairs. https://www.hsrd.research.va.gov/cyberseminars/series.cfm (accessed 12/1/2019).
‘Implementation Science Research Webinar Series’ National Cancer Institute http://news.consortiumforis.org/training/ucsf-implementation-science-online-training-program/ (accessed 12/1/2019).
‘UK Implementation Science Masterclass, Kings College London. https://www.kcl.ac.uk/events/implementation-science-masterclass (accessed 12/1/2019).
‘Implementation science module’. University of Exeter. http://medicine.exeter.ac.uk/programmes/programme/modules/module/?moduleCode=HPDM026&ay=2015/6 (accessed 12/1/2019).
Wahabi HA, Al-Ansary A. Innovative teaching methods for capacity building in knowledge translation. BMC Med Ed. 2011;11:85.
‘Specialist certificate in implementation science’ University of Melbourne. https://study.unimelb.edu.au/find/courses/graduate/specialist-certificate-in-implementation-science/ (accessed 12/1/2019).
Osanjo GO, Oyugi JO, Kibwage IO, et al. Building capacity in implementation science research training at the University of Nairobi. Implement Sci. 2016;11:30.
‘Massive open online course on implementation research (MOOC). The Special Programme for Research and Training in Tropical Diseases. https://www.publichealthupdate.com/registration-open-tdr-massive-open-online-course-mooc-on-implementation-research/ (accessed 12/1/2019).
Luke DA, Baumann AA, Carothers BJ, Landsverk J, Proctor EK. Forging a link between mentoring and collaboration: a new training model for implementation science. Implement Sci. 2016;11:137.
Park JS, Moore JE, Sayal R, et al. Evaluation of the “Foundations in knowledge translation” training initiative: preparing end users to practice KT. Implement Svi. 2018;13:63.
Fade S, Halter, M. Understanding South London’s Capacity for Implementation and Improvement Science, 2014. Report prepared for Health Innovation Network South London (south London’s academic health science network) and the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care (CLAHRC) South London.
Kho ME, Estey EA, Deforge RT, Mak L, Bell BL. Riding the knowledge translation roundabout: lessons learned from the Canadian Institutes of Health Research Summer Institute in knowledge translation. Implement Sci. 2009;4:33.
Metz A, Louison L, Ward C, Burke K. Implementation specialist practice profile: skills and competencies for implementation practitioners. Working draft, 2018. https://www.effectiveservices.org/downloads/Implementation_specialist_practice_profile.pdf (accessed 12/1/2019).
Mallidou AA, Atherton P, Chane L, Frisch N, Glegg S, Scarrow G. Core knowledge translation competencies: a scoping review. BMC Health Serv Res. 2018;18:502.
Newman K, Van Eerd D, Powell B, et al. Identifying emerging priorities in Knowledge Translation from the perspective of trainees. BMC Health Serv Res. 2014;14(Suppl 2):P130.
Darnell D, Dorsey CN, Melvin A, Chi J, Lyon AR, Lewis CC. A content analysis of dissemination and implementation science resource initiatives: what types of resources do they offer to advance the field? Implement Sci. 2017;12:137.
Padek M, Brownson R, Proctor E, et al. Developing dissemination and implementation competencies for training programs. 2015; 10(Suppl 1): A39.
Proctor E, Carpenter C, Brown CH, et al. Advancing the science of dissemination and implementation: three “6th NIH Meetings” on training, measures, and methods. Implement Sci. 2015;10(Suppl 1):A13.
Padek M, Colditz G, Dobbins M, Koscielniak N, Proctor EK, Sales AE, et al. Developing educational competencies for dissemination and implementation research training programs: an exploratory analysis using card sorts. Implement Sci. 2015;10:114 https://doi.org/10.1186/s13012-015-0304-3.
Chambers D, Proctor EK. Advancing a comprehensive plan for dissemination and implementation research training 6th NIH Meeting on Dissemination and Implementation Research in Health: a working meeting on training. In National Cancer Institute Division of Cancer Control & Population Science Implementation Science Webinar Series; January, 28th 2014. Retrieved from https://researchtoreality.cancer.gov/node/1281.
‘Implementation Science online training programme’. University of California, San Francisco. http://news.consortiumforis.org/training/ucsf-implementation-science-online-training-program/ (accessed 12/1/2019).
‘Inspiring change: creating impact with evidence-based implementation’. The Centre for Implementation. https://thecenterforimplementation.teachable.com/p/inspiring-change (accessed 12/1/2019).
Bauman AA, Carothers BJ, Landsverk, et al. Evaluation of the implementation research institute: trainees’ publications and grant productivity. Adm Policy Ment Health Ment Health Serv Res. 2019;8(1):105.
Stamatakis KA, Norton WE, Stirman SW, Melvin C, Brownson RC. Developing the next generation of dissemination and implementation researchers: insights from initial trainees. Implement Sci. 2013;8:29.