Assessing the complexity of interventions within systematic reviews: development, content and use of a new tool (iCAT_SR)

BMC Medical Research Methodology - Tập 17 - Trang 1-13 - 2017
Simon Lewin1,2, Maggie Hendry3, Jackie Chandler4, Andrew D. Oxman1, Susan Michie5, Sasha Shepperd6, Barnaby C. Reeves7, Peter Tugwell8, Karin Hannes9, Eva A. Rehfuess10, Vivien Welch11,12,13, Joanne E. Mckenzie14, Belinda Burford15, Jennifer Petkovic16, Laurie M. Anderson17, Janet Harris18, Jane Noyes19
1Norwegian Institute of Public Health, Oslo, Norway
2Health Systems Research Unit, South African Medical Research Council, Cape Town, South Africa
3North Wales Centre for Primary Care Research, Bangor University, Bangor, UK
4Cochrane, Cochrane Central Executive, London, UK
5Centre for Behaviour Change, University College London, London, UK
6Nuffield Department of Population Health, University of Oxford, Oxford, UK
7Clinical Trials and Evaluation Unit, School of Clinical Sciences, University of Bristol, Bristol, UK
8Institute of Population Health, University of Ottawa, Ottawa, Canada
9Social Research Methodology Group, Centre for Sociological Research, Faculty of Social Sciences, KU Leuven, Leuven, Belgium
10Institute for Medical Informatics, Biometry and Epidemiology, University of Munich, Munich, Germany
11Bruyère Research Institute, Bruyère Continuing Care, Ottawa, Canada
12School of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, Ottawa, Canada
13Ottawa Hospital Research Institute, Ottawa, Canada
14School of Public Health and Preventive Medicine, The Alfred Centre, Monash University, Melbourne, Australia
15Cochrane Public Health Group and Jack Brockhoff Child Health and Wellbeing Program, Melbourne School of Population and Global Health, University of Melbourne, Melbourne, Australia
16Campbell and Cochrane Equity Methods Group, Centre for Global Health, Institute of Population Health, University of Ottawa, Ottawa, Canada
17Department of Epidemiology, School of Public Health University of Washington, Seattle, USA
18School of Health and Related Research (ScHARR), University of Sheffield, Sheffield, UK
19School of Social Sciences, Bangor University, Bangor, UK

Tóm tắt

Health interventions fall along a spectrum from simple to more complex. There is wide interest in methods for reviewing ‘complex interventions’, but few transparent approaches for assessing intervention complexity in systematic reviews. Such assessments may assist review authors in, for example, systematically describing interventions and developing logic models. This paper describes the development and application of the intervention Complexity Assessment Tool for Systematic Reviews (iCAT_SR), a new tool to assess and categorise levels of intervention complexity in systematic reviews. We developed the iCAT_SR by adapting and extending an existing complexity assessment tool for randomized trials. We undertook this adaptation using a consensus approach in which possible complexity dimensions were circulated for feedback to a panel of methodologists with expertise in complex interventions and systematic reviews. Based on these inputs, we developed a draft version of the tool. We then invited a second round of feedback from the panel and a wider group of systematic reviewers. This informed further refinement of the tool. The tool comprises ten dimensions: (1) the number of active components in the intervention; (2) the number of behaviours of recipients to which the intervention is directed; (3) the range and number of organizational levels targeted by the intervention; (4) the degree of tailoring intended or flexibility permitted across sites or individuals in applying or implementing the intervention; (5) the level of skill required by those delivering the intervention; (6) the level of skill required by those receiving the intervention; (7) the degree of interaction between intervention components; (8) the degree to which the effects of the intervention are context dependent; (9) the degree to which the effects of the interventions are changed by recipient or provider factors; (10) and the nature of the causal pathway between intervention and outcome. Dimensions 1–6 are considered ‘core’ dimensions. Dimensions 7–10 are optional and may not be useful for all interventions. The iCAT_SR tool facilitates more in-depth, systematic assessment of the complexity of interventions in systematic reviews and can assist in undertaking reviews and interpreting review findings. Further testing of the tool is now needed.

Tài liệu tham khảo

Clark AM, Briffa TG, Thirsk L, Neubeck L, Redfern J. What football teaches us about researching complex health interventions. BMJ. 2012;345:e8316. Petticrew M. When are complex interventions ‘complex’? When are simple interventions ‘simple’? Eur J Public Health. 2011;21(4):397–8. Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, Wong G, Sheikh A. Can we systematically review studies that evaluate complex interventions? PLoS Med. 2009;6(8):e1000086. Moore G, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O’Cathain A, Tinati T, Wight D, et al. Process evaluation of complex interventions: medical research council guidance. London: MRC Population Health Science Research Network; 2014. Richards D, Hallberg I, editors. Complex interventions in health: an overview of research methods. Oxford and New York: Routledge; 2015. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Medical Research Council G. Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008;337:a1655. Lewin S, Oxman A, Glenton C. Assessing healthcare interventions along the complex-simple continuum: a proposal. Abstract P100. Dublin: 14th Cochrane Colloquium; 2006. Wells M, Williams B, Treweek S, Coyle J, Taylor J. Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. Trials. 2012;13(1):1. Clark AM. What are the components of complex interventions in healthcare? Theorizing approaches to parts, powers and the whole intervention. Soc Sci Med. 2013;93:185–93. Rogers P. Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation. 2008;14(1):29–48. Glouberman S, Zimmerman B. Complicated and complex systems: what would successful reform of Medicare look like? Discussion paper No.8. Canada: Commission for the future of health care in Canada; 2002. Available from: http://c.ymcdn.com/sites/www.plexusinstitute.org/resource/collection/6528ED29-9907-4BC7-8D00-8DC907679FED/ComplicatedAndComplexSystems-ZimmermanReport_Medicare_reform.pdf. Accessed 22 Apr 2017. Hooper R, Froud RJ, Bremner SA, Perera R, Eldridge S. Cascade diagrams for depicting complex interventions in randomised trials. BMJ. 2013;347:f6681. Perera R, Heneghan C, Yudkin P. Graphical method for depicting randomised trials of complex interventions. BMJ. 2007;334(7585):127–9. Noyes J, Gough D, Lewin S, Mayhew A, Michie S, Pantoja T, Petticrew M, Pottie K, Rehfuessk E, Shemilt I, et al. A research and development agenda for systematic reviews that ask complex questions about complex interventions. J Clin Epidemiol. 2013;66(11):1262–70. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, Barbour V, Macdonald H, Johnston M, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687. Higgins JPT, Deeks JJ. Chapter 7: Selecting studies and collecting data. In: Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration; 2011. Available from www.handbook.cochrane.org. Accessed 22 Apr 2017. MRC. A framework for development and evaluation of RCTs for complex interventions to improve health. United Kingdom: Medical Research Council; 2000. Available from: http://www.mrc.ac.uk/documents/pdf/rcts-for-complex-interventions-to-improve-health/. Accessed 22 Apr 2017. Anderson LM, Oliver SR, Michie S, Rehfuess E, Noyes J, Shemilt I. Investigating complexity in systematic reviews of interventions by using a spectrum of methods. J Clin Epidemiol. 2013;66(11):1223–9. Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, Ogedegbe G, Orwig D, Ernst D, Czajkowski S, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH behavior change consortium. Health Psychol. 2004;23(5):443–51. Borrelli B, Sepinwall D, Ernst D, Bellg AJ, Czajkowski S, Breger R, DeFrancesco C, Levesque C, Sharp DL, Ogedegbe G, et al. A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. J Consult Clin Psychol. 2005;73(5):852–60. Pfadenhauer LM, Mozygemba K, Gerhardus A, Hofmann B, Booth A, Lysdahl KB, Tummers M, Burns J, Rehfuess EA. Context and implementation: a concept analysis towards conceptual maturity. Z Evid Fortbild Qual Gesundhwes. 2015;109(2):103–14. Sutcliffe K, Thomas J, Stokes G, Hinds K, Bangpan M. Intervention component analysis (ICA): a pragmatic approach for identifying the critical features of complex interventions. Syst Rev. 2015;4:140. Anderson LM, Petticrew M, Rehfuess E, Armstrong R, Ueffing E, Baker P, Francis D, Tugwell P. Using logic models to capture complexity in systematic reviews. Res Synth Methods. 2011;2(1):33–42. De Silva MJ, Breuer E, Lee L, Asher L, Chowdhary N, Lund C, Patel V. Theory of change: a theory-driven approach to enhance the medical research Council’s framework for complex interventions. Trials. 2014;15:267. Glenton C, Colvin CJ, Carlsen B, Swartz A, Lewin S, Noyes J, Rashidian A. Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database Syst Rev. 2013;10:CD010414. Lewin S, Munabi-Babigumira S, Glenton C, Daniels K, Bosch-Capblanch X, van Wyk BE, Odgaard-Jensen J, Johansen M, Aja GN, Zwarenstein M, et al. Lay health workers in primary and community health care for maternal and child health and the management of infectious diseases. Cochrane Database Syst Rev. 2010;3:CD004015. Ames HMR, Glenton C, Lewin S. Parents’ and informal caregivers’ views and experiences of communication about routine childhood vaccination: a synthesis of qualitative evidence. Cochrane Database Syst Rev. 2017;2:CD011787. Saeterdal I, Lewin S, Austvoll-Dahlgren A, Glenton C, Munabi-Babigumira S. Interventions aimed at communities to inform and/or educate about early childhood vaccination. Cochrane Database Syst Rev. 2014;11:CD010232. Petticrew M, Anderson L, Elder R, Grimshaw J, Hopkins D, Hahn R, Krause L, Kristjansson E, Mercer S, Sipe T, et al. Complex interventions and their implications for systematic reviews: a pragmatic approach. J Clin Epidemiol. 2013;66(11):1209–14. Burford B, Lewin S, Welch V, Rehfuess E, Waters E. Assessing the applicability of findings in systematic reviews of complex interventions can enhance the utility of reviews for decision making. J Clin Epidemiol. 2013;66(11):1251–61. Petticrew M, Rehfuess E, Noyes J, Higgins JPT, Mayhew A, Pantoja T, Shemilt I, Sowden A. Synthesizing evidence on complex interventions: how meta-analytical, qualitative, and mixed-method approaches can contribute. J Clin Epidemiol. 2013;66(11):1230–43. Lamb SE, Becker C, Gillespie LD, Smith JL, Finnegan S, Potter R, Pfeiffer K, Taxonomy I. Reporting of complex interventions in clinical trials: development of a taxonomy to classify and describe fall-prevention interventions. Trials. 2011;12:125. Schulz R, Czaja SJ, McKay JR, Ory MG, Belle SH. Intervention taxonomy (ITAX): describing essential features of interventions. Am J Health Behav. 2010;34(6):811–21. Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42. Michie S, Hyder N, Walia A, West R. Development of a taxonomy of behaviour change techniques used in individual behavioural support for smoking cessation. Addict Behav. 2011;36(4):315–9. Michie S, Whittington C, Hamoudi Z, Zarnani F, Tober G, West R. Identification of behaviour change techniques to reduce excessive alcohol consumption. Addiction. 2012;107(8):1431–40. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95. Hildon Z, Allwood D, Black N. Impact of format and content of visual display of data on comprehension, choice and preference: a systematic review. Int J Qual Health Care. 2012;24(1):55–64. Glasziou P, Chalmers I, Altman DG, Bastian H, Boutron I, Brice A, Jamtvedt G, Farmer A, Ghersi D, Groves T, et al. Taking healthcare interventions from trial to practice. BMJ. 2010;341:c3852. Squires JE, Valentine JC, Grimshaw JM. Systematic reviews of complex interventions: framing the review question. J Clin Epidemiol. 2013;66(11):1215–22. Grimshaw JM, Freemantle N, Langhorne P, Song F. Complexity and systematic reviews: report to US congress office of technology assessment. Washington DC: Office of Technology Assessment; 1995. Bullock LF, Wells JE, Duff GB, Hornblow AR. Telephone support for pregnant women: outcome in late pregnancy. N Z Med J. 1995;108(1012):476–8. Hardy JB, Streett R. Family support and parenting education in the home: an effective extension of clinic-based preventive health care services for poor children. J Pediatr. 1989;115(6):927–31. Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, Norris S, Falck-Ytter Y, Glasziou P, DeBeer H, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94.
Thông tin
Thông tin xuất bản

BMC Medical Research Methodology

Tập 17

1-13

Thông tin tác giả