“Best fit” framework synthesis: refining the method

BMC Medical Research Methodology - Tập 13 - Trang 1-16 - 2013
Christopher Carroll1, Andrew Booth1, Joanna Leaviss1, Jo Rick2
1Health Economics and Decision Science (HEDS), School of Health and Related Research (ScHARR), Regent Court, Sheffield, UK
2Health Sciences Research Group - Primary Care, School of Community Based Medicine, University of Manchester, Manchester, UK

Tóm tắt

Following publication of the first worked example of the “best fit” method of evidence synthesis for the systematic review of qualitative evidence in this journal, the originators of the method identified a need to specify more fully some aspects of this particular derivative of framework synthesis. We therefore present a second such worked example in which all techniques are defined and explained, and their appropriateness is assessed. Specified features of the method include the development of new techniques to identify theories in a systematic manner; the creation of an a priori framework for the synthesis; and the “testing” of the synthesis. An innovative combination of existing methods of quality assessment, analysis and synthesis is used to complete the process. This second worked example was a qualitative evidence synthesis of employees’ views of workplace smoking cessation interventions, in which the “best fit” method was found to be practical and fit for purpose. The method is suited to producing context-specific conceptual models for describing or explaining the decision-making and health behaviours of patients and other groups. It offers a pragmatic means of conducting rapid qualitative evidence synthesis and generating programme theories relating to intervention effectiveness, which might be of relevance both to researchers and policy-makers.

Tài liệu tham khảo

Carroll C, Booth A, Cooper K: A worked example of "best-fit" framework synthesis: a systematic review of views concerning the taking of potential chemopreventive agents. BMC Med Res Methodol. 2011, 11: 29-10.1186/1471-2288-11-29. Kelly M, Morgan A, Ellis S, Younger T, Huntley J, Swann C: Evidence based public health: a review of the experience of the National Institute of Health and Clinical Excellence (NICE) of developing public health guidance in England. Soc Sci Med. 2010, 71: 1056-1062. 10.1016/j.socscimed.2010.06.032. Dixon-Woods M: Using framework-based synthesis for conducting reviews of qualitative studies. BMC Med. 2011, 9: 39-10.1186/1741-7015-9-39. Suri H: Epistemological pluralism in research synthesis methods. Int J Qual Stud Educ. 2012, 1: 1-23. Barnett-Page E, Thomas J: Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009, 9: 59-10.1186/1471-2288-9-59. Lewin S, Bosch-Capblanch X, Lavis J: Guidance for evidence-informed policies about health systems: rationale for and challenges of guidance development. PLoS Med. 2012, 9: e1001185-10.1371/journal.pmed.1001185. Dixon-Woods M: Ten challenges in improving quality in healthcare: lessons from the Health Foundation's programme evaluations and relevant literature. BMJ Quality & Safety. 2012, Online first Wong G, Grenhalgh T, Westhorp G, Buckingham J, Pawson R: RAMESES publication standards: realist syntheses. BMC Med. 2013, 11: Atkins S, Lewin S, Smith H, Engel M, Fretheim A, Volmink J: Conducting a meta-ethnography of qualitative literature: lessons learnt. BMC Med Res Methodol. 2008, 8: 21-10.1186/1471-2288-8-21. Brunton G, Oliver S, Oliver K, Lorenc T: A Synthesis of Research Addressing Children's, Young People's and Parents' Views of Walking and Cycling for Transport London. 2006, London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London Candy B, King M, Jones L, Oliver S: Using qualitative synthesis to explore heterogeneity of complex interventions. BMC Med Res Methodol. 2011, 11: 124-10.1186/1471-2288-11-124. Garside R, Pearson M, Moxham T, Anderson R: Providing Public Information to Prevent Skin Cancer. Review 2. Barriers and Facilitators to Conveying Information to Prevent First Occurrence of Skin Cancer: a Systematic Review of Qualitative Research. 2009, London: National Institute for Health and Clinical Excellence Oliver S, Rees R, Clarke-Jones L, Milne R, Oakley A, Gabbay J: A multidimensional conceptual framework for analysing public involvement in health services research. Health Expect. 2008, 11: 72-84. 10.1111/j.1369-7625.2007.00476.x. Hannes K, Macaitis K: A move to more systematic and transparent approaches in qualitative evidence synthesis: update on a review of published papers. Qual Res. 2012, 12: 402-442. 10.1177/1468794111432992. Fishwick D, McGregor M, Drury M, Webster J, Rick J, Carroll C: BOHRF smoking cessation review. HuSU/12/17. Health & Safety Laboratory. 2012, Available at: http://www.bohrf.org.uk/downloads/BOHRF_Smoking_Cessation_Review-April%202012.pdf Miles MB, Huberman AM: Qualitative Data Analysis: an Expanded Sourcebook. 1994, Thousand Oaks, CA: Sage, 2 Lorenc T, Jamal F, Cooper C: Sun Protection Resources and Changes to the Environment to Prevent Skin Cancer: Qualitative Evidence Review. 2010, London: National Institute for Health and Clinical Excellence Cameron A: Rapid Versus Full Systematic Reviews: An Inventory of Current Methods and Practice in Health Technology Assessment. 2007, Australia: ASERNIPS, 1-119. Ganann R, Ciliska D, Thomas H: Expediting systematic reviews: methods and implications of rapid reviews. Implementation Science. 2010, 5: 56-10.1186/1748-5908-5-56. Stansfield C, Kavanagh J, Rees R, Gomersall A, Thomas J: The selection of search sources influences the findings of a systematic review of people's views: a case study in public health. BMC Med Res Methodol. 2012, 12: 55-10.1186/1471-2288-12-55. Cooke A, Smith D, Booth A: Beyond PICO: the SPIDER tool for qualitative evidence synthesis. Qual Health Res. 2012, 22: 1435-1443. 10.1177/1049732312452938. Grayson L, Gomersall A: A Difficult Business: Finding the Evidence for Social Science Reviews. Working Paper 19. 2003, London: Economic and Social Research Council, UK Centre for Evidence Based Policy and Practice Hoffman T, Erueti C, Thorning S, Glasziou P: The scatter of research: cross sectional comparison of randomised trials and systematic reviews across specialties. Br Med J. 2012, 344: e3223-10.1136/bmj.e3223. Janke S, Haddock K, Poston W, Hoffman K, Hughey J, Lando H: A qualitative analysis of the tobacco control climate in the U.S. military. Nicotine Tob Res. 2010, 12: 88-95. 10.1093/ntr/ntp181. Bondy S, Bercovitz K: Non-smoking worksites in the residential construction sector: using an online forum to study perspectives and practices. Tob Control. 2011, 20: 189-195. 10.1136/tc.2010.038398. Borland R, Cappiello M, Owen N: Leaving work to smoke. Addiction. 1997, 92: 1361-1368. 10.1111/j.1360-0443.1997.tb02855.x. Croucher R, Choudhury S: Tobacco control policy initiatives and UK resident Bangladeshi male smokers: community-based, qualitative study. Ethn Health. 2007, 12: 321-327. 10.1080/13557850701300731. Eadie D, MacAskill S, Heim D, Hastings G: Responding to change: how did bar workers adapt to the smoke-free legislation in Scotland?. Int J Environ Health Res. 2010, 20: 13-26. 10.1080/09603120903255279. Styles G, Capewell S: No smoking at work: the effect of different types of workplace smoking restrictions on smokers' attitudes, behaviour and cessation intentions. Health Educ J. 1998, 57: 385-395. 10.1177/001789699805700410. Fisher E, Bishop D, Levitt-Gilmour T, Cappello M, Ashenberg Z, Newman E: Social support in worksite smoking cessation: qualitative analysis of the EASE project. Am J Health Promot. 1994, 9: 39-47. Glasgow R, Hollis J, Pettigrew L, Foster L, Givi M, Morrisette G: Implementing a year-long, worksite-based incentive program for smoking cessation. Am J Health Promot. 1991, 5: 192-199. 10.4278/0890-1171-5.3.192. Hunt M, Barbeau E, Lederman R, Stoddard A, Chetkovich C, Goldman R: Process evaluation results from the healthy directions-small business study. Health Educ Behav. 2007, 34: 90-107. Olsen G, Lacy S, Sprafka J, Arceneaux T, Potts T, Kravat B: A 5-year evaluation of a smoking cessation incentive program for chemical employees. Prev Med. 1991, 20: 774-784. 10.1016/0091-7435(91)90071-B. Powell D: A guided self-help smoking cessation intervention with white-collar and blue-collar employees. Am J Health Promot. 1993, 7: 325-326. 10.4278/0890-1171-7.5.325. Harley A, Devine C, Beard B, Stoddard A, Hunt M, Sorensen G: Multiple health behavior changes in a cancer prevention intervention for construction workers, 2001–2003. Prev Chronic Dis. 2010, 7: A55- Kim A, Kamyab K, Zhu J, Volpp K: Why are financial incentives not effective at influencing some smokers to quit? Results of a process evaluation of a worksite trial assessing the efficacy of financial incentives for smoking cessation. J Occup Environ Med. 2011, 53: 62-67. 10.1097/JOM.0b013e31820061d7. Osuchowski F, Penar-Zadarko B, Bukala-Siedlecka I, Binkowska-Bury M: The opinions of employees about smoking in the workplace. [Polish]. Przegl Lek. 2009, 66: 801-804. Tiede L, Hennrikus D, Cohen B, Hilgers D, Madsen R, Lando HA: Feasibility of promoting smoking cessation in small worksites: an exploratory study. Nicotine Tob Res. 2007, 9: S83-S90. Prochaska JO, Velicer WF: The transtheoretical model of health behavior change. Am J Health Promot. 1997, 12: 38-48. 10.4278/0890-1171-12.1.38. Azjen I: The theory of planned behavior. Organ Behav Hum Decis Process. 1991, 50: 179-211. 10.1016/0749-5978(91)90020-T. Rosenstock IM: Why people use health services. Milbank Mem Fund Q. 1966, 44: 94-127. 10.2307/3348967. Abrams D, Boutwell W, Grizzle J, Heimendinger J: Cancer control at the workplace: The Working Well Trial. Prev Med. 1994, 23: 15-27. 10.1006/pmed.1994.1003. Callaghan R, Herzog T: The relation between processes-of-change and stage-transition in smoking behavior: A two-year longitudinal test of the Transtheoretical Model. Addict Behav. 2006, 31: 1331-1345. 10.1016/j.addbeh.2005.10.011. Oldenburg B, Glanz K, French M: The application of staging models to the understanding of health behaviour change and the promotion of health. Psychol Health. 1999, 14: 503-516. 10.1080/08870449908407343. Hu SC, Lanese R: The applicability of the theory of planned behavior to the intention to quit smoking across workplaces in southern Taiwan. Addict Behav. 1998, 23: 225-237. 10.1016/S0306-4603(97)00045-2. Conrad K, Campbell R, Edington W, Faust H, Vilnius D: The worksite environment as a cue to smoking reduction. Res Nurs Health. 1996, 19: 21-31. 10.1002/(SICI)1098-240X(199602)19:1<21::AID-NUR3>3.0.CO;2-N. Morse JM: Constructing qualitatively derived theory: concept construction and concept typologies. Qual Health Res. 2004, 14: 1395-1404. Carroll C, Booth A, Lloyd-Jones M: Should we exclude inadequately-reported studies from qualitative systematic reviews? an evaluation of sensitivity analyses in Two case study reviews. Qual Health Res. 2012, 22: 1425-1434. 10.1177/1049732312452937. Thomas J, Harden A: Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008, 8: 45-10.1186/1471-2288-8-45. Michie S, Fixsen D, Grimshaw JM, Eccles MP: Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implementation Science. 2009, 4: 40-10.1186/1748-5908-4-40. Michie S, Webb TL, Sniehotta FF: The importance of making explicit links between theoretical constructs and behaviour change techniques. Addiction. 2010, 105: 1897-1898. 10.1111/j.1360-0443.2010.03161.x. Britten N, Campbell R, Pope C, Donovan J, Morgan M, Pill R: Using meta ethnography to synthesise qualitative research: a worked example. J Health Serv Res Policy. 2002, 7: 209-215. 10.1258/135581902320432732. Morse JM: The politics of evidence. Qual Health Res. 2006, 16: 395-404. 10.1177/1049732305285482. Morse JM: The significance of saturation. Qual Health Res. 1995, 5: 147-149. 10.1177/104973239500500201. Booth A, Carroll C, Illott I: Desperately seeking dissonance: identifying the "Disconfirming Case" in qualitative evidence synthesis. Qual Health Res. 2013, 23: 146-241. Boeije H, van Wesel F, Alisic G: Making a difference: towards a method for weighing the evidence in a qualitative synthesis. J Eval Clin Pract. 2011, 17: 657-663. 10.1111/j.1365-2753.2011.01674.x. Popay J, Rogers A, Williams G: Rationale and standards for the systematic review of qualitative literature in health services research. Qual Health Res. 1998, 8: 341-351. 10.1177/104973239800800305. Carroll C, Lloyd-Jones M, Cooke J, Owen JM: Reasons for the use and non-use of school sexual health services: a systematic review of young people's views. J Public Health. 2012 Carroll C, Booth A, Papaioannou D, Sutton A, Wong R: UK Healthcare professionals' experience of e-learning techniques: a systematic review of qualitative data. J Contin Educ Health Prof. 2009, 29: 2135-2141. Noyes J, Popay J: Directly observed therapy and tuberculosis: how can a systematic review of qualitative research contribute to improving services? A qualitative meta-synthesis. J Adv Nurs. 2007, 57: 227-243. 10.1111/j.1365-2648.2006.04092.x. Lucas P, Baird J, Arai L, Law C, Roberts H: Worked examples of alternative methods for the synthesis of qualitative and quantitative research in systematic reviews. BMC Med Res Methodol. 2007, 7: 4-10.1186/1471-2288-7-4. Lorenc T, Pearson M, Jamal F, Cooper C, Garside R: The role of systematic reviews of qualitative evidence in evaluating interventions: a case study. Res Synth Meth. 2012, 3: 1-10. 10.1002/jrsm.1036. Atkins S, Launiala A, Kagaha A, Smith H: Including mixed methods research in systematic reviews: examples from qualitative syntheses in TB and malaria control. BMC Med Res Methodol. 2012, 12: 62-10.1186/1471-2288-12-62. Morse JM: How different is qualitative health research from qualitative research? Do we have a subdiscipline?. Qual Health Res. 2010, 20: 1459-1464. 10.1177/1049732310379116. Thorne S: Toward methodological emancipation in applied health research. Qual Health Res. 2011, 21: 443-453. 10.1177/1049732310392595. Wuest J: Are We there Yet? positioning qualitative research differently. Qual Health Res. 2010, 21: 883- Glanz K, Rimer BK, Lewis FM: Health Behavior and Health Education. 2002, San Francisco: Wiley, 3 Morse JM: Going in "blind.". Qual Health Res. 1994, 4: 3-5. 10.1177/104973239400400101. Owen JM, Carroll C, Cooke J, Formby E, Hayter M, Hirst J: School-Linked Sexual Health Services for Young People (SSHYP): a survey and systematic review concerning current models, effectiveness, cost-effectiveness and research opportunities. Health Technol Assess. 2010, 14: 30- Thomas J, Harden A, Oliver S, Oakley A, Sutcliffe K, Rees R: Integrating qualitative research with trials in systematic reviews: an example from public health. Br Med J. 2004, 328: 1010-1012. 10.1136/bmj.328.7446.1010. Facey K: Patients' perspectives in health technology assessment: a route to robust evidence and fair deliberation. Int J Technol Assess Health Care. 2010, 26: 334-340. 10.1017/S0266462310000395. The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/13/37/prepub