Scanning for satisfaction or digging for dismay? Comparing findings from a postal survey with those from a focus group-study
Tóm tắt
Despite growing support for mixed methods approaches we still have little systematic knowledge about the consequences of combining surveys and focus groups. While the methodological aspects of questionnaire surveys have been researched extensively, the characteristics of focus group methodology are understudied. We suggest and discuss whether the focus group setting, as compared to questionnaire surveys, encourages participants to exaggerate views in a negative direction. Based on an example from our own research, where we conducted a survey as a follow up of a focus group study, and with reference to theoretical approaches and empirical evidence from the literature concerning survey respondent behaviour and small group dynamics, we discuss the possibility that a discrepancy in findings between the focus groups and the questionnaire reflects characteristics of the two different research methods. In contrast to the survey, the focus group study indicated that doctors were generally negative to clinical guidelines. We were not convinced that this difference in results was due to methodological flaws in either of the studies, and discuss instead how this difference may have been the result of a general methodological phenomenon. Based on studies of how survey questionnaires influence responses, it appears reasonable to claim that surveys are more likely to find exaggerated positive views. Conversely, there are some indications in the literature that focus groups may result in complaints and overly negative attitudes, but this is still an open question. We suggest that while problematic issues tend to be under-communicated in questionnaire surveys, they may be overstated in focus groups. We argue for the importance of increasing our understanding of focus group methodology, for example by reporting interesting discrepancies in mixed methods studies. In addition, more experimental research on focus groups should be conducted to advance the methodology and to test our hypothesis.
Tài liệu tham khảo
Johansen I, Carlsen B, Hunskaar S: Psychiatry out-of-hours: a focus group study of GPs' experiences in Norwegian casualty clinics. BMC Heal Serv Res. 2011, 11 (1): 132-10.1186/1472-6963-11-132.
Helitzer-Allen DL, Kendall C: Explaining differences between qualitative and quantitative data: a study of chemoprophylaxis during pregnancy. Health Educ Behav. 1992, 19 (1): 41-54. 10.1177/109019819201900104.
Morgan DL: Focus groups as qualitative research, vol. 16. 1997, Sage Publications, Thousand Oaks, 2
Forthofer MS: Status of mixed methods in the health sciences. Handbook of mixed methods in social and behavioural research. Edited by: Tashakkori A, Teddlie C. 2003, Sage Publications, London, 527-540.
Hines AM: Linking qualitative and quantitative methods in cross-cultural survey research: techniques from cognitive science. Am J Community Psychol. 1993, 21 (6): 729-746. 10.1007/BF00942245.
O'Cathain A: Editorial: mixed methods research in the health sciences: a quiet revolution. Journal of Mixed Methods Research. 2009, 3 (1): 3-6. 10.1177/1558689808326272.
O'Donnell AB, Lutfey KE, Marceau LD, McKinlay JB: Using focus groups to improve the validity of cross-national survey research: a study of physician decision making. Qual Heal Res. 2007, 17 (7): 971-981. 10.1177/1049732307305257.
Mendlinger S, Cwikel J: Spiraling between qualitative and quantitative data on women's health behaviors: a double helix model for mixed methods. Qual Heal Res. 2008, 18 (2): 280-293. 10.1177/1049732307312392.
Mays N, Pope C: Qualitative research: rigour and qualitative research. BMJ. 1995, 311 (6997): 109-112. 10.1136/bmj.311.6997.109.
Morgan DL: Focus groups. Annu Rev Sociol. 1996, 22 (1): 129-152. 10.1146/annurev.soc.22.1.129.
Bernard HR, Killworth P, Kronenfeld D, Sailer L: The problem of informant accuracy: the validity of retrospective data. Annu Rev Anthropol. 1984, 13: 495-517. 10.1146/annurev.an.13.100184.002431.
Schuman H, Johnson MP: Attitudes and behavior. Annu Rev Sociol. 1976, 2: 161-207. 10.1146/annurev.so.02.080176.001113.
The science of self report. Implications for research and practice. Edited by: Stone AA, Turkkan JS, Bachrach CA, Jobe JB, Kurtzman HS, Cain VS. 2000, Lawrence Erlbaum Associates, Mahwah
Sudman S, Bradburn NM: A review and synthesis. 1974, Aldine Pub. Co., Chicago
Carlsen B, Glenton C: What about N? a methodological study of sample-size reporting in focus group studies. BMC Med Res Methodol. 2011, 11 (1): 26-10.1186/1471-2288-11-26.
Fern EF: The Use of Focus Groups for Idea Generation: The Effects of Group Size, Acquaintanceship, and Moderator on Response Quantity and Quality. J Mark Res. 1982, 19 (1): 1-13. 10.2307/3151525.
Hyde A, Howlett E, Brady D, Drennan J: The focus group method: insights from focus group interviews on sexual health with adolescents. Soc Sci Med. 2005, 61 (12): 2588-2599. 10.1016/j.socscimed.2005.04.040.
Successful focus groups. Advancing the state of the art. Edited by: Morgan DL. 1993, SAGE, Newbury Park
Fern EF: Focus groups: a review of some contradictory evidence, implications, and suggestions for future research. Adv Consum Res. 1983, 10: 121-126.
Albrecht TL, Johnson GM, Walther JB: Understanding communication processes in focus groups. Successful focus groups advancing the state of the art. Edited by: Morgan DL. 1993, Sage Publications, Newbury Park, 51-64.
Carlsen B: The last frontier? autonomy, uncertainty and standardisation in general practice. Heal Sociol Rev. 2010, 19 (2): 260-272. 10.5172/hesr.2010.19.2.260.
Carlsen B, Bringedal B: Attitudes to clinical guidelines - do GPs differ from other medical doctors?. BMJ Quality & Safety. 2011, 20 (2): 158-162. 10.1136/bmjqs.2009.034249. qshc.2009.034249
Carlsen B, Kjellberg P: Guidelines; from foe to friend? comparative interviews with GPs in Norway and Denmark. BMC Heal Serv Res. 2010, 10 (1): 17-10.1186/1472-6963-10-17.
Carlsen B, Norheim OF: "What lies beneath it all?" an interview study of GPs' attitudes to the use of guidelines. BMC Heal Serv Res. 2008, 8: 218-10.1186/1472-6963-8-218.
Green J, Thorogood N: Qualitative methods for health research. 2004, Sage, London
NAV [The Norwegian Labour and Welfare Organisation]: Fastlegeordningen, Hovedtallsrapport [The regular GP scheme, Key statistical report.]. 2007, , Oslo, http://www.nav.no/page?id=1073743257Accessed May 2007
Brown L, Tyane M, Bertrand J, Don L, Abou-ouakil M, de Maria L: Quality of care in family planning services in Morocco. Stud Fam Plan. 1995, 26 (3): 154-168. 10.2307/2137834.
Sommer B, Sommer R: A Practical Guide to Behavioral Research. 1997, Oxford University Press, Oxford
Farquhar CM, Kofa EW, Slutsky JR: Clinicians' attitudes to clinical practice guidelines: a systematic review. Med J Aust. 2002, 177 (9): 502-506.
Adams AS, Soumerai SB, Lomas J, Ross-Degnan D: Evidence of self-report bias in assessing adherence to guidelines. Int J Qual Health Care. 1999, 11 (3): 187-192. 10.1093/intqhc/11.3.187.
Kitzinger J: Qualitative research: introducing focus groups. BMJ. 1995, 311 (7000): 299-302. 10.1136/bmj.311.7000.299.
Isenberg DJ: Group polarization: a critical review and meta-analysis. J Personal Soc Psychol. 1986, 50 (6): 1141-1151.
Asch SE: Group forces in the modification and distortion of judgements. Social Psychology. 1952, Prentice-Hall, Englewood Cliffs
Hollander JA: The social contexts of focus groups. J Contemp Ethnogr. 2004, 33 (5): 602-637. 10.1177/0891241604266988.
Stewart DW, Shamdasani PN, Rook DW: Focus groups. theory and practice, vol. 20. 2007, Sage Publications, Thousand Oaks
The SAGE Handbook of Qualitative Research. Edited by: Denzin NK, Lincoln YS. 2005, Sage Publications, Thousand Oaks, 3
Robson C: Real World Research: A Resource for Social Scientists and Practitioner–Researchers. 2002, Blackwell Publishers, Oxford
Morgan DL, Krueger RA: When to use focus groups and why. Successful focus groups Advancing the state of the art. Edited by: Morgan DL. 1993, Sage Publications, Newbury Park
Baron RS, Hoppe SI, Kao CF, Brunsman B, Linneweh B, Rogers D: Social corroboration and opinion extremity. J Exp Soc Psychol. 1996, 32 (6): 537-560. 10.1006/jesp.1996.0024.
Sussman S, Burton D, Dent CW, Stacy AW, Flay BR: Use of focus groups in developing an adolescent tobacco use cessation program: collective norm effects1. J Appl Soc Psychol. 1991, 21 (21): 1772-1782. 10.1111/j.1559-1816.1991.tb00503.x.
Hogg MA, Turner JC, Davidson B: Polarized norms and social frames of reference: a test of the self-categorization theory of group polarization. Basic and Applied Social Psychology. 1990, 11 (1): 77-100. 10.1207/s15324834basp1101_6.
Stycos JM: A critique of focus group and survey research: the machismo case. Stud Fam Plan. 1981, 12 (12): 450-456. 10.2307/1965657.
Gaskell G: Individual and group interviewing. Qualitative researching. Edited by: Bauer MW, Gaskell G. 2005, Sage Publications, London, 38-56.
Obeng-Quaidoo I: New development-oriented models of communication research/or Africa: the case for focus group research in Africa. Africa Media Review. 1987, 1 (2): 52-65.
Watts M, Ebbutt D: More than the sum of the parts: research methods in group interviewing. Br Educ Res J. 1987, 13 (1): 25-34. 10.1080/0141192870130103.
Lewin S, Glenton C, Oxman AD: Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009, 339: b3496-10.1136/bmj.b3496.
Mays N, Pope C: Assessing quality in qualitative research. BMJ. 2000, 320 (7226): 50-52. 10.1136/bmj.320.7226.50.
Harding S: Whose science? Whose knowledge?. 1991, Cornell University Press, Cornell
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/12/134/prepub