Sensitive questions and response effects: an evaluation

Journal of Managerial Psychology - Tập 13 Số 1/2 - Trang 63-76 - 1998
JulieBarnett1
1Social Psychology European Research Institute, University of Surrey, Guildford, UK

Tóm tắt

The literature relating to asking sensitive questions in surveys is reviewed and evaluated. It is argued that work relating to the nature of associated response effects and the development of strategies designed to cope with these embodies a number of largely unexamined assumptions. These are identified in three main areas. First, clarification is necessary in relation to the way in which sensitivity is defined and operationalised. Second, the relationship between sensitivity and context is explored with particular reference to identity. Finally, some of the implications of the link between assurances of anonymity and responses to sensitive questions are explored. In conclusion it is suggested that the benefits of methodology sophistication will be most apparent in the context of the theoretical development of these issues.

Từ khóa


Tài liệu tham khảo

Akers, R.L., Massey, W., Clarke, W. and Lauer, R.M. (1983, “Are self‐reports of adolescent deviance valid? Biochemical measures, randomized response, and the bogus pipeline technique”, Social Forces, Vol. 62, pp. 234‐51.

Barth, J.T. and Sandler, H.M. (1976, “Evaluation of the randomized response technique in a drinking survey”, Journal of Studies on Alcohol, Vol. 37, pp. 690‐3.

Barton, A.J. (1958, “Asking the embarrassing question”, Public Opinion Quarterly, Vol. 22, p. 67.

Becker, G. and Bakal, D.A. (1970, “Subject anonymity and motivational distortion in self‐report data”, Journal of Clinical Psychology, Vol. 26, pp. 207‐09.

Blair, E., Sudman, S., Bradburn, N.M. and Stocking, C. (1977, “How to ask questions about drinking and sex: response effects in measuring consumer behavior”, Journal of Marketing Research, Vol. XIV, pp. 316‐21.

Bradburn, N.M. (1983, “Response effects”, in Rossi, P.H., Wright, J.D. and Anderson, A.B. (Eds), Handbook of Survey Research, Academic Press, New York, NY.

Bradburn, N.M. and Sudman, S. (1979, Improving Interview Method and Questionnaire Design, Jossey‐Bass, San Francisco, CA.

Bradburn, N.M., Sudman, S., Blair, E. and Stocking, C. (1989, “Question threat and response bias”, in Singer, E. and Presser, S. (Eds), Survey Research Methods: A Reader, University of Chicago Press, Chicago and London, pp. 371‐84.

Buchman, T.A. and Tracy, J.A. (1982, “Obtaining responses to sensitive questions: conventional questionnaire versus randomized response technique”, Journal of Accounting Research, Vol. 20, pp. 263‐71.

Campbell, M.J. and Waters, W.E. (1990, “Does anonymity increase response rate in postal questionnaire surveys about sensitive subjects? A randomised trial”, Journal of Epidemiology and Community Health, Vol. 44, pp. 75‐6.

Catania, J.A., Gibson, D.R., Chitwood, D.D. and Coates, T.J. (1990, “Methodological problems in AIDS behavioral research: influences on measurement error and participation bias in studies of sexual behavior”, Psychological Bulletin, Vol. 108, pp. 339‐62.

Cavanagh, G.F. and Fritzsche, D.J. (1985, “Using vignettes in business ethics research”, Research in Corporate Social Performance and Policy, Vol. 7, pp. 279‐93.

Crino, M.D., Rubenfeld, S.A. and Willoughby, F.W. (1985, “The random response technique as an indicator of questionnaire item social desirability/personal sensitivity”, Educational and Psychological Measurement, Vol. 45, pp. 453‐68.

Fidler, D.S. and Kleinknecht, R.E. (1977, “Randomized response versus direct questioning: two data‐collection methods for sensitive information”, Psychological Bulletin, Vol. 84, pp. 1045‐49.

Ford, K. and Norris, A. (1991, “Methodological considerations for survey research on sexual behavior: urban African American and Hispanic youth”, Journal of Sex Research, Vol. 28, pp. 539‐55.

Fuller, C. (1974, “Effect of anonymity on return rate and response bias in a mail survey”, Journal of Applied Psychology, Vol. 59, pp. 292‐6.

Futrell, C.M. and Swan, J.E. (1977, “Anonymity and response by salespeople to a mail questionnaire”, Journal of Marketing Research, Vol. 14, pp. 611‐16.

Ganster, D.C., Hennessey, H.W and Luthans, F. (1983, “Social desirability response effects: three alternative models”, Academy of Management Journal, Vol. 26, pp. 321‐31.

Giles, W.F. and Feild, H.S. (1978, “Effects of amount, format, and location of demographic information on questionnaire return rate and response bias of sensitive and nonsensitive items”, Personnel Psychology, Vol. 31, pp. 549‐59.

Hippler, H.J., Schwarz, N. and Sudman, S. (1987, Social Information Processing and Survey Methodology, Springer‐Verlag, New York, NY.

Hoppe, M.J., Wells, E.A., Morrison, D.M. and Gillmore, M.R. (1995, “Using focus groups to discuss sensitive topics with children”, Evaluation Review, Vol. 19, pp. 102‐14.

Hosseini, J.C. and Armacost, R.L. (1993a, “Gathering sensitive data in organizations”, Special Issue: Improving organizational surveys: New directions and methods, American Behavioral Scientist, Vol. 36, pp. 443‐71.

Hosseini, J.C. and Armacost, R.L. (1993b, “Gathering sensitive data in organizations”, in Rosenfeld, P., Edwards, J.E. and Thomas, M.D. (Eds), Improving Organizational Surveys: New Directions, Methods, and Applications, Sage, Newbury Park, CA, pp. 29‐57.

Jabine, T.B., Straf, M.L., Tanur, J.M. and Tourangeau, R. (1984, Cognitive Aspects of Survey Methodology: Building a Bridge between Disciplines, National Academy Press, Washington, DC.

Jobe, J.B. and Mingay, D.J. (1991, “Cognition and survey measurement: history and overview”, Special Issue: Cognition and Survey Measurement, Applied Cognitive Psychology, Vol. 5, pp. 175‐92.

Johnson, W.T. and DeLamater, J.D. (1976, “Response effects in sex surveys”, Public Opinion Quarterly, Vol. 40, pp. 165‐81.

Lamb, C.W. and Stem, D.E. (1978, “An empirical validation of the randomized response technique”, Journal of Marketing Research, Vol. 15, pp. 616‐21.

Lautenschlager, G.J. and Flaherty, V.L. (1990, “Computer administration of questions: more desirable or more social desirability?”, Journal of Applied Psychology, Vol. 75, pp. 310‐14.

Lee, R.M. (1993, Doing Research on Sensitive Topics, Sage, London.

Linden, L.E. and Weiss, D.J. (1994, “An empirical assessment of the random response method of sensitive data collection”, Journal of Social Behavior and Personality, Vol. 9, pp. 823‐36.

Locander, W., Sudman, S. and Bradburn, N. (1976, “An investigation of interview method, threat and response distortion”, Journal of the American Statistical Association, Vol. 71 No. 354, pp. 269‐75.

McDaniel, S.W. and Rao, C.P. (1981, “An investigation of respondent anonymity’s effect on mailed questionnaire response rate and quality”, Journal of the Market Research Society, Vol. 23, pp. 150‐60.

Marquis, K.M. (1984, “Record checks for sample surveys”, in Jabine, T.B., Straf, M.L., Tanur, J.M. and Tourangeau, R. (Eds), Cognitive Aspects of Survey Methodology: Building a Bridge between Disciplines, National Academy Press, Washington, DC.

Martin, C.L. and Nagao, D.H. (1989, “Some effects of computerized interviewing on job applicant responses”, Journal of Applied Psychology, Vol. 74, pp. 72‐80.

Mays, V.M. and Jackson, J.S. (1991, “AIDS survey methodology with Black Americans”, Social Science and Medicine, Vol. 33, pp. 47‐54.

Millstein, S.G. (1987, “Acceptability and reliability of sensitive information collected via computer interview”, Educational and Psychological Measurement, Vol. 47, pp. 523‐33.

Renzetti, C.M. and Lee, R.M. (1993, Researching Sensitive Topics, Sage, London.

Rodgers, J.L., Billy, J.O. and Udry, J.R. (1982, “The rescission of behaviors: inconsistent responses in adolescent sexuality data”, Social Science Research, Vol. 11, pp. 280‐96.

Rosenfeld, P.E., Edwards, J.E. and Thomas, M.D. (1993, Improving Organizational Surveys: New Directions, Methods, and Applications, Sage, Newbury Park, CA.

Scheers, N.J. (1992, “A review of randomized response techniques”, Measurement and Evaluation in Counseling and Development, Vol. 25, pp. 27‐41.

Schoderbek, P.P. and Deshpande, S.P. (1996, “Impression management, overclaiming, and perceived unethical conduct: the role of male and female managers”, Journal of Business Ethics, Vol. 15 No. 4, p. 409.

Schuman, H. (1992, “Context effects: state of the past/state of the art”, in Schwarz, N. and Sudman, S. (Eds), Context Effects in Social and Psychological Research, Springer Verlag, New York, NY, pp. 5‐20.

Schwarz, N. and Sudman, S. (1992, Context Effects in Social and Psychological Research, Springer Verlag, New York, NY.

Singer, E. (1978, “Informed consent: consequences for response rate and response quality in social surveys”, American Sociological Review, Vol. 43 No. 43, pp. 144‐62.

Sirken, M. and Fuchsberg, R. (1984, “Laboratory‐based research on the cognitive aspects of survey methodology”, in Jabine, T.B., Straf, M.L., Tanur, J.M. and Tourangeau, R. (Eds), Cognitive Aspects of Survey Methodology: Building a Bridge between Disciplines, National Academy Press, Washington, DC.

Smith, R. (1996, “Capturing sensitive data from young people in a household setting”, Journal of the Market Research Society, Vol. 38 No. 2, p. 177.

Soeken, K.L. (1987, “Randomized response methodology in health research”, Evaluation & the Health Professions, Vol. 10, pp. 58‐66.

Soeken, K.L. and Damrosch, S.P. (1986, “Randomized response technique: applications to research on rape”, Psychology of Women Quarterly, Vol. 10, pp. 119‐25.

Soeken, K.L. and Macready, G.B. (1982, “Respondents’ perceived protection when using randomized response”, Psychological Bulletin, Vol. 92, pp. 487‐9.

Sudman, S. and Bradburn, N.M. (1974, Response Effects in Surveys: A Review and Synthesis, Aldine, Chicago.

Sudman, S. and Bradburn, N.M. (1982, Asking Questions: A Practical Guide to Questionnaire Design, Jossey‐Bass, San Francisco, CA.

Sudman, S., Bradburn, N.M. and Schwarz, N. (1996, Thinking about Answers: The Application of Cognitive Processes to Survey Methodology, Jossey‐Bass, San Francisco, CA.

Sudman, S., Blair, E., Bradburn, N. and Stocking, C. (1977, “Estimates of threatening behavior based on reports of friends”, Public Opinion Quarterly, Vol. 41, pp. 261‐4.

Swan, J.E. and Epley, D.E. (1981, “Completion and response rates for different forms of income questions in a mail survey”, Perceptual and Motor Skills, Vol. 52, pp. 219‐22.

Tracy, P.E. and Fox, J.A. (1981, “The validity of randomized response for sensitive measurements”, American Sociological Review, Vol. 46, pp. 187‐200.

Umesh, U.N. and Peterson, R.A. (1991, “A critical evaluation of the randomized response method: applications, validation, and research agenda”, Sociological Methods and Research, Vol. 20 No. 1, pp. 104‐38.

Vinten, G. (1995, “The art of asking threatening questions”, Management Decision, Vol. 33 No. 7, pp. 35‐9.

Warner, S.L. (1965, “Randomized response: a survey technique for eliminating evasive answer bias”, Journal of the American Statistical Association, Vol. 60, pp. 63‐9.

Will, V., Eadie, D. and MacAskill, S. (1996, “Projective and enabling techniques explored”, Marketing Intelligence & Planning, Vol. 14 No. 6, p. 38.

Williams, B.L. and Suen, H. (1994, “A methodological comparison of survey techniques in obtaining self‐reports of condom‐related behaviors”, Psychological Reports, Vol. 75, pp. 1531‐7.

Williams, B.L., Suen, H.K. and Baffi, C.R. (1993, “A controlled randomized response technique”, Evaluation and the Health Professions, Vol. 16, pp. 225‐38.

Zdep, S.M., Rhodes, I.N., Schwarz, R.M. and Kilkenny, M.J. (1979, “The validity of the randomized response technique”, Public Opinion Quarterly, Vol. 43, pp. 544‐9.

Zerbe, W.J. and Paulhus, D.L. (1987, “Socially desirable responding in organizational behaviour: a reconception”, Academy of Management Review, Vol. 12, pp. 250‐64.