Measurement properties of completely and end labeled unipolar and bipolar scales in Likert-type questions on income (in)equality

Social Science Research - Tập 97 - Trang 102544 - 2021
Jan Karem Höhne1,2, Dagmar Krebs3, Steffen-M. Kühnel4
1Collaborative Research Center SFB 884 “Political Economy of Reforms”, University of Mannheim, B6 30-32, 68131 Mannheim, Germany
2Universitat Pompeu Fabra, Research and Expertise Centre for Survey Methodology, Mercè Rodoreda 24.406, Ramón Trías Fargas, 25-27, 08005 Barcelona, Spain
3University of Giessen, Institute of Sociology, Karl-Glöckner-Straße 21E, 35394 Gießen, Germany
4University of Göttingen, Center of Methods in Social Sciences, Goßlerstraße 19, 37073 Göttingen, Germany

Tài liệu tham khảo

Alwin, 2007 Alwin, 2010, How good is survey measurement? Assessing the reliability and validity of survey measures, 405 Blom, 2015, Setting up an online panel representative of the general population: the German internet panel, Field Methods, 27, 391, 10.1177/1525822X15574494 Bryant, 2012, Principles and practice of scaled difference chi-square testing, Struct. Equ. Model., 19, 372, 10.1080/10705511.2012.687671 Byrne, 2012 Carpenter, 1975, Sentence comprehension: a psycholinguistic pro-cessing model of verification, Psychol. Rev., 82, 45, 10.1037/h0076248 Cheung, 2002, Evaluating goodness-of-fit indexes for testing measurement invariance, Struct. Equ. Model., 9, 233, 10.1207/S15328007SEM0902_5 Converse, 1986 DeCastellarnau, 2018, A classification of response scale characteristics that affect data quality: a literature review, Qual. Quantity, 52, 1523, 10.1007/s11135-017-0533-4 Fowler, 1995 Fowler, 2008, Writing effective questions, 136 Höhne, 2019, Eye-tracking methodology: exploring the processing of question formats in web surveys, Int. J. Soc. Res. Methodol., 22, 199, 10.1080/13645579.2018.1515533 Höhne, 2018, Scale direction effects in agree/disagree and item-specific questions: a comparison of question formats, Int. J. Soc. Res. Methodol., 21, 91, 10.1080/13645579.2017.1325566 Höhne, 2020, Measuring income (in)equality: comparing survey questions with unipolar and bipolar scales in a probability-based online panel, Soc. Sci. Comput. Rev. Höhne, 2018, New insights on the cognitive processing of agree/disagree and item-specific questions, J. Surv. Statis. Methodol., 6, 401, 10.1093/jssam/smx028 Höhne, 2019, Re-examining the middle means typical and the left and top means first heuristics using eye-tracking methodology, J. Surv. Statis. Methodol. Höhne, 2020, Investigating the impact of violations of the “left and top means first” heuristic on response behavior and data quality, Int. J. Soc. Res. Methodol., 23, 347, 10.1080/13645579.2019.1696087 Krosnick, 1997, Designing rating scales for effective measurement in surveys, 141 Krosnick, 2010, Question and questionnaire design, 263 Kuru, 2016, Improving social media measurement in surveys: avoiding acquiescence bias in facebook research, Comput. Hum. Behav., 57, 82, 10.1016/j.chb.2015.12.008 Lelkes, 2015, Much ado about acquiescence: the relative validity and reliability of construct-specific and agree-disagree questions, Res. Pol. Likert, 1932, A technique for the measurement of attitudes, Arch. Psychol., 140, 1 Liu, 2015, Comparing extreme response styles between agree-disagree and item-specific scales, Publ. Opin. Q., 79, 952, 10.1093/poq/nfv034 Menold, 2019, Response bias and reliability in verbal agreement rating scales: does polarity and verbalization of the middle category matter?, Soc. Sci. Comput. Rev. Menold, 2015 Menold, 2014, How do respondents attend to verbal labels in rating scales?, Field Methods, 26, 21, 10.1177/1525822X13508270 Menold, 2015, Can reliability of multiple component measuring instruments depend on response option presentation mode?, Educ. Psychol. Meas., 76, 454, 10.1177/0013164415593602 Mohler, 1998, Respondents' ratings of expressions from response scales: a two country, two language investigation on equivalence and translation, 159 O'Muircheartaigh, 1995, Weighing anchors: verbal and numeric labels for response scales, J. Off. Stat., 11, 295 Parducci, 1983, Category ratings and the relational character of judgment, 262 Revilla, 2014, Choosing the number of categories in agree-disagree scales, Socio. Methods Res., 43, 73, 10.1177/0049124113509605 Rhemtulla, 2012, When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions, Psychol. Methods, 17, 354, 10.1037/a0029315 Rohrmann, 1978, Empirische studien zur entwicklung von antwortskalen für die sozialwissenschaftliche forschung, Z. für Sozialpsychol., 9, 222 Rost, 1988, Measuring attitudes with a threshold model drawing on a traditional scaling concept, Appl. Psychol. Meas., 12, 397, 10.1177/014662168801200408 Saris, 2014 Saris, 2010, Comparing questions with agree/disagree response options to questions with item-specific response options, Surv. Res. Methods, 4, 61 Schaeffer, 2020, Advances in the science of asking questions, Annu. Rev. Sociol., 46, 10, 10.1146/annurev-soc-121919-054544 Schaeffer, 2003, The science of asking questions, Annu. Rev. Sociol., 29, 65, 10.1146/annurev.soc.29.110702.110112 Scholz Schwarz, 1996 Schwarz, 1991, Rating scales numeric values may change the meaning of scale labels, Publ. Opin. Q., 55, 570, 10.1086/269282 Stevens, 1946, On the theory of scales of measurement, Science, 103, 677, 10.1126/science.103.2684.677 Sturgis, 2014, Middle alternatives revisited: how the neither/nor response acts as a way of saying “I don't know”?, Socio. Methods Res., 43, 15, 10.1177/0049124112452527 Sudman, 1996 Thomas, 2018, We’ve got your number: can numeric labels replace semantic labels in scales Toepoel, 2011, How visual design affects the interpretability of survey questions, 165 Toepoel, 2011, Words, numbers, and visual heuristics in web surveys: is there a hierarchy of importance?, Soc. Sci. Comput. Rev., 29, 193, 10.1177/0894439310370070 Tourangeau, 2004, Spacing, position, and order: interpretive heuristics for visual features of survey questions, Publ. Opin. Q., 68, 368, 10.1093/poq/nfh035 Tourangeau, 2007, Color, labels, and interpretive heuristics for response scales, Publ. Opin. Q., 71, 91, 10.1093/poq/nfl046 Tourangeau, 2000 van Vaerenbergh, 2013, Response styles in survey research: a literature review of antecedents, consequences, and remedies, Int. J. Publ. Opin. Res., 25, 195, 10.1093/ijpor/eds021 Wang, 2020, Middle alternatives and measurement validity: a recommendation for survey researchers, Int. J. Soc. Res. Methodol., 23, 169, 10.1080/13645579.2019.1645384 Wetzel, 2014, Reversed thresholds in partial credit models: a reason for collapsing categories?, Assessment, 21, 765, 10.1177/1073191114530775