Vote overreporting in national election surveys: a 55-nation exploratory study
Tóm tắt
Election turnout is central to the health of a democracy, yet measuring it accurately in national election surveys presents major problems. Surveys show that respondents consistently overreport their turnout, usually by between 10 and 20 percentage points. To date, most research has been conducted on the United States, and what little comparative research exists has typically covered a small number of countries. In this paper, we present the largest comparative study yet undertaken on turnout overreporting. By utilizing 20 years of data from the Comparative Study of Electoral Systems (CSES), we analyse 184 elections across 55 different states. We examine the importance of the survey method and the election context as explanations for overreporting. The results suggest that aspects of both may shape the degree of error. These exploratory results provide a corrective to current studies by showing that institutional and contextual factors may be at least as important as survey method in shaping overreporting.
Tài liệu tham khảo
Adida, C., J. Gottlieb, E. Kramon, and G. McClendon. 2019. Response Bias in Survey Measures of Voter Behavior: Implications for Measurement and Inference. Journal of Experimental Political Science 6 (3): 192–198.
Andersson, H.E., and D. Granberg. 1997. On the Validity and Reliability of Self-Reported Vote: Validity without Reliability. Quality and Quantity 31 (2): 127–140.
Belli, R.F., S.E. Moore, and J. Van Hoewyk. 2006. An Experimental Comparison of Question forms Used to Reduce Vote Overreporting. Electoral Studies 25 (4): 751–759.
Belli, R.F., M. Traugott, M. Young, and K. McGonagle. 1999. Reducing Vote Overreporting in Surveys: Social Desirability, Memory Failure, and Source Monitoring. Public Opinion Quarterly 63 (1): 90–108.
Belli, R.F., M.W. Traugott, and M.N. Beckmann. 2001. What Leads to Voting Overreports? Contrasts of Overreporters to Validated Voters and Admitted Nonvoters in the American National Election Studies. Journal of Official Statistics 17 (4): 479–498.
Berent, M.K., J.A. Krosnick, and A. Lupia. 2016. Measuring Voter Registration and Turnout in Surveys: Do Official Government Records Yield More Accurate Assessments? Public Opinion Quarterly 80 (3): 597–621.
Bernstein, R., A. Chadha, and R. Montjoy. 2001. Overreporting Voting: Why It Happens and Why It Matters. Public Opinion Quarterly 65 (1): 22–44.
Blais, A. 2007. Turnout in Elections. In The Oxford Handbook of Political Behavior, ed. H.D. Klingemann and R.J. Dalton. Oxford: Oxford University Press.
Blais, A., and D. Rubenson. 2013. The Source of Turnout Decline New Values or New Contexts? Comparative Political Studies 46 (1): 95–117.
Blondel, J., R. Sinnott, and P. Svensson. 1998. People and Parliament in the European Union: Democracy, Participation and Legitimacy. Oxford: Oxford University Press.
Burden, B.C. 2000. Voter Turnout and the National Election Studies. Political Analysis 8 (4): 389–398.
Chapman, E.B. 2019. The Distinctive Value of Elections and the Case for Compulsory Voting. American Journal of Political Science 63 (1): 101–112.
Church, A.H. 1993. Estimating the Effect of Incentives on Mail Survey Response Rates: A Meta-Analysis. Public Opinion Quarterly 57 (1): 62–79.
CSES. 2018. The Comparative Study of Electoral Systems Integrated Module Dataset (CSES IMD) First Release. http://www.cses.org/ accessed May 14, 2019.
CSES. 2019. The Comparative Study of Electoral Systems Module 5 First Advance Release. https://cses.org/data-download/cses-module-5-2016-2021/ accessed May 22, 2019.
Dahlgaard, J., J. Hansen, K. Hansen, and Y. Bhatti. 2019. Bias in Self-reported Voting and How it Distorts Turnout Models: Disentangling Nonresponse Bias and Overreporting Among Danish Voters. Political Analysis 27 (4): 590–598.
Dalton, R.J. 2008. The Quantity and the Quality of Party Systems: Party System Polarization, Its Measurement, and Its Consequences. Comparative Political Studies 41 (7): 899–920.
Dassonneville, R., and M. Hooghe. 2017. Voter Turnout Decline and Stratification: Quasiexperimental and Comparative Evidence of a Growing Educational Gap. Politics 37 (2): 184–200.
DeBell, M., and J. Cowden. 2010. Benchmark Report for the 2008 American National Election Studies Time Series and Panel Study. ANES Technical Report Series. Ann Arbor, MI: Centre for Political Studies.
DeBell, M., J.A. Krosnick, K. Gera, D.S. Yeager, and M.P. McDonald. 2020. The Turnout Gap in Surveys: Explanations and Solutions. Sociological Methods & Research 49 (4): 1133–1162.
Enamorado, T., and K. Imai. 2019. Validating Self-Reported Turnout by Linking Public Opinion Surveys with Administrative Records. Public Opinion Quarterly 83 (4): 723–748.
Gimpel, J.G., K.M. Kaufmann, and S. Pearson-Merkowitz. 2007. Battleground States Versus Blackout States: The Behavioral Implications of Modern Presidential Campaigns. Journal of Politics 69 (3): 786–779.
Gorecki, M.A. 2011. Why Bother Lying When You Know So Few Care? Party Contact, Education and Over-Reporting Voter Turnout in Different Types of Elections. Scandinavian Political Studies 34 (3): 250–267.
Granberg, D., and S. Holmberg. 1991. Self-Reported Turnout and Voter Validation. American Journal of Political Science 35 (2): 448–459.
Groves, R.M. 2006. Nonresponse Rates and Nonresponse Bias in Household Surveys. Public Opinion Quarterly 70 (5): 646–675.
Groves, R.M., and M. Peytcheva. 2008. The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-analysis. Public Opinion Quarterly 72 (1): 167–189.
Holbrook, A.L., and J.A. Krosnick. 2010. Social Desirability Bias in Voter Turnout Reports: Tests Using the Item Count Technique. Public Opinion Quarterly 74 (1): 37–67.
Holbrook, A.L., C. Green, and J.A. Krosnick. 2003. Telephone Versus Face-to-face Interviewing of National Probability Samples with Long Questionnaires: Comparisons of Respondent Satisficing and Social Desirability Bias. Public Opinion Quarterly 67 (1): 79–125.
Hooghe, M., and A. Kern. 2017. The Tipping Point between Stability and Decline: Trends in Voter Turnout, 1950–1980–2012. European Political Science 16 (4): 535–552.
Jackman, S., and B. Spahn. 2019. Why Does the American National Election Study Overestimate Voter Turnout? Political Analysis 27 (2): 193–207.
Karp, J.A., and D. Brockington. 2005. Social Desirability and Response Validity: A Comparative Analysis of Overreporting Voter Turnout in Five Countries. Journal of Politics 67 (3): 825–840.
Kennedy, C., et al. 2018. An Evaluation of the 2016 Election Polls in the United States. Public Opinion Quarterly 82 (1): 1–33.
Klingemann, H.D. 1999. The Comparative Study of Electoral Systems. Oxford: Oxford University Press.
Laakso, M., and R. Taagepera. 1979. Effective Number of Parties: A Measure with Application to Western Europe. Comparative Political Studies 12 (1): 3–27.
Lavrakas, P.J. 2007. Surveys by Telephone. In The Sage Handbook of Public Opinion Research, ed. W. Donsbach and M.W. Traugott. London: Sage.
McDonald, M.P. 2005. Reporting Bias. In Polling in America: An Encyclopedia of Public Opinion, ed. B. Radcliff and S. Best. Westport, CT: Greenwood Press.
Martinez, M.D. 2003. Comment on ‘Voter Turnout and the National Election Studies.’ Political Analysis 11 (1): 187–192.
Morin-Chassé, A. 2018. How to Survey About Electoral Turnout? Additional Evidence. Journal of Experimental Political Science 5 (3): 230–233.
Morin-Chassé, A., D. Bol, L.B. Stephenson, and S. Labbé St-Vincent. 2017. How to Survey About Electoral Turnout? The Efficacy of the Face-Saving Response Items in 19 Different Contexts. Political Science Research and Methods 5 (3): 575–584.
Mummolo, J., and E. Peterson. 2018. Improving the Interpretation of Fixed Effects Regression Results. Political Science Research and Methods 6 (4): 829–835.
Rallings, C., M. Thrasher, and G. Borisyuk. 2003. Seasonal Factors, Voter Fatigue and the Costs of Voting. Electoral Studies 22 (1): 65–79.
Sciarini, P., and A.C. Goldberg. 2016. Turnout Bias in Postelection Surveys: Political Involvement, Survey Participation, and Voter Overreporting. Journal of Survey Statistics and Methodology 4 (1): 110–137.
Sciarini, P., and A.C. Goldberg. 2017. Lost on the Way: Nonresponse and its Influence on Turnout Bias in Postelection Surveys. International Journal of Public Opinion Research 29 (2): 291–315.
Selb, P., and S. Munzert. 2013. Voter Overrepresentation, Vote Overreporting, and Turnout Bias in Postelection Surveys. Electoral Studies 32 (1): 186–196.
Shino, E., M.D. Martinez, M.P. McDonald, and D.A. Smith. 2020. Verifying Voter Registration Records: Part of Special Symposium on Election Sciences. American Politics Research 48 (6): 677–681.
Stocke, V. 2007. Response Privacy and Elapsed Time Since Election Day as Determinants for Vote Overreporting. International Journal of Public Opinion Research 19 (2): 237–246.
Stocke, V., and T. Stark. 2007. Political Involvement and Memory Failure as Interdependent Determinants of Vote Overreporting. Applied Cognitive Psychology 21 (2): 239–257.
Tsai, C. 2020. A Re-examination of American National Election Studies to Resolve a Controversy About Who Overreports Turnout. International Journal of Public Opinion Research 32 (4): 780–789.
von Elsas, E.J., et al. 2014. Vote Recall: A Panel Study on the Mechanisms that Explain Vote Recall Inconsistency. International Journal of Public Opinion Research 26 (1): 18–40.
Valgarosson, V.O. 2019. Differential Turnout Decline in Norway and Sweden: A Generation of Apathy or Alienation? Scandinavian Political Studies 42 (2): 270–295.
Waismel-Manor, I., and J. Sarid. 2011. Can Overreporting in Surveys be Reduced? Evidence from Israel’s Municipal Elections. International Journal of Public Opinion Research 23 (4): 522–529.
Waldahl, R., and B. Aardal. 2000. The Accuracy of Recalled Previous Voting: Evidence from Norwegian Election Study Panels. Scandinavian Political Studies 23 (4): 373–389.
Warren, J.R., and A. Halpern-Manners. 2012. Panel Conditioning in Longitudinal Social Science Surveys. Sociological Methods & Research 41 (4): 491–534.