Using Factorial Surveys to Study Justice Perceptions: Five Methodological Problems of Attitudinal Justice Research

Adams, J. S. (1965). Inequity in social exchange. Advances in Experimental Social Psychology, 2, 267–299. Alexander, C. S., & Becker, H. J. (1978). The use of vignettes in survey research. Public Opinion Quarterly, 42(1), 93–104. Allison, P. D. (2009). Fixed effects regression models. Thousand Oaks: Sage. Almås, I., Cappelen, A. W., Sørensen, E. Ø., & Tungodden, B. (2010). Fairness and the development of inequality acceptance. Science, 328(5982), 1176–1178. Alves, W. M., & Rossi, P. H. (1978). Who should get what? Fairness judgments of the distribution of earnings. American Journal of Sociology, 84(3), 541–564. Auspurg, K., Gatskova, K., & Hinz, T. (2013a). Vorstellungen von Lohngerechtigkeit in West- und Ostdeutschland und in der Ukraine. WSI-Mitteilungen, 66(2), 77–88. Auspurg, K., & Hinz, T. (2015). Factorial survey experiments. sage series: Quantitative applications in the social sciences (Vol. 175). Thousand Oaks, CA: Sage. Auspurg, K., Hinz, T., Liebig, S., & Sauer, C. (2015). The factorial survey as a method for measuring sensitive issues. In U. Engel, B. Jann, P. Lynn, A. Scherpenzeel, & P. Sturgis (Eds.), Improving survey methods: Lessons from recent research (pp. 137–150). New York, NY: Routledge. Auspurg, K., Hinz, T., & Sauer, C. (2013b). Status construction or statistical discrimination? New insights on fair earnings from a factorial survey study. Paper presented at the 108th annual meeting of the American Sociological Association, New York, NY. Auspurg, K., & Jäckle, A. (2015). First equals most important? Order effects in vignette-based measurement. Sociological Methods & Research. doi:10.1177/0049124115591016. Beck, M., & Opp, K.-D. (2001). Der faktorielle Survey und die Messung von Normen. Kölner Zeitschrift für Soziologie und Sozialpsychologie, 53(2), 283–306. Boudon, R. (1990). Subjektive Rationalität und die Theorie der Ideologie. In H. Haferkamp (Ed.), Sozialstruktur und Kultur (pp. 384–414). Frankfurt am Main: Suhrkamp. Brosnan, S. F. (2006). Nonhuman species’ reactions to inequity and their implications for fairness. Social Justice Research, 19(2), 153–185. Brüderl, J. (2010). Kausalanalyse mit Paneldaten. In C. Wolf & H. Best (Eds.), Handbuch der sozialwissenschaftlichen Datenanalyse (pp. 963–994). Wiesbaden: VS Verlag für Sozialwissenschaften/Springer Fachmedien. Buzea, C., Mesesan-Schmitz, L., & van de Vijver, F. J. R. (2013). Reward-allocation judgments in Romania: A factorial survey approach. Revista de cercetare şi intervenţie socială, 40, 107–123. Cohn, E. S., White, S. O., & Sanders, J. (2000). Distributive and procedural justice in seven nations. Law and Human Behavior, 24(5), 553–579. Eifler, S. (2010). Validity of a factorial survey approach to the analysis of criminal behavior. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 6(3), 139–146. Elster, J. (1991a). Local justice and interpersonal comparisons. In J. Elster & J. E. Roemer (Eds.), Interpersonal comparisons of well-being (pp. 98–126). Cambridge: Cambridge University Press. Elster, J. (1991b). Local justice: How institutions allocate scarce goods and necessary burdens. European Economic Review, 35(2–3), 273–291. Elster, J. (1992). Local justice: How institutions allocate scarce goods and necessary burdens. New York, NY: Russell Sage Foundation. Falk, A., & Heckman, J. J. (2009). Lab experiments are a major source of knowledge in the social sciences. Science, 326(5952), 535–538. Fehr, E., & Schmidt, K. M. (2006). The economics of fairness, reciprocity and Altruism—Experimental evidence and new theories. In S.-C. Kolm & J. M. Ythier (Eds.), Handbook of the economics of giving, altruism and reciprocity: Volume 1: Foundations (pp. 615–691). Amsterdam: North-Holland. Fisher, R. J., & Katz, J. E. (2000). Social-desirability bias and the validity of self-reported values. Psychology and Marketing, 17(2), 105–120. Fortin, M., Cojuharenco, I., Patient, D., & German, H. (2014). It is time for justice: How time changes what we know about justice judgments and justice effects. Journal of Organizational Behavior. doi:10.1002/job.1958. Gangl, M. (2010). Causal inference in sociological research. Annual Review of Sociology, 36(1), 21–47. Gatskova, K. (2013). Distributive justice attitudes in Ukraine: Need, desert or social minimum? Communist and Post-Communist Studies, 46(2), 227–241. Greenberg, J. (1993). Stealing in the name of justice: Informational and interpersonal moderators of theft reactions to underpayment inequity. Organizational Behavior and Human Decision Processes, 54(1), 81–103. Hegtvedt, K. A. (2006). Justice Frameworks. In P. J. Burke (Ed.), Contemporary social psychological theories (pp. 46–69). Stanford, CA: Stanford University Press. Henrich, J., Heine, S. J., & Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33(2–3), 61–83. Hermkens, P. J., & Boerman, F. (1989). Consensus with respect to the fairness of incomes: Differences between social groups. Social Justice Research, 3(3), 201–215. Hysom, S. J., & Fişek, M. H. (2011). Situational determinants of reward allocation: The equity–equality equilibrium model. Social Science Research, 40(4), 1263–1285. Jann, B. (2008). Lohngerechtigkeit und Geschlechterdiskriminierung: Evidenz aus einem Vignetten-Experiment. In B. Jann (Ed.), Erwerbsarbeit, Einkommen und Geschlecht: Studien zum Schweizer Arbeitsmarkt (pp. 107–126). Wiesbaden: VS Verlag für Sozialwissenschaften. Jasso, G. (1978). On the justice of earnings: A new specification of the justice evaluation function. American Journal of Sociology, 83(6), 1398–1419. Jasso, G. (1994). Assessing individual and group differences in the sense of justice: Framework and application to gender differences in the justice of earnings. Social Science Research, 23(4), 368–406. Jasso, G. (2006). Factorial survey methods for studying beliefs and judgments. Sociological Methods and Research, 34(3), 334–423. Jasso, G. (2007). Studying justice: Measurement, estimation, and analysis of the actual reward and the just reward. In K. Törnblom & R. Vermunt (Eds.), Distributive and procedural justice: Research and social applications (pp. 225–253). London: Ashgate. Jasso, G. (2012). Safeguarding justice research. Sociological Methods and Research, 41(1), 217–239. Jasso, G., & Meyersson Milgrom, E. M. (2008). Distributive justice and CEO compensation. Acta Sociologica, 51(2), 123–143. Jasso, G., & Rossi, P. H. (1977). Distributive justice and earned income. American Sociological Review, 42(4), 639–651. Jasso, G., & Webster, M. J. (1997). Double standards in just earnings for male and female workers. Social Psychology Quarterly, 60(1), 66–78. Jasso, G., & Webster, M. J. (1999). Assessing the gender gap in just earnings and its underlying mechanisms. Social Psychology Quarterly, 62(4), 367–380. Jasso, G., & Wegener, B. (1997). Methods for empirical justice analysis: Part 1. Framework, models, and quantities. Social Justice Research, 10(4), 393–430. Jones, D. (2010). A WEIRD view of human nature skews psychologists’ studies. Science, 328(5986), 1627. Keller, M., Gummerum, M., Canz, T., Gigerenzer, G., & Takezawa, M. (2013). The is and ought of sharing: The equality heuristic across the lifespan. In R. Hertwig, U. Hoffrage, & ABC Research Group (Eds.), Simple heuristics in a social world (pp. 171–198). New York, NY: Oxford University Press. King, M. F., & Bruner, G. C. (2000). Social desirability bias: A neglected aspect of validity testing. Psychology and Marketing, 17(2), 79–103. Leventhal, G. S. (1980). What should be done with equity theory? New approaches to the study of fairness in social relationships. In K. J. Gergen, M. S. Greenberg, & R. H. Willis (Eds.), Social exchange: Advances in theory and research (pp. 27–55). New York, NY: Plenum Press. Liebig, S., & Mau, S. (2002). Einstellungen zur sozialen Mindestsicherung: Ein Vorschlag zur differenzierten Erfassung normativer Urteile. Kölner Zeitschrift für Soziologie und Sozialpsychologie, 54(1), 109–134. Liebig, S., & Mau, S. (2005). Wann ist ein Steuersystem gerecht? Einstellungen zu allgemeinen Prinzipien der Besteuerung und zur Gerechtigkeit der eigenen Steuerlast. Zeitschrift für Soziologie, 34(6), 468–491. Liebig, S., & Sauer, C. (2013). Soziologische Gerechtigkeitsanalyse: Überlegungen zur theoretischen Fundierung eines Forschungsfeldes. Analyse und Kritik, 35(2), 371–394. Liebig, S., & Sauer, C. (2016). Sociology of Justice. In C. Sabbagh & M. Schmitt (Eds.), Handbook of social justice theory and research. New York: Springer. Liebig, S., Sauer, C., May, M., Hinz, T., Auspurg, K., Joos, A., & Schwarz, J. (2010). Bericht zur Studie Einkommensgerechtigkeit in Deutschland. Bielefeld: Bielefeld University/Konstanz, University of Konstanz. Liebig, S., Sauer, C., & Schupp, J. (2012). The justice of earnings in dual-earner households. Research in Social Stratification and Mobility, 30(2), 219–232. Markovsky, B. (1988). Injustice and arousal. Social Justice Research, 2(3), 223–233. Markovsky, B., & Eriksson, K. (2012). Comparing direct and indirect measures of just rewards. Sociological Methods and Research, 41(1), 199–216. Messick, D. M. (1993). Equality as a decision heuristic. In B. A. Mellers & J. Baron (Eds.), Psychological perspectives on justice: Theory and applications (pp. 11–31). Cambridge: Cambridge University Press. Meulemann, H., & Birkelbach, K. (2001). Biographische Erfahrungen und politische Einstellungen zwischen Jugend und Lebensmitte: Die Entwicklung von Wertansprüchen an die Politik bei ehemaligen Gymnasiasten im 16, 30. und 43. Lebensjahr zwischen 1969–1997. Politische Vierteljahresschrift, 42(1), 30–50. Miller, D. (1976). Social justice. Oxford: Oxford University Press. Miller, D. (1999). Principles of social justice. Oxford: Oxford University Press. Mutz, D. C. (2011). Population-based survey experiments. Princeton, NJ: Princeton University Press. Opp, K.-D. (2010). Kausalität als Gegenstand der Sozialwissenschaften und der multivariaten Statistik. In C. Wolf & H. Best (Eds.), Handbuch der sozialwissenschaftlichen Datenanalyse (pp. 9–38). Wiesbaden: VS Verlag für Sozialwissenschaften/Springer Fachmedien. Paulhus, D. L. (1984). Two-component models of socially desirable responding. Journal of Personality and Social Psychology, 46(3), 598–609. Roch, S. G., Lane, J. A. S., Samuelson, C. D., Allison, S. T., & Dent, J. L. (2000). Cognitive load and the equality heuristic: A two-stage model of resource overconsumption in small groups. Organizational Behavior and Human Decision Processes, 83(2), 185–212. Rossi, P. H., & Anderson, B. (1982). The factorial survey approach: An introduction. In P. H. Rossi & S. L. Nock (Eds.), Measuring social judgements: The factorial survey approach (pp. 15–67). Beverly Hills, CA: Sage. Rossi, P. H., & Nock, S. L. (1982). Measuring social judgments: The factorial survey approach. Beverly Hills, CA: Sage. Rossi, P. H., Sampson, W. A., Bose, C. E., Jasso, G., & Passel, J. (1974). Measuring household social standing. Social Science Research, 3(1), 169–190. Rossi, P. H., Simpson, J. E., & Miller, J. L. (1985). Beyond crime seriousness: Fitting the punishment to the crime. Journal of Quantitative Criminology, 1(1), 59–90. Sauer, C. (2014). A just gender pay gap? Three factorial survey studies on justice evaluations of earnings for male and female employees. SFB 882 Working Paper Series, no. 29. Bielefeld: DFG Research Center (SFB) 882 From Heterogeneities to Inequalities. Sauer, C., Auspurg, K., Hinz, T., & Liebig, S. (2011). The application of factorial surveys in general population samples: The effects of respondent age and education on response times and response consistency. Survey Research Methods, 5(3), 89–102. Sauer, C., Auspurg, K., Hinz, T., Liebig, S., & Schupp, J. (2009). Die Bewertung von Erwerbseinkommen—Methodische und inhaltliche Analysen zu einer Vignettenstudie im Rahmen des SOEP-Pretest 2008. SOEPpapers on Multidisciplinary Panel Data Research, no. 189. Berlin: DIW Berlin, The German Socio-Economic Panel (SOEP). Sauer, C., Auspurg, K., Hinz, T., Liebig, S., & Schupp, J. (2014). Method effects in factorial surveys: An analysis of respondents’ comments, interviewers’ assessments, and response behavior. SOEP papers on Multidisciplinary Panel Data Research, no. 629 Berlin: DIW Berlin, The German Socio-Economic Panel (SOEP). Sauer, C., & Valet, P. (2013). Less is sometimes more: Consequences of overpayment on job satisfaction and absenteeism. Social Justice Research, 26(2), 132–150. Schaeffer, N. C. (1990). Principles of justice in judgments about child support. Social Forces, 69(1), 157–179. Schrenker, M. (2009). Warum fast alle das deutsche Rentensystem ungerecht finden, aber trotzdem nichts daran ändern möchten: Die Wahrnehmung gerechter Renten und die Akzeptanz von Rentenreformen. Kölner Zeitschrift für Soziologie und Sozialpsychologie, 61(2), 259–282. Schröder, M., & Vietze, F. (2015). Mediendebatten über soziale Ungleichheit, Armut und soziale Gerechtigkeit seit 1946-Online Anhang. Zeitschrift für Soziologie, 44(1), I–III. Schunck, R., Sauer, C., & Valet, P. (2015). Unfair pay and health: The effects of perceived injustice of earnings on physical health. European Sociological Review. doi:10.1093/esr/jcv065. Shepelak, N. J., & Alwin, D. F. (1986). Beliefs about Inequality and perceptions of distributive justice. American Sociological Review, 51(1), 30–46. Törnblom, K. Y. (1992). The social psychology of distributive justice. In K. R. Scherer (Ed.), Justice: Interdisciplinary perspectives (pp. 177–236). Cambridge: Cambridge University Press. Vanberg, V. J. (2007). Marktwirtschaft und Gerechtigkeit—Idee und Kritik der sozialen Gerechtigkeit im Konzept der Sozialen Marktwirtschaft. In S. Empter & R. B. Vehrkamp (Eds.), Soziale Gerechtigkeit—eine Bestandsaufnahme (pp. 25–50). Gütersloh: Bertelsmann-Stiftung. Wallander, L. (2009). 25 years of factorial surveys in sociology: A review. Social Science Research, 38(3), 505–520. Webster, M., & Sell, J. (2007). Theory and experimentation in the social sciences. In W. Outhwaite & S. Turner (Eds.), The Sage handbook of social science methodology (pp. 190–207). London: Sage.