Applying the matching law as micro-foundation of social phenomena

Social Science Research - Tập 73 - Trang 189-206 - 2018
Johannes Zschache1
1Institute of Sociology, Leipzig University, Beethovenstraße 15, 04107, Leipzig, Germany

Tài liệu tham khảo

Alonso, 2006, Associative learning for reinforcement learning: where animal learning and machine learning meet, 87 Antonides, 2002, Effects of feedback and educational training on maximization in choice tasks: experimental-game evidence, J. Soc. Econ., 31, 155, 10.1016/S1053-5357(01)00130-5 Axelrod, 1997, Advancing the art of simulation in the social sciences, Complexity, 3, 16, 10.1002/(SICI)1099-0526(199711/12)3:2<16::AID-CPLX4>3.0.CO;2-K Barto, 1990, Learning and sequential decision making, 539 Baum, 1974, On two types of deviation from the matching law: bias and undermatching, J. Exp. Anal. Behav., 22, 231, 10.1901/jeab.1974.22-231 Baum, 1979, Matching, undermatching, and overmatching in studies of choice, J. Exp. Anal. Behav., 32, 269, 10.1901/jeab.1979.32-269 Baum, 1981, Optimization and the matching law as accounts of instrumental behaviour, J. Exp. Anal. Behav., 36, 387, 10.1901/jeab.1981.36-387 Baum, 1981, Maximization theory: some empirical problems, Behav. Brain Sci., 4, 389, 10.1017/S0140525X00009420 Becker, 1981 Bellman, 1957, A Markov decision process, J. Appl. Math. Mech., 6, 679 Bendor, 1987, In good times and bad: reciprocity in an uncertain world, Am. J. Polit. Sci., 31, 531, 10.2307/2111282 Bendor, 2001, Bounded rationality, 1303 Borrero, 2007, An application of the matching law to social dynamics, J. Appl. Behav. Anal., 40, 589, 10.1901/jaba.2007.589-601 Braun, 1994, Restricted access in exchange systems, J. Math. Sociol., 19, 129, 10.1080/0022250X.1994.9990139 Brenner, 2006, Agent learning representation: advice on modelling economic learning, vol. 2 Brenner, 2003, Melioration learning in games with constant and frequency-dependent pay-offs, J. Econ. Behav. Organ., 50, 429, 10.1016/S0167-2681(02)00034-3 1969 Camerer, 1999, Experience-weighted attraction learning in normal form games, Econometrica, 67, 827, 10.1111/1468-0262.00054 Coleman, 1990 Conger, 1974, Use of concurrent operants in small group research: a demonstration, Pac. Socio Rev., 17, 399, 10.2307/1388548 Corrado, 2005, Linear-nonlinear-Poisson models of primate choice dynamics, J. Exp. Anal. Behav., 84, 581, 10.1901/jeab.2005.23-05 Darley, 1968, Bystander intervention in emergencies: diffusion of responsibility, J. Pers. Soc. Psychol., 8, 377, 10.1037/h0025589 de Villiers, 1976, Toward a law of response strength, Psychol. Bull., 83, 1131, 10.1037/0033-2909.83.6.1131 Diekmann, 1985, Volunteer's dilemma, J. Conflict Resolut., 29, 605, 10.1177/0022002785029004003 Diekmann, 1993, Cooperation in an asymmetric volunteer's dilemma game. Theory and experimental evidence, Int. J. Game Theor., 22, 75, 10.1007/BF01245571 Dixit, 1977, Monopolistic competition and optimum product diversity, Am. Econ. Rev., 67, 297 Emerson, 1972, Exchange theory, part i: a psychological basis for social exchange, vol. 2, 38 Fishburn, 1970 Flache, 2002, The rational weakness of strong ties: failure of group solidarity in a highly cohesive group of rational agents, J. Math. Sociol., 26, 189, 10.1080/00222500212988 Flache, 2002, Stochastic collusion and the power law of learning: a general reinforcement learning model of cooperation, J. Conflict Resolut., 46, 629, 10.1177/002200202236167 Franzen, 1995, Group size and one-shot collective action, Ration. Soc., 7, 183, 10.1177/1043463195007002006 Gallistel, 2001, The rat approximates an ideal detector of changes in rates or reward: implications for the law of effect, J. Exp. Psychol. Anim. Behav. Process., 27, 354, 10.1037/0097-7403.27.4.354 Gigerenzer, 1999 Goeree, 2017, An experimental examination of the volunteer's dilemma, Game. Econ. Behav., 102, 303, 10.1016/j.geb.2017.01.002 Gray, 1982, Social matching over multiple reinforcement domains: an explanation of local exchange imbalance, Soc. Forces, 61, 156, 10.2307/2578080 Gray, 1984, A satisfaction balance model of decision making and choice behavior, Soc. Psychol. Q., 47, 146, 10.2307/3033943 Gray, 1976, On the generalizability of the law of effect: social psychological measurement of group structure and process, Sociometry, 39, 175, 10.2307/2786510 Green, 1993, The substitutability of reinforcers, J. Exp. Anal. Behav., 60, 141, 10.1901/jeab.1993.60-141 Gureckis, 2009, Short term gains, long term pains: how cues about state aid learning in dynamic environments, Cognition, 113, 293, 10.1016/j.cognition.2009.03.013 Hamblin, 1977, Behavior and reinforcement: a generalization of the matching law, 469 Hamblin, 1979, Behavioral choice and social reinforcement: step function versus matching, Soc. Forces, 57, 1141, 10.2307/2577263 1977 Herrnstein, 1961, Relative and absolute strength of response as a function of frequency of reinforcement, J. Exp. Anal. Behav., 4, 267, 10.1901/jeab.1961.4-267 Herrnstein, 1982, Melioration as behavioral dynamism, 433 Herrnstein, 1990, Behavior, reinforcement and utility, Psychol. Sci., 1, 217, 10.1111/j.1467-9280.1990.tb00203.x Herrnstein, 1990, Rational choice theory: necessary but not sufficient, Am. Psychol., 45, 356, 10.1037/0003-066X.45.3.356 Herrnstein, 1997 Herrnstein, 1993, Utility maximization and melioration: internalities in individual choice, J. Behav. Decis. Making, 6, 149, 10.1002/bdm.3960060302 Herrnstein, 1992, A theory of addiction, 331 Herrnstein, 1991, Melioration: a theory of distributed choice, J. Econ. Perspect., 5, 137, 10.1257/jep.5.3.137 Hester, 2012, Learning and using models, 111 Homans, 1961 Homans, 1974 Kangas, 2009, Concurrent performance in a three-alternative choice situation: response allocation in a Rock/Paper/Scissors game, Behav. Process., 82, 164, 10.1016/j.beproc.2009.06.004 Kianercy, 2012, Dynamics of Boltzmann Q-Learning in two-player two-action games, Phys. Rev., 85 Krantz, 1971 Kubanek, 2017, Optimal decision making and matching are tied through diminishing returns, Proc. Natl. Acad. Sci. Unit. States Am., 114, 8499, 10.1073/pnas.1703440114 Loève, 1978 Loewenstein, 2010, Synaptic theory of replicator-like melioration, Front. Comput. Neurosci., 4, 17 Loewenstein, 2009, Operant matching as a Nash equilibrium of an intertemporal game, Neural Comput., 21, 2755, 10.1162/neco.2009.09-08-854 Loewenstein, 2006, Operant matching is a generic outcome of synaptic plasticity based on the covariance betwen reward and neural activity, Proc. Natl. Acad. Sci. Unit. States Am., 103, 15224, 10.1073/pnas.0505220103 Macy, 2015, The signal importance of noise, Socio. Meth. Res., 44, 306, 10.1177/0049124113508093 Macy, 2009, Social dynamics from the bottom up. Agent-based models of social interaction, 245 March, 1991, Exploration and exploitation in organization learning, Organ. Sci., 2, 71, 10.1287/orsc.2.1.71 Mazur, 1981, Optimization theory fails to predict performance of pigeons in a two-response situation, Science, 214, 823, 10.1126/science.7292017 McDowell, 1988, Matching theory in natural human environments, Behav. Analyst, 11, 95, 10.1007/BF03392462 McDowell, 2004, A computational model of selection by consequences, J. Exp. Anal. Behav., 81, 297, 10.1901/jeab.2004.81-297 McDowell, 2005, On the classic and modern theories of matching, J. Exp. Anal. Behav., 84, 111, 10.1901/jeab.2005.59-04 McDowell, 2013, On the theoretical and empirical status of the matching law and matching theory, Psychol. Bull., 139, 1000, 10.1037/a0029924 McDowell, 2013, A quantitative evolutionary theory of adaptive behavior dynamics, Psychol. Rev., 120, 731, 10.1037/a0034244 McDowell, 2007, Undermatching is an emergent property of selection by consequences, Behav. Process., 75, 97, 10.1016/j.beproc.2007.02.017 McDowell, 2008, A compuational theory of selection by consequences applied to concurrent schedules, J. Exp. Anal. Behav., 90, 387, 10.1901/jeab.2008.90-387 McDowell, 2010, Toward a mechanism of adaptive behavior: evolutionary dynamics and matching theory statics, J. Exp. Anal. Behav., 94, 241, 10.1901/jeab.2010.94-241 Molm, 2006, The social exchange framework, 24 Neth, 2005, Melioration despite more information: the role of feedback frequency in stable suboptimal performance, 357 Neth, 2006, Melioration dominates maximization : stable suboptimal performance despite global feedback, 627 Olson, 1965 Palacios-Huerta, 2003, Professionals play minimax, Rev. Econ. Stud., 70, 395, 10.1111/1467-937X.00249 Pierce, 1983, Choice, matching, and human behavior. A review of the literature, Behav. Analyst, 6, 57, 10.1007/BF03391874 Rachlin, 1971, On the tautology of the matching law, J. Exp. Anal. Behav., 15, 249, 10.1901/jeab.1971.15-249 Rachlin, 1981, Maximization theory in behavioral psychology, Behav. Brain Sci., 4, 371, 10.1017/S0140525X00009407 Rachlin, 1976, Economic demand theory and psychological studies of choice, vol. 10, 129 Rachlin, 1980, Substitutability in time allocation, Psychol. Rev., 87, 355, 10.1037/0033-295X.87.4.355 Roth, 1995, Learning in extensive-form games: experimental data and simple dynamic models in the intermediate term, Game. Econ. Behav., 8, 164, 10.1016/S0899-8256(05)80020-X Sakai, 2008, The actor-critic learning is behind the matching law: matching versus optimal behaviors, Neural Comput., 20, 227, 10.1162/neco.2008.20.1.227 Sakai, 2008, When does reward maximization lead to matching law?, PLoS One, 3, e3795, 10.1371/journal.pone.0003795 Sakai, 2006, Computational algorithms and neuronal network models underlying decision processes, Neural Network., 19, 1091, 10.1016/j.neunet.2006.05.034 Selten, 1975, Reexamination of the perfectness concept for equilibrium points in extensive games, Int. J. Game Theor., 4, 25, 10.1007/BF01766400 Shteingart, 2014, Reinforcement learning and human behavior, Curr. Opin. Neurobiol., 25, 93, 10.1016/j.conb.2013.12.004 Simon, 1955, A behavioral model of rational choice, Q. J. Econ., 69, 99, 10.2307/1884852 Sims, 2013, Melioration as rational choice: sequential decision making in uncertain environments, Psychol. Rev., 120, 139, 10.1037/a0030850 Skyrms, 2000, A dynamic model of social network formation, Proc. Natl. Acad. Sci. Unit. States Am., 97, 9340, 10.1073/pnas.97.16.9340 Spaan, 2012, Partially observable Markov decision processes, 387 Staddon, 1978, On matching and maximizing in operant choice experiments, Psychol. Rev., 85, 436, 10.1037/0033-295X.85.5.436 Sugrue, 2004, Matching behavior and the representation of value in the parietal cortex, Science, 304, 1782, 10.1126/science.1094765 Sunahara, 1982, The matching law and bias in a social exchange involving choice between alternatives, Can. J. Sociol., 7, 145, 10.2307/3340195 Sutton, 1998 Tunney, 2002, A re-examination of melioration and rational-choice, J. Behav. Decis. Making, 15, 291, 10.1002/bdm.415 van Hasselt, 2012, Reinforcement learning in continuous state and action spaces, 207 van Otterlo, 2012, Reinforcement learning and markov decision processes, 3 Vaughan, 1981, Melioration, matching, and maximization, J. Exp. Anal. Behav., 36, 141, 10.1901/jeab.1981.36-141 Vaughan, 1987, Stability, melioration, and natural selection, vol. 1, 185 Veksler, 2014, SAwSu: an integrated model of associative and reinforcement learning, Cognit. Sci., 38, 580, 10.1111/cogs.12103 Vollmer, 2000, An application of the matching law to evaluate the allocation of two- and three-point shots by college basketball players, J. Appl. Behav. Anal., 33, 137, 10.1901/jaba.2000.33-137 Watkins, 1989 Watkins, 1992, Q-learning, Mach. Learn., 8, 279, 10.1007/BF00992698 2012 Wilensky, 1999 Wunder, 2010, Classes of multiagent Q-learning dynamics with _-greedy exploration, 1167 Yechiam, 2003, Melioration and the transition from touch-typing training to everyday use, Hum. Factors: J. Hum. Factors Ergon. Soc., 45, 671, 10.1518/hfes.45.4.671.27085