Lựa chọn hành vi trong các quần thể có cấu trúc

Matthias Borgstede1
1University of Bamberg, Bamberg, Germany

Tóm tắt

Mô hình đa cấp về lựa chọn hành vi (MLBS) do Borgstede và Eggert (Behav Process 186:104370. 10.1016/j.beproc.2021.104370, 2021) cung cấp một khuôn khổ chính thức tích hợp học tăng cường với chọn lọc tự nhiên thông qua phương trình Price mở rộng. Tuy nhiên, MLBS hiện tại chỉ được xây dựng cho các quần thể đồng nhất, do đó loại trừ tất cả các nguồn biến đổi giữa các cá thể. Hạn chế này là một mối quan tâm lý thuyết chủ yếu vì bất kỳ ứng dụng nào của MLBS vào dữ liệu thực đều cần xem xét sự biến đổi giữa các cá thể. Trong bài báo này, tôi mở rộng MLBS để xem xét sự biến đổi giữa các cá thể bằng cách chia quần thể thành các tiểu quần thể đồng nhất và bao gồm các giá trị sinh sản riêng theo lớp như các yếu tố trọng số cho độ thích nghi tiến hóa của một cá thể. Hình thức kết quả này làm khít lại khoảng cách giữa cơ sở lý thuyết của lựa chọn hành vi và việc áp dụng lý thuyết vào dữ liệu thực nghiệm, điều này tự nhiên bao gồm sự biến đổi giữa các cá thể. Hơn nữa, MLBS mở rộng được sử dụng để thiết lập một kết nối rõ ràng giữa động lực học của học tập và tối đa hóa độ thích nghi của từng cá thể. Những kết quả này mở rộng phạm vi của MLBS như một khuôn khổ lý thuyết tổng quát cho phân tích định lượng về học tập và tiến hóa.

Từ khóa

#lựa chọn hành vi #quần thể có cấu trúc #học tăng cường #phương trình Price #độ thích nghi tiến hóa #phân tích định lượng

Tài liệu tham khảo

Aoki K, Feldman MW (2014) Evolution of learning strategies in temporally and spatially variable environments: a review of theory. Theor Popul Biol 91:3–19. https://doi.org/10.1016/j.tpb.2013.10.004 Batty CJK, Crewe P, Grafen A, Gratwick R (2014) Foundations of a mathematical theory of darwinism. J Math Biol 69(2):295–334. https://doi.org/10.1007/s00285-013-0706-2 Baum WM (1973) The correlation-based law of effect. J Exp Anal Behav 20(1):137–153. https://doi.org/10.1901/jeab.1973.20-137 Baum WM (2012) Rethinking reinforcement: allocation, induction, and contingency. J Exp Anal Behav 97(1):101–124. https://doi.org/10.1901/jeab.2012.97-101 Baum WM (2017) Selection by consequences, behavioral evolution, and the price equation. J Exp Anal Behav 107(3):321–342. https://doi.org/10.1002/jeab.256 Borgstede M (2020) An evolutionary model of reinforcer value. Behav Process. https://doi.org/10.1016/j.beproc.2020.104109 Borgstede M (2021) Why do individuals seek information? A selectionist perspective. Front Psychol. https://doi.org/10.3389/fpsyg.2021.684544 Borgstede M, Anselme P (2024) Model-based estimates for operant selection. BioRxiv. https://doi.org/10.1101/2022.07.22.501082 Borgstede M, Eggert F (2021) The formal foundation of an evolutionary theory of reinforcement. Behav Process 186:104370. https://doi.org/10.1016/j.beproc.2021.104370 Borgstede M, Eggert F (2023a) Meaningful measurement requires substantive formal theory. Theory Psychol. https://doi.org/10.1177/09593543221139811 Borgstede M, Eggert F (2023b) Squaring the circle: from latent variables to theory-based measurement. Theory Psychol. https://doi.org/10.1177/09593543221127985 Borgstede M, Luque VJ (2021) The covariance based law of effect: A fundamental principle of behavior. Behav Philos 49:63–81 Broadbent DE (1961) Behaviour. Methuen, London Burgos JE (2019) Selection by reinforcement: a critical reappraisal. Behav Proc 161:149–160. https://doi.org/10.1016/j.beproc.2018.01.019 Campbell DT (1956) Adaptive behavior from random response. Behav Sci 1(2):105–110. https://doi.org/10.1002/bs.3830010204 Caswell H (1982) Optimal life histories and the maximization of reproductive value: a general theorem for complex life cycles. Ecology 63(5):1218–1222. https://doi.org/10.2307/1938846 Caswell H (2001) Matrix Population Models. Construction, analysis, and interpretation, 2nd edn. Sinauer Associates, Sunderland Caswell H (2010) Reproductive value, the stable stage distribution, and the sensitivity of the population growth rate to changes in vital rates. Demogr Res 23:531–548. https://doi.org/10.4054/DemRes.2010.23.19 Davies NB, Krebs JR, West SA (2012) An introduction to behavioural ecology, 4th edn. Wiley-Blackwell, Hoboken Davison M, McCarthy D (2016) The matching law. Routledge. https://doi.org/10.4324/9781315638911 Dridi S, Lehmann L (2014) On learning dynamics underlying the evolution of learning rules. Theor Popul Biol 91:20–36. https://doi.org/10.1016/j.tpb.2013.09.003 Dunlap AS et al (2016) Reliability, uncertainty, and costs in the evolution of animal learning. Curr Opin Behav Sci 12:73–79. https://doi.org/10.1016/j.cobeha.2016.09.010 Fawcett TW, Hamblin S, Giraldeau L-A (2013) Exposing the behavioral gambit: the evolution of learning and decision rules. Behav Ecol 24(1):2–11. https://doi.org/10.1093/beheco/ars085 Fisher RA (1930) The genetical theory of natural selection. Clarendon Press, Oxford Frankenhuis WE, Panchanathan K, Barto AG (2019) Enriching behavioral ecology with reinforcement learning methods. Behav Proc 161:94–100. https://doi.org/10.1016/j.beproc.2018.01.008 Fretwell SD (1972) Populations in a seasonal environment. Monographs in population biology, vol 5. Princeton University Press, Princeton Fretwell SD, Lucas HL (1969) On territorial behavior and other factors influencing habitat distribution in birds. Acta Biotheor 19(1):16–36. https://doi.org/10.1007/BF01601953 Gardner A (2015) The genetical theory of multilevel selection. J Evol Biol 28:305–319. https://doi.org/10.1111/jeb.12566 Gilbert RM (1970) Psychology and biology. Can Psychol Psychol Can 11(3):221–238. https://doi.org/10.1037/h0082574 Grafen A (2006) A theory of Fisher’s reproductive value. J Math Biol 53(1):15–60. https://doi.org/10.1007/s00285-006-0376-4 Grafen A (2015) Biological fitness and the price equation in class-structured populations. J Theor Biol 373:62–72. https://doi.org/10.1016/j.jtbi.2015.02.014 Grafen A (2020) The Price equation and reproductive value. Philos Trans R Soc Lond Ser B Biol Sci 375(1797):20190356. https://doi.org/10.1098/rstb.2019.0356 Herrnstein RJ (1964) Will. Proc Am Philos Soc 108(6):455–458 Herrnstein RJ, Loewenstein GF, Prelec D, Vaughan W (1993) Utility maximization and melioration: Internalities in individual choice. J Behav Decis Mak 6(3):149–185. https://doi.org/10.1002/bdm.3960060302 Houston AI (2008) Matching and ideal free distributions. Oikos 117(7):978–983. https://doi.org/10.1111/j.0030-1299.2008.16041.x Hull DL, Langman RE, Glenn SS (2001) A general account of selection: biology, immunology, and behavior. Behav Brain Sci 24(3):511–528. https://doi.org/10.1017/S0140525X01004162 Kamin LJ (1969) Predictability, surprise, attention and conditioning. In: Campbell BA, Church RM (eds) Punishment and aversive behavior. New York, pp 279–296 Kraft JR, Baum WM, Burge MJ (2002) Group choice and individual choices: modeling human social behavior with the Ideal Free Distribution. Behav Proc 57(2–3):227–240. https://doi.org/10.1016/S0376-6357(02)00016-5 Lewis RL, Singh S, Barto AG (2010) Where do rewards come from? In: Proceedings of the international symposium on AI-inspired biology at the AISB 2010 convention Lion S (2018) Class Structure, demography, and selection: reproductive-value weighting in nonequilibrium. Polymor Popul Am Nat 191(5):620–637. https://doi.org/10.1086/696976 Loewenstein Y, Prelec D, Seung HS (2009) Operant matching as a Nash equilibrium of an intertemporal game. Neural Comput 21(10):2755–2773. https://doi.org/10.1162/neco.2009.09-08-854 McDowell JJ (2013) A quantitative evolutionary theory of adaptive behavior dynamics. Psychol Rev 120(4):731–750. https://doi.org/10.1037/a0034244 McNamara JM, Houston AI (2009) Integrating function and mechanism. Trends Ecol Evol 24(12):670–675. https://doi.org/10.1016/j.tree.2009.05.011 Menzies P, Price H (1993) Causation as a secondary quality. Br J Philos Sci 44(2):187–203. https://doi.org/10.1093/bjps/44.2.187 Moore BR (2004) The evolution of learning. Biol Rev Camb Philos Soc 79(2):301–335. https://doi.org/10.1017/S1464793103006225 Price GR (1970) Selection and Covariance. Nature 227(5257):520–521. https://doi.org/10.1038/227520a0 Price GR (1972) Extension of covariance selection mathematics. Ann Hum Genet 35(4):485–490. https://doi.org/10.1111/j.1469-1809.1957.tb01874.x Price, GR (1995, written ca. 1971). The nature of selection (Written circa 1971, published posthumously). J Theor Biol 175(3):389–396. https://doi.org/10.1006/jtbi.1995.0149 Pringle J (1951) On the parallel between learning and evolution. Behaviour 3(1):174–214. https://doi.org/10.1163/156853951X00269 Rachlin H (1978) A molar theory of reinforcement schedules. J Exp Anal Behav 30(3):345–360. https://doi.org/10.1901/jeab.1978.30-345 Rachlin H, Burkhard B (1978) The temporal triangle: response substitution in instrumental conditioning. Psychol Rev 85:22–47 Rachlin H, Green L, Kagel JH, Battalio RC (1976) Economic demand theory and psychological studies of choice. Psychol Learn Motiv 10:129–154 Rachlin H, Battalio RC, Kagel JH, Green L (1981) Maximization theory in behavioral psychology. Behav Brain Sci 4:371–417 Singh S, Lewis L, Barto AG (2010) Intrinsically motivated reinforcement learning: an evolutionary perspective. IEEE Trans Auton Ment Dev 2(2):70–82 Skinner BF (1966) The phylogeny and ontogeny of behavior. Contingencies of reinforcement throw light on contingencies of survival in the evolution of behavior. Science 153(3741):1205–1213. https://doi.org/10.1126/science.153.3741.1205 Skinner BF (1981) Selection by consequences. Science 213(4507):501–504 Stephens DW (1991) Change, regularity, and value in the evolution of animal learning. Behav Ecol 2(1):77–89. https://doi.org/10.1093/beheco/2.1.77 Stephens DW, Krebs JR (1986) Foraging theory. Monographs in behavior and ecology. Princeton University Press, Princeton Strand PS, Robinson MJF, Fiedler KR, Learn R, Anselme P (2021) Quantifying the instrumental and noninstrumental underpinnings of Pavlovian responding with the Price equation. Psychon Bull Rev. https://doi.org/10.3758/s13423-021-02047-z Taylor PD (1990) Allele-frequency change in a class-structured population. Am Nat 135(1):95–106 Thorndike EL (1900) The associative processes in animals. In: Biological lectures from the marine biological laboratory of woods holl, vol 1899, pp 69–91