Nội dung được dịch bởi AI, chỉ mang tính chất tham khảo
Lựa chọn hành vi trong các quần thể có cấu trúc
Theory in Biosciences - 2024
Tóm tắt
Mô hình đa cấp về lựa chọn hành vi (MLBS) do Borgstede và Eggert (Behav Process 186:104370. 10.1016/j.beproc.2021.104370, 2021) cung cấp một khuôn khổ chính thức tích hợp học tăng cường với chọn lọc tự nhiên thông qua phương trình Price mở rộng. Tuy nhiên, MLBS hiện tại chỉ được xây dựng cho các quần thể đồng nhất, do đó loại trừ tất cả các nguồn biến đổi giữa các cá thể. Hạn chế này là một mối quan tâm lý thuyết chủ yếu vì bất kỳ ứng dụng nào của MLBS vào dữ liệu thực đều cần xem xét sự biến đổi giữa các cá thể. Trong bài báo này, tôi mở rộng MLBS để xem xét sự biến đổi giữa các cá thể bằng cách chia quần thể thành các tiểu quần thể đồng nhất và bao gồm các giá trị sinh sản riêng theo lớp như các yếu tố trọng số cho độ thích nghi tiến hóa của một cá thể. Hình thức kết quả này làm khít lại khoảng cách giữa cơ sở lý thuyết của lựa chọn hành vi và việc áp dụng lý thuyết vào dữ liệu thực nghiệm, điều này tự nhiên bao gồm sự biến đổi giữa các cá thể. Hơn nữa, MLBS mở rộng được sử dụng để thiết lập một kết nối rõ ràng giữa động lực học của học tập và tối đa hóa độ thích nghi của từng cá thể. Những kết quả này mở rộng phạm vi của MLBS như một khuôn khổ lý thuyết tổng quát cho phân tích định lượng về học tập và tiến hóa.
Từ khóa
#lựa chọn hành vi #quần thể có cấu trúc #học tăng cường #phương trình Price #độ thích nghi tiến hóa #phân tích định lượngTài liệu tham khảo
Aoki K, Feldman MW (2014) Evolution of learning strategies in temporally and spatially variable environments: a review of theory. Theor Popul Biol 91:3–19. https://doi.org/10.1016/j.tpb.2013.10.004
Batty CJK, Crewe P, Grafen A, Gratwick R (2014) Foundations of a mathematical theory of darwinism. J Math Biol 69(2):295–334. https://doi.org/10.1007/s00285-013-0706-2
Baum WM (1973) The correlation-based law of effect. J Exp Anal Behav 20(1):137–153. https://doi.org/10.1901/jeab.1973.20-137
Baum WM (2012) Rethinking reinforcement: allocation, induction, and contingency. J Exp Anal Behav 97(1):101–124. https://doi.org/10.1901/jeab.2012.97-101
Baum WM (2017) Selection by consequences, behavioral evolution, and the price equation. J Exp Anal Behav 107(3):321–342. https://doi.org/10.1002/jeab.256
Borgstede M (2020) An evolutionary model of reinforcer value. Behav Process. https://doi.org/10.1016/j.beproc.2020.104109
Borgstede M (2021) Why do individuals seek information? A selectionist perspective. Front Psychol. https://doi.org/10.3389/fpsyg.2021.684544
Borgstede M, Anselme P (2024) Model-based estimates for operant selection. BioRxiv. https://doi.org/10.1101/2022.07.22.501082
Borgstede M, Eggert F (2021) The formal foundation of an evolutionary theory of reinforcement. Behav Process 186:104370. https://doi.org/10.1016/j.beproc.2021.104370
Borgstede M, Eggert F (2023a) Meaningful measurement requires substantive formal theory. Theory Psychol. https://doi.org/10.1177/09593543221139811
Borgstede M, Eggert F (2023b) Squaring the circle: from latent variables to theory-based measurement. Theory Psychol. https://doi.org/10.1177/09593543221127985
Borgstede M, Luque VJ (2021) The covariance based law of effect: A fundamental principle of behavior. Behav Philos 49:63–81
Broadbent DE (1961) Behaviour. Methuen, London
Burgos JE (2019) Selection by reinforcement: a critical reappraisal. Behav Proc 161:149–160. https://doi.org/10.1016/j.beproc.2018.01.019
Campbell DT (1956) Adaptive behavior from random response. Behav Sci 1(2):105–110. https://doi.org/10.1002/bs.3830010204
Caswell H (1982) Optimal life histories and the maximization of reproductive value: a general theorem for complex life cycles. Ecology 63(5):1218–1222. https://doi.org/10.2307/1938846
Caswell H (2001) Matrix Population Models. Construction, analysis, and interpretation, 2nd edn. Sinauer Associates, Sunderland
Caswell H (2010) Reproductive value, the stable stage distribution, and the sensitivity of the population growth rate to changes in vital rates. Demogr Res 23:531–548. https://doi.org/10.4054/DemRes.2010.23.19
Davies NB, Krebs JR, West SA (2012) An introduction to behavioural ecology, 4th edn. Wiley-Blackwell, Hoboken
Davison M, McCarthy D (2016) The matching law. Routledge. https://doi.org/10.4324/9781315638911
Dridi S, Lehmann L (2014) On learning dynamics underlying the evolution of learning rules. Theor Popul Biol 91:20–36. https://doi.org/10.1016/j.tpb.2013.09.003
Dunlap AS et al (2016) Reliability, uncertainty, and costs in the evolution of animal learning. Curr Opin Behav Sci 12:73–79. https://doi.org/10.1016/j.cobeha.2016.09.010
Fawcett TW, Hamblin S, Giraldeau L-A (2013) Exposing the behavioral gambit: the evolution of learning and decision rules. Behav Ecol 24(1):2–11. https://doi.org/10.1093/beheco/ars085
Fisher RA (1930) The genetical theory of natural selection. Clarendon Press, Oxford
Frankenhuis WE, Panchanathan K, Barto AG (2019) Enriching behavioral ecology with reinforcement learning methods. Behav Proc 161:94–100. https://doi.org/10.1016/j.beproc.2018.01.008
Fretwell SD (1972) Populations in a seasonal environment. Monographs in population biology, vol 5. Princeton University Press, Princeton
Fretwell SD, Lucas HL (1969) On territorial behavior and other factors influencing habitat distribution in birds. Acta Biotheor 19(1):16–36. https://doi.org/10.1007/BF01601953
Gardner A (2015) The genetical theory of multilevel selection. J Evol Biol 28:305–319. https://doi.org/10.1111/jeb.12566
Gilbert RM (1970) Psychology and biology. Can Psychol Psychol Can 11(3):221–238. https://doi.org/10.1037/h0082574
Grafen A (2006) A theory of Fisher’s reproductive value. J Math Biol 53(1):15–60. https://doi.org/10.1007/s00285-006-0376-4
Grafen A (2015) Biological fitness and the price equation in class-structured populations. J Theor Biol 373:62–72. https://doi.org/10.1016/j.jtbi.2015.02.014
Grafen A (2020) The Price equation and reproductive value. Philos Trans R Soc Lond Ser B Biol Sci 375(1797):20190356. https://doi.org/10.1098/rstb.2019.0356
Herrnstein RJ (1964) Will. Proc Am Philos Soc 108(6):455–458
Herrnstein RJ, Loewenstein GF, Prelec D, Vaughan W (1993) Utility maximization and melioration: Internalities in individual choice. J Behav Decis Mak 6(3):149–185. https://doi.org/10.1002/bdm.3960060302
Houston AI (2008) Matching and ideal free distributions. Oikos 117(7):978–983. https://doi.org/10.1111/j.0030-1299.2008.16041.x
Hull DL, Langman RE, Glenn SS (2001) A general account of selection: biology, immunology, and behavior. Behav Brain Sci 24(3):511–528. https://doi.org/10.1017/S0140525X01004162
Kamin LJ (1969) Predictability, surprise, attention and conditioning. In: Campbell BA, Church RM (eds) Punishment and aversive behavior. New York, pp 279–296
Kraft JR, Baum WM, Burge MJ (2002) Group choice and individual choices: modeling human social behavior with the Ideal Free Distribution. Behav Proc 57(2–3):227–240. https://doi.org/10.1016/S0376-6357(02)00016-5
Lewis RL, Singh S, Barto AG (2010) Where do rewards come from? In: Proceedings of the international symposium on AI-inspired biology at the AISB 2010 convention
Lion S (2018) Class Structure, demography, and selection: reproductive-value weighting in nonequilibrium. Polymor Popul Am Nat 191(5):620–637. https://doi.org/10.1086/696976
Loewenstein Y, Prelec D, Seung HS (2009) Operant matching as a Nash equilibrium of an intertemporal game. Neural Comput 21(10):2755–2773. https://doi.org/10.1162/neco.2009.09-08-854
McDowell JJ (2013) A quantitative evolutionary theory of adaptive behavior dynamics. Psychol Rev 120(4):731–750. https://doi.org/10.1037/a0034244
McNamara JM, Houston AI (2009) Integrating function and mechanism. Trends Ecol Evol 24(12):670–675. https://doi.org/10.1016/j.tree.2009.05.011
Menzies P, Price H (1993) Causation as a secondary quality. Br J Philos Sci 44(2):187–203. https://doi.org/10.1093/bjps/44.2.187
Moore BR (2004) The evolution of learning. Biol Rev Camb Philos Soc 79(2):301–335. https://doi.org/10.1017/S1464793103006225
Price GR (1970) Selection and Covariance. Nature 227(5257):520–521. https://doi.org/10.1038/227520a0
Price GR (1972) Extension of covariance selection mathematics. Ann Hum Genet 35(4):485–490. https://doi.org/10.1111/j.1469-1809.1957.tb01874.x
Price, GR (1995, written ca. 1971). The nature of selection (Written circa 1971, published posthumously). J Theor Biol 175(3):389–396. https://doi.org/10.1006/jtbi.1995.0149
Pringle J (1951) On the parallel between learning and evolution. Behaviour 3(1):174–214. https://doi.org/10.1163/156853951X00269
Rachlin H (1978) A molar theory of reinforcement schedules. J Exp Anal Behav 30(3):345–360. https://doi.org/10.1901/jeab.1978.30-345
Rachlin H, Burkhard B (1978) The temporal triangle: response substitution in instrumental conditioning. Psychol Rev 85:22–47
Rachlin H, Green L, Kagel JH, Battalio RC (1976) Economic demand theory and psychological studies of choice. Psychol Learn Motiv 10:129–154
Rachlin H, Battalio RC, Kagel JH, Green L (1981) Maximization theory in behavioral psychology. Behav Brain Sci 4:371–417
Singh S, Lewis L, Barto AG (2010) Intrinsically motivated reinforcement learning: an evolutionary perspective. IEEE Trans Auton Ment Dev 2(2):70–82
Skinner BF (1966) The phylogeny and ontogeny of behavior. Contingencies of reinforcement throw light on contingencies of survival in the evolution of behavior. Science 153(3741):1205–1213. https://doi.org/10.1126/science.153.3741.1205
Skinner BF (1981) Selection by consequences. Science 213(4507):501–504
Stephens DW (1991) Change, regularity, and value in the evolution of animal learning. Behav Ecol 2(1):77–89. https://doi.org/10.1093/beheco/2.1.77
Stephens DW, Krebs JR (1986) Foraging theory. Monographs in behavior and ecology. Princeton University Press, Princeton
Strand PS, Robinson MJF, Fiedler KR, Learn R, Anselme P (2021) Quantifying the instrumental and noninstrumental underpinnings of Pavlovian responding with the Price equation. Psychon Bull Rev. https://doi.org/10.3758/s13423-021-02047-z
Taylor PD (1990) Allele-frequency change in a class-structured population. Am Nat 135(1):95–106
Thorndike EL (1900) The associative processes in animals. In: Biological lectures from the marine biological laboratory of woods holl, vol 1899, pp 69–91
