Adaptation, Punctuation and Information: A Rate-Distortion Approach to Non-Cognitive 'Learning Plateaus' in Evolutionary Process
Tóm tắt
We extend recent information-theoretic phase transition approaches to evolutionary and cognitive process via the Rate Distortion and Joint Asymptotic Equipartition Theorems, in the circumstance of interaction with a highly structured environment. This suggests that learning plateaus in cognitive systems and punctuated equilibria in evolutionary process are formally analogous, even though evolution is not cognitive. Extending arguments by Adami et al. (2000), we argue that 'adaptation' is the process by which a distorted genetic image of a coherently structured environment is imposed upon a species.
Tài liệu tham khảo
Adami, C., C. Ofria and T. Collier (2000). Evolution of biological complexity. Proceedings of the National Academy of Sciences 97: 4463-4468.
Ash, R. (1990). Information Theory. Dover Publications, New York.
Atlan, H. and I.R. Cohen (1998). Immune information, self-organization and meaning. International Immunology 10: 711-717.
Bennett, C. (1988). Logical depth and physical complexity. In: Herkin, R. (Ed). The Universal Turing Machine: A Half-Century Survey. Oxford University Press, pp. 227-257.
Binney, J., N. Dowrick, A. Fisher and M. Newman (1995). The theory of critical phenomena. Clarenden Press, Oxford.
Cohen, I.R. (1992). The cognitive principle challenges clonal selection. Immunology Today 13: 441-444.
Cohen, I.R. (2000). Tending Adam's Garden: evolving the cognitive immune self. Academic Press, New York.
Cohen, I.R. (2001). Immunity, set points, reactive systems, and allograft rejection. To appear.
Cover, T. and J. Thomas (1991). Elements of Information Theory. Wiley, New York.
Dembo, A. and O. Zeitouni (1998). Large Deviations: Techniques and Applications, 2nd Ed., Springer-Verlag, New York.
Dimitrov, A. and J. Miller (2001). Neural coding and decoding: communication channels and quantization. Network: Computation on Neural Systems 12: 441-472.
Durham, W. (1991). Coevolution: Genes, Culture and Human Diversity. Stanford University Press, Palo Alto, CA.
Eldredge, N. (1995). Reinventing Darwin: the great debate at the high table of evolutionary theory. John Wiley and Sons, New York.
Gould, S. and N. Eldredge (1977). Punctuated equilibria: the tempo and mode of evolutionary reconsidered. Paleobiology 3: 115-151.
Granovetter, M. (1973). The strength of weak ties. American Journal of Sociology 78: 1360-1380.
Khinchine, A. (1957). The Mathematical Foundations of Information Theory. Dover Publications, New York.
Labov, W. (1966). The Social Stratification of English in New York City. Center for Applied Linguistics, Washington, DC.
Labov, W. (ed.) (1980). Locating Language in Time and Space. Academic Press, New York.
Labov, W. (1986). Language structure and social structure, in S. Lindenberg et al. (eds.), Approaches to Social Theory. Russell Sage, New York.
Lewontin, R. (2000). The Triple Helix: Gene, Organism and Environment. Harvard University Press, Cambridge, MA.
McCauley, L. (1993). Chaos, Dynamics, and Fractals: an algorithmic approach to deterministic chaos. Cambridge University Press, Cambridge, UK.
Milroy, L. (1987). Language and Social Networks. second edition, Blackwell, Cambridge, USA.
Milroy, J. (1992). Linguistic Variation and Change. Blackwell, Cambridge, USA.
Park H., S. Amari and K. Fukumizu (2000). Adaptive natural gradient learning algorithms for various stochastic models. Neural Networks 13: 755-764.
Pielou, E. (1977). Mathematical Ecology. John Wiley and Sons, New York.
Richerson, P. and R. Boyd (1995). The evolution of human hypersociality. Paper for Ringberg Castle Symposium on Ideology, Warfare and Indoctrinability (January, 1995), and for HBES meeting, 1995.
Richerson, P. and R. Boyd (1998). Complex societies: the evolutionary origins of a crude superorganism. to appear.
Rojdestvenski, I. and M. Cottam (2000). Mapping of statistical physics to information theory with applications to biological systems. Journal of Theoretical Biology 202: 43-54.
Rose, K. (1998). Deterministic annealing for clustering, compression, classification, regression and related optimization problems. Proceedings of the IEEE 86: 2210-2239.
Trudgill, P. and J. Cheshire (eds.) (1998). The Sociolinguistics Reader. Arnold, New York.
Waddington, C. (1972). Epilog. In Waddington C, (Ed.) Toward a Theoretical Biology 4: Essays. Aldin-Atherton, Chicago.
Wallace, D. and R. Wallace (2000). Life and death in Upper Manhattan and the Bronx: toward an evolutionary perspective on catastrophic social change. Environment and Planning A 32: 1245-1266.
Wallace, R. (2000a). Language and coherent neural amplification in hierarchical systems: Renormalization and the dual information source of a generalized spatiotemporal stochastic resonance. International Journal of Bifurcation and Chaos 10: 493-502.
Wallace, R. (2000b). Information resonance and pattern recognition in classical and quantum systems: toward a 'language model' of hierarchical neural structure and process. www.ma.utexas.edu/mp_arc-bin/mpa?yn=00-190.
Wallace, R. and R.G. Wallace (1998). Information theory, scaling laws and the thermodynamics of evolution. Journal of Theoretical Biology 192: 545-559.
Wallace, R. and R.G. Wallace (1999). Organisms, organizations and interactions: an information theory approach to biocultural evolution. BioSystems 51: 101-119.
Wilson, K. (1971). Renormalization group and critical phenomena. I Renormalization group and the Kadanoff scaling picture. Physical Review B 4: 3174-3183.