The Understanding Capacity and Information Dynamics in the Human Brain

Entropy - Tập 21 Số 3 - Trang 308
Yan M. Yufik1
1Virtual Structures Research, Inc., Potomac, MD 20854, USA

Tóm tắt

This article proposes a theory of neuronal processes underlying cognition, focusing on the mechanisms of understanding in the human brain. Understanding is a product of mental modeling. The paper argues that mental modeling is a form of information production inside the neuronal system extending the reach of human cognition “beyond the information given” (Bruner, J.S., Beyond the Information Given, 1973). Mental modeling enables forms of learning and prediction (learning with understanding and prediction via explanation) that are unique to humans, allowing robust performance under unfamiliar conditions having no precedents in the past history. The proposed theory centers on the notions of self-organization and emergent properties of collective behavior in the neuronal substrate. The theory motivates new approaches in the design of intelligent artifacts (machine understanding) that are complementary to those underlying the technology of machine learning.

Từ khóa


Tài liệu tham khảo

Bruner, J.S. (1973). Beyond the Information Given, W.W. Norton and Company.

Eddington, A. (1978). Space, Time and Gravitation, The University Press.

Hariri, Y.N. (2018). Sapiens: A brief History of Humankind, Harper Perennial.

Popper, K.R. (1994). Knowledge and the Mind-Body Problem, Routledge.

Popper, K.R., and Eccles, J.R. (1977). The Self and Its Brain, Springer.

Piaget, J. (1978). Success and Understanding, Harvard University Press.

Piaget, J. (1975). The Development of Thought: Equilibration of Cognitive Structures, The Viking Press.

Maturana, H.R., and Varela, F.J. (1998). The Tree of Knowledge: The Biological Roots of Human Understanding, Shambhala.

Kirchhoff, 2018, The Markov blankets of life: Autonomy, active inference and the free energy principle, J. R. Soc. Interface, 15, 20170792, 10.1098/rsif.2017.0792

Friston, 2013, Life as we know it, J. R. Soc. Interface, 10, 20130475, 10.1098/rsif.2013.0475

Friston, 2010, The free-energy principle: A unified brain theory?, Nat. Rev. Neurosci., 11, 127, 10.1038/nrn2787

Russell, B. (1921). The Analysis of Mind, George Allen & Unwin LTD.

Morowitz, H.J. (1979). Energy Flow in Biology, Ox Bow Press.

Prigogine, I. (1980). From Being to Becoming: Time and Complexity in the Physical Sciences, W.H. Freeman and Co.

Prigogine, I., Stengers, I., and Toffler, A. (1984). Order Out of Chaos, Bantam.

Haken, H. (1977). Synergetics: Nonequilibrium Phase Transitions and Self-Organization in Physics, Chemistry and Biology, Springer.

Klimontovich, Y.L. (1991). Turbulent Motion and the Structure of Chaos: A New Approach to the Statistical Theory of Open Systems, Kluwer Academic Publishers.

Glansdorff, P., and Prigogine, I. (1971). Thermodynamic Theory of Structure, Stability and Fluctuations, Wiley-Interscience.

Klimontovich, Y.L. (1986). Statistical Physics, Harwood Academic Publishers.

Klimontovich, 1996, Is turbulent motion chaos or order, Phys. B Condense. Matter, 228, 51, 10.1016/S0921-4526(96)00338-9

Brillouine, L. (1956). Science and Information Theory, Academic Press.

Bendjaballah, C., Hirota, O., and Reynaud, S. (1990). Physical information theory for 30 years: Basic concepts and results. Quantum Aspects of Optical Communications, Springer.

Stratonovich, 1965, On value of information, Izv. USSR Acad. Sci. Tech. Cybern., 5, 3

Stratonovich, R.L. (1975). Information Theory, Sovetskoe Radio. (In Russian).

Stratonovich, R.L. (2012). Nonlinear Nonequilibrium Thermodynamics: Linear and Nonlinear Fluctuation-Dissipation Theorems, Springer.

Jarzynski, 1997, A nonequilibrium equality for free energy differences, Phys. Rev. Lett., 78, 2690, 10.1103/PhysRevLett.78.2690

Still, 2014, Information bottleneck approach to predictive inference, Entropy, 16, 968, 10.3390/e16020968

Nielsen, M.A., and Chuang, I.L. (2000). Quantum Computation and Quantum Information, Cambridge University Press.

Shannon, 1948, A mathematical theory of communication, Bell Syst. Tech. J., 2, 623, 10.1002/j.1538-7305.1948.tb00917.x

Pribram, K.H. (1998). Virtual associative networks: A framework for cognitive modelling. Brain and Values, Lawrence Erlbaum Associates.

Yufik, Y.M. (2002, January 12–17). How the mind works: An exercise in pragmatism. Proceedings of the International Joint Conference on Neural Networks (IJCNN 02), Honolulu, HI, USA.

Yufik, 2013, Understanding, consciousness and thermodynamics of cognition, Chaos Solitons Fractals, 55, 44, 10.1016/j.chaos.2013.04.010

Yufik, 2016, Life and understanding: Origins of the understanding capacity in the self-organizing nervous system, Front. Syst. Neurosci., 10, 98, 10.3389/fnsys.2016.00098

Hebb, D.O. (1949). The Organization of Behavior, Wiley & Sons.

Hebb, D.O. (1980). Essay on Mind, Lawrence Erlbaum Associates.

Briggman, 2006, From crawling to cognition: Analyzing the dynamical interactions among populations of neurons, Curr. Opin. Neurobiol., 16, 135, 10.1016/j.conb.2006.03.014

Briggman, 2005, Optical imaging of neuronal populations during decision-making, Science, 307, 896, 10.1126/science.1103736

Calabrese, 2006, Motor networks: Shifting coalitions, Curr. Biol., 17, 139, 10.1016/j.cub.2006.12.007

Kristan, 2005, Neuronal control of leech behavior, Prog. Neurobiol., 76, 279, 10.1016/j.pneurobio.2005.09.004

Lin, 2006, Organizing principles of real-time memory encoding: Neural clique assemblies and universal neural codes, Trends Neurosci., 29, 48, 10.1016/j.tins.2005.11.004

Georgopoulos, 1989, Mental rotation of the neuronal population vector, Science, 243, 234, 10.1126/science.2911737

Georgopoulos, 1987, Cognitive spatial-motor processes 1. The making of movements at various angles from a stimulus direction, Exp. Brain Res., 65, 361

Georgopoulos, 1993, Cognitive neurophysiology of the motor cortex, Science, 260, 47, 10.1126/science.8465199

Georgopoulos, 1988, Primate motor cortex and free arm movements to visual targets in three-dimensional space. II. Coding of the direction of movement by a neuronal population, J. Neurosci., 8, 2928, 10.1523/JNEUROSCI.08-08-02928.1988

Amirikian, 1999, Cortical populations and behaviour: Hebb’s thread, Can. J. Exp. Psychol., 53, 21, 10.1037/h0087297

Chang, 2017, The code for facial identity in the primate brain, Cell, 169, 1013, 10.1016/j.cell.2017.05.011

James, W. (1950). The Principles of Psychology, Dover Publications.

De Groot, A.D. (1965). Though and Choice in Chess, Basic Books Publishers.

Kasparov, G. (2007). How Life Imitates Chess, Bloomsbury.

Berwick, R.C., and Chomsky, N. (2016). Why Only Us? Language and Evolution, The MIT Press.

Nelson, 2017, Neurophysiological dynamics of phrase-structure building during sentence processing, Proc. Natl. Acad. Sci. USA, 114, E3669, 10.1073/pnas.1701590114

Glenberg, 2000, Symbol grounding and meaning: A Comparison of high-dimensional and embodied theories of meaning, J. Mem. Lang., 43, 379, 10.1006/jmla.2000.2714

Bower, T.G.R. (1974). Development in Infancy, W.H. Freeman & Co.

Bernstein, N. (1967). The Co-Ordination and Regulation of Movements, Pergamon Press.

Saltiel, 2003, Combinations of muscle synergies in the construction of a natural motor behavior, Nat. Neurosci., 6, 300, 10.1038/nn1010

Bizzi, 2005, Shared and specific muscle synergies in natural motor behaviors, Proc. Natl. Acad. Sci. USA, 102, 3076, 10.1073/pnas.0500199102

Nazifi, 2017, Shared and task-specific muscle synergies during normal walking and slipping, Front. Hum. Neurosci., 11, 40, 10.3389/fnhum.2017.00040

Chvatal, 2012, Voluntary and reactive recruitment of locomotor muscle synergies during perturbed walking, J. Neurosci., 32, 12237, 10.1523/JNEUROSCI.6344-11.2012

Overduin, 2012, Microstimulation activates a handful of muscle synergies, Neuron, 76, 1071, 10.1016/j.neuron.2012.10.018

Sukstanskii, 2006, Theoretical model of temperature regulation in the brain during changes in functional activity, Proc. Natl. Acad. Sci. USA, 103, 12144, 10.1073/pnas.0604376103

Eysenck, M.W., and Keane, M.T. (1995). Cognitive Psychology, Psychology Press.

Horwitz, 1988, The cerebral metabolic landscape in autism; intercorrelations of regional glucose utilization, Arch. Neurol., 45, 749, 10.1001/archneur.1988.00520310055018

Just, 2004, Cortical activation and synchronization during sentence comprehension in high-functioning autism: Evidence of underconnectivity, Brain, 127, 1811, 10.1093/brain/awh199

McAlonnan, 2005, Mapping the brain in autism: A voxel-based MRI study of volumetric differences and intercorrelations in autism, Brain, 128, 268, 10.1093/brain/awh332

Mayes, 2011, Anxiety, depression, and irritability in children with autism relative to children with other neuropsychiatric disorders and typical development, Res. Autism Spectr. Disord., 5, 474, 10.1016/j.rasd.2010.06.012

Treffert, 2009, Savant syndrome: An extraordinary condition, Philos. Trans. R. Soc. Lond. B Bio. Sci., 364, 1351, 10.1098/rstb.2008.0326

Hardy, 2002, The amyloid hypothesis of Alzheimer’s disease: Progress and problems on the road to therapeutics, Science, 297, 353, 10.1126/science.1072994

Ahmed, 2016, Neuronal network disintegration: Common pathways, linking neurodegenerative diseases, J Neurol. Neurosurg. Psychiatry, 87, 1234, 10.1136/jnnp-2014-308350

Descartes, R. (1964). Philosophical Essays, Bobbs-Merill.

Libet, 1979, Subjective referral of the timing for a conscious sensory experience, Bain, 102, 193

Stephens, G.L., and Graham, G. (1994). Self-Consciousness, Mental Agency, and the Clinical Psychopathology of Thought Insertion, Philosophy, Psychiatry and Psychology, Johns Hopkins University Press.

Westbrook, 2015, Cognitive effort: A neuroeconomy approach, Cogn. Affect Behav. Neurosci., 15, 395, 10.3758/s13415-015-0334-y

Kurzban, 2013, An opportunity cost model of subjective effort and task performance, Behav. Brain Sci., 36, 661, 10.1017/S0140525X12003196

Zee, 2009, The intrinsic value of visual information affects saccade velocities, Exp. Brain Res., 196, 475, 10.1007/s00221-009-1879-1

Gegenfurtner, 2012, Dynamic integration of information about salience and value for saccadic eye movements, Proc. Natl. Acad. Sci. USA, 109, 7547, 10.1073/pnas.1115638109

Veale, 2002, Over-valued ideas: A conceptual analysis, Behav. Res. Ther., 40, 383, 10.1016/S0005-7967(01)00016-X

Bartram, 2013, The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value, Neuroimage, 76, 412, 10.1016/j.neuroimage.2013.02.063

Diekhof, 2012, The role of the human ventral striatum and the medial orbitofrontal cortex in the representation of reward magnitude—An activation likelihood estimation meta-analysis of neuroimaging studies of passive reward expectancy and outcome processing, Neuropshologia, 50, 1252, 10.1016/j.neuropsychologia.2012.02.007

Peters, 2010, Neural representation of subjective reward value, Behav. Brain Res., 213, 135, 10.1016/j.bbr.2010.04.031

Kurnianinsingh, 2016, Natural mechanisms of the transformation from objective value to to subjective utility: Converting from count to worth, Front. Neurosci., 10, 507

Raichle, 2001, A default mode of brain function, Proc. Natl. Acad. Sci. USA, 98, 676, 10.1073/pnas.98.2.676

Koestler, A. (1964). The Act of Creation, Arkana.

Noftzinger, 1997, Forebrain activation in REM sleep: An FDG PET study, Brain Res., 770, 192, 10.1016/S0006-8993(97)00807-X

Vasquez, 2001, Basal forebrain acetylcholine release during REM sleep is significantly greater than during waking, Am. J. Physiol. Regul. Integr. Comp. Physiol., 280, 598, 10.1152/ajpregu.2001.280.2.R598

Tsujino, 2009, Orexin/Hypocretin: A Neuropeptide at the interface of sleep, energy homeostasis, and reward system, Pharmacol. Rev., 61, 162, 10.1124/pr.109.001321

Rechtschaffen, 1989, Sleep deprivation in rats: Integration and discussion of the findings, Sleep, 12, 68

Bennion, 2015, Sleep and cortisol interact to support memory consolidation, Cereb. Cortex, 25, 646, 10.1093/cercor/bht255

Hobson, 2009, REM sleep and dreaming: Towards a theory of protoconsiousness, Nat. Rev. Neurosci., 10, 803, 10.1038/nrn2716

Saalmann, 2011, Cognitive and perceptual functions of the visual thalamus, Neuron, 71, 209, 10.1016/j.neuron.2011.06.027

Saalmann, Y.B., and Kastner, S. (2015). The cognitive thalamus. Front. Syst. Neurosci.

Bruno, 2006, Cortex is driven by weak but synchronously active thalamocortical synapses, Science, 312, 1622, 10.1126/science.1124593

Mitchell, 2013, What does the mediodorsal thalamus do?, Front. Syst. Neurosci., 7, 37, 10.3389/fnsys.2013.00037

Prevosto, 2013, Cognitive control of movement via the cerebellar-recipient thalamus, Front. Syst. Neurosci., 7, 56, 10.3389/fnsys.2013.00056

Minamimoto, 2014, Neural signal for counteracting pre-action bias in the centromedian thalamic nucleus, Front. Syst. Neurosci., 8, 3, 10.3389/fnsys.2014.00003

Klostermann, 2013, Functional roles of the thalamus for language capacities, Front. Syst. Neurosci., 7, 32, 10.3389/fnsys.2013.00032

Saalmann, 2014, Intralaminar and medial thalamic influence on cortical synchrony, information transmission and cognition, Front. Syst. Neurosci., 8, 83, 10.3389/fnsys.2014.00083

Ito, 2008, Control of mental activities by internal models in the cerebellum, Nat. Rev. Neurosci., 9, 304, 10.1038/nrn2332

Leisman, 2014, Cognitive-motor interactions of the basal ganglia in development, Front. Syst. Neurosci., 8, 16, 10.3389/fnsys.2014.00016

Cotterill, 2001, Cooperation of the basal ganglia, cerebellum, sensory cerebrum and hippocampus: Possible implications for cognition, consciousness, intelligence and creativity, Prog. Neurobiol., 64, 1, 10.1016/S0301-0082(00)00058-7

Yagi, 2013, Genetic basis of neuronal individuality in the mammalian brain, J. Neurogenet., 27, 97, 10.3109/01677063.2013.801969

Haken, H. (1996). Principles of Brain Functioning: A Synergistic Approach to Brain Activity, Behavior and Cognition, Springer.

Rabinovich, M.I., Huerta, R., Varona, P., and Afraimovich, V.S. (2008). Transient cognitive dynamics, metastability, and decision making. PLoS Comput. Biol., 4.

Newborn, M. (1997). Kasparov vs. Deep Blue: Computer Chess Game of Age, Springer.

Newell, A., and Simon, H.A. (1972). Human Problem Solving, Prentice Hall.

Buchler, J. (1950). Abduction and induction. Philosophical writings of Peirce, Dover Publications.

Yufik, Y., and Yufik, T. (2018, January 27–28). Situational understanding. Proceedings of the 7th International Conference on Advances in Computing, Communication, Information Technology, Rome, Italy.

Yufik, Y.M. (2018, January 18–21). Gnostron: A framework fro human-like machine understanding. Proceedings of the 2018 IEEE Symposium Series on Computational Intelligence (SSCI), Bangalore, India.

Yufik, Y.M. (2016). Systems and Method for Understanding Multi-Modal Data Streams. (9,563,843,B2), U.S. Patent.

Pellionisz, 1985, Tensor network theory of the metaorganization of functional geometries in the central nervous system, Neurocsience, 16, 245, 10.1016/0306-4522(85)90001-6

Davies, 2013, Self-organization and entropy reduction in a living cell, Biosystems, 111, 1, 10.1016/j.biosystems.2012.10.005

Daut, 1987, The living cell as an energy-transducing machine, Biochem. Biophys. Acta, 895, 41

Sabater, 2009, Entropy decrease associated to solute compartmentalization in the cell, Biosystems, 98, 31, 10.1016/j.biosystems.2009.07.001

Toyabe, 2010, Experimental demonstration of information-to-energy conversion and validation of the generalized Jarzynski equality, Nat. Phys., 6, 988, 10.1038/nphys1821

Faes, 2013, Compensated transfer entropy as a tool for reliably estimating information transfer in physiological time series, Entropy, 15, 198, 10.3390/e15010198

Stramaglia, 2014, Synergy and redundancy in the Granger causal analysis of dynamical networks, New J. Phys., 16, 105003, 10.1088/1367-2630/16/10/105003

Deutch, S. (arXiv, 2014). Constructor theory of information, arXiv.

Deutch, S. (2011). The Beginning of Infinity: Explanations That Transform the World, Penguin.

Bialek, W. (2012). Biophysics: Searching for Principles, Princeton University Press.

Yufik, Y.M. (1998). Probabilistic Resource Allocation System with Self-Adaptive Capabilities. (5,794,224), U.S Patent.

Sperry, 1986, A modified concept of consciousness, Psychol. Rev., 76, 534

Han, 2018, Neural substrates of purely endogenous, self-regulatory control of attention, Sci. Rep., 8, 925, 10.1038/s41598-018-19508-6

Asplund, 2010, A central role for the lateral prefrontal cortex in goal-directed and stimulus-driven attention, Nat. Neurosci., 13, 507, 10.1038/nn.2509

Crick, 1990, Towards a neurobiological theory of consciousness, Semin. Neurosci., 2, 263

Duffy, 1997, The neural substrate of consciousness, Psychiatr. Ann., 27, 24, 10.3928/0048-5713-19970101-07

Kimura, 2003, Tonically active neurons in the striatum encode motivational contexts of action, Brain. Dev., 25, S20, 10.1016/S0387-7604(03)90003-9

Howard, 2019, Numerical cognition in honeybees enables addition and subtraction, Sci. Adv., 5, eaav0961, 10.1126/sciadv.aav0961

Matzel, 2010, Selective attention, working memory, and animal intelligence, Neurosci. Behav. Rev., 34, 23, 10.1016/j.neubiorev.2009.07.002

Banerjee, K., Chabris, C.F., Johnson, V.E., Lee, J.J., Tsao, F., and Hauser, M.D. (2009). General intelligence in another primate: Individual differences across cognitive task performance in a New World Monkey (Saguinus oedipus). PLoS ONE, 4.

Chaqas, A.M., Theis, L., Sengupta, B., Stuttgen, M.C., Bethge, M., and Schwarz, C. (2013). Functional analysis of ultra high information rates conveyed by rat vibrissal primary afferents. Front. Neural Circuits.

Fried, 2005, Directional selectivity is formed at multiple levels by laterally offset inhibition in the rabbit retina, Neuron, 46, 1117, 10.1016/j.neuron.2005.02.007

Singh, 2018, A systematic review on muscle synergies: From building blocks of motor behavior to neurorehabilitation tool, Appl. Bionics Biomech., 2018, 3615368, 10.1155/2018/3615368

Rosenbaum, D.A. (2010). Human Motor Control, Elsevier.

Solla, 2004, Neural primitives for motion control, IEEE J. Ocean. Eng., 29, 640, 10.1109/JOE.2004.833102

Quiroga, 2012, Concept cells: The building blocks of declarative memory functions, Nat. Rev. Neurosci., 13, 587, 10.1038/nrn3251

Roberts, D.D. (1973). The existential graphs of Charles S. Peirce, Mouton.

Rabinovich, M.I., and Varona, P. (2011). Robust transient dynamics and brain functions. Front. Comp. Neurosci.

Beggs, 2003, Neuronal avalanches in neocortical circuits, J. Neurocsi., 23, 11167

Cattell, R.B. (1987). Intelligence: Its Structure, Growth, And Action, Elsevier Science.

Harris, 2012, Synaptic energy use and supply, Neuron, 75, 762, 10.1016/j.neuron.2012.08.019

Aiello, 1995, The expensive tissue hypothesis: The brain and the digestive system in human and primate evolution, Curr. Antrhropol., 36, 199, 10.1086/204350

Atwell, 2001, An energy budget for signaling in the grey matter of the brain, J. Cereb. Blood Flow Metab., 21, 1133, 10.1097/00004647-200110000-00001

Sabour, S., Frost, N., and Hinton, G.E. (2019, March 20). Dynamic Routing between Capsules. Available online: https://papers.nips.cc/paper/6975-dynamic-routing-between-capsules.pdf.

Dorny, N.C. (1975). A Vector Space Approach to Models and Optimization, John Wiley & Sons.

Kozma, R., and Noack, R. (2018, January 7–10). Neuroenergetics of brain operation and implications for energy-aware computing. Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan.

Negoita, C.V. (1992). Order, evolution, and natural law: Fundamental relations in complex systems theory. Cybernetics and Applied Systems, Marcel Decker, Inc.

Swenson, 1989, Emergent attractors and the law of maximum energy production: Foundations to a theory of general evolution, Sys. Res., 6, 187, 10.1002/sres.3850060302

Lorenz, K. (1997). The Natural Science of the Human Species, The MIT Press.

Kittel, C. (1977). Thermal Physics, John Wiley & Sons.

Haynie, D.T. (2001). Biological Thermodynamics, Cambridge University Press.

Lamprecht, I., and Zotin, A.I. (1978). Thermodynamics of Biological Processes, De Gruyter.

Werner, 2007, Metastability, criticality and phase transitions in brain and its models, Biosystems, 90, 496, 10.1016/j.biosystems.2006.12.001

Fingelkurts, 2004, Making complexity simpler: Multivariability and meatstability in the brain, Int. J. Neurocsi., 114, 843

Bressler, 2001, Cortical coordination dynamics and cognition, Trends Cog. Sci., 5, 26, 10.1016/S1364-6613(00)01564-3

Edelman, G. (1987). Neural Darwinism: The Theory of Neuronal Group Selection, Basic Books.

1995, What might cognition be, if not computation, J. Philos., 92, 345, 10.2307/2941061

Port, R., and van Gelder, T. (1995). Mind as Motion: Explorations in the Dynamics of Cognition, MIT Press.

Kelso, J.A.S. (1995). Dynamic Patterns: The Self-Organization of Brain and Behavior, Bradford Book, The MIT Press.

Lakoff, G., and Nunez, R.E. (2000). Where Mathematics Comes from: How the Embodied Mind Brings Mathematics into Beings, Basic books.

Newell, 1992, Précis of unified theories of cognition, Behav. Brain Sci., 15, 425, 10.1017/S0140525X00069478

Fugelsang, 2005, Brain-based mechanisms underlying complex causal thinking, Neuropsychologia, 43, 1204, 10.1016/j.neuropsychologia.2004.10.012

Garner, H. (2011). Frames of Mind: The Theory of Multiple Intelligences, Basic Books.