Proposal for a computational model of incentive memory

Acevedo-Mosqueda, 2006, A new model of BAM: Alpha-beta bidirectional associative memories, 286 Adigun, 2019, Noise-boosted bidirectional backpropagation and adversarial learning, Neural Networks, 120, 9, 10.1016/j.neunet.2019.09.016 Amaral, 1989, The three-dimensional organization of the hippocampal formation: A review of anatomical data, Neuroscience, 31, 571, 10.1016/0306-4522(89)90424-7 Ambroggi, 2008, Basolateral amygdala neurons facilitate reward-seeking behavior by exciting nucleus accumbens neurons, Neuron, 59, 648, 10.1016/j.neuron.2008.07.004 Andersen, 2006 Anderson, 2014 Arlin Cuncic, 2022 Basu, 1999, A cursory look at parallel architectures and biologically inspired computing, Soft Computing and Intelligent Systems: Theory and Applications, 185 Bear, 2003, Bidirectional synaptic plasticity: from theory to reality, Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 358, 649, 10.1098/rstb.2002.1255 Benarroch, 2015, La amígdala, Neurology, 84, 31 Beyeler, 2016, Divergent routing of positive and negative information from the amygdala during memory retrieval, Neuron, 90, 348, 10.1016/j.neuron.2016.03.004 Bhatia, 2019, Bidirectional constraint satisfaction in rational strategic decision making, Journal of Mathematical Psychology, 88, 48, 10.1016/j.jmp.2018.11.004 Bissonette, 2015, Neurophysiology of reward-guided behavior: Correlates related to predictions, value, motivation, errors, attention, and action, Behavioral Neuroscience of Motivation, 199, 10.1007/7854_2015_382 Bosch, 2014, Reinstatement of associative memories in early visual cortex is signaled by the hippocampus, Journal of Neuroscience, 34, 7493, 10.1523/JNEUROSCI.0805-14.2014 Bowman, 2020 Bowman, 2020, Training set coherence and set size effects on concept generalization and recognition, Journal of Experimental Psychology: Learning, Memory, and Cognition, 46, 1442 Cain, 2008, Brain mechanisms of Pavlovian and instrumental aversive conditioning, Handbook of Behavioral Neuroscience, 17, 103, 10.1016/S1569-7339(07)00007-0 Chai, 2010, Scene complexity: Influence on perception, memory, and development in the medial temporal lobe, Frontiers in Human Neuroscience, 21 Chartier, 2006, A bidirectional heteroassociative memory for binary and grey-level patterns, IEEE Transactions on Neural Networks, 17, 385, 10.1109/TNN.2005.863420 Chartier, 2006, A sequential dynamic heteroassociative memory for multistep pattern recognition and one-to-many association, IEEE Transactions on Neural Networks, 17, 59, 10.1109/TNN.2005.860855 Chartier, 2009, A new bidirectional heteroassociative memory encompassing correlational, competitive and topological properties, Neural Networks, 22, 568, 10.1016/j.neunet.2009.06.011 Chong, 2007, Integrated cognitive architectures: A survey, Artificial Intelligence Review, 28, 103, 10.1007/s10462-009-9094-9 Chrobak, 2000, Physiological patterns in the hippocampo-entorhinal cortex system, Hippocampus, 10, 457, 10.1002/1098-1063(2000)10:4<457::AID-HIPO12>3.0.CO;2-Z Church, 2020 Corchado, 2022 Cowan, 2008, What are the differences between long-term, short-term, and working memory?, Progress in Brain Research, 169, 323, 10.1016/S0079-6123(07)00020-9 Cutsuridis, 2008, A CA1 heteroassociative microcircuit model of the hippocampus, 26 Cutsuridis, 2008, Encoding and retrieval in a CA1 microcircuit model of the hippocampus, 238 Cutsuridis, 2010, Encoding and retrieval in a model of the hippocampal CA1 microcircuit, Hippocampus, 20, 423 Cutsuridis, 2009, Hippocampus, microcircuits and associative memory, Neural Networks, 22, 1120, 10.1016/j.neunet.2009.07.009 De Jong, 2015, Reducing ventral tegmental dopamine D2 receptor expression selectively boosts incentive motivation, Neuropsychopharmacology, 40, 2085, 10.1038/npp.2015.60 D’Ottavio, 2019 Duch, 2008, Cognitive architectures: Where do we go from here?, 122 Dukas, 2009, Learning: mechanisms, ecology and evolution, Cognitive Ecology II, 7, 10.7208/chicago/9780226169378.003.0002 Dumitru, 2013, Advantages and disadvantages of using neural networks for predictions, Ovidius University Annals, Series Economic Sciences, 13 Dunlap, 2009, Components of change in the evolution of learning and unlearned preference, Proceedings of the Royal Society B: Biological Sciences, 276, 3201, 10.1098/rspb.2009.0602 Eichenbaum, 2000, Hippocampus: Mapping or memory?, Current Biology, 10, R785, 10.1016/S0960-9822(00)00763-6 Eichenbaum, 2007, The medial temporal lobe and recognition memory, Annual Review of Neuroscience, 30, 123, 10.1146/annurev.neuro.30.051606.094328 Felleman, 1991, Distributed hierarchical processing in the primate cerebral cortex, Cerebral Cortex (New York, NY: 1991), 1, 1 Fenton, 2014, Medial prefrontal cortex circuit function during retrieval and extinction of associative learning under anesthesia, Neuroscience, 265, 204, 10.1016/j.neuroscience.2014.01.028 Ferguson, 2020, Neurons of the ventral tegmental area encode individual differences in motivational “wanting” for reward cues, Journal of Neuroscience, 40, 8951, 10.1523/JNEUROSCI.2947-19.2020 Franklin, 2012 Franklin, 2016, A LIDA cognitive model tutorial, Biologically Inspired Cognitive Architectures, 16, 105, 10.1016/j.bica.2016.04.003 Franklin, Stan, Ramamurthy, Uma, D’Mello, Sidney, Mccauley, Lee, Negatu, Aregahegn, Silva, Rodrigo, et al. (2007). LIDA: A computational model of global workspace theory and developmental learning. In AAAI fall symposium on AI and consciousness: Theoretical foundations and current approaches. Freedman, 2006, Experience-dependent sharpening of visual shape selectivity in inferior temporal cortex, Cerebral Cortex, 16, 1631, 10.1093/cercor/bhj100 Fröhlich, 2016, 97 Gobet, Fernand, & Lane, Peter (2010). The CHREST Architecture of Cognition The Role of Perception in General Intelligence. In Artificial general intelligence - proceedings of the third conference on artificial general intelligence. Gogolla, 2017, The insular cortex, Current Biology, 27, R580, 10.1016/j.cub.2017.05.010 González-Casillas, 2018, Towards a model of visual recognition based on neurosciences, Procedia Computer Science, 145, 214, 10.1016/j.procs.2018.11.043 Grabenhorst, 2011, Value, pleasure and choice in the ventral prefrontal cortex, Trends in Cognitive Sciences, 15, 56, 10.1016/j.tics.2010.12.004 Hasselmo, 2002, A proposed function for hippocampal theta rhythm: Separate phases of encoding and retrieval enhance reversal of prior learning, Neural Computation, 14, 793, 10.1162/089976602317318965 Hasselmo, 1999, Neural models of memory, Current Opinion in Neurobiology, 9, 184, 10.1016/S0959-4388(99)80025-7 Hawkins, 2009, Sequence memory for prediction, inference and behaviour, Philosophical Transactions of the Royal Society, Series B (Biological Sciences), 364, 1203, 10.1098/rstb.2008.0322 Hélie, 2015, Cognitive architectures and agents, Springer Handbook of Computational Intelligence, 683, 10.1007/978-3-662-43505-2_36 Henke, 2010, A model for memory systems based on processing modes rather than consciousness, Nature Reviews Neuroscience, 11, 523, 10.1038/nrn2850 Hernandez, 2020 Hiatt, 2020, An associative learning account for retrieval-induced forgetting Holly, 2016, Ventral tegmental area dopamine revisited: Effects of acute and repeated stress, Psychopharmacology, 233, 163, 10.1007/s00213-015-4151-3 Hopfield, 1982, Neural networks and physical systems with emergent collective computational abilities, Proceedings of the National Academy of Sciences, 79, 2554, 10.1073/pnas.79.8.2554 Hopfield, 2007, Hopfield network, Scholarpedia, 2, 1977, 10.4249/scholarpedia.1977 Ito, 2016, The role of the hippocampus in approach-avoidance conflict decision-making: Evidence from rodent and human studies, Behavioural Brain Research, 313, 345, 10.1016/j.bbr.2016.07.039 Izquierdo, 1993, Role of the amygdala, hippocampus and entorhinal cortex in memory consolidation and expression, Brazilian Journal of Medical and Biological Research, 26, 573 Jaime, 2015, A middleware for integrating cognitive architectures, 435 Kaas, 2019, The evolution of the pulvinar complex in primates and its role in the dorsal and ventral streams of cortical processing, Vision, 4, 3, 10.3390/vision4010003 Kalivas, 1993, Neurotransmitter regulation of dopamine neurons in the ventral tegmental area, Brain Research Reviews, 18, 75, 10.1016/0165-0173(93)90008-N Kandel, 2007 Kesner, 2018, An analysis of dentate gyrus function (an update), Behavioural Brain Research, 354, 84, 10.1016/j.bbr.2017.07.033 Kesner, 2015, Role of the dentate gyrus in mediating object-spatial configuration recognition, Neurobiology of Learning and Memory, 118, 42, 10.1016/j.nlm.2014.11.004 Kobayashi, 2021, Bicomplex-valued twin-hyperbolic hopfield neural networks, Neurocomputing, 434, 203, 10.1016/j.neucom.2020.12.109 Kohonen, 1972, Correlation matrix memories, IEEE Transactions on Computers, 100, 353, 10.1109/TC.1972.5008975 Kosko, 1987, Adaptive bidirectional associative memories, Applied Optics, 26, 4947, 10.1364/AO.26.004947 Kosko, 1988, Bidirectional associative memories, IEEE Transactions on Systems, Man, and Cybernetics, 18, 49, 10.1109/21.87054 Kosko, 2021, Bidirectional associative memories: Unsupervised Hebbian learning to bidirectional backpropagation, IEEE Transactions on Systems, Man, and Cybernetics: Systems, 51, 103, 10.1109/TSMC.2020.3043249 Kugele, 2021, Learning in LIDA, Cognitive Systems Research, 66, 176, 10.1016/j.cogsys.2020.11.001 Laird, 2019 Lane, 2012, CHREST models of implicit learning and board game interpretation, 148 Lavenex, 2000, Hippocampal-neocortical interaction: A hierarchy of associativity, Hippocampus, 10, 420, 10.1002/1098-1063(2000)10:4<420::AID-HIPO8>3.0.CO;2-5 LeDoux, 2007, The amygdala, Current Biology, 17, R868, 10.1016/j.cub.2007.08.005 LeDoux, 1990, The lateral amygdaloid nucleus: Sensory interface of the amygdala in fear conditioning, Journal of Neuroscience, 10, 1062, 10.1523/JNEUROSCI.10-04-01062.1990 Lee, 1994, Stereo correspondence using the hopfield neural network of a new energy function, Pattern Recognition, 27, 1513, 10.1016/0031-3203(94)90129-5 Lee, 2012, The hippocampus and visual perception, Frontiers in Human Neuroscience, 6, 91, 10.3389/fnhum.2012.00091 de León, 2011, Arquitecturas cognitivas y cerebro: hacia una teoría unificada de la cognición, International Journal of Psychological Research, 4, 38 Lin, 2020, The raphe dopamine system controls the expression of incentive memory, Neuron, 106, 498, 10.1016/j.neuron.2020.02.009 Lucentini, 2015, A comparison among cognitive architectures: A theoretical analysis, Procedia Computer Science, 71, 56, 10.1016/j.procs.2015.12.198 Memel, 2017, Visual integration enhances associative memory equally for young and older adults without reducing hippocampal encoding activation, Neuropsychologia, 100, 195, 10.1016/j.neuropsychologia.2017.04.031 Milner, 1998, Neuropsychological studies of perception and visuomotor control, Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 353, 1375, 10.1098/rstb.1998.0291 Morgado-Bernal, 2005, Psicobiología del aprendizaje y la memoria, Cic: cuadernos de información y comunicación, 221 Motzkin, 2015, Ventromedial prefrontal cortex is critical for the regulation of amygdala activity in humans, Biological Psychiatry, 77, 276, 10.1016/j.biopsych.2014.02.014 Muñoz-Capote, 2022, A bioinspired model to motivate learning of appetitive signals’ incentive value under a pavlovian conditioning approach, Neurocomputing, 10.1016/j.neucom.2022.05.104 Murty, 2017, Selectivity in postencoding connectivity with high-level visual cortex is associated with reward-motivated memory, Journal of Neuroscience, 37, 537, 10.1523/JNEUROSCI.4032-15.2016 Namazi, 2019, Information-based analysis of the relation between visual stimuli and human eye movements, Fluctuation and Noise Letters, 18, 10.1142/S021947751950010X Nieuwenhuys, 2012, The insular cortex: A review, Progress in Brain Research, 195, 123, 10.1016/B978-0-444-53860-4.00007-6 Ohara, 2018, Intrinsic projections of layer Vb neurons to layers Va, III, and II in the lateral and medial entorhinal cortex of the rat, Cell Reports, 24, 107, 10.1016/j.celrep.2018.06.014 Okano, 2000, Learning and memory, Proceedings of the National Academy of Sciences, 97, 12403, 10.1073/pnas.210381897 O’keefe, S. E. M., & Austin, Jim (1994). Application of an Associative Memory to the Analysis of Document Fax Images. In BMVC (pp. 1–12). Palombo, 2019, Hippocampal contributions to value-based learning: Converging evidence from fMRI and amnesia, Cognitive, Affective, & Behavioral Neuroscience, 19, 523, 10.3758/s13415-018-00687-8 Pontes, 2020, The evolutionary origin of associative learning, American Naturalist, 195, E1, 10.1086/706252 Ranganath, 2006, Working memory for visual objects: Complementary roles of inferior temporal, medial temporal, and prefrontal cortex, Neuroscience, 139, 277, 10.1016/j.neuroscience.2005.06.092 Ranganath, 2004, Inferior temporal, prefrontal, and hippocampal contributions to visual working memory maintenance and associative memory retrieval, Journal of Neuroscience, 24, 3917, 10.1523/JNEUROSCI.5053-03.2004 Reber, 2008, Cognitive neuroscience of declarative and nondeclarative memory, Advances in Psychology, 139, 113, 10.1016/S0166-4115(08)10010-3 Redondo, 2014, Bidirectional switch of the valence associated with a hippocampal contextual memory engram, Nature, 513, 426, 10.1038/nature13725 Rolls, 1995, A model of the operation of the hippocampus and entorhinal cortex in memory, International Journal of Neural Systems, 6, 51 Rolls, 2000, Memory systems in the brain, Annual Review of Psychology, 51, 599, 10.1146/annurev.psych.51.1.599 Rosales, 2017, Automatic reward system for virtual creatures, emergent processes of emotions and physiological motivation, Biologically Inspired Cognitive Architectures, 22, 51, 10.1016/j.bica.2017.09.003 Rose, 2018, Experience-dependent plasticity in the lateral geniculate nucleus, Current Opinion in Neurobiology, 53, 22, 10.1016/j.conb.2018.04.016 Rosen, 2018, The role of visual association cortex in associative memory formation across development, Journal of Cognitive Neuroscience, 30, 365, 10.1162/jocn_a_01202 Sah, 2003, The amygdaloid complex: anatomy and physiology, Physiological reviews, 83, 803, 10.1152/physrev.00002.2003 Schacter, 2013, Learning and memory Schumacher, 2016, The ventral hippocampus, but not the dorsal hippocampus is critical for learned approach-avoidance decision making, Hippocampus, 26, 530, 10.1002/hipo.22542 Sefton, 2015, Visual system, 947 Sharp, 1999, Complimentary roles for hippocampal versus subicular/entorhinal place cells in coding place, context, and events, Hippocampus, 9, 432, 10.1002/(SICI)1098-1063(1999)9:4<432::AID-HIPO9>3.0.CO;2-P Simons, 2003, Prefrontal and medial temporal lobe interactions in long-term memory, Nature Reviews Neuroscience, 4, 637, 10.1038/nrn1178 Solís, 2009, Neuroanatomía funcional de la memoria, Archivos de Neurociencias, 14, 176 Squire, 1996, Structure and function of declarative and nondeclarative memory systems, Proceedings of the National Academy of Sciences, 93, 13515, 10.1073/pnas.93.24.13515 Su, 1999, Application of associative memory in human face detection, 3194 Sun, 2005, The interaction of the explicit and the implicit in skill learning: A dual-process approach, Psychological Review, 112, 159, 10.1037/0033-295X.112.1.159 Sun, 2006, Accounting for a variety of reasoning data within a cognitive architecture, Journal of Experimental & Theoretical Artificial Intelligence, 18, 169, 10.1080/09528130600557713 Suzuki, 2005, Associative learning and the hippocampus, Psychological Science Agenda Takehara-Nishiuchi, 2014, Entorhinal cortex and consolidated memory, Neuroscience Research, 84, 27, 10.1016/j.neures.2014.02.012 Takehara-Nishiuchi, 2022, Neuronal ensemble dynamics in associative learning, Current Opinion in Neurobiology, 73, 10.1016/j.conb.2022.102530 Tanaka, 1996, Representation of visual features of objects in the inferotemporal cortex, Neural Networks, 9, 1459, 10.1016/S0893-6080(96)00045-7 The University of Michigan SOAR group, 2022 Treves, 1994, Computational analysis of the role of the hippocampus in memory, Hippocampus, 4, 374, 10.1002/hipo.450040319 Tyulmankov, 2021, Biological key-value memory networks, Advances in Neural Information Processing Systems, 34 Valentin Nägerl, 2004, Bidirectional activity-dependent morphological plasticity in hippocampal neurons, Neuron, 44, 759, 10.1016/j.neuron.2004.11.016 Vanston, 2017, Sex differences in the human visual system, Journal of Neuroscience Research, 95, 617, 10.1002/jnr.23895 Wallenstein, 1998, The hippocampus as an associator of discontiguous events, Trends in Neurosciences, 21, 317, 10.1016/S0166-2236(97)01220-4 Wang, 2017, Associative memory cells: Formation, function and perspective, F1000Research, 6, 10.12688/f1000research.11096.2 Wassum, 2015, The basolateral amygdala in reward learning and addiction, Neuroscience & Biobehavioral Reviews, 57, 271, 10.1016/j.neubiorev.2015.08.017 Weber, 2012, ACT - adaptive control of thought, 60 Wendelken, 2011, Neural indices of improved attentional modulation over middle childhood, Developmental Cognitive Neuroscience, 1, 175, 10.1016/j.dcn.2010.11.001 Witkowski, 2020, Examining sleep’s role in memory generalization and specificity through the lens of targeted memory reactivation, Current Opinion in Behavioral Sciences, 33, 86, 10.1016/j.cobeha.2020.01.007 Wolosin, 2012, Reward modulation of hippocampal subfield activation during successful associative encoding and retrieval, Journal of Cognitive Neuroscience, 24, 1532, 10.1162/jocn_a_00237 Wolosin, 2013, Distributed hippocampal patterns that discriminate reward context are associated with enhanced associative binding, Journal of Experimental Psychology: General, 142, 1264, 10.1037/a0033609 Woloszyn, 2009, Neural dynamics in inferior temporal cortex during a visual working memory task, Journal of Neuroscience, 29, 5494, 10.1523/JNEUROSCI.5785-08.2009 Wyss, 2006, A model of the ventral visual system based on temporal stability and local memory, PLOS Biology, 4, 10.1371/journal.pbio.0040120 Xue, 2010, Greater neural pattern similarity across repetitions is associated with better memory, Science, 330, 97, 10.1126/science.1193125 Yáñez-Márquez, 2018, Theoretical foundations for the alpha-beta associative memories: 10 years of derived extensions, models, and applications, Neural Processing Letters, 48, 811, 10.1007/s11063-017-9768-2 Yang, 2017, From structure to behavior in basolateral amygdala-hippocampus circuits, Frontiers in Neural Circuits, 11, 86, 10.3389/fncir.2017.00086 Zhaoping, 2019, A new framework for understanding vision from the perspective of the primary visual cortex, Current Opinion in Neurobiology, 58, 1, 10.1016/j.conb.2019.06.001 Zheng, 2017, Amygdala-hippocampal dynamics during salient information processing, Nature Communications, 8, 1, 10.1038/ncomms14413