A model of the neural substrates for exploratory dynamics in basal ganglia

Akaike, 1987, Excitatory and inhibitory effects of dopamine on neuronal activity of the caudate nucleus neurons in vitro, Brain Res., 418, 262, 10.1016/0006-8993(87)90094-1 Albin, 1989, The functional anatomy of basal ganglia disorders, Trends Neurosci., 12, 366, 10.1016/0166-2236(89)90074-X Alexander, 1990, Functional architecture of basal ganglia circuits: neural substrates of parallel processing, Trends Neurosci., 13, 266, 10.1016/0166-2236(90)90107-L Baunez, 2001, Effects of STN lesions on simple vs choice reaction time tasks in the rat: preserved motor readiness, but impaired response selection, Eur. J. Neurosci., 13, 1609, 10.1046/j.0953-816x.2001.01521.x Bevan, 2002, Move to the rhythm: oscillations in the subthalamic nucleus-external globus pallidus network, Trends Neurosci., 25, 525, 10.1016/S0166-2236(02)02235-X Bogacz, 2011, Integration of reinforcement learning and optimal decision-making theories of the Basal Ganglia, Neural Comput., 23, 817, 10.1162/NECO_a_00103 Bourdaud, 2008, Characterizing the EEG correlates of exploratory behavior, IEEE Trans. Neural Syst. Rehabil. Eng., 16, 549, 10.1109/TNSRE.2008.926712 Brown, 1996, Cognitive-motor function in Parkinson's disease, Eur. J. Neurol., 36, 24, 10.1159/000118880 Brunel, 2000, Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons, J. Comput. Neurosci., 8, 183, 10.1023/A:1008925309027 Chakravarthy, 2011, Do Basal Ganglia amplify willed action by stochastic resonance? Chakravarthy, 2010, What do the basal ganglia do? A modeling perspective, Biol. Cybern., 103, 237, 10.1007/s00422-010-0401-y Critchley, 1981, Speech disorders of Parkinsonism: a review, J. Neurol. Neurosurg. Psychiatry, 44, 751, 10.1136/jnnp.44.9.751 Cutsuridis, 2006, A neural network model of Parkinson's disease bradykinesia, Neural Netw., 19, 354, 10.1016/j.neunet.2005.08.016 Damasio, 1980, Structure and function of the supplementary motor area, Neurology (NY), 30, 359 Daw, 2006, Cortical substrates for exploratory decisions in humans, Nature, 441, 876, 10.1038/nature04766 Frank, 2005, Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and non-medicated Parkinsonism, J. Cogn. Neurosci., 17, 51, 10.1162/0898929052880093 Gammaitoni, 1998, Stochastic resonance, Rev. Mod. Phys., 70, 223, 10.1103/RevModPhys.70.223 Gangadhar, 2008, Understanding Parkinsonian Handwriting using a computational model of basal ganglia, Neural Comput., 20, 2491, 10.1162/neco.2008.03-07-498 Gerfen, 1992, The neostriatal mosaic: multiple levels of compartmental organization in the Basal Ganglia, Annu. Rev. Neurosci., 15, 285, 10.1146/annurev.ne.15.030192.001441 Gerfen, 2000, Molecular effects of dopamine on striatal projection pathways, Trends Neurosci., 23, S64, 10.1016/S1471-1931(00)00019-7 Giladi, 1992, Motor blocks in Parkinson's disease, Neurology, 42, 333, 10.1212/WNL.42.2.333 Gillies, 2002, Subthalamic-pallidal interactions are critical indetermining normal and abnormal functioning of the basal ganglia, Proc. Biol. Sci., 269, 545, 10.1098/rspb.2001.1817 Grillner, 1997, Selection and initiation of motor behaviour Gruber, 2003, Modulation of striatal single units by expected reward: a spiny neuron model displaying dopamine-induced bistability, J. Neurophysiol., 90, 1095, 10.1152/jn.00618.2002 Hauptmann, 2007, Therapeutic rewiring by means of desynchronizing brain stimulation, Biosystems, 89, 173, 10.1016/j.biosystems.2006.04.015 Houk, 1995 Hurtado, 1999, Dynamics of tremor-related oscillations in the human globus pallidus: a single case study, Proc. Natl. Acad. Sci. U.S.A., 96, 1674, 10.1073/pnas.96.4.1674 Izhikevich, 2007 James, 1890 Joel, 2002, Actor-critic models of the basal ganglia: new anatomical and computational perspectives, Neural Netw., 15, 535, 10.1016/S0893-6080(02)00047-3 Joseph, 2010, ACE (actor–critic–explorer) paradigm for reinforcement learning in Basal Ganglia: highlighting the role of sub-thalamic and pallidal nuclei, Neurocomputing, 74, 205, 10.1016/j.neucom.2010.03.001 Kalva, 2012, On the neural substrates for exploratory dynamics in basal ganglia: a model, Neural Netw., 32, 65, 10.1016/j.neunet.2012.02.031 Kauffman, 1993 Kitzbichler, 2009, Broadband criticality of human brain network synchronization, PLoS Comput. Biol., 5, e1000314, 10.1371/journal.pcbi.1000314 Krishnan, 2011, Modeling the role of basal ganglia in Saccade generation: is the indirect pathway the explorer?, Neural Netw., 24, 801, 10.1016/j.neunet.2011.06.002 Langton, 1990, Computation at the edge of chaos, Phys. D, 42, 12, 10.1016/0167-2789(90)90064-V Magdoom, 2011, Modeling basal ganglia for understanding Parkinsonian reaching movements, Neural Comput., 23, 477, 10.1162/NECO_a_00073 Magill, 2001, Dopamine regulates the impact of the cerebral cortex on the subthalamic nucleus-globus pallidus, network, Neuroscience, 106, 313, 10.1016/S0306-4522(01)00281-0 Maia, 2009, Reinforcement learning, conditioning, and the brain: successes and challenges, Cogn. Affect. Behav. Neurosci., 9, 343, 10.3758/CABN.9.4.343 May, 1976, Simple mathematical models with very complicated dynamics, Nature, 261, 459, 10.1038/261459a0 Maya, 2010, An oscillatory neural network model for birdsong learning and generation Montague, 1996, A framework for mesencephalic dopamine systems based on predictive Hebbian learning, J. Neurosci., 16, 1936, 10.1523/JNEUROSCI.16-05-01936.1996 Norman, 1983, Attention to action: willed and automatic control of behavior O'Doherty, 2004, Dissociable roles of ventral and dorsal striatum in instrumental conditioning, Science, 304, 452, 10.1126/science.1094285 Plenz, 1999, A basal ganglia pacemaker formed by the subthalamic nucleus and external globus pallidus, Nature, 400, 677, 10.1038/23281 Schultz, 1998, Predictive reward signal of dopamine neurons, J. Neurophysiol., 80, 1, 10.1152/jn.1998.80.1.1 Sridharan, 2006, The role of the basal ganglia in exploration in a neural model based on reinforcement learning, Int. J. Neural Syst., 16, 111, 10.1142/S0129065706000548 Standage, 2005, Modelling divided visual attention with a winner-take-all network, Neural Netw., 18, 620, 10.1016/j.neunet.2005.06.015 Sukumar, 2010, A computational neuromotor model of the role of basal ganglia and hippocampus in spatial navigation, 10.1007/978-3-642-15822-3_28 Sutton, 1998 Terman, 2002, Activity patterns in a model for the subthalamopallidal network of the basal ganglia, J. Neurosci., 22, 2963, 10.1523/JNEUROSCI.22-07-02963.2002 van Gemmert, 2003, Parkinson's disease patients undershoot target size in handwriting and similar tasks, J. Neurol. Neurosurg. Psychiatry, 74, 1502, 10.1136/jnnp.74.11.1502