Getting Formal with Dopamine and Reward

Abercrombie, 1989, Differential effect of stress on in vivo dopamine release in striatum, nucleus accumbens, and medial frontal cortex, J. Neurochem., 52, 1655, 10.1111/j.1471-4159.1989.tb09224.x Ahlenius, 1974, Effects of low and high doses of L-dopa on the tetrabenazine or α-methyltyrosine-induced suppression of behaviour in a successive discrimination task, Psychopharmacologia, 39, 199, 10.1007/BF00421027 Amador, 2000, Reward-predicting and reward-detecting neuronal activity in the primarte supplementary eye field, J. Neurophysiol., 84, 2166, 10.1152/jn.2000.84.4.2166 Andén, 1966, A quantitative study on the nigro-neostriatal dopamine neurons. Acta physiol, Scand., 67, 306 Apicella, 1992, Neuronal activity in monkey striatum related to the expectation of predictable environmental events, J. Neurophysiol., 68, 945, 10.1152/jn.1992.68.3.945 Apicella, 1997, Responses of tonically discharging neurons in the monkey striatum to primary rewards delivered during different behavioral states, Exp. Brain Res., 116, 456, 10.1007/PL00005773 Aston-Jones, 1981, Norepinephrine-containing locus coeruleus neurons in behaving rats exhibit pronounced responses to nonnoxious environmental stimuli, J. Neurosci., 1, 887, 10.1523/JNEUROSCI.01-08-00887.1981 Aston-Jones, 1994, Locus coeruleus neurons in monkey are selectively activated by attended cues in a vigilance task, J. Neurosci., 14, 4467, 10.1523/JNEUROSCI.14-07-04467.1994 Aston-Jones, 1997, Conditioned responses of monkey locus coeruleus neurons anticipate acquisition of discriminative behavior in a vigilance task, Neuroscience, 80, 697, 10.1016/S0306-4522(97)00060-2 Attwell, 2002, Cerebellar function in consolidation of a motor memory, Neuron, 34, 1011, 10.1016/S0896-6273(02)00719-5 Bao, 2001, Cortical remodelling induced by activity of ventral tegmental dopamine neurons, Nature, 412, 79, 10.1038/35083586 Barto, 1995, Adaptive critics and the basal ganglia Barto, 1983, Neuronlike adaptive elements that can solve difficult learning problems, IEEE Trans. Syst. Man and Cybern., SMC-13, 834, 10.1109/TSMC.1983.6313077 Berger, 1988, Regional and laminar distribution of the dopamine and serotonin innervation in the macaque cerebral cortex, J. Comp. Neurol., 273, 99, 10.1002/cne.902730109 Berns, 1997, Brain regions responsive to novelty in the absence of awareness, Science, 276, 1272, 10.1126/science.276.5316.1272 Blond, 2002, Long-term potentiation in rat prefrontal slices facilitated by phased application of dopamine, Eur. J. Pharmacol., 438, 115, 10.1016/S0014-2999(02)01291-8 Bowman, 1996, Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards, J. Neurophysiol., 75, 1061, 10.1152/jn.1996.75.3.1061 Brembs, 2002, Operant learning in aplysia, Science, 296, 1706, 10.1126/science.1069434 Brown, 1983, The electrophysiology of dopamine (D2) receptors, Neuroscience, 10, 349, 10.1016/0306-4522(83)90138-0 Brozoski, 1979, Cognitive deficit caused by regional depletion of dopamine in prefrontal cortex of rhesus monkey, Science, 205, 929, 10.1126/science.112679 Burns, 1983, A primate model of parkinsonism, selective destruction of dopaminergic neurons in the pars compacta of the substantia nigra by N-methyl-4-phenyl-1,2,3,6-tetrahydropyridine, Proc. Natl. Acad. Sci. USA, 80, 4546, 10.1073/pnas.80.14.4546 Calabresi, 1992, Long-term synaptic depression in the striatum, J. Neurosci., 12, 4224, 10.1523/JNEUROSCI.12-11-04224.1992 Calabresi, 1997, Abnormal synaptic plasticity in the striatum of mice lacking dopamine D2 receptors, J. Neurosci., 17, 4536, 10.1523/JNEUROSCI.17-12-04536.1997 Canavan, 1989, The performance on learning tasks of patients in the early stages of Parkinson's disease, Neuropsychologia, 27, 141, 10.1016/0028-3932(89)90167-X Carelli, 1993, Firing patterns of nucleus accumbens neurons during cocaine self-administration, Brain Res., 626, 14, 10.1016/0006-8993(93)90557-4 Carr, 1996, Hippocampal afferents to the rat prefrontal cortex, J. Comp. Neurol., 369, 1, 10.1002/(SICI)1096-9861(19960520)369:1<1::AID-CNE1>3.0.CO;2-7 Cepeda, 1993, Neuromodulatory actions of dopamine in the neostriatum are dependent upon the excitatory amino acid receptor subtypes activated, Proc. Natl. Acad. Sci. USA, 90, 9576, 10.1073/pnas.90.20.9576 Chang, 1994, Electrophysiological and pharmacological evidence for the role of the nucleus accumbens in cocaine self-administration in freely moving rats, J. Neurosci., 14, 1224, 10.1523/JNEUROSCI.14-03-01224.1994 Chergui, 1994, Nonlinear relationship between impulse flow, dopamine release and dopamine elimination in the rat brain in vivo, Neuroscience, 62, 641, 10.1016/0306-4522(94)90465-0 Chesselet, 1984, Presynaptic regulation of neurotransmitter release in the brain, Neuroscience, 12, 347, 10.1016/0306-4522(84)90058-7 Church, 1987, Extracellular dopamine in rat striatum following uptake inhibition by cocaine, nomifensine and benztropine, Eur. J. Pharmacol., 139, 345, 10.1016/0014-2999(87)90592-9 Contreras-Vidal, 1999, A predictive reinforcement model of dopamine neurons for learning approach behavior, J. Comput. Neurosci., 6, 191, 10.1023/A:1008862904946 Critchley, 1996, Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex, J. Neurophysiol., 75, 1673, 10.1152/jn.1996.75.4.1673 Dahl, 1989, Norepinepherine induces pathway-specific long-lasting potentiation and depression in the hippocampal dentate gyrus, Proc. Natl. Acad. Sci., 86, 4776, 10.1073/pnas.86.12.4776 DeLong, 1983, Relations between movement and single cell discharge in the substantia nigra of the behaving monkey, J. Neurosci., 3, 1599, 10.1523/JNEUROSCI.03-08-01599.1983 Dickinson, 1980 Dickinson, 2001, Causal learning, Q. J. Exp. Psychol., 54B, 3, 10.1080/02724990042000010 Dickinson, 1994, Motivational control of goal-directed action, Anim. Learn. Behav., 22, 1, 10.3758/BF03199951 Ding, 2002, Dopamine modulates excitability of spiny neurons in the avian basal ganglia, J. Neurosci., 22, 5210, 10.1523/JNEUROSCI.22-12-05210.2002 Doherty, 1992, High-speed chronoamperometric measurements of mesolimbic and nigrostriatal dopamine release associated with repeated daily stress, Brain Res., 586, 295, 10.1016/0006-8993(92)91639-V Doucet, 1986, Quantification of the dopamine innervation in adult rat neostriatum, Neuroscience, 19, 427, 10.1016/0306-4522(86)90272-1 Dugast, 1994, Continuous in vivo monitoring of evoked dopamine release in the rat nucleus accumbens by amperometry, Neuroscience, 62, 647, 10.1016/0306-4522(94)90466-9 Eccles, 1967 Elliott, 1997, Effects of methylphenidate on spatial working memory and planning in healthy young adults, Psychopharmacology (Berl.), 131, 196, 10.1007/s002130050284 Fagg, A.H. (1993). Reinforcement learning for robotic reaching and grasping. In New Perspectives in the Control of the Reach to Grasp Movement, K.M.B. Bennet and U. Castiello, eds. (North Holland), pp. 281–308. Falkenstein, 1991, Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasks, Electroencephalgr. Clin. Neurophysiol., 78, 447, 10.1016/0013-4694(91)90062-9 Fibiger, 1986, Reward, motivation, cognition, psychobiology of mesotelencephalic dopamine systems Filion, 1988, Abnormal influences of passive limb movement on the activity of globus pallidus neurons in parkinsonian monkey, Brain Res., 444, 165, 10.1016/0006-8993(88)90924-9 Flaherty, 1996 Fletcher, 2001, Responses of human frontal cortex to surprising events are predicted by formal associative learning theory, Nat. Neurosci., 4, 1043, 10.1038/nn733 Foote, 1980, Impulse activity of locus coeruleus neurons in awake rats and monkeys is a function of sensory stimulation and arousal, Proc. Natl. Acad. Sci. USA, 77, 3033, 10.1073/pnas.77.5.3033 Freedman, 1977, Interaction of norepinephrine with cerebellar activity evoked by mossy and climbing fibers, Exp. Neurol., 55, 269, 10.1016/0014-4886(77)90175-3 Freund, 1984, Tyrosine hydroxylase-immunoreactive boutons in synaptic contact with identified striatonigral neurons, with particular reference to dendritic spines, Neuroscience, 13, 1189, 10.1016/0306-4522(84)90294-X Friston, 1994, Value-dependent selection in the brain, Neuroscience, 59, 229, 10.1016/0306-4522(94)90592-4 Gemba, 1986, “Error” potentials in limbic cortex (anterior cingulate area 24) of monkeys during motor learning, Neurosci. Lett., 70, 223, 10.1016/0304-3940(86)90467-2 German, 1988, 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP)-induced parkinsonian syndrome in macaca fascicularis, Neuroscience, 24, 161, 10.1016/0306-4522(88)90320-X Gilbert, 1977, Purkinje cell activity during motor learning, Brain Res., 128, 309, 10.1016/0006-8993(77)90997-0 Giros, 1996, Hyperlocomotion and indifference to cocaine and amphetamine in mice lacking the dopamine transporter, Nature, 379, 606, 10.1038/379606a0 Goldman-Rakic, 1989, Dopamine synaptic complex with pyramidal neurons in primate cerebral cortex, Proc. Natl. Acad. Sci. USA, 86, 9015, 10.1073/pnas.86.22.9015 Gonon, 1988, Nonlinear relationship between impulse flow and dopamine released by rat midbrain dopaminergic neurons as studied by in vivo electrochemistry, Neuroscience, 24, 19, 10.1016/0306-4522(88)90307-7 Gonon, 1997, Prolonged and extrasynaptic excitatory action of dopamine mediated by D1 receptors in the rat striatum in vivo, J. Neurosci., 17, 5972, 10.1523/JNEUROSCI.17-15-05972.1997 Grenhoff, 1986, Nicotinic effects on the firing pattern of midbrain dopamine neurons, Acta Physiol. Scand., 128, 351, 10.1111/j.1748-1716.1986.tb07988.x Groves, 1995, Elements of the intrinsic organization and information processing in the neostriatum Gullapalli, V., Barto, A.G., and Grupen, R.A. (1994). Learning admittance mapping for force-guided assembly. In Proceedings of the 1994 International Conference on Robotics and Automation (Los Alamitos, CA: Computer Society Press), pp. 2633–2638. Gurden, 1999, Integrity of the mesocortical DA system is necessary for complete expression of in vivo hippocampal-prefrontal cortex long-term potentiation, Neuroscience, 94, 1019, 10.1016/S0306-4522(99)00395-4 Gurden, 2000, Essential role of D1 but not D2 receptors in the NMDA receptor-dependent long-term potentiation at hippocampal-prefrontal cortex synapses in vivo, J. Neurosci., 20, RC106, 10.1523/JNEUROSCI.20-22-j0003.2000 Harlow, 1949, The formation of learning sets, Psychol. Rev., 56, 51, 10.1037/h0062474 Hassani, 2001, Influence of expectation of different rewards on behavior-related neuronal activity in the striatum, J. Neurophysiol., 85, 2477, 10.1152/jn.2001.85.6.2477 Hernandez-Lopez, 1997, D1 receptor activation enhances evoked discharge in neostriatal medium spiny neurons by modulating an L-type Ca2+ conductance, J. Neurosci., 17, 3334, 10.1523/JNEUROSCI.17-09-03334.1997 Herrera-Marschitz, 1996, On the origin of extracellular glutamate levels monitored in the basal ganglia of the rat by in vivo microdialysis, J. Neurochem., 66, 1726, 10.1046/j.1471-4159.1996.66041726.x Hikosaka, 1989, Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward, J. Neurophysiol., 61, 814, 10.1152/jn.1989.61.4.814 Hirsch, 1990, Use-dependent changes in synaptic efficacy in rat prefrontal neurons in vitro, J. Physiol., 427, 31, 10.1113/jphysiol.1990.sp018159 Hollerman, 1998, Dopamine neurons report an error in the temporal prediction of reward during learning, Nat. Neurosci., 1, 304, 10.1038/1124 Hollerman, 1998, Influence of reward expectation on behavior-related neuronal activity in primate striatum, J. Neurophysiol., 80, 947, 10.1152/jn.1998.80.2.947 Horvitz, 2000, Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events, Neuroscience, 96, 651, 10.1016/S0306-4522(00)00019-1 Houk, 1995, A model of how the basal ganglia generate and use neural signals that predict reinforcement Houk, 1996, Models of the cerebellum and motor learning, Behav. Brain Sci., 19, 368, 10.1017/S0140525X00081474 Ito, 1989, Long-term depression, Annu. Rev. Neurosci., 12, 85, 10.1146/annurev.ne.12.030189.000505 Jones, 2000, Amphetamine blocks long-term synaptic depression in the ventral tegmental area, J. Neurosci., 20, 5575, 10.1523/JNEUROSCI.20-15-05575.2000 Jörntell, 2002, Reciprocal bidirectional plasticity of parallel fiber receptive fields in cerebellar Purkinje cells and their afferent interneurons, Neuron, 34, 797, 10.1016/S0896-6273(02)00713-4 Kamin, 1969, Selective association and conditioning Katsuki, 1997, Noradrenergic regulation of synaptic plasticity in the hippocampal CA1 region, J. Neurophysiol., 77, 3013, 10.1152/jn.1997.77.6.3013 Kawagoe, 1998, Expectation of reward modulates cognitive signals in the basal ganglia, Nat. Neurosci., 1, 411, 10.1038/1625 Kawato, 1992, The cerebellum and VOR/OKR learning models, Trends Neurosci., 15, 445, 10.1016/0166-2236(92)90008-V Kerr, 2001, Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro, J. Neurophysiol., 85, 117, 10.1152/jn.2001.85.1.117 Kim, 1998, Inhibitory cerebello-olivary projections and blocking effect in classical conditioning, Science, 279, 570, 10.1126/science.279.5350.570 Kitazawa, 1998, Cerebellar complex spikes encode both destinations and errors in arm movement, Nature, 392, 494, 10.1038/33141 Knowlton, 1996, A neostriatal habit learning system in humans, Science, 273, 1399, 10.1126/science.273.5280.1399 LeDoux, 1998 Leon, 1999, Effect of expected reward magnitude on the responses of neurons in the dorsolateral prefrontal cortex of the macaque, Neuron, 24, 415, 10.1016/S0896-6273(00)80854-5 Lichtensteiger, 1976, A quantitative correlation between single unit activity and fluorescence intensity of dopamine neurones in zona compacta of substantia nigra, as demonstrated under the influence of nicotine and physostigmine, Brain Res., 117, 85, 10.1016/0006-8993(76)90558-8 Linden, 1990, Slow cortical potentials in Parkinsonian patients during the course of an associative learning task, J. Psychophysiol., 4, 145 Linden, 1993, Cellular mechanisms of long-term depression in the cerebellum, Curr. Opin. Neurobiol., 3, 401, 10.1016/0959-4388(93)90133-J Ljungberg, 1991, Responses of monkey midbrain dopamine neurons during delayed alternation performance, Brain Res., 586, 337, 10.1016/0006-8993(91)90816-E Ljungberg, 1992, Responses of monkey dopamine neurons during learning of behavioral reactions, J. Neurophysiol., 67, 145, 10.1152/jn.1992.67.1.145 Llinas, 1993, On the cerebellum and motor learning, Curr. Opin. Neurobiol., 3, 958, 10.1016/0959-4388(93)90168-X Lovibond, 1983, Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus, J. Exp. Psychol. Anim. Behav. Process., 9, 225, 10.1037/0097-7403.9.3.225 Louilot, 1986, Differential reactivity of dopaminergic neurons in the nucleus accumbens in response to different behavioral situations. An in vivo voltammetric study in free moving rats, Brain Res., 397, 395, 10.1016/0006-8993(86)90646-3 Lynd-Balta, 1994, Primate striatonigral projections, J. Comp. Neurol., 345, 562, 10.1002/cne.903450407 Mackintosh, 1975, A theory of attention, Psychol. Rev., 82, 276, 10.1037/h0076778 Mansvelder, 2000, Long-term potentiation of excitatory inputs to brain reward areas by nicotine, Neuron, 27, 349, 10.1016/S0896-6273(00)00042-8 Mansvelder, 2002, Synaptic mechanisms underlie nicotine-induced excitability of brain areas, Neuron, 33, 905, 10.1016/S0896-6273(02)00625-6 Marr, 1969, A theory of cerebellar cortex, J. Physiol., 202, 437, 10.1113/jphysiol.1969.sp008820 Martin, 1991, Blocking observed in human eyelid conditioning, Q. J. Exp. Psychol., 43B, 233 Matsumura, 1992, Visual and oculomotor functions of monkey subthalamic nucleus, J. Neurophysiol., 67, 1615, 10.1152/jn.1992.67.6.1615 Medina, 2002, Inhibition of climbing fibers is a signal for the extinction of conditioned eyelid responses, Nature, 416, 330, 10.1038/416330a Miller, 1981, Mesencephalic dopaminergic unit activity in the behaviorally conditioned rat, Life Sci., 29, 1255, 10.1016/0024-3205(81)90231-9 Mirenowicz, 1994, Importance of unpredictability for reward responses in primate dopamine neurons, J. Neurophysiol., 72, 1024, 10.1152/jn.1994.72.2.1024 Mirenowicz, 1996, Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli, Nature, 379, 449, 10.1038/379449a0 Mitchell, 1987, The primate globus pallidus, Exp. Brain Res., 68, 491, 10.1007/BF00249793 Montague, 1995, Bee foraging in uncertain environments using predictive hebbian learning, Nature, 377, 725, 10.1038/377725a0 Montague, 1996, A framework for mesencephalic dopamine systems based on predictive Hebbian learning, J. Neurosci., 16, 1936, 10.1523/JNEUROSCI.16-05-01936.1996 Murphy, 1996, Increased dopamine turnover in the prefrontal cortex impairs spatial working memory performance in rats and monkeys, Proc. Natl. Acad. Sci. USA, 93, 1325, 10.1073/pnas.93.3.1325 Nargeot, 1999, Dopaminergic synapses mediate neuronal changes in an analogue of operant conditioning, J. Neurophysiol., 81, 1983, 10.1152/jn.1999.81.4.1983 Niki, 1979, Prefrontal and cingulate unit activity during timing behavior in the monkey, Brain Res., 171, 213, 10.1016/0006-8993(79)90328-7 Nishijo, 1988, Topographic distribution of modality-specific amygdalar neurons in alert monkey, J. Neurosci., 8, 3556, 10.1523/JNEUROSCI.08-10-03556.1988 Nishino, 1987, Neuronal activity in the ventral tegmental area (VTA) during motivated bar press feeding behavior in the monkey, Brain Res., 413, 302, 10.1016/0006-8993(87)91021-3 Nobre, 1999, Orbitofrontal cortex is activated during breaches of expectation in tasks of visual attention, Nat. Neurosci., 2, 11, 10.1038/4513 Ojakangas, 1992, Purkinje cell complex and simple spike changes during a voluntary arm movement learning task in the monkey, J. Neurophysiol., 68, 2222, 10.1152/jn.1992.68.6.2222 Otani, 1998, Dopamine facilitates long-term depression of glutamatergic transmisssion in rat prefrontal cortex, Neuroscience, 85, 669, 10.1016/S0306-4522(97)00677-5 Otmakhova, 1996, D1/D5 dopamine recetor activation increases the magnitude of early long-term potentiation at CA1 hippocampal synapses, J. Neurosci., 16, 7478, 10.1523/JNEUROSCI.16-23-07478.1996 Otmakhova, 1998, D1/D5 dopamine receptors inhibit depotentiation at CA1 synapses via cAMP-dependent mechanism, J. Neurosci., 18, 1273, 10.1523/JNEUROSCI.18-04-01270.1998 Pearce, 1980, A model for Pavlovian conditioning, Psychol. Rev., 87, 532, 10.1037/0033-295X.87.6.532 Peoples, 1998, Phasic firing time locked to cocaine self-infusion and locomotion, J. Neurosci., 18, 7588, 10.1523/JNEUROSCI.18-18-07588.1998 Percheron, 1989, The primate nigro-striato-pallido-nigral system. Not a mere loop Platt, 1999, Neural correlates of decision variables in parietal cortex, Nature, 400, 233, 10.1038/22268 Poirier, 1960, Experimental and histological study of midbrain dyskinesias, J. Neurophysiol., 23, 534, 10.1152/jn.1960.23.5.534 Rasmussen, 1986, Single unit activity of locus coeruleus neurons in the freely moving cat. I. During naturalistic behaviors and in response to simple and complex stimuli, Brain Res., 371, 324, 10.1016/0006-8993(86)90370-7 Redgrave, 1999, Is the short-latency dopamine response too short to signal reward?, Trends Neurosci., 22, 146, 10.1016/S0166-2236(98)01373-3 Rescorla, 1972, A theory of Pavlovian conditioning Reynolds, 2001, A cellular mechanism of reward-related learning, Nature, 413, 67, 10.1038/35092560 Richardson, 1986, Nucleus basalis of Meynert neuronal activity during a delayed response task in monkey, Brain Res., 399, 364, 10.1016/0006-8993(86)91529-5 Richardson, 1990, Context-dependent responses of primate nucleus basalis neurons in a go/no-go task, J. Neurosci., 10, 2528, 10.1523/JNEUROSCI.10-08-02528.1990 Richfield, 1989, Anatomical and affinity state comparisons between dopamine D1 and D2 receptors in the rat central nervous system, Neuroscience, 30, 767, 10.1016/0306-4522(89)90168-1 Robbins, 1996, Neurobehavioural mechanisms of reward and motivation, Curr. Opin. Neurobiol., 6, 228, 10.1016/S0959-4388(96)80077-8 Robinson, 1993, The neural basis for drug craving, Brain Res. Brain Res. Rev., 18, 247, 10.1016/0165-0173(93)90013-P Rolls, 1999, Responses to the sensory properties of fat of neurons in the primate orbitofrontal cortex, J. Neurosci., 19, 1532, 10.1523/JNEUROSCI.19-04-01532.1999 Romo, 1990, Dopamine neurons of the monkey midbrain, J. Neurophysiol., 63, 592, 10.1152/jn.1990.63.3.592 Rosenkilde, 1981, Single cell activity in ventral prefrontal cortex of behaving monkeys, Brain Res., 209, 375, 10.1016/0006-8993(81)90160-8 Rosenkranz, 2002, Dopamine-mediated modulation of odour-evoked amygdala potentials during pavlovian conditioning, Nature, 417, 282, 10.1038/417282a Sakurai, 1987, Synaptic modofication of parallel fibre-Purkinje cell transmission in in vitro guinea-pig cerebellar slices, J. Physiol., 394, 463, 10.1113/jphysiol.1987.sp016881 Sara, 1991, Plasticity of sensory responses of locus coeruleus neurons in the behaving rat, Prog. Brain Res., 88, 571, 10.1016/S0079-6123(08)63835-2 Sardo, 2000, Influence of the predicted time of stimuli eliciting movements on responses to tonically active neurons in the monkey striatum, Eur. J. Neurosci., 12, 1801, 10.1046/j.1460-9568.2000.00068.x Sawaguchi, 1991, D1 dopamine receptors in prefrontal cortex, Science, 251, 947, 10.1126/science.1825731 Schachter, 1962, Cognitive, social and physiological determinants of emotional state, Psychol. Rev., 69, 379, 10.1037/h0046234 Schultz, 1986, Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey, J. Neurophysiol., 56, 1439, 10.1152/jn.1986.56.5.1439 Schultz, 1992, Activity of dopamine neurons in the behaving primate, Semin. Neurosci., 4, 129, 10.1016/1044-5765(92)90011-P Schultz, 1998, Predictive reward signal of dopamine neurons, J. Neurophysiol., 80, 1, 10.1152/jn.1998.80.1.1 Schultz, 1987, Responses of nigrostriatal dopamine neurons to high intensity somatosensory stimulation in the anesthetized monkey, J. Neurophysiol., 57, 201, 10.1152/jn.1987.57.1.201 Schultz, 1990, Dopamine neurons of the monkey midbrain, J. Neurophysiol., 63, 607, 10.1152/jn.1990.63.3.607 Schultz, 1983, The encoding of motor acts by the substantia nigra, Exp. Brain Res. Suppl., 7, 171, 10.1007/978-3-642-68915-4_16 Schultz, 1983, The activity of pars compacta neurons of the monkey substantia nigra in relation to motor activation, Exp. Brain Res., 51, 377, 10.1007/BF00237874 Schultz, 1993, Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task, J. Neurosci., 13, 900, 10.1523/JNEUROSCI.13-03-00900.1993 Schultz, 1997, A neural substrate of prediction and reward, Science, 275, 1593, 10.1126/science.275.5306.1593 Sears, 1991, Dorsal accessory inferior olive activity diminishes during acquisition of the rabbit classically conditioned eyelid response, Brain Res., 545, 114, 10.1016/0006-8993(91)91276-7 Sessler, 1995, Noradrenergic enhancement of GABA-induced input resistance changes in layer V regular spiking pyramidal neurons of rat somatosensory cortex, Brain Res., 675, 171, 10.1016/0006-8993(95)00060-4 Shima, 1998, Role for cingulate motor area cells in voluntary movement selection based on reward, Science, 282, 1335, 10.1126/science.282.5392.1335 Simon, 1980, Dopaminergic A10 neurons are involved in cognitive functions, Nature, 286, 150, 10.1038/286150a0 Smith, 1990, The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurones, Trends Neurosci., 13, 259, 10.1016/0166-2236(90)90106-K Smith, 1994, Synaptic relationships between dopaminergic afferents and cortical or thalamic input in the sensorimotor territory of the striatum in monkey, J. Comp. Neurol., 344, 1, 10.1002/cne.903440102 Sprengelmeyer, 1995, Associative learning in degenerative neostriatal disorders, Mov. Disord., 10, 85, 10.1002/mds.870100110 Stuphorn, 2000, Performance monitoring by the supplementary eye field, Nature, 408, 857, 10.1038/35048576 Suaud-Chagny, 1995, Uptake of dopamine released by impulse flow in the rat mesolimbic and striatal system in vivo, J. Neurochem., 65, 2603, 10.1046/j.1471-4159.1995.65062603.x Suri, 1998, Learning of sequential movements by neural network model with dopamine-like reinforcement signal, Exp. Brain Res., 121, 350, 10.1007/s002210050467 Suri, 1999, A neural network with dopamine-like reinforcement signal that learns a spatial delayed response task, Neuroscience, 91, 871, 10.1016/S0306-4522(98)00697-6 Sutton, 1981, Toward a modern theory of adaptive networks, Psychol. Rev., 88, 135, 10.1037/0033-295X.88.2.135 Sutton, 1990, Time-derivative models of Pavlovian reinforcement Talwar, 2002, Rat navigation guided by remote control, Nature, 417, 37, 10.1038/417037a Tang, 2001, Dopamine-dependent synaptic plasticity in striatum during in vivo development, Proc. Natl. Acad. Sci. USA, 98, 1255, 10.1073/pnas.98.3.1255 Tesauro, 1994, TD-Gammon, a self-teaching backgammon program, achieves master-level play, Neural Comput., 6, 215, 10.1162/neco.1994.6.2.215 Thompson, 1991, Brain substrates of basic associative learning and memory Thorpe, 1983, The orbitofrontal cortex, Exp. Brain Res., 49, 93, 10.1007/BF00235545 Toan, 1985, Responses of rat pallidum cells to cortex stimulation and effects of altered dopaminergic activity, Neuroscience, 15, 683, 10.1016/0306-4522(85)90070-3 Tong, 1995, Chronic administration of (+) amphetamine alters the reactivity of midbrain dopaminergic neurons to prefrontal cortex stimulation in the rat, Brain Res., 674, 63, 10.1016/0006-8993(94)01439-O Tremblay, 1999, Relative reward preference in primate orbitofrontal cortex, Nature, 398, 704, 10.1038/19525 Tremblay, 2000, Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex, J. Neurophysiol., 83, 1877, 10.1152/jn.2000.83.4.1877 Tremblay, 1998, Modifications of reward expectation-related neuronal activity during learning in primate striatum, J. Neurophysiol., 80, 964, 10.1152/jn.1998.80.2.964 Umeno, 1997, Spatial processing in the monkey frontal eye field. I. Predictive visual responses, J. Neurophysiol., 78, 1373, 10.1152/jn.1997.78.3.1373 Ungless, 2001, Single cocaine exposure in vivo induces long-term potentiation in dopamine neurons, Nature, 411, 583, 10.1038/35079077 Valins, 1966, Cognitive effects of false heart-rate feedback, J. Pers. Soc. Psychol., 4, 400, 10.1037/h0023791 Vankov, 1995, Response to novelty and its rapid habituation in locus coeruleus neurons of the freely exploring rat, Eur. J. Neurosci., 7, 1180, 10.1111/j.1460-9568.1995.tb01108.x Vriezen, 1990, Memory for temporal order and conditional associative-learning in patients with Parkinson's disease, Neuropsychologia, 28, 1283, 10.1016/0028-3932(90)90044-O Yang, 1996, Dopamine D1 receptor actions in layer V–VI rat prefrontal cortex neurons in vitro, J. Neurosci., 16, 1922, 10.1523/JNEUROSCI.16-05-01922.1996 Yim, 1982, Response of nucleus accumbens neurons to amygdala stimulation and its modification by dopamine, Brain Res., 239, 401, 10.1016/0006-8993(82)90518-2 Young, 1992, Increased dopamine release in vivo in nucleus accumbens and caudate nucleus of the rat during drinking, Neuroscience, 48, 871, 10.1016/0306-4522(92)90275-7 Waelti, 2001, Dopamine responses comply with basic assumptions of formal learning theory, Nature, 412, 43, 10.1038/35083500 Watanabe, 1989, The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units, Neurosci. Lett., 101, 113, 10.1016/0304-3940(89)90450-3 Watanabe, 1996, Reward expectancy in primate prefrontal neurons, Nature, 382, 629, 10.1038/382629a0 Waterhouse, 1980, Interaction of norepinephrine with cerebrocortical activity evoked by stimulation of somatosensory afferent pathways in the rat, Exp. Neurol., 67, 11, 10.1016/0014-4886(80)90159-4 West, 1997, Low-dose amphetamine elevates movement-related firing of rat striatal neurons, Brain Res., 745, 331, 10.1016/S0006-8993(96)01215-2 Wickens, 1996, Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro, Neuroscience, 70, 1, 10.1016/0306-4522(95)00436-M Williams, 1993, Characterization of the dopaminergic innervation of the primate frontal cortex using a dopamine-specific antibody, Cereb. Cortex, 3, 199, 10.1093/cercor/3.3.199 Wilson, 1990, Neuronal responses related to the novelty and familiarity of visual stimuli in the substantia innominata, Exp. Brain Res., 80, 104, 10.1007/BF00228852 Wilson, 1990, Neuronal responses related to reinforcement in the primate basal forebrain, Brain Res., 509, 213, 10.1016/0006-8993(90)90546-N Wilson, 1990, Learning and memory is reflected in the responses of reinforcement-related neurons in the primate basal forebrain, J. Neurosci., 10, 1254, 10.1523/JNEUROSCI.10-04-01254.1990 Wise, 1996, Addictive drugs and brain stimulation reward, Annu. Rev. Neurosci., 19, 319, 10.1146/annurev.ne.19.030196.001535 Wise, 1996, Neurobiology of addiction, Curr. Opin. Neurobiol., 6, 243, 10.1016/S0959-4388(96)80079-1 Wise, 2002, Brain reward circuitry, Neuron, 36, 229, 10.1016/S0896-6273(02)00965-0 Wise, 1992, Localization of drug reward mechanisms by intracranial injections, Synapse, 10, 247, 10.1002/syn.890100307