Serotonin and the Evaluation of Future Rewards

Annals of the New York Academy of Sciences - Tập 1104 Số 1 - Trang 289-300 - 2007
Nicolas Schweighofer1, Saori Tanaka2, Kenji Doya2,3
1Department of Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, California, USA
2Computational Neuroscience Laboratories, Advanced Telecommunications Research Institute, Kyoto, Japan
3Initial Research Project, Okinawa Institute of Science and Technology, Okinawa, Japan

Tóm tắt

Abstract:  The ability to select an action by considering both delays and amount of reward outcome is critical for survival and well‐being of animals and humans. Previous animal experiments suggest a role of serotonin in action choice by modulating the evaluation of delayed rewards. It remains unclear, however, through which neural circuits, and through what receptors and intracellular mechanisms, serotonin affects the evaluation of delayed rewards. Here, we review experimental studies and computational theory of decisions under delayed rewards, and propose that serotonin controls the timescale of reward prediction by regulating neural activity in the basal ganglia.

Từ khóa


Tài liệu tham khảo

10.1093/acprof:oso/9780198524243.001.0001

Saper C.B., 2000, Principles of Neural Science, 889

10.1016/S0893-6080(02)00043-6

10.1016/S0301-0511(96)05222-2

10.1038/35072566

Soubrie P., 1986, Serotonergic neurons and behavior, J. Pharmacol., 17, 107

10.1016/S0959-4388(02)00302-1

10.2307/2967612

10.1016/0003-3472(86)90032-1

Sutton R.S., 1998, Reinforcement Learning

10.1037/h0076860

Mazur J.E., 1987, Quantitative Analysis of Behavior. Vol. V: The Effect of Delay and Intervening Events

10.1037/0097-7403.14.1.105

10.1901/jeab.1991.55-233

10.1093/beheco/7.3.341

10.1007/PL00005490

10.1007/PL00005482

10.1037/0096-3445.128.1.78

10.1037/0021-843X.110.3.482

10.1002/9780470515372.ch5

Laibson D.I., 2003, Encyclopedia of Cognitive Science

Thaler R.H., 1981, An economic theory of self‐control. J, Economy, 89, 392

10.1017/S0140525X05000117

10.1016/0165-1765(81)90067-7

10.1006/obhd.1995.1086

10.1901/jeab.1995.64-263

10.1257/jep.15.3.47

Schweighofer N., 2006, Humans can adopt optimal discounting strategy under real‐time constraints, Plos Comp. Biol., 11, 1349

10.1037/1064-1297.8.2.155

10.1037/1064-1297.5.3.256

10.1037/1064-1297.6.3.292

10.1037/1064-1297.11.1.18

10.1152/jn.1998.80.1.1

Houk J.C. J.Davis&D.Beiser Eds.1995. Models of Information Processing in the Basal Ganglia .249–270.The MIT Press. Cambridge MA .

10.1523/JNEUROSCI.16-05-01936.1996

10.1016/S0959-4388(00)00153-7

Littman M.L. T.L.Dean&L. P.Kaelbling.1995.On the complexity of solving Markov decision problems.Eleventh International Conference on Uncertainty in Artificial Intelligence.

10.1016/S0959-4388(97)80013-X

10.1016/S0079-6123(00)26030-5

10.1016/S0166-4328(98)00117-X

10.1007/PL00005481

10.1037/0097-7403.11.4.565

10.1007/BF02245530

10.1016/S1364-6613(00)01650-8

10.1007/PL00005485

10.1097/00008877-199608000-00011

10.1007/s002130000385

10.1007/s002139900368

10.1126/science.1094285

10.1038/nn1279

Shidara M., 1998, Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials, J. Neurosci., 18, 2613, 10.1523/JNEUROSCI.18-07-02613.1998

10.1152/jn.2000.83.4.1864

10.1126/science.1115270

10.1162/089892998563815

Doya K., 2000, Metalearning and neuromodulation, Math. Sci., 38, 19

10.1038/35092560

10.1016/S0893-6080(02)00045-X

10.1016/S0006-8993(98)00168-1

10.1002/hbm.20035

10.1002/(SICI)1096-9861(19971208)389:1<1::AID-CNE1>3.0.CO;2-6

10.1016/S0361-9230(00)00358-0

10.1046/j.1471-4159.1999.0731033.x

10.1016/S0165-0173(99)00040-5

10.1093/cercor/10.3.295

10.1126/science.1060818

10.1093/cercor/10.3.284

10.1037/0735-7044.113.4.718

10.1523/JNEUROSCI.23-35-11189.2003

10.1016/S0166-2236(99)01439-3

10.1016/j.bmcl.2005.07.024

10.1016/S0166-4328(01)00412-0

10.1016/S0893-6080(02)00228-9

10.1016/0893-6080(90)90056-Q

10.1016/0166-2236(93)90090-9

Daw N.D. S.Kakade&P.Dayan.2002.Opponent interactions between serotonin and dopamine.Neural Netw.15:603–616.

10.1046/j.0953-816x.2001.01616.x

Thông tin
Thông tin xuất bản

Annals of the New York Academy of Sciences

Tập 1104 Số 1

289-300

Thông tin tác giả