Multiple Representations of Belief States and Action Values in Corticobasal Ganglia Loops

Annals of the New York Academy of Sciences - Tập 1104 Số 1 - Trang 213-228 - 2007
Kazuyuki Samejima1, Kenji Doya2
1Tamagawa University Brain Science Institute, Machida, Tokyo, Japan#TAB#
2[Okinawa Institute of Science and Technology, Uruma, Okinawa, Japan]

Tóm tắt

Abstract:  Reward‐related neural activities have been found in a variety of cortical and subcortical areas by neurophysiological and neuroimaging experiments. Here we present a unified view on how three subloops of the corticobasal ganglia network are involved in reward prediction and action selection using different types of information. The motor/premotor‐posterior striatum loop is specialized for action‐based value representation and movement selection. The orbitofrontal–ventral striatum loop is specialized for object‐based value representation and target selection. The lateral prefrontal–anterior striatum loop is specialized for context‐based value representation and context estimation. Furthermore, the medial prefrontal cortex (MPFC) coordinates these multiple value representations and actions at different levels of hierarchy by monitoring the error in predictions.

Từ khóa


Tài liệu tham khảo

Sutton R.S., 1998, Reinforcement Learning

10.1016/j.conb.2006.03.006

10.1126/science.275.5306.1593

10.1126/science.1094765

10.1126/science.1115270

10.1038/35092560

10.1016/S0893-6080(02)00045-X

10.1016/S0959-4388(00)00153-7

10.1162/089976602753712972

10.1038/nn1560

Doya K., 2007, Bayesian Brain: Probablistic Approaches to Neural Coding (Computational Neuroscience)

10.1016/j.neuron.2006.03.045

10.1038/283

10.1126/science.1067653

10.1111/j.1460-9568.2006.04702.x

10.1016/S0893-6080(99)00046-5

10.1038/1625

10.1152/jn.1998.80.2.964

10.1038/nn1662

10.1152/jn.2001.85.6.2477

10.1152/jn.01014.2002

10.1523/JNEUROSCI.3745-06.2007

10.1038/19525

10.1093/cercor/10.3.263

10.1038/nature04676

10.1523/JNEUROSCI.22-06-02391.2002

10.1016/j.neuron.2006.08.031

10.1038/nn1209

10.1152/jn.01149.2004

10.1093/cercor/bhj042

10.1038/22268

10.1016/j.neuron.2004.09.009

Samejima K., 2004, Advances in Neural Information Processing Systems, 1335

10.1901/jeab.1961.4-267

10.1093/cercor/10.3.272

10.1016/j.neuron.2006.06.027

10.1016/j.neuron.2005.05.020

10.1126/science.1077349

10.1016/S0896-6273(03)00869-9

10.1523/JNEUROSCI.23-30-09913.2003

10.1126/science.1094285

10.1038/nature05051

10.1038/nn1279

10.1016/j.neunet.2006.05.039

10.1523/JNEUROSCI.4853-05.2006

10.1523/JNEUROSCI.3688-06.2006

10.1016/j.neuron.2006.05.006

10.1038/nature03287

10.1523/JNEUROSCI.21-08-02793.2001

10.1016/S1053-8119(02)00057-5

10.1038/nn1238

10.1126/science.282.5392.1335

10.1038/nn1724

10.1126/science.1084204

10.1523/JNEUROSCI.1010-06.2006

10.1038/nrn1884

10.1523/JNEUROSCI.20-06-02369.2000

10.1016/B978-012547626-3/50022-3

Thông tin
Thông tin xuất bản

Annals of the New York Academy of Sciences

Tập 1104 Số 1

213-228

Thông tin tác giả