Modulation of feedback related activity in the rostral anterior cingulate cortex during trial and error exploration

Amiez, 2007, Selective involvement of the mid-dorsolateral prefrontal cortex in the coding of the serial order of visual stimuli in working memory, Proc. Natl. Acad. Sci., 104, 13786, 10.1073/pnas.0706220104 Amiez, 2005, Anterior cingulate error-related activity is modulated by predicted reward, Eur. J. Neurosci., 21, 3447, 10.1111/j.1460-9568.2005.04170.x Amiez, 2006, Reward encoding in the monkey anterior cingulate cortex, Cereb. Cortex, 16, 1040, 10.1093/cercor/bhj046 Amiez, 2012, Response selection versus feedback analysis in conditional visuo-motor learning, Neuroimage, 59, 3723, 10.1016/j.neuroimage.2011.10.058 Apicella, 2009, Tonically active neurons in the striatum differentiate between delivery and omission of expected reward in a probabilistic task context, Eur. J. Neurosci., 30, 515, 10.1111/j.1460-9568.2009.06872.x Apicella, 2011, The role of striatal tonically active neurons in reward prediction error signaling during instrumental task performance, J. Neurosci., 31, 1507, 10.1523/JNEUROSCI.4880-10.2011 Beckmann, 2009, Connectivity-based parcellation of human cingulate cortex and its relation to functional specialization, J. Neurosci., 29, 1175, 10.1523/JNEUROSCI.3328-08.2009 Behrens, 2007, Learning the value of information in an uncertain world, Nat. Neurosci., 10, 1214, 10.1038/nn1954 Boorman, 2009, How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action, Neuron, 62, 733, 10.1016/j.neuron.2009.05.014 Boorman, 2011, Counterfactual choice and learning in a neural network centered on human lateral frontopolar cortex, PLoS Biol., 9, e1001093, 10.1371/journal.pbio.1001093 Brovelli, 2008, Understanding the neural computations of arbitrary visuomotor learning through fMRI and associative learning theory, Cereb. Cortex, 18, 1485, 10.1093/cercor/bhm198 Bullmore, 1996, Statistical methods of estimation and inference for functional MR image analysis, Magn. Reson. Med., 35, 261, 10.1002/mrm.1910350219 Caplin, 2008, Axiomatic methods, dopamine and reward prediction error, Curr. Opin. Neurobiol., 18, 197, 10.1016/j.conb.2008.07.007 Champod, 2007, Dissociable roles of the posterior parietal and the prefrontal cortex in manipulation and monitoring processes, Proc. Natl. Acad. Sci. U. S. A., 104, 14837, 10.1073/pnas.0607101104 Cohen, 2007, Reward expectation modulates feedback-related negativity and EEG spectra, Neuroimage, 35, 968, 10.1016/j.neuroimage.2006.11.056 Cohen, 2011, Cortical electrophysiological network dynamics of feedback learning, Trends Cogn. Sci., 15, 558, 10.1016/j.tics.2011.10.004 Collins, 1994, Automatic 3D intersubject registration of MR volumetric data in standardized Talairach space, J. Comput. Assist. Tomogr., 18, 192, 10.1097/00004728-199403000-00005 Cox, 1999, Real-time 3D image registration for functional MRI, Magn. Reson. Med., 42, 1014, 10.1002/(SICI)1522-2594(199912)42:6<1014::AID-MRM4>3.0.CO;2-F Croxson, 2009, Effort-based cost–benefit valuation and the human brain, J. Neurosci., 29, 4531, 10.1523/JNEUROSCI.4515-08.2009 d'Acremont, 2009, Neural correlates of risk prediction error during reinforcement learning in humans, Neuroimage, 47, 1929, 10.1016/j.neuroimage.2009.04.096 Daw, 2006, Cortical substrates for exploratory decisions in humans, Nature, 441, 876, 10.1038/nature04766 Dum, 1991, The origin of corticospinal projections from the premotor areas in the frontal lobe, J. Neurosci., 11, 667, 10.1523/JNEUROSCI.11-03-00667.1991 Durstewitz, 2008, The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-o-methyltransferase genotypes and schizophrenia, Biol. Psychiatry, 64, 739-479, 10.1016/j.biopsych.2008.05.015 Friston, 1995, Analysis of fMRI time-series revisited, Neuroimage, 2, 45, 10.1006/nimg.1995.1007 Friston, 2005, Conjunction revisited, Neuroimage, 25, 661, 10.1016/j.neuroimage.2005.01.013 Hadland, 2003, The anterior cingulate and reward-guided selection of actions, J. Neurophysiol., 89, 1161, 10.1152/jn.00634.2002 Hajcak, 2006, The feedback-related negativity reflects the binary evaluation of good versus bad outcomes, Biol. Psychol., 71, 148, 10.1016/j.biopsycho.2005.04.001 Haruno, 2006, Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning, Neural Netw., 19, 1242, 10.1016/j.neunet.2006.06.007 Haruno, 2006, Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus–action–reward association learning, J. Neurophysiol., 95, 948, 10.1152/jn.00382.2005 Haxby, 2012, Multivariate pattern analysis of fMRI: the early beginnings, Neuroimage, 62, 852, 10.1016/j.neuroimage.2012.03.016 Hayden, 2010, Neurons in anterior cingulate cortex multiplex information about reward and action, J. Neurosci., 30, 3339, 10.1523/JNEUROSCI.4874-09.2010 Hayden, 2010, Cognitive control signals in posterior cingulate cortex, Front. Hum. Neurosci., 4, 223, 10.3389/fnhum.2010.00223 Hayden, 2011, Neuronal basis of sequential foraging decisions in a patchy environment, Nat. Neurosci., 14, 933, 10.1038/nn.2856 Hayden, 2011, Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior, J. Neurosci., 31, 4178, 10.1523/JNEUROSCI.4652-10.2011 Holroyd, 2002, The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity, Psychol. Rev., 109, 679, 10.1037/0033-295X.109.4.679 Holroyd, 2003, Errors in reward prediction are reflected in the event-related brain potential, Neuroreport, 14, 2481, 10.1097/00001756-200312190-00037 Holroyd, 2009, When is an error not a prediction error? An electrophysiological investigation, Cogn. Affect. Behav. Neurosci., 9, 59, 10.3758/CABN.9.1.59 Isoda, 2007, Switching from automatic to controlled action by monkey medial frontal cortex, Nat. Neurosci., 10, 240, 10.1038/nn1830 Ito, 2003, Performance monitoring by the anterior cingulate cortex during saccade countermanding, Science, 302, 120, 10.1126/science.1087847 Jessup, 2011, Human dorsal striatal activity during choice discriminates reinforcement learning behavior from the gambler's fallacy, J. Neurosci., 31, 6296, 10.1523/JNEUROSCI.6421-10.2011 Jessup, 2010, Error effects in anterior cingulate cortex reverse when error likelihood is high, J. Neurosci., 30, 3467, 10.1523/JNEUROSCI.4130-09.2010 Jung, 2010, Brain responses to success and failure: direct recordings from human cerebral cortex, Hum. Brain Mapp., 31, 1217 Kennerley, 2009, Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables, Eur. J. Neurosci., 29, 2061, 10.1111/j.1460-9568.2009.06743.x Kennerley, 2011, Decision making and reward in frontal cortex: complementary evidence from neurophysiological and neuropsychological studies, Behav. Neurosci., 125, 297, 10.1037/a0023575 Kennerley, 2006, Optimal decision making and the anterior cingulate cortex, Nat. Neurosci., 9, 940, 10.1038/nn1724 Landmann, 2007, Dynamics of prefrontal and cingulate activity during a reward-based logical deduction task, Cereb. Cortex, 17, 749, 10.1093/cercor/bhk028 Lapish, 2007, The ability of the mesocortical dopamine system to operate in distinct temporal modes, Psychopharmacology (Berl), 191, 609, 10.1007/s00213-006-0527-8 Lau, 2007, Action and outcome encoding in the primate caudate nucleus, J. Neurosci., 27, 14502, 10.1523/JNEUROSCI.3060-07.2007 Litt, 2011, Dissociating valuation and saliency signals during decision-making, Cereb. Cortex, 21, 95, 10.1093/cercor/bhq065 Matsumoto, 2007, Medial prefrontal cell activity signaling prediction errors of action values, Nat. Neurosci., 10, 647, 10.1038/nn1890 Mirenowicz, 1996, Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli, Nature, 379, 449, 10.1038/379449a0 Montague, 2004, Computational roles for dopamine in behavioural control, Nature, 431, 760, 10.1038/nature03015 Morris, 1999, Fiber system linking the mid-dorsolateral frontal cortex with the retrosplenial/presubicular region in the rhesus monkey, J. Comp. Neurol., 407, 183, 10.1002/(SICI)1096-9861(19990503)407:2<183::AID-CNE3>3.0.CO;2-N Norman, 2006, Beyond mind-reading: multi-voxel pattern analysis of fMRI data, Trends Cogn. Sci., 10, 424, 10.1016/j.tics.2006.07.005 Oliveira, 2007, Performance monitoring in the anterior cingulate is not all error related: expectancy deviation and the representation of action-outcome associations, J. Cogn. Neurosci., 19, 1994, 10.1162/jocn.2007.19.12.1994 Palomero-Gallagher, 2008, Cytology and receptor architecture of human anterior cingulate cortex, J. Comp. Neurol., 508, 906, 10.1002/cne.21684 Petrides, 1991, Monitoring of selections of visual stimuli and the primate frontal cortex, Proc. R. Soc. Lond. B Biol. Sci., 246, 293, 10.1098/rspb.1991.0157 Petrides, 1995, Impairments on nonspatial self-ordered and externally ordered working memory tasks after lesions of the mid-dorsal part of the lateral frontal cortex in the monkey, J. Neurosci., 15, 359, 10.1523/JNEUROSCI.15-01-00359.1995 Petrides, 1996, Specialized systems for the processing of mnemonic information within the primate frontal cortex, Philos. Trans. R. Soc. Lond. B Biol. Sci., 351, 1455, 10.1098/rstb.1996.0130 Petrides, 2004, 950 Petrides, 1993, Dissociation of human mid-dorsolateral from posterior dorsolateral frontal cortex in memory processing, Proc. Natl. Acad. Sci. U. S. A., 90, 873, 10.1073/pnas.90.3.873 Petrides, 2002, Differential activation of the human orbital, mid-ventrolateral and mid-dorsolateral prefrontal cortex during the processing of visual stimuli, Proc. Natl. Acad. Sci. U. S. A., 99, 5649, 10.1073/pnas.072092299 Preuschoff, 2008, Human insula activation reflects risk prediction errors as well as risk, J. Neurosci., 28, 2745, 10.1523/JNEUROSCI.4286-07.2008 Procyk, 2006, Modulation of dorsolateral prefrontal delay activity during self-organized behavior, J. Neurosci., 26, 11313, 10.1523/JNEUROSCI.2157-06.2006 Procyk, 1996, Problem solving and logical reasoning in the macaque monkey, Behav. Brain Res., 82, 67, 10.1016/S0166-4328(97)81109-6 Procyk, 2000, Anterior cingulate activity during routine and non-routine sequential behaviors in macaques, Nat. Neurosci., 3, 502, 10.1038/74880 Quilodran, 2008, Behavioral shifts and action valuation in the anterior cingulate cortex, Neuron, 57, 314, 10.1016/j.neuron.2007.11.031 Rametti, 2010, Anterior cingulate and paracingulate sulci morphology in patients with schizophrenia, Schizophr. Res., 121, 66, 10.1016/j.schres.2010.05.016 Rothe, 2011, Coordination of high gamma activity in anterior cingulate and lateral prefrontal cortical areas during adaptation, J. Neurosci., 31, 11110, 10.1523/JNEUROSCI.1016-11.2011 Rudebeck, 2008, Frontal cortex subregions play distinct roles in choices between actions and stimuli, J. Neurosci., 28, 13775, 10.1523/JNEUROSCI.3541-08.2008 Rushworth, 2008, Choice, uncertainty and value in prefrontal and cingulate cortex, Nat. Neurosci., 11, 389, 10.1038/nn2066 Rushworth, 2011, Frontal cortex and reward-guided learning and decision-making, Neuron, 70, 1054, 10.1016/j.neuron.2011.05.014 Rutledge, 2010, Testing the reward prediction error hypothesis with an axiomatic model, J. Neurosci., 30, 13525, 10.1523/JNEUROSCI.1747-10.2010 Sallet, 2007, Expectations, gains, and losses in the anterior cingulate cortex, Cogn. Affect. Behav. Neurosci., 7, 327, 10.3758/CABN.7.4.327 Seo, 2009, Behavioral and neural changes after gains and losses of conditioned reinforcers, J. Neurosci., 29, 3627, 10.1523/JNEUROSCI.4726-08.2009 Shima, 1998, Role for cingulate motor area cells in voluntary movement selection based on reward, Science, 282, 1335, 10.1126/science.282.5392.1335 St-Laurent, 2009, Does the cingulate cortex contribute to spatial conditional associative learning in the rat?, Hippocampus, 19, 612, 10.1002/hipo.20539 Vezoli, 2009, Frontal feedback-related potentials in nonhuman primates: modulation during learning and under haloperidol, J. Neurosci., 29, 15675, 10.1523/JNEUROSCI.4943-09.2009 Vickery, 2011, Ubiquity and specificity of reinforcement signals throughout the human brain, Neuron, 72, 166, 10.1016/j.neuron.2011.08.011 Vogt, 2006, Cytology and functionally correlated circuits of human posterior cingulate areas, Neuroimage, 29, 452, 10.1016/j.neuroimage.2005.07.048 Wallis, 2011, Challenges of interpreting frontal neurons during value-based decision-making, Front. Neurosci., 10.3389/fnins.2011.00124 Walton, 2004, Interactions between decision making and performance monitoring within prefrontal cortex, Nat. Neurosci., 7, 1259, 10.1038/nn1339 Wang, 2004, Selective D2 receptor actions on the functional circuitry of working memory, Science, 303, 853, 10.1126/science.1091162 Worsley, 1996, A unified statistical approach for determining significant signals in images of cerebral activation, Hum. Brain Mapp., 4, 58, 10.1002/(SICI)1097-0193(1996)4:1<58::AID-HBM4>3.0.CO;2-O Worsley, 2002, A general statistical analysis for fMRI data, Neuroimage, 15, 1, 10.1006/nimg.2001.0933 Yamada, 2011, Neuronal basis for evaluating selected action in the primate striatum, Eur. J. Neurosci., 34, 489, 10.1111/j.1460-9568.2011.07771.x Yoshida, 2006, Resolution of uncertainty in prefrontal cortex, Neuron, 50, 781, 10.1016/j.neuron.2006.05.006 Zink, 2004, Human striatal responses to monetary reward depend on saliency, Neuron, 42, 509, 10.1016/S0896-6273(04)00183-7