Appetitive Pavlovian-instrumental Transfer: A review

Aitken, 2016, Nucleus accumbens core dopamine signaling tracks the need-based motivational value of food-paired cues, J. Neurochem., 136, 1026, 10.1111/jnc.13494 Alarcón, 2016, The effect of conditioned inhibition on the specific pavlovian-instrumental transfer effect, J. Exp. Psychol. Anim. Learn. Cognit., 42, 82, 10.1037/xan0000087 Allman, 2010, Learning processes affecting human decision making: an assessment of reinforcer-selective pavlovian-to-instrumental transfer following reinforcer devaluation, J. Exp. Psychol. Anim. Behav. Process., 36, 402, 10.1037/a0017876 Balleine, 1994, Asymmetrical interactions between thirst and hunger in pavlovian-instrumental transfer, Q. J. Exp. Psychol. B, Comp. Physiol. Psychol., 47, 211 Balleine, 1998, Goal-directed instrumental action: contingency and incentive learning and their cortical substrates, Neuropharmacology, 37, 407, 10.1016/S0028-3908(98)00033-1 Balleine, 2011, The orbitofrontal cortex, predicted value, and choice, Ann. N. Y. Acad. Sci., 1239, 43, 10.1111/j.1749-6632.2011.06270.x Balleine, 2015, Thalamocortical integration of instrumental learning and performance and their disintegration in addiction, Brain Res., 1628, 104, 10.1016/j.brainres.2014.12.023 Balleine, 2010, Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action, Neuropsychopharmacol.: Off. Publ. Am. Coll. Neuropsychopharmacol., 35, 48, 10.1038/npp.2009.131 Balleine, 2007, Still at the choice-point: action selection and initiation in instrumental conditioning, Ann. N. Y. Acad. Sci., 1104, 147, 10.1196/annals.1390.006 Baxter, 1982, Reinforcer and response specificity in appetitive transfer of control, Anim. Learn. Behav., 10, 201, 10.3758/BF03212271 Belin, 2009, Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction, Behav. Brain Res., 199, 89, 10.1016/j.bbr.2008.09.027 Bertran-Gonzalez, 2013, Learning-related translocation of δ-opioid receptors on ventral striatal cholinergic interneurons mediates choice between goal-directed actions, J. Neurosci., 33, 16060, 10.1523/JNEUROSCI.1927-13.2013 Bindra, 1974, A motivational view of learning perfomance, and behavior modification, Psychol. Rev., 81, 199, 10.1037/h0036330 Blundell, 2001, Lesions of the basolateral amygdala disrupt selective aspects of reinforcer representation in rats, J. Neurosci., 21, 9018, 10.1523/JNEUROSCI.21-22-09018.2001 Bradfield, 2013, Hierarchical and binary associations compete for behavioral control during instrumental biconditional discrimination, J. Exp. Psychol. Anim. Behav. Process., 39, 2, 10.1037/a0030941 Bradfield, 2015, Medial orbitofrontal cortex mediates outcome retrieval in partially observable task situations, Neuron, 88, 1268, 10.1016/j.neuron.2015.10.044 Bray, 2008, The neural mechanisms underlying the influence of pavlovian cues on human decision making, J. Neurosci.: Off. J. Soc. Neurosci., 28, 5861, 10.1523/JNEUROSCI.0897-08.2008 Campese, 2013, Development of an aversive pavlovian-to-instrumental transfer task in rat, Front. Behav. Neurosci., 7, 176 Cardinal, 2003, Role of the anterior cingulate cortex in the control over behavior by pavlovian conditioned stimuli in rats, Behav. Neurosci., 117, 566, 10.1037/0735-7044.117.3.566 Cartoni, 2015, The relationship between specific pavlovian instrumental transfer and instrumental reward probability, Front. Psychol., 6, 1 Cartoni, 2013, The three principles of action: a pavlovian-instrumental transfer hypothesis, Front. Behav. Neurosci., 7, 153 Cohen-Hatton, 2013, Pavlovian-to-instrumental transfer: paradoxical effects of the pavlovian relationship explained, J. Exp. Psychol. Anim. Behav. Process., 39, 14, 10.1037/a0030594 Colagiuri, 2015, How food cues can enhance and inhibit motivation to obtain and consume food, Appetite, 84, 79, 10.1016/j.appet.2014.09.023 Collins, 2016, Nucleus accumbens acetylcholine receptors modulate dopamine and motivation, Neuropsychopharmacology, 41, 2830, 10.1038/npp.2016.81 Colwill, 1994, Encoding of the unconditioned stimulus in pavlovian conditioning, Anim. Learn. Behav., 22, 384, 10.3758/BF03209158 Colwill, 1988, Associations between the discriminative stimulus and the reinforcer in instrumental learning, J. Exp. Psychol.: Anim. Behav. Process., 14, 155 Colwill, 1990, Effect of reinforcer devaluation on discriminative control of instrumental behavior, J. Exp. Psychol. Anim. Behav. Process., 16, 40, 10.1037/0097-7403.16.1.40 Corbit, 2003, Instrumental and pavlovian incentive processes have dissociable effects on components of a heterogeneous instrumental chain, J. Exp. Psychol. Anim. Behav. Process., 29, 99, 10.1037/0097-7403.29.2.99 Corbit, 2003, The role of prelimbic cortex in instrumental conditioning, Behav. Brain Res., 146, 145, 10.1016/j.bbr.2003.09.023 Corbit, 2005, Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer, J. Neurosci., 25, 962, 10.1523/JNEUROSCI.4507-04.2005 Corbit, 2011, The general and outcome-specific forms of pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell, J. Neurosci., 31, 11786, 10.1523/JNEUROSCI.2711-11.2011 Corbit, 2016, Nucleus accumbens core and shell are differentially involved in general and outcome-specific forms of pavlovian-instrumental transfer with alcohol and sucrose rewards, Eur. J. Neurosci., 43, 1229, 10.1111/ejn.13235 Corbit, 2007, Ethanol-associated cues produce general pavlovian-instrumental transfer, Alcohol. Clin. Exp. Res., 31, 766, 10.1111/j.1530-0277.2007.00359.x Corbit, 2007, Inactivation of the lateral but not medial dorsal striatum eliminates the excitatory impact of pavlovian stimuli on instrumental responding, J. Neurosci., 27, 13977, 10.1523/JNEUROSCI.4097-07.2007 Corbit, 2010, Posterior dorsomedial striatum is critical for both selective instrumental and pavlovian reward learning, Eur. J. Neurosci., 31, 1312, 10.1111/j.1460-9568.2010.07153.x Corbit, 2007, General and outcome-specific forms of pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area, Eur. J. Neurosci., 26, 3141, 10.1111/j.1460-9568.2007.05934.x Corbit, 2001, The role of the nucleus accumbens in instrumental conditioning: Evidence of a functional dissociation between accumbens core and shell, J. Neurosci.: Off. J. Soc. Neurosci., 21, 3251, 10.1523/JNEUROSCI.21-09-03251.2001 Crombag, 2008, Pavlovian influences on goal-directed behavior in mice: the role of cue-reinforcer relations., Learn. Memory (Cold Spring Harbor, N. Y.), 15, 299, 10.1101/lm.762508 Crombag, 2008, A role for alpha-amino-3-hydroxy-5-methylisoxazole-4-propionic acid glur1 phosphorylation in the modulatory effects of appetitive reward cues on goal-directed behavior, Eur. J. Neurosci., 27, 3284, 10.1111/j.1460-9568.2008.06299.x Dailey, 2016, The antagonism of ghrelin alters the appetitive response to learned cues associated with food, Behav. Brain Res., 303, 191, 10.1016/j.bbr.2016.01.040 Daw, 2011, Model-based influences on humans’ choices and striatal prediction errors, Neuron, 69, 1204, 10.1016/j.neuron.2011.02.027 Dawson, 1990, Performance on ratio and interval schedules with matched reinforcement rates, Q. J. Exp. Psychol. B, 42, 225 de Borchgrave, 2002, Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats, Exp. Brain Res. Experimentelle Hirnforschung. Expérimentation cérébrale, 144, 50, 10.1007/s00221-002-1031-y Delamater, 1995, Outcome-selective effects of intertrial reinforcement in a pavlovian appetitive conditioning paradigm with rats, Anim. Learn. Behav., 23, 31, 10.3758/BF03198013 Delamater, 1996, Effects of several extinction treatments upon the integrity of pavlovian stimulus-outcome associations, Anim. Learn. Behav., 24, 437, 10.3758/BF03199015 Delamater, 2008, The influence of CS-US interval on several different indices of learning in appetitive conditioning, J. Exp. Psychol. Anim. Behav. Process., 34, 202, 10.1037/0097-7403.34.2.202 Delamater, 2003, Outcome-specific conditioned inhibition in pavlovian backward conditioning, Learn. Behav., 31, 393, 10.3758/BF03196000 Delamater, 2007, Learning about multiple attributes of reward in pavlovian conditioning, Ann. N. Y. Acad. Sci., 1104, 1, 10.1196/annals.1390.008 DePoy, 2013, Chronic alcohol produces neuroadaptations to prime dorsal striatal learning, Proc. Natl. Acad. Sci. U. S. A., 110, 14783, 10.1073/pnas.1308198110 Depoy, 2014 Dickinson, 1987, Pavlovian processes in the motivational control of instrumental performance, Q. J. Exp. Psychol. B, Comp. Physiol. Psychol., 39, 201 Dickinson, 2000, Dissociation of pavlovian and instrumental incentive learning under dopamine antagonists, Behav. Neurosci., 114, 468, 10.1037/0735-7044.114.3.468 Eder, 2015, Cue-elicited food seeking is eliminated with aversive outcomes following outcome devaluation, Q. J. Exp. Psychol. (2006), 1 Eder, 2016, Asymmetrical effects of posttraining outcome revaluation onoutcome-selective pavlovian-to-instrumental transfer ofcontrol in human adults, Learn. Motiv., 12, 10.1016/j.lmot.2016.05.002 El-Amamy, 2007, Dissociable effects of disconnecting amygdala central nucleus from the ventral tegmental area or substantia nigra on learned orienting and incentive motivation, Eur. J. Neurosci., 25, 1557, 10.1111/j.1460-9568.2007.05402.x Estes, 1943, Discriminative conditioning I. A discriminative property of conditioned anticipation, Exp. Psychol., 32, 150, 10.1037/h0058316 Estes, 1941, Some quantitative properties of anxiety, J. Exp. Psychol., 29, 390, 10.1037/h0062283 Freeman, 2015, Suppressing a motivationally-triggered action tendency engages a response control mechanism that prevents future provocation, Neuropsychologia, 68, 218, 10.1016/j.neuropsychologia.2015.01.016 Freeman, 2014, Top-down response suppression mitigates action tendencies triggered by a motivating stimulus, Curr. Biol., 24, 212, 10.1016/j.cub.2013.12.019 Gámez, 2005, Transfer of stimulus control across instrumental responses is attenuated by extinction in human instrumental conditioning, Int. J. Psychol. Psychol. Ther., 5, 207 Garbusow, 2016, Pavlovian-to-instrumental transfer effects in the nucleus accumbens relate to relapse in alcohol dependence, Addict. Biol., 21, 719, 10.1111/adb.12243 Garbusow, 2014, Pavlovian-to-instrumental transfer in alcohol dependence: a pilot study, Neuropsychobiology, 70, 111, 10.1159/000363507 Garofalo, 2015, Individual differences in the influence of task-irrelevant pavlovian cues on human behavior, Front. Behav. Neurosci., 9, 1 George, 2009, Differential effects of MPEP and diazepam in tests of conditioned emotional response and pavlovian-to-instrumental transfer suggests ‘anxiolytic’ effects are mediated by different mechanisms, Psychopharmacology, 204, 499, 10.1007/s00213-009-1479-6 Geurts, 2013, Aversive pavlovian control of instrumental behavior in humans, J. Cognit. Neurosci., 25, 1428, 10.1162/jocn_a_00425 Geurts, 2013, Serotonin and aversive pavlovian control of instrumental behavior in humans, J. Neurosci.: Off. J. Soc. Neurosci., 33, 18932, 10.1523/JNEUROSCI.2749-13.2013 Gilroy, 2014, Response-outcome versus outcome-response associations in pavlovian-to-instrumental transfer: effects of instrumental training context, Int. J. Comp. Psychol., 27, 585, 10.46867/ijcp.2014.27.04.02 Glasner, 2005, The role of pavlovian cues in alcohol seeking in dependent and nondependent rats, J. Stud. Alcohol, 66, 53, 10.15288/jsa.2005.66.53 Hall, 2011, Disruptive effect of amphetamines on pavlovian to instrumental transfer, Behav. Brain Res., 216, 440, 10.1016/j.bbr.2010.08.040 Hall, 2001, Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating pavlovian influences on instrumental behaviour, Eur. J. Neurosci., 13, 1984, 10.1046/j.0953-816x.2001.01577.x Hogarth, 2012, Goal-directed and transfer-cue-elicited drug-seeking are dissociated by pharmacotherapy: evidence for independent additive controllers, J. Exp. Psychol. Anim. Behav. Process., 38, 266, 10.1037/a0028914 Hogarth, 2013, Associative learning mechanisms underpinning the transition from recreational drug use to addiction, Ann. N. Y. Acad. Sci., 1282, 12, 10.1111/j.1749-6632.2012.06768.x Hogarth, 2011, Parallel goal-directed and habitual control of human drug-seeking: implications for dependence vulnerability, J. Exp. Psychol. Anim. Behav. Process., 37, 261, 10.1037/a0022913 Hogarth, 2012, Evaluating psychological markers for human nicotine dependence: tobacco choice, extinction, and pavlovian-to-instrumental transfer, Exp. Clin. Psychopharmacol., 20, 213, 10.1037/a0027203 Hogarth, 2007, The role of drug expectancy in the control of human drug seeking, J. Exp. Psychol. Anim. Behav. Process., 33, 484, 10.1037/0097-7403.33.4.484 Hogarth, 2013, Phasic transition from goal-directed to habitual control over drug-seeking produced by conflicting reinforcer expectancy, Addict. Biol., 18, 88, 10.1111/adb.12009 Hogarth, 2015, Plain cigarette packs do not exert pavlovian to instrumental transfer of control over tobacco-seeking, Addiction, 110, 174, 10.1111/add.12756 Hogarth, 2014, Extinction of cue-evoked drug-seeking relies on degrading hierarchical instrumental expectancies, Behav. Res. Ther., 59, 61, 10.1016/j.brat.2014.06.001 Hogarth, 2015, A hierarchical instrumental decision theory of nicotine dependence, Curr. Top. Behav. Neurosci., 23, 165, 10.1007/978-3-319-13665-3_7 Holland, 2004, Relations between pavlovian-instrumental transfer and reinforcer devaluation, J. Exp. Psychol., Anim. Behav. Process., 30, 104, 10.1037/0097-7403.30.2.104 Holland, 2003, Double dissociation of the effects of lesions of basolateral and central amygdala on conditioned stimulus-potentiated feeding and pavlovian-instrumental transfer, Eur. J. Neurosci., 17, 1680, 10.1046/j.1460-9568.2003.02585.x Holmes, 2010, Pavlovian to instrumental transfer: a neurobehavioural perspective, Neurosci. Biobehav. Rev., 34, 1277, 10.1016/j.neubiorev.2010.03.007 Homayoun, 2009, Differential representation of pavlovian-instrumental transfer by prefrontal cortex subregions and striatum, Eur. J. Neurosci., 29, 1461, 10.1111/j.1460-9568.2009.06679.x Huys, 2011, Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding, PLoS Comput. Biol., 7, e1002028, 10.1371/journal.pcbi.1002028 Huys, 2016, The specificity of pavlovian regulation is associated with recovery from depression, Psychol. Med., 46, 1027, 10.1017/S0033291715002597 Johnson, 2007, Targeted deletion of the glur-1 ampa receptor in mice dissociates general and outcome-specific influences of appetitive rewards on learning, Behav. Neurosci., 121, 1192, 10.1037/0735-7044.121.6.1192 Keistler, 2015, 509 Konorski, 1967 Krank, 2003, Pavlovian conditioning with ethanol: sign-tracking (autoshaping), conditioned incentive, and ethanol self-administration, Alcohol. Clin. Exp. Res., 27, 1592, 10.1097/01.ALC.0000092060.09228.DE Krank, 2008, Goal- and signal-directed incentive: conditioned approach, seeking, and consumption established with unsweetened alcohol in rats, Psychopharmacology, 196, 397, 10.1007/s00213-007-0971-0 Kruzich, 2001, Conditioned reinstatement of drug-seeking behavior with a discrete compound stimulus classically conditioned with intravenous cocaine, Behav. Neurosci., 115, 1086, 10.1037/0735-7044.115.5.1086 Lamb, 2016, Conditioned stimuli's role in relapse: preclinical research on pavlovian-instrumental-transfer, Psychopharmacology, 233, 1933, 10.1007/s00213-016-4216-y Lansade, 2013, Dimensions of temperament modulate cue-controlled behavior: a study on pavlovian to instrumental transfer in horses (equus caballus), PLOS ONE, 8, e64853, 10.1371/journal.pone.0064853 Laurent, 2015, Factual and counterfactual action-outcome mappings control choice between goal-directed actions in rats, Curr. Biol., 25, 1074, 10.1016/j.cub.2015.02.044 Laurent, 2014, δ-opioid and dopaminergic processes in accumbens shell modulate the cholinergic control of predictive learning and choice, J. Neurosci.: Off. J. Soc. Neurosci., 34, 1358, 10.1523/JNEUROSCI.4592-13.2014 Laurent, 2012, μ- and δ-opioid-related processes in the accumbens core and shell differentially mediate the influence of reward-guided and stimulus-guided decisions on choice, J. Neurosci.: Off. J. Soc. Neurosci., 32, 1875, 10.1523/JNEUROSCI.4688-11.2012 Laurent, 2015, δ-opioid receptors in the accumbens shell mediate the influence of both excitatory and inhibitory predictions on choice, Br. J. Pharmacol., 172, 562, 10.1111/bph.12731 LeBlanc, 2013, Repeated cocaine exposure facilitates the expression of incentive motivation and induces habitual control in rats, PLOS ONE, 8, e61355, 10.1371/journal.pone.0061355 LeBlanc, 2014, Impact of repeated intravenous cocaine administration on incentive motivation depends on mode of drug delivery, Addict. Biol., 19, 965, 10.1111/adb.12063 LeBlanc, 2012, Pavlovian-to-instrumental transfer in cocaine seeking rats, Behav. Neurosci., 126, 681, 10.1037/a0029534 Lederle, 2011, Reward-related behavioral paradigms for addiction research in the mouse: performance of common inbred strains, PLoS ONE, 6, e15536, 10.1371/journal.pone.0015536 Lee, 2011, Interactions between amygdala central nucleus and the ventral tegmental area in the acquisition of conditioned cue-directed behavior in rats, Eur. J. Neurosci., 33, 1876, 10.1111/j.1460-9568.2011.07680.x Leung, 2013, The ventral striato-pallidal pathway mediates the effect of predictive learning on choice between goal-directed actions, J. Neurosci.: Off. J. Soc. Neurosci., 33, 13848, 10.1523/JNEUROSCI.1697-13.2013 Leung, 2015, Ventral pallidal projections to mediodorsal thalamus and ventral tegmental area play distinct roles in outcome-specific pavlovian-instrumental transfer, J. Neurosci., 35, 4953, 10.1523/JNEUROSCI.4837-14.2015 Lewis, 2013, Avoidance-based human pavlovian-to-instrumental transfer, Eur. J. Neurosci., 38, 3740, 10.1111/ejn.12377 Lex, 2008, Dopamine d1 and d2 receptors in the nucleus accumbens core and shell mediate pavlovian-instrumental transfer, Learn. Mem., 15, 483, 10.1101/lm.978708 Lingawi, 2012, Amygdala central nucleus interacts with dorsolateral striatum to regulate the acquisition of habits, J. Neurosci.: Off. J. Soc. Neurosci., 32, 1073, 10.1523/JNEUROSCI.4806-11.2012 Lovibond, 1981, Appetitive pavlovian-instrumental interactions: effects of inter-stimulus interval and baseline reinforcement conditions, Q. J. Exp. Psychol. B, Comp. Physiol. Psychol., 33, 257, 10.1080/14640748108400811 Lovibond, 1983, Facilitation of instrumental behavior by a pavlovian appetitive conditioned stimulus, J. Exp. Psychol. Anim. Behav. Process., 9, 225, 10.1037/0097-7403.9.3.225 Lovibond, 2013, Facilitation of voluntary goal-directed action by reward cues, Psychol. Sci., 24, 2030, 10.1177/0956797613484043 Lovibond, 2015, Extinction can reduce the impact of reward cues on reward-seeking behavior, Behav. Ther., 46, 432, 10.1016/j.beth.2015.03.005 Malvaez, 2015, Basolateral amygdala rapid glutamate release encodes an outcome-specific representation vital for reward-predictive cues to selectively invigorate reward-seeking actions, Sci. Rep., 5, 12511, 10.1038/srep12511 Martinovic, 2014, Electrophysiological responses to alcohol cues are not associated with pavlovian-to-instrumental transfer in social drinkers, PLOS ONE, 9, e94605, 10.1371/journal.pone.0094605 Mead, 2003, Involvement of ampa receptor glur2 subunits in stimulus-reward learning: evidence from glutamate receptor gria2 knock-out mice, J. Neurosci.: Off. J. Soc. Neurosci., 23, 9500, 10.1523/JNEUROSCI.23-29-09500.2003 Mead, 2003, Selective disruption of stimulus-reward learning in glutamate receptor gria1 knock-out mice, J. Neurosci.: Off. J. Soc. Neurosci., 23, 1041, 10.1523/JNEUROSCI.23-03-01041.2003 Meltzer, 1970, Conditioned suppression and conditioned enhancement with the same positive UCS: an effect of CS duration, J. Exp. Anal. Behav., 13, 67, 10.1901/jeab.1970.13-67 Meltzer, 1974, Conditioned enhancement as a function of schedule of reinforcement, Bull. Psychonom. Soc., 3, 99, 10.3758/BF03333406 Mendelsohn, 2014, Between thoughts and actions: Motivationally salient cues invigorate mental action in the human brain, Neuron, 81, 207, 10.1016/j.neuron.2013.10.019 Milton, 2010, The psychological and neurochemical mechanisms of drug memory reconsolidation: implications for the treatment of addiction, Eur. J. Neurosci., 31, 2308, 10.1111/j.1460-9568.2010.07249.x Milton, 2012, Antagonism at NMDA receptors, but not beta-adrenergic receptors, disrupts the reconsolidation of pavlovian conditioned approach and instrumental transfer for ethanol-associated conditioned stimuli, Psychopharmacology, 219, 751, 10.1007/s00213-011-2399-9 Morgado, 2012, Stress transiently affects pavlovian-to-instrumental transfer, Front. Neurosci., 6, 93 Morris, 2015, Corticostriatal control of goal-directed action is impaired in schizophrenia, Biol. Psychiatry, 77, 187, 10.1016/j.biopsych.2014.06.005 Morse, 1958, Some factors involved in the stimulus control of operant behavior, J. Exp. Anal. Behav., 1, 103, 10.1901/jeab.1958.1-103 Murschall, 2005, Effects of a systemic AMPA/KA and NMDA receptor blockade on pavlovian-instrumental transfer, Psychopharmacology, 182, 290, 10.1007/s00213-005-0073-9 Murschall, 2006, Inactivation of the ventral tegmental area abolished the general excitatory influence of pavlovian cues on instrumental performance, Learn. Mem. (Cold Spring Harb., N. Y.), 13, 123, 10.1101/lm.127106 Nadler, 2011, Pavlovian to instrumental transfer of control in a human learning task, Emotion (Washington, DC), 11, 1112, 10.1037/a0022760 Ostlund, 2007, Orbitofrontal cortex mediates outcome encoding in pavlovian but not instrumental conditioning, J Neurosci.: Off. J. Soc. Neurosci., 27, 4819, 10.1523/JNEUROSCI.5443-06.2007 Ostlund, 2008, Differential involvement of the basolateral amygdala and mediodorsal thalamus in instrumental action selection, J. Neurosci.: Off. J. Soc. Neurosci., 28, 4398, 10.1523/JNEUROSCI.5472-07.2008 Ostlund, 2014, Differential effects of systemic cholinergic receptor blockade on pavlovian incentive motivation and goal-directed action selection, Neuropsychopharmacol.: Off. Publ. Am. Coll. Neuropsychopharmacol., 39, 1490, 10.1038/npp.2013.348 Ostlund, 2014, Phasic mesolimbic dopamine signaling encodes the facilitation of incentive motivation produced by repeated cocaine exposure, Neuropsychopharmacol.: Off. Publ. Am. Coll. Neuropsychopharmacol., 39, 2441, 10.1038/npp.2014.96 Ostlund, 2012, Dopamine receptor blockade attenuates the general incentive motivational effects of noncontingently delivered rewards and reward-paired cues without affecting their ability to bias action selection, Neuropsychopharmacol.: Off. Publ. Am. Coll. Neuropsychopharmacol., 37, 508, 10.1038/npp.2011.217 Paredes-Olay, 2002, Transfer of control between causal predictive judgments and instrumental responding, Anim. Learn. Behav., 30, 239, 10.3758/BF03192833 Peciña, 2013, Dopamine or opioid stimulation of nucleus accumbens similarly amplify cue-triggered ‘wanting’ for reward: entire core and medial shell mapped as substrates for pit enhancement, Eur. J. Neurosci., 37, 1529, 10.1111/ejn.12174 Peciña, 2006, Nucleus accumbens corticotropin-releasing factor increases cue-triggered motivation for sucrose reward: paradoxical positive incentive effects in stress, BMC Biol., 4, 8, 10.1186/1741-7007-4-8 Pielock, 2011, The role of dopamine in the dorsomedial striatum in general and outcome-selective pavlovian-instrumental transfer, Eur. J. Neurosci., 33, 717, 10.1111/j.1460-9568.2010.07561.x Pielock, 2013, The effects of acute stress on Pavlovian-instrumental transfer in rats, Cogn. Affect. Behav. Neurosci., 13, 174, 10.3758/s13415-012-0129-3 Pielock, 2013, Post-training glucocorticoid receptor activation during pavlovian conditioning reduces pavlovian-instrumental transfer in rats, Pharmacol. Biochem. Behav., 104, 125, 10.1016/j.pbb.2012.12.017 Pool, 2014, Stress increases cue-triggered “wanting” for sweet reward in humans, J. Exp. Psychol.: Anim. Learn. Cognit., 41, 128 Prévost, 2012, Neural correlates of specific and general pavlovian-to-instrumental transfer within human amygdalar subregions: a high-resolution fmri study, J. Neurosci., 32, 8383, 10.1523/JNEUROSCI.6237-11.2012 Quail, 2016, Stress associated changes in pavlovian-instrumental transfer in humans, Q. J. Exp. Psychol., 0218, 1 Remus, 2012, Stimulus-specific and differential distribution of activated extracellular signal-regulated kinase in the nucleus accumbens core and shell during pavlovian-instrumental transfer, Brain Struct. Funct., 218, 913, 10.1007/s00429-012-0438-x Rescorla, 1991, Associations of multiple outcomes with an instrumental response, J. Exp. Psychol.: Anim. Behav. Process., 17, 465 Rescorla, 1994, Control of instrumental performance by pavlovian and instrumental stimuli, J. Exp. Psychol. Anim. Behav. Process., 20, 44, 10.1037/0097-7403.20.1.44 Rescorla, 1994, Transfer of instrumental control mediated by a devalued outcome, Anim. Learn. Behav., 22, 27, 10.3758/BF03199953 Rescorla, 1965, Inhibition of avoidance behavior, J. Comp. Physiol. Psychol., 59, 406, 10.1037/h0022060 Rescorla, 1967, Two-process learning theory: relationships between pavlovian conditioning and instrumental learning, Psychol. Rev., 74, 151, 10.1037/h0024475 Rigoli, 2012, Aversive pavlovian responses affect human instrumental motor performance, Front. Neurosci., 6, 134 Ripley, 2004, Selective deficits in appetitive conditioning as a consequence of ethanol withdrawal, Eur. J. Neurosci., 19, 415, 10.1111/j.0953-816X.2003.03114.x Rosas, 2010, Outcome-specific transfer between predictive and instrumental learning is unaffected by extinction but reversed by counterconditioning in human participants, Learn. Motiv., 41, 48, 10.1016/j.lmot.2009.09.002 Saddoris, 2011, Neural correlates of pavlovian-to-instrumental transfer in the nucleus accumbens shell are selectively potentiated following cocaine self-administration, Eur. J. Neurosci., 33, 2274, 10.1111/j.1460-9568.2011.07683.x Scarlet, 2012, Differential involvement of the basolateral amygdala and orbitofrontal cortex in the formation of sensory-specific associations in conditioned flavor preference and magazine approach paradigms, Eur. J. Neurosci., 35, 1799, 10.1111/j.1460-9568.2012.08113.x Sebold, 2016, Don’t think, just feel the music: individuals with strong pavlovian-to-instrumental transfer effects rely less on model-based reinforcement learning, J. Cognit. Neurosci., 28, 985, 10.1162/jocn_a_00945 Shiflett, 2012, The effects of amphetamine exposure on outcome-selective pavlovian-instrumental transfer in rats, Psychopharmacology, 223, 361, 10.1007/s00213-012-2724-y Shiflett, 2010, At the limbic-motor interface: disconnection of basolateral amygdala from nucleus accumbens core and shell reveals dissociable components of incentive motivation, Eur. J. Neurosci., 32, 1735, 10.1111/j.1460-9568.2010.07439.x Shiflett, 2011, Molecular substrates of action control in cortico-striatal circuits, Prog. Neurobiol., 95, 1, 10.1016/j.pneurobio.2011.05.007 Shiflett, 2013, The effects of amphetamine sensitization on conditioned inhibition during a pavlovian-instrumental transfer task in rats, Psychopharmacology, 230, 137, 10.1007/s00213-013-3144-3 Soares-Cunha, 2014, The motivational drive to natural rewards is modulated by prenatal glucocorticoid exposure, Transl. Psychiatry, 4, e397, 10.1038/tp.2014.45 Stebbins, 1964, Cardiovascular concomitants of the conditioned emotional response inthe monkey, Science, 144, 881, 10.1126/science.144.3620.881 Talmi, 2008, Human pavlovian-instrumental transfer, J. Neurosci.: Off. J. Soc. Neurosci., 28, 360, 10.1523/JNEUROSCI.4028-07.2008 Tomie, 1996, Locating reward cue at response manipulandum (cam) induces symptoms of drug abuse, Neurosci. Biobehav. Rev., 20, 505, 10.1016/0149-7634(95)00023-2 Trapold, 1972, The second learning process in instrumental learning. van den Bos, 2004, On the relationship between anticipatory behaviour in a pavlovian paradigm and pavlovian-to-instrumental transfer in rats (rattus norvegicus), Behav. Brain Res., 153, 397, 10.1016/j.bbr.2003.12.017 Van Dyne, 1971, Conditioned suppression with a positive US in the rat, J. Comp. Physiol. Psychol., 77, 131, 10.1037/h0031576 Walker, 1942, The effect of a discriminative stimulus transferred to a previously unassociated response, J. Exp. Psychol., 31, 312, 10.1037/h0062929 Wassum, 2011, Differential dependence of pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling, Learn. Mem. (Cold Spring Harb., N. Y.), 18, 475, 10.1101/lm.2229311 Wassum, 2013, Phasic mesolimbic dopamine release tracks reward seeking during expression of pavlovian-to-instrumental transfer, Biol. Psychiatry, 73, 747, 10.1016/j.biopsych.2012.12.005 Watson, 2014, Working for food you don’t desire – cues interfere with goal-directed food-seeking, Appetite, 79, 139, 10.1016/j.appet.2014.04.005 Watson, 2016, An associative account of how the obesogenic environment biases adolescents’ food choices, Appetite, 96, 560, 10.1016/j.appet.2015.10.008 Weber, 2016, Dopamine d2/3- and μ-opioid receptor antagonists reduce cue-induced responding and reward impulsivity in humans, Transl. Psychiatry, 6, e850, 10.1038/tp.2016.113 Wiltgen, 2012, The effect of ratio and interval training on pavlovian-instrumental transfer in mice, PLoS ONE, 7, e48227, 10.1371/journal.pone.0048227 Wyvell, 2000, Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward “wanting” without enhanced “liking” or response reinforcement, J. Neurosci., 20, 8122, 10.1523/JNEUROSCI.20-21-08122.2000 Wyvell, 2001, Incentive sensitization by previous amphetamine exposure: increased cue-triggered “wanting” for sucrose reward, J. Neurosci.: Off. J. Soc. Neurosci., 21, 7831, 10.1523/JNEUROSCI.21-19-07831.2001 Zorawski, 2003, Glucocorticoid receptor agonist enhances pavlovian appetitive conditioning but disrupts outcome-specific associations, Behav. Neurosci., 117, 1453, 10.1037/0735-7044.117.6.1453