Sự xuất hiện của động lực phức tạp trong việc lựa chọn do tiếp xúc lặp lại với quá trình học tiêu biến

André MAE, Güntürkün O, Manahan-Vaughan D (2015) The metabotropic glutamate receptor, mGlu5, is required for extinction learning that occurs in the absence of a context change. Hippocampus 25:149–158 Anger D, Anger K (1976) Behavior changes during repeated eight-day extinctions. J Exp Anal Behav 26:181–190 Anselme P, Güntürkün O (2019) How foraging works: uncertainty magnifies food-seeking motivation. Behav Brain Sci 42(e35):1–59 Antonitis JJ (1951) Response variability in the white rat during conditioning, extinction, and reconditioning. J Exp Psychol 42:273–281 Bai JYH, Podlesnik CA (2017) No impact of repeated extinction exposures on operant responding maintained by different reinforcer rates. Behav Processes 138:29–33 Baker AG, Steinwald H, Bouton ME (1991) Contextual conditioning and reinstatement of extinguished instrumental responding. Q J Exp Psychol Sect B 43:199–218 Barad M, Gean P-W, Lutz B (2006) The role of the amygdala in the extinction of conditioned fear. Biol Psychiatry 60:322–328 Baum WM (2012) Extinction as discrimination: the molar view. Behav Proc 90(1):101–110 Bernal-Gamboa R, Nieto J, Uengoer M (2017) Effects of extinction in multiple contexts on renewal of instrumental responses. Behav Processes 142:64–69 Bernal-Gamboa R, Nieto J, Uengoer M (2018) Removing but not adding elements of a context affects generalization of instrumental responses. Learn Behav 46:256–264 Bouton ME (2011) Learning and the persistence of appetite: extinction and the motivation to eat and overeat. Physiol Behav 103:51–58 Bouton ME (2019) Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control. Psychopharmacology 236:7–19 Bouton ME, Todd TP, Vurbic D, Winterbauer NE (2011) Renewal after the extinction of free operant behavior. Learn Behav 39:57–67 Bullock DH (1960) Repeated conditioning-extinction sessions as a function of the reinforcement schedule. J Exp Anal Behav 3:241–243 Bullock DH, Smith WC (1953) An effect of repeated conditioning-extinction upon operant strength. J Exp Psychol 46(5):349–352 Bush RR, Mosteller F (1951) A mathematical model for simple learning. Psychol Rev 58:313–323 Cheng S, Sabes PN (2006) Modeling sensorimotor learning with linear dynamical systems. Neural Comput 18:760–793 Cheng S, Sabes PN (2007) Calibration of visually guided reaching is driven by error-corrective learning and internal dynamics. J Neurophysiol 97:3057–3069 Conklin CA, Tiffany ST (2002) Applying extinction research and theory to cue-exposure addiction treatments. Addiction 97:155–167 Craig AR, Shahan TA (2016) Experience with dynamic reinforcement rates decreases resistance to extinction. J Exp Anal Behav 105:291–306 Craig AR, Sweeney MM, Shahan TA (2019) Behavioral momentum and resistance to extinction across repeated extinction tests. J Exp Anal Behav 112:290–309 Eckerman DA, Lanson RN (1969) Variability of response location for pigeons responding under continuous reinforcement, intermittent reinforcement, and extinction1. J Exp Anal Behav 12(1):73–80 Eisenberg M, Dudai Y (2004) Reconsolidation of fresh, remote, and extinguished fear memory in medaka: old fears don’t die. Eur J Neurosci 20:3397–3403 Everitt BJ, Robbins TW (2005) Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat Neurosci 8:1481–1489 Feldmann-Wüstefeld T, Uengoer M, Schubö A (2015) You see what you have learned. Evidence for an interrelation of associative learning and visual selective attention. Psychophysiology 52:1483–1497 Felsenberg J, Jacob PF, Walker T, Barnstedt O, Edmondson-Stait AJ, Pleijzier MW, Otto N, Schlegel P, Sharifi N, Perisse E et al (2018) Integration of parallel opposing memories underlies memory extinction. Cell 175:709-722.e15 Fuller PR (1949) Operant conditioning of a vegetative human organism. Am J Psychol 62:587–590 Galatzer-Levy IR, Bonanno GA, Bush DE, LeDoux J (2013) Heterogeneity in threat extinction learning: substantive and methodological considerations for identifying individual difference in response to stress. Front Behav Neurosci 7:55 Gallistel CR, Fairhurst S, Balsam P (2004) The learning curve: implications of a quantitative analysis. Proc Natl Acad Sci 101:13124–13131 Gao M, Lengersdorf D, Stüttgen MC, Güntürkün O (2018) NMDA receptors in the avian amygdala and the premotor arcopallium mediate distinct aspects of appetitive extinction learning. Behav Brain Res 343:71–82 Gershman SJ, Blei DM, Niv Y (2010) Context, learning, and extinction. Psychol Rev 117:197–209 Gharib A, Gade C, Roberts S (2004) Control of variation by reward probability. J Exp Psychol Anim Behav Process 30:271–282 Ghazizadeh A, Ambroggi F, Odean N, Fields HL (2012) Prefrontal cortex mediates extinction of responding by two distinct neural mechanisms in accumbens shell. J Neurosci 32:726–737 Gottfried JA, Dolan RJ (2004) Human orbitofrontal cortex mediates extinction learning while accessing conditioned representations of value. Nat Neurosci 7:1144–1152 Grow LL, Kelley ME, Roane HS, Shillingsburg MA (2008) Utility of extinction-induced response variability for the selection of mands. J Appl Behav Anal 41:15–24 Guilhardi P, Yi L, Church RM (2006) Effects of repeated acquisitions and extinctions on response rate and pattern. J Exp Psychol Anim Behav Process 32(3):322–328 Honey RC, Hall G (1989) Acquired equivalence and distinctiveness of cues. J Exp Psychol Anim Behav Process 15:338–346 Hyman SE (2005) Addiction: a disease of learning and memory. Am J Psychiatry 162:1414–1422 Jenkins HM (1961) The effect of discrimination training on extinction. J Exp Psychol 61:111–121 Kelley AE (2004) Memory and addiction: shared neural circuitry and molecular mechanisms. Neuron 44:161–179 Koenig S, Kadel H, Uengoer M, Schubö A, Lachnit H (2017a) Reward draws the eye, uncertainty holds the eye: associative learning modulates distractor interference in visual search. Front Behav Neurosci 11:128 Koenig S, Uengoer M, Lachnit H (2017b) Attentional bias for uncertain cues of shock in human fear conditioning: evidence for attentional learning theory. Front Hum Neurosci 11:266 Lachnit H (1986) Transswitching and contextual conditioning. Pavlov J Biol Sci 21:160–172 Larrauri JA, Schmajuk NA (2008) Attentional, associative, and configural mechanisms in extinction. Psychol Rev 115:640–676 Lattal MK, Lattal KA (2012) Facets of Pavlovian and operant extinction. Behav Process 90:1–8 Leitenberg H, Rawson RA, Bath K (1970) Reinforcement of competing behavior during extinction. Science 169:301–303 Lengersdorf D, Stüttgen MC, Uengoer M, Güntürkün O (2014) Transient inactivation of the pigeon hippocampus or the nidopallium caudolaterale during extinction learning impairs extinction retrieval in an appetitive conditioning paradigm. Behav Brain Res 265:93–100 Leslie JC, Shaw D, Gregg G, McCormick N, Reynolds DS, Dawson GR (2005) Effects of reinforcement schedule on facilitation of operant extinction by chlordiazepoxide. J Exp Anal Behav 84:327–338 Lissek S, Glaubitz B, Güntürkün O, Tegenthoff M (2015) Noradrenergic stimulation modulates activation of extinction-related brain regions and enhances contextual extinction learning without affecting renewal. Front Behav Neurosci 9:34 Livesey EJ, Don HJ, Uengoer M, Thorwart A (2019) Transfer of associability and relational structure in human associative learning. J Exp Psychol Anim Learn Cogn 45:125–142 Lucke S, Lachnit H, Koenig S, Uengoer M (2013) The informational value of contexts affects context-dependent learning. Learn Behav 41:285–297 Mackintosh NJ (1975) A theory of attention: Variations in the associability of stimuli with reinforcement. Psychol Rev 82:276–298 McClelland JL, Rumelhart DE (1985) Distributed memory and the representation of general and specific information. J Exp Psychol Gen 114:159–197 Méndez-Couz M, Becker JM, Manahan-Vaughan D (2019) Functional compartmentalization of the contribution of hippocampal subfields to context-dependent extinction learning. Front Behav Neurosci 13:256 Milad MR, Wright CI, Orr SP, Pitman RK, Quirk GJ, Rauch SL (2007) Recall of fear extinction in humans activates the ventromedial prefrontal cortex and hippocampus in concert. Biol Psychiatry 62:446–454 Morgan CL (1903) Other minds than ours. An Introduction to comparative psychology. Walter Scott Publishing, London, pp 36–59 Neuringer A, Kornell N, Olufs M (2001) Stability and variability in extinction. J Exp Psychol Anim Behav Process 27(1):79–94 Nevin JA (2012) Resistance to extinction and behavioral momentum. Behav Processes 90:89–97 Nieto J, Uengoer M, Bernal-Gamboa R (2017) A reminder of extinction reduces relapse in an animal model of voluntary behavior. Learn Mem 24:76–80 Nieto J, Mason TA, Bernal-Gamboa R, Uengoer M (2020) The impacts of acquisition and extinction cues on ABC renewal of voluntary behaviors. Learn Mem 27:114–118 Packheiser J, Güntürkün O, Pusch R (2019) Renewal of extinguished behavior in pigeons (Columba livia) does not require memory consolidation of acquisition or extinction in a free-operant appetitive conditioning paradigm. Behav Brain Res. https://doi.org/10.1016/j.bbr.2019.111947 Packheiser J, Donoso JR, Cheng S, Güntürkün O, Pusch R (2020a) Trial-by-trial dynamics of reward prediction error associated signals during extinction learning and renewal. Prog Neurobiol. https://doi.org/10.1016/j.pneurobio.2020.101901 Packheiser J, Pusch R, Stein CC, Güntürkün O, Lachnit H, Uengoer M (2020b) How competitive is cue competition? Q J Exp Psychol 73:104–114 Pearce JM, Hall G (1979) The influence of context-reinforcer associations on instrumental performance. Anim Learn Behav 7:504–508 Pearce JM, Hall G (1980) A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev 87:532–552 Podlesnik CA, Sanabria F (2011) Repeated extinction and reversal learning of an approach response supports an arousal-mediated learning model. Behav Processes 87:125–134 Podlesnik CA, Shahan TA (2009) Behavioral momentum and relapse of extinguished operant responding. Learn Behav 37:357–364 Podlesnik CA, Shahan TA (2010) Extinction, relapse, and behavioral momentum. Behav Processes 84:400–411 Podlesnik CA, Kelley ME, Jimenez-Gomez C, Bouton ME (2017) Renewed behavior produced by context change and its implications for treatment maintenance: a review. J Appl Behav Anal 50:675–697 Redish AD (2004) Addiction as a computational process gone awry. Science 306:1944–1947 Redish AD, Jensen S, Johnson A, Kurth-Nelson Z (2007) Reconciling reinforcement learning models with behavioral extinction and renewal: Implications for addiction, relapse, and problem gambling. Psychol Rev 114:784–805 Rescorla RA (1993) Inhibitory associations between S and R in extinction. Anim Learn Behav 21:327–336 Rescorla RA (1997) Response inhibition in extinction. Q J Exp Psychol Sect B 50:238–252 Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Black AH, Prokasy WF (eds) Classical conditioning ii: current research and theory. Appleton-Century-Crofts, New York, pp 64–99 Rose J, Otto T, Dittrich L (2008) The Biopsychology-toolbox: a free, open-source Matlab-toolbox for the control of behavioral experiments. J Neurosci Methods 175:104–107 Samson H, Chappell A, Czachowski C, Sharpe A (2001) Measuring ethanol-seeking behavior: the effect of using repeated extinction trials. Alcohol 24(3):205–209 Schmajuk NA, Moore JW (1985) Real-time attentional models for classical conditioning and the hippocampus. Physiol Psychol 13:278–290 Skinner BF (1938) The behavior of organisms: an experimental analysis. Appleton-Century, Oxford, England Starosta S, Stüttgen MC, Güntürkün O (2014) Recording single neurons’ action potentials from freely moving pigeons across three stages of learning. J vis Exp 88:51283 Stollhoff N, Menzel R, Eisenhardt D (2005) Spontaneous recovery from extinction depends on the reconsolidation of the acquisition memory in an appetitive learning paradigm in the honeybee (Apis mellifera). J Neurosci 25:4485–4492 Tinsley MR, Timberlake W, Sitomer M, Widman DR (2002) Conditioned inhibitory effects of discriminated Pavlovian training with food in rats depend on interactions of search modes, related repertoires, and response measures. Anim Learn Behav 30:217–227 Todd TP (2013) Mechanisms of renewal after the extinction of instrumental behavior. J Exp Psychol Anim Behav Process 39:193–207 Todd TP, Vurbic D, Bouton ME (2014) Mechanisms of renewal after the extinction of discriminated operant behavior. J Exp Psychol Anim Learn Cogn 40:355–368 Trask S, Bouton ME (2014) Contextual control of operant behavior: evidence for hierarchical associations in instrumental learning. Learn Behav 42:281–288 Trask S, Thrailkill EA, Bouton ME (2017) Occasion setting, inhibition, and the contextual control of extinction in Pavlovian and instrumental (operant) learning. Behav Processes 137:64–72 Tulving E, Thomson DM (1973) Encoding specificity and retrieval processes in episodic memory. Psychol Rev 80:352–373 Uengoer M, Lachnit H, Lotz A, Koenig S, Pearce JM (2013) Contextual control of attentional allocation in human discrimination learning. J Exp Psychol Anim Behav Process 39:56–66 Üngör M, Lachnit H (2006) Contextual control in discrimination reversal learning. J Exp Psychol Anim Behav Process 32:441–453 Winterbauer NE, Bouton ME (2010) Mechanisms of resurgence of an extinguished instrumental behavior. J Exp Psychol Anim Behav Process 36:343–353 Wirth S, Yanike M, Frank LM, Smith AC, Brown EN, Suzuki WA (2003) Single neurons in the monkey hippocampus and learning of new associations. Science 300:1578–1581 Zentall TR, Wasserman EA, Urcuioli PJ (2014) Associative concept learning in animals. J Exp Anal Behav 101:130–151