Sex differences in reward- and punishment-guided actions
Tóm tắt
Differences in the prevalence and presentation of psychiatric illnesses in men and women suggest that neurobiological sex differences confer vulnerability or resilience in these disorders. Rodent behavioral models are critical for understanding the mechanisms of these differences. Reward processing and punishment avoidance are fundamental dimensions of the symptoms of psychiatric disorders. Here we explored sex differences along these dimensions using multiple and distinct behavioral paradigms. We found no sex difference in reward-guided associative learning but a faster punishment-avoidance learning in females. After learning, females were more sensitive than males to probabilistic punishment but less sensitive when punishment could be avoided with certainty. No sex differences were found in reward-guided cognitive flexibility. Thus, sex differences in goal-directed behaviors emerged selectively when there was an aversive context. These differences were critically sensitive to whether the punishment was certain or unpredictable. Our findings with these new paradigms provide conceptual and practical tools for investigating brain mechanisms that account for sex differences in susceptibility to anxiety and impulsivity. They may also provide insight for understanding the evolution of sex-specific optimal behavioral strategies in dynamic environments.
Tài liệu tham khảo
Abuse, S. (2013). Mental Health Services Administration,(SAMHSA), 2013 Results from the 2012 National Survey on Drug Use and Health: Summary of National Findings, NSDUH Series H-46, HHS Publication No.(SMA) 13-4795. Substance Abuse and Mental Health Services Administration, Rockville.
Andrews, N., & File, S. E. (1993). Handling history of rats modifies behavioural effects of drugs in the elevated plus-maze test of anxiety. Eur J Pharmacol, 235(1), 109-112.
Bangasser, D. A., & Valentino, R. J. (2014). Sex differences in stress-related psychiatric disorders: neurobiological perspectives. Front Neuroendocrinol, 35(3), 303-319. doi:https://doi.org/10.1016/j.yfrne.2014.03.008
Becker, J. B., McClellan, M. L., & Reed, B. G. (2017). Sex differences, gender and addiction. J Neurosci Res, 95(1-2), 136-147. doi:https://doi.org/10.1002/jnr.23963
Cahill, L., Haier, R. J., White, N. S., Fallon, J., Kilpatrick, L., Lawrence, C., … Alkire, M. T. (2001). Sex-related difference in amygdala activity during emotionally influenced memory storage. Neurobiol Learn Mem, 75(1), 1-9. doi:https://doi.org/10.1006/nlme.2000.3999
Cornwell, B. R., Garrido, M. I., Overstreet, C., Pine, D. S., & Grillon, C. (2017). The Unpredictive Brain Under Threat: A Neurocomputational Account of Anxious Hypervigilance. Biol Psychiatry, 82(6), 447-454. doi:https://doi.org/10.1016/j.biopsych.2017.06.031
Cyranowski, J. M., Frank, E., Young, E., & Shear, M. K. (2000). Adolescent onset of the gender difference in lifetime rates of major depression: a theoretical model. Arch Gen Psychiatry, 57(1), 21-27.
Dalla, C., & Shors, T. J. (2009). Sex differences in learning processes of classical and operant conditioning. Physiol Behav, 97(2), 229-238. doi:https://doi.org/10.1016/j.physbeh.2009.02.035
Day, H. L. L., Reed, M. M., & Stevenson, C. W. (2016). Sex differences in discriminating between cues predicting threat and safety. Neurobiol Learn Mem, 133, 196-203. doi:https://doi.org/10.1016/j.nlm.2016.07.014
Denti, A., & Epstein, A. (1972). Sex differences in the acquisition of two kinds of avoidance behavior in rats. Physiol Behav, 8(4), 611-615.
Dombrovski, A. Y., Szanto, K., Clark, L., Reynolds, C. F., & Siegle, G. J. (2013). Reward signals, attempted suicide, and impulsivity in late-life depression. JAMA Psychiatry, 70(10), 1. doi:https://doi.org/10.1001/jamapsychiatry.2013.75
Fernandes, C., M. I. Gonzalez, C. A. Wilson, and Sandra E. File. (1999). Factor analysis shows that female rat behaviour is characterized primarily by activity, male rats are driven by sex and anxiety. Pharmacology Biochemistry and Behavior 64(4) (1999): 731-736.
Floresco, S. B., Block, A. E., & Tse, M. T. (2008). Inactivation of the medial prefrontal cortex of the rat impairs strategy set-shifting, but not reversal learning, using a novel, automated procedure. Behav Brain Res, 190(1), 85-96. doi:https://doi.org/10.1016/j.bbr.2008.02.008
Grissom, N. M., & Reyes, T. M. (2018). Let’s call the whole thing off: evaluating gender and sex differences in executive function. Neuropsychopharmacology, 1.
Gruene, T. M., Flick, K., Stefano, A., Shea, S. D., & Shansky, R. M. (2015). Sexually divergent expression of active and passive conditioned fear responses in rats. Elife, 4. doi:https://doi.org/10.7554/eLife.11352
Hogg, S. (1996). A review of the validity and variability of the elevated plus-maze as an animal model of anxiety. Pharmacol Biochem Behav, 54(1), 21-30.
Juckel, G. (2016). Inhibition of the reward system by antipsychotic treatment. Dialogues Clin Neurosci, 18(1), 109-114.
Kirsch, P., Ronshausen, S., Mier, D., & Gallhofer, B. (2007). The influence of antipsychotic treatment on brain reward system reactivity in schizophrenia patients. Pharmacopsychiatry, 40(5), 196-198. doi:https://doi.org/10.1055/s-2007-984463
Kumar, P., Goer, F., Murray, L., Dillon, D. G., Beltzer, M. L., Cohen, A. L., … Pizzagalli, D. A. (2018). Impaired reward prediction error encoding and striatal-midbrain connectivity in depression. Neuropsychopharmacology, 43(7), 1581-1588. doi:https://doi.org/10.1038/s41386-018-0032-x
Martin, L. A., Neighbors, H. W., & Griffith, D. M. (2013). The experience of symptoms of depression in men vs women: analysis of the National Comorbidity Survey Replication. JAMA Psychiatry, 70(10), 1100-1106. doi:https://doi.org/10.1001/jamapsychiatry.2013.1985
Martin, L. J., Acland, E. L., Cho, C., Gandhi, W., Chen, D., Corley, E., … Mogil, J. S. (2019). Male-Specific Conditioned Pain Hypersensitivity in Mice and Humans. Curr Biol, 29(2), 192-201.e194. doi:https://doi.org/10.1016/j.cub.2018.11.030
McCabe, C., Woffindale, C., Harmer, C. J., & Cowen, P. J. (2012). Neural processing of reward and punishment in young people at increased familial risk of depression. Biol Psychiatry, 72(7), 588-594. doi:https://doi.org/10.1016/j.biopsych.2012.04.034
McEwen, B. S. (2014). Sex, stress and the brain: interactive actions of hormones on the developing and adult brain. Climacteric, 17 Suppl 2, 18-25. doi:https://doi.org/10.3109/13697137.2014.949662
Orsini, C. A., & Setlow, B. (2017). Sex differences in animal models of decision making. Journal of neuroscience research, 95(1-2), 260-269.
Orsini, C. A., Willis, M. L., Gilbert, R. J., Bizon, J. L., & Setlow, B. (2016). Sex differences in a rat model of risky decision making. Behav Neurosci, 130(1), 50-61. doi:https://doi.org/10.1037/bne0000111
Park, J., & Moghaddam, B. (2017). Risk of punishment influences discrete and coordinated encoding of reward-guided actions by prefrontal cortex and VTA neurons. Elife, 6. doi:https://doi.org/10.7554/eLife.30056
Pellman, B. A., Schuessler, B. P., Tellakat, M., & Kim, J. J. (2017). Sexually Dimorphic Risk Mitigation Strategies in Rats. eNeuro, 4(1). doi:https://doi.org/10.1523/ENEURO.0288-16.2017
Pellow, S., Chopin, P., File, S. E., & Briley, M. (1985). Validation of open:closed arm entries in an elevated plus-maze as a measure of anxiety in the rat. J Neurosci Methods, 14(3), 149-167.
Perrot-Sinal, T. S., Kostenuik, M. A., Ossenkopp, K. P., & Kavaliers, M. (1996). Sex differences in performance in the Morris water maze and the effects of initial nonstationary hidden platform training. Behav Neurosci, 110(6), 1309-1320.
Perry, J. L., & Carroll, M. E. (2008). The role of impulsive behavior in drug abuse. Psychopharmacology (Berl), 200(1), 1-26. doi:https://doi.org/10.1007/s00213-008-1173-0
Pizzagalli, D. A., Holmes, A. J., Dillon, D. G., Goetz, E. L., Birk, J. L., Bogdan, R., … Fava, M. (2009). Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder. Am J Psychiatry, 166(6), 702-710. doi:https://doi.org/10.1176/appi.ajp.2008.08081201
Roof, R. L., & Stein, D. G. (1999). Gender differences in Morris water maze performance depend on task parameters. Physiol Behav, 68(1-2), 81-86.
Rowland, A. S., Lesesne, C. A., & Abramowitz, A. J. (2002). The epidemiology of attention-deficit/hyperactivity disorder (ADHD): a public health view. Ment Retard Dev Disabil Res Rev, 8(3), 162-170. doi:https://doi.org/10.1002/mrdd.10036
Scheres, A., Milham, M. P., Knutson, B., & Castellanos, F. X. (2007). Ventral striatal hyporesponsiveness during reward anticipation in attention-deficit/hyperactivity disorder. Biol Psychiatry, 61(5), 720-724. doi:https://doi.org/10.1016/j.biopsych.2006.04.042
Schlagenhauf, F., Juckel, G., Koslowski, M., Kahnt, T., Knutson, B., Dembler, T., … Heinz, A. (2008). Reward system activation in schizophrenic patients switched from typical neuroleptics to olanzapine. Psychopharmacology (Berl), 196(4), 673-684. doi:https://doi.org/10.1007/s00213-007-1016-4
Schulz, K. M., Andrud, K. M., Burke, M. B., Pearson, J. N., Kreisler, A. D., Stevens, K. E., … Adams, C. E. (2013). The effects of prenatal stress on alpha4 beta2 and alpha7 hippocampal nicotinic acetylcholine receptor levels in adult offspring. Dev Neurobiol, 73(11), 806-814. doi:https://doi.org/10.1002/dneu.22097
Schulz, K. M., Pearson, J. N., Gasparrini, M. E., Brooks, K. F., Drake-Frazier, C., Zajkowski, M. E., … Stevens, K. E. (2014). Dietary choline supplementation to dams during pregnancy and lactation mitigates the effects of in utero stress exposure on adult anxiety-related behaviors. Behav Brain Res, 268, 104-110. doi:https://doi.org/10.1016/j.bbr.2014.03.031
Sheynin, J., Beck, K. D., Pang, K. C., Servatius, R. J., Shikari, S., Ostovich, J., & Myers, C. E. (2014). Behaviourally inhibited temperament and female sex, two vulnerability factors for anxiety disorders, facilitate conditioned avoidance (also) in humans. Behav Processes, 103, 228-235. doi:https://doi.org/10.1016/j.beproc.2014.01.003
Shors, T. J., Chua, C., & Falduto, J. (2001). Sex differences and opposite effects of stress on dendritic spine density in the male versus female hippocampus. J Neurosci, 21(16), 6292-6297.
Shors, T. J., Seib, T. B., Levine, S., & Thompson, R. F. (1989). Inescapable versus escapable shock modulates long-term potentiation in the rat hippocampus. Science, 244(4901), 224-226.
Söderpalm, B., & Engel, J. A. (1988). Biphasic effects of clonidine on conflict behavior: involvement of different alpha–adrenoceptors. Pharmacology Biochemistry and Behavior, 30(2), 471–477. doi:https://doi.org/10.1016/0091-3057(88)90482-0
Strohle, A., Stoy, M., Wrase, J., Schwarzer, S., Schlagenhauf, F., Huss, M., … Heinz, A. (2008). Reward anticipation and outcomes in adult males with attention-deficit/hyperactivity disorder. Neuroimage, 39(3), 966-972. doi:https://doi.org/10.1016/j.neuroimage.2007.09.044
Voulo, M. E., & Parsons, R. G. (2017). Response-specific sex difference in the retention of fear extinction. Learn Mem, 24(6), 245-251. doi:https://doi.org/10.1101/lm.045641.117
Wallin, K. G., & Wood, R. I. (2015). Anabolic-androgenic steroids impair set-shifting and reversal learning in male rats. Eur Neuropsychopharmacol, 25(4), 583-590. doi:https://doi.org/10.1016/j.euroneuro.2015.01.002
Weafer, J., De Arcangelis, J., & de Wit, H. (2015). Sex differences in behavioral impulsivity in at-risk and non-risk drinkers. Front Psychiatry, 6, 72. doi:https://doi.org/10.3389/fpsyt.2015.00072
Weafer, J., & de Wit, H. (2014). Sex differences in impulsive action and impulsive choice. Addict Behav, 39(11), 1573-1579. doi:https://doi.org/10.1016/j.addbeh.2013.10.033
Weinberg, M. S., Grissom, N., Paul, E., Bhatnagar, S., Maier, S. F., & Spencer, R. L. (2010). Inescapable but not escapable stress leads to increased struggling behavior and basolateral amygdala c-fos gene expression in response to subsequent novel stress challenge. Neuroscience, 170(1), 138-148. doi:https://doi.org/10.1016/j.neuroscience.2010.06.052