Peril, prudence and planning as risk, avoidance and worry

Abramson, 1978, Learned helplessness in humans: critique and reformulation, Journal of Abnormal Psychology, 87, 49, 10.1037/0021-843X.87.1.49 Agrawal, 2021, The temporal dynamics of opportunity costs: A normative account of cognitive fatigue and boredom, Psychological Review 2013 Arnaudova, 2017, Pathways towards the proliferation of avoidance in anxiety and implications for treatment, Behaviour Research and Therapy, 96, 3, 10.1016/j.brat.2017.04.004 Artzner, 1999, Coherent measures of risk, Mathematical Finance, 9, 203, 10.1111/1467-9965.00068 Artzner, 2007, Coherent multiperiod risk adjusted values and Bellman’s principle, Annals of Operations Research, 152, 5, 10.1007/s10479-006-0132-6 Bäuerle, 2011, Markov decision processes with average-value-at-risk criteria, Mathematical Methods of Operations Research, 74, 361, 10.1007/s00186-011-0367-0 Behar, 2009, Current theoretical models of generalized anxiety disorder (GAD): Conceptual review and treatment implications, Journal of Anxiety Disorders, 23, 1011, 10.1016/j.janxdis.2009.07.006 Bellman, 1952, On the theory of dynamic programming, Proceedings of the National Academy of Sciences of the United States of America, 38, 716, 10.1073/pnas.38.8.716 Berenbaum, 2010, An initiation–termination two-phase model of worrying, Clinical Psychology Review, 30, 962, 10.1016/j.cpr.2010.06.011 Berenbaum, 2007, The relation between worrying and concerns: The importance of perceived probability and cost, Behaviour Research and Therapy, 45, 301, 10.1016/j.brat.2006.03.009 Bertsekas, 1995 Birnbaum, 2008, New paradoxes of risky decision making, Psychological Review, 115, 463, 10.1037/0033-295X.115.2.463 Boda, 2006, Time consistent dynamic risk measures, Mathematical Methods of Operations Research, 63, 169, 10.1007/s00186-005-0045-1 Borkovec, 1983, Preliminary exploration of worry: Some characteristics and processes, Behaviour Research and Therapy, 21, 9, 10.1016/0005-7967(83)90121-3 Butler, 1983, Cognitive processes in anxiety, Advances in Behaviour Research and Therapy, 5, 51, 10.1016/0146-6402(83)90015-2 Calhoon, 2015, Resolving the neural circuits of anxiety, Nature Neuroscience, 18, 1394, 10.1038/nn.4101 Charpentier, 2017, Enhanced risk aversion, but not loss aversion, in unmedicated pathological anxiety, Biological Psychiatry, 81, 1014, 10.1016/j.biopsych.2016.12.010 Chen, 2016, Decision making under the gambler’s fallacy: Evidence from asylum judges, loan officers, and baseball umpires, Quarterly Journal of Economics, 131, 1181, 10.1093/qje/qjw017 Choi, 2007, Consistency and heterogeneity of individual behavior under uncertainty, American Economic Review, 97, 1921, 10.1257/aer.97.5.1921 Chow, 2017, Risk-constrained reinforcement learning with percentile risk criteria, Journal of Machine Learning Research, 18, 6070 Chow, 2015, Risk-sensitive and robust decision-making: a cvar optimization approach, 1522 Coraluppi, 1999, Risk-sensitive and minimax control of discrete-time, finite-state Markov decision processes, Automatica, 35, 301, 10.1016/S0005-1098(98)00153-8 Croson, 2005, The gambler’s fallacy and the hot hand: Empirical data from casinos, Journal of Risk and Uncertainty, 30, 195, 10.1007/s11166-005-1153-2 Dabney, 2018 Davey, 2016, The perseverative worry bout: A review of cognitive, affective and motivational factors that contribute to worry perseveration, Biological Psychology, 121, 233, 10.1016/j.biopsycho.2016.04.003 Daw, 2011, Model-based influences on humans’ choices and striatal prediction errors, Neuron, 69, 1204, 10.1016/j.neuron.2011.02.027 Dayan, 1993, Improving generalization for temporal difference learning: The successor representation, Neural Computation, 5, 613, 10.1162/neco.1993.5.4.613 Dayan, 2008, Serotonin, inhibition, and negative mood, PLoS Computational Biology, 4, 10.1371/journal.pcbi.0040004 Eldar, 2020, The roles of online and offline replay in planning, BioRxiv Fox, 2015, Decision under risk: From the field to the laboratory and back, The Wiley Blackwell Handbook of Judgment and Decision Making, 43 Gagne, 2021, Two steps to risk sensitivity, Advances in Neural Information Processing Systems Gallagher, 2014, Perceived control and vulnerability to anxiety disorders: A meta-analytic review, Cognitive Therapy and Research, 38, 571, 10.1007/s10608-014-9624-x Gillan, 2016, Characterizing a psychiatric symptom dimension related to deficits in goal-directed control, Elife, 5, 10.7554/eLife.11305 Hardy, 2004, The iterated CTE: A dynamic risk measure, North American Actuarial Journal, 8, 62, 10.1080/10920277.2004.10596171 Heger, M. (1994). Consideration of risk in reinforcement learning. In Machine learning proceedings, Vol. 1994 (pp. 105–111). Hirsch, 2012, A cognitive model of pathological worry, Behaviour Research and Therapy, 50, 636, 10.1016/j.brat.2012.06.007 Hirsch, 2013, Characteristics of worry in generalized anxiety disorder, Journal of Behavior Therapy and Experimental Psychiatry, 44, 388, 10.1016/j.jbtep.2013.03.004 Hofmann, 2018, Rethinking avoidance: Toward a balanced approach to avoidance in treating anxiety disorders, Journal of Anxiety Disorders, 55, 14, 10.1016/j.janxdis.2018.03.004 Huys, 2015, Decision-theoretic psychiatry, Clinical Psychological Science, 3, 400, 10.1177/2167702614562040 Iancu, 2015, Tight approximations of dynamic risk measures, Mathematics of Operations Research, 40, 655, 10.1287/moor.2014.0689 Imas, 2016, The realization effect: Risk-taking after realized versus paper losses, American Economic Review, 106, 2086, 10.1257/aer.20140386 Kahneman, 1979, Prospect theory: An analysis of decision under risk, Econometrica, 47, 263, 10.2307/1914185 Krokhmal, 2013, Modeling and optimization of risk, Handbook of the Fundamentals of Financial Decision Making: Part II, 555, 10.1142/9789814417358_0031 Laplace, 1796 Levin, 2003, Risk preferences in young children: Early evidence of individual differences in reaction to potential gains and losses, Journal of Behavioral Decision Making, 16, 397, 10.1002/bdm.453 Lichtenstein, 1978, Judged frequency of lethal events, Journal of Experimental Psychology: Human Learning and Memory, 4, 551 Lieder, 2018, Overrepresentation of extreme events in decision making reflects rational use of cognitive resources, Psychological Review, 125, 1, 10.1037/rev0000074 Liu, 2020, Experience replay supports non-local learning, BioRxiv MacLeod, 1996, Anxiety, depression, and the anticipation of future positive and negative experiences, Journal of Abnormal Psychology, 105, 286, 10.1037/0021-843X.105.2.286 Madan, 2014, Remembering the best and worst of times: Memories for extreme outcomes bias risky decisions, Psychonomic Bulletin & Review, 21, 629, 10.3758/s13423-013-0542-9 Majumdar, 2020, How should a robot assess risk? Towards an axiomatic theory of risk in robotics, 75 Mannor, 2011 Markowitz, 1952, Portfolio selection, The Journal of Finance, 7, 77 Mattar, 2018, Prioritized memory access explains planning and hippocampal replay, Nature Neuroscience, 21, 1609, 10.1038/s41593-018-0232-z Mihatsch, 2002, Risk-sensitive reinforcement learning, Machine Learning, 49, 267, 10.1023/A:1017940631555 Momennejad, 2018, Offline replay supports planning in human reinforcement learning, Elife, 7, 10.7554/eLife.32548 Moore, 1993, Prioritized sweeping: Reinforcement learning with less data and less time, Machine Learning, 13, 103, 10.1007/BF00993104 Muris, 2006, Anxiety, depression, and judgments about the probability of future negative and positive events in children, Journal of Anxiety Disorders, 20, 252, 10.1016/j.janxdis.2004.12.001 Pflug, 2016, Time-consistent decisions and temporal decomposition of coherent risk functionals, Mathematics of Operations Research, 41, 682, 10.1287/moor.2015.0747 Quiggin, 1982, A theory of anticipated utility, Journal of Economic Behaviour and Organization, 3, 323, 10.1016/0167-2681(82)90008-7 Raghunathan, 1999, All negative moods are not equal: Motivational influences of anxiety and sadness on decision making, Organizational Behavior and Human Decision Processes, 79, 56, 10.1006/obhd.1999.2838 Rockafellar, 2000, Optimization of conditional value-at-risk, Journal of Risk, 2, 21, 10.21314/JOR.2000.038 Roorda, 2007, Time consistency conditions for acceptability measures, with an application to tail value at risk, Insurance: Mathematics & Economics, 40, 209 Rudloff, 2014, Time consistency and risk averse dynamic decision models: Definition, interpretation and practical consequences, European Journal of Operational Research, 234, 743, 10.1016/j.ejor.2013.11.037 Ruszczyński, 2010, Risk-averse dynamic programming for Markov decision processes, Mathematical Programming, 125, 235, 10.1007/s10107-010-0393-3 Schur, 2019, Time-consistent, risk-averse dynamic pricing, European Journal of Operational Research, 277, 587, 10.1016/j.ejor.2019.02.038 Shapiro, 2009, On a time consistency concept in risk averse multistage stochastic programming, Operations Research Letters, 37, 143, 10.1016/j.orl.2009.02.005 Shapiro, 2014 Shapiro, 2020, Time inconsistency of optimal policies of distributionally robust inventory models, Operations Research, 68, 1576, 10.1287/opre.2019.1932 Stachenfeld, 2017, The hippocampus as a predictive map, Nature Neuroscience, 20, 1643, 10.1038/nn.4650 Stöber, 1997, Trait anxiety and pessimistic appraisal of risk and chance, Personality and Individual Differences, 22, 465, 10.1016/S0191-8869(96)00232-2 Symmonds, 2010, A behavioral and neural evaluation of prospective decision-making under risk, Journal of Neuroscience, 30, 14380, 10.1523/JNEUROSCI.1459-10.2010 Tallis, 1994 Tallis, 1994, Worry: Mechanisms and modulating influences, Behavioural and Cognitive Psychotherapy, 22, 37, 10.1017/S1352465800011796 Tamar, 2016, Sequential decision making with coherent risk, IEEE Transactions on Automatic Control, 62, 3323, 10.1109/TAC.2016.2644871 Tversky, 1992, Advances in prospect theory: Cumulative representation of uncertainty, Journal of Risk and Uncertainty, 5, 297, 10.1007/BF00122574 Van Seijen, 2013, Planning by prioritized sweeping with small backups, International Conference on Machine Learning, 361 von Neumann, 1947 Wang, 2000, A class of distortion operators for pricing financial and insurance risks, The Journal of Risk and Insurance, 15, 10.2307/253675 Watkins, 2008, Constructive and unconstructive repetitive thought, Psychological Bulletin, 134, 163, 10.1037/0033-2909.134.2.163 Wells, 1999, A metacognitive model and therapy for generalized anxiety disorder, Clinical Psychology & Psychotherapy: An International Journal of Theory & Practice, 6, 86, 10.1002/(SICI)1099-0879(199905)6:2<86::AID-CPP189>3.0.CO;2-S Wu, 2011, The affective impact of financial skewness on neural activity and choice, PLoS One, 6, 10.1371/journal.pone.0016838 Wu, 2017, Hippocampal awake replay in fear memory retrieval, Nature Neuroscience, 20, 571, 10.1038/nn.4507 Yaari, 1987, The dual theory of choice under risk, Econometrica, 95, 10.2307/1911158 Zorowitz, 2020, Anxiety, avoidance, and sequential evaluation, Computational Psychiatry, 4, 1, 10.1162/CPSY_a_00026