Automated and distributed statistical analysis of economic agent-based models

Agha, 2018, A survey of statistical model checking, ACM Trans. Model. Comp. Simul., 28, 6:1 Alexopoulos, 2004, To batch or not to batch?, ACM Transactions on Modeling and Computer Simulation (TOMACS), 14, 76, 10.1145/974734.974738 Alexopoulos, 1996, Implementing the batch means method in simulation experiments, 214 An, 2009, From artificial life to in silico medicine, 183 Austin, 2014, Multiple hypothesis testing: a review, J Indian Soc Agric Stat, 68, 303 Barde, 2016, Direct comparison of agent-based models of herding in financial markets, Journal of Economic Dynamics and Control, 73, 329, 10.1016/j.jedc.2016.10.005 ter Beek, 2020, A framework for quantitative modeling and analysis of highly (re) configurable systems, IEEE Trans. Software Eng., 46, 321, 10.1109/TSE.2018.2853726 ter Beek, 2015, Quantitative analysis of probabilistic models of software product lines with statistical model checking, 56 ter Beek, 2021, Quantitative security risk modeling and analysis with RisQFLan, Comput. Secur., 109, 102381, 10.1016/j.cose.2021.102381 Belzner, 2014, Reasoning (on) service component ensembles in rewriting logic, 188 Belzner, 2016, Onplan: A framework for simulation-based online planning, 1 Benjamini, 1995, Controlling the false discovery rate: a practical and powerful approach to multiple testing, Journal of the Royal statistical society: series B (Methodological), 57, 289 Benjamini, 1999, A step-down multiple hypotheses testing procedure that controls the false discovery rate under independence, J Stat Plan Inference, 82, 163, 10.1016/S0378-3758(99)00040-3 Benjamini, 2001, The control of the false discovery rate in multiple testing under dependency, Ann Stat, 1165 Beygelzimer, 2012, Learning performance of prediction markets with kelly bettors, arXiv preprint arXiv:1201.6655 Billingsley, 1995 Bortolussi, 2015, Machine learning methods in statistical model checking and system design - tutorial, 323 Bottazzi, 2017, Wealth and price distribution by diffusive approximation in a repeated prediction market, Physica A, 471, 473, 10.1016/j.physa.2016.12.012 Bottazzi, 2019, Betting, selection, and luck: a long-run analysis of repeated betting markets, Entropy, 21, 585, 10.3390/e21060585 Bottazzi, 2019, Far from the madding crowd: collective wisdom in prediction markets, Quantitative Finance, 19, 1461, 10.1080/14697688.2019.1622285 Brown, 2005, Path dependence and the validation of agent-based spatial models of land use, International Journal of Geographical Information Science, 19, 153, 10.1080/13658810410001713399 Caiani, 2016, Agent based-stock flow consistent macroeconomics: towards a benchmark model, Journal of Economic Dynamics and Control, 69, 375, 10.1016/j.jedc.2016.06.001 Caiani, 2019, Does inequality hamper innovation and growth? an ab-sfc analysis, Journal of Evolutionary Economics, 29, 177, 10.1007/s00191-018-0554-8 Carley, 2006, Biowar: scalable agent-based model of bioattacks, IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 36, 252, 10.1109/TSMCA.2005.851291 Carrella, 2021, No free lunch when estimating simulation parameters, Journal of Artificial Societies and Social Simulation, 24, 7, 10.18564/jasss.4572 Chow, 2002, A note on sample size calculation for mean comparisons based on noncentral t-statistics, J Biopharm Stat, 12, 441, 10.1081/BIP-120016229 Ciancia, 2016, A tool-chain for statistical spatio-temporal model checking of bike sharing systems, Vol. 9952, 657 Cincotti, 2010, Credit money and macroeconomic instability in the agent-based model and simulator eurace, Economics: The Open-Access, Open-Assessment E-Journal, 4, 10.5018/economics-ejournal.ja.2010-26 Cohen, 1992, A power primer, Psychol Bull, 112, 155, 10.1037/0033-2909.112.1.155 Conway, 1963, Some tactical problems in digital simulation, Manage Sci, 10, 47, 10.1287/mnsc.10.1.47 Corradini, 2021, A formal approach for the analysis of BPMN collaboration models, J. Syst. Softw., 180, 111007, 10.1016/j.jss.2021.111007 Dahlke, J., Bogner, K., Mueller, M., Berger, T., Pyka, A., Ebersberger, B., 2020. Is the juice worth the squeeze? machine learning (ML) in and for agent-based modelling (ABM). 2003.11985. Dawid, 2019, Macroeconomics with heterogeneous agent models: fostering transparency, reproducibility and replication, Journal of Evolutionary Economics, 29, 467, 10.1007/s00191-018-0594-0 Delli Gatti, 2005, A new approach to business fluctuations: heterogeneous interacting agents, scaling laws and financial fragility, Journal of Economic behavior & organization, 56, 489, 10.1016/j.jebo.2003.10.012 Delli Gatti, 2018 Delli Gatti, 2020, Rising to the challenge: bayesian estimation and forecasting techniques for macroeconomic agent based models, Journal of Economic Behavior & Organization, 178, 875, 10.1016/j.jebo.2020.07.023 Dosi, 2015, Fiscal and monetary policies in complex evolving economies, Journal of Economic Dynamics and Control, 52, 166, 10.1016/j.jedc.2014.11.014 Dosi, 2010, Schumpeter meeting keynes: a policy-friendly model of endogenous growth and business cycles, Journal of Economic Dynamics and Control, 34, 1748, 10.1016/j.jedc.2010.06.018 Dosi, 2019, More is different... and complex! the case for agent-based macroeconomics, Journal of Evolutionary Economics, 29, 1, 10.1007/s00191-019-00609-y Dosi, 2019, Endogenous growth and global divergence in a multi-country agent-based model, Journal of Economic Dynamics and Control, 101, 101, 10.1016/j.jedc.2019.02.005 Effken, 2012, Simulating nursing unit performance with orgahead: strengths and challenges, Computers, informatics, nursing: CIN, 30, 620, 10.1097/NXN.0b013e318261f1bb Fagiolo, 2020, Innovation, finance, and economic growth: an agent-based approach, Journal of Economic Interaction and Coordination, 15, 703, 10.1007/s11403-019-00258-1 Fagiolo, 2019, Validation of agent-based models in economics and finance, 763 Fagiolo, 2012, Macroeconomic policy in dsge and agent-based models, Revue de l’OFCE, 124, 67 Fagiolo, 2017, Macroeconomic policy in DSGE and agent-based models redux: new developments and challenges ahead, Journal of Artificial Societies and Social Simulation, 20, 10.18564/jasss.3280 Feller, W., 1957. An introduction to probability theory and its applications. Franke, 2012, Structural stochastic volatility in asset pricing dynamics: estimation and model contest, Journal of Economic Dynamics and Control, 36, 1193, 10.1016/j.jedc.2011.10.004 Friguet, 2009, A factor model approach to multiple testing under dependence, J Am Stat Assoc, 104, 1406, 10.1198/jasa.2009.tm08332 Galán, 2005, Appearances can be deceiving: lessons learned re-implementing Axelrod’s ’evolutionary approach to norms’, Journal of Artificial Societies and Social Simulation, 8, 2 Galpin, 2018, Statistical analysis of CARMA models: an advanced tutorial, 395 Gibbons, 1986, Nonparametric statistical inference, 2nd. ed. statistics: textbooks and monographs vol. 65. marcel dekker, inc., new york and basel 1985, xv, 408 s., $ 41,25 ($ 34,50 us and canada), Biometrical Journal, 28 Gilmore, 2017, Transient and steady-state statistical analysis for discrete event simulators, 145 Gilmore, 2014, An analysis pathway for the quantitative evaluation of public transport systems, 71 Godley, 2006 Gomes, 1999, Approximation by penultimate extreme value distributions, Extremes (Boston), 2, 71, 10.1023/A:1009920327187 Gray, 2009, Vol. 1 Grazzini, 2012, Analysis of the emergent properties: stationarity and ergodicity, Journal of Artificial Societies and Social Simulation, 15, 7, 10.18564/jasss.1929 Grazzini, 2015, Estimation of ergodic agent-based models by simulated minimum distance, Journal of Economic Dynamics and Control, 51, 148, 10.1016/j.jedc.2014.10.006 Grazzini, 2017, Bayesian estimation of agent-based models, Journal of Economic Dynamics and Control, 77, 26, 10.1016/j.jedc.2017.01.014 Grimm, 2013 Guerini, 2017, A method for agent-based models validation, Journal of Economic Dynamics and Control, 82, 125, 10.1016/j.jedc.2017.06.001 Ilachinski, 1997, Irreducible Semi-Autonomous Adaptive Combat (ISAAC): An Artificial-Life Approach to Land Warfare Kelton, 1984, An analytical evaluation of alternative strategies in steady-state simulation, Oper. Res., 32, 169, 10.1287/opre.32.1.169 Kets, 2014, Betting strategies, market selection, and the wisdom of crowds Kukacka, 2020, Do complexfinancial models really lead to complex dynamics? agent-based models and multifractality, Journal of Economic Dynamics and Control, 113, 103855, 10.1016/j.jedc.2020.103855 Kwiatkowski, 1992, Testing the null hypothesis of stationarity against the alternative of a unit root: how sure are we that economic time series have a unit root?, J Econom, 54, 159, 10.1016/0304-4076(92)90104-Y Lada, 2013, Ard: An automated replication-deletion method for simulation analysis, 802 Lamperti, 2018, Empirical validation of simulated models through the gsl-div: an illustrative application, Journal of Economic Interaction and Coordination, 13, 143, 10.1007/s11403-017-0206-3 Lamperti, 2018, An information theoretic criterion for empirical validation of simulation models, Econometrics and Statistics, 5, 83, 10.1016/j.ecosta.2017.01.006 Lamperti, 2019, The public costs of climate-induced financial instability, Nat Clim Chang, 9, 829, 10.1038/s41558-019-0607-5 Lamperti, 2018, Faraway, so close: coupled climate and economic dynamics in an agent-based integrated assessment model, Ecol. Econ., 150, 315, 10.1016/j.ecolecon.2018.03.023 Lamperti, 2020, Climate change and green transitions in an agent-based integrated assessment model, Technol Forecast Soc Change, 153, 119806, 10.1016/j.techfore.2019.119806 Lamperti, 2018, Agent-based model calibration using machine learning surrogates, Journal of Economic Dynamics and Control, 90, 366, 10.1016/j.jedc.2018.03.011 Law, 1979, A sequential procedure for determining the length of a steady-state simulation, Oper Res, 27, 1011, 10.1287/opre.27.5.1011 Law, 2015 L’Ecuyer, P., 2016. SSJ: Stochastic simulation in Java, software library. http://simul.iro.umontreal.ca/ssj/. L’Ecuyer, 2002, SSJ: a framework for stochastic simulation in Java, 234 Lee, 2015, The complexities of agent-based modeling output analysis, The journal of artificial societies and social simulation, 18, 10.18564/jasss.2897 Legay, 2019, Statistical Model Checking, Vol. 10000, 478 Legay, 2016, Rare events for statistical model checking an overview, 23 Lehr, 1992, Sixteen s-squared over d-squared: a relation for crude sample size estimates, Stat Med, 11, 1099, 10.1002/sim.4780110811 Lux, 2018, Empirical validation of agent-based models, Vol. 4, 437, 10.1016/bs.hescom.2018.02.003 Macy, 2002, From factors to actors: computational sociology and agent-based modeling, Annu Rev Sociol, 143, 10.1146/annurev.soc.28.110601.141117 Malerba, 1999, ’History-friendly’models of industry evolution: the computer industry, Industrial and corporate change, 8, 3, 10.1093/icc/8.1.3 Mandes, 2017, Complexity and model comparison in agent based modeling of financial markets, Journal of Economic Interaction and Coordination, 12, 469, 10.1007/s11403-016-0173-0 Mann, 1947, On a test of whether one of two random variables is stochastically larger than the other, The Annals of Mathematical Statistics, 18, 50, 10.1214/aoms/1177730491 von Neumann, 1941, Distribution of the ratio of the mean square successive difference to the variance, Ann. Math. Statist., 12, 367, 10.1214/aoms/1177731677 Pianini, 2014, Distributed statistical analysis of complex systems modeled through a chemical metaphor, 416 Poledna, S., Miess, M. G., Hommes, C. H., 2020. Economic forecasting with an agent-based model. Available at SSRN 3484768. Popoyan, 2020, Winter is possibly not coming: mitigating financial instability in an agent-based model with interbank market, Journal of Economic Dynamics and Control, 103937, 10.1016/j.jedc.2020.103937 Richiardi, 2006, A common protocol for agent-based social simulation, Journal of artificial societies and social simulation, 9 Richiardi, 2017, Jas-mine: a new platform for microsimulation and agent-based modelling, International Journal of Microsimulation, 10, 106, 10.34196/ijm.00151 Saltelli, 1999, A quantitative model-independent method for global sensitivity analysis of model output, Technometrics, 41, 39, 10.1080/00401706.1999.10485594 Sarkar, 2002, Some results on false discovery rate in stepwise multiple testing procedures, The Annals of Statistics, 30, 239, 10.1214/aos/1015362192 Sarkar, 1997, The simes method for multiple hypothesis testing with positively dependent test statistics, J Am Stat Assoc, 92, 1601, 10.1080/01621459.1997.10473682 Satterthwaite, 1946, An approximate distribution of estimates of variance components, Biometrics bulletin, 2, 110, 10.2307/3002019 Sebastio, 2013, MultiVeStA: statistical model checking for discrete event simulators, 310 Secchi, 2017, Controlling for false negatives in agent-based models: a review of power analysis in organizational research, Comput Math Organ Theory, 23, 94, 10.1007/s10588-016-9218-0 Sen, 2004, Statistical model checking of black-box probabilistic systems, 202 Seri, 2021, Asymptotic properties of the plug-in estimator of the discrete entropy under dependence, IEEE Trans. Inf. Theory, 10.1109/TIT.2021.3109307 Seri, 2021, Model calibration and validation via confidence sets, Econometrics and Statistics, 20, 62, 10.1016/j.ecosta.2020.01.001 Seri, 2017, How many times should one run a computational simulation?, 229 Steiger, 2005, Asap3: a batch means procedure for steady-state simulation analysis, ACM Transactions on Modeling and Computer Simulation (TOMACS), 15, 39, 10.1145/1044322.1044325 Steiger, 2001, Convergence properties of the batch means method for simulation output analysis, INFORMS J Comput, 13, 277, 10.1287/ijoc.13.4.277.9737 Stuart, 1994 Sun, 2009, Large-scale multiple testing under dependence, Journal of the Royal Statistical Society: Series B (Statistical Methodology), 71, 393, 10.1111/j.1467-9868.2008.00694.x Tafazzoli, 2011, Performance of skart: a skewness-and autoregression-adjusted batch means procedure for simulation analysis, INFORMS J Comput, 23, 297, 10.1287/ijoc.1100.0401 Tesfatsion, 2006 Thiele, 2012, RNETLOGO: An r package for running and exploring individual-based models implemented in NETLOGO, Methods Ecol. Evol., 3, 480, 10.1111/j.2041-210X.2011.00180.x Valente, 2008, Laboratory for simulation development: Lsd van der Hoog, 2019, Surrogate modelling in (and of) agent-based models: aprospectus, Computational Economics, 53, 1245, 10.1007/s10614-018-9802-0 Vandin, 2018, QFLan: A tool for the quantitative analysis of highly reconfigurable systems, 329 Wald, 1940, On a test whether two samples are from the same population, The Annals of Mathematical Statistics, 11, 147, 10.1214/aoms/1177731909 Welch, 1947, The generalization of student’s’ problem when several different population variances are involved, Biometrika, 34, 28, 10.2307/2332510 Welch, 1983, The statistical analysis of simulation results, The computer performance modeling handbook, 22, 268 Whitt, 1991, The efficiency of one long run versus independent replications in steady-state simulation, Manage Sci, 37, 645, 10.1287/mnsc.37.6.645 Wilensky, U., 1999. NetLogo. http://ccl.northwestern.edu/netlogo/. Center for Connected Learning and Computer-Based Modeling, Northwestern University, Evanston, IL. Windrum, 2007, Empirical validation of agent-based models: alternatives and prospects, Journal of Artificial Societies and Social Simulation, 10, 8 Winker, 2007, An objective function for simulation based inference on exchange rate data, Journal of Economic Interaction and Coordination, 2, 125, 10.1007/s11403-007-0020-4 Younes, 2005, Probabilistic verification for ǣblack-boxǥ systems, 253