A benchmarking framework for simulation-based optimization of environmental models

Adams, 1998, Artesian landfill liner system: optimization and numerical analysis, Journal of Water Resources Planning and Management, 124, 345, 10.1061/(ASCE)0733-9496(1998)124:6(345) Ali, 1997, A numerical comparison of some modified controlled random Search Algorithms, Journal of Global Optimization, 11, 377, 10.1023/A:1008236920512 Barr, 1995, Designing and reporting on computational experiments with heuristic methods, Journal of Heuristics, 1, 9, 10.1007/BF02430363 Bartelt-Hunt, 2005, Evaluation of granular activated carbon, shale and two organoclays for use as sorptive amendments in clay landfill liners, Journal of Geotechnical and Geoenvironmental Engineering, 131, 848, 10.1061/(ASCE)1090-0241(2005)131:7(848) Bartelt-Hunt, 2006, Optimal design of a compacted soil liner containing sorptive amendments, Journal of Environmental Engineering, 132, 769, 10.1061/(ASCE)0733-9372(2006)132:7(769) Baú, 2008, Optimal design of pump-and-treat systems under uncertain hydraulic conductivity and plume distribution, Journal of Contaminant Hydrology, 100, 30, 10.1016/j.jconhyd.2008.05.002 Bayer, 2004, Evolutionary algorithms for the optimization of advective control of contaminated aquifer zones, Water Resources Research, 40 Beielstein, 2002 Burn, 2001, Waste-load allocation using genetic algorithms, Journal of Water Resources Planning and Management, 127, 121, 10.1061/(ASCE)0733-9496(2001)127:2(121) Carroll, 2009, An unconfined groundwater model of the Death Valley Regional Flow System and a comparison to its confined predecessor, Journal of Hydrology, 373, 316, 10.1016/j.jhydrol.2009.05.006 Collette, 2003 Cools, 2011, Coupling a hydrological water quality model and an economic optimization model to set up a cost-effective emission reduction scenario for nitrogen, Environmental Modelling & Software, 26, 44, 10.1016/j.envsoft.2010.04.017 Deb, 2000, An efficient constraint handling method for genetic algorithms, Computer Methods in Applied Mechanics and Engineering, 186, 311, 10.1016/S0045-7825(99)00389-8 Draper, 2003, Economic-engineering optimization for California water management, Journal of Water Resources Planning and Management, 129, 155, 10.1061/(ASCE)0733-9496(2003)129:3(155) Duan, 1992, Effective and efficient global optimization for conceptual rainfall-runoff models, Water Resources Research, 28, 1015, 10.1029/91WR02985 Erickson, 2002, Multi-objective optimal design of groundwater remediation systems: application of the niched Pareto genetic algorithm (NPGA), Advances in Water Resources, 25, 51, 10.1016/S0309-1708(01)00020-3 Finsterle, 2011, Solving iTOUGH2 simulation and optimization problems using the PEST protocol, Environmental Modelling & Software, 26, 959, 10.1016/j.envsoft.2011.02.008 Finsterle, 2006, Demonstration of optimization techniques for groundwater plume remediation using iTOUGH2, Environmental Modelling & Software, 21, 665, 10.1016/j.envsoft.2004.11.012 Foose, 2002, Comparison of solute transport in three composite liners, Journal of Geotechnical and Geoenvironmental Engineering, 128, 391, 10.1061/(ASCE)1090-0241(2002)128:5(391) Fowler, 2008, Comparison of derivative-free optimization methods for groundwater supply and hydraulic capture community problems, Advances in Water Resources, 31, 743, 10.1016/j.advwatres.2008.01.010 Franz, 2008, Operational snow modeling: addressing the challenges of an energy balance model for National Weather Service forecasts, Journal of Hydrology, 360, 48, 10.1016/j.jhydrol.2008.07.013 Freeze, 1999, Convergence of stochastic optimization and decision analysis in the engineering design of aquifer remediation, Ground Water, 37, 934, 10.1111/j.1745-6584.1999.tb01193.x García, 2009, A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour: a case study on the CEC'2005 special session on real parameter optimization, Journal of Heuristics, 15, 617, 10.1007/s10732-008-9080-4 Gibbons, 1992 Gill, 2006, Multiobjective particle swarm optimization for parameter estimation in hydrology, Water Resources Research, 42, W07417, 10.1029/2005WR004528 Gitau, 2006, Watershed level best management practice selection and Placement in the Town Brook watershed, New York, Journal of the American Water Resources Association, 42, 1565, 10.1111/j.1752-1688.2006.tb06021.x Goodman, 1954, Kolmogorov–Smirnov test for psychological research, Psychologicul Bulletin, 51, 160, 10.1037/h0060275 Guan, 2004, Optimal design of groundwater remediation systems using fuzzy set theory, Water Resources Research, 40, W01518, 10.1029/2003WR002121 Gullick, 2001, Evaluation of shale and organoclays as sorbent additives for low-permeability soil containment barriers, Environmental Science & Technology, 35, 1523, 10.1021/es0015601 Hadka, D., Reed, P., in press. Diagnostic Assessment of Search Controls and Failure Modes in Many-Objective Evolutionary Optimization. Evolutionary Computation, doi:10.1162/EVCO_a_00053. Herrera, 2010 Hilton, 2000, Constraint handling for genetic algorithms in optimal remediation design, Journal of Water Resources Planning and Management, 126, 128, 10.1061/(ASCE)0733-9496(2000)126:3(128) Jia, 2006, Robust optimization for total maximum daily load allocations, Water Resources Research, 42, W02412, 10.1029/2005WR004079 Joslin, 2006, Opportunistic fitness evaluation in a genetic algorithm for civil engineering design optimization, 2904 Kalwij, 2006, Simulation/optimization modeling for robust pumping strategy design, Ground Water, 44, 574, 10.1111/j.1745-6584.2006.00176.x Kennedy, 1995 Lo, 1996, Optimization in thickness of a liner composed of claymax® and organo-clay, Water Science and Technology, 34, 421, 10.1016/S0273-1223(96)00774-3 Matott, 2010, NIGHTHAWK–A program for modeling saturated batch and column experiments incorporating equilibrium and kinetic biogeochemistry, Computers & Geosciences, 36, 253, 10.1016/j.cageo.2009.05.004 Matott, 2006, Application of heuristic optimization techniques and algorithm tuning to multi-layered sorptive barrier design, Environmental Science & Technology, 40, 6354, 10.1021/es052560+ Mayer, 2002, Optimal design for problems involving flow and transport phenomena in saturated subsurface systems, Advances in Water Resources, 25, 1233, 10.1016/S0309-1708(02)00054-4 Medellín-Azuara, 2007, The application of economic-engineering optimization for water management in Ensenada, Baja California, Mexico, Water Science & Technology, 55, 339, 10.2166/wst.2007.038 Moré, 2009, Benchmarking derivative-free optimization algorithms, SIAM Journal on Optimization, 20, 172, 10.1137/080724083 Muleta, 2005, Sensitivity and uncertainty analysis coupled with automatic calibration for a distributed watershed model, Journal of Hydrology, 306, 127, 10.1016/j.jhydrol.2004.09.005 Nicklow, 2010, State of the art for genetic algorithms and beyond in water resources planning and management, Journal of Water Resources Planning and Management, 136, 412, 10.1061/(ASCE)WR.1943-5452.0000053 Noether, 1963, Note on the kolmogorov statistic in the discrete case, Metrika, 7, 115, 10.1007/BF02613966 Painter, 2007, Comparison of factorial and scenario analysis methods for assessing uncertainty in the design of permeable reactive barriers, Ground Water Monitoring & Remediation, 27, 102, 10.1111/j.1745-6592.2007.00152.x Painter, 2005 Parno, 2009 Peña-Haro, 2011, Stochastic hydro-economic modeling for optimal management of agricultural groundwater nitrate pollution under hydraulic conductivity uncertainty, Environmental Modelling & Software, 26, 999, 10.1016/j.envsoft.2011.02.010 Rabideau, 2003 Rardin, 2001, Experimental evaluation of heuristic optimization algorithms: a tutorial, Journal of Heuristics, 7, 261, 10.1023/A:1011319115230 Razavi, 2010, Reducing the computational cost of automatic calibration through model preemption, Water Resources Research, 46, W11523, 10.1029/2009WR008957 Regis, 2007, Improved strategies for Radial basis function methods for global optimization, Journal of Global Optimization, 37, 113, 10.1007/s10898-006-9040-1 Rehana, 2009, An imprecise fuzzy risk approach for water quality management of a river system, Journal of Environmental Management, 90, 3653, 10.1016/j.jenvman.2009.07.007 Schaake, 2006, The model parameter estimation experiment (MOPEX), Journal of Hydrology, 320, 1, 10.1016/j.jhydrol.2005.07.054 Slaughter, 2001, Thirty-five years of research data collection at the Reynolds Creek experimental watershed, Idaho, United States, Water Resources Research, 37, 2819, 10.1029/2001WR000413 Taillard, 2008, Few statistical tests for proportions comparisons, European Journal of Operational Research, 185, 1336, 10.1016/j.ejor.2006.03.070 Tang, 2006, How effective and efficient are multiobjective evolutionary algorithms at hydrologic model calibration?, Hydrology and Earth System Sciences, 10, 289, 10.5194/hess-10-289-2006 Tang, 2007, Parallelization strategies for rapid and robust evolutionary multiobjective optimization in water resources applications, Advances in Water Resources, 30, 335, 10.1016/j.advwatres.2006.06.006 Tolson, 2007, Dynamically dimensioned search algorithm for computationally efficient watershed model calibration, Water Resources Research, 43 Tolson, 2009, Hybrid discrete dynamically dimensioned search (HD-DDS) algorithm for water distribution system design optimization, Water Resources Research, 45 Vasan, 2010, Optimization of water distribution network design using differential evolution, Journal of Water Resources Planning and Management, 136, 279, 10.1061/(ASCE)0733-9496(2010)136:2(279) Vrugt, 2003, Effective and efficient algorithm for multiobjective optimization of hydrologic models, Water Resources Research, 39, 1214, 10.1029/2002WR001746 Vrugt, 2005, Improved treatment of uncertainty in hydrologic modeling: combining the strengths of global optimization and data assimilation, Water Resources Research, 41, W01017, 10.1029/2004WR003059 Walsh, 1963, Bounded probability properties of Kolmogorov-Smirnov and similar statistics for discrete data, Annals of the Institute of Statistical Mathematics, 15, 153, 10.1007/BF02865912 Wang, 2008, Basin-wide cooperative water resources allocation, European Journal of Operational Research, 190, 798, 10.1016/j.ejor.2007.06.045 Weng, 2010, An integrated scenario-based multi-criteria decision support system for water resources management and planning – A case study in the Haihe River Basin, Expert Systems with Applications, 37, 8242, 10.1016/j.eswa.2010.05.061 Ximing, 2008, Implementation of holistic water resources-economic optimization models for river basin management – Reflective experiences, Environmental Modelling & Software, 23, 2, 10.1016/j.envsoft.2007.03.005 Yandamuri, 2006, Multiobjective optimal waste load allocation models for rivers using nondominated sorting genetic algorithm-II, Journal of Water Resources Planning and Management, 132, 133, 10.1061/(ASCE)0733-9496(2006)132:3(133) Yapo, 1998, Multi-objective global optimization for hydrologic models, Journal of Hydrology, 204, 83, 10.1016/S0022-1694(97)00107-8 Zhang, 2009, Evaluation of global optimization algorithms for parameter calibration of a computationally intensive hydrologic model, Hydrological Processes, 23, 430, 10.1002/hyp.7152