Comparison of synchronous and asynchronous parallelization of extreme surrogate-assisted multi-objective evolutionary algorithm

Akinsolu MO, Liu B, Grout V, Lazaridis PI, Mognaschi ME, Barba PD (2019) A parallel surrogate model assisted evolutionary algorithm for electromagnetic design optimization. IEEE Trans Emerg Top Comput Intell 3(2):93–105

Alba E, Tomassini M (2002) Parallelism and evolutionary algorithms. IEEE Trans Evol Comput 6(5):443–462. https://doi.org/10.1109/TEVC.2002.800880

Alba E, Luque G, Nesmachnow S (2013) Parallel metaheuristics: recent advances and new trends. Int Trans Oper Res 20(1):1–48. https://doi.org/10.1111/j.1475-3995.2012.00862.x

Barbera P, Kozlov AM, Czech L, Morel B, Darriba D, Flouri T, Stamatakis A (2018) EPA-ng: massively parallel evolutionary placement of genetic sequences. Syst Biol 68(2):365–369. https://doi.org/10.1093/sysbio/syy054

Cheng R, Jin Y, Olhofer M, Sendhoff B (2016) A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 20(5):773–791. https://doi.org/10.1109/TEVC.2016.2519378

Das S, Suganthan PN (2011) Differential evolution: A survey of the state-of-the-art. IEEE Trans Evol Comput 15(1):4–31. https://doi.org/10.1109/TEVC.2010.2059031

Davis JBA, Shayeghi A, Horswell SL, Johnston RL (2015) The Birmingham parallel genetic algorithm and its application to the direct dft global optimisation of irn (n = 10–20) clusters. Nanoscale 7:14032–14038. https://doi.org/10.1039/C5NR03774C

Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, New York

Deb K, Goyal M (1996) A combined genetic adaptive search (GeneAS) for engineering design. Comput Sci Inform 26:30–45

Deb K, Thiele L, Laumanns M, Zitzler E (2002) Scalable multi-objective optimization test problems. In: Proceedings of the 2002 congress on evolutionary computation. CEC’02 (Cat. No.02TH8600), 1:825–830 vol.1, https://doi.org/10.1109/CEC.2002.1007032

Devos O, Downey G, Duponchel L (2014) Simultaneous data pre-processing and svm classification model selection based on a parallel genetic algorithm applied to spectroscopic data of olive oils. Food Chem 148:124–130. https://doi.org/10.1016/j.foodchem.2013.10.020

Fan Z, Li W, Cai X, Huang H, Fang Y, You Y, Mo J, Wei C, Goodman E (2019) An improved epsilon constraint-handling method in moea/d for cmops with large infeasible regions. Soft Comput 23(23):12491–12510. https://doi.org/10.1007/s00500-019-03794-x

Habib A, Singh HK, Chugh T, Ray T, Miettinen K (2019) A multiple surrogate assisted decomposition-based evolutionary algorithm for expensive multi/many-objective optimization. IEEE Trans Evol Comput 23(6):1000–1014. https://doi.org/10.1109/TEVC.2019.2899030

Haftka RT, Villanueva D, Chaudhuri A (2016) Parallel surrogate-assisted global optimization with expensive functions—a survey. Struct Multidiscip Optim 54(1):3–13. https://doi.org/10.1007/s00158-016-1432-3

Harada T, Takadama K (2013) Asynchronous evaluation based genetic programming: comparison of asynchronous and synchronous evaluation and its analysis. In: Krawiec K, Moraglio A, Hu T, Etaner-Uyar A, Hu B (eds) Genetic programming, vol 7831. Lecture notes in computer science. Springer, Berlin, pp 241–252. https://doi.org/10.1007/978-3-642-37207-0_21

Harada T, Takadama K (2014) Asynchronously evolving solutions with excessively different evaluation time by reference-based evaluation. In: Proceedings of the 2014 annual conference on genetic and evolutionary computation, ACM, New York, USA, GECCO ’14, pp 911–918, https://doi.org/10.1145/2576768.2598330

Huang GB (2015) What are extreme learning machines? filling the gap between frank Rosenblatt’s dream and John von Neumann’s puzzle. Cogn Comput 7(3):263–278

Huang GB, Zhu QY, Siew CK (2004) Extreme learning machine: a new learning scheme of feedforward neural networks. In: 2004 IEEE International joint conference on neural networks (IEEE Cat. No.04CH37541), vol 2, pp 985–990 vol.2, https://doi.org/10.1109/IJCNN.2004.1380068

Huband S, Barone L, While L, Hingston P (2005) A scalable multi-objective test problem toolkit. In: Coello Coello CA, Hernández Aguirre A, Zitzler E (eds) Evolutionary multi-criterion optimization. Springer, Berlin, pp 280–295

Jin Y (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evolut Comput 1(2):61–70. https://doi.org/10.1016/j.swevo.2011.05.001

Knowles J (2006) ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Trans Evol Comput 10(1):50–66. https://doi.org/10.1109/TEVC.2005.851274

Li H, Zhang Q (2009) Multiobjective optimization problems with complicated pareto sets, MOEA/D and NSGA-II. IEEE Trans Evol Comput 13(2):284–302. https://doi.org/10.1109/TEVC.2008.925798

Liu B, Akinsolu MO, Ali N, Abd-Alhameed R (2019) Efficient global optimisation of microwave antennas based on a parallel surrogate model-assisted evolutionary algorithm. IET Microw Antennas Propag 13(2):149–155

Loshchilov I, Glasmachers T (2015) Black box optimization competition. https://www.ini.rub.de/PEOPLE/glasmtbl/projects/bbcomp/index.html, Online

McKay MD, Beckman RJ, Conover WJ (1979) A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21(2):239–245

Nebro AJ, Durillo JJ, Vergne M (2015) Redesigning the jmetal multi-objective optimization framework. In: Proceedings of the companion publication of the 2015 annual conference on genetic and evolutionary computation, Association for computing machinery, New York, NY, USA, GECCO Companion ’15, p 1093–1100, https://doi.org/10.1145/2739482.2768462

Obayashi S, Jeong S, Shimoyama K, Chiba K, Morino H (2010) Multi-objective design exploration and its applications. Int J Aeronaut Space Sci 4(4):247–265. https://doi.org/10.5139/IJASS.2010.11.4.247

Oyama A, Kohira T, Kemmotsu H, Tatsukawa T, Watanabe T (2017) Simultaneous structure design optimization of multiple car models using the k computer. In: 2017 IEEE symposium series on computational intelligence (SSCI), pp 1–4, https://doi.org/10.1109/SSCI.2017.8285350

Pavelski LM, Delgado MR, Almeida CP, Gonçalves RA, Venske SM (2014) ELMOEA/D-DE: Extreme learning surrogate models in multi-objective optimization based on decomposition and differential evolution. In: 2014 Brazilian conference on intelligent systems, pp 318–323, https://doi.org/10.1109/BRACIS.2014.64

Pavelski LM, Delgado MR, Almeida CP, Gonçalves RA, Venske SM (2016) Extreme learning surrogate models in multi-objective optimization based on decomposition. Neurocomputing 180:55–67. https://doi.org/10.1016/j.neucom.2015.09.111

Roberge V, Tarbouchi M, Okou F (2014) Strategies to accelerate harmonic minimization in multilevel inverters using a parallel genetic algorithm on graphical processing unit. IEEE Trans Power Electron 29(10):5087–5090. https://doi.org/10.1109/TPEL.2014.2311737

Scott EO, De Jong KA (2015a) Evaluation-time bias in asynchronous evolutionary algorithms. In: Proceedings of the companion publication of the 2015 annual conference on genetic and evolutionary computation, ACM, New York, NY, USA, GECCO Companion ’15, pp 1209–1212, https://doi.org/10.1145/2739482.2768482

Scott EO, De Jong KA (2015b) Understanding simple asynchronous evolutionary algorithms. In: Proceedings of the 2015 ACM conference on foundations of genetic algorithms XIII, ACM, New York, NY, USA, FOGA ’15, pp 85–98, https://doi.org/10.1145/2725494.2725509

Shayeghi A, Gotz D, Davis JBA, Schafer R, Johnston RL (2015) Pool-bcga: a parallelised generation-free genetic algorithm for the ab initio global optimisation of nanoalloy clusters. Phys Chem Chem Phys 17:2104–2112. https://doi.org/10.1039/C4CP04323E

Soufan O, Kleftogiannis D, Kalnis P, Bajic VB (2015) Dwfs: a wrapper feature selection tool based on a parallel genetic algorithm. PLoS ONE 10(2):1–23. https://doi.org/10.1371/journal.pone.0117988

Storn R, Price K (1997) Differential evolution—a simple and efficient Heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359. https://doi.org/10.1023/A:1008202821328

Strofylas G, Porfyri K, Nikolos I, Delis A, Papageorgiou M (2018) Using synchronous and asynchronous parallel differential evolution for calibrating a second-order traffic flow model. Adv Eng Softw 125:1–18. https://doi.org/10.1016/j.advengsoft.2018.08.011

Talbi EG (2019) A unified view of parallel multi-objective evolutionary algorithms. J Parallel Distrib Comput 133:349–358. https://doi.org/10.1016/j.jpdc.2018.04.012

Wang J, Clark SC, Liu E, Frazier PI (2016) Parallel Bayesian global optimization of expensive functions. arXiv:1602.05149

Zapotecas Martínez S, Coello Coello CA (2013) MOEA/D assisted by RBF networks for expensive multi-objective optimization problems. In: Proceedings of the 15th annual conference on genetic and evolutionary computation, ACM, New York, NY, USA, GECCO ’13, pp 1405–1412, https://doi.org/10.1145/2463372.2465805

Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712–731. https://doi.org/10.1109/TEVC.2007.892759

Zitzler E, Thiele L (1998) Multiobjective optimization using evolutionary algorithms—a comparative case study. In: Eiben AE, Bäck T, Schoenauer M, Schwefel HP (eds) Parallel problem solving from nature—PPSN V. Springer, Berlin, pp 292–301

Zitzler E, Deb K, Thiele L (2000) Comparison of multiobjective evolutionary algorithms: empirical results. Evol Comput 8(2):173–195

Zăvoianu AC, Lughofer E, Koppelstätter W, Weidenholzer G, Amrhein W, Klement EP (2015) Performance comparison of generational and steady-state asynchronous multi-objective evolutionary algorithms for computationally-intensive problems. Knowl-Based Syst 87(C):47–60. https://doi.org/10.1016/j.knosys.2015.05.029