A decomposition-based evolutionary algorithm for scalable multi/many-objective optimization

Memetic Computing - Tập 13 - Trang 413-432 - 2021
Jiaxin Chen1, Jinliang Ding1, Kay Chen Tan2, Qingda Chen1
1State Key Laboratory of Synthetical Automation for Process Industries, Northeastern University, Shenyang, China
2Department of Computing, Hong Kong Polytechnic University, Hong Kong, China

Tóm tắt

The aim of evolutionary multi/many-objective optimization is to obtain a set of Pareto-optimal solutions with good trade-off among the multiple conflicting objectives. However, the convergence and diversity of multiobjective evolutionary algorithms often seriously decrease with the number of objectives and decision variables increasing. In this paper, we present a decomposition-based evolutionary algorithm for solving scalable multi/many-objective problems. The key features of the algorithm include the following three aspects: (1) a resource allocation strategy to coordinate the utility value of subproblems for good coverage; (2) a multioperator and multiparameter strategy to improve adaptability and diversity of the population; and (3) a bidirectional local search strategy to prevent the decrease in exploration capability during the early stage and increase the exploitation capability during the later stage of the search process. The performance of the proposed algorithm is benchmarked extensively on a set of scalable multi/many-objective optimization problems. The statistical comparisons with seven state-of-the-art algorithms verify the efficacy and potential of the proposed algorithm for scalable multi/many-objective problems.

Tài liệu tham khảo

Ponsich A, Jaimes AL, Coello CAC (2012) A survey on multiobjective evolutionary algorithms for the solution of the portfolio optimization problem and other finance and economics applications. IEEE Trans Evol Comput 17(3):321–344 Mardle S, Miettinen K (1999) Nonlinear multiobjective optimization. J Oper Res Soc 51(2):246 Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197 Cheng R, Jin Y, Narukawa K, Sendhoff B (2015) A multiobjective evolutionary algorithm using gaussian process-based inverse modeling. IEEE Trans Evol Comput 19(6):1–1 Zitzler E, Laumanns M, Thiele L (2001) SPEA2: improving the strength Pareto evolutionary algorithm for multiobjective optimization. Evolutionary methods for design. In: Optimization and control with applications to industrial problems, Athens, pp 95–100 Zhang Q, Li H (2008) MOEA/D: A multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712–731 Bader J, Zitzler E (2011) HypE: An algorithm for fast hypervolume-based many-objective optimization. Evol Comput 19(1):45–76 Beume N, Naujoks B, Emmerich M (2007) SMS-EMOA: multiobjective selection based on dominated hypervolume. Eur J Oper Res 181(3):1653–1669 Zitzler E, Thiele L (1999) Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach. IEEE Trans Evol Comput 3(4):257–271 Zitzler E, Thiele L, Laumanns M, Fonseca CM, da Fonseca VG (2003) Performance assessment of multiobjective optimizers: an analysis and review. IEEE Trans Evol Comput 7(2):117–132 Brockhoff D, Wagner T, Trautmann H (2015) R2 indicator-based multiobjective search. Evol Comput 23(3):369–395 Murata T (2001) Specification of genetic search directions in cellular multi-objective genetic algorithm. Evol Multi Criter Opt EMO 1993:82–95 Sato H (2015) Analysis of inverted PBI and comparison with other scalarizing functions in decomposition based MOEAs. J Heuristics 21(6):819–849 Yang S, Jiang S, Jiang Y (2017) Improving the multiobjective evolutionary algorithm based on decomposition with new penalty schemes. Soft Comput 21(16):4677–4691 Ma X, Zhang Q, Yang J, Zhu Z (2017) On Tchebycheff decomposition approaches for multi-objective evolutionary optimization. IEEE Trans Evol Comput 22(2):226–224 Das I, Dennis J (1998) Normal-boundary intersection: a new method for generating the Pareto surface in nonlinear multicriteria optimization problems. SIAM J Optim 8(3):631–657 Zhang Q, Li H, Maringer D, Tsang E (2010) MOEA/D with NBI-style Tchebycheff approach for portfolio management. In: 2010 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8 Zheng W, Tan Y, Meng L, Zhang H (2018) An improved MOEA/D design for many-objective optimization problems. Appl Intell 48(10):3839–3861 Ishibuchi H, Sakane Y, Tsukamoto N, Nojima Y (2009) Adaptation of scalarizing functions in MOEA/D: an adaptive scalarizing function-based multiobjective evolutionary algorithm. In: International conference on evolutionary multi-criterion optimization. Springer, pp 1–8 Wu M, Li K, Kwong S, Zhang Q, Zhang J (2019) Learning to decompose: a paradigm for decomposition-based multiobjective optimization. IEEE Trans Evol Comput 23(3):376–390 Wang R, Zhang Q, Zhang T (2016) Decomposition-based algorithms using Pareto adaptive scalarizing methods. IEEE Trans Evol Comput 20(6):821–837 Liu H, Gu F, Zhang Q (2014) Decomposition of a multiobjective optimization problem into a number of simple multiobjective subproblems. IEEE Trans Evol Comput 18(3):450–455 Zhang Y, Yang R, Zuo J, Jing X (2015) Enhancing MOEA/D with uniform population initialization, weight vector design and adjustment using uniform design. J Syst Eng Elect 26(5):1010–1022 Jain H, Deb K (2013) An evolutionary many-objective optimization algorithm using reference-point based nondominated sorting approach, part II: handling constraints and extending to an adaptive approach. IEEE Trans Evol Comput 18(4):602–622 Qi Y, Ma X, Liu F, Jiao L, Sun J, Wu J (2014) MOEA/D with adaptive weight adjustment. Evol Comput 22(2):231 Ma X, Liu F, Qi Y, Li L, Jiao L, Deng X, Wu J (2016) MOEA/D with biased weight adjustment inspired by user preference and its application on multi-objective reservoir flood control problem. Soft Comput 20(12):4999–5023 Zhang Q, Liu W, Li H (2009) The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances. In: 2009 IEEE congress on evolutionary computation (CEC). IEEE, pp 203–208 Kang Q, Song X, Zhou M (2018) A collaborative resource allocation strategy for decomposition-based multiobjective evolutionary algorithms. IEEE Trans Syst Man Cybern Syst 49(12):2416–2423 Zhou A, Zhang Q (2015) Are all the subproblems equally important? Resource allocation in decomposition-based multiobjective evolutionary algorithms. IEEE Trans Evol Comput 20(1):52–64 Wang P, Zhu W, Liu H (2019) A new resource allocation strategy based on the relationship between subproblems for MOEA/D. Inf Sci 501:337–362 Li H, Zhang Q (2008) Multiobjective optimization problems with complicated Pareto sets, MOEA/D and NSGA-II. IEEE Trans Evol Comput 13(2):284–302 Chiang T, Lai Y (2011) MOEA/D-AMS: improving MOEA/D by an adaptive mating selection mechanism. In: 2011 IEEE congress on evolutionary computation (CEC). IEEE, pp 1473–1480 Jiang S, Yang S (2015) An improved multiobjective optimization evolutionary algorithm based on decomposition for complex Pareto fronts. IEEE Trans Cybern 46(2):421–437 Wang Z, Zhang Q, Gong M, Zhou A (2014) A replacement strategy for balancing convergence and diversity in MOEA/D. In: 2014 IEEE congress on evolutionary computation (CEC). IEEE, pp 2132–2139 Wang Z, Zhang Q, Zhou A, Gong M, Jiao L (2015) Adaptive replacement strategies for MOEA/D. IEEE Trans Cybern 46(2):474–486 Huang W, Li H (2010). On the differential evolution schemes in MOEA/D. In: 2010 sixth international conference on natural computation. IEEE, pp 2788–2792 Li H, Zhang Q, Deng J (2016) Biased multiobjective optimization and decomposition algorithm. IEEE Trans Cybern 47(1):52–66 Huang W, Li H (2010) On the differential evolution schemes in MOEA/D. In: Sixth international conference on natural computation, vol 6. IEEE, pp 2788–2792 Chong JK (2016) A novel multi-objective memetic algorithm based on opposition-based self-adaptive differential evolution. Memet Comput 8(2):147–165 Venske SM, Gonçalves RA, Delgado MR (2014) ADEMO/D: multiobjective optimization by an adaptive differential evolution algorithm. Neurocomputing 127(127):65–77 Shim V A, Tan. KC, Tan K (2012) A hybrid adaptive evolutionary algorithm in the domination-based and decomposition-based frameworks of multi-objective optimization. Evol Comput 1–8 Ke L, Zhang Q, Battiti R (2013) MOEA/D-ACO: a multiobjective evolutionary algorithm using decomposition and AntColony. IEEE Trans Cybern 43(6):1845–1859 Zheng X, Wang L (2016) A collaborative multiobjective fruit fly optimization algorithm for the resource constrained unrelated parallel machine green scheduling problem. IEEE Trans Syst Man Cybern Syst 48(5):790–800 Paterakis N, Gibescu M, Bakirtzis AG, Catalão JPS (2017) A multi-objective optimization approach to risk-constrained energy and reserve procurement using demand response. IEEE Trans Power Syst 33(4):3940–3954 Fan Z, Fang Y, Li W, Cai X, Wei C (2019) MOEA/D with angle-based constrained dominance principle for constrained multi-objective optimization problems. Appl Soft Comput 74:621–633 Liu J, Gong M, Miao Q, Wang X, Li H (2017) Structure learning for deep neural networks based on multiobjective optimization. IEEE Trans Neural Net Learn Syst 29(6):2450–2463 Xu Y, Ding O, Qu R, Li K (2018) Hybrid multi-objective evolutionary algorithms based on decomposition for wireless sensor network coverage optimization. Appl Soft Comput 68:268–282 Deb K, Jain H (2013) An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints. IEEE Trans Evol Comput 18(4):577–601 Li K, Deb K, Zhang Q, Kwong S (2014) An evolutionary many-objective optimization algorithm based on dominance and decomposition. IEEE Trans Evol Comput 19(5):694–716 Sun Y, Yen GG, Yi Z (2018) IGD indicator-based evolutionary algorithm for many-objective optimization problems. IEEE Trans Evol Comput 23(2):173–187 Yuan Y, Xu H, Wang B, Zhang B, Yao X (2015) Balancing convergence and diversity in decomposition-based many-objective optimizers. IEEE Trans Evol Comput 20(2):180–198 Gu F, Cheung Y (2017) Self-organizing map-based weight design for decomposition-based many-objective evolutionary algorithm. IEEE Trans Evol Comput 22(2):211–225 Cheng R, Jin Y, Olhofer M, Sendhoff B (2016) A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 20(5):773–791 Jeyakumar G, Velayutham CS (2013) Distributed mixed variant differential evolution algorithms for unconstrained global optimization. Memet Comput 5(4):275–293 Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15(1):55–66 Mallipeddi R, Suganthan PN (2010) Differential evolution algorithm with ensemble of parameters and mutation and crossover strategies. In: International conference on swarm, evolutionary, and memetic computing. Springer, pp 71–78 Wang Z, Ong Y-S, Ishibuchi H (2018) On scalable multiobjective test problems with hardly dominated boundaries. IEEE Trans Evol Comput 23(2):217–231 Wang Z, Ong Y-S, Sun J, Gupta A, Zhang Q (2018) A generator for multiobjective test problems with difficult-to-approximate pareto front boundaries. IEEE Trans Evol Comput 23(4):556–571 Zitzler E, Deb K, Thiele L (2000) Comparison of multiobjective evolutionary algorithms: empirical results. Evol Comput 8(2):173–195 Zhang Q, Zhou A, Zhao SZ, Suganthan PN, Liu W, Tiwari S (2008) Multiobjective optimization test instances for the CEC-2009 special session and competition. Technical report, Nanyang Technological University, Singapore Deb K, Thiele L, Laumanns M (2005) Scalable test problems for evolutionary multiobjective optimization. In: Evolutionary multiobjective optimization. Springer, pp 105–145 Huband S, Hingston P, Barone L, While L (2006) A review of multiobjective test problems and a scalable test problem toolkit. IEEE Trans Evol Comput 10(5):477–506 Cheng R, Li M, Tian Y, Zhang X, Yang S, Jin Y, Yao X (2017) A benchmark test suite for evolutionary many-objective optimization. Comp Intell Syst 3(1):67–81 Li H, Deb K, Zhang Q, Suganthan PN, Chen L (2019) Comparison between MOEA/D and NSGA-III on a set of novel many and multi-objective benchmark problems with challenging difficulties. Swarm Evol Comput 46:104–117 Tian Y, Cheng R, Zhang X, Jin Y (2017) PlatEMO: A MATLAB platform for evolutionary multi-objective optimization. IEEE Comput Intell Mag 12(4):73–87 Gong D, Xu B, Zhang Y, Guo Y, Yang S (2019) A similarity-based cooperative co-evolutionary algorithm for dynamic interval multi-objective optimization problems. IEEE Trans Evol Comput 24(1):142–156 Wilcoxon F (1945) Individual comparisons by ranking methods. Biomet Bull 1(6):80–83