Multi-objective particle swarm optimization with multi-mode collaboration based on reinforcement learning for path planning of unmanned air vehicles

Zhao, 2018, Survey on computational-intelligence-based UAV path planning, Knowl.-Based Syst., 158, 54, 10.1016/j.knosys.2018.05.033 Yu, 2015, Cooperative path planning for target tracking in urban environments using unmanned air and ground vehicles, IEEE/ASME Trans. Mechatronics, 20, 541, 10.1109/TMECH.2014.2301459 Razi, 2018, 3D land mapping and land deformation monitoring using persistent scatterer interferometry (PSI) ALOS PALSAR: validated by geodetic GPS and UAV, IEEE Access, 6, 12395, 10.1109/ACCESS.2018.2804899 Alotaibi, 2019, LSAR: Multi-UAV collaboration for search and rescue missions, IEEE Access, 7, 55817, 10.1109/ACCESS.2019.2912306 Qu, 2020, A novel hybrid grey wolf optimizer algorithm for unmanned aerial vehicle (UAV) path planning, Knowl.-Based Syst., 194, 10.1016/j.knosys.2020.105530 Du, 2019, A real-time collision avoidance strategy in dynamic airspace based on dynamic artificial potential field algorithm, IEEE Access, 7, 169469, 10.1109/ACCESS.2019.2953946 Lin, 2017, Sampling-based path planning for UAV collision avoidance, IEEE Trans. Intell. Transp. Syst., 18, 3179, 10.1109/TITS.2017.2673778 Liu, 2016, Adaptive sensitivity decision based path planning algorithm for unmanned aerial vehicle with improved particle swarm optimization, Aerosp. Sci. Technol., 58, 92, 10.1016/j.ast.2016.08.017 Jia, 2018, Cooperative multiple task assignment problem with stochastic velocities and time windows for heterogeneous unmanned aerial vehicles using a genetic algorithm, Aerosp. Sci. Technol., 76, 112, 10.1016/j.ast.2018.01.025 Zhang, 2018, Routing optimization of emergency grain distribution vehicles using the immune ant colony optimization algorithm, Appl. Soft Comput., 71, 917, 10.1016/j.asoc.2018.07.050 Kong, 2018, An improved artificial bee colony algorithm based on elite group guidance and combined breadth-depth search strategy, Inform. Sci., 442–443, 54, 10.1016/j.ins.2018.02.025 Zhang, 2018, A novel phase angle-encoded fruit fly optimization algorithm with mutation adaptation mechanism applied to UAV path planning, Appl. Soft Comput., 70, 371, 10.1016/j.asoc.2018.05.030 Zhang, 2015, An improved constrained differential evolution algorithm for unmanned aerial vehicle global route planning, Appl. Soft Comput., 26, 270, 10.1016/j.asoc.2014.09.046 Yu, 2020, A constrained differential evolution algorithm to solve UAV path planning in disaster scenarios, Knowl.-Based Syst., 204, 10.1016/j.knosys.2020.106209 Li, 2020, Path planning of multiple UAVs with online changing tasks by an ORPFOA algorithm, Eng. Appl. Artif. Intell., 94, 10.1016/j.engappai.2020.103807 Liu, 2019, Collision free 4D path planning for multiple UAVs based on spatial refined voting mechanism and PSO approach, Chin. J. Aeronaut., 32, 1504, 10.1016/j.cja.2019.03.026 Radmanesh, 2018, Grey wolf optimization based sense and avoid algorithm in a Bayesian framework for multiple UAV path planning in an uncertain environment, Aerosp. Sci. Technol., 77, 168, 10.1016/j.ast.2018.02.031 Zhou, 2019, Adaptive exact penalty design for constrained distributed optimization, IEEE Trans. Automat. Control, 64, 4661, 10.1109/TAC.2019.2902612 A. Saha, R. Datta, K. Deb, Hybrid gradient projection based genetic algorithms for constrained optimization, in: Proceedings of 2010 IEEE Congress on Evolutionary Computation, Barcelona, 2010, pp. 1–8. Wang, 2012, Combining multiobjective optimization with differential evolution to solve constrained optimization problems, IEEE Trans. Evol. Comput., 16, 117, 10.1109/TEVC.2010.2093582 M. Zhao, R. Liu, W. Li, H. Liu, Multi-objective optimization based differential evolution constrained optimization algorithm, in: Proceedings of 2010 Second WRI Global Congress on Intelligent Systems, Wuhan, 2010, pp. 320–326. R. Chai, A. Savvaris, A. Tsourdos, Y. Xia, S. Chai, Solving Multiobjective Constrained Trajectory Optimization Problem by an Extended Evolutionary Algorithm, IEEE Trans. Cybern. 50 (4) 1630–1643. Chai, 2017, Multi-objective trajectory optimization of Space Manoeuvre Vehicle using adaptive differential evolution and modified game theory, Acta Astronaut., 136, 273, 10.1016/j.actaastro.2017.02.023 Mosa, 2020, A novel hybrid particle swarm optimization and gravitational search algorithm for multi-objective optimization of text mining, Appl. Soft Comput., 90, 10.1016/j.asoc.2020.106189 Liu, 2016, A new quantum-behave d particle swarm optimization based on cultural evolution mechanism for multiobjective problems, Knowl.-Based Syst., 101, 90, 10.1016/j.knosys.2016.03.009 Coello, 2002, MOPSO: a proposal for multiple objective particle swarm optimization, Evol. Comput., 1051 Mac, 2017, A hierarchical global path planning approach for mobile robots based on multi-objective particle swarm optimization, Appl. Soft Comput., 59, 68, 10.1016/j.asoc.2017.05.012 Zhao, 2011, Two-lbests based multi-objective particle swarm optimizer, Eng. Optim., 43, 1, 10.1080/03052151003686716 Ang, 2020, A constrained multi-swarm particle swarm optimization without velocity for constrained optimization problems, Expert Syst. Appl., 140, 10.1016/j.eswa.2019.112882 Feng, 2017, Multi-objective quantum-behaved particle swarm optimization for economic environmental hydrothermal energy system scheduling, Energy, 131, 165, 10.1016/j.energy.2017.05.013 Qie, 2019, Joint optimization of multi-UAV target assignment and path planning based on multi-agent reinforcement learning, IEEE Access, 7, 146264, 10.1109/ACCESS.2019.2943253 Li, 2020, Path planning for UAV ground target tracking via deep reinforcement learning, IEEE Access, 8, 29064, 10.1109/ACCESS.2020.2971780 Zhou, 2019, Learn to navigate: cooperative path planning for unmanned surface vehicles using deep reinforcement learning, IEEE Access, 7, 165262, 10.1109/ACCESS.2019.2953326 Qu, 2020, A novel reinforcement learning based grey wolf optimizer algorithm for unmanned aerial vehicles (UAVs) path planning, Appl. Soft Comput., 89, 10.1016/j.asoc.2020.106099 Chai, 2020, Real-time reentry trajectory planning of hypersonic vehicles: A two-step strategy incorporating fuzzy multiobjective transcription and deep neural network, IEEE Trans. Ind. Electron., 67, 6904, 10.1109/TIE.2019.2939934 R. Chai, A. Tsourdos, A. Savvaris, S. Chai, Y. Xia, C.L.P. Chen, Six-DOF Spacecraft Optimal Trajectory Planning and Real-Time Attitude Control: A Deep Neural Network-Based Approach, IEEE Trans. Neural Netw. Learn. Syst.. J. Sun, W.B. Xu, B. Feng, Adaptive parameter control for quantum-behaved particle swarm optimization on individual level, in: Proceedings of 2005 IEEE International Conference on Systems, Man and Cybernetics, Waikoloa, HI, Vol. 4, 2005, pp. 3049–3054. Coelho, 2007, Novel Gaussian quantum-behaved particle swarm optimiser applied to electromagnetic design, IET Sci. Meas. Technol., 1, 290, 10.1049/iet-smt:20060124 Aguilar, 2020, Multi-objective PSO applied to PI control of DFIG wind turbine under electrical fault conditions, Electr. Power Syst. Res., 180 Huang, 2006, Comprehensive learning particle swarm optimizer for solving multiobjective optimization problems: Research articles, Int. J. Intell. Syst., 21, 209, 10.1002/int.20128 J.G. Wang, W.J. Liu, W.X. Zhang, B. Yang, Multi-objective particle swarm optimization algorithm based on self-update strategy, in: Proceedings of 2012 International Conference on Industrial Control and Electronics Engineering, Xi’an, 2012, pp. 171–174. M.R. Tanweer, A. Al-Dujaili, S. Suresh, Multi-objective self regulating particle swarm optimization algorithm for BMOBench platform, in: 2016 IEEE Symposium Series on Computational Intelligence (SSCI), Athens, 2016, pp. 1–6. dos Santos Coelho, 2010, A multiobjective Gaussian particle swarm approach applied to electromagnetic optimization, IEEE Trans. Magn., 46, 3289, 10.1109/TMAG.2010.2047250 J. Wang, G. Jia, J. Lin, Z. Hou, Cooperative Mission Planning for Heterogeneous UAVs with the Improved Multi-objective Quantum-behaved Particle Swarm Optimization Algorithm, in: 2019 Chinese Control and Decision Conference (CCDC), Nanchang, China, 2019, pp. 3740–3745.