UAV path design with connectivity constraint based on deep reinforcement learning

Zeng, 2016, Wireless communications with unmanned aerial vehicles: opportunities and challenges, IEEE Commun. Mag., 54, 36, 10.1109/MCOM.2016.7470933 Valavanis, 2014 Kerczewski, 2012 Amorim, 2017, Radio channel modeling for UAV communication over cellular networks, IEEE Wirel. Commun. Lett., 6, 514, 10.1109/LWC.2017.2710045 2017 Zeng, 2019, Cellular-connected UAV: Potential, challenges, and promising technologies, IEEE Wirel. Commun., 26, 120, 10.1109/MWC.2018.1800023 Mei, 2020, Cooperative downlink interference transmission and cancellation for cellular-connected UAV: A divide-and-conquer approach, IEEE Trans. Commun., 68, 1297, 10.1109/TCOMM.2019.2955953 Mei, 2019, Cellular-connected UAV: Uplink association, power control and interference coordination, IEEE Trans. Wireless Commun., 18, 5380, 10.1109/TWC.2019.2936021 A. Rahmati, X. He, I. Guvenc, H. Dai, Dynamic mobility-aware interference avoidance for aerial base stations in cognitive radio networks, in: IEEE INFOCOM 2019 - IEEE Conference on Computer Communications, 2019, pp. 595–603, http://dx.doi.org/10.1109/INFOCOM.2019.8737472. Challita, 2019, Interference management for cellular-connected UAVs: A deep reinforcement learning approach, IEEE Trans. Wireless Commun., 18, 2125, 10.1109/TWC.2019.2900035 Lu, 2022, Resource and trajectory optimization for secure communications in dual unmanned aerial vehicle mobile edge computing systems, IEEE Transactions on Industrial Informatics, 18, 2704, 10.1109/TII.2021.3087726 Hanna, 2021, Uav swarm position optimization for high capacity mimo backhaul, IEEE Journal on Selected Areas in Communications, 39, 3006, 10.1109/JSAC.2021.3088677 Li, 2019, A near-optimal UAV-aided radio coverage strategy for Dense Urban Areas, IEEE Trans. Veh. Technol., 68, 9098, 10.1109/TVT.2019.2927425 Li, 2019, Rechargeable multi-UAV aided seamless coverage for QoS-guaranteed IoT networks, IEEE Internet Things J., 6, 10902, 10.1109/JIOT.2019.2943147 Zhang, 2019, Cellular-enabled UAV communication: A connectivity-constrained trajectory optimization perspective, IEEE Trans. Commun., 67, 2580, 10.1109/TCOMM.2018.2880468 E. Bulut, I. Guevenc, Trajectory optimization for cellular-connected UAVs with disconnectivity constraint, in: 2018 IEEE International Conference on Communications Workshops, ICC Workshops, 2018, pp. 1–6, http://dx.doi.org/10.1109/ICCW.2018.8403623. S. Zhang, R. Zhang, Trajectory design for cellular-connected UAV under outage duration constraint, in: ICC 2019 - 2019 IEEE International Conference on Communications, ICC, 2019, pp. 1–6, http://dx.doi.org/10.1109/ICC.2019.8761259. Chen, 2020, Trajectory optimization for cellular-enabled UAV with connectivity outage constraint, IEEE Access, 8, 29205, 10.1109/ACCESS.2020.2971772 A. Al-Hourani, S. Kandeepan, A. Jamalipour, Modeling air-to-ground path loss for low altitude platforms in urban environments, in: 2014 IEEE Global Communications Conference, 2014, pp. 2898–2904, http://dx.doi.org/10.1109/GLOCOM.2014.7037248. O. Esrafilian, R. Gangula, D. Gesbert, 3D-map assisted UAV trajectory design under cellular connectivity constraints, in: ICC 2020 - 2020 IEEE International Conference on Communications, ICC, 2020, pp. 1–6, http://dx.doi.org/10.1109/ICC40277.2020.9149190. B. Khamidehi, E.S. Sousa, Federated learning for cellular-connected UAVs: Radio mapping and path planning, in: GLOBECOM 2020 - 2020 IEEE Global Communications Conference, 2020, pp. 1–6, http://dx.doi.org/10.1109/GLOBECOM42002.2020.9322349. H. Yang, J. Zhang, S. Song, K.B. Lataief, Connectivity-aware UAV path planning with aerial coverage maps, in: 2019 IEEE Wireless Communications and Networking Conference, WCNC, 2019, pp. 1–6, http://dx.doi.org/10.1109/WCNC.2019.8886129. S. Zhang, R. Zhang, Radio map based path planning for cellular-connected UAV, in: 2019 IEEE Global Communications Conference, GLOBECOM, 2019, pp. 1–6, http://dx.doi.org/10.1109/GLOBECOM38437.2019.9013177. Y. Zeng, X. Xu, Path design for cellular-connected UAV with reinforcement learning, in: 2019 IEEE Global Communications Conference, GLOBECOM, 2019, pp. 1–6, http://dx.doi.org/10.1109/GLOBECOM38437.2019.9014041. Zeng, 2020 Sutton, 2018 2017 Sutton, 2005, Reinforcement learning: An introduction, IEEE Trans. Neural Netw., 16, 285, 10.1109/TNN.2004.842673 Hasselt, 2016 Wang, 2016 Yang, 2021, Privacy-preserving federated learning for UAV-enabled networks: Learning-based joint scheduling and resource management, IEEE J. Sel. Areas Commun., 39, 3144, 10.1109/JSAC.2021.3088655 Liu, 2021, Machine learning empowered trajectory and passive beamforming design in UAV-RIS wireless networks, IEEE J. Sel. Areas Commun., 39, 2042, 10.1109/JSAC.2020.3041401 2012, Propagation data and prediction methods required for the design of terrestrial broadband radio access systems operating in a frequency range from 3 to 60 GHz Ding, 2020, 3D UAV trajectory design and frequency band allocation for energy-efficient and fair communication: A deep reinforcement learning approach, IEEE Trans. Wireless Commun., 19, 7796, 10.1109/TWC.2020.3016024