Deep reinforcement learning-based controller for path following of an unmanned surface vehicle

Ocean Engineering - Tập 183 - Trang 155-166 - 2019
Joohyun Woo1, Chan-Woo Yu2, Nakwan Kim3
1Institute of Engineering Research, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul 08826, Republic of Korea
2The 6th R&D Institute — 3rd Directorate, Agency for Defense Development, Dong-eup, Uichang-gu, Jinhae, Changwon, 51698, Republic of Korea
3Research Institute of Marine Systems Engineering, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul, 08826, Republic of Korea

Tóm tắt

Từ khóa


Tài liệu tham khảo

Bertaska, 2016

Bertaska, 2018, Experimental evaluation of supervisory switching control for unmanned surface vehicles, IEEE J. Ocean. Eng.

Bertram, 2008, Unmanned surface vehicles-a survey, Skibsteknisk Selskab, Copenhagen, Denmark, 1, 1

Bibuli, 2009, Path-following algorithms and experiments for an unmanned surface vehicle, J. Field Robotics, 26, 669, 10.1002/rob.20303

Carreras, 2003, Semi-online neural-Q/spl I. bar/leaming for real-time robot learning, 662

Cheng, 2018, Concise deep reinforcement learning obstacle avoidance for underactuated unmanned marine vessels, Neurocomputing, 272, 63, 10.1016/j.neucom.2017.06.066

Corfield, 2006, Unmanned surface vehicles-game changing technology for naval operations, IEE Control Eng. Ser., 69, 311

Cui, 2017, Adaptive neural network control of AUVs with control input nonlinearities using reinforcement learning, IEEE Trans. Syst. Man Cybern. Syst., 47, 1019, 10.1109/TSMC.2016.2645699

De Paula, 2015, Trajectory tracking algorithm for autonomous vehicles using adaptive reinforcement learning, 1

Fossen, 2002, Marine control system-guidance, navigation and control of ships, rigs and underwater vehicles, Mar. Cybemetics

Garus, 2010, Using of soft computing techniques to control of underwater robot, 415

Kucik, D., Reconnaissance using unmanned surface vehicles and unmanned micro-aerial vehicles, Google Patents, US Patent 6,712,312, 2004.

Lekkas, 2012, A time-varying lookahead distance guidance law for path following, Arenzano, Italy

Lillicrap, 2015

Lu, 2018, Robust adaptive formation control of underactuated autonomous surface vessels based on MLP and DOB, Nonlinear Dynam., 94, 503, 10.1007/s11071-018-4374-z

Magalhães, 2018, Reinforcement learning: The application to autonomous biomimetic underwater vehicles control, 12

Majohr, 2006, Modelling, simulation and control of an autonomous surface marine vehicle for surveying applications Measuring Dolphin MESSIN, IEE Control Eng. Ser., 69, 329

Meng, 2012, Global sliding mode based adaptive neural network path following control for underactuated surface vessels with uncertain dynamics, 40

Mnih, 2015, Human-level control through deep reinforcement learning, Nature, 518, 529, 10.1038/nature14236

Mu, 2017, Adaptive LOS path following for a podded propulsion unmanned surface vehicle with uncertainty of model and actuator saturation, Appl. Sci., 7, 1232, 10.3390/app7121232

Naeem, W., Sutton, R., Chudley, J., Modelling and control of an unmanned surface vehicle for environmental monitoring, in: UKACC International Control Conference, August, Glasgow, Scotland, 2006.

Nelson, 2007, Vector field path following for miniature air vehicles, IEEE Trans. Robot., 23, 519, 10.1109/TRO.2007.898976

Niu, 2016, Efficient path following algorithm for unmanned surface vehicle, 1

Rodriguez-Ramos, 2019, A deep reinforcement learning strategy for UAV autonomous landing on a moving platform, J. Intell. Robot. Syst., 93, 351, 10.1007/s10846-018-0891-8

Shin, 2017, Adaptive path-following control for an unmanned surface vessel using an identified dynamic model, IEEE/ASME Trans. Mechatronics, 22, 1143, 10.1109/TMECH.2017.2651057

Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., Riedmiller, M., Deterministic policy gradient algorithms, in: ICML, 2014.

Sonnenburg, 2013, Modeling, identification, and control of an unmanned surface vehicle, J. Field Robotics, 30, 371, 10.1002/rob.21452

Sutton, 1998

Woo, 2018

Woo, 2016, Vector field based guidance method for docking of an unmanned surface vehicle

Woo, 2018, Dynamic model identification of unmanned surface vehicles using deep learning network, Appl. Ocean Res., 78, 123, 10.1016/j.apor.2018.06.011

Yiannis, P., Mitchel, W., Operations architecture and vector field guidance for the river scout subscale unmanned surface vehicle, in: Defence and Homeland Security Symposium, 2013, pp. 55–60.

Yoo, 2016, Path optimization for marine vehicles in ocean currents using reinforcement learning, J. Mar. Sci. Technol., 21, 334, 10.1007/s00773-015-0355-9

Zhang, 2018, Novel DVS guidance and path-following control for underactuated ships in presence of multiple static and moving obstacles, Ocean Eng., 170, 100, 10.1016/j.oceaneng.2018.10.009

Zhang, 2014, An adaptive obstacle avoidance algorithm for unmanned surface vehicle in complicated marine environments, IEEE/CAA J. Autom. Sin., 1, 385, 10.1109/JAS.2014.7004666

Zhu, 2016, Straight path following of unmanned surface vehicle under flow disturbance, 1