Online optimal control of nonlinear discrete-time systems using approximate dynamic programming

Travis Dierks1, S. Jagannathan2
1DRS Sustainment Systems, Inc., St. Louis, USA
2Department of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, USA

Tóm tắt

Từ khóa


Tài liệu tham khảo

S. Jagannathan. Neural Network Control of Nonlinear Discrete-time Systems. Boca Raton: CRC Press, 2006.

F. L. Lewis, V. L. Syrmos. Optimal Control. 2nd ed. New York: John Wiley & Sons, 1995.

J. Shamma, J. Cloutier. Existence of SDRE stabilizing feedback. IEEE Transactions on Automatic Control, 2003, 48(3): 513–517.

J. Vlassenbroeck, R. Van Dooren. A Chebyshev technique for solving nonlinear optimal control problems. IEEE Transactions on Automatic Control, 1988, 33(4): 333–340.

Z. Chen, S. Jagannathan. Generalized Hamilton-Jacobi-Bellman formulation based neural network control of affine nonlinear discretetime systems. IEEE Transactions on Neural Networks, 2008, 19(1): 90–106.

A. Al-Tamimi, F. L. Lewis, M. Abu-Khalaf. Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. IEEE Transactions on Systems, Man, and Cybernetics — Part B, 2008, 38(4): 943–949.

D. Vrabie, O. Pastravanu, M. Abu-Khalaf, et al. Adaptive optimal control for continuous-time linear systems based on policy iteration. Automatica, 2009, 45(2): 477–484.

G. Toussaint, T. Basar, F. Bullo. H-infinity-optimal tracking control techniques for nonlinear underactuated systems. Proceedings of IEEE Conference on Decision and Control, New York: IEEE, 2000: 2078–2083.

D. Gu, H. Hu. Receding horizon tracking control of wheeled mobile robots. IEEE Transactions on Control Systems Technology, 2006, 14(4): 743–49.

H. Zhang, Q. Wei, Y. Luo. A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm. IEEE Transactions on Systems, Man, and Cybernetics — Part B, 2008, 38(4): 937–942.

T. Dierks, B. T. Thumati, S. Jagannathan. Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence. Neural Networks, 2009, 22(5/6): 851–860.

K. G. Vamvoudakis, F. L. Lewis. Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem. Automatica, 2010, 46(5): 878–888.

H. K. Khalil. Nonlinear Systems, 3rd ed. New York: Prentice Hall, 2002.

D. Wang, J. Huang. Neural network-based adaptive dynamic surface control for a class of uncertain nonlinear systems in strict-feedback form. IEEE Transactions on Neural Networks, 2005, 16(1): 195–202.

M. K. Bugeja, S. G. Fabri, L. Camilleri. Dual adaptive dynamic control of mobile robots using nearal networks. IEEE Transactions on Systems, Man, and Cybernetics — Part B, 2009, 39(1): 129–141.