Lyapunov-theory-based radial basis function networks for adaptive filtering

Kah Phooi Seng1, Zhihong Man2, Hong Ren Wu3
1School of Engineering, Monash University, Australia
2School of Computer Engineering, Nanyang Technological University, Singapore
3School of Computer Science and Software Engineering, Monash University, Clayton, VIC, Australia

Tóm tắt

Two important convergence properties of Lyapunov-theory-based adaptive filtering (LAF) adaptive filters are first explored. The LAF finite impulse response and infinite impulse response adaptive filters are then realized using the radial basis function (RBF) neural networks (NNs). The proposed adaptive RBF neural filtering system possesses the distinctive properties of RBF NN and the LAF filtering system. Unlike many adaptive filtering schemes using gradient search techniques, a Lyapunov function of the error between the desired signal and the RBF NN output is first defined. By properly choosing the weights update law in the Lyapunov sense, the RBF filter output can asymptotically converge to the desired signal. The design is independent of the stochastic properties of the input disturbances and the stability is guaranteed by the Lyapunov stability theory. Simulation examples for nonlinear adaptive prediction of nonstationary signal and system identification are performed.

Từ khóa

#Radial basis function networks #Adaptive filters #IIR filters #Neural networks #Finite impulse response filter #Filtering #Lyapunov method #Convergence #Stochastic processes #Stability

Tài liệu tham khảo

10.1109/78.599942 zhihong, 1998, design of adaptive filters using lyapunov stability theory, Proc IEEE Int Workshop on Intelligent Signal Processing and Communication Systems, 1, 304 slotine, 1991, Applied nonlinear control 10.1016/S0893-6080(96)00024-X 10.1016/0893-6080(94)00078-Z 10.1109/78.348134 10.1109/78.782193 10.1109/78.705435 institute for integrated signal processing systems, 0 kirkpatrick, 1983, optimization by simulated annealing, Science, 220, 671, 10.1126/science.220.4598.671 narenda, 1989, Learning Automata&#x2014 An Introduction 10.1002/j.1538-7305.1981.tb00302.x park, 1991, universal approximation using rbf networks, Neural Comput, 3, 246, 10.1162/neco.1991.3.2.246 10.1109/TCOM.1978.1093988 10.1016/0005-1098(85)90110-4 goldberg, 1989, Genetic Algorithms in Search Optimization Machine Learning haykin, 1985, Adaptive Filter Theory 10.1016/0005-1098(89)90013-7