A scaled conjugate gradient algorithm for fast supervised learning

Neural Networks - Tập 6 Số 4 - Trang 525-533 - 1993
Martin F. Møller1
1University of Aarhus, Denmark

Tóm tắt

Từ khóa


Tài liệu tham khảo

Battiti, 1989, Accelerated backpropagation learning: Two optimization methods, Complex Systems, 3, 331

Battiti, 1990, Optimization methods for back-propagation: Automatic parameter tuning and faster convergence, IJNNC-90-WASH-DC, 1, 593

Battiti, 1990, BFGS Optimization for faster and automated supervised learning, INCC 90 Paris. International Neural Network Conference, 2, 757, 10.1007/978-94-009-0643-3_68

Fletcher, 1975

Gill, 1980

Gill, 1974, Safeguarded steplength algorithms for optimization using descent methods, 37

Hestenes, 1990

Hinton, 1989, Connectionist learning procedures, Artificial Intelligence, 40, 185, 10.1016/0004-3702(89)90049-0

Johansson, 1991, Back-propagation learning for multi-layer feed-forward neural networks using the conjugate gradient method, International Journal of Neural Systems, 2, 291, 10.1142/S0129065791000261

Judd, 1987, Complexity of connectionist learning with various node functions

Le Cun, 1989, Generalization and network design strategies, 143

Luenberger, 1984

Møller, 1990, Learning by conjugate gradients, 464, 184

Møller, 1991

Powell, 1977, Restart procedures for the conjugate gradient method, Mathematical Programming, 12, 241, 10.1007/BF01593790

Rumelhart, 1986, Learning internal representations by error propagation, 318

Tesauro, 1987, Scaling relationships in back-propagation learning: Dependence on training set size, Complex Systems, 2, 367

Yoshida, 1991, A learning algorithm for multilayered neural networks: A Newton method using automatic differentiation, 10.1109/IJCNN.1991.155623

Watrous, 1987, Learning algorithms for connectionist networks: Applied gradient methods of nonlinear optimization, 2, 619

Williams, 1990