Accelerating the convergence of the back-propagation method

Thomas P. Vogl1, J. K. Mangis1, A. K. Rigler2, Walter Zink1, Daniel L. Alkon3
1Environmental Research Institute of Michigan, Arlington, USA 22209#TAB#
2Computer Science Department, University of Missouri, Rolla, USA 65401#TAB#
3Neural Systems Section, National Institute of Neurological and Communicative Disorders and Stroke, NIH, Bethesda, USA 20892#TAB#

Tóm tắt

Từ khóa


Tài liệu tham khảo

Akaike H (1959) On a successive transformation of probability distribution and its application to the analysis of the optimum gradient method. Ann Inst Statist Math 11:1–17

Alkon DL (1983) Learning in a marine snail. Scientific American (July 1984), pp 70–84

Alkon DL (1984) Calcium-mediated reduction in ionic currents: a biophysical memory trace. Science 226:1037–1945

Alkon DL (1985) Conditioning — induced changes ofHermissenda channels: relevance to mammalian brain function. In: Weinberger NM, McGaugh JL, Lynch G (eds) Memory systems of the brain. The Guiford Press, New York

Levy AV, Gomez S (1985) The tunneling method applied to global optimization. In: Boggs PT, Byrd RH, Schnabel RB (eds) Numerical optimization 1984. SIAM, Philadelphia, pp 213–244

Luenberger DG (1984) Linear and nonlinear programming, 2nd ed. Addison-Wesley, Reading, Mass

Lundy M, Mees A (1986) Convergence of an annealing algorithm. Math Prog 34:111–124

Muneer T (1988) Comparison of optimization methods for nonlinear least squares minimization. Int J Math Educ Sci Tech 19:192–197

Pardalos PM, Rosen JB (1986) Methods for global concave minimization: a bibliographic survey. SIAM Rev 28:367–379

Parker DB (1987) Optimal algorithms for adaptive networks: second order back propagation, second order direct propagation, and second order Hebbian learning. In: Caudill M, Butler C (eds) Proceedings of the 1st International Conference on Neural Networks, San Diego, Calif., June 1987. IEEE Cat. #87TH0191-7, pp II-593-II-600

Pegis RJ, Grey DS, Vogl TP, Rigler AK (1966) The generalized orthonormal optimization program and its applications. In: Lavi A, Vogl TP (eds) Recent advances in optimization techniques, Wiley, New York, pp 47–60

Pineda FJ (1987) Generalization of back propagation to recurrent and higher order neural networks. Proceedings of the IEEE Conference on Neural Information Processing Systems, Denver, Colorado 1987: (to be published)

Rinnooy-Kan AHG, Timmer GT (1985) A stochastic approach to global optimization. In: Boggs PT, Byrd RH, Schnabel RB (eds) Numerical optimization 1984. STAM, Philadelphia, pp 245–262

Rumelhart DE, Hinton GE, Williams RJ (1986) Learning internal representation by error propagation. In: Rumelhart DE, McClelland JL and the PDP Research Group (eds) Parallel distributed processing, vol 1, chap 8. MIT Press, Cambridge, Mass

Walster GW, Hansen ER, Sengupta S (1985) Test results for a global optimization algorithm. In: Boggs PT, Byrd RH, Schnabel RB (eds) Numerical optimization 1984. SIAM, Philadelphia, pp 272–287

Watson LT (1986) Numerical linear algebra aspects of globally convergent homotopy methods. SIAM Rev 28:529–545

Whitson GM (1988) An introduction the the parallel distributed processing model of cognition and some examples of how it is changing the teaching of artificial intelligence. In: Dreshem HL (ed) Proceedings of the 19th Annual Technical Symposium on Comp Sci Education. ACM, New York, pp 59–62

Whitson GM, Kulkarni A (1988) A testbed for sensory PDP models. Proceedings of the 16th Annual Comp Sci Conf. ACM, New York, pp 467–468