Neural Networks and the Bias/Variance Dilemma
Tóm tắt
Feedforward neural networks trained by error backpropagation are examples of nonparametric regression estimators. We present a tutorial on nonparametric inference and its relation to neural networks, and we use the statistical viewpoint to highlight strengths and weaknesses of neural models. We illustrate the main points with some recognition experiments involving artificial data as well as handwritten numerals. In way of conclusion, we suggest that current-generation feedforward neural networks are largely inadequate for difficult problems in machine perception and machine learning, regardless of parallel-versus-serial hardware or other implementation issues. Furthermore, we suggest that the fundamental challenges in neural modeling are about representation rather than learning per se. This last point is supported by additional experiments with handwritten numerals.
Từ khóa
Tài liệu tham khảo
Barron A. R., 1989, Florida, 280
Baum L. E., 1972, Inequalities, 3, 1
Burr D. J., 1980, IEEE Transact. Pattern Anal. Machine Intell. PAMI-3, 6, 708
Chauvin Y., 1990, Neural Information Processing Systems 11, D. S. Touretzky, ed., 642
Dempster A., 1976, J. R. Statist. SOC. B, 39, 1
Denker J., 1987, Complex Syst., 1, 877
Goldman L., 1982, J. Med., 307, 588
Stone M., 1974, J. R. Statist. SOC., 36, 111