Artificial neural networks: fundamentals, computing, design, and application

Anderson, 1988 2000, Artificial neural networks in hydrology. I. Preliminary concepts, J. Hydro. Eng. ASCE, 5, 115, 10.1061/(ASCE)1084-0699(2000)5:2(115) Attoh-Okine, N., Basheer, I., Chen, D.-H., 1999. Use of artificial neural networks in geomechanical and pavement systems. Trans. Res. Board, Circular E-C012. Barron, 1993, Universal approximation bounds for superpositions of a sigmoidal function, IEEE Trans. Inform. Theory, 39, 930, 10.1109/18.256500 Basheer, I.A., 1998. Neuromechanistic-based modeling and simulation of constitutive behavior of fine-grained soils. PhD Dissertation, Kansas State University, 435 pp. Basheer, 2000, Selection of methodology for modeling hysteresis behavior of soils using neural networks, J. Comput.-aided Civil Infrastruct. Eng., 5, 445, 10.1111/0885-9507.00206 Baum, 1989, What size net gives valid generalization?, Neural Computation, 1, 151, 10.1162/neco.1989.1.1.151 Bishop, 1995 Carpenter, 1988, The ART of adaptive pattern recognition by a self-organizing neural network, Computer, March, 77, 10.1109/2.33 Carpenter, 1987, ART2: self-organization of stable category recognition codes for analog input patterns, Appl. Opt., 26, 4914, 10.1364/AO.26.004919 Carson, 1995, Escherichia coli O157:H7 restriction pattern recognition by artificial neural network, J. Clin. Microbiol., 33, 2894, 10.1128/JCM.33.11.2894-2898.1995 Cheng, 1994, Neural networks: a review from a statistical perspective, Statist. Sci., 9, 2, 10.1214/ss/1177010638 Chun, 1993, Rapid identification of Streptomyces by artificial neural network analysis of pyrolysis mass spectra, FEMS Microbiol. Lett., 114, 115, 10.1111/j.1574-6968.1993.tb06560.x Chun, 1993, Artificial neural network analysis of pyrolysis mass spectrometric data in the identification of Streptomyces strains, FEMS Microbiol. Lett., 107, 321, 10.1111/j.1574-6968.1993.tb06051.x Dowla, 1995 Eaton, 1992, Learning coefficient dependence on training set size, Neural Networks, 5, 283, 10.1016/S0893-6080(05)80026-7 Fahlman, S.E., 1988. An empirical study of learning speed in backpropagation. Technical Report, CMU-CS-88-162, Carnegie-Mellon University. Fu, 1995 Garth, 1996, Evaluation of model discrimination techniques in artificial neural networks with application to grain drying, Vol. 6, 939 Geeraerd, 1998, Application of artificial neural networks as a nonlinear modular modeling technique to describe the bacterial growth in chilled food products, Int. J. Food Microbiol., 44, 49, 10.1016/S0168-1605(98)00127-5 Giacomini, 1997, Artificial neural network identification of heterotrophic marine bacteria based on their fatty-acid composition, IEEE Trans. Biomed. Eng., 44, 1185, 10.1109/10.649990 Goodacre, 1994, Sub-species discrimination using pyrolysis mass spectrometry and self-organizing neural networks of Propionibacterium acnes isolated from normal human skin, Zbl. Bakt., 22, 124 Goodacre, 1997, Use of pyrolysis mass spectrometry with supervised learning for the assessment of the adulteration of milk of different species, Appl. Spectrosc., 51, 1144, 10.1366/0003702971941665 Goodacre, 1993, Rapid assessment of olive oil adulteration using pyrolysis mass spectrometry and artificial neural networks, J. Sci. Food Agric., 63, 297, 10.1002/jsfa.2740630306 Hajmeer, 1996, The growth of Escherichia coli O157:H7 — a backpropagation neural network approach, 635 Hajmeer, 1997, Computational neural networks for predictive microbiology. II. Application to microbial growth, Int. J. Food Microbiol., 34, 51, 10.1016/S0168-1605(96)01169-5 Hajmeer, 1998, A nonlinear response surface model based on artificial neural networks for growth of Saccharomyces cerevisiae, J. Rapid Methods Automation Microbiol., 6, 103, 10.1111/j.1745-4581.1998.tb00191.x Hajmeer, M.N., Basheer, I.A., Fung, D.Y.C., Marsden, J.L., 2000. New approach for modeling generalized microbial growth curves using artificial neural networks (under review). Han, 1996, Optimization of feedforward neural networks, Eng. Appl. Artif. Intell., 9, 109, 10.1016/0952-1976(95)00001-1 Hanson, 1995, Backpropagation: some comments and variations, 237 Hassoun, 1995 Haykin, 1994 Hebb, 1949 Hecht-Nielsen, 1988, Applications of counterpropagation networks, Neural Networks, 1, 131, 10.1016/0893-6080(88)90015-9 Hecht-Nielsen, 1990 Henseler, 1995, Backpropagation, 37 Hertz, 1991 Hoffman, 1987, The problem of extracting the knowledge of experts from the perspective of experimental psychology, AI Mag., 8, 53 Hopfield, 1984, Neurons with graded response have collective computational properties like those of two-state neurons, Proc. Natl. Acad. Sci., 81, 3088, 10.1073/pnas.81.10.3088 Hopfield, 1986, Computing with neural circuits: a model, Science, 233, 625, 10.1126/science.3755256 Horimoto, 1997, Classification of microbial defects in milk using a dynamic headspace gas chromatograph and computer-aided data processing. 2. Artificial neural networks, partial least-squares regression analysis, and principal component regression analysis, J. Agric. Food Chem., 45, 743, 10.1021/jf960660g Hudson, 1995, Choosing and using a neural net, 273 Jadid, 1996, Predicting moment-curvature parameters from experimental data, Eng. Appl. Artif. Intell., 9, 309, 10.1016/0952-1976(96)00021-8 Jain, 1996, Artificial neural networks: a tutorial, Comput. IEEE, March, 31, 10.1109/2.485891 Jonsson, 1997, Electronic nose for microbial classification of grains, Int. J. Food Microbiol., 35, 187, 10.1016/S0168-1605(96)01218-4 1992 Kerber, 1992, ChiMerge: discretization of numeric attributes, 123 Kohonen, 1989 Lachtermacher, 1995, Backpropagation in time-series forecasting, J. Forecasting, 14, 381, 10.1002/for.3980140405 Lakshmanan, 1997, Detecting rare signatures, Vol. 7, 521 Lee, 1991, The effect of initial weights on premature saturation in backpropagation learning, 765 Li, 1993, Acceleration of backpropagation through initial weight pre-training with Delta rule, 580 Lippmann, 1987, An introduction to computing with neural nets, IEEE ASSP Mag., 4, 4, 10.1109/MASSP.1987.1165576 Looney, 1996, Advances in feedforward neural networks: demystifying knowledge acquiring black boxes, IEEE Trans. Knowledge Data Eng., 8, 211, 10.1109/69.494162 Maren, 1991, A logical topology of neural networks Masters, 1994 McCulloh, 1943, A logical calculus of the ideas immanent in nervous activity, Bull. Math. Biophys., 5, 115, 10.1007/BF02478259 Minsky, 1969 Moody, 1992, Networks with learned unit response functions, Vol. 4, 1048 Najjar, 1997, Computational neural networks for predictive microbiology. I. Methodology, Int. J. Food Microbiol., 34, 27, 10.1016/S0168-1605(96)01168-3 Nelson, 1990 Nguyen, 1990, Improving the learning speed of two-layer neural networks by choosing initial values of the adaptive weights, 21 Ni, 1998, Food quality prediction with neural networks, Food Technol., 5, 60 Pal, 1996, Neurocomputing: motivation, models, and hybridization, Computer, March, 24, 10.1109/MC.1996.485890 Pham, 1994, Neural networks in engineering, 3 Plant, 1991 Ramos-Nino, 1997, A comparison of quantitative structure–activity relationships for the effect of benzoic and cinnamic acids on Listeria monocytogenes using multiple linear regression, artificial neural network and fuzzy systems, J. Appl. Microbiol., 82, 168, 10.1111/j.1365-2672.1997.tb02847.x Rizzo, 1994, Characterization of aquifer properties using artificial neural networks: neural kriging, Water Res., 30, 483, 10.1029/93WR02477 Rosenblatt, 1962 Rumelhart, 1986, Learning internal representation by error propagation, Vol. 1 Rumelhart, 1995, Backpropagation: the basic theory, 1 Schalkoff, 1997 Schmidt, 1993, Initialization, backpropagation and generalization of feed-forward classifiers, 598 Sietsma, 1988, Neural net pruning — why and how, IEEE Int. Conf. Neural Networks, 1, 325, 10.1109/ICNN.1988.23864 Simpson, 1990 Specht, 1991, A general regression neural network, IEEE Trans. Neural Networks, 2, 568, 10.1109/72.97934 Stein, 1993, Selecting data for neural networks, AI Expert, 2, 42 Sui, 1992, An initial investigation of integrating neural networks with GIS for spatial decision making Sun, 1997, Function approximation and prediction: a comparative study with neural networks and regression models, 70 Swingler, 1996 Timmins, 1997, Rapid quantitative analysis of binary mixtures of Escherichia coli strains using pyrolysis mass spectrometry with multivariate calibration and artificial neural networks, J. Appl. Microbiol., 83, 208, 10.1046/j.1365-2672.1997.00218.x Twomey, 1997, Validation and verification, 44 Upadhaya, 1992, Application of neural network for sensory validation and plant monitoring, Neural Technol., 97, 170 Vallejo-Cordoba, 1995, Predicting milk shelf-life based on artificial neural networks and headspace gas chromatographic data, J. Food Sci., 60, 885, 10.1111/j.1365-2621.1995.tb06253.x van Rooij, 1996 von Neuman, 1958 Werbos, P.J., 1974. Beyond regression: new tools for prediction and analysis in the behavioral sciences. PhD Thesis, Harvard University. White, 1989, Learning in artificial neural networks: a statistical perspective, Neural Computation, 1, 425, 10.1162/neco.1989.1.4.425 White, 1990, Connectionist nonparametric regression — multilayer feedforward networks can learn arbitrary mappings, Neural Networks, 3, 535, 10.1016/0893-6080(90)90004-5 Widrow, 1990, 30 years of adaptive neural networks: perceptron, Madaline, and backpropagation, Proc. IEEE, 78, 1415, 10.1109/5.58323 Wythoff, 1993, Backpropagation neural networks: a tutorial, Chemometr. Intell. Lab. Syst., 18, 115, 10.1016/0169-7439(93)80052-J Yu, 1993, A new acceleration technique for the backpropagation algorithm, 1157 Zaika, 1994, Model for the combined effects of temperature, initial pH, sodium chloride and sodium nitrite concentrations on anaerobic growth of Shigella flexneri, Int. J. Food Microbiol., 23, 345, 10.1016/0168-1605(94)90162-7 Zupan, 1991, Neural networks: a new method for solving chemical problems or just a passing phase?, Anal. Chim. Acta, 248, 1, 10.1016/S0003-2670(00)80865-X Zupan, 1993