Akaike's Information Criterion and Recent Developments in Information Complexity

Journal of Mathematical Psychology - Tập 44 - Trang 62-91 - 2000
Hamparsum Bozdogan1
1The University of Tennessee

Tài liệu tham khảo

Akaike, 1973, Information theory and an extension of the maximum likelihood principle, 267 Akaike, 1974, A new look at the statistical model identification, IEEE Transactions on Automatic Control, 19, 716, 10.1109/TAC.1974.1100705 Akaike, 1981, Likelihood of a model and information criteria, Journal of Econometrics, 16, 3, 10.1016/0304-4076(81)90071-3 Akaike, 1987, Factor analysis and AIC, Psychometrika, 52, 317, 10.1007/BF02294359 Balasubramanian, V. 1996, A geometric formulation of Occam's razor for inference of parametric distributions. Unpublished paper available as preprint number adap-org/9601001 from, http://xyz.lanl.gov/, and as Princeton University Physics Preprint PUPT-1588, January 1996. Baxter, 1996 Bearse, 1998, Subset selection in vector autoregressive (VAR) models using the genetic algorithm with informational complexity as the fitness function, Systems Analysis, Modeling, Simulation (SAMS), 31, 61 Behboodian, 1964 Bhansali, 1977, Some properties of the order of an autoregressive model selected by a generalization of Akaike's FPE criterion, Biometrika, 64, 547 Boltzmann, 1877, Über die Beziehung zwischen dem zweiten Hauptsatze der mechanischen Wärmetheorie und der Wahrscheinlichkeitsrechnung respective den Satzen über das Wärmegleichgewicht, Wiener Berichte, 76, 373 Bozdogan, 1987, Model selection and Akaike's information criterion (AIC): The general theory and its analytical extensions, Psychometrika, 52, 345, 10.1007/BF02294361 Bozdogan, 1987, ICOMP: A new model-selection criterion, Classification and related methods of data analysis Bozdogan, 1988, ICOMP: A new model-selection criterion, 599 Bozdogan, 1988, The theory and applications of information-theoretic measure of complexity (ICOMP) as a new model selection criterion, Unpublished research report Bozdogan, 1990, On the information-based measure of covariance complexity and its application to the evaluation of multivariate linear models, Communications in statistics theory and methods, 19, 221, 10.1080/03610929008830199 Bozdogan, 1994, Theory & methodology of time series analysis, Proceedings of the first US/Japan conference on the frontiers of statistical modeling: An informational approach, 1 Bozdogan, 1994, Multivariate statistical modeling, Proceedings of the first US/Japan conference on the frontiers of statistical modeling: An informational approach, 2 Bozdogan, 1994, Engineering & scientific applications of informational modeling, Proceedings of the first US/Japan conference on the frontiers of statistical modeling: An informational approach, 3 Bozdogan, 1994, Mixture-model cluster analysis using model selection criteria and a new informational measure of complexity, 2, 69 Bozdogan, 1996 Bozdogan, 1998 Bozdogan, 1998 Bozdogan, 2000, Model selection using informational complexity with appplications to vector autoregressive (VAR) models, Journal of Statistical Planning and Inference Bozdogan, 1998, Informational complexity criteria for regression models, Computational Statistics and Data Analysis, 10.1016/S0167-9473(98)00025-5 Chen, 1996 Chen, 1998 Chernoff, 1956, Large sample theory: Parametric case, Annals of Mathematical Statistics, 27, 1, 10.1214/aoms/1177728347 Cover, 1989, Kolmogorov's contributions to information theory and algorithmic complexity, Annals of Probability, 17, 840, 10.1214/aop/1176991250 Cox, 1984, Effective degrees of freedom and the likelihood ratio test, Biometrika, 71, 487, 10.1093/biomet/71.3.487 Forster, 1999, The new science of simplicity Finn, 1974 Graham, 1987 Hannan, 1986, Remembrance of things past Harris, 1978, An information theoretic approach to estimation, 563 Hosking, 1980, Lagrange-multiplier tests of time-series models, Journal of the Royal Statistics Society, (Series B), 42, 170 Hurvich, 1989, Regression and time series model selection in small samples, Biometrika, 76, 297, 10.1093/biomet/76.2.297 Kitagawa, 1996 Kolmogorov, 1983, Combinatorial foundations of information theory and the calculus of probabilities, Russian Math Surveys, 38, 29, 10.1070/RM1983v038n04ABEH004203 Konishi, 1996, Generalized information criteria in model-selection, Biometrika, 83, 875, 10.1093/biomet/83.4.875 Konishi, 1998, Statistical model evaluation and information criteria Kullback, 1968 Kullback, 1951, On information and sufficiency, Annals of Mathematical Statistics, 22, 79, 10.1214/aoms/1177729694 Li, 1996, Using parameter sensitivity and interdependence to predict model scope and falsifiability, Journal of Experimental Psychology, 125, 360, 10.1037/0096-3445.125.4.360 Ljung, 1978, On canonical forms, parameter identifiability and the concept of complexity, 1415 Lutkepohl, 1993 Magnus, 1988 Maklad, 1980, A new approach to model structure discrimination, IEEE Transactions on Systems, Man, and Cybernetics, 10, 78, 10.1109/TSMC.1980.4308436 Morgera, 1985, Information theoretic covariance complexity and its relation to pattern recognition, IEEE Transactions on Systems, Man, and Cybernetics, 15, 608, 10.1109/TSMC.1985.6313437 Mustonen, 1997, A measure of total variability in multivariate normal distribution, Computational Statistics and Data Analysis, 23, 321, 10.1016/S0167-9473(96)00042-4 Rissanen, 1976, Minmax entropy estimation of models for vector processes, 97 Rissanen, 1978, Modeling by shortest data description, Automatica, 14, 465, 10.1016/0005-1098(78)90005-5 Rissanen, 1986, Stochastic complexity and modeling, Annals of Statistics, 14, 1080, 10.1214/aos/1176350051 Rissanen, 1987, Stochastic complexity (with discussion), Journal of Royal Statistical Society, (Series B), 49, 223 Rissanen, 1989 Ross, 1970, The efficient use of function minimization in nonlinear maximum likelihood estimation, Applied Statistics, 19, 205, 10.2307/2346325 Schwarz, 1978, Estimating the dimension of a model, Annals of Statistics, 6, 461, 10.1214/aos/1176344136 Sclove, 1987, Application of model-selection criteria to some problems in multivariate analysis, Psychometrika, 52, 333, 10.1007/BF02294360 Seber, G. A. F, &, Wild, C. J. 1989, Nonlinear regression, New York, Wiley. Shannon, 1948, A mathematical theory of communication, Bell Systems Technology Journal, 27, 379, 10.1002/j.1538-7305.1948.tb01338.x Shibata, 1989, Statistical aspects of model selection, 216 Sugiura, 1978, Further analysis of the data by Akaike's information criterion and the finite corrections, Communications in Statistics, Theory and Methods, A7, 13, 10.1080/03610927808827599 Takeuchi, 1976, Distribution of information statistics and a criterion of model fitting, Suri-Kagaku (Mathematical Sciences), 153, 12 Theil, 1984 van Emden, 1971 Wallace, 1987, Estimation and inference by compact coding (with discussion), Journal of Royal Statistical Society, (Series B), 49, 240 Wallace, 1993, MML estimation of the von Mises concentration parameter, Technical Report Watanabe, 1985 White, 1982, Maximum likelihood estimation of misspecified models, Econometrica, 50, 1, 10.2307/1912526 Woodroofe, 1982, On model selection and the arc sine law, Annals of Statistics, 10, 1182, 10.1214/aos/1176345983