Optimal design of regularization term and regularization parameter by subspace information criterion

Akaike, 1974, A new look at the statistical model identification, IEEE Transactions on Automatic Control, AC-19, 716, 10.1109/TAC.1974.1100705

Akaike, 1980, Likelihood and the Bayes procedure, 141

Cherkassky, 1999, Model complexity control for regression using VC generalization bounds, IEEE Transactions on Neural Networks, 10, 1075, 10.1109/72.788648

Craven, 1979, Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation, Numerische Mathematik, 31, 377, 10.1007/BF01404567

Fedorov, 1972

Groetsch, 1984, Vol. 105

Hagiwara, 2000, Vol. 4

Konishi, 1996, Generalized information criterion in model selection, Biometrika, 83, 875, 10.1093/biomet/83.4.875

Kunisch, 1998, Iterative choices of regularization parameters in linear inverse problem, Inverse Problem, 14, 1247, 10.1088/0266-5611/14/5/010

MacKay, 1992, Bayesian interpolation, Neural Computation, 4, 415, 10.1162/neco.1992.4.3.415

Mallows, C. L. (1964). Choosing variables in a linear regression: A graphical aid. Central Regional Meeting of the Institute of Mathematical Statistics, Manhattan, KS.

Mallows, 1973, Some comments on CP, Technometrics, 15, 661, 10.2307/1267380

Morozov, 1993

Murata, N. (1998). Bias of estimators and regularization terms, Proceedings of 1998 Workshop on Information-Based Induction Sciences (IBIS'98), Izu, Japan, pp. 87–94.

Murata, N., Yoshizawa, S., & Amari, S. (1994). Network information criterion—determining the number of hidden units for an artificial neural network model. IEEE Transactions on Neural Networks, 5 (6), 865–872.

Orr, 1996

Rasmussen, 1996

Schuurmans, 2000

Shibata, 1989, Statistical aspects of model selection, 215

Sugiyama, 2001, Subspace information criterion for model selection, Neural Computation, 13, 1863, 10.1162/08997660152469387

Sugiyama, 2002, Theoretical and experimental evaluation of subspace information criterion, Machine Learning, 48, 25, 10.1023/A:1013995402903

Vapnik, 1995

Wahba, 1990

Watanabe, 2001, Algebraic analysis for non-identifiable learning machines, Neural Computation, 13, 899, 10.1162/089976601300014402