Moments and root-mean-square error of the Bayesian MMSE estimator of classification error in the Gaussian model

Pattern Recognition - Tập 47 - Trang 2178-2192 - 2014
Amin Zollanvari1,2, Edward R. Dougherty1,3
1Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, United States
2Department of Statistics, Texas A&M University, College Station, TX 77843, United States
3Translational Genomics Research Institute (TGEN), Phoenix, AZ 85004, United States

Tài liệu tham khảo

Hills, 1966, Allocation rules and their error rates, J. R. Stat. Soc. Ser. B (Methodological), 28, 1 Foley, 1972, Considerations of sample and feature size, IEEE Trans. Inf. Theory, IT18, 618, 10.1109/TIT.1972.1054863 Sorum, 1971, Estimating the conditional probability of misclassification, Technometrics, 13, 333, 10.1080/00401706.1971.10488788 McLachlan, 1973, An asymptotic expansion of the expectation of the estimated error rate in discriminant analysis, Aust. J. Stat., 15, 210, 10.1111/j.1467-842X.1973.tb00201.x Moran, 1975, On the expectation of errors of allocation associated with a linear discriminant function, Biometrika, 62, 141, 10.1093/biomet/62.1.141 Berikov, 2002, A priori estimates of recognition quality for discrete features, Pattern Recognit. Image Anal., 12, 235 Berikov, 2003, The influence of prior knowledge on the expected performance of a classifier, Pattern Recognit. Lett., 24, 2537, 10.1016/S0167-8655(03)00099-0 Braga-Neto, 2005, Exact performance measures and distributions of error estimators for discrete classifiers, Pattern Recognit., 38, 1799, 10.1016/j.patcog.2005.02.013 Glick, 1978, Additive estimators for probabilities of correct classification, Pattern Recognit., 10, 211, 10.1016/0031-3203(78)90029-8 Fukunaga, 1989, Estimation of classifier performance, IEEE Trans. Pattern Anal. Mach. Intell., 11, 1087, 10.1109/34.42839 Raudys, 2001 Zollanvari, 2009, On the sampling distribution of resubstitution and leave-one-out error estimators for linear classifiers, Pattern Recognit., 42, 2705, 10.1016/j.patcog.2009.05.003 Braga-Neto, 2010, Exact correlation between actual and estimated errors in discrete classification, Pattern Recognit. Lett., 31, 407, 10.1016/j.patrec.2009.10.017 Zollanvari, 2012, Exact representation of the second-order moments for resubstitution and leave-one-out error estimation for linear discriminant analysis in the univariate heteroskedastic gaussian model, Pattern Recognit., 45, 908, 10.1016/j.patcog.2011.08.006 Zollanvari, 2010, Joint sampling distribution between actual and estimated classification errors for linear discriminant analysis, IEEE Trans. Inf. Theory, 56, 784, 10.1109/TIT.2009.2037034 Zollanvari, 2011, Analytic study of performance of error estimators for linear discriminant analysis, IEEE Trans. Signal Process., 59, 4238, 10.1109/TSP.2011.2159210 Wyman, 1990, A comparison of asymptotic error rate expansions for the sample linear discriminant function, Pattern Recognit., 23, 775, 10.1016/0031-3203(90)90100-Y Pikelis, 1976, Comparison of methods of computing the expected classification errors, Autom. Remote Control, 5, 59 Raudys, 1972, On the amount of a priori information in designing the classification algorithm, Tech. Cybern., 4, 168 Deev, 1970, Representation of statistics of discriminant analysis and asymptotic expansion when space dimensions are comparable with sample size, Dokl. Akad. Nauk SSSR, 195, 759 Fujikoshi, 2000, Error bounds for asymptotic approximations of the linear discriminant function when the sample size and dimensionality are large, J. Multivar. Anal., 73, 1, 10.1006/jmva.1999.1862 Serdobolskii, 2000 Bickel, 2004, Some theory for Fisher's linear discriminant function, ‘naive bayes', and some alternatives when there are many more variables than observations, Bernoulli, 10, 989, 10.3150/bj/1106314847 Raudys, 2004, Results in statistical discriminant analysis, J. Multivar. Anal., 89, 1, 10.1016/S0047-259X(02)00021-0 Dougherty, 2010, Performance of error estimators for classification, Curr. Bioinforma., 5, 53, 10.2174/157489310790596385 Dougherty, 2011, The illusion of distribution-free small-sample classification in genomics, Curr. Genomics, 12, 333, 10.2174/138920211796429763 Dalton, 2011, Bayesian minimum mean-square error estimation for classification error–Part I, IEEE Trans. Signal Process., 59, 115, 10.1109/TSP.2010.2084572 Dalton, 2011, Bayesian minimum mean-square error estimation for classification error—Part II, IEEE Trans. Signal Process., 59, 130, 10.1109/TSP.2010.2084573 Dalton, 2012, Exact sample conditioned MSE performance of the Bayesian MMSE estimator for classification error—Part I, IEEE Trans. Signal Process., 60, 2575, 10.1109/TSP.2012.2184101 Dalton, 2012, Exact sample conditioned MSE performance of the Bayesian MMSE estimator for classification error—Part II, IEEE Trans. Signal Process., 60, 2588, 10.1109/TSP.2012.2184102 Anderson, 1951, Classification by multivariate analysis, Psychometrika, 16, 31, 10.1007/BF02313425 John, 1961, Errors in discrimination, Ann. Math. Stat., 32, 1125, 10.1214/aoms/1177704851 Devroye, 1996 Kan, 2008, From moments of sum to moments of product, J. Multivar. Anal., 99, 542, 10.1016/j.jmva.2007.01.013 Bao, 2010, Expectation of quadratic forms in normal and nonnormal variables with econometric applications, J. Stat. Plan. Inference, 140, 1193, 10.1016/j.jspi.2009.11.002