Exact and approximate algorithms for variable selection in linear discriminant analysis

Akaike, 1974, A new look at statistical model identification, IEEE Transactions on Automatic Control, 19, 716, 10.1109/TAC.1974.1100705 Beale, 1967, The discarding of variables in multivariate analysis, Biometrika, 54, 357, 10.1093/biomet/54.3-4.357 Breiman, 1984 Brusco, 2001, A variable-selection heuristic for k-means clustering, Psychometrika, 66, 249, 10.1007/BF02294838 Brusco, 2005 Brusco, 2010, Neighborhood search heuristics for selecting hierarchically well-formulated subsets in polynomial regression, Naval Research Logistics, 57, 33, 10.1002/nav.20380 Brusco, 2009, Variable neighborhood search heuristics for selecting a subset of variables in principal component analysis, Psychometrika, 74, 705, 10.1007/s11336-009-9130-3 Brusco, 2009, An exact algorithm for hierarchically well-formulated subsets in second-order polynomial regression, Technometrics, 51, 306, 10.1198/tech.2009.08022 Cadima, 2004, Computational aspects of algorithms for variable selection in the context of principal components, Computational Statistics and Data Analysis, 47, 225, 10.1016/j.csda.2003.11.001 Drezner, 1999, Tabu search model selection in multiple regression analysis, Communications in Statistics, 28, 349, 10.1080/03610919908813553 Duarte Silva, 2001, Efficient variable screening for multivariate analysis, Journal of Multivariate Analysis, 76, 35, 10.1006/jmva.2000.1920 Fisher, 1936, The use of multiple measurements in taxonomic problems, Annals of Eugenics, 7, 179, 10.1111/j.1469-1809.1936.tb02137.x Fisher, 1938, The statistical utilization of multiple measurements, Annals of Eugenics, 8, 376, 10.1111/j.1469-1809.1938.tb02189.x Fueda, 2009, Variable selection in multivariate methods using global score estimation, Computational Statistics, 24, 127, 10.1007/s00180-008-0109-9 Fujikoshi, 1983, A criterion for variable selection in multiple discriminant analysis, Hiroshima Mathematical Journal, 13, 203, 10.32917/hmj/1206133544 Furnival, 1971, All possible regressions with less computation, Technometrics, 13, 403, 10.2307/1266801 Furnival, 1974, Regression by leaps and bounds, Technometrics, 16, 499, 10.2307/1267601 Ganeshanandam, 1989, On selecting variables and assessing their performance in linear discriminant analysis, Australian Journal of Statistics, 31, 433, 10.1111/j.1467-842X.1989.tb00988.x Gatu, 2006, Branch-and-bound algorithms for computing the best-subset regression models, Journal of Computational and Graphical Statistics, 15, 139, 10.1198/106186006X100290 Glover, 1993, Tabu search, 70 Habbema, 1977, Selection of variables in discriminant analysis by—statistic and error rate, Technometrics, 19, 487, 10.2307/1267890 Hand, 1981 Hansen, 2003, Variable neighborhood search, 145 Hogarty, 2004, Selection of variables in exploratory factor analysis: an empirical comparison of a stepwise and traditional approach, Psychometrika, 69, 593, 10.1007/BF02289857 Horton, 1968, Multivariate-covariance and canonical analysis: a method for selecting the most effective discriminators in a multivariate situation, Biometrics, 24, 845, 10.2307/2528875 Huberty, 1984, Issues in the use and interpretation of discriminant analysis, Psychological Bulletin, 95, 156, 10.1037/0033-2909.95.1.156 Huberty, 2006 Johnson, 2007 Jolliffe, 2002 Kano, 2000, Stepwise variable selection in factor analysis, Psychometrika, 65, 7, 10.1007/BF02294182 Kendall, 1957 Krzanowski, 2009, A simple method for screening variables before clustering of microarray data, Computational Statistics and Data Analysis, 53, 2747, 10.1016/j.csda.2009.02.001 MathWorks, Inc. 2005. Using MATLAB. Version 7. Natick, MA. The MathWorks, Inc. McCabe, 1975, Computations for variable selection in discriminant analysis, Technometrics, 17, 103, 10.2307/1268007 McHenry, 1978, An efficient computational procedure for selecting a best subset, Applied Statistics, 27, 291, 10.2307/2347164 McKay, 1982, Variable selection techniques in discriminant analysis: I. Description, British Journal of Mathematical and Statistical Psychology, 35, 1, 10.1111/j.2044-8317.1982.tb00638.x McKay, 1982, Variable selection techniques in discriminant analysis: II. Allocation, British Journal of Mathematical and Statistical Psychology, 35, 30, 10.1111/j.2044-8317.1982.tb00639.x McLachlan, 1976, A criterion for selecting variables for the linear discriminant function, Biometrics, 32, 529, 10.2307/2529742 McLachlan, 1992 Miller, 2002 Mori, 2007, Variable selection in principal component analysis, 265 Moscato, 2003, A gentle introduction to memetic algorithms, 105 Murphy, P.M., Aha, D.W., 1994. UCI repository of machine learning. Department of Information and Computer Science, University of California. http://www.ics.uci.edu/mlearn/MLRepository.html. Murray, 1977, A cautionary note on selection of variables in discriminant analysis, Applied Statistics, 26, 246, 10.2307/2346964 Pacheco, 2009, A variable selection method based on tabu search for logistic regression models, European Journal of Operational Research, 199, 506, 10.1016/j.ejor.2008.10.007 Pacheco, 2006, Analysis of new variable selection methods for discriminant analysis, Computational Statistics and Data Analysis, 51, 1463, 10.1016/j.csda.2006.04.019 Peixoto, 1987, Hierarchical variable selection in polynomial regression models, American Statistician, 41, 311, 10.2307/2684752 Robert, 1976, A unifying tool for linear multivariate statistical methods, Applied Statistics, 25, 257, 10.2307/2347233 Roy, 1958, Step-down procedures in multivariate statistics, Annals of Mathematical Statistics, 29, 177, 10.1214/aoms/1177706449 Seaman, 1990, A non-parametric variable selection algorithm for allocatory discriminant analysis, Educational and Psychological Measurement, 50, 837, 10.1177/0013164490504012 Smith, 1947, Some examples of discrimination, Annals of Eugenics, 13, 272, 10.1111/j.1469-1809.1946.tb02368.x Snappin, 1989, Estimation of error rates in discriminant analysis with selection of variables, Biometrics, 45, 289, 10.2307/2532053 Stam, 1997, Nontraditional approaches to statistical classification: some perspectives on Lp-norm methods, Annals of Operations Research, 74, 1, 10.1023/A:1018958001886 Steinley, 2008, Selection of variables in cluster analysis: an empirical comparison of eight procedures, Psychometrika, 73, 125, 10.1007/s11336-007-9019-y Trendafilov, 2007, DALASS: variable selection in discriminant analysis via the lasso, Computational Statistics and Data Analysis, 51, 3718, 10.1016/j.csda.2006.12.046 Urbakh, 1971, Linear discriminant analysis: loss of discriminating power when a variable is omitted, Biometrics, 27, 531, 10.2307/2528594 Weiner, 1966, Elimination of variates in linear discrimination problems, Biometrics, 22, 268, 10.2307/2528518 Wood, 2005, Variable selection for discriminant analysis of fish sounds using matrix correlations, Journal of Agricultural, Biological and Environmental Statistics, 10, 1, 10.1198/108571105X58540