Partial least squares for discrimination

Journal of Chemometrics - Tập 17 Số 3 - Trang 166-173 - 2003
Matthew L Barker1, William S. Rayens2
1Biometrics and Statistical Sciences, The Procter and Gamble Company, Mason, OH 45040, USA
2Department of Statistics, University of Kentucky, Lexington, KY 40506, USA

Tóm tắt

AbstractPartial least squares (PLS) was not originally designed as a tool for statistical discrimination. In spite of this, applied scientists routinely use PLS for classification and there is substantial empirical evidence to suggest that it performs well in that role. The interesting question is: why can a procedure that is principally designed for overdetermined regression problems locate and emphasize group structure? Using PLS in this manner has heurestic support owing to the relationship between PLS and canonical correlation analysis (CCA) and the relationship, in turn, between CCA and linear discriminant analysis (LDA). This paper replaces the heuristics with a formal statistical explanation. As a consequence, it will become clear that PLS is to be preferred over PCA when discrimination is the goal and dimension reduction is needed. Copyright © 2003 John Wiley & Sons, Ltd.

Từ khóa


Tài liệu tham khảo

Gottfries J, 1995, Diagnosis of dementias using partial least squares discriminant analysis, Dementia, 6, 83

10.1021/jf950305a

10.1016/0169-7439(89)80121-2

10.1002/qsar.19860050202

Delwiche S, 1972, Differentiation of hard red wheat by near‐infrared analysis of bulk samples, Grain Qual., 3, 243

10.3109/08039489509011931

10.1039/an9962101009

10.1111/j.1365-2621.1997.tb04377.x

10.1002/cem.1180020406

10.1016/0003-2670(86)80028-9

10.1080/03610918808812681

Helland IS, 1992, Maximum likelihood regression on relevant components, J. R. Statist. Soc. B, 54, 637

10.1002/cem.1180020306

10.1016/0169-7439(92)80092-I

Wold H, 1966, Multivariate Analysis, 391

Wold H, 1981, Systems under Indirect Observation, Causality–Structure–Prediction, 1

Wold S, 1983, Proceedings from the Conference on Matrix Pencils, 286, 10.1007/BFb0062108

BarkerM.Partial least squares for discrimination.PhD Dissertation University of Kentucky 2000.

10.1080/00401706.1993.10485033

10.1016/0169-7439(95)00062-3

HinkleJandRayensWS.Partial least squares reciprocal components and reciprocal curves.Proceedings from the 1998 Joint Statistical Meetings Dallas TX 1998;126–130.

Stone M, 1990, Continuum regression: cross‐validated sequentially constructed prediction embracing ordinary least squares, partial least squares, and principal component regression, J. R. Statist. Soc. B, 52, 237

HinkleJ.Reciprocal components reciprocal curves and partial least squares.PhD Dissertation University of Kentucky 1995.

10.1111/j.1469-1809.1936.tb02137.x

10.2307/2683679

10.1017/S0305004100019897

10.1002/0471725293

10.1080/00401706.1968.10490530

Rayens WS, 2003, Oriented partial least squares, Ital. J. Appl. Statist.

RayensWS.The art of maximizing covariance.University of Kentucky Technical Report 383 2000.