A new algorithm for the least-squares solution in factor analysis
Tóm tắt
A new algorithm to obtain the least-squares or MINRES solution in common factor analysis is presented. It is based on the up-and-down Marquardt algorithm developed by the present authors for a general nonlinear least-squares problem. Experiments with some numerical models and some empirical data sets showed that the algorithm worked nicely and that SMC (Squared Multiple Correlation) performed best among four sets of initial values for common variances but that the solution might sometimes be very sensitive to fluctuations in the sample covariance matrix.
Tài liệu tham khảo
Mattsson, A., Olsson, U. & Rosen, M. The maximum likelihood method in factor analysis with special consideration to the problem of improper solutions. Research Report, Institute of Statistics, University of Uppsala, 1966.
Anderson, T. W. & Rubin, H. Statistical inference in factor analysis.Proceedings of the Third Berkeley Symposium, 1956,5, 111–150.
Bechtoldt, H. P. An empirical study of the factor analysis stability hypothesis.Psychometrika, 1961,26, 405–432.
Derflinger, G. Efficient methods for obtaining minres and maximum likelihood solutions in factor analysis.Metrika, 1969,14, 214–231.
Derflinger, G. A general computing algorithm for factor analysis.Biometrical Journal, 1979,21, 25–38.
Driel, O. P. van. On various causes of improper solutions in maximum likelihood factor analysis.Psychometrika, 1978,43, 225–243.
Emmett, W. G. Factor analysis by Lawley's method of maximum likelihood.British Journal of Psychology and Statistics, 1949,2, 90–97.
Fukutomi, K. On the adequacy of factor extractions.TRU Mathematics, 1972,7, 119–136.
Guttman, L. “Best possible” systematic estimates of communalities.Psychometrika, 1956,21, 273–285.
Harman, H. H.Modern factor analysis. 3rd ed. Chicago: Univ. of Chicago Press, 1976.
Harman, H. H. & Jones, W. H. Factor analysis by minimizing residuals (minres).Psychometrika, 1966,31, 351–368.
Jöreskog, K. G. Some contributions to maximum likelihood factor analysis.Psychometrika, 1967,32, 443–482.
Levenberg, K. A method for the solution of certain non-linear problems in least squares.Quarterly of Applied Mathematics, 1944,2, 164–168.
Marquardt, D. W. An algorithm for least-squares estimation of non-linear parameters.SIAM Journal, 1963,11, 431–441.
Nosal, M. A note on the MINRES method.Psychometrika, 1977,42, 149–151.
Okamoto, M. & Ihara, M. A simple Marquardt algorithm for the nonlinear least-squares problem.Statistics and Probability Letters, 1983 (in press).
Rao, C. R. Estimation and tests of significance in factor analysis.Psychometrika, 1955,20, 93–111.
Tumura, Y. & Fukutomi, K. On the improper solutions in factor analysis.TRU mathematics, 1970,6, 63–71.