Independent component analysis: recent advances
Tóm tắt
Independent component analysis is a probabilistic method for learning a linear transform of a random vector. The goal is to find components that are maximally independent and non-Gaussian (non-normal). Its fundamental difference to classical multi-variate statistical methods is in the assumption of non-Gaussianity, which enables the identification of original, underlying components, in contrast to classical methods. The basic theory of independent component analysis was mainly developed in the 1990s and summarized, for example, in our monograph in 2001. Here, we provide an overview of some recent developments in the theory since the year 2000. The main topics are: analysis of causal relations, testing independent components, analysing multiple datasets (three-way data), modelling dependencies between the components and improved methods for estimating the basic model.
Từ khóa
Tài liệu tham khảo
Comon P, 2010, Handbook of blind source separation.
Amari S-I, 1996, Advances in neural information processing systems
Hyvärinen A, 2010, In Proc. Asian Conf. Machine Learning, Tokyo, Japan, 1
Hyvärinen A& Smith SM. Submitted. Pairwise likelihood ratios for estimation of non-Gaussian structural equation models.
Shimizu S, 2006, A linear non-Gaussian acyclic model for causal discovery, J. Mach. Learn. Res., 7, 2003
Lacerda G, 2008, In Proc. 24th Conf. Uncertainty in Artificial Intelligence (UAI2008), Helsinki, Finland.
Shimizu S, 2011, DirectLiNGAM: a direct method for learning a linear non-Gaussian structural equation model, J. Mach. Learn. Res., 12, 1225
Hyvärinen A, 2010, Estimation of a structural vector autoregression model using non-Gaussianity, J. Mach. Learn. Res., 11, 1709
Hoyer PO, 2009, Advances in neural information processing systems
Zhang K, 2009, In Proc. 25th Conf. on Uncertainty in Artificial Intelligence (UAI2009), Montréal, Canada, 647
Hyvärinen A& Ramkumar P. Submitted. Testing independent components by inter-subject or inter-session consistency.
Hyvärinen A, 2012, In Human Brain Mapping Meeting, Beijing, China, 10–14 June 2012.
Harshman RA, 1970, Foundations of the PARAFAC procedure: models and conditions for an explanatory multimodal factor analysis, UCLA Working Papers Phonetics, 16, 1
Yeredor A, 2010, Handbook of blind source separation
Hyvärinen A, 2006, In Proc. Eur. Symp. Artificial Neural Networks, Bruges, Belgium.
Gruber P, 2009, Proc. Int. Conf. on Independent Component Analysis and Blind Signal Separation (ICA2009), Paraty, Brazil, 259, 10.1007/978-3-642-00599-2_33
Ranzato M, 2010, In Proc. 13th Int. Conf. on Artificial Intelligence and Statistics (AISTATS2010), Sardinia, Italy, 13–15 May 2010.
Hyvärinen A, 2005, Estimation of non-normalized statistical models using score matching, J. Mach. Learn. Res., 6, 695
Gutmann MU, 2012, Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics, J. Mach. Learn. Res., 13, 307
Kawanabe M, 2005, Estimating functions for blind separation when sources have variance dependencies, J. Mach. Learn. Res., 6, 453
Hyvärinen A, 1998, In Proc. Int. Conf. on Artificial Neural Networks (ICANN’98), Skövde, Sweden, 135
Zhang K& Hyvärinen A. 2011 A general linear non-Gaussian state-space model: identifiability identification applications. Proc. Asian Conf. on Machine Learning Tokyo Japan pp. 113–128.
Sasaki H, 2012, In Proc. Asian Conf. on Machine Learning, Singapore.
Bach FR, 2003, Beyond independent components: trees and clusters, J. Mach. Learn. Res., 4, 1205
Zoran D, 2010, Advances in neural information processing systems, 22
Pham D-T, 2002, In Proc. Int. Conf. on Digital Signal Processing (DSP2002), 151
Pham D-T& Cardoso J-F. 2003 Source adaptive blind source separation: Gaussian models and sparsity. In. In SPIE Conf. Wavelets: Applications in Signal and Image Processing. SPIE.
Kisilev P, 2003, A multiscale framework for blind separation of linearly mixed signals, J. Mach. Learn. Res., 4, 1339
Gribonval R, 2010, Handbook of blind source separation
Hastie T, 2003, In Advances in neural information processing 15 (Proc. NIPS*2002).
Learned-Miller EG, 2003, ICA using spacings estimates of entropy, J. Mach. Learn. Res., 4, 1271
Bach FR, 2002, Kernel independent component analysis, J. Mach. Learn. Res., 3, 1
Gretton A, 2008, Advances in neural information processing systems
Donoho DL, 2004, In Advances in neural information processing 16 (Proc. NIPS*2003)
Hoyer PO, 2004, Non-negative matrix factorization with sparseness constraints, J. Mach. Learn. Res., 5, 1457
Plumbley MD, 2010, Handbook of blind source separation