Rational approximations of spectral densities based on the Alpha divergence
Tóm tắt
We approximate a given rational spectral density by one that is consistent with prescribed second-order statistics. Such an approximation is obtained by selecting the spectral density having minimum “distance” from under the constraint corresponding to imposing the given second-order statistics. We analyze the structure of the optimal solutions as the minimized “distance” varies in the Alpha divergence family. We show that the corresponding approximation problem leads to a family of rational solutions. Secondly, such a family contains the solution which generalizes the Kullback–Leibler solution proposed by Georgiou and Lindquist in 2003. Finally, numerical simulations suggest that this family contains solutions close to the non-rational solution given by the principle of minimum discrimination information.
Tài liệu tham khảo
Amari SI (1985) Differential-geometrical methods in statistics. Springer, Berlin
Aujla JS (2011) A simple proof of Lieb concavity theorem. J Math Phys 52(4):043505
Blomqvist A, Lindquist A, Nagamune R (2003) Matrix-valued Nevanlinna-Pick interpolation with complexity constraint: an optimization approach. IEEE Trans Autom Control 48(12):2172–2190
Boyd S, Vandenberghe L (2004) Convex optimization. Cambridge University Press, Cambridge
Byrnes C, Georgiou TT, Lindquist A (2000) A new approach to spectral estimation: a tunable high-resolution spectral estimator. IEEE Trans Signal Process 48(11):3189–3205
Cichocki A, Amari SI (2010) Families of Alpha- Beta- and Gamma- divergences: flexible and robust measures of similarities. Entropy 12(6):1532–1568
Cover TM, Thomas JA (1991) Information Theory. Wiley, New York
Csiszar I, Matus F (2003) Information projections revisited. IEEE Trans Inform Theory 49(6):1474–1490
Ferrante A, Masiero C, Pavon M (2012) Time and spectral domain relative entropy: a new approach to multivariate spectral estimation. IEEE Trans Autom Control 57(10):2561–2575
Ferrante A, Pavon M, Ramponi F (2007) Further results on the Byrnes-Georgiou-Lindquist generalized moment problem. In: Chiuso A, Ferrante A, Pinzoni S (eds) Modeling, Estimation and Control: Festschrift in honor of Giorgio Picci on the occasion of his sixty-fifth birthday. Springer, Berlin, pp 73–83
Ferrante A, Pavon M, Ramponi F (2008) Hellinger versus Kullback–Leibler multivariable spectrum approximation. IEEE Trans Autom Control 53(4):954–967
Ferrante A, Pavon M, Zorzi M (2012) A maximum entropy enhancement for a family of high-resolution spectral estimators. IEEE Trans Autom Control 57(2):318–329
Ferrante A, Ramponi F, Ticozzi F (2011) On the convergence of an efficient algorithm for Kullback–Leibler approximation of spectral densities. IEEE Trans Autom Control 56(3):506–515
Georgiou TT (1999) The interpolation problem with a degree constraint. IEEE Trans Autom Control 44(3):631–635
Georgiou TT (2002) Spectral analysis based on the state covariance: the maximum entropy spectrum and linear fractional parametrization. IEEE Trans Autom Control 47(11):1811–1823
Georgiou TT (2002) The structure of state covariances and its relation to the power spectrum of the input. IEEE Trans Autom Control 47(7):1056–1066
Georgiou TT (2006) Relative entropy and the multivariable multidimensional moment problem. IEEE Trans Inform Theory 52(3):1052–1066
Georgiou TT, Lindquist A (2003) Kullback–Leibler approximation of spectral density functions. IEEE Trans Inform Theory 49(11):2910–2917
Kullback S (1959) Information Theory and Statistics. Wiley, New York
Pavon M, Ferrante A (2006) On the Georgiou–Lindquist approach to constrained Kullback–Leibler approximation of spectral densities. IEEE Trans Autom Control 51(4):639–644
Ramponi F, Ferrante A, Pavon M (2009) A globally convergent matricial algorithm for multivariate spectral estimation. IEEE Trans Autom Control 54(10):2376–2388
Zorzi M (2012) A new family of high-resolution multivariate spectral estimators. http://arxiv.org/abs/1210.8290. Accessed 31 Oct 2012
Zorzi M, Ferrante A (2012) On the estimation of structured covariance matrices. Automatica 48(9):2145–2151