Adaptive efficient analysis for big data ergodic diffusion models
Tóm tắt
We consider drift estimation problems for high dimension ergodic diffusion processes in nonparametric setting based on observations at discrete fixed time moments in the case when diffusion coefficients are unknown. To this end on the basis of sequential analysis methods we develop model selection procedures, for which we show non asymptotic sharp oracle inequalities. Through the obtained inequalities we show that the constructed model selection procedures are asymptotically efficient in adaptive setting, i.e. in the case when the model regularity is unknown. For the first time for such problem, we found in the explicit form the celebrated Pinsker constant which provides the sharp lower bound for the minimax squared accuracy normalized with the optimal convergence rate. Then we show that the asymptotic quadratic risk for the model selection procedure asymptotically coincides with the obtained lower bound, i.e this means that the constructed procedure is efficient. Finally, on the basis of the constructed model selection procedures in the framework of the big data models we provide the efficient estimation without using the parameter dimension or any sparse conditions.
Tài liệu tham khảo
Bayisa FL, Zhou Z, Cronie O, Yu J (2019) Adaptive algorithm for sparse signal recovery. Digit Signal Proc 87:10–18
Comte F, Genon-Catalot V, Rozenholc Y (2009) Non-parametric estimation for a discretely observed integrated diffusion model. Stoch Process Appl 119:811–834
Dalalyan AS (2005) Sharp adaptive estimation of the drift function for ergodic diffusion. Ann Stat 33(6):2507–2528
Dalalyan AS, Kutoyants YuA (2002) Asymptotically efficient trend coefficient estimation for ergodic diffusion. Math Methods Stat 11(4):402–427
Fan J, Fan Y, Barut E (2014) Adaptive robust variable selection. Ann Stat 42(1):324–351
Florens-Zmirou D (1993) On estimating the diffusion coefficient from discrete observations. J Appl Probab 30(4):790–804
Fujimori K (2019) The Danzing selector for a linear model of diffusion processes. Stat Infer Stoch Process 22:475–498
De Gregorio A, Iacus SM (2012) Adaptive LASSO-type estimation for multivariate diffusion processes. Econ Theory 28(4):838–860
Galtchouk LI (1978) Existence and uniqueness of a solution for stochastic equations with respect to semimartingales. Theory Probab Appl 23:751–763
Galtchouk L, Pergamenshchikov S (2001) Sequential nonparametric adaptive estimation of the drift coefficient in diffusion processes. Math Methods Stat 10(3):316–330
Galtchouk L, Pergamenshchikov S (2004) Nonparametric sequential estimation of the drift in diffusion via model selection. Math Methods Stat 13:25–49
Galtchouk L, Pergamenshchikov S (2005) Nonparametric sequential minimax estimation of the drift coefficient in diffusion processes. Sequ Anal 24(3):303–330
Galtchouk L, Pergamenshchikov S (2006) Asymptotically efficient sequential kernel estimates of the drift coefficient in ergodic diffusion processes. Stat Infer Stoch Process 9:1–16
Galtchouk L, Pergamenshchikov S (2007) Uniform concentration inequality for ergodic diffusion processes. Stoch Process Appl 117:830–839
Galtchouk L, Pergamenshchikov S (2009a) Sharp non-asymptotic oracle inequalities for nonparametric heteroscedastic regression models. J Nonparametr Stat 21:1–16
Galtchouk L, Pergamenshchikov S (2009b) Adaptive asymptotically efficient estimation in heteroscedastic nonparametric regression. J Korean Stat Soc 38(4):305–322
Galtchouk L, Pergamenshchikov S (2011) Adaptive sequential estimation for ergodic diffusion processes in quadratic metric. J Nonparametr Stat 23(2):255–285
Galtchouk L, Pergamenshchikov S (2013) Uniform concentration inequality for ergodic diffusion processes observed at discrete times. Stoch Process Appl 123(1):91–109
Galtchouk L, Pergamenshchikov S (2014) Geometric ergodicity for classes of homogeneous Markov chains. Stoch Process Appl 124(10):3362–3391
Galtchouk L, Pergamenshchikov S (2015) Efficient pointwise estimation based on discrete data in ergodic nonparametric diffusions. Bernoulli 21(4):2569–2594
Galtchouk L, Pergamenshchikov S (2019) Non asymptotic sharp oracle inequalities for high dimensional ergodic diffusion models. Preprint https://hal.archives-ouvertes.fr/hal-02387034 (2019)
Gihman II, Skorohod AV (1968) Stochastic differential equations. Naukova Dumka, Kiev
Gobet E, Hoffmann M, Reiss M (2004) Nonparametric estimation of scalar diffusions based on low frequency data. Ann Stat 32(5):2223–2253
Hoffmann M (1999) Adaptive estimation in diffusion processes. Stoch Process Appl 79:135–163
Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning. Data mining, inference and prediction. Springer series in statistics. Springer, Berlin
Jacod J (2000) Non-parametric kernel estimation of the coefficient of a diffusion. Scand J Stat 27(1):83–96
Kabanov YM, Pergamenshchikov SM (2003) Two scale stochastic systems: asymptotic analysis and control. Applications of mathematics, stochastic modelling and applied probability, vol 49. Springer Berlin
Karatzas I, Shreve SE (1998a) Brownian motion and stochastic calculus. Graduate texts in mathematics, 2nd edn. Springer Science+Business Media, New York
Karatzas I, Shreve SE (1998b) Methods of mathematical finance. Springer, New York
Kutoyants YuA (1977) Estimation of the signal parameter in a Gaussian noise. Probl Inf Transm 13(4):29–38
Kutoyants YuA (1984a) Parameter estimation for stochastic processes. Heldeman-Verlag, Berlin
Kutoyants YuA (1984b) On nonparametric estimation of trend coefficients in a diffusion process. Statistics and control of stochastic processes. Steklov seminar proceedings, Moscow, pp 230–250
Kutoyants YuA (2003) Statistical inferences for ergodic diffusion processes. Springer, Berlin
Konev VV, Pergamenshchikov SM (2015) Robust model selection for a semimartingale continuous time regression from discrete data. Stoch Process Appl 125:294–326
Lamberton D, Lapeyre B (1996) Introduction to stochastic calculus applied to finance. Chapman & Hall, London
Pinsker MS (1981) Optimal filtration of square integrable signals in gaussian noise. Probl Inf Transm 17:120–133