Prediction for nonlinear time series by improved deep echo state network based on reservoir states reconstruction

M. Casdagli, Nonlinear prediction of chaotic time series. Phys. D, Nonlinear Phenom. 35(3), 335–356 (1989)

Z. Hajirahimi, M. Khashei, Hybrid structures in time series modeling and forecasting: a review. Eng. Appl. Artif. Intell. 86, 83–106 (2019)

N.I. Sapankevych, R. Sankar, Time series prediction using support vector machines: a survey. IEEE Comput. Intell. Mag. 4(2), 24–38 (2009). https://doi.org/10.1109/MCI.2009.932254

G. Heydari, M.A. Vali, A.A. Gharaveisi, Chaotic time series prediction via artificial neural square fuzzy inference system. Expert Syst. Appl. 55, 461–468 (2016)

C. Sun, M. Song, S. Hong et al., A review of designs and applications of echo state networks (2020). arXiv preprint. arXiv:2012.02974

J.L. Elman, Finding structure in time. Cogn. Sci. 14(2), 179–211 (1990)

D.E. Rumelhart, G.E. Hinton, R.J. Williams, Learning internal representations by error propagation, California Univ. San Diego La Jolla Inst. for Cognitive Science, 1985

K. Doya, Bifurcations in the learning of recurrent neural networks 3. Learn. (RTRL) 3, Article ID 17 (1992)

R. Grosse, Lecture 15: Exploding and Vanishing Gradients (University of Toronto Computer Science, 2017)

M. Lukoševičius, H. Jaeger, Reservoir computing approaches to recurrent neural network training. Comput. Sci. Rev. 3(3), 127–149 (2009)

C. Gallicchio, A. Micheli, L. Pedrelli, Deep reservoir computing: a critical experimental analysis. Neurocomputing 268, 87–99 (2017)

Q. Ma, L. Shen, W. Chen et al., Functional echo state network for time series classification. Inf. Sci. 373, 1–20 (2016)

X. Sun, H. Cui, R. Liu et al., Modeling deterministic echo state network with loop reservoir. J. Zhejiang Univ. Sci. C 13(9), 689–701 (2012)

P. Verzelli, C. Alippi, L. Livi, Echo state networks with self-normalizing activations on the hyper-sphere. Sci. Rep. 9(1), 1–14 (2019)

Z. Li, T. Tanaka, HP-ESN: echo state networks combined with Hodrick–Prescott filter for nonlinear time-series prediction, in 2020 International Joint Conference on Neural Networks (IJCNN) (IEEE Press, New York, 2020), pp. 1–9

H. Jaeger, H. Haas, Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304(5667), 78–80 (2004)

H. Jaeger, M. Lukoševičius, D. Popovici et al., Optimization and applications of echo state networks with leaky-integrator neurons. Neural Netw. 20(3), 335–352 (2007)

H.T. Fan, W. Wang, Z. Jin, Performance optimization of echo state networks through principal neuron reinforcement, in 2017 International Joint Conference on Neural Networks (IJCNN) (IEEE Press, New York, 2017), pp. 1717–1723

Š. Babinec, J. Pospíchal, Improving the prediction accuracy of echo state neural networks by anti-Oja’s learning, in International Conference on Artificial Neural Networks (Springer, Berlin, 2007), pp. 19–28

A. Rodan, P. Tino, Minimum complexity echo state network. IEEE Trans. Neural Netw. 22(1), 131–144 (2010)

Y. Yang, X. Zhao, X. Liu, A novel echo state network and its application in temperature prediction of exhaust gas from hot blast stove. IEEE Trans. Instrum. Meas. 69(12), 9465–9476 (2020)

Q. Ma, L. Shen, G.W. Cottrell, DeePr-ESN: a deep projection-encoding echo-state network. Inf. Sci. 511, 152–171 (2020)

Z. Carmichael, H. Syed, S. Burtner et al., Mod-deepesn: modular deep echo state network (2018). arXiv preprint. arXiv:1808.00523

Z. Li, G. Tanaka, Multi-reservoir echo state networks with sequence resampling for nonlinear time-series prediction. Neurocomputing 467, 115–129 (2022)

R. Wcisło, W. Czech, Grouped multi-layer echo state networks with self-normalizing activations, in International Conference on Computational Science (Springer, Cham, 2021), pp. 90–97

Š. Babinec, J. Pospíchal, Merging echo state and feedforward neural networks for time series forecasting, in International Conference on Artificial Neural Networks (Springer, Berlin, 2006), pp. 367–375

K. He, L. Mao, J. Yu et al., Long-term performance prediction of PEMFC based on LASSO-ESN. IEEE Trans. Instrum. Meas. 70, 1–11 (2021)

H. Jaeger, The “echo state” approach to analysing and training recurrent neural networks-with an erratum note, Bonn, Germany: German National Research Center for Information Technology GMD Technical Report, 148(34), 13 (2001)

M. Buehner, P. Young, A tighter bound for the echo state property. IEEE Trans. Neural Netw. 17(3), 820–824 (2006)

R. Wcisło, W. Czech, Grouped multi-layer echo state networks with self-normalizing activations, in International Conference on Computational Science (Springer, Cham, 2021), pp. 90–97

Y. Xue, L. Yang, S. Haykin, Decoupled echo state networks with lateral inhibition. Neural Netw. 20(3), 365–376 (2007)

O.E. Rössler, An equation for continuous chaos. Phys. Lett. A 57(5), 397–398 (1976)

A.S. Weigend, N.A. Gershenfeld, Results of the time series prediction competition at the Santa Fe Institute, in IEEE International Conference on Neural Networks (IEEE Press, New York, 1993), pp. 1786–1793

A.L. Goldberger, L.A.N. Amaral, L. Glass et al., PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation 101(23), e215–e220 (2000)

M. Xu, Y. Yang, M. Han et al., Spatio-temporal interpolated echo state network for meteorological series prediction. IEEE Trans. Neural Netw. Learn. Syst. 30(6), 1621–1634 (2018)