A review and comparison of strategies for multi-step ahead time series forecasting based on the NN5 forecasting competition

1997 Ahmed, 2010, An empirical comparison of machine learning models for time series forecasting, Econometric Reviews (to appear), 29 Allen, 1974, The relationship between variable selection and data agumentation and a method for prediction, Technometrics, 16, 125, 10.2307/1267500 Alpaydin, 2010 Anders, 1999, Model selection in neural networks, Neural Networks, 12, 309, 10.1016/S0893-6080(98)00117-8 Andrawis, 2011, Combination of long term and short term forecasts, with application to tourism demand forecasting, International Journal of Forecasting, 27, 870, 10.1016/j.ijforecast.2010.05.019 Andrawis, R. R., Atiya, A. F., & El-Shishiny, H. (in press). Forecast combinations of computational intelligence and linear models for the nn5 time series forecasting competition. International Journal of Forecasting (Corrected Proof). ISSN: 0169-2070. <http://www.sciencedirect.com/science/article/B6V92-51WV6JD-2/2/110d69a3e7fdea1d853ee3152755f99a>. Atiya, 1999, A comparison between neural-network forecasting techniques – Case study: River flow forecasting, IEEE Transactions on Neural Networks, 10, 402, 10.1109/72.750569 Atkeson, 1997, Locally weighted learning, Artificial Intelligence Review, 11, 11, 10.1023/A:1006559212014 Atkeson, 1997, Locally weighted learning, Artificial Intelligence Review, 11, 11, 10.1023/A:1006559212014 Bates, 1969, The combination of forecasts, OR, 20, 451, 10.2307/3008764 Ben Taieb, S., Bontempi, G., Sorjamaa, A., & Lendasse, A. (2009). Long-term prediction of time series by combining direct and mimo strategies. In International joint conference on neural networks. <http://eprints.pascal-network.org/archive/00004925/>. Ben Taieb, 2010, Multiple-output modeling for multi-step-ahead time series forecasting, Neurocomputing, 73, 1950, 10.1016/j.neucom.2009.11.030 Birattari, B., & Bersini, M. (1997). Lazy learning for local modeling and control design. <http://citeseer.ist.psu.edu/bontempi97lazy.html>. Birattari, 1999, Lazy learning meets the recursive least-squares algorithm, Vol. 11, 375 Bontempi, G. (1999). Local learning techniques for modeling, prediction and control. Ph.d., IRIDIA-Université Libre de Bruxelles, BELGIUM. Bontempi, G. (2008). Long term time series prediction with multi-input multi-output local learning. In Proceedings of the 2nd European symposium on time series prediction (TSP), ESTSP08, Helsinki, Finland (pp. 145–154). Bontempi, 2011, Conditionally dependent strategies for multiple-step-ahead prediction in local learning, International Journal of Forecasting, 27, 689, 10.1016/j.ijforecast.2010.09.004 Bontempi, 1999, Local learning for iterated time-series prediction, 32 Bontempi, G., Birattari, M., & Bersini, H. (1998). Lazy learning for iterated time series prediction. In J.A.K. Suykens, & J. Vandewalle (Eds.), Proceedings of the international workshop on advanced black-box techniques for nonlinear modeling (pp. 62–68). Belgium: Katholieke Universiteit Leuven. Breiman, 1996, Bagging predictors, Machine Learning, 24, 123, 10.1007/BF00058655 Breiman, 1997, Predicting multivariate responses in multiple linear regression, Journal of the Royal Statistical Society, Series B, 59, 3, 10.1111/1467-9868.00054 Breiman, 1984 Casdagli, 1991, State space reconstruction in the presence of noise, Physica D, 51, 52, 10.1016/0167-2789(91)90222-U Chapelle, 2000, Model selection for support vector machines, Vol. 12 Cheng, 2006, Multistep-ahead time series prediction, Vol. 3918, 765 Clemen, 1989, Combining forecasts: A review and annotated bibliography, International Journal of Forecasting, 5, 559, 10.1016/0169-2070(89)90012-5 Clements, 2004, Forecasting economic and financial time-series with non-linear models, International Journal of Forecasting, 20, 169, 10.1016/j.ijforecast.2003.10.004 Cleveland, 1988, Regression by local fitting: Methods, properties, and computational algorithms, Journal of Econometrics, 37, 87, 10.1016/0304-4076(88)90077-2 Crone, 2009, Mining the past to determine the future: Comments, International Journal of Forecasting, 25, 456, 10.1016/j.ijforecast.2009.05.022 Crone, Sven., 2009a. NN3 Forecasting Competition. http://www.neural-forecasting-competition.com/NN3/index.htm, a. Last update 26/05/2009. Visited on 05/07/2010. Crone, Sven., 2009b. NN5 Forecasting Competition. http://www.neural-forecasting-competition.com/NN5/index.htm, b. Last update 27/05/2009. Visited on 05/07/2010. Crone, S. F., & Kourentzes, N. (2009). Input-variable specification for neural networks: an analysis of forecasting low and high time series frequency. In Proceedings of the 2009 international joint conference on Neural Networks, IJCNN’09 Piscataway, NJ, USA (pp. 3221–3228). IEEE Press. ISBN: 978-1-4244-3549-4. <http://portal.acm.org/citation.cfm?id=1704555.1704739>. Curry, 2006, Model selection in neural networks: Some difficulties, European Journal of Operational Research, 170, 567, 10.1016/j.ejor.2004.05.026 De Gooijer, 2006, 25 years of time series forecasting, International Journal of Forecasting, 22, 443, 10.1016/j.ijforecast.2006.01.001 De Gooijer, 1992, Some recent developments in non-linear time series modelling, testing, and forecasting, International Journal of Forecasting, 8, 135, 10.1016/0169-2070(92)90115-P Demšar, 2006, Statistical comparisons of classifiers over multiple data sets, Journal of Machine Learning Research, 7, 1 Engle, 1982, Autoregressive conditional heteroscedasticity with estimates of the variance of united kingdom inflation, Econometrica, 50, 987, 10.2307/1912773 Fan, 1995, Adaptive order polynomial fitting: Bandwidth robustification and bias reduction, Journal of Computational and Graphical Statistics, 4, 213, 10.2307/1390848 Friedman, 1937, The use of ranks to avoid the assumption of normality implicit in the analysis of variance, Journal of the American Statistical Association, 32, 675, 10.2307/2279372 Friedman, 1940, A comparison of alternative tests of significance for the problem of m rankings, The Annals of Mathematical Statistics, 11, 86, 10.1214/aoms/1177731944 Garca, 2009, An extension on “statistical comparisons of classifiers over multiple data sets” for all pairwise comparisons, Journal of Machine Learning Research, 9, 2677 Guillén, A., Sovilj, D., Mateo, F., Rojas, I., & Lendasse, A. (2008). New methodologies based on delta test for variable selection in regression problems. In Workshop on parallel architectures and bioinspired algorithms, Toronto, Canada. Hamzacebi, 2009, Comparison of direct and iterative artificial neural network forecast approaches in multi-periodic time series forecasting, Expert Systems with Applications, 36, 3839, 10.1016/j.eswa.2008.02.042 Hand, 2008, Mining the past to determine the future: Problems and possibilities, International Journal of Forecasting Hastie, 2009 Hylleberg, 1992 Iman, 1980, Approximations of the critical region of the friedman statistic, Communications in Statistics, 571, 10.1080/03610928008827904 Jacobs, 1991, Adaptive Mixtures of Local Experts, Neural Computation, 3, 79, 10.1162/neco.1991.3.1.79 Jordan, 1994, Hierarchical mixtures of experts and the em algorithm, Neural Computation, 6, 181, 10.1162/neco.1994.6.2.181 Kantz, 2004 Kline, 2004, Methods for multi-step time series forecasting with neural networks, 226 Lapedes, A., & Farber, R. (1987). Nonlinear signal processing using neural networks: prediction and system modelling. Technical Report LA-UR-87-2662, Los Alamos National Laboratory, Los Alamos, NM. Lendasse, A. (Ed.) (2007). ESTSP 2007: Proceedings. ISBN: 978-951-22-8601-0. Lendasse, A., (Ed.) (2008). ESTSP 2008: Proceedings, Multiprint Oy/ Otamedia. ISBN: 978-951-22-9544-9. Liitiäinen, E., & Lendasse, A. (2007). Variable scaling for time series prediction: Application to the ESTSP07 and the NN3 forecasting competitions. In IJCNN 2007, international joint conference on neural networks, Orlando, Florida, USA (pp. 2812 – 2816). Eau Claire, Wisconsin, USA: Documation LLC. Makridakis, 1998 Maron, 1997, The racing algorithm: Model selection for lazy learners, Artificial Intelligence Review, 11, 193, 10.1023/A:1006556606079 Mateo, 2008, A variable selection approach based on the delta test for extreme learning machine models, 57 Mateo, 2010, Approximate k-NN delta test minimization method using genetic algorithms: Application to time series, Neurocomputing, 73, 2017, 10.1016/j.neucom.2009.11.032 Matías, 2005, Multi-output nonparametric regression, Vol. 3808, 288 McNames, J. (1998). A nearest trajectory strategy for time series prediction. In Proceedings of the internationalworkshop on advanced black-box techniques for nonlinear modeling, Belgium (pp. 112–128). K.U. Leuven. Micchelli, 2005, On learning vector-valued functions, Neural Computation, 17, 177, 10.1162/0899766052530802 Mitchel, 1997 Montgomery, 2006 Moody, 1989, Fast learning in networks of locally-tuned processing units, Neural Computation, 1, 281, 10.1162/neco.1989.1.2.281 Murray-Smith, R. (1994). A local model network approach to nonlinear modelling. PhD thesis, Department of Computer Science, University of Strathclyde, Strathclyde, UK. Nelson, 1999, Time series forecasting using neural networks: should the data be deseasonalized first?, Journal of Forecasting, 18, 359, 10.1002/(SICI)1099-131X(199909)18:5<359::AID-FOR746>3.0.CO;2-P Palit, 2005 Pi, 1994, Finding the embedding dimension and variable dependencies in time series, Neural Computation, 6, 509, 10.1162/neco.1994.6.3.509 Poggio, 1990, Regularization algorithms for learning that are equivalent to multilayer networks, Science, 247, 978, 10.1126/science.247.4945.978 Poskitt, 1986, The selection and use of linear and bilinear time series models, International Journal of Forecasting, 2, 101, 10.1016/0169-2070(86)90033-6 Price, 2009, Mining the past to determine the future: Comments, International Journal of Forecasting, 25, 452, 10.1016/j.ijforecast.2008.11.001 Raudys, S., & Zliobaite, I. (2006). The multi-agent system for prediction of financial time series. In Artificial intelligence and soft computing, ICAISC 2006 (pp. 653–662). Rumelhart, 1986, Learning representations by backpropagating errors, Nature, 323, 533, 10.1038/323533a0 Ruppert, 1995, An effective bandwidth selector for local least squares regression, Journal of the American Statistical Association, 90, 1257, 10.2307/2291516 Saad, 1998, Comparative study of stock trend prediction using time delay, recurrent and probabilistic neural networks, IEEE Transactions on Neural Networks, 9, 1456, 10.1109/72.728395 Sauer, 1994, Time series prediction by using delay coordinate embedding, 175 Schapire, 1998, Boosting the margin: A new explanation for the effectiveness of voting methods, Annals of Statistics, 26, 1651, 10.1214/aos/1024691352 Seber, 1989 Sorjamaa, A., & Lendasse, A. (2006). Time series prediction using dirrec strategy. In M. Verleysen (Ed.), ESANN06, European symposium on artificial neural networks, Bruges, Belgium (pp. 143–148). Sorjamaa, 2007, Methodology for long-term prediction of time series, Neurocomputing, 70, 2861, 10.1016/j.neucom.2006.06.015 Takagi, 1985, Fuzzy identification of systems and its applications to modeling and control, IEEE Transactions on Systems, Man, and Cybernetics, 15, 116, 10.1109/TSMC.1985.6313399 Tashman, 2000, Out-of-sample tests of forecasting accuracy: An analysis and review, International Journal of Forecasting, 16, 437, 10.1016/S0169-2070(00)00065-0 Tiao, 1994, Some advances in non-linear and adaptive modelling in time-series, Journal of Forecasting, 13, 109, 10.1002/for.3980130206 Timmermann, 2006, Forecast combinations, 135, 10.1016/S1574-0706(05)01004-9 Tong, 1983 Tong, 1990 Tong, 1980, Threshold autoregression, limit cycles and cyclical data, Journal of the Royal Statistical Society. Series B (Methodological), 42, 245, 10.1111/j.2517-6161.1980.tb01126.x Tran, 2009, Multi-step ahead direct prediction for the machine condition prognosis using regression trees and neuro-fuzzy systems, Expert Systems with Applications, 36, 9378, 10.1016/j.eswa.2009.01.007 Weigend, A. S., & Gershenfeld, N. A. (Eds.) (1994). Time series prediction: Forecasting the future and understanding the past. <http://adsabs.harvard.edu/cgi-bin/nph-bib_query?bibcode=1994tspf.conf.W>. Weigend, 1992, Predicting sunspots and exchange rates with connectionist networks, 395 Werbos, P. (1974). Beyond regression: New tools for prediction and analysis in the behavioral sciences. PhD thesis, Harvard University, Cambridge, MA. Werbos, 1988, Generalization of backpropagation with application to a recurrent gas market model, Neural Networks, 1, 339, 10.1016/0893-6080(88)90007-X Wichard, 2011, Forecasting the nn5 time series with hybrid models, International Journal of Forecasting, 27, 700, 10.1016/j.ijforecast.2010.02.011 Zhang, 1998, Forecasting with artificial neural networks: The state of the art, International Journal of Forecasting, 14, 35, 10.1016/S0169-2070(97)00044-7 Zhang, 1994, Simple architectures on fast machines: Practical issues in nonlinear time series prediction, 219 Zhang, 2005, Neural network forecasting for seasonal and trend time series, European Journal of Operational Research, 160, 501, 10.1016/j.ejor.2003.08.037