Evaluating Forecasting Methods by Considering Different Accuracy Measures

Procedia Computer Science - Tập 95 - Trang 264-271 - 2016
Nijat Mehdiyev1,2, David Enke3, Peter Fettke1,2, Peter Loos1,2
1Institute for Information Systems (IWi). German Research Center for Artificial Intelligence (DFKI), Campus D3 2, 66123 Saarbrücken, Germany
2Saarland University, Campus D3 2, 66123 Saarbrücken, Germany
3Department of Engineering Management and System Engineering, Missouri University of Science and Technology, Rolla, MO, 65409-0370, USA

Tóm tắt

Từ khóa


Tài liệu tham khảo

Makridakis, 1993, Accuracy measures: theoretical and practical concerns, International Journal of Forecasting, 9, 527, 10.1016/0169-2070(93)90079-3

Mahmoud, 1984, Accuracy in forecasting: A survey, Journal of Forecasting, 3, 139, 10.1002/for.3980030203

Hyndman, 2006, Another look at measures of forecast accuracy, International Journal of Forecasting, 22, 679, 10.1016/j.ijforecast.2006.03.001

Sokolova, 2009, A systematic analysis of performance measures for classification tasks, Information Processing & Management, 45, 427, 10.1016/j.ipm.2009.03.002

Powers, 2011, from precision, recall and F-measure to ROC, informedness, markedness and correlation.

Armstrong, 1992, Error measures for generalizing about forecasting methods: Empirical comparisons, International journal of forecasting, 8, 69, 10.1016/0169-2070(92)90008-W

Xu, 2012, Performance evaluation of competing forecasting models: A multidimensional framework based on MCDA. Expert Systems with Applications, 39, 8312

Ouenniche, 2014, Forecasting Models Evaluation Using A Slacks-Based Context-Dependent DEA Framework, Journal of Applied Business Research, 30, 1477, 10.19030/jabr.v30i5.8800

Peng, 2011, A fusion approach of MCDM methods to rank multiclass classification algorithms, Omega, 39, 677, 10.1016/j.omega.2011.01.009

Khanmohammadi, 2014, AHP based Classification Algorithm Selection for Clinical Decision Support System Development, Procedia Computer Science, 36, 328, 10.1016/j.procs.2014.09.101

Jurman G, Furlanello C. A unifying view for performance measures in multi-class prediction. arXiv preprint arXiv:10082908 2010.

Labatut, 2012, Accuracy measures for the comparison of classifiers. arXiv preprint arXiv:12073790

Felkin, 2007, Comparing classification results between n-ary and binary problems, Quality Measures in Data Mining. Springer, 277, 10.1007/978-3-540-44918-8_12

Pencina, 2008, Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond, Statistics in medicine, 27, 157, 10.1002/sim.2929

Mohri, 2005, Confidence intervals for the area under the ROC curve, Advances in Neural Information Processing Systems Curran Associates, 305

Landgrebe, 2007, Approximating the multiclass ROC by pairwise analysis. Pattern Recognition Letters, 28, 1747, 10.1016/j.patrec.2007.05.001

Hand, 2009, Measuring classifier performance: a coherent alternative to the area under the ROC curve, Machine Learning, 77, 103, 10.1007/s10994-009-5119-5

Cohen, 1968, Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit, Psychological Bulletin, 70, 213, 10.1037/h0026256

Provost, 1997, Analysis and visualization of classifier performance: comparison under imprecise class and cost distributions, KDD, 97, 43

van Rijsbergen, 1979, Information Retrieval, 1979. Butterworth

Davis, 2006, The relationship between Precision-Recall and ROC curves, Proceedings of the 23rd International Conference on Machine learning, 233, 10.1145/1143844.1143874

Cleverdon, 1972, On the inverse relationship of recall and precision, Journal of documentation, 28, 195, 10.1108/eb026538

Mehdiyev, 2015, Determination of rule patterns in complex event processing using machine learning techniques, Procedia Computer Science, 61, 395, 10.1016/j.procs.2015.09.168

Witten, 2005, Practical machine learning tools and techniques, Morgan Kaufmann

Enke, 2012, A New Hybrid Approach For Forecasting Interest Rates, Procedia Computer Science, 12, 259, 10.1016/j.procs.2012.09.066

Kotsiantis, 2007, Supervised machine learning: A review of classification techniques.

Amancio, 2014, A systematic comparison of supervised classifiers. PloS one, 9, e94137

Wu, 2008, Top 10 algorithms in data mining, Knowledge and information systems, 14, 1, 10.1007/s10115-007-0114-2

Hall, 2009, The WEKA data mining software: an update, ACM SIGKDD explorations newsletter, 11, 10, 10.1145/1656274.1656278

Kahraman, 2013, The development of intuitive knowledge classifier and the modeling of domain dependent data, Knowledge-Based Systems, 37, 283, 10.1016/j.knosys.2012.08.009

Brans J. , L’ingenierie de la décision. Elaboration d’instruments d’aide a la décision. Méthode PROMETHEE,[in:] R. Nadeau, M. Landry. L’aide a la decision: Nature, Instruments et perspectives d’Avenir 1982: 183-213.

Brans, 1985, Note—A Preference Ranking Organisation Method: (The PROMETHEE Method for Multiple Criteria Decision-Making), Management science, 31, 647, 10.1287/mnsc.31.6.647

Brans, 2016, PROMETHEE Methods. Multiple Criteria Decision Analysis. Springer, 187, 10.1007/978-1-4939-3094-4_6

Behzadian, 2010, A comprehensive literature review on methodologies and applications, European Journal of Operational Research, 200, 198, 10.1016/j.ejor.2009.01.021