Using AUC and accuracy in evaluating learning algorithms

IEEE Transactions on Knowledge and Data Engineering - Tập 17 Số 3 - Trang 299-310 - 2005
Jin Huang1, Charles X. Ling1
1Department of Computer Science, University of Western Ontario, London, ONT, Canada

Tóm tắt

Từ khóa


Tài liệu tham khảo

kononenko, 1990, Comparison of Inductive and Naive Bayesian Learning Approaches to Automatic Knowledge Acquisition, Current Trends in Knowledge Acquisition

hsu, 2001, A Comparison on Methods for Multi-Class Support Vector Machines

langley, 1992, An Analysis of Bayesian Classifiers, Proc Nat Conf Artif Intell, 223

10.1023/A:1010920819831

10.1016/B978-1-55860-377-6.50069-4

scholkopf, 2002, Learning with kernels

green, 1966, Signal Detection Theory and Psychophysics

hastie, 2001, The Elements of Statistical Learning, 10.1007/978-0-387-21606-5

suykens, 1999, Multiclass Least Squares Support Vector Machines, Proc Int'l Joint Conf Neural Networks (IJCNN '99), 10.1109/IJCNN.1999.831072

10.1148/radiology.143.1.7063747

10.1016/B978-1-55860-036-2.50047-3

egan, 1975, Signal Detection Theory and ROC Analysis

vapnik, 1998, Statistical Learning Theory

swets, 1988, Measuring the Accuracy of Diagnostic Systems, Science, 240, 1285, 10.1126/science.3287615

ferri, 2002, Learning Decision Trees Using the Area under the ROC Curve, Proc 19th Int'l Conf Machine Learning (ICML '02), 139

fayyad, 1993, Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning, Proc 13th Int'l Joint Conf Artificial Intelligence, 1022

blake, 1998

quinlan, 1993, C4 5 Programs for Machine Learning

provost, 1998, The Case Against Accuracy Estimation for Comparing Induction Algorithms, Proc 15th Int'l Conf Machine Learning, 445

provost, 1997, Analysis and Visualization of Classifier Performance: Comparison under Imprecise Class and Cost Distribution, Proc Third Int'l Conf Knowledge Discovery and Data Mining, 43

10.1023/A:1024099825458

provost, 2000, Well-Trained PETs: Improving Probability Estimation Trees

meyer, 2002, Benchmarking Support Vector Machines

10.1016/S0001-2998(78)80014-2

10.1023/A:1016304305535

ling, 2002, Toward Bayesian Classifiers with Accurate Probabilities, Proc Sixth Pacific-Asia Conf Knowledge Discovery and Data Mining, 123, 10.1007/3-540-47887-6_12

ling, 2003, AUC: A Statistically Consistent and More Discriminating Measure than Accuracy, Proc 18th Int'l Conf Artificial Intelligence (IJCAI '03), 329

ling, 1998, Data Mining for Direct Marketing?Specific Problems and Solutions, Proc Fourth Int'l Conf Knowledge Discovery and Data Mining (KDD '98), 73

10.1016/S0031-3203(96)00142-2

10.1145/130385.130401

10.1145/1961189.1961199

10.1023/A:1009715923555

cristianini, 0, An Introduction to Support Vector Machines

cohen, 1999, Learning to Order Things, J Artificial Intelligence Research, 10, 243, 10.1613/jair.587

duda, 1973, Pattern Classification and Scene Analysis

domingos, 1996, Beyond Independence: Conditions for the Optimality of the Simple Bayesian Classifier, Proc 13th Int'l Conf Machine Learning, 105