Comparing Three-class Diagnostic Tests by Three-way ROC Analysis

Medical Decision Making - Tập 20 Số 3 - Trang 323-331 - 2000
Stephan Dreiseitl1, Lucila Ohno‐Machado, Michael Binder
1Brigham and Women's Hospital, Division of Health Sciences and Technology, Harvard Medical School, Massachusetts Institute of Technology, Boston, USA. [email protected]

Tóm tắt

Three-way ROC surfaces are based on a generalization of dichotomous ROC analysis to three-class diagnostic tests. The discriminatory power of three-class diagnostic tests is measured by the volume under the ROC surface. This measure can be given a probabilistic interpretation similar to the equivalence of the c-index to the area under the ROC curve. This article presents a method to calculate nonparametric estimates of the variance of the volume under the surface using Mann-Whitney U statistics. As a simple extension of this result, it is possible to calculate covariance estimates for the volume under the surface. This allows the statistical comparison of two tests used for diagnostic tasks with three possible outcomes. The formulas derived are validated on synthetic data and applied to a three-class data set of pigmented skin lesions. It is shown that a neural network algorithm trained on clinical data and lesion features performs better than one trained on only the lesion features. Key words: Receiver operating characteristic curves; trichotomous ROC analysis. (Med Decis Making 2000; 20:323-331)

Từ khóa


Tài liệu tham khảo

10.1177/0272989X9901900110

Swets JA, 1982, Evaluation of Diagnostic Systems Methods from Signal Detection Theory

10.1016/0022-2496(75)90001-2

10.1214/aoms/1177730196

10.1214/aoms/1177729639

10.1016/0022-2496(80)90020-6

10.1148/radiology.143.1.7063747

10.1016/S1076-6332(97)80161-4

10.1148/radiology.148.3.6878708

10.2307/2531595

10.1177/0272989X9601600206

10.1177/0272989X9801800118

Randles RH, 1979, Introduction to the Theory of Nonparametric Statistics

10.1038/jid.1993.63

10.1001/archderm.1995.01690150050011

10.1007/978-1-4612-0745-0

Lehmann EL., 1975, Nonparametrics. Statistical Methods Based on Ranks

Thông tin
Thông tin xuất bản

Medical Decision Making

Tập 20 Số 3

323-331

Thông tin tác giả