The use of receiver operating characteristic curves in biomedical informatics

Shapiro, 1999, The interpretation of diagnostic tests, Stat Methods Med Res, 8, 113, 10.1191/096228099666928387

Zweig, 1993, Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine, Clin Chem, 39, 561, 10.1093/clinchem/39.4.561

Obuchowski, 2003, Receiver operating characteristic curves and their use in radiology, Radiology, 229, 3, 10.1148/radiol.2291010898

Metz, 1986, ROC methodology in radiologic imaging, Invest Radiol, 21, 720, 10.1097/00004424-198609000-00009

Pepe, 2003

Zhou, 2002

Swets, 1988, Measuring the accuracy of diagnostic systems, Science, 240, 1285, 10.1126/science.3287615

Aphinyanaphongs, 2004, Text categorization models for high quality article retrieval in internal medicine, J Am Med Inform Assoc, 10.1197/jamia.M1641

Chapman, 2001, A comparison of classification algorithms to automatically identify chest X-ray reports that support pneumonia, J Biomed Inform, 34, 4, 10.1006/jbin.2001.1000

Chapman, 2003, Creating a text classifier to detect radiology reports describing mediastinal findings associated with inhalational anthrax and other disorders, J Am Med Inform Assoc, 10, 494, 10.1197/jamia.M1330

Li, 2004, Data mining techniques for cancer detection using serum proteomic profiling, Artif Intell Med, 32, 71, 10.1016/j.artmed.2004.03.006

Fraser, 2003, Evaluation of a cardiac diagnostic program in a typical clinical setting, J Am Med Inform Assoc, 10, 373, 10.1197/jamia.M1184

Hanley, 1982, The meaning and use of the area under a receiver operating characteristic (ROC) curve, Radiology, 143, 29, 10.1148/radiology.143.1.7063747

Bamber, 1975, The area above the ordinal dominance graph and the area below the receiver operating characteristic graph, J Math Psychol, 12, 387, 10.1016/0022-2496(75)90001-2

Harrell, 1982, Evaluating the yield of medical tests, JAMA, 247, 2543, 10.1001/jama.1982.03320430047030

Faraggi, 2002, Estimation of the area under the ROC curve, Stat Med, 21, 3093, 10.1002/sim.1228

DeLong, 1988, Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach, Biometrics, 44, 837, 10.2307/2531595

Hanley, 1997, Sampling variability of nonparametric estimates of the areas under receiver operating characteristic curves: an update, Acad Radiol, 4, 49, 10.1016/S1076-6332(97)80161-4

http://www.accumetric.com. Accessed October 19, 2004

Zou, 1997, Smooth non-parametric receiver operating characteristic (ROC) curves for continuous diagnostic tests, Stat Med, 16, 2143, 10.1002/(SICI)1097-0258(19971015)16:19<2143::AID-SIM655>3.0.CO;2-3

Lloyd, 1998, Using smoothed receiver operating characteristic curves to summarize and compare diagnostic systems, J Am Stat Assoc, 93, 1356, 10.1080/01621459.1998.10473797

Hajian-Tilaki, 1997, A comparison of parametric and nonparametric approaches to ROC analysis of quantitative diagnostic tests, Med Decis Making, 17, 94, 10.1177/0272989X9701700111

Wieand, 1989, A family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data, Biometrika, 76, 585, 10.1093/biomet/76.3.585

Metz, 1998, Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously distributed data, Stat Med, 17, 1033, 10.1002/(SICI)1097-0258(19980515)17:9<1033::AID-SIM784>3.0.CO;2-Z

Hajian-Tilaki, 2002, Comparison of three methods for estimating the standard error of the area under the curve in ROC analysis of quantitative data, Acad Radiol, 9, 1278, 10.1016/S1076-6332(03)80561-5

Dorfman, 1992, Receiver operating characteristic rating analysis. Generalization to the population of readers and patients with the jackknife method, Invest Radiol, 27, 723, 10.1097/00004424-199209000-00015

Obuchowski, 2002, Confidence bounds when the estimated ROC area is 1.0, Acad Radiol, 9, 526, 10.1016/S1076-6332(03)80329-X

Obuchowski, 1998, Confidence intervals for the receiver operating characteristic area in studies with small samples, Acad Radiol, 5, 561, 10.1016/S1076-6332(98)80208-0

McClish, 1989, Analyzing a portion of the ROC curve, Med Decis Making, 9, 190, 10.1177/0272989X8900900307

Zhang, 2002, A non-parametric method for the comparison of partial areas under ROC curves and its application to large health care data sets, Stat Med, 21, 701, 10.1002/sim.1011

Obuchowski, 2004, ROC curves in clinical chemistry: uses, misuses, and possible solutions, Clin Chem, 50, 1118, 10.1373/clinchem.2004.031823

Pepe, 2003, 100

Pepe, 2003, 226

Obuchowski, 2003, Determining sample size for ROC studies: what is reasonable for the expected difference in tests’ ROC areas?, Acad Radiol, 10, 1327, 10.1016/S1076-6332(03)00386-6

Obuchowski, 1994, Computing sample size for receiver operating characteristic studies, Invest Radiol, 29, 238, 10.1097/00004424-199402000-00020

Stephan, 2003, Comparison of eight computer programs for receiver-operating characteristic analysis, Clin Chem, 49, 433, 10.1373/49.3.433

Vida, 1993, A computer program for non-parametric receiver operating characteristic analysis, Comput Methods Programs Biomed, 40, 95, 10.1016/0169-2607(93)90004-5

http://www.analyse-it.com/products/clinical/diagnostic-testing.htm. Accessed October 19, 2004

http://city.vetmed.fu-berlin.de/~mgreiner/CMDT/cmdt.htm. Accessed October 19, 2004

Venkatraman, 1996, A distribution-free procedure for comparing receiver operating characteristic curves from a paired experiment, Biometrika, 83, 835, 10.1093/biomet/83.4.835

http://www.netti.fi/~maxiw/. Accessed January 20, 2005

Kairisto, 1995, Software for illustrative presentation of basic clinical characteristics of laboratory tests—GraphROC for Windows, Scand J Clin Lab Invest Suppl, 222, 43, 10.3109/00365519509088450

Hanley, 1983, A method of comparing the areas under receiver operating characteristic curves derived from the same cases, Radiology, 148, 839, 10.1148/radiology.148.3.6878708

http://www.medcalc.be. Accessed October 19, 2004

Schoonjans, 1995, MedCalc: a new computer program for medical statistics, Comput Methods Programs Biomed, 48, 257, 10.1016/0169-2607(95)01703-8

Metz, 1989, Some practical issues of experimental design and data analysis in radiological ROC studies. Invest, Radiol, 24, 234

http://www-radiology.uchicago.edu/krl/KRL_ROC/software_index.htm. Accessed October 19, 2004

Metz, 1998, Statistical comparison of two ROC-curve estimates obtained from partially paired datasets, Med Decis Making, 18, 110, 10.1177/0272989X9801800118

Lu, 2003, Preoperative prediction of malignancy of ovarian tumors using least squares support vector machines, Artif Intell Med, 28, 281, 10.1016/S0933-3657(03)00051-4

Whiting, 2004, Sources of variation and bias in studies of diagnostic accuracy: a systematic review, Ann Intern Med, 140, 189, 10.7326/0003-4819-140-3-200402030-00010

Kester, 2000, Meta-analysis of ROC curves, Med Decis Making, 20, 430, 10.1177/0272989X0002000407

Hand, 2001, A simple generalization of the area under the ROC curve for multiple class classification problems, Mach Learn, 45, 171, 10.1023/A:1010920819831

Mossman, 1999, Three-way ROCs, Med Decis Making, 19, 78, 10.1177/0272989X9901900110

Dreiseitl, 2000, Comparing three-class diagnostic tests by three-way ROC analysis, Med Decis Making, 20, 323, 10.1177/0272989X0002000309

Obuchowski, 1997, Nonparametric analysis of clustered ROC curve data, Biometrics, 53, 567, 10.2307/2533958

Parker, 2003, ROC methodology within a monitoring framework, Stat Med, 22, 3473, 10.1002/sim.1580