Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests

Albert, 1982, On the use of likelihood ratios in clinical chemistry, Clin. Chem., 28, 1113, 10.1093/clinchem/28.5.1113

Anderson, J.A., 1982. Logistic regression. In: Krishnaiah, P.R., Kanal, L.N. (Eds.), Handbook of Statistics. North-Holland, New York, pp. 169–191.

Bamber, 1975, The area above the ordinal dominance graph and the area below the receiver operating characteristic graph, J. Math. Psychol., 12, 387, 10.1016/0022-2496(75)90001-2

Barajas-Rojas, 1993, Notes about determining the cut-off value in enzyme-linked immunosorbent assay (ELISA), Prev. Vet. Med., 15, 231, 10.1016/0167-5877(93)90116-B

Beam, 1998, Analysis of clustered data in receiver operating characteristic studies, Stat. Meth. Med. Res., 7, 324, 10.1191/096228098669595619

Beam, 1991, A statistical method for the comparison of a discrete diagnostic test with several continuous diagnostic tests, Biometrics, 47, 907, 10.2307/2532648

Bennett, 1972, On comparisons of sensitivity, specificity, and predictive value of a number of diagnostic procedures, Biometrics, 28, 793, 10.2307/2528763

Campbell, 1994, Advances in statistical methodology for the evaluation of diagnostic and laboratory tests, Stat. Med., 13, 499, 10.1002/sim.4780130513

Choi, 1998, Slopes of a receiver operating characteristic curve and likelihood ratios for a diagnostic test, Am. J. Epidemiol., 148, 1127, 10.1093/oxfordjournals.aje.a009592

Detilleux, 1999, Methods for estimating areas under receiver-operating characteristic curves: illustration with somatic-cell scores in subclinical intramammary infections, Prev. Vet. Med., 41, 75, 10.1016/S0167-5877(99)00054-9

Dorfman, 1968, Maximum likelihood estimation of parameters of signal detection theory — a direct solution, Psychometrika, 33, 117, 10.1007/BF02289677

Gardner, 2000, Conditional dependence between tests affects the diagnosis and surveillance of animal diseases, Prev. Vet. Med., 45, 107, 10.1016/S0167-5877(00)00119-7

Gefeller, 1994, How to correct for chance agreement in the estimation of sensitivity and specificity of diagnostic tests, Methods Inf. Med., 33, 180, 10.1055/s-0038-1635010

Greiner, 1996, Two-graph receiver operating characteristic (TG-ROC): update version supports optimisation of cut-off values that minimise overall misclassification costs, J. Immunol. Methods, 191, 93, 10.1016/0022-1759(96)00013-0

Greiner, 2000, Epidemiologic issues in the validation of veterinary diagnostic tests, Prev. Vet. Med., 45, 3, 10.1016/S0167-5877(00)00114-8

Greiner, 1995, A modified ROC analysis for the selection of cut-off values and the definition of intermediate results of serodiagnostic tests, J. Immunol. Methods, 185, 123, 10.1016/0022-1759(95)00121-P

Greiner, 1997, Evaluation and comparison of antibody ELISAs for serodiagnosis of bovine trypanosomosis, Vet. Parasitol., 73, 197, 10.1016/S0304-4017(97)00134-9

Hanley, 1988, The robustness of the “binormal” assumptions used in fitting ROC curves, Med. Decis. Mak., 8, 197, 10.1177/0272989X8800800308

Hanley, 1982, The meaning and use of the area under a receiver operating characteristic curve, Radiology, 143, 29, 10.1148/radiology.143.1.7063747

Hanley, 1983, A method of comparing the areas under receiver operating characteristic curves derived from the same cases, Radiology, 148, 839, 10.1148/radiology.148.3.6878708

Hanson, 2000, Log-linear and logistic modeling of dependence among diagnostic tests, Prev. Vet. Med., 45, 123, 10.1016/S0167-5877(00)00120-3

Henderson, 1993, Assessing test accuracy and its clinical consequences — a primer for receiver operating characteristic curve analysis, Ann. Clin. Biochem., 30, 521, 10.1177/000456329303000601

Henderson, 1995, A modest proposal for the consistent presentation of ROC plots in clinical chemistry, Clin. Chem., 41, 1205, 10.1093/clinchem/41.8.1205

Hilden, 1991, The area under the ROC curve and its competitors, Med. Decis. Mak., 11, 95, 10.1177/0272989X9101100204

Holle, 1997, Is there a gain from chance-corrected measures of diagnostic validity?, J. Clin. Epidemiol., 50, 117, 10.1016/S0895-4356(96)00311-3

Irwig, 1995, Meta-analytic methods for diagnostic test accuracy, J. Clin. Epidemiol., 48, 119, 10.1016/0895-4356(94)00099-C

Knottnerus, 1992, Application of logistic regression to the analysis of diagnostic data: exact modeling of a probability tree of multiple binary variables, Med. Decis. Mak., 12, 93, 10.1177/0272989X9201200202

Kraemer, H.C., 1992. Evaluating Medical Tests — Objective and Quantitative Guidelines. Sage, Newbury Park.

Linnet, 1998, Evaluation of regression procedures for method comparison studies, Clin. Chem., 39, 424, 10.1093/clinchem/39.3.424

Metz, 1978, Basic principles of ROC analysis, Semin. Nucl. Med., 8, 283, 10.1016/S0001-2998(78)80014-2

Metz, 1998, Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data, Med. Decis. Mak., 17, 1033

Moses, 1983, Combining independent studies of a diagnostic test into a summary ROC curve — data-analytic approaches and some additional considerations, Stat. Med., 12, 1293, 10.1002/sim.4780121403

Obuchowski, 1994, Computing sample size for receiver operating characteristic studies, Invest. Radiol., 29, 238, 10.1097/00004424-199402000-00020

Obuchowski, 1997, Testing for equivalence of diagnostic tests, Am. J. Roentgenol., 168, 13, 10.2214/ajr.168.1.8976911

Obuchowski, 1998, Sample size calculations in studies of test accuracy, Stat. Meth. Med. Res., 7, 371, 10.1191/096228098678080061

Obuchowski, 1997, Sample size determination for diagnostic accuracy studies involving binormal ROC curve indices, Stat. Med., 16, 1529, 10.1002/(SICI)1097-0258(19970715)16:13<1529::AID-SIM565>3.0.CO;2-H

Paré, 1995, An enzyme-linked-immunosorbent-assay (ELISA) for serological diagnosis of Neospora sp. infection in cattle, J. Vet. Diagn. Invest., 7, 352, 10.1177/104063879500700310

Reiser, 1997, Confidence intervals for the generalised ROC criterion, Biometrics, 53, 644, 10.2307/2533964

Remaley, 1999, Prevalence-value-accuracy plots: a new method for comparing diagnostic tests based on misclassification costs, Clin. Chem., 45, 934, 10.1093/clinchem/45.7.934

Schäfer, 1989, Constructing a cut-off point for a quantitative diagnostic test, Stat. Med., 8, 1381, 10.1002/sim.4780081110

Schäfer, 1994, Efficient confidence bounds for ROC curves, Stat. Med., 13, 1551, 10.1002/sim.4780131506

Schulzer, 1994, Diagnostic tests: a statistical review, Muscle Nerve, 17, 815, 10.1002/mus.880170719

Simel, 1993, Likelihood ratios for continuous test results — making the clinician’s job easier or harder?, J. Clin. Epidemiol., 46, 85, 10.1016/0895-4356(93)90012-P

Smith, 1993, Decision-analysis in the evaluation of diagnostic tests, J. Am. Vet. Med. Assoc., 203, 1184, 10.2460/javma.1993.203.08.1184

Smith, R.D., 1995. Evaluation of diagnostic tests. In: Veterinary Clinical Epidemiology. A Problem-Oriented Approach. CRC Press, Boca Raton, FL, pp. 31–43.

Sondik, 1982, Clinical evaluation of test strategies. A decision analysis of parameter estimation, Clin. Lab. Med., 2, 821, 10.1016/S0272-2712(18)31015-1

Swets, 1988, Measuring the accuracy of diagnostic systems, Science, 240, 1285, 10.1126/science.3287615

Thompson, 1989, On the statistical analysis of ROC curves, Stat. Med., 8, 1277, 10.1002/sim.4780081011

Toledano, 1996, Ordinal regression methodology for ROC curves derived from correlated data, Stat. Med., 15, 1807, 10.1002/(SICI)1097-0258(19960830)15:16<1807::AID-SIM333>3.0.CO;2-U

Tosteson, 1988, A general regression methodology for ROC curve estimation, Med. Decis. Mak., 8, 204, 10.1177/0272989X8800800309

Venkatraman, 1996, A distribution-free procedure for comparing receiver operating characteristic curves from a paired experiment, Biometrika, 83, 835, 10.1093/biomet/83.4.835

Vida, 1993, A computer program for non-parametric receiver operating characteristic analysis, Comput. Methods Programs Biomed., 40, 95, 10.1016/0169-2607(93)90004-5

Zweig, 1993, ROC plots display test accuracy, but are still limited by the study design, Clin. Chem., 39, 1345, 10.1093/clinchem/39.6.1345

Zweig, 1993, Receiver-operating characteristic (ROC) plots — a fundamental evaluation tool in clinical medicine, Clin. Chem., 39, 561, 10.1093/clinchem/39.4.561