Assessing the Performance of Prediction Models

Harrell, 2001, Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis., 10.1007/978-1-4757-3462-1

Pepe, 2004, Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker., Am J Epidemiol, 159, 882, 10.1093/aje/kwh101

Gerds, 2008, The performance of risk prediction models., Biom J, 50, 457, 10.1002/bimj.200810443

Hosmer, 1997, A comparison of goodness-of-fit tests for the logistic regression model., Stat Med, 16, 965, 10.1002/(SICI)1097-0258(19970515)16:9<965::AID-SIM509>3.0.CO;2-O

Obuchowski, 2003, Receiver operating characteristic curves and their use in radiology., Radiology, 229, 3, 10.1148/radiol.2291010898

Heagerty, 2005, Survival model predictive accuracy and ROC curves., Biometrics, 61, 92, 10.1111/j.0006-341X.2005.030814.x

Gonen, 2005, Concordance probability and discriminatory power in proportional hazards regression., Biometrika, 92, 965, 10.1093/biomet/92.4.965

Cook, 2007, Use and misuse of the receiver operating characteristic curve in risk prediction., Circulation, 115, 928, 10.1161/CIRCULATIONAHA.106.672402

Pencina, 2008, Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond., Stat Med, 27, 157, 10.1002/sim.2929

Pencina, 2008, Comments on ‘Integrated discrimination and net reclassification improvements-Practical advice.’, Stat Med, 27, 207, 10.1002/sim.3106

Janes, 2008, Assessing the value of risk predictions by using risk stratification tables., Ann Intern Med, 149, 751, 10.7326/0003-4819-149-10-200811180-00009

McGeechan, 2008, Assessing new biomarkers and predictive models for use in clinical practice: a clinician's guide., Arch Intern Med, 168, 2304, 10.1001/archinte.168.21.2304

Cook, 2009, Advances in measuring the effect of individual predictors of cardiovascular risk: the role of reclassification measures., Ann Intern Med, 150, 795, 10.7326/0003-4819-150-11-200906020-00007

Vickers, 2006, Decision curve analysis: a novel method for evaluating prediction models., Med Decis Making, 26, 565, 10.1177/0272989X06295361

Steyerberg, 2008, Decision curve analysis: a discussion., Med Decis Making, 28, 146, 10.1177/0272989X07312725

Altman, 2000, What do we mean by validating a prognostic model?, Stat Med, 19, 453, 10.1002/(SICI)1097-0258(20000229)19:4<453::AID-SIM350>3.0.CO;2-5

Justice, 1999, Assessing the generalizability of prognostic information., Ann Intern Med, 130, 515, 10.7326/0003-4819-130-6-199903160-00016

Steyerberg, 2001, Internal validation of predictive models: efficiency of some procedures for logistic regression analysis., J Clin Epidemiol, 54, 774, 10.1016/S0895-4356(01)00341-9

Steyerberg, 2009, Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating.

Simon, 2006, A checklist for evaluating reports of expression profiling for treatment selection., Clin Adv Hematol Oncol, 4, 219

Ioannidis, 2008, Why most discovered true associations are inflated., Epidemiology, 19, 640, 10.1097/EDE.0b013e31818131e7

Schumacher, 2007, Assessment of survival prediction models based on microarray data., Bioinformatics, 23, 1768, 10.1093/bioinformatics/btm232

Vickers, 2006, Selecting patients for randomized trials: a systematic approach based on risk group., Trials, 7, 30, 10.1186/1745-6215-7-30

Hernandez, 2004, Covariate adjustment in randomized controlled trials with dichotomous outcomes increases statistical power and reduces sample size requirements., J Clin Epidemiol, 57, 454, 10.1016/j.jclinepi.2003.09.014

Hernandez, 2006, Randomized controlled trials with time-to-event outcomes: how much does prespecified covariate adjustment increase power?, Ann Epidemiol, 16, 41, 10.1016/j.annepidem.2005.09.007

Iezzoni, 2003, Risk Adjustment for Measuring Health Care Outcomes. 3rd ed.

Kattan, 2003, Judging new markers by their ability to improve predictive accuracy., J Natl Cancer Inst, 95, 634, 10.1093/jnci/95.9.634

Hilden, 1978, The measurement of performance in probabilistic diagnosis. Part II: Trustworthiness of the exact values of the diagnostic probabilities., Methods Inf Med, 17, 227, 10.1055/s-0038-1636442

Hand, 1992, Statistical methods in diagnosis., Stat Methods Med Res, 1, 49, 10.1177/096228029200100104

Habbema, 1981, The measurement of performance in probabilistic diagnosis: Part IV. Utility considerations in therapeutics and prognostics., Methods Inf Med, 20, 80, 10.1055/s-0038-1635297

Vittinghoff, 2005, Regression Methods in Biostatistics: Linear, Logistic, Survival, and Repeated Measures Models (Statistics for Biology and Health).

Nagelkerke, 1991, A note on a general definition of the coefficient of determination., Biometrika, 78, 691, 10.1093/biomet/78.3.691

Brier, 1950, Verification of forecasts expressed in terms of probability., Mon Wea Rev, 78, 1, 10.1175/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2

Hu, 2006, Properties of R2 statistics for logistic regression., Stat Med, 25, 1383, 10.1002/sim.2300

Schumacher, 2003, How to assess prognostic models for survival data: a case study in oncology., Methods Inf Med, 42, 564, 10.1055/s-0038-1634384

Gerds, 2006, Consistent estimation of the expected Brier score in general survival models with right-censored event times., Biom J, 48, 1029, 10.1002/bimj.200610301

Chambless, 2006, Estimation of time-dependent area under the ROC curve for long-term risk prediction., Stat Med, 25, 3474, 10.1002/sim.2299

Yates, 1982, External correspondence: decomposition of the mean probability score., Organ Behav Hum Perform, 30, 132, 10.1016/0030-5073(82)90237-9

Miller, 1993, Validation of probabilistic predictions., Med Decis Making, 13, 49, 10.1177/0272989X9301300107

Cox, 1958, Two further applications of a model for binary regression., Biometrika, 45, 562, 10.1093/biomet/45.3-4.562

Copas, 1983, Regression, prediction and shrinkage., J R Stat Soc Ser B, 45, 311

van Houwelingen, 1990, Predictive value of statistical models., Stat Med, 9, 1303, 10.1002/sim.4780091109

Cook, 2008, Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve., Clin Chem, 54, 17, 10.1373/clinchem.2007.096529

Pepe, 2008, Integrating the predictiveness of a marker with its performance as a classifier., Am J Epidemiol, 167, 362, 10.1093/aje/kwm305

Youden, 1950, Index for rating diagnostic tests., Cancer, 3, 32, 10.1002/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3

Pauker, 1980, The threshold approach to clinical decision making., N Engl J Med, 302, 1109, 10.1056/NEJM198005153022003

Peirce, 1884, The numerical measure of success of predictions., Science, 4, 453, 10.1126/science.ns-4.93.453-a

Steyerberg, 1995, Prediction of residual retroperitoneal mass histology after chemotherapy for metastatic nonseminomatous germ cell tumor: multivariate analysis of individual patient data from six study groups., J Clin Oncol, 13, 1177, 10.1200/JCO.1995.13.5.1177

Steyerberg, 2001, Residual mass histology in testicular cancer: development and validation of a clinical prediction rule., Stat Med, 20, 3847, 10.1002/sim.915

Vergouwe, 2001, Validation of a prediction model and its predictors for the histology of residual masses in nonseminomatous testicular cancer., J Urol, 165, 84, 10.1097/00005392-200101000-00021

Steyerberg, 1999, Resection of small, residual retroperitoneal masses after chemotherapy for nonseminomatous testicular cancer: a decision analysis., Cancer, 85, 1331, 10.1002/(SICI)1097-0142(19990315)85:6<1331::AID-CNCR16>3.0.CO;2-I

Pauker, 1981, The toss-up., N Engl J Med, 305, 1467, 10.1056/NEJM198112103052409

Hunault, 2004, Two new prediction rules for spontaneous pregnancy leading to live birth among subfertile couples, based on the synthesis of three previous models., Hum Reprod, 19, 2019, 10.1093/humrep/deh365

Peek, 2007, External validation of prognostic models for critically ill patients required substantial sample sizes., J Clin Epidemiol, 60, 491, 10.1016/j.jclinepi.2006.08.011

Greenland, 2008, The need for reorientation toward cost-effective prediction: comments on ‘Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond’ by M. J. Pencina et al. Statistics in Medicine (DOI: 10.1002/sim. 2929)., Stat Med, 27, 199, 10.1002/sim.2995

Vergouwe, 2002, Validity of prognostic models: when is a model clinically useful?, Semin Urol Oncol, 20, 96, 10.1053/suro.2002.32521

McNeil, 1975, Primer on certain elements of medical decision making., N Engl J Med, 293, 211, 10.1056/NEJM197507312930501

Hilden, 1991, The area under the ROC curve and its competitors., Med Decis Making, 11, 95, 10.1177/0272989X9101100204

Gail, 2005, On criteria for evaluating models of absolute risk., Biostatistics, 6, 227, 10.1093/biostatistics/kxi005

Grunkemeier, 2007, Actual and actuarial probabilities of competing risks: apples and lemons., Ann Thorac Surg, 83, 1586, 10.1016/j.athoracsur.2006.11.044

Fine, 1999, A proportional hazards model for the subdistribution of a competing risk., JASA, 94, 496, 10.1080/01621459.1999.10474144

Gail, 1975, A review and critique of some models used in competing risk analysis., Biometrics, 31, 209, 10.2307/2529721

Steyerberg, 2004, Validation and updating of predictive logistic regression models: a study on sample size and shrinkage., Stat Med, 23, 2567, 10.1002/sim.1844

Reilly, 2006, Translating clinical research into clinical practice: impact of using prediction rules to make decisions., Ann Intern Med, 144, 201, 10.7326/0003-4819-144-3-200602070-00009