Adaptive Validation Design

Epidemiology - Tập 31 Số 4 - Trang 509-516 - 2020
Lindsay J. Collin1, Richard F. MacLehose2, Thomas P. Ahern3, Rebecca Nash1, Darios Getahun4, Douglas Roblin5, Michael J. Silverberg6, Michael Goodman1, Timothy L. Lash1
1Department of Epidemiology, Emory University, Atlanta, GA
2Division of Epidemiology and Community Health, University of Minnesota, Minneapolis, MN
3Department of Surgery, The Robert Larner, M.D. College of Medicine at The University of Vermont, Burlington, VT
4Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA
5Mid-Atlantic Permanente Research Institute, Kaiser Permanente Mid-Atlantic States, Rockville, MD
6Division of Research, Kaiser Permanente Northern California, Oakland, CA

Tóm tắt

An internal validation substudy compares an imperfect measurement of a variable with a gold-standard measurement in a subset of the study population. Validation data permit calculation of a bias-adjusted estimate, which has the same expected value as the association that would have been observed had the gold-standard measurement been available for the entire study population. Existing guidance on optimal sampling for validation substudies assumes complete enrollment and follow-up of the target cohort. No guidance exists for validation substudy design while cohort data are actively being collected. In this article, we use the framework of Bayesian monitoring methods to develop an adaptive approach to validation study design. This method monitors whether sufficient validation data have been collected to meet predefined criteria for estimation of the positive and negative predictive values. We demonstrate the utility of this method using the Study of Transition, Outcomes and Gender—a cohort study of transgender and gender nonconforming people. We demonstrate the method’s ability to determine efficacy (when sufficient validation data have accumulated to obtain estimates of the predictive values that fall above a threshold value) and futility (when sufficient validation data have accumulated to conclude the mismeasured variable is an untenable substitute for the gold-standard measurement). This proposed method can be applied within the context of any parent epidemiologic study design and modified to meet alternative criteria given specific study or validation study objectives. Our method provides a novel approach to effective and efficient estimation of classification parameters as validation data accrue.

Từ khóa


Tài liệu tham khảo

Collins, 2014, Policy: NIH plans to enhance reproducibility., Nature, 505, 612, 10.1038/505612a

Lash, 2016, Epidemiology announces the “Validation Study” submission category., Epidemiology, 27, 613, 10.1097/EDE.0000000000000532

Ehrenstein, 2016, Helping everyone do better: a call for validation studies of routinely recorded health data., Clin Epidemiol, 8, 49, 10.2147/CLEP.S104448

Holcroft, 1999, Design of validation studies for estimating the odds ratio of exposure-disease relationships when exposure is misclassified., Biometrics, 55, 1193, 10.1111/j.0006-341X.1999.01193.x

Spiegelman, 2000, Estimation and inference for logistic regression with covariate misclassification and measurement error in main study/validation study designs., J Am Stat Assoc, 95, 51, 10.1080/01621459.2000.10473898

Spiegelman, 1991, Cost-efficient study designs for binary response data with Gaussian covariate measurement error., Biometrics, 47, 851, 10.2307/2532644

Holford, 1995, Study design for epidemiologic studies with measurement error., Stat Methods Med Res, 4, 339, 10.1177/096228029500400405

Greenland, 1988, Variance estimation for epidemiologic effect estimates under misclassification., Stat Med, 7, 745, 10.1002/sim.4780070704

Fayers, 1997, Tutorial in biostatistics Bayesian data monitoring in clinical trials., Stat Med, 16, 1413, 10.1002/(SICI)1097-0258(19970630)16:12<1413::AID-SIM578>3.0.CO;2-U

Quinn, 2017, Cohort profile: Study of Transition, Outcomes and Gender (STRONG) to assess health status of transgender people., BMJ Open, 7, e018121, 10.1136/bmjopen-2017-018121

Cronin-Fenton, 2017, Validity of Danish Breast Cancer Group (DBCG) registry data used in the predictors of breast cancer recurrence (ProBeCaRe) premenopausal breast cancer cohort study., Acta Oncol, 56, 1155, 10.1080/0284186X.2017.1327720