Generalizability Theory's Role in Validity Research: Innovative Applications in Health Science Education

Brennan, 2001, Some problems, pitfalls, and paradoxes in educational measurement, Educ Meas, 40, 6, 10.1111/j.1745-3992.2001.tb00071.x Cronbach, 1972 Cronbach, 1976, 199 Kane, 1999, The role of generalizability in validity, 1 St-Onge, 2017, Validity: one word with a plurality of meanings, Adv Health Sci Educ, 22, 853, 10.1007/s10459-016-9716-3 Kane, 2006, Validation, 17 Kreiter, 1998, A generalizability study of a new standardized rating form used to evaluate students' clinical clerkship performances, Acad Med, 73, 1294, 10.1097/00001888-199812000-00021 Elstein, 1978 van der Vleuten, 1990, Assessment of clinical skills with standardized patients: the state of the art, Teach Learn Med, 2, 58, 10.1080/10401339009539432 Kreiter, 2007, Case specificity: empirical phenomenon or measurement artifact, Teach Learn Med, 19, 378, 10.1080/10401330701542776 Norman, 1985, Knowledge and clinical problem-solving, Med Educ, 19, 344, 10.1111/j.1365-2923.1985.tb01336.x Shavelson, 1993, Sampling variability of performance assessments, J Educ Meas, 30, 215, 10.1111/j.1745-3984.1993.tb00424.x Jarjoura, 2004, A multivariate generalizability model for clinical skills assessment, Educ Psychol Meas, 64, 22, 10.1177/0013164403258466 Schuwirth, 2010 Vispoel, 2018, Practical applications of generalizability theory for designing, evaluating, and improving psychological assessments, J Pers Assess, 100, 53, 10.1080/00223891.2017.1296455 Messick, 1984, The psychology of educational measurement, J Educ Meas, 21, 215, 10.1111/j.1745-3984.1984.tb01030.x Kreiter, 2002, An empirical validity study of a preceptor evaluation instrument, Acad Med, 77, S70, 10.1097/00001888-200210001-00023 Kreiter, 2016, Examining rater and occasion influences in observational assessments obtained from within the clinical environment, Med Educ Online, 10.3402/meo.v21.29279 Wood, 2018, Can physician examiners overcome their first impression when examining performance changes?, Adv Health Sci Educ, 23, 721, 10.1007/s10459-018-9823-4 Margolis, 2006, A regression-based procedure for automated scoring of a complex medical performance assessment, 123 Clauser, 2002, An examination of the contribution of computer-based case simulations to the USMLE Step 3 Examination, Acad Med, 77, S80, 10.1097/00001888-200210001-00026 Gadbury-Amyot, 2014, Validity and reliability of portfolio assessment of student competence in two dental school populations: a four-year study, J Dent Educ, 78, 657, 10.1002/j.0022-0337.2014.78.5.tb05718.x Kreiter, 2013, A measurement perspective on affirmative action in U.S. medical education, Med Educ Online, 18, 10.3402/meo.v18i0.20531 Kreiter, 2018, A meta-analytic perspective on the valid use of subjective human judgement to make medical school admission decisions, Med Educ Online, 10.1080/10872981.2018.1522225 Monroe, 2013, An overview of medical school admission process and use of applicant data in decision making: what has changed since the 1980s?, Acad Med, 88, 672, 10.1097/ACM.0b013e31828bf252 Kane, 2013, Validating the interpretations and uses of test scores, J Educ Meas, 50, 1, 10.1111/jedm.12000 Stratton, 2019, Main and regional campus ratings of applicants to a rural physician leadership program: a generalizability analysis, Journal of Regional Medical Campuses, vol. 1 Kane, 1982, A sampling model for validity, Appl Psychol Meas, 6, 125, 10.1177/014662168200600201 Violato, 2018 Campbell, 1959, Convergent and discriminant validation by the multitrait- multimethod matrix, Psychol Bull, 56, 81, 10.1037/h0046016 Lance, 2007, Case study: a Monte Carlo investigation of assessment center construct validity models, Organ Res Methods, 10, 30, 10.1177/1094428106289395 Kreiger, 1990, Generalizability theory as construct-related evidence of the validity of job performance ratings, Hum Perform, 3, 19, 10.1207/s15327043hup0301_2 2014 2019 Huang, 2012, Using generalizability theory to examine the accuracy and validity of large-scale ESL writing assessment, Assess Writ, 17, 123, 10.1016/j.asw.2011.12.003 Shavelson, 1991, Measurement methods for the social sciences series, vol. 1 Ebel, 1961, Must all tests be valid?, Am Psychol, 16, 640, 10.1037/h0045478