Associations between residency selection strategies and doctor performance: a meta-analysis

Medical Education - Tập 47 Số 8 - Trang 790-800 - 2013
Stephanie Kenny1, Matthew D. F. McInnes1, Vivek K. Singh1
1Department of Medical Imaging, Ottawa Hospital, University of Ottawa, Ottawa, Ontario, Canada

Tóm tắt

Từ khóa


Tài liệu tham khảo

Olson, 2011, The residency application abyss: insights and advice, Yale J Biol Med, 84, 195

Wagoner, 1992, Recommendation for changing the residency selection process based on a survey of programme directors, Acad Med, 67, 459, 10.1097/00001888-199207000-00011

Wagoner, 1999, Programme directors’ responses to a survey on variables used to select residents in a time of change, Acad Med, 74, 51, 10.1097/00001888-199901001-00018

Harfmann, 2011, Can performance in medical school predict performance in residency?, J Am Acad Dermatol, 65, 1010, 10.1016/j.jaad.2010.07.034

Hamdy, 2006, BEME systematic review: predictive values of measurements obtained in medical schools and future performance in medical practice, Med Teach, 28, 103, 10.1080/01421590600622723

Landon, 2003, Doctor clinical performance assessment: prospects and barriers, JAMA, 290, 1183, 10.1001/jama.290.9.1183

Green, 2009, Selection criteria for residency: results of a national programme directors survey, Acad Med, 84, 362, 10.1097/ACM.0b013e3181970c6b

Association of American Medical Colleges Curriculum report: honours policy - curriculum inventory and reports (CIR) - initiatives https://www.aamc.org/download/183226/data/honorspolicy.pdf

Stroup, 2000, Meta-analysis of observational studies in epidemiology: a proposal for reporting, JAMA, 283, 2008, 10.1001/jama.283.15.2008

Liberati, 2009, The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration, BMJ, 339, 2700, 10.1136/bmj.b2700

Durlak, 2009, How to select, calculate and interpret effect sizes, J Pediatr Psychol, 34, 917, 10.1093/jpepsy/jsp004

Carletta, 1996, Assessing agreement on classification tasks: the kappa statistic, Comput Linguist, 22, 249

Viswanathan M Ansari MT Berkman ND et al Assessing the risk of bias of individual studies in systematic reviews of health care interventions. Agency for Healthcare Research and Quality Methods Guide for Comparative Effectiveness Reviews www.effectivehealthcare.ahrq.gov/

Egger, 1997, Bias in meta-analysis detected by a simple, graphical test, BMJ, 315, 629, 10.1136/bmj.315.7109.629

DerSimonian, 1986, Meta-analysis in clinical trials, Control Clin Trials, 7, 177, 10.1016/0197-2456(86)90046-2

Higgins, 2003, Measuring inconsistency in meta-analyses, BMJ, 327, 557, 10.1136/bmj.327.7414.557

Deeks, 2008, Cochrane Handbook for Systematic Reviews of Interventions, 278

Adusumilli, 2000, How well does applicant rank order predict subsequent performance during radiology residency?, Acad Radiol, 7, 635, 10.1016/S1076-6332(00)80580-2

Alterman, 2011, The predictive value of general surgery application data for future resident performance, J Surg Educ, 68, 513, 10.1016/j.jsurg.2011.07.007

Altmaier, 1992, The predictive utility of behaviour-based interviewing compared with traditional interviewing in the selection of radiology residents, Invest Radiol, 27, 385, 10.1097/00004424-199205000-00013

Andriole, 2004, What predicts surgical internship performance?, Am J Surg, 188, 161, 10.1016/j.amjsurg.2004.03.003

Andriole, 2005, What predicts USMLE Step 3 performance?, Acad Med, 80, 21, 10.1097/00001888-200510001-00009

Armstrong, 2007, Do US Medical Licensing Examination Step 1 scores correlate with Council on Resident Education in Obstetrics and Gynaecology in-training examination scores and American Board of Obstetrics and Gynaecology written examination performance?, Mil Med, 172, 640, 10.7205/MILMED.172.6.640

Artino, 2012, Does self-reported clinical experience predict performance in medical school and internship?, Med Educ, 46, 172, 10.1111/j.1365-2923.2011.04080.x

Bent, 2011, Otolaryngology resident selection: do rank lists matter?, Otolaryngol Head Neck Surg, 144, 537, 10.1177/0194599810396604

Bergen, 2000, Identification of high-risk residents, J Surg Res, 92, 239, 10.1006/jsre.2000.5924

Black, 2006, Orthopaedic in-training examination scores: a correlation with USMLE results, J Bone Joint Surg Am, 88, 671, 10.2106/JBJS.C.01184

Borowitz, 2000, Information collected during the residency match process does not predict clinical performance, Arch Pediatr Adolesc Med, 154, 256, 10.1001/archpedi.154.3.256

Boyse, 2002, Does medical school performance predict radiology resident performance?, Acad Radiol, 9, 437, 10.1016/S1076-6332(03)80189-7

Brenner, 2010, Can we predict ‘problem residents’?, Acad Med, 85, 1147, 10.1097/ACM.0b013e3181e1a85d

Calhoun, 1985, Validity coefficients of clinical competence on NBME Part III examination, J Med Educ, 60, 189

Callahan, 2000, Validity of faculty ratings of students’ clinical competence in core clerkships in relation to scores on licensing examinations and supervisors’ ratings in residency, Acad Med, 75, 71, 10.1097/00001888-200010001-00023

Callahan, 2010, The predictive validity of three versions of the MCAT in relation to performance in medical school, residency, and licensing examinations: a longitudinal study of 36 classes of Jefferson Medical College, Acad Med, 85, 980, 10.1097/ACM.0b013e3181cece3d

Carmichael, 2005, Relation of residency selection factors to subsequent orthopaedic in-training examination performance, South Med J, 98, 528, 10.1097/01.SMJ.0000157560.75496.CB

Cavalcanti, 2010, Publishing history does not correlate with clinical performance among internal medicine residents, Med Educ, 44, 468, 10.1111/j.1365-2923.2009.03605.x

Chole, 2012, Predictors of future success in otolaryngology residency applicants, Arch Otolaryngol Head Neck Surg, 138, 707, 10.1001/archoto.2012.1374

Clemente, 1976, The dean's letter of recommendation and internship performance, J Med Educ, 51, 590

Crawford, 2010, Relationship among United States Medical Licensing Step 1, orthopaedic in-training, subjective clinical performance evaluations, and American Board of Orthopaedic Surgery examination scores: a 12-year review of an orthopaedic surgery residency programme, J Surg Educ, 67, 71, 10.1016/j.jsurg.2009.12.006

Cullen, 2011, Selection criteria for internal medicine residency applicants and professionalism ratings during internship, Mayo Clin Proc, 86, 197, 10.4065/mcp.2010.0655

Curry, 1988, A path analysis of medical school and residency performance: implications for housestaff selection, Eval Health Prof, 11, 113, 10.1177/016327878801100108

Daly, 2006, Predictors for resident success in otolaryngology, J Am Coll Surg, 202, 649, 10.1016/j.jamcollsurg.2005.12.006

DaRosa, 1991, Evaluation of a system designed to enhance the resident selection process, Surgery, 109, 715

Dawkins, 2005, The relationship between psychiatry residency applicant evaluations and subsequent residency performance, Acad Psychiatry, 29, 69, 10.1176/appi.ap.29.1.69

de Virgilio, 2010, Predicting performance on the American Board of Surgery qualifying and certifying examinations: a multi-institutional study, Arch Surg, 145, 852, 10.1001/archsurg.2010.177

Dougherty, 2010, Do scores of the USMLE Step 1 and OITE correlate with the ABOS Part I certifying examination? A multicentre study, Clin Orthop Relat Res, 468, 2797, 10.1007/s11999-010-1327-3

Dubovsky, 2005, Do data obtained from admissions interviews and resident evaluations predict later personal and practice problems?, Acad Psychiatry, 29, 443, 10.1176/appi.ap.29.5.443

Dubovsky, 2008, Can admissions interviews predict performance in residency?, Acad Psychiatry, 32, 498, 10.1176/appi.ap.32.6.498

Erlandson, 1982, Resident selection: applicant selection criteria compared with performance, Surgery, 92, 270

Fening, 2011, Correlation of USMLE Step 1 scores with performance on dermatology in-training examinations, J Am Acad Dermatol, 64, 102, 10.1016/j.jaad.2009.12.051

Fish, 2003, Correlation of standardised testing results with success on the 2001 American Board of Physical Medicine and Rehabilitation Part 1 board certificate examination, Am J Phys Med Rehabil, 82, 686, 10.1097/01.PHM.0000083688.23340.EA

Gardner, 1973, Overall student performance as a measure of internship performance, Surgery, 74, 80

George, 1989, Evaluating selected internship candidates and their subsequent performances, Acad Med, 64, 480, 10.1097/00001888-198908000-00013

Greenburg, 2007, Identifying medical students likely to exhibit poor professionalism and knowledge during internship, J Gen Intern Med, 22, 1711, 10.1007/s11606-007-0405-z

Guffey, 2011, The utility of pre-residency standardised tests for anaesthesiology resident selection: the place of United States Medical Licensing Examination scores, Anesth Analg, 112, 201, 10.1213/ANE.0b013e3181fcfacd

Gunderman, 2000, Are NBME examination scores useful in selecting radiology residency candidates?, Acad Radiol, 7, 603, 10.1016/S1076-6332(00)80575-9

Gunzburger, 1987, Pre-medical and medical school performance in predicting first-year residency performance, J Med Educ, 62, 379

Hayden, 2005, What characteristics of applicants to emergency medicine residency programmes predict future success as an emergency medicine resident?, Acad Emerg Med, 12, 206, 10.1111/j.1553-2712.2005.tb00870.x

Herndon, 2009, Predictors of success on the American Board of Orthopaedic Surgery examination, Clin Orthop Relat Res, 467, 2436, 10.1007/s11999-009-0939-y

Hojat, 1993, Is the glass half full or half empty? A re-examination of the associations between assessment measures during medical school and clinical competence after graduation, Acad Med, 68, 69, 10.1097/00001888-199302000-00035

Hoja, 2007, Components of postgraduate competence: analyses of thirty years of longitudinal data, Med Educ, 41, 982, 10.1111/j.1365-2923.2007.02841.x

Johnson, 2010, A comparative study of resident performance on standardised training examinations and the American Board of Ophthalmology written examination, Ophthalmology, 117, 2435, 10.1016/j.ophtha.2010.03.056

Kahn, 2001, Residency programme director evaluations do not correlate with performance on a required fourth-year objective structured clinical examination, Teach Learn Med, 13, 9, 10.1207/S15328015TLM1301_3

Kanna, 2009, Predicting performance using background characteristics of international medical graduates in an inner-city university-affiliated internal medicine residency training programme, BMC Med Educ, 9, 42, 10.1186/1472-6920-9-42

Keck, 1979, Efficacy of cognitive/non-cognitive measures in predicting resident-doctor performance, J Med Educ, 54, 759

Kesler, 1986, Intern ranking versus subsequent house officer performance, South Med J, 79, 1562, 10.1097/00007611-198612000-00020

Khongphatthanayothin, 2002, Resident recruitment: what are good predictors for performance during paediatric residency training?, J Med Assoc Thai, 85, 302

Komives, 1984, The applicant interview as a predictor of resident performance, J Med Educ, 59, 425

Markert, 1993, Comparing clerkship sites in a community-based medical school by evaluating students’ undergraduate and postgraduate performances, Acad Med, 68, 298, 10.1097/00001888-199304000-00018

McCaskill, 2007, USMLE Step 1 scores as a significant predictor of future board passage in paediatrics, Ambul Pediatr, 7, 192, 10.1016/j.ambp.2007.01.002

McDonald, 2008, Associations between United States Medical Licensing Examination (USMLE) and internal medicine in-training examination (IM-ITE) scores, J Gen Intern Med, 23, 1016, 10.1007/s11606-008-0641-x

Naylor, 2008, Factors related to attrition in surgery residency based on application data, Arch Surg, 143, 647, 10.1001/archsurg.143.7.647

Norcini, 1986, Predictors of the performance of foreign medical graduates on the 1982 certifying examination in internal medicine, JAMA, 256, 3367, 10.1001/jama.1986.03380240061029

Olawaiye, 2006, Resident selection process and prediction of clinical performance in an obstetrics and gynaecology programme, Teach Learn Med, 18, 310, 10.1207/s15328015tlm1804_6

Ozuah, 2008, Predicting residents’ performance: a prospective study, BMC Med Educ, 2, 7, 10.1186/1472-6920-2-7

Papp, 1997, The relationship between criteria used to select residents and performance during residency, Am J Surg, 173, 326, 10.1016/S0002-9610(96)00389-3

Part, 1993, Predicting the first-year performances of international medical graduates in an internal medicine residency, Acad Med, 68, 856, 10.1097/00001888-199311000-00015

Perez, 2009, Correlation of United States Medical Licensing Examination and internal medicine in-training examination performance, Adv Health Sci Educ, 14, 753, 10.1007/s10459-009-9158-2

Rezek, 2012, Pre-residency publication rate strongly predicts future academic radiology potential, Acad Radiol, 19, 632, 10.1016/j.acra.2011.11.017

Rifkin, 2005, Correlation between housestaff performance on the United States Medical Licensing Examination and standardised patient encounters, Mt Sinai J Med, 72, 47

Shiroma, 2010, Selection factors among international medical graduates and psychiatric residency performance, Acad Psychiatry, 34, 128, 10.1176/appi.ap.34.2.128

Sosenko, 1993, NBME examination Part I as a predictor of clinical and ABIM certifying examination performances, J Gen Intern Med, 8, 86, 10.1007/BF02599990

Spellacy, 1985, The use of national board scores in selecting residents for obstetrics and gynaecology, Am J Obstet Gynecol, 153, 605, 10.1016/S0002-9378(85)80242-8

Spitzer, 2009, Factors associated with successful performance in an orthopaedic surgery residency, J Bone Joint Surg Am, 91, 2750, 10.2106/JBJS.H.01243

Spurlock, 2010, Using United States Medical Licensing Examination (USMLE) examination results to predict later in-training examination performance among general surgery residents, J Surg Educ, 67, 452, 10.1016/j.jsurg.2010.06.010

Stohl, 2010, Can medical school performance predict residency performance? Resident selection and predictors of successful performance in obstetrics and gynaecology, J Grad Med Educ, 2, 322, 10.4300/JGME-D-09-00101.1

Strand, 2011, Can a structured, behaviour-based interview predict future resident success?, Am J Obstet Gynecol, 204, 446.e1, 10.1016/j.ajog.2011.02.019

Swanson, 1991, Validity of NBME Part I and Part II scores in prediction of Part III performance, Acad Med, 66, 7, 10.1097/00001888-199109000-00024

Swanson, 2009, Relationship between performance on Part I of the American Board of Orthopaedic Surgery certifying examination and scores on USMLE Steps 1 and 2, Acad Med, 84, 21, 10.1097/ACM.0b013e3181b37fd2

Taylor, 2005, The relationship between the National Board of Medical Examiners’ prototype of the Step 2 clinical skills exam and interns’ performance, Acad Med, 80, 496, 10.1097/00001888-200505000-00019

Thordarson, 2007, Resident selection: how we are doing and why?, Clin Orthop Relat Res, 459, 255, 10.1097/BLO.0b013e31805d7eda

Thundiyil, 2010, Do United States Medical Licensing Examination (USMLE) scores predict in-training test performance for emergency medicine residents?, J Emerg Med, 38, 65, 10.1016/j.jemermed.2008.04.010

Tolan, 2010, The electronic residency application service application can predict Accreditation Council for Graduate Medical Education competency-based surgical resident performance, J Surg Educ, 67, 444, 10.1016/j.jsurg.2010.05.002

Turner, 1987, Using ratings of resident competence to evaluate NBME examination passing standards, J Med Educ, 62, 572

Turner, 2006, A quantitative composite scoring tool for orthopaedic residency screening and selection, Clin Orthop Relat Res, 44, 50, 10.1097/01.blo.0000224042.84839.44

Warrick, 1986, Predictors of success in an anaesthesiology residency, J Med Educ, 61, 591

Weiss, 1984, A prospective evaluation of performance during the first year of the medical residency, J Med Educ, 59, 967

Yindra, 1988, Medical school achievements as predictors of residency performance, J Med Educ, 63, 356

Shimahara, 2010, Should medical grades be standardised? Improving the resident selection process, J Grad Med Educ, 2, 297, 10.4300/JGME-D-09-00098.1

Epstein, 2007, Assessment in medical education, N Engl J Med, 356, 387, 10.1056/NEJMra054784

Epstein, 2002, Defining and assessing professional competence, JAMA, 287, 226, 10.1001/jama.287.2.226

Leinster, 2003, Assessment in medical training, Lancet, 362, 1770, 10.1016/S0140-6736(03)14849-0

Doherty, 2011, Personality factors and medical training: a review of the literature, Med Educ, 45, 132, 10.1111/j.1365-2923.2010.03760.x

Barclay, 2001, Improving selection interviews with structure: organisations use of ‘behavioural’ interviews, Pers Rev, 30, 81, 10.1108/00483480110380154