Impact of Structured Feedback on Examiner Judgements in Objective Structured Clinical Examinations (OSCEs) Using Generalisability Theory

Khan, 2013, The objective structured clinical examination (OSCE): AMEE guide no. 81. Part I: an historical and theoretical perspective, Med Teach, 35, e1437, 10.3109/0142159X.2013.818634 Fuller, 2017, Managing extremes of assessor judgment within the OSCE, Med Teach, 39, 58, 10.1080/0142159X.2016.1230189 Downing, 2009 Harden, 2016 Daniels, 2018, Twelve tips for developing an OSCE that measures what you want, Med Teach, 40, 1208, 10.1080/0142159X.2017.1390214 Roberts, 2010, Should candidate scores be adjusted for interviewer stringency or leniency in the multiple mini-interview?, Med Educ, 44, 690, 10.1111/j.1365-2923.2010.03689.x Williams, 2003, Special article: cognitive, social and environmental sources of bias in clinical performance ratings, Teach Learn Med, 15, 270, 10.1207/S15328015TLM1504_11 McManus, 2006, Assessment of examiner leniency and stringency ('hawk-dove effect') in the MRCP(UK) clinical examination (PACES) using multi-facet Rasch modelling, BMC Med Educ, 6, 42, 10.1186/1472-6920-6-42 Harasym, 2008, Undesired variance due to examiner stringency/leniency effect in communication skill scores assessed in OSCEs, Adv Health Sci Educ Theory Pract, 13, 617, 10.1007/s10459-007-9068-0 Bartman, 2013, A method for identifying extreme OSCE examiners, Clin Teach, 10, 27, 10.1111/j.1743-498X.2012.00607.x Yeates, 2013, Seeing the same thing differently: mechanisms that contribute to assessor differences in directly-observed performance assessments, Adv Health Sci Educ Theory Pract, 18, 325, 10.1007/s10459-012-9372-1 Hope, 2014, Examiners are most lenient at the start of a two-day OSCE, Med Teach, 37, 81, 10.3109/0142159X.2014.947934 Berendonk, 2013, Expertise in performance assessment: assessors' perspectives, Adv Health Sci Educ Theory Pract, 18, 559, 10.1007/s10459-012-9392-x Gingerich, 2014, Seeing the ‘black box’ differently: assessor cognition from three research perspectives, Med Educ, 48, 1055, 10.1111/medu.12546 Van der Vleuten, 2012, A model for programmatic assessment fit for purpose, Med Teach, 34, 205, 10.3109/0142159X.2012.652239 Hodges, 2013, Assessment in the post-psychometric era: learning to love the subjective and collective, Med Teach, 35, 564, 10.3109/0142159X.2013.789134 Ten Cate, 2019, The power of subjectivity in the assessment of medical trainees, Acad Med, 94, 333, 10.1097/ACM.0000000000002495 Holmboe, 2004, Effects of training in direct observation of medical residents' clinical competence: a randomized trial, Ann Intern Med, 140, 874, 10.7326/0003-4819-140-11-200406010-00008 Pell, 2008, Assessor training: its effects on criterion-based assessment in a medical context, Int J Res Method Educ, 31, 143, 10.1080/17437270802124525 Cook, 2009, Effect of rater training on reliability and accuracy of mini-CEX scores: a randomized, controlled trial, J Gen Intern Med, 24, 74, 10.1007/s11606-008-0842-3 Malau-Aduli, 2012, Inter-rater reliability: comparison of checklist and global scoring for OSCEs, Creativ Educ, 3, 937, 10.4236/ce.2012.326142 Weitz, 2014, Effects of a rater training on rating accuracy in a physical examination skills assessment, GMS Z Med Ausbild, 31, doc41 Mortsiefer, 2017, Examiner characteristics and interrater reliability in a communication OSCE, Patient Educ Counsel, 100, 1230, 10.1016/j.pec.2017.01.013 Reid, 2016, Taking OSCE examiner training on the road: reaching the masses, Med Educ Online, 21, 32389, 10.3402/meo.v21.32389 Crossley, 2002, A key to unlock professional assessment, Med Educ, 36, 972, 10.1046/j.1365-2923.2002.01320.x Cronbach, 1972 Brennan, 2010, Generalizability theory and classical test theory, Appl Meas Educ, 24, 1, 10.1080/08957347.2011.532417 Bloch, 2012, Generalizability theory for the perplexed: a practical introduction and guide: AMEE guide no. 68, Med Teach, 34, 960, 10.3109/0142159X.2012.703791 2019 Marcoulides, 2000, Generalizability theory, 527 Crossley, 2007, 'I'm pickin' up good regressions': the governance of generalisability analyses, Med Educ, 41, 926, 10.1111/j.1365-2923.2007.02843.x