Do outcomes from high stakes examinations taken in test centres and via live remote proctoring differ?

COMPUTERS AND EDUCATION OPEN - Tập 2 - Trang 100061 - 2021
Gemma Cherry1, Michael O'Leary1, Oksana Naumenko2, Li-Ann Kuan2, Linda Waters2
1Centre for Assessment Research, Policy and Practice in Education (CARPE), Institute of Education, Dublin City University, D09Y00, Ireland
2Proemtric Inc, 501 South Clinton St, Baltimore, MD 21224, United States

Tài liệu tham khảo

Alessio, 2017, Examining the effect of proctoring on online test scores, Online Learn., 21, 10.24059/olj.v21i1.885 2014 2021, Test centers are dead, long live test centers, Webinar Audio Transcr. Bedford, 2011, Preventing online cheating with technology: a pilot study of remote proctor and an update of its use, J Higher Educ Theory Pract, 11, 41 Caplan-Bricker, 2021 Carstairs, 2009, Internet testing: a natural experiment reveals test score inflation on a high-stakes, unproctored cognitive test, Comput Hum Behav, 25, 738, 10.1016/j.chb.2009.01.011 Castillo, 2017, Mobile and nonmobile assessment in organisations: does proctoring make a difference?, Psychology, 8, 878, 10.4236/psych.2017.86057 Chen, 2020, Learning by cheating, Proc Mach Learn Res, 100, 66 Coghlan, 2021, Good proctor or “Big Brother”? Ethics and online exam supervision technologies, Philosophy and Technology, 10.1007/s13347-021-00476-1 Cohen, 1988 Dadashzadeh, 2021, The online examination dilemma: to proctor or not to proctor?, J Instr Pedag, 25, 1 Dadey, 2018, The comparability of scores from different digital devices: a literature review and synthesis with recommendations for practice, Appl Meas Educ, 31, 30, 10.1080/08957347.2017.1391262 Daffin, 2018, Comparing student performance on proctored and non-proctored exams in online psychology courses, Online Learn, 22, 131, 10.24059/olj.v22i1.1079 Davis, 2017, Device comparability of tablets and computers for assessment purposes, Appl Meas Educ, 30, 16, 10.1080/08957347.2016.1243538 Draaijer, J. (2017). A report on the current state of online proctoring practices in higher education within the EU and an outlook for OP4RE activities. Retrieved July 11, 2021, from https://research.vu.nl/ws/portalfiles/portal/39908260/StartReportOP4RE_exended.pdf. Flaherty, C. (2020, May 11). 'Big Proctor'. Retrived July 6, 2021, from https://www.insidehighered.com/news/2020/05/11/online-proctoring-surging-during-covid-19. Foster, 2009, Secure, online, high-stakes testing: Science fiction or business reality?, Industrial and Organizational Psychology, 2, 31, 10.1111/j.1754-9434.2008.01103.x Goedl, 2020, A study of grade equivalency between proctored and unproctored exams in distance education, Am J Distance Educ, 34, 280, 10.1080/08923647.2020.1796376 Hylton, 2016, Utilizing webcam-based proctoring to deter misconduct in online exams, Comput Educ, 92–93, 53, 10.1016/j.compedu.2015.10.002 Illingworth, 2014, Internet-based, unproctored assessments on mobile and non-mobile devices: usage, measurement equivalence, and outcomes, J Bus Psychol, 30, 325, 10.1007/s10869-014-9363-8 Institute for Credentialing Excellence . (2021). Report on the NCCA assessment of live remote proctoring. Washington, DC. Retrived from https://www.dcu.ie/sites/default/files/inline-files/ncca_lrp_report-final-2.2021.pdf. Karim, 2014, Cheating, reactions, and performance in remotely proctored testing: an exploratory experimental study, J Bus Psychol, 29, 555, 10.1007/s10869-014-9343-z King, 2011, Does size matter? A study on the use of netbooks in K-12 assessment Lee, 2020, Impact of proctoring environments on student performance: online vs offline proctored exams, J Asian Financ Econ Bus, 7, 653, 10.13106/jafeb.2020.vol7.no8.653 Lilley, 2016, Remote live invigilation: a pilot study, J Interact Media Educ, 2016, 1 Milliron, 2008, The net generation cheating challange, Innovative, 4, 1 National Commission for Credentialling Agencies (NCCA). (2014). National commission for certifying agencies: standards for the accreditation of certification programs. Institute for Credentialing Excellence. Retrived April 15, 2021, from https://knappinternational.com/assets/uploads/pages/NCCA%20standards(1).pdf. Nigam, 2021, A systematic review on ai-based proctoring systems: past, present and future, Educ Inform Technol, 10.1007/s10639-021-10597-x O'Leary, L. (2020, June 17). Psychometric perspectives on remote proctoring. Alpine Testing Solutions. Retrieved July 14, 2021, from https://www.alpinetesting.com/psychometric-perspectives-on-remote-proctoring/. Paredes, 2021, Remote proctored exams: integrity assurance in online education?, Distance Educ, 42, 200, 10.1080/01587919.2021.1910495 Peters, J. (2020, June 8). IBM will no longer offer, develop, or research facial recognition technology. The Verge. Retrieved July 12, 2021, from https://www.theverge.com/2020/6/8/21284683/ibm-no-longer-general-purpose-facial-recognition-analysis-software. Prince, 2009, Comparisons of proctored versus non-proctored testing strategies in graduate distance education curriculum, J Coll Teach Learn (TLC), 6, 51 Rea, 1992 Reisenwitz, 2020, Examining the necessity of proctoring online exams, J Higher Educ Theory Pract, 20, 118 Rios, 2017, Online proctored versus unproctored low-stakes internet test administration: is there differential test-taking behavior and performance?, Am J Dis Educ, 31, 226 Scully, 2020, Remote proctoring : memo 1. Dublin City University: Centre for Assessment Research, Policy and Practice in Education. Unpublished Manuscript, -, 1 Silverman, 2021, What happens when you close the door on remote proctoring? Moving toward authentic assessments with a people-centered approach, Improv Acad J Educ Dev, 39, 115 Sinha, 2020, Remote proctored theory and objective online examination, Int J Adv Netw Appl, 11, 4494 Steedle, 2016 Swauger, 2020, Our bodies encoded: algorithmic test proctoring in higher education, Hybrid Pedag Thompson, 2007, Effect sizes, confidence intervals, and confidence intervals for effect sizes, Psychol Sch, 44, 423, 10.1002/pits.20234 Way, 2015, From standardization to personalization: the comparability of scores based on different testing conditions, modes, and devices Weiner, 2017, A comparative study of online remote proctored versus onsite proctered high-stakes exams, J Appl Test Technol, 18, 13 Woldeab, 2019, 21st Century assessment: online proctoring, test anxiety, and student performance, Int J E Learn Dis Educ, 34, 1 Wuthisatian, 2020, Student exam performance in different proctored environments: evidence from an online economics course, Int Rev Econ Educ, 35, 10.1016/j.iree.2020.100196 Zhang, 2018, A virtual proctor with biometric authentication for facilitating distance education, Online engineering and internet of things. lecture notes in networks and systems, 22, 10.1007/978-3-319-64352-6_11 Harwell, D. (2020). Mass school closures in the wake of the coronavirus are driving a new wave of student surveillance. Retrived from https://www.washingtonpost.com/technology/2020/04/01/online-proctoring-college-exams-coronavirus/. Butler-Henderson, 2020, A systematic review of online examinations: A pedagogical innovation for scalable authentication and integrity, Computers and Education, 159, 104024, 10.1016/j.compedu.2020.104024 Burke, 2009, Preserving the integrity of online testing, Industrial and Organizational Psychology, 2, 35, 10.1111/j.1754-9434.2008.01104.x Crocker, 1986