Comparing computer-based and paper-based rating modes in an English writing test

Barkaoui, 2015, Test takers’ writing activities during the TOEFL iBT® writing tasks: A stimulated recall study, ETS Research Report Series, 2015, 1, 10.1002/ets2.12050 Barkaoui, 2016, What and when second-language learners revise when responding to timed writing tasks on the computer: The roles of task type, second language proficiency, and keyboarding skills, The Modern Language Journal, 100, 320, 10.1111/modl.12316 Barkaoui, 2018, The effects of writing mode and computer ability on L2 test-takers' essay characteristics and scores, Assessing Writing, 36, 19, 10.1016/j.asw.2018.02.005 Bennett, 2003 Brown, 1991, Computers and assessment: The effect of typing versus handwriting on the holistic scoring of essays, Research and Teaching in Developmental Education, 8, 5 Brunfaut, 2018, Going online: The effect of mode of delivery on performances and perceptions on an English L2 writing test suite, Assessing Writing, 36, 3, 10.1016/j.asw.2018.02.003 Canz, 2020, Presentation-mode effects in large-scale writing assessments, Language Assessment Quarterly, 18, 83 Chan, 2018, Researching the comparability of paper-based and computer-based delivery in a high-stakes writing test, Assessing Writing, 36, 32, 10.1016/j.asw.2018.03.008 Chen, 2011, Effects of computer versus paper administration of an adult functional writing assessment, Assessing Writing, 16, 49, 10.1016/j.asw.2010.11.001 Cheung, 2016, A comparative study of paper-and-pen versus computer-delivered assessment modes on students' writing quality: A Singapore study, The Asia-Pacific Education Researcher, 25, 25, 10.1007/s40299-015-0229-2 Cohen, 1988 Coniam, 2009, Marking essays on screen: An investigation into the reliability of marking extended subjective texts, British Journal of Educational Technology, 41, 814 Coniam, 2010, A comparison of on-screen and paper-based marking in the Hong Kong public examination system, Educational Research and Evaluation: An International Journal on Theory and Practice, 15, 242 Coniam, 2016 Creswell, 2011 Dastpak, 2021, Investigating IELTS paper mode vs. computer mode: Evidence from academic writing test, Journal of Language and Translation, 11, 175 Douglas, 2007, Assessing language using computer technology, Annual Review of Applied Linguistics, 27, 115, 10.1017/S0267190508070062 Guapacha Chamorro, M. (2020). Investigating the comparative validity of computer-and paper-based writing tests and differences in impact on EFL test-takers and raters. Doctoral dissertation, ResearchSpace@ Auckland. Haladyna, 2004, Construct‐irrelevant variance in high‐stakes testing, Educational Measurement: Issues and Practice, 23, 17, 10.1111/j.1745-3992.2004.tb00149.x He, 2019, 9 Hoomanfard, 2015, Writing on a computer and using paper and pencil: Is there any difference in the internal cognitive processes, GEMA Online® Journal of Language Studies, 15 Hughes, 2010, The influence of presentation upon examination marks, 11th Annual Conference of the Subject Centre for Information and Computer Sciences Jeong, 2021, Advantages of print reading over screen reading: a comparison of visual patterns, reading performance, and reading attitudes across paper, computers, and tablets, International Journal of Human–Computer Interaction, 37, 1674, 10.1080/10447318.2021.1908668 Jian, 2022, Reading in print versus digital media uses different cognitive strategies: evidence from eye movements during science-text reading, Reading and Writing, 35, 1549, 10.1007/s11145-021-10246-2 Jin, 2009, Principles for designing the Internet-Based College English Test, Foreign Language World, 4, 61 2014 Johnson, 2012, Marking extended essays on screen: Exploring the link between marking processes and comprehension, E-Learning and Digital Media, 9, 50, 10.2304/elea.2012.9.1.50 Johnson, 2010, Marking essays on screen: An investigation into the reliability of marking extended subjective texts, British Journal of Educational Technology, 41, 814, 10.1111/j.1467-8535.2009.00979.x Johnson, 2009, An investigation into marker reliability and other qualitative aspects of on-screen essay marking Martin, Paper presented at the British Educational Research Association Annual Conference Manchester University Klein, 2005, The effect of variations in handwriting and print on evaluation of student essays, Assessing Writing, 10, 134, 10.1016/j.asw.2005.05.002 Kohler, 2015, Based or computer-based essay writing: Differences in performance and perception, Linguistic Portfolios, 4, 13 Li, 2006, The mediation of technology in ESL writing and its implications for writing assessment, Assessing Writing, 11, 5, 10.1016/j.asw.2005.09.001 Linacre, 2013, Facets computer program for many-facet Rasch measurement, version 3.71.2 Luo, 2009, Review of on-screen marking research, Zhongguo Kaoshi (China Examinations), 11, 3 McNamara, 1996 Messick, 1995, Validity of psychological assessment, American Psychologist, 50, 741, 10.1037/0003-066X.50.9.741 Ministry of Education. (2007). The approval for Beijing Xi Pu Wu You Educational Service Company Limited to develop the Internet-based CET Testing System. Document No. 87. Beijing, China: Ministry of Education, P.R. China. Ministry of Education. (2008). The notice about the trial implementation of the Internet-based CET. Document No. 239. Beijing, China: Ministry of Education, P.R. China. Nakatsuhara, 2021, Comparing rating modes: Analysing live, audio, and video ratings of IELTS speaking test performances, Language Assessment Quarterly, 18, 83, 10.1080/15434303.2020.1799222 Powers, 1994, Will they think less of my handwritten essay if others word process theirs? Effects on essay scores of intermingling handwritten and word-processed essays, Journal of Educational Measurement, 31, 220, 10.1111/j.1745-3984.1994.tb00444.x Raikes, 2004, From Paper to Screen: some issues on the way, Paper presented at the IAEA Conference, Vilamoura, Portugal Russell, 2004, Effects of handwriting and computer-print on composition scores: A follow-up to powers, fowles, farnum, & ramsey, Practical Assessment, Research, and Evaluation, 9, 1 Sarbakhshian, 2016, The comparison of typed and handwritten essays of Iranian EFL students in terms of length, spelling, and grammar, The Journal of Applied Linguistics, 9, 104 Shaw, 2008, Essay Marking On-Screen: implications for assessment validity, E-Learning, 5, 256 Shiell, 2011, Extended essay marking on screen: Does marking mode influence marking outcomes and processes?, Research Matters: A Cambridge Assessment Publication, 11, 2 Sprouse, J., & Webb J. (1994). The Pygmalion Effect and Its Influence on the Grading and Gender Assignment on Spelling and Essay Assessments. Retrieved from 〈http://www.eric.ed.gov〉. Whithaus, 2008, Keyboarding compared with handwriting on a high-stakes writing assessment: Student choice of composing medium, raters' perceptions, and text quality, Assessing Writing, 13, 4, 10.1016/j.asw.2008.03.001 Yu, 2004, Investigating differences in examinee performance between computer-based and handwritten essays Zhang, 2003 Zou, 2016, Effects of test media on different EFL test-takers in writing scores and in the cognitive writing process, Technology, Pedagogy and Education, 25, 79, 10.1080/1475939X.2014.954140