Assembling validity evidence for assessing academic writing: Rater reactions to integrated tasks

Barkaoui, 2011, Think-aloud protocols in research on essay rating: An empirical study of their veridicality and reactivity, Language Testing, 28, 51, 10.1177/0265532210376379 Bowles, 2010 Brown, 2005 Brown, 1991, Do English and ESL faculties rate writing samples differently?, TESOL Quarterly, 25, 587, 10.2307/3587078 Cumming, 1990, Expertise in evaluating second language compositions, Language Testing, 7, 31, 10.1177/026553229000700104 Cumming, 2001 Cumming, 2002, Decision making while rating ESL/EFL writing tasks: A descriptive framework, The Modern Language Journal, 86, 67, 10.1111/1540-4781.00137 DeRemer, 1998, Writing assessment: Raters’ elaboration of the rating task, Assessing Writing, 5, 7, 10.1016/S1075-2935(99)80003-8 Douglas, 1994, Quantity and quality in speaking test performance, Language Testing, 11, 125, 10.1177/026553229401100203 Douglas, 1992, Analyzing oral proficiency test performance in general and specific-purpose contexts, System, 20, 317, 10.1016/0346-251X(92)90043-3 Duff, 2007 Ericsson, 1993 Green, 1998 Gebril, 2009, Score generalizability of academic writing tasks: Does one test method fit it all?, Journal of Language Testing, 26, 507, 10.1177/0265532209340188 Gebril, 2010, Bringing reading-to-write and writing-only assessment tasks together: A generalizability analysis, Assessing Writing Journal, 15, 100, 10.1016/j.asw.2010.05.002 Gebril, 2009, Investigating source use, discourse features, and process in integrated writing tests, 7, 47 Gebril, 2013, Towards a transparent construct of reading-to-write assessment tasks: The interface between discourse features and proficiency, Language Assessment Quarterly, 10, 1, 10.1080/15434303.2011.642040 Hale, 1996 Horowitz, 1986, What professors actually require: Academic tasks for the ESL classroom, TESOL Quarterly, 20, 445, 10.2307/3586294 Kane, 2006, Validation, 7 Lumley, 2002, Assessment criteria in a large-scale writing test: What do they really mean to the raters?, Language Testing, 19, 246, 10.1191/0265532202lt230oa Milanovic, 1996, A study of the decision-making behavior of composition markers, 92 Moore, 1999, 64 Pennycook, 1996, Borrowing others’ words: Text, ownership, memory, and plagiarism, TESOL Quarterly, 30, 201, 10.2307/3588141 Plakans, 2008, Comparing composing processes in writing-only and reading-to-write test tasks, Assessing Writing, 13, 111, 10.1016/j.asw.2008.07.001 Plakans, 2009, Discourse synthesis in integrated second language writing assessment, Language Testing, 26, 561, 10.1177/0265532209340192 Plakans, 2012, A close investigation of source use in integrated writing tasks, Assessing Writing Journal, 17, 18, 10.1016/j.asw.2011.09.002 Schoonen, 1997, The assessment of writing ability: Expert readers versus lay readers, Language Testing, 14, 157, 10.1177/026553229701400203 Shaw, 2007 Shi, 2001, Native-and nonnative-speaking EFL teachers’ evaluation of Chinese students’ English writing, Language Testing, 18, 303 Shohamy, 1992, The effect of raters’ background and training on the reliability of direct writing tests, Modern Language Journal, 76, 27, 10.1111/j.1540-4781.1992.tb02574.x Song, 1996, Do English and ESL faculty differ in evaluating the essays of native English-speaking and ESL students?, Journal of Second Language Writing, 5, 163, 10.1016/S1060-3743(96)90023-5 Watanabe, 2001 Weigle, 1994, Effects of training on raters of ESL compositions, Language Testing, 11, 197, 10.1177/026553229401100206 Weigle, 1998, Using FACETS to model rater training effects, Language Testing, 15, 263, 10.1177/026553229801500205