Writing evaluation: what can analytic versus holistic essay scoring tell us?

1992 Bachman, 1990 Bachman, 1991, What does language testing have to offer, TESOL Quarterly, 25, 671, 10.2307/3587082 Bamberg, 1982, Multiple-choice and holistic essay scores: what are they measuring?, College Composition and Communication, 33, 404, 10.2307/357953 Braddock, 1963 Brossell, 1983, Rhetorical specification in essay examination topics, College English, 45, 165, 10.2307/377224 Carlman, 1986, Topic differences on writing tests: how much do they matter?, English Quarterly, 19, 39 Carlson, S. et al., 1985: Relationship of Admission Test Scores to Writing Performance of Native and Non-native Speakers of English (TOEFL Research Reports, 19). Educational Testing Service, Princeton, New Jersey. Caudery, 1990, The validity of timed essay tests in the assessment of writing skills, ELT Journal, 44, 122, 10.1093/elt/44.2.122 Charney, 1984, The validity of using holistic scoring to evaluate writing, Research in the Teaching of English, 18, 65 Cohen, 1994 Connor-Linton, 1995, Looking behind the curtain: what do L2 composition ratings really mean?, TESOL Quarterly, 29, 762, 10.2307/3588174 Cooper, 1977 Crowhurst, 1979, Audience and mode of discourse effects on syntactic complexity in writing at two grade levels, Research in the Teaching of English, 13, 101 Cumming, 1990, Expertise in evaluating second language compositions, Language Testing, 7, 31, 10.1177/026553229000700104 Cushing-Weigle, 1994, Effects of training on raters of ESL compositions, Language Testing, 11, 197, 10.1177/026553229401100206 Douglas, 1995, Developments in language testing, Annual Review of Applied Linguistics, 15, 167 Doushaq, 1986, An investigation into stylistic errors of Arab students learning English for academic purposes, English for Specific Purposes, 5, 27, 10.1016/0889-4906(86)90005-0 Elbow, 1999, Ranking, evaluating, and liking: sorting out three forms of judgments, 175 Gamaroff, 2000, Rater reliability in language assessment: the bug of all bears, System, 28, 31, 10.1016/S0346-251X(99)00059-7 Hamp-Lyons, L., 1986a. Testing second language writing in academic settings. Unpublished doctoral dissertation, University of Edinburgh, England. Hamp-Lyons, 1986, Writing in a foreign language and rhetorical transfer: influences on raters’ evaluation, 72 Hamp-Lyons, 1990, Second language writing: assessment issues, 69 1991 Hamp-Lyons, 1995, Rating nonnative writing: the trouble with holistic scoring, TESOL Quarterly, 29, 759, 10.2307/3588173 Hayward, 1990, Evaluations of essay prompts by nonnative speakers of English, TESOL Quarterly, 24, 753, 10.2307/3587130 Hillocks, 1986 Hoetker, 1982, Essay examination topics and students’ writing, College Composition and Communication, 33, 377, 10.2307/357950 Hoey, 1991 Homburg, 1984, Holistic evaluation of ESL compositions: can it be validated objectively?, TESOL Quarterly, 18, 87, 10.2307/3586337 Horowitz, 1986, Essay examination prompts and the teaching of academic writing, English for Specific Purposes, 5, 107, 10.1016/0889-4906(86)90017-7 Horowitz, 1986, What professors actually require: academic tasks for the ESL classroom, TESOL Quarterly, 20, 445, 10.2307/3586294 Jacobs, 1981 Kaczmarek, 1980, Scoring and rating essay tasks, 151 Kegley, 1986, The effect of mode-discourse on student writing performance: implications for policy, Educational Evaluation and Policy Analysis, 8, 147, 10.3102/01623737008002147 1990 Kroll, 1990, What does time buy? ESL student performance on home versus class compositions, 140 1998 Lloyd-Jones, 1987, Tests of writing ability, 155 Mullen, 1980, Evaluating writing proficiency in ESL, 160 Myers, 1980 1981 Oller, 1980 Pere-Woodley, 1991, Writing in L1 and L2: analyzing and evaluating learners’ texts, Language Teaching, 2, 69, 10.1017/S0261444800006170 Perkins, 1983, On the use of composition scoring techniques, objective measures and objective tests to evaluate ESL writing ability, TESOL Quarterly, 17, 651, 10.2307/3586618 Pierce, 1991, TOEFL test of written English (TWE) scoring guide, TESOL Quarterly, 25, 159, 10.2307/3587035 Purves, 1992, Reflections on research and assessment in written composition, Research in the Teaching of English, 26, 108 Quellmalz, 1982, Effects of discourse and response mode on the measurement of writing competence, Journal of Educational Measurement, 19, 241, 10.1111/j.1745-3984.1982.tb00131.x Raymond, 1982, What we don’t know about the evaluation of writing, College Composition and Communication, 33, 399, 10.2307/357952 Read, 1990, Providing relevant content in an EAP writing test, English for Specific Purposes, 9, 109, 10.1016/0889-4906(90)90002-T Reid, 1993 Ruth, 1988 Shakir, 1991, Coherence in EFL student-written texts: two perspectives, Foreign Language Annals, 24, 399, 10.1111/j.1944-9720.1991.tb00485.x Shohamy, 1995, Performance assessment in language testing, Annual Review of Applied Linguistics, 15, 188, 10.1017/S0267190500002683 Siegel, 1990, Multiple tests: some practical considerations, TESOL Quarterly, 24, 773, 10.2307/3587136 Smith, 1985, Some effects of varying the structure of a topic on college students’ writing, Written Communication, 2, 73, 10.1177/0741088385002001005 SPSS Base 7.5 for Windows’ User’s Guide, 1997. SPSS Inc, Michigan, Chicago. Sweedler-Brown, 1992, The effect of training on the appearance bias of holistic essay graders, Journal of Research and Development in Education, 26, 24 Sweedler-Brown, 1993, ESL essay evaluation: the influence of sentence-level and rhetorical features, Journal of Second Language Writing, 2, 3, 10.1016/1060-3743(93)90003-L Silva, 1993, Toward an understanding of the distinct nature of L2 writing: the ESL research and its implications, TESOL Quarterly, 27, 657, 10.2307/3587400 Tedick, 1990, ESL writing assessment: subject matter knowledge and its impact on performance, English for Specific Purposes, 9, 123, 10.1016/0889-4906(90)90003-U Tedick, D.J., Mathison, M.A., 1995. Holistic scoring in ESL writing assessment: what does an analysis of rhetorical features reveal? In: Academic Writing in a Second Language: Essays on Research and Pedagogy. Ablex Publishing Corporation, Norwood, pp. 205–230. Upshur, 1995, Constructing rating scales for second language tests, ELT Journal, 49, 3, 10.1093/elt/49.1.3 Weir, C., 1983. Identifying the language problems of overseas students in tertiary education in the UK. Unpublished doctoral dissertation, University of London, England. Weir, 1990 White, 1994