Design and evaluation of automated writing evaluation models: Relationships with writing in naturalistic settings

Attali, 2006, Automated essay scoring with e-rater® V.2, Journal of Technology, Learning, and Assessment, 4 Attali, 2007 Baird, 2014 Bennett, 1997 Bennett, 2016, Validity and automated scoring, 142 Breyer, 2017 Bridgeman, 2014, Using an external validity criterion as an alternate basis for automated scoring Bridgeman, 2012, Comparison of human and machine scoring of essays: differences by gender, ethnicity, and country, Applied Measurement in Education, 25, 27, 10.1080/08957347.2012.635502 Budescu, 1993, Dominance analysis: a new approach to the problem of relative importance of predictors in multiple regression, Psychological Bulletin, 114, 542, 10.1037/0033-2909.114.3.542 Burstein, 2013, The e-rater automated essay scoring system, 55 Condon, 2013, Large-scale assessment, locally developed measures, and automated scoring of essays: fishing for red herrings?, Assessing Writing, 18, 100, 10.1016/j.asw.2012.11.001 Council of Writing Program Administrators, National Council of Teachers of English, & National Writing Project. (2011). Framework for Success in Postsecondary Writing. Retrieved from http://www.nwp.org/img/resources/framework_for_success.pdf. Dikli, 2006, An overview of automated scoring of essays, The Journal of Technology, Learning, and Assessment, 5 ETS, 2016 ETS, 2017 ETS, 2017 Elliott, 2013, Automated essay evaluation and the teaching of writing, 16 Elliott, 2007, Portfolio assessment: quantification and community, Journal of Writing Assessment, 3, 5 Elliott, 2016, ePortfolios: Foundational issues in measurement, Journal of Writing Assessment, 9 Hamp-Lyons, 2016, Editorial: farewell to holistic scoring. Part two: why build a house with only one brick?, Assessing Writing, 29, A1, 10.1016/j.asw.2016.06.006 Kane, 2006, Validation, 17 Kane, 2013, Validating the interpretation and uses of test scores, Journal of Educational Measurement, 50, 1, 10.1111/jedm.12000 Kelly-Riley, 2016, A theory of ethics for writing assessment, Journal of Writing Assessment, 9 Knoch, 2009, Diagnostic assessment of writing: a comparison of two scales, Language Testing, 26, 275, 10.1177/0265532208101008 Matoush, 2012, Tests of english language as significant thresholds for college-bound Chinese and the washback of test-preparation, Changing English, 19, 10.1080/1358684X.2012.649176 Mislevy, 1996, Test theory reconceived, Journal of Educational Measurement, 33, 379, 10.1111/j.1745-3984.1996.tb00498.x Page, 1966, The imminence of grading essays by computer, Phi Delta Kappan, 48, 238 Pedhazur, 1997, Multiple regression in behavioral research Perelman, 2014, When the state of the art is counting words, Assessing Writing, 21, 104, 10.1016/j.asw.2014.05.001 Poe, 2016, Writing assessment as social justice, College English, 79 Poe, 2012, Diversity and international writing assessment, Research in the Teaching of English, 48 Powers, D., Bridgeman, B., Schramm-Possinger, M., Validating a revised GRE general test: accumulating evidence (ETS-RR), Educational Testing Service Princeton, NJ; (in press). Pullen, 2008, Assessment through the lens of opportunity to learn, 17 Ramineni, C., Williamson, D.M., Understanding mean score differences between e-rater® and human scores for demographic groups in GRE®. GRE Program Report and ETS RR), Educational Testing Service Princeton, NJ ; (in press). Ramineni, 2011, Understanding mean score differences between e-rater and humans for demographic-based groups in the GRE Ramineni, 2012 Ramineni, 2012 Shermis, 2013, Contrasting state-of-the-art automated scoring of essays, 313 Toulmin, S. (1958). The uses of argument, Cambridge: Cambridge University Press. Williamson, 2012, A framework for evaluation and use of automated scoring, Educational Measurement: Issues and Practices, 31, 2, 10.1111/j.1745-3992.2011.00223.x Williamson, 2013, Probable cause: developing warrants for automated scoring of essays, 313