Modeling Basic Writing Processes From Keystroke Logs

Journal of Educational Measurement - Tập 55 Số 2 - Trang 194-216 - 2018
Hongwen Guo1, Paul Deane1, Peter W. van Rijn1, Mo Zhang1, Randy Elliot Bennett1
1Educational Testing Service

Tóm tắt

AbstractThe goal of this study is to model pauses extracted from writing keystroke logs as a way of characterizing the processes students use in essay composition. Low‐level timing data were modeled, the interkey interval and its subtype, the intraword duration, thought to reflect processes associated with keyboarding skills and composition fluency. Heavy‐tailed probability distributions (lognormal and stable distributions) were fit to individual students' data. Both density functions fit reasonably well, and estimated parameters were found to be robust across prompts designed to assess student proficiency for the same writing purpose. In addition, estimated parameters for both density functions were statistically significantly associated with human essay scores after accounting for total time spent writing the essay, a result consistent with cognitive theory on the role of low‐level processes in writing.

Từ khóa


Tài liệu tham khảo

10.1002/j.2333-8504.2012.tb02305.x

Alves R. A., 2007, Writing and cognition: Research and applications, 55, 10.1163/9781849508223_005

10.1177/0741088312451108

10.1080/00461520.2016.1141683

Bennett R. E., 2017, Technology enhanced innovative assessment: Development, modeling, and scoring from an interdisciplinary perspective, 197

10.1207/s1532690xci1202_2

10.3389/fpsyg.2014.00182

10.17239/jowr-2014.06.01.3

10.1080/713665670

Cooke R., 2011, Heavy‐tailed distributions: Data, diagnostics, and new developments

10.1002/ets2.12002

10.1016/j.pse.2014.10.001

10.1002/ets2.12071

10.18637/jss.v064.i04

Fayol M., 2012, Writing: A mosaic of new perspectives, 141

10.1214/aos/1176343247

10.1016/j.jmp.2013.07.001

10.2307/1423513

Kharrat T. &Boshnakov G.(2015).StableEstim: Estimate the 4 parameters of stable law using different methods. R package version 2.0. Retrieved fromhttp://CRAN.R‐project.org/package=StableEstim

10.1177/0741088313491692

10.1037/0278-7393.18.5.883

10.1002/cplx.21666

10.1080/03610918608812563

10.1016/S0169-7161(96)14015-3

10.1207/S15326985EP3501_3

10.1007/s11145-017-9723-7

Martin F., 2009, Proceedings of the 31st Annual Conference of the Cognitive Science Society, 1270

Nolan J.(2016).Stable distributions: Models for heavy tailed data. Retrieved fromhttp://fs2.american.edu/jpnolan/www/stable/chap1.pdf

Prokhorov A. V., 2001, Encyclopedia of mathematics

R Core Team, 2014, R: A language and environment for statistical computing

10.1006/jmps.1993.1032

10.3102/10769986031002181

Rijn P., 2016, Statistical results from the 2013 CBAL English language arts multistate study: Parallel forms for policy recommendation writing

Rijn P., 2016, Statistical results from the 2013 CBAL English language arts multistate study: Parallel forms for argumentative writing

Xu X., 2014, An exploratory study of pauses in computer‐assisted EFL writing, Language Learning and Technology, 18, 80

10.1007/978-3-319-38759-8_23