Do raters use rating scale categories consistently across analytic rubric domains in writing assessment?

Assessing Writing - Tập 43 - Trang 100416 - 2020
Stefanie A. Wind1
1Educational Studies in Psychology, Research Methodology, and Counseling, The University of Alabama, 313C Carmichael Hall, United States

Tài liệu tham khảo

Andrich, 1978, A rating formulation for ordered response categories, Psychometrika, 43, 561, 10.1007/BF02293814 Crusan, 2015, Dance, ten; looks, three: Why rubrics matter, Assessing Writing, 26, 1, 10.1016/j.asw.2015.08.002 Engelhard, 2013 Engelhard, 2018 Jin, 2018, A new facets model for rater’s centrality/extremity response style, Journal of Educational Measurement, 55, 543, 10.1111/jedm.12191 Linacre, 1989 Linacre, 2000, Comparing “partial credit models” (PCM) and “rating scale models” (RSM), Rasch Measurement Transactions, 14, 768 Linacre, 2002, Optimizing rating scale category effectiveness, Journal of Applied Measurement, 3, 85 Linacre, 2015 Masters, 1982, A Rasch model for partial credit scoring, Psychometrika, 47, 149, 10.1007/BF02296272 Penfield, 2007, Assessing differential step functioning in polytomous items using a common odds ratio estimator, Journal of Educational Measurement, 44, 187, 10.1111/j.1745-3984.2007.00034.x Penfield, 2009, An NCME instructional module on using differential step functioning to refine the analysis of DIF in polytomous items, Educational Measurement Issues and Practice, 28, 38, 10.1111/j.1745-3992.2009.01135.x Penfield, 2008, Methods for assessing item, step, and threshold invariance in polytomous items following the Partial Credit model, Educational and Psychological Measurement, 68, 717, 10.1177/0013164407312602 Rasch, 1960 Trace, 2016, “I can see that”: Developing shared rubric category interpretations through score negotiation, Assessing Writing, 30, 32, 10.1016/j.asw.2016.08.001 Wesolowski, 2016, Examining rater precision in music performance assessment: An analysis of rating scale structure using the multifaceted Rasch partial credit model, Music Perception, 33, 662, 10.1525/mp.2016.33.5.662 Wesolowski, 2017, Evaluating differential rater functioning over time in the context of solo music performance assessment, Bulletin of the Council for Research in Music Education, 212, 75, 10.5406/bulcouresmusedu.212.0075 Wind, 2018, Principals’ use of rating scale categories in classroom observations for teacher evaluation, School Effectiveness and School Improvement, 29, 485, 10.1080/09243453.2018.1470989