A Revised Index of Interrater Agreement for Multi-Item Ratings of a Single Target

Applied Psychological Measurement - Tập 23 Số 2 - Trang 127-135 - 1999
Michael K. Lindell1, Christina J. Brandt2, David J. Whitney3
1Texas A&M University;
2Michigan State University
3California State University, Long Beach

Tóm tắt

The commonly used form of r wg. (J) can display irregular behavior, so four variants of this index were examined. An alternative index, r* wg. J, is recommended. This index is an inverse linear function of the ratio of the average obtained variance to the variance of uniformly distributed random error. r* wg.Jis superficially similar to Cronbach’s α, but careful examination confirms that r* wg.Jis an index of agreement, not reliability. Based on an examination of the small-sample behavior of r wgand r* wg.J, sample sizes of 10 or more raters are recommended.

Từ khóa


Tài liệu tham khảo

Bailey, D. E., 1971, Probability and statistics: Models for research

10.1007/BF02310555

10.1177/001316447003000106

10.1037/0021-9010.69.1.85

10.1037/0021-9010.78.2.306

10.1037/0021-9010.77.2.161

10.1037/h0032935

10.1177/01466216970213006

Phillips, L. D., 1974, Bayesian statistics for social scientists

10.1037/0021-9010.74.2.368

10.1037/h0076640

Thông tin
Thông tin xuất bản

Applied Psychological Measurement

Tập 23 Số 2

127-135

Thông tin tác giả