A program to evaluate general and conditional agreement among categorical assignments of many raters

Paul A. McDermott1, Marley W. Watkins2
1Graduate School of Education, University of Pennsylvania, Philadelphia
2Department of Educational Psychology and Measurements, University of Nebraska, Lincoln

Tóm tắt

Từ khóa


Tài liệu tham khảo

Antonak, R. F. A computer program to compute measures of response agreement for nominal scale data obtained from two judges.Behavior Research Methods & Instrumentation, 1977,9, 553.

Berk, R. A., &Campbell, K. A. A FORTRAN program for Cohen’s kappa coefficient of observer agreement.Behavior Research Methods & Instrumentation, 1976,8, 396.

Cicchetti, D. V., Lee, C., Fontana, A. F., &Dowds, B. N.A computer program for assessing specific category rater agreement for qualitative data. West Haven, Conn: Veterans Administration Hospital, 1978.

Cohen, J. A. A coefficient of agreement for nominal scales.Educational and Psychological Measurement, 1960,20, 37–46.

Fleiss, J. L. Measuring nominal scale agreement among many raters.Psychological Bulletin, 1971,76, 378–382.

Light, R. J. Measures of response agreement for qualitative data: Some generalizations and alternatives.Psychological Bulletin, 1971,76, 365–377.