Answers to 20 Questions About Interrater Reliability and Interrater Agreement

10.1006/obhd.2000.2897

10.1037/0033-2909.83.5.762

10.1177/109442819814001

Bliese, P.D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In K. J. Klein & S. W. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations (pp. 349-381). San Francisco: Jossey-Bass.

Borman, W.C. (1991). Job behavior, performance, and effectiveness. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., vol. 2, pp. 271-326). Palo Alto, CA: Consulting Psychologists Press.

10.1177/1094428105275376

10.1177/1094428102005002002

10.1177/109442819921004

Bryk, A.S., 1992, Hierarchical linear models: Application and data analysis methods

Cardy, R.L., 1994, Performance appraisal: Alternative perspectives

10.1037/0021-9010.83.2.234

10.1037/1082-989X.6.3.297

Cohen, J., 1988, Statistical power analysis for the behavioral sciences, 2

10.1037/0033-2909.90.2.218

Cronbach, L.J., 1972, The dependability of behavioral measurements

10.5465/amr.1986.4306242

10.1037/0021-9010.88.2.356

10.1037/0021-9010.66.2.127

10.1037/0021-9010.73.2.239

10.1177/014662169001400407

10.1177/0013164494054002010

10.1037/0033-2909.101.1.75

10.1037/0021-9010.75.2.107

10.1037/0021-9010.87.3.465

10.1037/13240-000

10.1016/0149-2063(94)90028-0

Hofmann, D.A. (2002). Issues in multilevel research: Theory development, measurement, and analysis. In S. G. Rogelberg (Ed.), Handbook of research methods in industrial and organizational psychology (pp. 247-274). New York: Blackwell .

Hofmann, D.A., Griffin, M.A. & Gavin, M.B. (2000). The application of hierarchical linear modeling to organizational research. In K. J. Klein & S. W. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations (pp. 467-511). San Francisco: Jossey-Bass.

10.1006/obhd.1993.1015

10.1037/0021-9010.67.2.219

10.1037/0021-9010.69.1.85

10.1037/0021-9010.78.2.306

10.1037/h0037511

10.1037/0021-9010.77.2.161

10.1111/j.1744-6570.1987.tb00614.x

Kozlowski, S.W.J. & Klein, K.J. (2000). A multilevel approach to theory and research in organizations: Contextual, temporal, and emergent processes. In K. J. Klein & S. W. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations (pp. 349-381). San Francisco: Jossey-Bass.

10.1177/1094428105284919

10.1177/1094428102239427

10.1177/1094428104272181

10.1177/01466216010251007

10.1177/01466216970213006

10.1037/0021-9010.84.4.640

10.1037/0021-9010.85.3.331

10.1177/01466219922031257

Lord, F.M., 1968, Statistical theories of mental test scores

10.1037/1082-989X.1.1.30

10.1037/0021-9010.74.4.619

Murphy, K.R., 1995, Understanding performance appraisal: Social, organizational, and goal based perspectives

10.1111/j.1744-6570.2000.tb02421.x

10.1111/j.1744-6570.2000.tb02423.x

Murphy, K.R., 1998, Statistical power analysis: A simple and general model for traditional and modern hypothesis tests

Newman, D.A., Organizational Research Methods

Nunnally, J.C., 1978, Psychometric theory, 2

Nunnally, J.C., 1994, Psychometric theory, 3

Roberson, Q.M., Organizational Research Methods

10.1037/0021-9010.74.2.368

10.1111/j.1744-6570.2000.tb02422.x

10.1037/0021-9010.87.2.220

Schriesheim, C.A., Paper presented the annual meeting of the Academy of Management

10.1037/0033-2909.86.2.420

Smith, G.M., 1970, A simplified guide to statistics for psychology and education, 4

10.1037/0021-9010.73.3.497

10.1111/j.1744-6570.1996.tb01803.x

10.1037/0021-9010.81.5.557

10.1037/0021-9010.90.1.108