RATER SOURCE EFFECTS ARE ALIVE AND WELL AFTER ALL

Personnel Psychology - Tập 63 Số 1 - Trang 119-151 - 2010
Brian J. Hoffman1, Charles E. Lance1, Bethany H. Bynum1, William A. Gentry2
1University of Georgia;
2Center for Creative Leadership

Tóm tắt

Từ khóa


Tài liệu tham khảo

Arthur, 2008, The importance of distinguishing between constructs and methods when comparing predictors in personnel selection research and practice, Journal of Applied Psychology, 93, 435, 10.1037/0021-9010.93.2.435

Austin, 1992, The criterion problem: 1917-1992, Journal of Applied Psychology, 77, 836, 10.1037/0021-9010.77.6.836

Bentler, 1990, Comparative fit indexes in structural models, Psychological Bulletin, 107, 238, 10.1037/0033-2909.107.2.238

Bentler, 1980, Significance tests and goodness of fit in the analysis of covariance structures, Psychological Bulletin, 88, 588, 10.1037/0033-2909.88.3.588

Bentler, 1983, Principals of modern psychological measurement: A Festschrift to Frederic M. Lord, 237

Borman, 1974, The rating of individuals in organizations: An alternative approach, Organizational Behavior and Human Performance, 12, 105, 10.1016/0030-5073(74)90040-3

Borman, 1997, 360 ratings: An analysis of assumptions and research agenda for evaluating their validity, Human Resource Management Review, 7, 299, 10.1016/S1053-4822(97)90010-3

Borman, 1993, More progress toward a taxonomy of managerial performance requirements, Human Performance, 6, 1, 10.1207/s15327043hup0601_1

Bowler, 2006, A meta-analytic evaluation of the impact of dimension and exercise factors on assessment center ratings, Journal of Applied Psychology, 91, 1114, 10.1037/0021-9010.91.5.1114

Browne, 1993, Testing structural models, 136

Campbell, 1959, Convergent and discriminant validation by the multitrait-multimethod matrix, Psychological Bulletin, 56, 81, 10.1037/h0046016

Campbell, 1990, Modeling job performance in a population of jobs, Personnel Psychology, 43, 313, 10.1111/j.1744-6570.1990.tb01561.x

Carty, 2003, The fifteenth mental measurements yearbook, 123

Cheung, 2002, Evaluating goodness-of-fit indexes for testing measurement invariance, Structural Equation Modeling, 9, 233, 10.1207/S15328007SEM0902_5

Church, 1997, Advancing the state of the art of 360-degree feedback, Group and Organization Management, 22, 149, 10.1177/1059601197222002

Conway, 1996, Analysis and design of multitrait-multirater performance appraisal studies, Journal of Management, 22, 139, 10.1177/014920639602200106

Conway, 1999, Distinguishing contextual performance from task performance for managerial jobs, Journal of Applied Psychology, 84, 3, 10.1037/0021-9010.84.1.3

Conway, 1997, Psychometric properties of multisource performance ratings: A meta-analysis of subordinate, supervisor, peer, and self-ratings, Human Performance, 10, 331, 10.1207/s15327043hup1004_2

Conway, 2004, Bias in the correlated uniqueness model for MTMM data, Structural Equation Modeling, 11, 535, 10.1207/s15328007sem1104_3

Cooper, 1981, Ubiquitous halo, Psychological Bulletin, 90, 218, 10.1037/0033-2909.90.2.218

Coovert, 1997, Effectiveness of the direct product versus confirmatory factor model for reflecting the structure of multimethod-multirater job performance data, Journal of Applied Psychology, 82, 271, 10.1037/0021-9010.82.2.271

Dansereau, 1975, A vertical dyad linkage approach to leadership within formal organizations: A longitudinal investigation of the role making process, Organizational Behavior and Human Performance, 13, 46, 10.1016/0030-5073(75)90005-7

DeVries, 1986, Performance appraisal on the line

Feldman, 1981, Beyond attribution theory: Cognitive processes in performance appraisal, Journal of Applied Psychology, 66, 127, 10.1037/0021-9010.66.2.127

Fleenor, 1996, Self-other rating agreement and leader effectiveness, Leadership Quarterly, 7, 487, 10.1016/S1048-9843(96)90003-X

Guilford, 1954, Psychometric methods

Harris, 1988, A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings, Personnel Psychology, 41, 43, 10.1111/j.1744-6570.1988.tb00631.x

Hoffman, 2007, Expanding the criterion domain? A meta-analysis of the OCB literature, Journal of Applied Psychology, 92, 555, 10.1037/0021-9010.92.2.555

Hoffman, 2009, Disentangling the meaning of multisource feedback source and dimension factors, Personnel Psychology, 62, 735, 10.1111/j.1744-6570.2009.01156.x

Holzbach, 1978, Rater bias in performance ratings: Superior, self, and peer ratings, Journal of Applied Psychology, 63, 579, 10.1037/0021-9010.63.5.579

Hu, 1998, Fit indices in covariance structure modeling: Sensitivity to underparameterization model misspecification, Psychological Methods, 3, 424, 10.1037/1082-989X.3.4.424

Hu, 1999, Cutoff criteria for fit indexes in covariance structure analysis, Structural Equation Modeling, 6, 1, 10.1080/10705519909540118

Jöreskog, 2004, LISREL 8.70

Kenny, 1980, Statistical approaches to the correction of correlational bias, Psychological Bulletin, 88, 288, 10.1037/0033-2909.88.2.288

King, 1980, Halo in a multidimensional forced-choice performance evaluation scale, Journal of Applied Psychology, 65, 507, 10.1037/0021-9010.65.5.507

Kingstrom, 1981, A critical analysis of studies comparing behaviorally anchored rating scale (BARS) and other rating formats, Personnel Psychology, 34, 263, 10.1111/j.1744-6570.1981.tb00942.x

Klimoski, 1974, Role of the rater in performance appraisal, Journal of Applied Psychology, 59, 445, 10.1037/h0037332

Lakey, 2007, Examining DSM-IV criteria for pathological gambling: Psychometric properties and evidence from cognitive biases, Journal of Gambling Studies, 23, 479, 10.1007/s10899-007-9063-7

Lance, 2006, Performance measurement: Current perspectives and future challenges, 49

Lance, 2008, Rater source factors represent important subcomponents of the criterion construct space, not rater bias, Human Resource Management Review, 18, 223-232, 10.1016/j.hrmr.2008.03.002

Lance, 2002, A critique of the correlated trait-correlated method (CTCM) and correlated uniqueness (CU) models for multitrait-multimethod (MTMM) data, Psychological Methods, 7, 228, 10.1037/1082-989X.7.2.228

Lance, 1992, Specification of the criterion construct space: An application of hierarchical confirmatory factor analysis, Journal of Applied Psychology, 77, 437, 10.1037/0021-9010.77.4.437

Lance, 1986, Statistical control of halo: Clarification from two cognitive models of the performance appraisal process, Journal of Applied Psychology, 71, 679, 10.1037/0021-9010.71.4.679

Lance, 1991, Cognitive categorization processes in performance evaluation: Confirmatory tests of two models, Journal of Organizational Behavior, 12, 1, 10.1002/job.4030120102

Lance, 2007, Case study: A Monte Carlo investigation of assessment center construct validity models, Organizational Research Methods, 10, 430, 10.1177/1094428106289395

Landy, 1980, Performance rating, Psychological Bulletin, 87, 72, 10.1037/0033-2909.87.1.72

Lawler, 1967, The multitrait-multirater approach to measuring managerial job performance, Journal of Applied Psychology, 51, 369, 10.1037/h0025095

LeBreton, 2003, The restriction of variance hypothesis and interrater reliability and agreement: Are ratings from multiple sources really dissimilar?, Organizational Research Methods, 6, 80, 10.1177/1094428102239427

Li, 1996, Reliability of measurement in psychology: From Spearman-Brown to maximal reliability, Psychological Methods, 1, 98, 10.1037/1082-989X.1.1.98

Lombardo, 1994, BENCHMARKS®: A manual and trainer's guide

Lombardo, 1999, BENCHMARKS® developmental reference points

Mabe, 1982, Validity of self-evaluation of ability: A review and meta-analysis, Journal of Applied Psychology, 67, 280, 10.1037/0021-9010.67.3.280

Mann, 1965, Leadership and productivity, 68

McCauley, 1990, Measures of leadership, 535

McCauley, 1989, Diagnosing management development needs: An instrument based on how managers develop, Journal of Management, 15, 389, 10.1177/014920638901500303

Mintzberg, 1975, The manager's job: Folklore and fact, Harvard Business Review, 53, 49

Mount, 1998, Trait, rater, and level effects in 360-degree performance ratings, Personnel Psychology, 51, 557, 10.1111/j.1744-6570.1998.tb00251.x

Murphy, 2008, Three models of the performance appraisal process, Industrial and Organizational Psychology Perspectives on Research and Practice

Murphy, 2000, Interrater correlations do not estimate the reliability of job performance ratings, Personnel Psychology, 53, 873, 10.1111/j.1744-6570.2000.tb02421.x

Newcomb, 1931, An experiment designed to test the validity of a rating technique, Journal of Educational Psychology, 22, 279, 10.1037/h0070737

Saal, 1980, Rating the ratings: Assessing the psychometric quality of rating data, Psychological Bulletin, 88, 413, 10.1037/0033-2909.88.2.413

Schmidt, 2000, Reliability is not validity and validity is not reliability, Personnel Psychology, 53, 901, 10.1111/j.1744-6570.2000.tb02422.x

Scullen, 2000, Understanding the latent structure of job performance ratings, Journal of Applied Psychology, 85, 956, 10.1037/0021-9010.85.6.956

Sevy, 1985, Managerial skills profile technical manual

Smith, 1983, Organizational citizenship behavior: Its nature and antecedents, Journal of Applied Psychology, 68, 653, 10.1037/0021-9010.68.4.653

Spangler, 2003, The fifteenth mental measurements yearbook, 124

Sparrowe, 1997, Process and structure in leader-member exchange, Academy of Management Review, 22, 522, 10.5465/amr.1997.9707154068

Steiger, 1990, Structural model evaluation and modification: An interval estimation approach, Multivariate Behavioral Research, 25, 173, 10.1207/s15327906mbr2502_4

Thorndike, 1920, A constant error in psychological ratings, Journal of Applied Psychology, 4, 25, 10.1037/h0071663

Thornton, 1980, The relationship between supervisory and self appraisals of executive performance, Personnel Psychology, 21, 441, 10.1111/j.1744-6570.1968.tb02044.x

Timmreck, 1997, Multisource feedback: A study of its use in decision-making, Employment Relations Today, 24, 21, 10.1002/ert.3910240104

Tucker, 1973, A reliability coefficient for maximum likelihood factor analysis, Psychometrika, 38, 1, 10.1007/BF02291170

Vance, 1988, Construct validity of multiple job performance measures using confirmatory factor analysis, Journal of Applied Psychology, 73, 74, 10.1037/0021-9010.73.1.74

Viswesvaran, 1996, Comparative analysis of the reliability of job performance ratings, Journal of Applied Psychology, 81, 557, 10.1037/0021-9010.81.5.557

Viswesvaran, 2002, The moderating influence of job performance dimension on convergence of supervisory and peer ratings of job performance: Unconfounding construct-level convergence and rating difficulty, Journal of Applied Psychology, 87, 245, 10.1037/0021-9010.87.2.345

Viswesvaran, 2005, Is there a general factor in ratings of job performance? A meta-analytic framework for disentangling substantive and error influences, Journal of Applied Psychology, 90, 108, 10.1037/0021-9010.90.1.108

Wells, 1907, A statistical study of literary merit. (Columbia Univ. Cont. to Phil. & Psych., 16, 3.), Archives of Psychology, 7, 5

Wherry, 1952, The control of bias in ratings: VIII. A theory of rating

Wherry, 1982, The control of bias in ratings: A theory of rating, Personnel Psychology, 35, 521, 10.1111/j.1744-6570.1982.tb02208.x

Wildaman, 1985, Hierarchically nested covariance structure models for multitrait-multimethod data, Applied Psychological Measurement, 9, 1, 10.1177/014662168500900101

Woehr, 1994, Rater training for performance appraisal: A quantitative review, Journal of Occupational and Organizational Psychology, 67, 189, 10.1111/j.2044-8325.1994.tb00562.x

Woehr, 2005, Assessing measurement equivalence across ratings sources: A multitrait-multirater approach, Journal of Applied Psychology, 90, 592, 10.1037/0021-9010.90.3.592

Yukl, 2006, Leadership in organizations

Zedeck, 1995, The twelfth mental measurements yearbook, 1, 128

Zedeck, 1972, Nursing performance as measured by behavioral expectation sales: A multitrait-multirater analysis, Organizational Behavior and Human Performance, 7, 457, 10.1016/0030-5073(72)90029-3