A review, analysis, and extension of peer-leader feedback agreement: Contrasting group aggregate agreement vs. self-other agreement using entity analytics and visualization

Abdulla, 2008, A critical analysis of mini peer assessment tool (mini-PAT), Journal of the Royal Society of Medicine, 101, 22, 10.1258/jrsm.2007.070077 Alicke, 2010, Mere categorization and the frog-pond effect, Psychological Science, 21, 174, 10.1177/0956797609357718 Antonioni, 2001, The relationship between rater affect and three sources of 360-degree feedback ratings, Journal of Management, 27, 479, 10.1177/014920630102700405 Armstrong, 2004, The effects of cognitive style on research supervision: A study of student-supervisor dyads in management education, Academy of Management Learning & Education, 3, 41, 10.5465/AMLE.2004.12436818 Atwater, 2006, 360-degree feedback to leaders - Does it relate to changes in employee attitudes?, Group & Organization Management, 31, 578, 10.1177/1059601106286887 Atwater, 1998, 360 degree feedback and leadership development, The Leadership Quarterly, 9, 423, 10.1016/S1048-9843(98)90009-1 Atwater, 1997, Self-other rating agreement: A review and model, Research in Personnel and Human Resources Management, 15, 121 Atwater, 1998, Self-other agreement: Does it really matter?, Personnel Psychology, 51, 577, 10.1111/j.1744-6570.1998.tb00252.x Bachman, 1986, Self-concepts, self-esteem, and educational-experiences: The frog pond revisited (again), Journal of Personality and Social Psychology, 50, 35, 10.1037/0022-3514.50.1.35 Baker, 2014 Bamberger, 2005, Peer assessment, individual performance, and contribution to group processes - the impact of rater anonymity, Group & Organization Management, 30, 344, 10.1177/1059601104267619 Bartram, 2004, Assessment in organisations, Applied Psychology - An International Review-Psychologie Appliquee-Revue Internationale, 53, 237, 10.1111/j.1464-0597.2004.00170.x Bergman, 2014, Leader personality and 360-degree assessments of leader behavior, Scandinavian Journal of Psychology, 55, 389, 10.1111/sjop.12130 Berson, 2007, The relationship between self-other rating agreement and influence tactics and organizational processes, Group & Organization Management, 32, 675, 10.1177/1059601106288068 Bettenhausen, 1997, Peer and upward appraisals - A comparison of their benefits and problems, Group & Organization Management, 22, 236, 10.1177/1059601197222006 Beus, 2012, Perceptual equivalence of psychological climates within groups: When agreement indices do not agree, Journal of Occupational and Organizational Psychology, 85, 454, 10.1111/j.2044-8325.2011.02049.x Boerboom, 2011, Peer group reflection helps clinical teachers to critically reflect on their teaching, Medical Teacher, 33, E615, 10.3109/0142159X.2011.610840 Braddy, 2014, Leader behaviors and career derailment potential: A multi-analytic method examination of rating source and self-other agreement, The Leadership Quarterly, 25, 373, 10.1016/j.leaqua.2013.10.001 Brown, 2005, Interrater agreement reconsidered: An alternative to the r(wg) indices, Organizational Research Methods, 8, 165, 10.1177/1094428105275376 Brutus, 1999, Exploring the link between rating congruence and managerial effectiveness, Canadian Journal of Administrative Sciences-Revue Canadienne Des Sciences De L Administration, 16, 308, 10.1111/j.1936-4490.1999.tb00691.x Byrd, 2015, Examination of the quality and effectiveness of peer feedback and self-reflection exercises among medical students, Federation of American Societies for Experimental Biology Journal, 29, 1, 10.1096/fasebj.29.1_supplement.690.12 Calhoun, 2010, Multi-rater feedback with gap analysis: An innovative means to assess communication skill and self-insight, Patient Education and Counseling, 80, 321, 10.1016/j.pec.2010.06.027 Carson, 2012, The relationship between dysfunctional interpersonal tendencies, derailment potential behavior, and turnover, Journal of Business and Psychology, 27, 291, 10.1007/s10869-011-9239-0 Castro, 2002, Data analytic methods for the analysis of multilevel questions - A comparison of intraclass correlation coefficients, r(wg(j)), hierarchical linear modeling, within- and between-analysis, and random group resampling, The Leadership Quarterly, 13, 69, 10.1016/S1048-9843(01)00105-9 Church, 1997, Advancing the state of the art of 360-degree feedback - guest editors' comments on the research and practice of multirater assessment methods, Group & Organization Management, 22, 149, 10.1177/1059601197222002 Cogliser, 2009, Balance in leader and follower perceptions of leader-member exchange: Relationships with performance and work attitudes, The Leadership Quarterly, 20, 452, 10.1016/j.leaqua.2009.03.010 Conger, 2004, When CEOs step up to fail, MIT Sloan Management Review, 45 Conway, 2001, A meta-analysis of incremental validity and nomological networks for subordinate and peer ratings, Human Performance, 14, 267, 10.1207/S15327043HUP1404_1 Cullen, 2015, Biased self-perception tendencies: Self-enhancement/self-diminishment and leader derailment in individualistic and collectivistic cultures, Applied Psychology-an International Review-Psychologie Appliquee-Revue Internationale, 64, 161, 10.1111/apps.12026 Cushing, 2011, Peer feedback as an aid to learning - What do we want? Feedback. When do we want it? Now!, Medical Teacher, 33, e105, 10.3109/0142159X.2011.542522 Dalessio, 2001, Multisource feedback reports: Content, formats, and levels of analysis, 181 Dansereau, 1995, A dyadic approach to leadership: Creating and nurturing this approach under fire, The Leadership Quarterly, 6, 479, 10.1016/1048-9843(95)90022-5 Dansereau, 2000 Dansereau, 1984 Dansereau, 1995, Individualized leadership: A new multiple-level approach, The Leadership Quarterly, 6, 413, 10.1016/1048-9843(95)90016-0 Dansereau, 2006, Avoiding the “fallacy of the wrong level” - A within and between analysis (WABA) approach, Group & Organization Management, 31, 536, 10.1177/1059601106291131 Day, 2015, Leadership development: An outcome-oriented review based on time and levels of analyses, Vol. 2, 133 Day, 2014, Advances in leader and leadership development: A review of 25years of research and theory, The Leadership Quarterly, 25, 63, 10.1016/j.leaqua.2013.11.004 DeStephano, 2014, Providing 360-degree multisource feedback to nurse educators in the country of Georgia: A formative evaluation of acceptability, Journal of Continuing Education in Nursing, 45, 278, 10.3928/00220124-20140528-03 Devos, 2013, Self-other agreement as an alternative perspective of school leadership analysis: An exploratory study, School Effectiveness and School Improvement, 24, 296, 10.1080/09243453.2012.693103 Diab, 2016, A comparison of peer, teacher and self-feedback on the reduction of language errors in student essays, System, 57, 55, 10.1016/j.system.2015.12.014 Dominick, 1997, The effects of peer feedback on team member behavior, Group & Organization Management, 22, 508, 10.1177/1059601197224006 Donnon, 2014, The reliability, validity, and feasibility of multisource feedback physician assessment: A systematic review, Academic Medicine, 89, 511, 10.1097/ACM.0000000000000147 Dotlich, 2003 Edwards, 1994, Regression-analysis as an alternative to difference scores, Journal of Management, 20, 683, 10.1177/014920639402000311 Edwards, 1995, Alternatives to difference scores as dependent variables in the study of congruence in organizational research, Organizational Behavior and Human Decision Processes, 64, 307, 10.1006/obhd.1995.1108 Edwards, 2001, Ten difference score myths, Organizational Research Methods, 4, 265, 10.1177/109442810143005 Edwards, 1993, On the use of polynomial regression equations as an alternative to difference scores in organizational research, Academy of Management Journal, 36, 1577, 10.2307/256822 Espenshade, 2005, The frog pond revisited: High school academic context, class rank, and elite college admission, Sociology of Education, 78, 269, 10.1177/003804070507800401 Facteau, 2001, Are performance appraisal ratings from different rating sources comparable?, Journal of Applied Psychology, 86, 215, 10.1037/0021-9010.86.2.215 Facteau, 1998, Reactions of leaders to 360-degree feedback from subordinates and peers, The Leadership Quarterly, 9, 427, 10.1016/S1048-9843(98)90010-8 Fedor, 1999, Peer reviews - Employees' dual roles as raters and recipients, Group & Organization Management, 24, 92, 10.1177/1059601199241006 Ferris, 2009, Relationships at work: Toward a multidimensional conceptualization of dyadic work relationships, Journal of Management, 35, 1379, 10.1177/0149206309344741 Feudo, 1998, Bridgeport's Teen Outreach and Primary Services (TOPS) project - A model for raising community awareness about adolescent HIV risk, Journal of Adolescent Health, 23, 49, 10.1016/S1054-139X(98)00051-2 Firebaugh, 1980, Groups as contexts and frog ponds, 43 Firmin, 2015, Self-initiated helping behaviors and recovery in severe mental illness: Implications for work, volunteerism, and peer support, Psychiatric Rehabilitation Journal, 38, 336, 10.1037/prj0000145 Fleenor, 1996, Self-other rating agreement and leader effectiveness, The Leadership Quarterly, 2, 487, 10.1016/S1048-9843(96)90003-X Furnham, 2010 Furnham, 1998, Congruence in job-performance ratings: A study of 360 degree feedback examining self, manager, peers, and consultant ratings, Human Relations, 51, 517, 10.1177/001872679805100404 Gielen, 2010, Improving the effectiveness of peer feedback for learning, Learning and Instruction, 20, 304, 10.1016/j.learninstruc.2009.08.007 Gooty, 2011, Dyads in organizational research: Conceptual issues and multilevel analyses, Organizational Research Methods, 14, 456, 10.1177/1094428109358271 Gooty, 2016, The leader-member exchange relationship: A multisource, cross-level investigation, Journal of Management, 42, 915, 10.1177/0149206313503009 Gooty, 2012, Use and misuse of levels of analysis in leadership research: An illustrative review of leader-member exchange, The Leadership Quarterly, 23, 1080, 10.1016/j.leaqua.2012.10.002 Heidemeier, 2009, Self-other agreement in job performance ratings: A meta-analytic test of a process model, Journal of Applied Psychology, 94, 353, 10.1037/0021-9010.94.2.353 Herbst, 2014 Howe, 2003, From science teacher to teacher leader: Leadership development as meaning making in a community of practice, Science Education, 87, 281, 10.1002/sce.10022 Jiang, 2014, Why me? The frog-pond effect, relative deprivation and individual outcomes in the face of budget cuts, Work and Stress, 28, 387, 10.1080/02678373.2014.965241 Kalafat, 1992, Adolescents experience with and response to suicidal peers, Suicide and Life-threatening Behavior, 22, 315 Kellerman, 2012 Kenny, 2006 Lee, 2016, Can student self-ratings be compared with peer ratings? A study of measurement invariance of multisource feedback, Advances in Health Sciences Education, 21, 401, 10.1007/s10459-015-9638-5 Leslie, 2013 Lockyer, 2003, Likelihood of change: A study assessing surgeon use of multisource feedback data, Teaching and Learning in Medicine, 15, 168, 10.1207/S15328015TLM1503_04 Markham, 1988, Pay-for-performance dilemma revisited: Empirical example of the importance of group effects, Journal of Applied Psychology, 73, 172, 10.1037/0021-9010.73.2.172 Markham, 1998, The scientific visualization of organizations: A rationale for a new approach to organizational modeling, Decision Sciences, 29, 1, 10.1111/j.1540-5915.1998.tb01342.x Markham, 2002, Multi-level simulation analysis issues: Four themes, Vol. 1, 387, 10.1016/S1475-9144(02)01044-5 Markham, 2010, Leadership, levels of analysis, and deja vu: Modest proposals for taxonomy and cladistics coupled with replication and visualization, The Leadership Quarterly, 21, 1121, 10.1016/j.leaqua.2010.10.011 Markham, 2002, Within- and between-entity analyses in multilevel research: A leadership example using single level analyses and boundary conditions (MRA), The Leadership Quarterly, 13, 35, 10.1016/S1048-9843(01)00103-5 Markham, 1991, Declining organizational size and increasing unemployment rates; Predicting employee absenteeism from within-plant and between-plant perspectives, Academy of Management Journal, 34, 952, 10.2307/256399 Markham, 2014, A new approach to analyzing the Achilles' heel of multisource feedback programs: Can we really trust ratings of leaders at the group level of analysis?, The Leadership Quarterly, 25, 1120, 10.1016/j.leaqua.2014.10.003 Markham, 2014, A visual illustration of induction in multilevel methods: The problem of leaders awarding countervailing merit components, Journal of Business and Psychology, 29, 503, 10.1007/s10869-014-9352-y Markham, 2015, At the crux of dyadic leadership: Self–other agreement of leaders and direct reports — Analyzing 360-degree feedback, The Leadership Quarterly, 26, 958, 10.1016/j.leaqua.2015.10.001 Mayo, 2012, Aligning or inflating your leadership self-image? A longitudinal study of responses to peer feedback in MBA teams, Academy of Management Learning & Education, 11, 631, 10.5465/amle.2010.0069 McIntosh, 2006, Why do children experiment with illegal drugs? The declining role of peer pressure with increasing age, Addiction Research and Theory, 14, 275, 10.1080/16066350500330465 Naslund, 2016, The future of mental health care: Peer-to-peer support and social media, Epidemiology and Psychiatric Sciences, 25, 113, 10.1017/S2045796015001067 Nowack, 1997, Congruence between self-other ratings and assessment center performance, Journal of Social Behavior and Personality, 12, 145 Pedersen, 2013, Perceived norms moderate the association between mental health symptoms and drinking outcomes among at-risk adolescents, Journal of Studies on Alcohol and Drugs, 74, 736, 10.15288/jsad.2013.74.736 Perreault, 2016, Resident perspectives on a Montreal peer-run housing project for opioid users, Journal of Substance Use, 21, 355, 10.3109/14659891.2015.1029022 Pfeffer, 2015 Pierro, 2012, Frogs and ponds: A multilevel analysis of the regulatory mode complementarity hypothesis, Personality and Social Psychology Bulletin, 38, 269, 10.1177/0146167211424418 Platt, 1964, Strong inference, Science, 146, 347, 10.1126/science.146.3642.347 Podschun, 1993, Teen peer outreach-street work project - HIV prevention education for runaway and homeless youth, Public Health Reports, 108, 150 Roberts, 2013, Self-other agreement in multisource feedback: The influence of doctor and rater group characteristics, Journal of Continuing Education in the Health Professions, 33, 14, 10.1002/chp.21162 Saedon, 2012, The role of feedback in improving the effectiveness of workplace based assessments: A systematic review, BMC Medical Education, 12, 8, 10.1186/1472-6920-12-25 Schriesheim, 2011, A two-study investigation of item wording effects on leader-follower convergence in descriptions of the leader-member exchange (LMX) relationship, The Leadership Quarterly, 22, 881, 10.1016/j.leaqua.2011.07.009 Stoddard, 2008, The costs of CEO failure, Chief Executive, 66 Swanson, 2010, Surgical leadership development: Identification of discrepancies in self-awareness using a customized 360-degree feedback assessment, Journal of the American College of Surgeons, 211, S113, 10.1016/j.jamcollsurg.2010.06.299 Tang, 2013, Assessing leadership derailment factors in 360 degree feedback: Differences across position levels and self-other agreement, Leadership and Organization Development Journal, 34, 326, 10.1108/LODJ-07-2011-0070 Taylor, 2011, Open-mindedness and defensiveness in multisource feedback processes: A conceptual framework, The Journal of Applied Behavioral Science, 47, 432, 10.1177/0021886311408724 Thuraisingham, 2010 Toegel, 2003, 360-degree assessment: Time for reinvention, Academy of Management Learning & Education, 2, 297, 10.5465/AMLE.2003.10932156 van Schaik, 2016, Does source matter? Nurses' and physicians' perceptions of interprofessional feedback, Medical Education, 50, 181, 10.1111/medu.12850 Van Velsor, 1993, An examination of the relationships among self-perception accuracy, self-awareness, gender, and leader effectiveness, Human Resource Management, 32, 249, 10.1002/hrm.3930320205 Van Velsor, 2010 Williams, 2013, Leader derailment: The impact of self-defeating behaviors, Leadership and Organization Development Journal, 34, 85, 10.1108/01437731311289983 Wright, 2016, Interpreting multisource feedback: Online study of consensus and variation among GP appraisers, British Journal of General Practice, 66, E277, 10.3399/bjgp16X684373 Yammarino, 2003, Modern data analytic techniques for multisource feedback, Organizational Research Methods, 6, 6, 10.1177/1094428102239423 Yammarino, 1993, Understanding self-perception accuracy: Implications for human-resource management, Human Resource Management, 32, 231, 10.1002/hrm.3930320204 Yammarino, 1992, On the application of within and between analysis: Are absence and affect really group-based phenomena, Journal of Applied Psychology, 77, 168, 10.1037/0021-9010.77.2.168 Yammarino, 2005, Leadership and levels of analysis: A state-of-the-science review, The Leadership Quarterly, 16, 879, 10.1016/j.leaqua.2005.09.002 Zell, 2009, Contextual neglect, self-evaluation, and the frog-pond effect, Journal of Personality and Social Psychology, 97, 467, 10.1037/a0015453 Zenger, 1992, Why do employers only reward extreme performance? Examining the relationships among performance, pay, and turnover, Administrative Science Quarterly, 37, 198, 10.2307/2393221 Zenger, 2009, Ten fatal flaws that derail leaders, Harvard Business Review, 87 Zhou, 2009, Supervisor-subordinate convergence in descriptions of leader-member exchange (LMX) quality: Review and testable propositions, The Leadership Quarterly, 20, 920, 10.1016/j.leaqua.2009.09.007 Zhou, 2010, Quantitative and qualitative examination of propositions concerning supervisor-subordinate convergence in descriptions of leader-member exchange (LMX) quality, The Leadership Quarterly, 21, 826, 10.1016/j.leaqua.2010.07.010