Moving Beyond Student Ratings: A Balanced Scorecard Approach for Evaluating Teaching Performance
Tóm tắt
This position paper proposes a viable alternative to higher education's current focus on student ratings as the primary metric for summative teaching evaluations (i.e., for personnel decisions). In contrast to the divergent opinions among educational researchers about the validity of student ratings, a strong consensus exists that summative measures derived from the student ratings process represent a necessary rather than a sufficient source for evaluating teaching performance (Cashin 1990; Berk 2005). Accordingly, to more completely describe annual teaching performance, we propose a multisource, multiple-perspective Teaching Balanced Scorecard (TBSC), fashioned from the “classic” Balanced Scorecard developed by Kaplan and Norton (1992a). The TBSC can guide academic administrators to expand their conceptual view of teaching performance beyond the boundaries of the classroom, while coherently communicating the department's teaching expectations to the faculty; consistent with this proposition, we provide supporting evidence from a successful TBSC implementation in an academic department.
Từ khóa
Tài liệu tham khảo
Aigner, 1986, On student evaluations of teaching ability, Journal of Economic Education, 17, 243, 10.1080/00220485.1986.10845172
Albrecht, 2009, An empirical assessment of commercial web-based professor evaluation services, Journal of Accounting Education, 27, 125, 10.1016/j.jaccedu.2010.06.002
Aleamoni, 1987, Student rating myths versus research facts, Journal of Personnel Evaluation in Educations, 1, 111, 10.1007/BF00143282
Aleamoni, 1999, Student rating myths versus research facts from 1924 to 1998, Journal of Personnel Evaluation in Education, 13, 152, 10.1023/A:1008168421283
American Educational Research Association (AERA), American Psychological Association (APA), and National Council on Measurement in Education (NCME) . 1999 . Standards for Educational and Psychological Testing . Washington, DC : AERA .
Banker, 2004, The balanced scorecard: Judgmental effects of performance measures linked to strategy, The Accounting Review, 79, 1, 10.2308/accr.2004.79.1.1
Banker, 2000, An empirical investigation of an incentive plan that includes nonfinancial performance measures, The Accounting Review, 75, 65, 10.2308/accr.2000.75.1.65
Berk, 2005, Survey of 12 strategies to measure teaching effectiveness, International Journal of Teaching and Learning in Higher Education, 17, 48
Blocher, E., D. Stout, G. Cokins, and K. Chen. 2008 . Cost Management: A Strategic Emphasis. 4th edition . New York, NY : McGraw-Hill Irwin .
Bok, D. 2003 . Universities in the Marketplace: The Commercialization of Higher Education . Princeton, NJ : Princeton University Press .
Braskamp, L. A., and J. C. Ory. 1994 . Assessing Faculty Work . San Francisco, CA : Jossey-Bass .
Cashin, W. E. 1989 . Defining and Evaluating College Teaching. IDEA Paper No. 21 . Manhattan, KS : Kansas State University .
Cashin, W. E. 1990 . Student Ratings of Teaching: Recommendations for Use. IDEA Paper No. 22 . Manhattan, KS : Kansas State University .
Cashin, W. E. 1995 . Student Ratings of Teaching: The Research Revisited. IDEA Paper No. 32 . Manhattan, KS : Kansas State University .
Cashin, W. E. 1999 . Student Ratings of Teaching: Uses and Misuses. In Changing Practices in Evaluating Teaching: A Practical Guide to Improve Faculty Performance and Promotion/Tenure Decisions, edited by Seldin and Associates, 25–44 . Bolton, MA : Anker Publishing Company .
Centra, J. A. 1993 . Reflective Faculty Evaluation: Enhancing Teaching and Determining Faculty Effectiveness . San Francisco, CA : Jossey-Bass .
Chang, 1999, The balanced scorecard: A potential tool for supporting change and continuous improvement in accounting education, Issues in Accounting Education, 14, 395, 10.2308/iace.1999.14.3.395
Cochran, L. 1992 . Publish or Perish . Cape Girardeau, MO : Stepup, Inc .
Cohen, 1981, Student ratings of instruction and student achievement: A meta-analysis of multisection validity studies, Review of Educational Research, 51, 281, 10.3102/00346543051003281
Crumbley, 2002, Accounting administrators' perceptions of student evaluation of teaching (SET) information, Quality Assurance in Education, 10, 213, 10.1108/09684880210446884
Davies, 2007, Systematic influences on teaching evaluations: The case for caution, Australian Economic Papers, 46, 18, 10.1111/j.1467-8454.2007.00303.x
Devanas, M. A. 2006 . Teaching portfolios. In Evaluating Faculty Performance: A Practical Guide to Assessing Teaching, Research, and Service, edited by Seldin and Associates, 111–130 . Bolton, MA : Anker Publishing Company .
Ditts, 1983, A statistical interpretation of student evaluation feedback, Journal of Economic Education (Spring), 10
Easton, R., Halsey, M. McAnally, A. Hartgraves , and W. Morse. 2008 . Financial and Managerial Accounting for MBAs. 2nd edition . Westmont, IL : Cambridge Business Publishers .
Eiszler, 2002, College students' evaluation of teaching and grade inflation, Research in Higher Education, 43, 483, 10.1023/A:1015579817194
Feldman, 1976, Grades and college students' evaluations of their courses and teachers, Research in Higher Education, 4, 69, 10.1007/BF00991462
Feldman, 1977, Consistency and variability among college students in rating their teachers and curses: A review and analysis, Research in Higher Education, 6, 233, 10.1007/BF00991288
Feldman, 1987, Research productivity and scholarly accomplishment of college teachers as related to their instructional effectiveness: A review and exploration, Research in Higher Education, 25, 227, 10.1007/BF00992241
Feldman, 1989, The association of student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies, Research in Higher Education, 30, 583, 10.1007/BF00992392
Feldman, 1993, College students' views of male and female college teachers, part II: Evidence from students' evaluations of their classroom teachers, Research in Higher Education, 4, 69, 10.1007/BF00991462
Fellingham, 2007, Is accounting an academic discipline?, Accounting Horizons, 21, 159, 10.2308/acch.2007.21.2.159
Flinn, R. E., and D. L. Crumbley. 2009a . Measure Learning Rather than Satisfaction in Higher Education . Sarasota, FL : American Accounting Association .
Flinn, 2009, Multiple teaching performance measures needed: SET management similar to earnings management, Measure Learning Rather than Satisfaction in Higher Education
Germain, 2005, Grade inflation and student individual differences as systemic bias in faculty evaluations, Journal of Instructional Psychology, 32, 58
Glenn, 2010, Rating your professors: Scholars test improved course evaluations, The Chronicle of Higher Education, 1
Green, 1998, A content analysis of teaching evaluation instruments used in accounting departments, Issues in Accounting Education, 13, 15
Greenwald, 1997, Grading leniency is a removable contaminant of student ratings, Journal of Educational Psychology, 89, 1209
Haskell, 2009, Academic freedom, tenure, promotion, and student evaluation of faculty (SEF): Retrospective and abstracted summaries, Measure Learning Rather than Satisfaction in Higher Education
Horngren, C., S. Datar, G. Foster, M. Rajan, and C. Ittner. 2008 . Cost Accounting: A Managerial Emphasis. 13th edition . Upper Saddle River, NJ : Prentice Hall .
Hoyt, D., and W. Pallett. 1999 . Appraising Teaching Effectiveness: Beyond Student Ratings. IDEA Paper No. 36 . Manhattan, KS : The IDEA Center .
Huber, M. T. 1998 . Community College Faculty: Attitudes and Trends, 1997 . Menlo Park, CA : The Carnegie Foundation for the Advancement of Teaching .
Huefner, 2009, Inputs to the measurement of teaching quality: Moving beyond student evaluations of teaching, Measure Learning Rather than Satisfaction in Higher Education
The IDEA Center . n.d. Our mission . Available at: http://www.theideacenter.org/about/our-mission
Isely,, 2005, Do higher grades lead to favorable student evaluations?, Journal of Economic Education, 36, 29, 10.3200/JECE.36.1.29-42
Ittner, 1998, Are nonfinancial measures leading indicators of financial performance? An analysis of customer satisfaction, Journal of Accounting Research, 1, 10.2307/2491304
Kaplan, 1992, The balanced scorecard—Measures that drive performance, Harvard Business Review (January–February), 71
Kaplan, 1992, Strategic learning and the balanced scorecard, Strategy and Leadership, 24, 18, 10.1108/eb054566
Kaplan, 1993, Putting the balanced scorecard to work, Harvard Business Review (September–October), 134
Kaplan, 1996, Using the balanced scorecard as a strategic management system, Harvard Business Review (January–February), 75
Kaplan, R. S., and D. Norton. 1996 b . Translating Strategy Into Action: The Balanced Scorecard . Boston, MA : Harvard Business School Press .
Kaplan, 1996, Linking the balanced scorecard to strategy, California Management Review, 39, 53, 10.2307/41165876
Kaplan, 2000, Having trouble with your strategy? Then map it, Harvard Business Review (September–October), 167
Kaplan, 2001, Transforming the balanced scorecard from performance measurement to strategic management: Part I, Accounting Horizons, 15, 87, 10.2308/acch.2001.15.1.87
Kaplan, 2001, Transforming the balanced scorecard from performance measurement to strategic management: Part II, Accounting Horizons, 15, 147, 10.2308/acch.2001.15.2.147
Kaplan, R. S., and D. Norton. 2001 c . The Strategy Focused Organization: How Balanced Scorecard Companies Thrive in the New Business Environment . Boston, MA : Harvard Business School Press .
Kaplan, 2009, The judgmental effects of management communications and a fifth balanced scorecard category on performance evaluation, Behavioral Research in Accounting, 21, 37, 10.2308/bria.2009.21.2.37
Kau, 1976, Measurement techniques, grades and ratings of instructors, Journal of Economic Education, 8, 59, 10.2307/1182139
Langbein, 2008, Management by results: Student evaluation of teaching and the mis-measurement of performance, Economics of Education Review, 27, 417, 10.1016/j.econedurev.2006.12.003
Li, Y. 1993 . A Comparative Study of Asian and American Students' Perceptions of Faculty Teaching Effectiveness at Ohio University . Unpublished doctoral dissertation , Ohio University .
Libby, 2004, The balanced scorecard: The effects of assurance and process accountability on managerial judgment, The Accounting Review, 79, 1075, 10.2308/accr.2004.79.4.1075
Lipe, 2000, The balanced scorecard: Judgmental effects of common and unique performance measures, The Accounting Review, 75, 283, 10.2308/accr.2000.75.3.283
Maher, M., C. Stickney, and R. Weil. 2008 . Managerial Accounting, 10th edition . Mason, OH : South-Western/Cengage Learning .
Marsh, 1982, The use of path analysis to estimate teacher and course effects in student ratings of instructional effectiveness, Applied Psychological Measurement, 6, 47, 10.1177/014662168200600106
Marsh, 1991, Students' evaluations of teaching effectiveness: The stability of mean ratings of the same teachers over a 13-year period, Teaching and Teacher Education, 7, 303, 10.1016/0742-051X(91)90001-6
Martin, 1998, Evaluating faculty based on student opinions: Problems, implications and recommendations from Deming's theory of management perspective, Issues in Accounting Education, 13, 1079
McKeachie, 1997, Student ratings: The validity of use, American Psychologist, 52, 1218, 10.1037/0003-066X.52.11.1218
McPherson, 2006, Determinants of how students evaluate teachers, Journal of Economic Education, 37, 3, 10.3200/JECE.37.1.3-20
Merchant, K., and W. Van der Stede. 2003 . Management Control Systems: Performance Measurement, Evaluation and Incentives . Essex, UK : Pearson Education Limited .
Mehdizadeh, 1990, Loglinear models and student course evaluations, Journal of Economic Education, 21, 7, 10.1080/00220485.1990.10844649
Miller, J. E. 2006 . Summary and recommendations for evaluating faculty performance. In Evaluating Faculty Performance: A Practical Guide to Assessing Teaching, Research, and Service, edited by Seldin and Associates, 217–229 . Bolton, MA : Anker Publishing Company .
Moore, 2001, HCS: Designing a balanced scorecard in a knowledge-based firm, Issues in Accounting Education, 16, 569, 10.2308/iace.2001.16.4.569
Nichols, 1972, Economic man in the classroom, Journal of Political Economy, 80, 1069, 10.1086/259956
Overall, 1980, Students evaluations of instruction: A longitudinal study of their stability, Journal of Educational Psychology, 72, 321, 10.1037/0022-0663.72.3.321
Pallett, W. 2006 . Uses and abuses of student ratings. In Evaluating Faculty Performance: A Practical Guide to Assessing Teaching, Research, and Service, edited by Seldin and Associates, 50–65 . Bolton, MA : Anker Publishing Company .
Seldin, P . 1999 . Current practices good and bad nationally . In Changing Practices in Evaluating Teaching : A Practical Guide to Improve Faculty Performance and Promotion/Tenure Decisions , edited by Seldin and Associates . Bolton, MA: Anker Publishing Company .
Seldin, P. 2004 . The teaching portfolio . In Teaching Portfolio : A Practical Guide to Improved Performance and Promotion/Tenure Decisions, edited by Seldin and Associates . Bolton, MA. Anker Publishing Company .
Seldin, P. 2010 . Evaluating College Teaching . Proceedings of the American Council on Education Workshop : Chairing the Academic Department, San Diego, CA, February 24–27 .
Simons, R. 2000 . Performance Measurement and Control Systems for Implementing Strategy . Upper Saddle River, NJ : Prentice Hall .
Taylor, 2010, The balanced scorecard as a strategy-evaluation tool: The effects of implementation involvement and a causal-chain focus, The Accounting Review, 85, 1095, 10.2308/accr.2010.85.3.1095
Theall, 1990, Student ratings in the context of complex evaluation systems, Student Ratings of Instruction: Issues for Improving Practice (New Directions for Teaching and Learning, No. 43)
The University of Alabama . 2006 . Policy on student evaluation of teachers. In College of Commerce and Business Administration Faculty Handbook, 53–58 . Tuscaloosa, AL : The University of Alabama .
U.S. Department of Education, 1991, Assessing teaching performance, The Department Chair: A Newsletter for Academic Administrators, 3, 2
Wallace, 1998, Why the costs of student evaluations have long exceeded their value, Issues in Accounting Education, 13, 443
Wilson, 2010, Why teaching is not priority no. 1, The Chronicle of Higher Education, 1
Zangenehzadeh, 1988, Grade inflation: A way out, Journal of Economic Education, 19, 217, 10.1080/00220485.1988.10845263
Zimmerman, 2002, Reduced rigor and grade inflation diminish the quality of higher education