Benchmarking performance indices: pitfalls and solutions
Tóm tắt
Many organizations include benchmarking as a component of their performance management system. Often, a performance index is used to quantify the ability of an organizational entity to operate successfully. Benchmarking a performance index is done inappropriately when statistical methods are employed that ignore sample size effects or use aggregate performance data over a period during which changes occurred within the organization. Benchmarking will also be ineffective when invalid targets are employed. When benchmarking is done incorrectly, customer satisfaction may actually decline due to gaming and poor morale among employees. Based on the philosophy of W. Edwards Deming, the techniques of statistical process control (SPC), and basic undergraduate statistics, a system is described for effectively benchmarking a performance index. Examples are presented to illustrate the pitfalls that exist in many performance management systems and to explain the system presented for effective benchmarking.
Từ khóa
Tài liệu tham khảo
Berenson, M.L., Levine, D.M. and Krehbiel, T.C. (2002), Basic Business Statistics: Concepts and Applications, 8th ed., Prentice‐Hall, Englewood Cliffs, NJ.
Brownlie, D. (2000), “Benchmarking your marketing process”, Long Range Planning, Vol. 32 No. 1, pp. 88–95.
Camp, R.C. (1995), Business Process Benchmarking, ASQC Quality Press, Milwaukee, WI.
Deming, W.E. (1986), Out of the Crisis, MIT Center for Advanced Engineering Study, Cambridge, MA.
Deming, W.E. (1993), The New Economics for Industry, Government, Education, 2nd ed., MIT Center for Advanced Engineering Study, Cambridge, MA.
Dubois, R.W., Brook, R.H. and Rogers, W.H. (1987), “Adjusted hospital death rates: a potential screen for quality of medical care”, American Journal of Public Health, Vol. 77 No. 9, pp. 1162–6.
Elmuti, D. and Kathawala, Y. (1997), “An overview of benchmarking process: a tool for continuous improvement and competitive advantage”, Benchmarking for Quality Management & Technology, Vol. 4 No. 4, pp. 229–43.
Freytag, P.V. and Hollensen, S. (2001), “The process of benchmarking, benchlearning, and benchaction”, The TQM Magazine, Vol. 13 No. 1, pp. 25–33.
Gautreau, A. and Kleiner, B.H. (2001), “Recent trends in performance measurement systems – the balanced scorecard approach”, Management Research News, Vol. 24 No. 3/4, pp. 153–6.
Hartocollis, A. (2000), “9 educators accused of encouraging students to cheat”, New York Times, 3 May, p. B4.
Joint Commission on Accreditation of Healthcare Organizations (2000), Comprehensive Accreditation Manual for Hospitals: The Official Handbook, JCAHO, Oakbrook Terrace, IL.
Kaminsky, F.C., Maleyeff, J., Providence, S., Purinton, E. and Waryasz, M. (1997), “Using SPC to analyze quality indicators in a healthcare organization”, Journal of Healthcare Risk Management, Vol. 17 No. 4, pp. 14–22.
MacCarthy, B.L. and Wasusri, T. (2002), “A review of non‐standard applications of statistical process control (SPC) charts”, International Journal of Quality & Reliability Management, Vol. 19 No. 3, pp. 295–320.
McKenzie, F. and Shilling, M. (1998), “Avoiding performance measurement traps: ensuring effective incentive design and implementation”, Compensation and Benefits Review, Vol. 30 No. 4, pp. 57–64.
Madu, C.N. and Kuei, C. (1998), “Application of data envelop analysis for benchmarking”, International Journal of Quality Science, Vol. 3 No. 4, pp. 320–7.
Maleyeff, J. and Kaminsky, F.C. (2002), “Six Sigma and introductory statistics education”, Education + Training, Vol. 44 No. 2, pp. 82–9.
Maleyeff, J., Kaminsky, F.C., Jubinville, A. and Fenn, C.A. (2001a), “A guide to using performance measurement systems for continuous improvement”, Journal for Healthcare Quality, Vol. 23 No. 4, pp. 33–7.
Maleyeff, J., Kaminsky, F.C., Schwartz, E., Bombardier, G. and Fenn, C.A. (2001b), “Analysis of hospital mortality for continuous improvement”, Journal of Healthcare Risk Management, Vol. 21 No. 2, pp. 23–31.
National Institute of Standards and Technology (2002), Criteria for Performance Excellence, Baldrige National Quality Program, NIST, Gaithersburg, MD.
Neely, A., Gregory, M. and Platts, K. (1995), “Performance measurement systems design: a literature review and research agenda”, International Journal of Operations & Production Management, Vol. 15 No. 4, pp. 80–116.
Persico, J. Jr and McLean, G.N. (1994), “Manage with valid rather than invalid goals”, Quality Progress, April, pp. 49–53.
Procurement Executives’ Association (1999), Guide to a Balanced Scorecard Performance Management Methodology, Procurement Executives’ Association, available at: http://oamweb.osec.doc.gov/bsc/guide.htm.
Pun, K.F., Chin, K.S. and Lau, H. (2000), “A QFD/hoshin approach for service quality deployment: a case study”, Managing Service Quality, Vol. 10 No. 3, pp. 156–70.
Shah, J. and Singh, N. (2001), “Benchmarking internal supply chain performance: development of a framework”, The Journal of Supply Chain Management, Vol. 37 No. 1, pp. 37–47.
Swindell, D. and Kelly, J.M. (2000), “Linking citizen satisfaction data to performance measures”, Public Performance & Management Review, Vol. 24 No. 1, pp. 30–52.
Treadway, J. (2000), “Inflated scores discussed at education conference”, Times‐Picayne, April 25, p. B1.
Walsh, P. (2000), “Targets and how to assess performance against them”, Benchmarking: An International Journal, Vol. 7 No. 3, pp. 183–99.
Zairi, M. and Ahmed, P.Z. (1999), “Benchmarking maturity as we approach the millennium?”, Total Quality Management, Vol. 10 No. 4/5, pp. 810–6.