Towards meaningful benchmarking of software development team productivity

Emerald - Tập 10 Số 4 - Trang 382-399 - 2003
Andrew Flitman1
1School of Business Systems, Monash University, Victoria, Australia

Tóm tắt

Software development projects are known for inaccuracies associated with elapsed time and total cost estimates. Attempts have previously been made to provide tools to facilitate estimation of just how much effort will be required. One such tool is the estimation of project size (and therefore effort and time required) using function point counts. This benchmarking tool facilitates measures of productivity relating this size to the person‐hours required. The problem with this is that such relative productivity measures assume labour hours to be homogenous and that the only measure of output is the size of the project. This paper investigates the use of data envelopment analysis as a method of benchmarking which overcomes these issues. The end result is a set of simple tools that can be used to determine whether a given project or project plan is efficient.

Tài liệu tham khảo

Andersen, P. and Petersen, N.C. (1993), “A procedure for ranking efficient units in data envelopment analysis”, Management Science, Vol. 39, pp. 1261‐4. Athanassopoulos, A.D. and Ballantine, J.A. (1995), “Ratio frontier analysis for assessing corporate performance – evidence from the grocery industry in the UK”, Journal of the Operational Research Society, Vol. 46, pp. 427‐40. Banker, R.D., Charnes, A. and Cooper, W.W. (1984), “Some models for estimating technical and scale inefficiencies in data envelopment analysis”, Management Science, Vol. 30, pp. 1078‐92. Banker, R.D., Datar, S.M. and Kemerer, C.F. (1989), “Factors affecting software maintenance productivity: an exploratory study”, Proceedings of the 8th International Conference on Information Systems, Pittsburgh, PA, pp. 160‐75. Banker, R.D., Kauffman, R.J. and Morey, R.C. (1990), “Measuring gains in operational efficiency from information technology: a study of the Positran Deployment at Hardee's Inc.”, Journal of Management Information Systems, Vol. 7, pp. 29‐54. Barr, R.S. and Durchholz, M.L. (1997), “Parallel and hierarchical decomposition approaches for solving large‐scale data envelopment analysis models”, Annals of Operations Research, Vol. 73, pp. 339‐72. Bell, R.A. and Morey, R.C. (1994), “The search for appropriate benchmarking partners – a macro approach and application to corporate travel management”, Omega, Vol. 22, pp. 477‐90. Bogetoft, P. (1997), “DEA‐based yardstick competition: the optimality of best practice regulation”, Annals of Operations Research, Vol. 73, pp. 277‐98. Camanho, A.S. and Dyson, R.G. (1999), “Efficiency, size, benchmarks and targets for bank branches: an application of data envelopment analysis”, Journal of the Operational Research Society, Vol. 50, pp. 903‐15. Charnes, A., Cooper, W.W. and Rhodes, E. (1978), “Measuring the efficiency of decision making units”, European Journal of Operational Research, Vol. 2, pp. 444‐79. Cheung, Y., Willis, R. and Milne, B. (1999), “Software benchmarking using function point analysis”, Benchmarking, Vol. 6 No. 3, pp. 269‐79. Chilingerian, J.A. and Sherman, H.D. (1996), “Benchmarking physician practice patterns with DEA: a multi‐stage approach for cost containment”, Annals of Operations Research, Vol. 67, pp. 83‐116. Dey, D. and Seidmann, A. (1994), “Benchmarking decision models for database management systems”, Information Systems Research, Vol. 5, pp. 275‐93. Dyson, R.G., Thanassoulis, E. and Boussofiane, A. (1990), “Data envelopment analysis”, in Hendry, L.C. and Eglese, R.W. (Eds), Tutorial Papers in Operational Research, Operational Research Society, Birmingham. Elam, J. and Thomas, J.B. (1989), “Evaluating productivity of information systems organisations in state government”, Public Productivity Review, Vol. 12, pp. 263‐77. Farrell, M.J. (1957), “The measurement of productive efficiency”, J. Roy. Statistic Soc., Ser A No. III, pp. 252‐67. Golany, B. and Thore, S. (1997), “Restricted best practice selection in DEA: an overview with a case study evaluating the socio‐economic performance of nations”, Annals of Operations, Vol. 73, pp. 117‐40. Hibiki, N. and Sueyoshi, T. (1999), “DEA sensitivity analysis by changing a reference set: regional contribution to Japanese industrial development”, Omega, Vol. 27, pp. 139‐53. Hill, P.R. (1999), Software Project Estimation, ISBSG, Melbourne. Horsky, D. and Nelson, P. (1996), “Evaluation of salesforce size and productivity through efficient frontier benchmarking”, Market Science, Vol. 15 No. 4, pp. 301‐20. Mahmood, M.A. (1994), “Evaluation organizational efficiency resulting from information technology investment: an application to data envelopment analysis”, Information Systems Journal, Vol. 4, pp. 93‐115. Morey, M.R. and Morey, R.C. (1999), “Mutual fund performance appraisals: a multi‐horizon perspective with endogenous benchmarking”, Omega, Vol. 27, pp. 241‐58. Post, T. and Spronk, J. (1999), “Performance benchmarking using interactive data envelopment analysis”, Eur. J. Oper. Res., Vol. 115 No. 3, pp. 472‐87. Retzlaff‐Roberts, D.L. (1997), “A data envelopment analysis approach to discriminant analysis”, Annals of Operations Research, Vol. 73, pp. 299‐321. Schefczyk, M. (1993), “Industrial benchmarking: a case study of performance analysis techniques”, International Journal of Production Economics, Vol. 32, pp. 2‐11. Shafer, S.M. and Byrd, T.A. (2000), “A framework for measuring the efficiency of organizational investments in information technology using data envelopment analysis”, Omega, Vol. 28, pp. 125‐41. Sherman, H.D. and Ladino, G. (1995), “Managing bank productivity using data envelopment analysis (DEA)”, Interfaces, Vol. 25, pp. 60‐73. Smith, P. (1997), “Model misspecification in data envelopment analysis”, Annals of Operations Research, Vol. 73, pp. 233‐52. Wang, C.H., Gopal, R.D. and Zionts, S. (1997), “Use of data envelopment analysis in assessing information technology impact on firm performance”, Annals of Operations Research, Vol. 73, pp. 191‐213. Whiteman, I. (1995), “Benchmarking developing country electricity systems using data envelopment analysis”, Asia‐Pacific Economic Review, Vol. 1 No. 3, pp. 71‐8.