Measurement in business processes: a systematic review

Emerald - Tập 16 Số 1 - Trang 114-134 - 2010
Laura Sánchez González1, Félix García1, Francisco Ruiz González2, Mario Piattini1
1Alarcos Research Group, Department of Information Technologies and Systems, Escuela Superior de Informática, University of Castilla‐La Mancha, Ciudad Real, Spain
2Alarcos Research Group, Department of Information Technologies and Systems, Escuela Superior de Informática, University of Castilla‐La Mancha, Ciudad Real, Spain Department of Mathematics, Statistics and Computational Science, Cantabria University, Santander, Spain

Tóm tắt

PurposeThe purpose of this paper is to analyze the current state of the art and trends with regard to business process measurement by means of a systematic review of literature.Design/methodology/approachThe results are obtained through a systematic review carried out according to existing relevant guidelines. Additionally, a specific methodology through which to systematically obtain all the most important journals is followed. In total, 19 relevant articles are selected and later analyzed. A subsequent critical analysis of the data obtained is applied to identify the gaps in the current literature.FindingsA considerable effort has been made by researchers in the field of business process measurement, particularly in recent years. Many of the defined measures for business processes have been applied to models (approximately 77 per cent). Most of the initiatives concerning business measurement have been adapted from the software engineering field. A small percentage of the existing business process measures has been empirically validated.Originality/valueThe results presented contribute towards providing an updated overview of the current state of research into business process measurement, in order to identify existing research gaps and concerns on which ongoing and future research efforts on this topic can be focused.

Từ khóa


Tài liệu tham khảo

Aversano, L., Bodhuin, T., Canfora, G. and Tortorella, M. (2004), “A framework for measuring business processes based on GQM”, Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS'04) – Track 1, IEEE Computer Society, Washington, DC, p. 10012.1.

Biolchini, J.C., Gomes, P., Cruz, A.C. and Horta, G. (2005), “Systematic review in software engineering”, Technical Report RT‐ES 679/05, Systems Engineering and Computer Science Department, COPPE/UFRJ, Rio de Janeiro.

Biolchini, J.C., Mian, P.G., Cruz, A.C., Conte, T.U. and Horta, G. (2007), “Scientific research ontology to support systematic review in software engineering”, Adv. Eng. Inform., Vol. 21 No. 2, pp. 133‐51.

Briand, L.C., El Eman, K. and Morasca, E.S. (1995), “Theoretical and empirical validation of software product measures”, Technical Report ISERN‐95‐03, International Software Engineering Research Network, Kaiserslautern.

Briand, L.C., Morasca, E.S. and Basili, V.R. (1996), “Property‐based software engineering measurement”, IEEE Transactions on Software Engineering, Vol. 22 No. 1, pp. 68‐86.

Cardoso, J. (2006), “Process control‐flow complexity metric: an empirical validation”, IEEE International Conference on Services Computing, Chicago, IL, pp. 167‐73.

Cardoso, J. (2007), “Business process quality metrics: log‐based complexity of workflow patterns”, On the Move to Meaningful Internet Systems (OTM Conferences), pp. 427‐34.

Ciolkowski, M., Shull, F. and Biffl, S. (2002), “A family of experiments to investigate the influence of context on the effect of inspection techniques”, Proceedings of the 6th International Conference on Empirical Assessment in Software Engineering, Keele.

Dufresne, T. and Martin, J. (2003), “Process modeling for e‐business”, INF 770 – Methods for Informations Systems Engineering: Knowledge Management and E‐Business, George Mason University, Fairfax, VA.

Fenton, N. (1994), “Software measurement: a necessary scientific basis”, IEEE Transactions on Software Engineering, Vol. 20, pp. 199‐206.

García, F., Bertoa, M., Calero, C., Vallecillo, A., Ruiz, F., Piattini, M. and Genero, M. (2005), “Towards a consistent terminology for software measurement”, Information and Software Technology, Vol. 48, pp. 631‐44.

Ghani, A., Muketha, K.T. and Wen, W.P. (2008), “Complexity metrics for measuring the understandability and maintainability of business process models using goal‐question‐metric”, International Journal of Computer Science and Network Security, Vol. 8, pp. 219‐25.

Gruhn, V. and Laue, R. (2006a), “Adopting the cognitive complexity measure for business process models”, 5th IEEE International Conference on Cognitive Informatics, Beijing, pp. 236‐41.

Gruhn, V. and Laue, R. (2006b), “Complexity metrics for business process models”, Proceedings of 9th International Conference on Business Information System, Klagenfurt.

Guceglioglu, S. and Demirors, O. (2005), “Using software quality characteristics to measure business process quality”, Business Process Management, Lecture Notes in Computer Science (LNCS 3649), Springer, New York, NY, pp. 374‐9.

Heravizadeh, M., Mendling, J. and Rosemann, M. (2008), “Dimensions of business processes quality (QoBP)”, Proceedings of the 6th International Conference on Business Process Management Workshops (BPM Workshops 2008), Milan.

Huan, Z. and Kumar, A. (2008a), “An analysis of the quality and accuracy trade‐off in process models from noisy logs”, working paper, Penn State University, Philadelphia, PA.

Huan, Z. and Kumar, A. (2008b), “New quality metrics for evaluating process models”, paper presented at the Business Process Management 2008, Business Process Intelligence Workshop, Milan.

Jung, J.Y. (2008), “Measuring entropy in business process models”, International Conference on Innovative Computing, Information and Control, p. 246.

Juristo, N. and Moreno, A. (2001), Basics of Software Engineering Experimentation, Kluwer Academic, Boston, MA.

Kitchenham, B. and Charters, S. (2007), Guidelines for Performing Systematic Literature Reviews in Software Engineering, Technical Report, Keele University and University of Durham, Keele.

Korherr, B. and List, B. (2007), “Extending the EPC with performance measures”, Proceedings of the 2007 ACM Symposium on Applied Computing (SAC'07), ACM, New York, NY, pp. 1265‐6.

Laird, L.M. and Brennan, M.C. (2006), Software Measurement and Estimation: A Practical Approach, Quantitative Software Engineering Series, Wiley‐IEEE Computer Society, New York, NY.

Latva‐Koivisto, A. (2001), “Finding a complexity measure for business process models”, Technical Report, Systems Analysis Laboratory, Helsinki University of Technology, Helsinki.

Mendling, J. (2006), “Testing density as a complexity metric for EPCS”, Technical Report JM‐2006‐11‐15, Vienna University of Economics and Business Administration, Wien.

Mendling, J. (2008), Metrics for Process Models. Empirical Foundations of Verification, Error Prediction, and Guidelines for Correctness, Lecture Notes in Business Information Processing, Vol. 6, Springer, Berlin.

Mendling, J., Reijers, H. and Cardoso, J. (2007), “What makes process models understandable?”, in Alonso, G., Dadam, P. and Rosemann, M. (Eds), Proceedings of the 5th International Conference on Business Process Management, Brisbane, Australia, 24‐28 September, Lecture Notes in Computer Science, Vol. 4714, pp. 48‐63.

Neumann, G. and Mendling, J. (2007), “Error metrics for business process models”, paper presented at the CAiSE Forum, Vol. 247.

Park, R.E., Wolfhart, B., Goethert, W. and Florac, W.A. (1996), Goal‐driven Software Measurement – A Guidebook, Handbook CMU/SEI‐96‐HB‐002, Software Engineering Institute, Pittsburgh, PA.

Perry, D.E., Porter, A.A. and Votta, L.G. (2000), “Empirical studies of software engineering: a roadmap”, Proceedings of the Conference on the Future of Software Engineering (ICSE '00), ACM, New York, NY, pp. 345‐55.

Pino, F.J., García, F. and Piattini, M. (2008), “Software process improvement in small and medium software enterprises: a systematic review”, Software Quality Journal, Vol. 16 No. 2, pp. 337‐40.

Powell, S.G., Schwaninger, M. and Trimble, C. (2001), “Measurement and control of business processes”, System Dynamic Review, Vol. 17 No. 1, pp. 63‐91.

Rolón, E., Ruiz, F., García, F. and Piattini, M. (2006), “Evaluation measures for business process models”, Proceedings of the 2006 ACM Symposium on Applied Computing (SAC'06), ACM, New York, NY, pp. 1567‐8.

Sanchez, L., Delgado, A., Ruiz, F., García, F. and Piattini, M. (2009), “Measurement and maturity of business processes”, Handbook of Research on Business Process Modeling, IGI Global, Hershey, PA, pp. 532‐56.

Smith, H. and Fingar, P. (2003), Business Process Management: The Third Wave, Meghan‐Kiffer Press, Tampa, FL.

Tjaden, G. (1999), Business Process Structural Analysis, Georgia Tech Center for Enterprise, Atlanta, GA.

Vanderfeesten, I., Reijers, H.A. and van der Aalst, W.M.P. (2008a), “Evaluating workflow process designs using cohesion and coupling metrics”, Computers in Industry, Vol. 59 No. 5, pp. 420‐37.

Vanderfeesten, I., Reijers, H.A., Mendling, J., van der Aalst, W.M.P. and Cardoso, J. (2008b), “On a quest for good process models: the cross‐connectivity metric”, CAiSE'08: Proceedings of the 20th International Conference on Advanced Information Systems Engineering, pp. 480‐94.

Vitolins, V. (2004), “Business process measures”, Proceedings of the International Conference Baltic DB&IS 2004, University of Latvia, Riga, Latvia, Scientific Papers University of Latvia, Vol. 673.

Wand, Y. and Weber, R. (2002), “Research commentary: information systems and conceptual modeling – a research agenda”, Info. Sys. Research, Vol. 13 No. 4, pp. 363‐76.

Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B. and Wesslén, A. (2000), Experimentation in Software Engineering: An Introduction, Kluwer Academic, Norwell, MA.

Zeithalm, V. (1990), Delivering Quality Service: Balancing Customer Perceptions and Expectations, The Free Press, New York, NY.

Zelkowitz, M.V. and Wallace, D.R. (1998), “Experimental models for validating technology”, Computer, Vol. 31 No. 5, pp. 23‐31.