The Training Evaluation Inventory (TEI) - Evaluation of Training Design and Measurement of Training Outcomes for Predicting Training Success

Sandrina Ritzmann1, Vera Hagemann2, Annette Kluge2
1Institute Humans in Complex Systems, University of Applied Sciences and Arts Northwestern Switzerland , Olten , Switzerland
2Business and Organizational Psychology, University of Duisburg-Essen, Duisburg, Germany

Tóm tắt

Từ khóa


Tài liệu tham khảo

Aguinis, H., & Kraiger, K. (2009). Benefits of training and development for individuals and teams, organizations, and society. Annual Review of Psychology, 60, 451–474.

Alliger, G. M., & Janak, E. A. (1989). Kirkpatrick’s levels of training criteria: thirty years later. Personnel Psychology, 42, 331–342.

Alliger, G. M., Tannenbaum, S. I., Bennett, W., Traver, H., & Shotland, A. (1997). A meta-analysis of the relations among training criteria. Personnel Psychology, 50, 341–358.

Arthur, W., Bennett, W., Stanush, P. L., & McNelly, T. L. (1998). Factors that influence skill decay and retention: a quantitative review and analysis. Human Performance, 11(1), 57–101.

Arthur, W., Bennett, W., Edens, P. S., & Bell, S. T. (2003). Effectiveness of training in organizations: a meta-analysis of design and evaluation features. Journal of Applied Psychology, 88(2), 234–245.

Bassi, L. J., Benson, G., & Cheney, S. (1996). The top ten trends. Training and Development, 50(11), 28–42.

Billett, S. (2008). Welcome to the new journal. Vocations and Learning, 1, 1–5.

Blanchard, P. N., Thacker, J. W., & Way, S. A. (2002). Training evaluation: perspectives and evidence from Canada. International Journal of Training and Development, 4(4), 295–304.

Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010). Transfer of training: a meta-analytic review. Journal of Management, 36(4), 1065–1105.

Burke, M. J., & Day, R. R. (1986). A cumulative study of the effectiveness of managerial training. Journal of Applied Psychology, 71(2), 232–245.

Campbell, D. J., & Lee, C. (1988). Self-Appraisal in performance evaluation: development versus evaluation. The Academy of Management Review, 13(2), 302–314.

Cannon-Bowers, J. A., Salas, E., Tannenbaum, S. I., & Mathieu, J. E. (1995). Toward theoretically based principles of training effectiveness: a model and initial empirical investigation. Military Psychology, 7(3), 141–164.

Chesebro, J. L., & McCroskey, J. C. (2000). The relationship between students’ reports of learning and their actual recall of lecture material: a validity test. Communication Education, 49, 297–301.

Clark, L. A., & Watson, D. (1995). Constructing validity: basic issues in objective scale development. Psychological Assessment, 7(3), 309–319.

Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159.

Colquitt, J. A., LePine, J. A., & Noe, R. A. (2000). Toward an integrative theory of training motivation: a meta-analytic path analysis of 20 years of research. Journal of Applied Psychology, 85(5), 678–707.

Cooper, H., & Hedges, L. V. (2009). Research synthesis as a scientific process. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (pp. 3–16). New York: Russell Sage.

European Centre for the Development of Vocational Training. (2010). Employer-provided vocational training in Europe. Evaluation and interpretation of the third continuing vocational training survey. Luxembourg: Publications Office of the European Union.

Field, A. (2005). Discovering statistics using SPSS. London: Sage Publications Ltd.

Frick, T., Chadha, R., Watson, C., Wang, Y., & Green, P. (2009). College student perceptions of teaching and learning quality. Educational Technology Research and Development, 57, 705–720.

Gagné, R. M., Wagner, W. W., Golas, K. C., & Keller, J. M. (2005). Principles of instructional design (5th ed.). Belmont: Wadsworth.

Gegenfurtner, A. (2011). Motivation and transfer in professional training: a meta-analysis of the moderating effects of knowledge type, instruction, and assessment conditions. Educational Research Review, 6, 153–168.

Gegenfurtner, A. (2012). Dimensions of motivation to transfer: a longitudinal analysis of their influence on retention, transfer, and attitude change. Vocations and Learning. doi: 10.1007/s12186-012-9084-y .

Gegenfurtner, A., Veermans, K., Festner, D., & Gruber, H. (2009). Motivation to transfer training: an integrative literature review. Human Resource Development Review, 8, 403–423.

Goldstein, I., & Ford, J. K. (2002). Training in organizations (4th ed.). Belmont: Wadsworth.

Gully, S., & Chen, G. (2010). Individual differences, attribute-treatment interactions, and training outcomes. In S. W. Kozlowsky & E. Salas (Eds.), Learning, training, and development in organizations (pp. 3–64). New York: Routledge.

Hagemann, V. (2011). Trainingsentwicklung für High Responsibility Teams [Training development for High Responsibility Teams]. Lengerich: Pabst Science Publishers.

Hagemann, V., Kluge, A., & Greve, J. (2012). Measuring the effects of team resource management training for the fire service. Proceedings of the 56th Annual Meeting of the Human Factors and Ergonomics Society (HFES), Boston, 56, 1, 2442–2446.

Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2006). Multivariate data analysis (6th ed.). Upper Saddle River: Prentice Hall.

Helmreich, R. L., Merritt, A. C., & Wilhelm, J. A. (1999). The evolution of crew resource management training in commercial aviation. The International Journal of Aviation Psychology, 9(1), 19–32.

Hochholdinger, S., Rowold, J., & Schaper, N. (2008). Ansätze zur Trainings- und Transferevaluation [Approaches to the evaluation of training and transfer]. In Evaluation und Transfersicherung betrieblicher Trainings [Evaluation and assurance of transfer of vocational training] (pp. 30–53). Göttingen: Hogrefe.

Holton, E. F. (1996). The flawed four-level evaluation model. Human Resource Development Quarterly, 7, 5–21.

Hu, & Bentler. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55.

Kauffeld, S. (2010). Nachhaltige Weiterbildung [Sustainable further education]. Berlin: Springer Verlag.

Keith, N., & Frese, M. (2008). Effectiveness of error management training: a meta-analysis. Journal of Applied Psychology, 93(1), 59–69.

Kirkpatrick, D. L. (1998). Evaluating training programs: The four levels (2nd ed.). San Francisco: Berrett-Koehler Publishers.

Kraiger, K. (2002). Decision-based evaluation. In K. Kraiger (Ed.), Creating, implementing, and managing effective training and development (pp. 331–375). San Francisco: Jossey-Bass.

Kraiger, K., Ford, J. K., & Salas, E. (1993). Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology, 78(2), 311–328.

Lewis, J. L. (2009). Student attitudes toward impairment and accessibility: an evaluation of awareness training for urban planning students. Vocations and Learning, 2, 109–125.

McDonnald, L. M., & Shadow, L. W. (2003). Precursor for error: An analysis of wildland fire crew leaders’ attitudes about organizational culture and safety. Presentation to the 3rd International Wildland Fire 2003 Conference, Australasian Fire Authorities Council, Sydney, Australia.

Merrill, M. D. (2002). First principles of instruction. Educational Technology Research and Development, 50(3), 43–59.

Nunnally, J. C. (1978). Psychometric theory. New York: McGraw-Hill.

Olson, J. M., & Zanna, M. P. (1993). Attitudes and attitude change. Annual Review of Psychology, 44, 117–154.

Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: a critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.

Ritzmann, S. (2012). Entwicklung und Evaluation von Crew Resource Management Training für Flight Attendants [Development and evaluation of crew resource management training for flight attendants]. Lengerich: Pabst Science Publishers.

Ritzmann, S., Kluge, A., & Hagemann, V. (2009). Crew Resource Management für Kabinenbesatzungen: Ein konzeptbasierter Ansatz. [Crew Resource Management for cabin crews: A conceptual approach.]. In M. Grandt & A. Bauch (Eds.), Kooperative Arbeitsprozesse [Cooperative work processes] (DGLR-Report 2009–02) (pp. 261–277). Bonn: Deutsche Gesellschaft für Luft- und Raumfahrt e.V.

Ritzmann, S., Kluge, A., Hagemann, V., & Tanner, M. (2011). Integrating safety and crew resource management (CRM) aspects in the recurrent training of cabin crew members. Aviation Psychology and Applied Human Factors, 1(1), 45–51.

Salas, E., & Cannon-Bowers, J. A. (2001). The science of training: a decade of progress. Annual Review of Psychology, 52, 471–499.

Salas, E., Prince, C., Bowers, C. A., Stout, R. J., Oser, R. L., & Cannon-Bowers, J. A. (1999). A methodology for enhancing crew resource management training. Human Factors, 41, 161–172.

Salas, E., Wilson, K. A., Burke, C. S., & Wightman, D. (2006a). Does crew resource management work? An update, an extension, and some critical needs. Human Factors, 48(2), 392–412.

Salas, E., Wilson, K. A., Priest, H. A., & Guthrie, J. W. (2006b). Design, delivery, and evaluation of training systems. In G. Salvendy (Ed.), Handbook of human factors and ergonomics (pp. 472–512). Hoboken: Wiley.

Sexton, J. B., Helmreich, R. L., Glenn, D., Wilhelm, J. A., & Merritt, A. C. (2000). Operating Room Management Attitudes Questionnaire (ORMAQ) The University of Texas at Austin, Human Factors Research Project.

Shelton, A., & Alliger, G. M. (1993). Who’s afraid of level 4 evaluation? A practical approach. Training and Development, 47, 43–46.

Sitzmann, T., Brown, K. G., Casper, W. J., Ely, K., & Zimmerman, R. D. (2008). A review and meta-analysis of the nomological network of trainee reactions. Journal of Applied Psychology, 93(2), 280–295.

Sitzmann, T., Ely, K., Brown, K. G., & Bauer, K. N. (2010). Self-assessment of knowledge: a cognitive learning or affective measure. Academy of Management Learning & Education, 9, 169–191.

Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics. Boston: Pearson Education.

Tannenbaum, S. I., & Woods, S. B. (1992). Determining a strategy for evaluating training: operating within organizational constraints. Human Resource Planning, 15, 63–81.

Tannenbaum, S. I., & Yukl, G. (1992). Training and development in work organizations. Annual Review of Psychology, 43(1), 399–441.

Taylor, P. J., Russ-Eft, D. F., & Chang, D. W. (2005). A meta-analytic review of behavior modeling training. Journal of Applied Psychology, 90(4), 692–709.

Twitchell, S., Holton, E. F., & Trott, J. W. (2000). Technical training evaluation practices in the United States. Performance Improvement Quarterly, 13, 84–109.

Vroom, V. H. (1964). Work and motivation. New York: Wiley.

Warr, P., & Bunce, D. (1995). Trainee characteristics and the outcomes of open learning. Personnel Psychology, 48(2), 347–375.

Warr, P., Allan, C., & Birdi, K. (1999). Predicting three levels of training outcome. Journal of Occupational and Organizational Psychology, 72, 351–375.

Wasserman, J. D., & Bracken, B. A. (2003). Psychometric characteristics of assessment procedures. In J. R. Graham & J. A. Naglieri (Eds.), Handbook of psychology: Assessment psychology (Volume 10) (pp. 43–66). Hoboken: Wiley.

Weick, K. E., & Sutcliffe, K. M. (2007). Managing the unexpected (2nd ed.). San Francisco: Jossey-Bass.

Yule, S., Flin, R., Paterson-Brown, S., & Maran, N. (2004). Surgeons’ attitudes to teamwork and safety. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 2045–2049).

zu Knyphausen-Aufsess, D., Smukalla, M., & Abt, M. (2009). Towards a new training transfer portfolio: a review of training-related studies in the last decade. Zeitschrift für Personalforschung [German Journal of Research in Human Resource Management], 23, 288–311.