A proposed quantitative methodology for the evaluation of the effectiveness of Human Element, Leadership and Management (HELM) training in the UK
Tóm tắt
In 2006, a review of maritime accidents found that non-technical skills (NTSs) are the single largest contributing factor towards such incidents. NTSs are composed of both interpersonal and cognitive elements. These include things such as situational awareness, teamwork, decision making, leadership, management and communication skills. In a crisis situation, good NTSs allow a deck officer to quickly recognise that a problem exists and then harness the resources that are at their disposal to safely and efficiently bring the situation back under control. This paper has two aims. The first is to develop a methodology which will enable educators to quantitatively assess the impact of Maritime and Coastguard Agency (MCA)-approved Human Element, Leadership and Management (HELM) training on deck officer’s NTSs with a view to identifying further training requirements. The second is to determine whether the HELM training provided to develop the NTSs of trainee deck officers is fit for purpose. To achieve these aims, a three-phase approach was adopted. Initially, a taxonomy for deck officer’s NTSs is established, behavioural markers are identified and the relative importance of each attribute is calculated using the analytical hierarchy process (AHP). Subsequently, a set of scenarios were identified for the assessment of deck officer’s NTSs in a ship bridge simulator environment. A random selection of students that have completed the Chief Mate (CM) programme was performed, and data regarding their NTS-related performance in the scenarios was collected. Finally, the collected data was fed into the evidential reasoning (ER) algorithm, utility values were produced and, having established these values, the effectiveness of the HELM training that the students have received was then evaluated.
Tài liệu tham khảo
Aull-Hyde R, Erdogan S, Duke JM (2006) An experiment on the consistency of aggregated comparison matrices in AHP. Eur J Oper Res 171(1):290–295
Barnett, M., Gatfield, D., Peckan, C. (2006) “Non-technical skills: the vital ingredient in world maritime technology”, London; Institute of Marine Engineering, Science and Technology (IMarEST)
Civil Aviation Authority (CAA) “Crew Resource Management Training” https://www.caa.co.uk/Safety-initiatives-and-resources/Working-with-industry/Human-factors/Human-factors/ [Accessed 3 Feb. 2016]
Cohen SG, Bailey DE (1997) What makes teams work, group effectiveness research from the shop floor to the executive suite. J Manag 23(3):239–290
Coyle, G. (2004) “The analytic hierarchy process (AHP)”, practical strategy, Open Access Material AHP, Pearson Education Limited
Crichton MT, Flin R (2004) Identifying and training non-technical skills of nuclear emergency response teams. Ann Nucl Energy 31:1317–1330
Dempster AP (1967) Upper and lower probabilities induced by a multivalued mapping. Ann Math Stat 38(2):325–339
Endsley MR (1995) Towards a theory of situation awareness in dynamic systems. Hum Factors 37(1):32–64
Fiedler FE (1995) Cognitive resources and leadership performance. Appl Psychol 44(1):5–28
Fletcher, G., Flin, R and Mcgeorge, P. (2003a) “Review of human factors research in anaesthesia”, University of Aberdeen SCPMDE Project: RDNES/991/C
Flin R, Martin L, Geosters K, Hoermann J, Amalberti R, Valot C, Nijhuis H (2003a) Development of the NOTECHS (non-technical skills) system for assessing pilots’ CRM skills. Hum Factors Aerosp Saf 3(2):95–117
Flin R, Martin L, Geosters K, Hoermann J, Amalberti R, Valot C, Nijhuis H (2003b) Development of the NOTECHS (non-technical skills) system for assessing pilots’ CRM skills. Hum Factors Aerosp Saf 3(2):95–117
Flin R, O’Connor P, Crichton M (2008) Safety at the sharp end. Ashgate Publishing Limited, Abingdon
Flin, R, Winter, J, Sarac, C and Raduma, M (2009) Human factors in patient safety: review of topics and tools. Report for methods and measures working group of WHO patient safety: World Health Organization
Gatfield D (2008) “Behavioural markers for the assessment of competence in crisis management”. In: PhD Thesis. Southampton Solent University,, United Kingdom
Goulielmos AM, Lathouraki G, Giziakis C (2012) “The quest of marine accidents due to human error, 1998–2011”. Int J Emerg Serv 1(1):39–70
Grech MR, Horberry T, Smith A (2002) Human error in maritime operations: analysis of accident reports using the Leximancer tool. Proceedings of the Human factors and Ergonomics society 46th annual meeting, Baltimore September 30-October 4, 2002
Gregory D, Shanahan P (2010) The human element guide to human behaviour in the shipping industry. United Kingdom Maritime and Coastguard Agency (MCA), Southampton
Habberley J, Barnett M, Gatfield D, Musselwhite C, Mcneil G (2001) “Simulator training for handling escalating emergencies”, United Kingdom Maritime and Coastguard Agency (MCA), Research Project 467
Havold JI (2000) “Culture in maritime safety”. J Marit Policy Manag 27(1):79–88
Helmreich RL, Merritt AC, Wilhelm JA (1999) The evolution of crew resource management training in commercial aviation. Int J Aviat Psychol 9(1):19–32
International Association of Maritime Universities (2010) “Review of manila amendments”, presented at the IAMU annual general assembly 14-18th October 2010, Pusan, Korea.
Ishizaka A, Labib A (2009) Analytic hierarchy process and expert choice: benefits and limitations. OR Insights 22(4):201–220
Kern AT (2001) “Controlling pilot error: culture, environment and crew resource management”, controlling pilot error series. McGraw-Hill Professional, New York
MNTB (2012) Human element leadership and management–operational and management levels. 1st edition, Merchant Navy Training Board
Pillay A, Wang J (2003) A risk ranking approach incorporating fuzzy set theory and grey theory. Reliab Eng Syst Saf 79(1):61–67
Registro Italiano Navale (1996) Class booklet. Registro Italiano Navale (RINA) Classification Society, Geneva
Riahi R, Bonsall S, Jenkinson I, Wang J (2012) “A seafarer’s reliability assessment incorporating subjective judgements”, proceedings of the institution of mechanical engineers. Part M: J Eng Marit Environ 226(4):313–334
Saaty TL (1980) The analytic hierarchy process. McGraw-Hill, New York
Saaty TL (1990) How to make decisions: the analytic hierarchy process. J Oper Res 48(1):9–26
Saaty TL (2008) Decision making with the analytic hierarchy process. Int J Serv Sci 1(1):83–98
Salas E, Burke CS, Stagl KC (2004) Developing teams and team leaders: strategies and principles. In: Day DV, Zaccaro SJ, Halpin SM (eds) Leader development for transforming organizations: growing leaders for tomorrow, series in applied psychology. Lawrence Erlbaum Associates, Mahwah, pp. 325–355
Salmon PM, Stanton NA, Walker GH, Jenkins DP (2009) Distributed situation awareness: theory, measurement and application to teamwork. Ashgate Publishing Limited, Abingdon
Shafer G (1976) A mathematical theory of evidence. Princeton University Press, Princeton
Smith RD (2001) “controlling pilot error: controlled flight into terrain (CFIT/CFTT)”, controlling pilot error series. McGraw-Hill Professional, New York
Stanton N (1996) Team performance: communication, co-ordination, co-operation and control. In: Stanton N (ed) Human factors in nuclear safety. Taylor and Francis, Philadelphia, pp. 197–215
West MA (2012) Effective teamwork, practical lessons from organizational research. BPS Blackwell, Chichester
Yule S, Flin R, Peterson-Brown S, Maran N, Rowley D (2006) Development of a rating system for surgeons’ non-technical skills. Med Educ 40:1098–1104