Effective in-service training design and delivery: evidence from an integrative literature review

Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, Fineberg H, Garcia P, Ke Y, Kelley P, Kistnasamy B, Meleis A, Naylor D, Pablos-Mendez A, Reddy S, Scrimshaw S, Sepulveda J, Serwadda D, Zurayk H: Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. 2010, 376 (9756): 1923-1958. 10.1016/S0140-6736(10)61854-5.

Wittemore R, Kanfl K: The integrative review: updated methodology. In J Adv Nursing. 2005, 52 (5): 546-553. 10.1111/j.1365-2648.2005.03621.x.

Marinopoulos SS, Baumann MH: American College of Chest Physicians Health and Science Policy Committee: Methods and definition of terms: effectiveness of continuing medical education: American College of Chest Physicians Evidence-Based Educational Guidelines. Chest. 2009, 135 (3 Suppl): 17S-28S.

Oxford Centre for Evidence-Based Medicine (OCEBM) Levels of Evidence Working Group: The Oxford 2011 Levels of Evidence. 2011, Oxford: Centre for Evidence Based Medicine, http://www.cebm.net/?O=1025 ,

Best Evidence in Medical Education (BEME): Appendix 1-BEME Coding Sheet. 2011, http://www.medicalteacher.org/MEDTEACH_wip/supp%20files/BEME%204%20Figs%20%20Appendices/BEME4_Appx1.pdf ,

Marinopoulos SS, Dorman T, Ratanawongsa N, Wilson LM, Ashar BH, Magaziner JL, Miller RG, Thomas PA, Prokopowicz GP, Qayyum R, Bass EB: Effectiveness of continuing medical education. Evidence Report/Technology Assessment, No. 149, (Prepared by the Johns Hopkins Evidence-based Practice Center, under Contract No.290-02-0018) AHRQ Publication No. -7-E006. January 2007, Agency for Healthcare Research and Quality: Rockville, MD

Triola M, Feldman H, Kalet AL, Zabar S, Kachur EK, Gillespie C, Anderson M, Griesser C, Lipkin M: A randomized trial of teaching clinical skills using virtual and live standardized patients. J Gen Intern Med. 2006, 21 (5): 424-429. 10.1111/j.1525-1497.2006.00421.x.

Smits PB, De Buisonje CD, Verbeek JH, Van Dijk FJ, Metz JC, Ten Cate OJ: Problem-based learning versus lecture-based learning in postgraduate medical education. Scand J Work Environ Health. 2003, 29 (4): 280-287. 10.5271/sjweh.732.

White M, Michaud G, Pachev G, Lirenman D, Kolenc A, FitzGerald JM: Randomized trial of problem-based versus didactic seminars for disseminating evidence-based guidelines on asthma management to primary care physicians. J ContinEduc Health Prof. 2004, 24 (4): 237-243. 10.1002/chp.1340240407.

De Lorenzo RA, Abbott CA: Effectiveness of an adult-learning, self-directed model compared with traditional lecture-based teaching methods in out-of-hospital training. Acad Emerg Med. 2004, 11 (1): 33-37.

Lin CF, Lu MS, Chung CC, Yang CM: A comparison of problem-based learning and conventional teaching in nursing ethics education. Nurs Ethics. 2010, 17 (3): 373-382. 10.1177/0969733009355380.

Reynolds A, Ayres-de-Campos D, Pereira-Cavaleiro A, Ferreira-Bastos L: Simulation for teaching normal delivery and shoulder dystocia to midwives in training. Educ Health (Abingdon). 2010, 23 (3): 405-

Alvarez MP, Agra Y: Systematic review of educational interventions in palliative care for primary care physicians. Palliat Med. 2006, 20 (7): 673-683. 10.1177/0269216306071794.

Bloom BS: Effects of continuing medical education on improving physician clinical care and patient health: a review of systematic reviews. Int J Technol Assess Health Care. 2005, 21 (3): 380-385.

Satterlee WG, Eggers RG, Grimes DA: Effective medical education: insights from the Cochrane Library. Obstet Gynecol Surv. 2008, 63 (5): 329-333. 10.1097/OGX.0b013e31816ff661.

Herbert CP, Wright JM, Maclure M, Wakefield J, Dormuth C, Brett-MacLean P, Legare J, Premi J: Better Prescribing Project: a randomized controlled trial of the impact of case-based educational modules and personal prescribing feedback on prescribing for hypertension in primary care. Fam Pract. 2004, 21 (5): 575-581. 10.1093/fampra/cmh515.

Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ: Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005, 27 (1): 10-28. 10.1080/01421590500046924.

Raza A, Coomarasamy A, Khan KS: Best evidence continuous medical education. Arch Gynecol Obstet. 2009, 280 (4): 683-687. 10.1007/s00404-009-1128-7.

Akl EA, Pretorius RW, Sackett K, Erdley WS, Bhoopathi PS, Alfarah Z, Schunemann HJ: The effect of educational games on medical students’ learning outcomes: a systematic review: BEME Guide No 14. Med Teach. 2010, 32 (1): 16-27. 10.3109/01421590903473969.

Laprise R, Thivierge R, Gosselin G, Bujas-Bobanovic M, Vandal S, Paquette D, Luneau M, Julien P, Goulet S, Desaulniers J, Maltais P: Improved cardiovascular prevention using best CME practices: a randomized trial. J Contin Educ Health Prof. 2009, 29 (1): 16-31. 10.1002/chp.20002.

Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, Davis D, Odgaard-Jensen J, Oxman AD: Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009, 2: CD003030-

Mansouri M, Lockyer J: A meta-analysis of continuing medical education effectiveness. J Contin Educ Health Prof. 2007, 27 (1): 6-15. 10.1002/chp.88.

Perry M, Draskovic I, Lucassen P, Vernooij-Dassen M, Van Achterberg T, Rikkert MO: Effects of educational interventions on primary dementia care: A systematic review. Int J Geriatr Psychiatr. 2011, 26 (1): 1-11. 10.1002/gps.2479.

Rampatige R, Dunt D, Doyle C, Day S, Van Dort P: The effect of continuing professional education on health care outcomes: lessons for dementia care. Int Psychogeriatr. 2009, 21 (Suppl 1): S34-S43.

Blaya JA, Fraser HS, Holt B: E-health technologies show promise in developing countries. Health Aff (Millwood). 2010, 29 (2): 244-251. 10.1377/hlthaff.2009.0894.

Leung GM, Johnston JM, Tin KY, Wong IO, Ho LM, Lam WW, Lam TH: Randomised controlled trial of clinical decision support tools to improve learning of evidence-based medicine in medical students. BMJ. 2003, 327 (7423): 1,090-

You JS, Park S, Chung SP, Park JW: Usefulness of a mobile phone with video telephony in identifying the correct landmark for performing needle thoracocentesis. Emerg Med J. 2009, 26 (3): 177-179. 10.1136/emj.2008.060541.

Yuan H, Williams BA, Fan L: A systematic review of selected evidence on developing nursing students’ critical thinking through problem-based learning. Nurse Educ Today. 2008, 28 (6): 657-663. 10.1016/j.nedt.2007.12.006.

Zurovac D, Sudoi RK, Akhwale WS, Ndiritu M, Hamer DH, Rowe AK, Snow RW: The effect of mobile phone text-message reminders on Kenyan health workers’ adherence to malaria treatment guidelines: a cluster randomised trial. Lancet. 2011, 378 (9793): 795-803. 10.1016/S0140-6736(11)60783-6.

Murad MH, Coto-Yglesias F, Varkey P, Prokop LJ, Murad AL: The effectiveness of self-directed learning in health professions education: a systematic review. Med Educ. 2010, 44 (11): 1,057-1,068.

Young JM, Ward J: Can distance learning improve smoking cessation advice in family practice? A randomized trial. J Contin Educ Health Prof. 2002, 22 (2): 84-93. 10.1002/chp.1340220204.

Harder BN: Use of simulation in teaching and learning in health sciences: a systematic review. J Nurs Educ. 2010, 49 (1): 23-28. 10.3928/01484834-20090828-08.

McGaghie WC, Siddall VJ, Mazmanian PE, Myers J: American College of Chest Physicians Health and Science Policy Committee: Lessons for continuing medical education from simulation research in undergraduate and graduate medical education: effectiveness of continuing medical education: American College of Chest Physicians Evidence-Based Educational Guidelines. Chest. 2009, 135 (3 Suppl): 62S-68S.

Sturm LP, Windsor JA, Cosman PH, Cregan P, Hewett PJ, Maddern GJ: A systematic review of skills transfer after surgical simulation training. Ann Surg. 2008, 248 (2): 166-179. 10.1097/SLA.0b013e318176bf24.

Steadman RH, Coates WC, Huang YM, Matevosian R, Larmon BR, McCullough L, Ariel D: Simulation-based training is superior to problem-based learning for the acquisition of critical assessment and management skills. Crit Care Med. 2006, 34 (1): 151-157. 10.1097/01.CCM.0000190619.42013.94.

Lamb D: Could simulated emergency procedures practised in a static environment improve the clinical performance of a Critical Care Air Support Team (CCAST)? A literature review. Intensive Crit Care Nurs. 2007, 23 (1): 33-42. 10.1016/j.iccn.2006.07.002.

Bruppacher HR, Alam SK, LeBlanc VR, Latter D, Naik VN, Savoldelli GL, Mazer CD, Kurrek MM, Joo HS: Simulation-based training improves physicians’ performance in patient care in high-stakes clinical setting of cardiac surgery. Anesthesiology. 2010, 112 (4): 985-992. 10.1097/ALN.0b013e3181d3e31c.

Daniels K, Arafeh J, Clark A, Waller S, Druzin M, Chueh J: Prospective randomized trial of simulation versus didactic teaching for obstetrical emergencies. Simul Healthc. 2010, 5 (1): 40-45. 10.1097/SIH.0b013e3181b65f22.

Ellis D, Crofts JF, Hunt LP, Read M, Fox R, James M: Hospital, simulation center, and teamwork training for eclampsia management: a randomized controlled trial. Obstet Gynecol. 2008, 111 (3): 723-731. 10.1097/AOG.0b013e3181637a82.

Hamilton R: Nurse’s knowledge and skill retention following cardiopulmonary resuscitation training: a review of the literature. J Adv Nurs. 2005, 51 (3): 288-297. 10.1111/j.1365-2648.2005.03491.x.

Merien AE, Van de Ven J, Mol BW, Houterman S, Oei SG: Multidisciplinary team training in a simulation setting for acute obstetric emergencies: a systematic review. Obstet Gynecol. 2010, 115 (5): 1,021-1,031.

Crofts JF, Ellis D, Draycott TJ, Winter C, Hunt LP, Akande VA: Change in knowledge of midwives and obstetricians following obstetric emergency training: a randomised controlled trial of local hospital, simulation centre and teamwork training. BJOG. 2007, 114 (12): 1,534-1,541.

Kerfoot BP, Fu Y, Baker H, Connelly D, Ritchey ML, Genega EM: Online spaced education generates transfer and improves long-term retention of diagnostic skills: a randomized controlled trial. J Am Coll Surg. 2010, 211 (3): 331-337. 10.1016/j.jamcollsurg.2010.04.023.

Kerfoot BP, Kearney MC, Connelly D, Ritchey ML: Interactive spaced education to assess and improve knowledge of clinical practice guidelines: a randomized controlled trial. Ann Surg. 2009, 249 (5): 744-749. 10.1097/SLA.0b013e31819f6db8.

Kerfoot BP, Baker HE, Koch MO, Connelly D, Joseph DB, Ritchey ML: Randomized, controlled trial of spaced education to urology residents in the United States and Canada. J Urol. 2007, 177 (4): 1,481-1,487.

Coomarasamy A, Khan KS: What is the evidence that postgraduate teaching in evidence based medicine changes anything? A systematic review. BMJ. 2004, 329 (7473): 1,017-

Harrington SS, Walker BL: The effects of computer-based training on immediate and residual learning of nursing facility staff. J Contin Educ Nurs. 2004, 35 (4): 154-163. quiz 186–7

Curran VR, Fleet L: A review of evaluation outcomes of web-based continuing medical education. Med Educ. 2005, 39 (6): 561-567. 10.1111/j.1365-2929.2005.02173.x.

Choa M, Park I, Chung HS, Yoo SK, Shim H, Kim S: The effectiveness of cardiopulmonary resuscitation instruction: animation versus dispatcher through a cellular phone. Resuscitation. 2008, 77 (1): 87-94. 10.1016/j.resuscitation.2007.10.023.

Farmer AP, Legare F, Turcot L, Grimshaw J, Harvey E, McGowan JL, Wolf F: Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2008, 3: CD004398-

Liaw ST, Sulaiman ND, Barton CA, Chondros P, Harris CA, Sawyer S, Dharmage SC: An interactive workshop plus locally adapted guidelines can improve general practitioners asthma management and knowledge: a cluster randomised trial in the Australian setting. BMC Fam Pract. 2008, 9: 22-10.1186/1471-2296-9-22.

Gysels M, Richardson A, Higginson IJ: Communication training for health professionals who care for patients with cancer: a systematic review of training methods. Support Care Canc. 2005, 13 (6): 356-366. 10.1007/s00520-004-0732-0.

Berkhof M, Van Rijssen HJ, Schellart AJ, Anema JR, Van der Beek AJ: Effective training strategies for teaching communication skills to physicians: an overview of systematic reviews. Patient Educ Couns. 2011, 84 (2): 152-162. 10.1016/j.pec.2010.06.010.

Rabol LI, Ostergaard D, Mogensen T: Outcomes of classroom-based team training interventions for multiprofessional hospital staff: A systematic review. Qual Saf Health Care. 2010, 19 (6): e27-10.1136/qshc.2009.037184.

Woolfolk AE: Educational Psychology. 2009, Upper Saddle River, NJ: Pearson/Merrill/Prentice Hall, 11

Mayer RE: Applying the science of learning to medical education. Med Educ. 2010, 44 (6): 543-549. 10.1111/j.1365-2923.2010.03624.x.

Gott S, Lesgold A: Competence in the workplace: how cognitive performance models and situated instruction can accelerate skill acquisition. Advances in Instructional Psychology, Volume 4. Edited by: Glaser R. 2000, Hillsdale, NJ: Erlbaum