Diagnostic flexible pharyngo-laryngoscopy: development of a procedure specific assessment tool using a Delphi methodology
Tóm tắt
Proper training and assessment of skill in flexible pharyngo-laryngoscopy are central in the education of otorhinolaryngologists. To facilitate an evidence-based approach to curriculum development in this field, a structured analysis of what constitutes flexible pharyngo-laryngoscopy is necessary. Our aim was to develop an assessment tool based on this analysis. We conducted an international Delphi study involving experts from twelve countries in five continents. Utilizing reiterative assessment, the panel defined the procedure and reached consensus (defined as 80% agreement) on the phrasing of an assessment tool. Conclusion The gathering of validity evidence for assessment of core procedural skills within Otorhinolaryngology is central to the development of a competence-based education. The use of an international Delphi panel allows for the creation of an assessment tool which is widely applicable and valid. This work allows for an informed approach to technical skills training for flexible pharyngo-laryngoscopy and as further validity evidence is gathered allows for a valid assessment of clinical performance within this important skillset.
Tài liệu tham khảo
Garcia M (1854) Observations on the human voice. Proc R Soc Lond 7:399–410
Regionernes Lønnings- og Takstnævn (2015) Danske Reg [Internet]. http://www.rltn.dk
Sethi RKV, Kozin ED, Remenschneider AK, Lee DJ, Gray ST, Shrime MG et al (2014) Subspecialty emergency room as alternative model for otolaryngologic care: implications for emergency health care delivery. Am J Otolaryngol Head Neck Surg 35:758–765
Couch ME (2010) Cummings otolaryngology—head and neck surgery, Fifth Edit. Cummings Otolaryngology Head and Neck Surgery. Copyright © 2010, 2005, 1998, 1993, 1986 by Mosby, Inc. All Rights Reserved, pp 93–107
Paul BC, Rafii B, Achlatis S, Amin MR, Branski RC (2012) Morbidity and patient perception of flexible laryngoscopy. Ann Otol Rhinol Laryngol 121(11):708–713
Ongkasuwan J, Yung KC, Courey MS (2012) The physiologic impact of transnasal flexible endoscopy. Laryngoscope 122(6):1331–1334
Sethi RKV, Kozin ED, Remenschneider AK, Lee DJ, Gliklich RE, Shrime MG et al (2015) Otolaryngology-specific emergency room as a model for resident training. Laryngoscope 125(1):99–104
Reznick RK (1993) Teaching and testing technical skills. Am J Surg 165(3):358–361
Nasca TJ, Philibert I, Brigham T, Flynn TC (2012) The next GME accreditation system—rationale and benefits. N Engl J Med 366(11):1051–1056
Swing SR, Clyman SG, Holmboe ES, Williams RG (2009) Advancing resident assessment in graduate medical education. J Grad Med Educ 1(2):278–286
Ghaderi I, Manji F, Park YS, Juul D, Ott M, Harris I et al (2015) Technical skills assessment toolbox. Ann Surg 261(2):251–262
Messick S (1995) Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. Am Psychol 50(22):741–749
Cook D, Beckman TJ (2006) Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 119(2):166.e7–166.e16
Stefanidis D, Arora S, Parrack DM, Hamad GG, Capella J, Grantcharov T et al (2012) Research priorities in surgical simulation for the 21st century. Am J Surg 203(1):49–53
Robinson HF, Dennick R (2015) Teaching laryngeal endoscopy skills to speech and language therapists. Curr Opin Otolaryngol Head Neck Surg 23(3):197–201
Herrmann IF, Domagk D, Strahl M, Arens C (2016) The transnasal videopanendoscopy (ViP): diagnostics of the upper aerodigestive tract using an anatomically correct model from the model to the patient. Eur Arch Otorhinolaryngol 273(3):749–754
Laeeq K, Pandian V, Skinner M, Masood H, Stewart CM, Weatherly R et al (2010) Learning curve for competency in flexible laryngoscopy. Laryngoscope. 120(10):1950–1953
Brook CD, Platt MP, Russell K, Grillone G, Aliphas A, Noordzij JP (2015) Time to competency, reliability of flexible transnasal laryngoscopy by training level: A Pilot Study. Otolaryngol Head Neck Surg 152(5):843–850
Okoli C, Pawlowski SD (2004) The Delphi method as a research tool: an example, design considerations and applications. Inf Manag 42(1):15–29
de Villiers MR, de Villiers PJT, Kent AP (2005) The Delphi technique in health sciences education research. Med Teach 27(7):639–643
Murry JW, Hammons JO. Delphi (1995) A versatile methodology for conducting qualitative research. Rev High Educ 18(4):423–436
Keeney S, Hasson F, McKenna H (2006) Consulting the Oracle: ten lessons from using the Delphi techniques in nursing research. J Adv Nurs 53(2):205–212
Streiner DL, Norman GR, Cairney J (2015) Health measurement scales, vol 9. Oxford University Press, Oxford
Walsh CM, Ling SC, Khanna N, Cooper MA, Grover SC, May G et al (2014) Gastrointestinal endoscopy competency assessment tool: development of a procedure-specific assessment tool for colonoscopy. Gastrointest Endosc 79(5):798–807.e5
Madani A, Watanabe Y, Vassiliou M, Feldman LS, Duh QY, Singer MC et al (2016) Defining competencies for safe thyroidectomy: an international Delphi consensus. Surg (United States) 159(1):86–101
Maertens H, Aggarwal R, Macdonald S, Vermassen F, Van Herzeele I, Brodmann M et al (2016) Transatlantic multispecialty consensus on fundamental endovascular skills: results of a Delphi Consensus Study. Eur J Vasc Endovasc Surg 51(1):141–149
Downing S, Yudkowsky R (2009) Assessment in health professions education. Routledge, New York
Ilgen JS, Ma IWY, Hatala R, Cook D (2015) A systematic review of validity evidence for checklists versus global rating scales in simulation-based assessment. Med Educ 49:161–173
Tolsgaard MG, Todsen T, Sorensen JL, Ringsted C, Lorentzen T, Ottesen B et al (2013) International multispecialty consensus on how to evaluate ultrasound competence: a Delphi Consensus Survey. PLoS One 8(2):e57687. https://doi.org/10.1371/journal.pone.0057687
Thomas W (2006) Teaching and assessing surgical competence. Ann R Coll Surg Engl 88(5):429–432
Miller GE (1990) The assessment of clinical skills/competence/performance. Acad Med 65(9):63–67
Melchiors J, Todsen T, Nilsson P, Kohl AP, Bøttger M, Charabi B et al (2016) Self-directed simulation-based training of emergency cricothyroidotomy: a route to lifesaving skills. Eur Arch Otorhinolaryngol 273(12):4623–4628
Mcgaghie WC (2015) Mastery learning: it is time for medical education to join the 21st Century. Acad Med 90(11):1438–1441
Lineberry M, Soo Park Y, Cook D, Yudkowsky R (2015) Making the case for mastery learning assessments. Acad Med 90(11):1
Melchiors J, Todsen T, Nilsson P, Wennervaldt K, Charabi B, Bøttger M et al (2015) Preparing for emergency: a valid, reliable assessment tool for emergency cricothyroidotomy skills. Otolaryngol Head Neck Surg 152(2):260–265