Assessing suturing skills in a self-guided learning setting: absolute symmetry error
Tóm tắt
Directed self-guidance, whereby trainees independently practice a skill-set in a structured setting, may be an effective technique for novice training. Currently, however, most evaluation methods require an expert to be present during practice. The study aim was to determine if absolute symmetry error, a clinically important measure that can be assessed by the trainee, is a feasible assessment tool for self-guided learning of suturing skill. Forty-eight undergraduate medical trainees independently practiced suturing and knot tying skills using a benchtop model. Performance on a pretest, posttest, retention test and a transfer test was assessed using (1) the validated final product analysis (FPA), (2) the surgical efficiency score (SES), a combination of the FPA and hand motion analysis and (3) absolute symmetry error, a new measure that assesses the symmetry of the final product. Absolute symmetry error, along with the other objective assessment tools, detected improvements in performance from pretest to posttest (P < 0.05). A battery of correlation analyses indicated that absolute symmetry error correlates moderately with the FPA and SES. The development of valid, reliable and feasible technical skill assessments is needed to ensure all training centers evaluate trainee performance in a standardized fashion. Measures that do not require the use of experts or computers have potential for widespread use. We suggest that absolute symmetry error is a useful approximation of novices’ suturing and knot tying performance. Future research should evaluate whether absolute symmetry error can enhance learning when used as a source of feedback during self-guided practice.
Tài liệu tham khảo
Aggarwal, R., & Darzi, A. (2006). Technical-skills training in the 21st century. The New England Journal of Medicine, 355, 2695–2696. doi:10.1056/NEJMe068179.
Brydges, R., Carnahan, H., & Dubrowski, A. (2008b, April). Can medical students self-regulate their learning? Use of an interactive instructional video to teach wound closure skills. (Paper presented at the Annual Meeting of the Association for Surgical Education, Toronto).
Brydges, R., Classen, R., Larmer, J., Xeroulis, G., & Dubrowski, A. (2006). Computer-assisted assessment of one-handed knot tying skills performed within various contexts: A construct validity study. American Journal of Surgery, 192, 109–113. doi:10.1016/j.amjsurg.2005.11.014.
Brydges, R., Kurahashi, A., Brummer, V., Satterthwaite, L., Classen, R., & Dubrowski, A. (2008a). Developing criteria for proficiency-based training of surgical technical skills using simulation: Changes in performances as a function of training year. Journal of the American College of Surgeons, 206, 205–211. doi:10.1016/j.jamcollsurg.2007.07.045.
Brydges, R., Sidhu, R., Park, J., & Dubrowski, A. (2007). Construct validity of computer-assisted assessment: Quantification of movement processes during a vascular anastomosis on a live porcine model. American Journal of Surgery, 193, 523–529. doi:10.1016/j.amjsurg.2006.08.076.
Datta, V., Bann, S., Mandalia, M., & Darzi, A. (2006). The surgical efficiency score: A feasible, reliable, and valid method of skills assessment. American Journal of Surgery, 192, 372–378. doi:10.1016/j.amjsurg.2006.06.001.
Datta, V., Chang, A., Mackay, S., & Darzi, A. (2002). The relationship between motion analysis and surgical technical assessments. American Journal of Surgery, 184, 70–73. doi:10.1016/S0002-9610(02)00891-7.
Datta, V., Mackay, S., Mandalia, M., & Darzi, A. (2001). The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model. Journal of the American College of Surgeons, 193, 479–485. doi:10.1016/S1072-7515(01)01041-9.
Dubrowski, A. (2005). Performance versus learning curves—what is motor learning and how is it measured? Surgical Endoscopy and Other Interventional Techniques, 19, 1290.
Fraser, S. A., Klassen, D. R., Feldman, L. S., Ghitulescu, G. A., Stanbridge, D., & Fried, G. M. (2003). Evaluating laparoscopic skills: Setting the pass/fail score for the MISTELS system. Surgical Endoscopy, 17, 964–967. doi:10.1007/s00464-002-8828-4.
Gallagher, A., Ritter, E., Champion, H., Higgins, G., Fried, M., Moses, G., et al. (2005). Virtual reality simulation for the operating room: Proficiency-based training as a paradigm shift in surgical skills training. Annals of Surgery, 241, 364–372. doi:10.1097/01.sla.0000151982.85062.80.
Hamstra, S. J., Dubrowski, A., & Backstein, D. (2006). Teaching technical skills to surgical residents—A survey of empirical research. Clinical Orthopaedics and Related Research, 449, 108–115. doi:10.1097/01.blo.0000224058.09496.34
Hanna, G. B., Frank, T. G., & Cuschieri, A. (1997). Objective assessment of endoscopic knot quality. American Journal of Surgery, 174, 410–413. doi:10.1016/S0002-9610(97)00129-3.
Ivy, J. J., Unger, J. B., Hurt, J., & Mukherjee, D. (2004). The effect of number of throws on knot security with nonidentical sliding knots. American Journal of Obstetrics and Gynecology, 191, 1618–1620. doi:10.1016/j.ajog.2004.05.029.
Leming, J. K., Dorman, K., Brydges, R., Carnahan, H., & Dubrowski, A. (2007). Tensiometry as a measure of improvement in knot quality in undergraduate medical students. Advances in Health Sciences Education: Theory and Practice, 12, 331–344. doi:10.1007/s10459-006-9005-7.
Moorthy, K., Munz, Y., Sarker, S. K., & Darzi, A. (2003). Objective assessment of technical skills in surgery. British Medical Journal, 327, 1032–1037. doi:10.1136/bmj.327.7422.1032.
Porte, M. C., Xeroulis, G., Reznick, R. K., & Dubrowski, A. (2007). Verbal feedback from an expert is more effective than self-accessed feedback about motion efficiency in learning new surgical skills. American Journal of Surgery, 193, 105–110. doi:10.1016/j.amjsurg.2006.03.016.
Reznick, R. K., & MacRae, H. (2006). Teaching surgical skills—changes in the wind. The New England Journal of Medicine, 355, 2664–2669. doi:10.1056/NEJMra054785.
Reznick, R., Regehr, G., MacRae, H., Martin, J., & McCulloch, W. (1997). Testing technical skill via an innovative ‘‘bench station’’ examination. American Journal of Surgery, 173, 226–230. doi:10.1016/S0002-9610(97)89597-9.
Schmidt, R. A., & Lee, T. D. (2005). Motor control and learning: A behavioral emphasis (3rd ed.). IL, Champaign: Human Kinetics.
Scott, D. J., Goova, M. T., & Tesfay, S. T. (2007). A cost-effective proficiency-based knot-tying and suturing curriculum for residency programs. The Journal of Surgical Research, 141, 7–15. doi:10.1016/j.jss.2007.02.043.
Stefanidis, D., Korndorffer, J. R., Markley, S., Sierra, R., & Scott, D. J. (2006). Proficiency maintenance: Impact of ongoing simulator training on laparoscopic skill retention. Journal of the American College of Surgeons, 202, 599–603. doi:10.1016/j.jamcollsurg.2005.12.018.
Stefanidis, D., Scerbo, M. W., Korndorffer, J. R., Jr, & Scott, D. J. (2007). Redefining simulator proficiency using automaticity theory. American Journal of Surgery, 193, 502–506. doi:10.1016/j.amjsurg.2006.11.010.
Szalay, D., MacRae, H., Regehr, G., & Reznick, R. (2000). Using operative outcome to assess technical skill. American Journal of Surgery, 180, 234–237. doi:10.1016/S0002-9610(00)00470-0.