Learning deliberate reflection in medical diagnosis: does learning-by-teaching help?
Tóm tắt
Deliberate reflection has been found to foster diagnostic accuracy on complex cases or under circumstances that tend to induce cognitive bias. However, it is unclear whether the procedure can also be learned and thereby autonomously applied when diagnosing future cases without instructions to reflect. We investigated whether general practice residents would learn the deliberate reflection procedure through ‘learning-by-teaching’ and apply it to diagnose new cases. The study was a two-phase experiment. In the learning phase, 56 general-practice residents were randomly assigned to one of two conditions. They either (1) studied examples of deliberate reflection and then explained the procedure to a fictitious peer on video; or (2) solved cases without reflection (control). In the test phase, one to three weeks later, all participants diagnosed new cases while thinking aloud. The analysis of the test phase showed no significant differences between the conditions on any of the outcome measures (diagnostic accuracy, p = .263; time to diagnose, p = .598; mental effort ratings, p = .544; confidence ratings, p = .710; proportion of contradiction units (i.e. measure of deliberate reflection), p = .544). In contrast to findings on learning-by-teaching from other domains, teaching deliberate reflection to a fictitious peer, did not increase reflective reasoning when diagnosing future cases. Potential explanations that future research might address are that either residents in the experimental condition did not apply the learned deliberate reflection procedure in the test phase, or residents in the control condition also engaged in reflection.
Tài liệu tham khảo
Atkinson, R. K., Derry, S. J., Renkl, A., & Wortham, D. (2000). Learning from examples: Instructional principles from the worked examples research. Review of Educational Research, 70(2), 181–214.
Brown, A. L., & Kane, M. J. (1988). Preschool children can learn to transfer: Learning to learn and learning from example. Cognitive Psychology, 20(4), 493–523. https://doi.org/10.1016/0010-0285(88)90014-X
Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Lawrence Erlbaum Associates.
Costa Filho, G. B., Moura, A. S., Brandão, P. R., Schmidt, H. G., & Mamede, S. (2019). Effects of deliberate reflection on diagnostic accuracy, confidence and diagnostic calibration in dermatology. Perspectives on Medical Education, 8(4), 230–236. https://doi.org/10.1007/s40037-019-0522-5
Dewey, J. (1910). How we think. D.C. Heath & Co.
Durning, S. J., Artino, A. R., Beckman, T. J., Graner, J., der Vleuten, C. V., et al. (2013). Does the think-aloud protocol reflect thinking? Exploring functional neuroimaging differences with thinking (answering multiple choice questions) versus thinking aloud. Medical Teacher, 35(9), 720–726. https://doi.org/10.3109/0142159x.2013.801938
Eva, K. W., Neville, A. J., & Norman, G. R. (1998). Exploring the etiology of content specificity: Factors influencing analogic transfer and problem solving. Academic Medicine, 73(10 Suppl), S1-5.
Fiorella, L., & Mayer, R. E. (2013). The relative benefits of learning by teaching and teaching expectancy. Contemporary Educational Psychology, 38(4), 281–288. https://doi.org/10.1016/j.cedpsych.2013.06.001
Fiorella, L., & Mayer, R. E. (2014). Role of expectations and explanations in learning by teaching. Contemporary Educational Psychology, 39(2), 75–85. https://doi.org/10.1016/j.cedpsych.2014.01.001
Graber, M. L., Franklin, N., & Gordon, R. (2005). Diagnostic error in internal medicine. Archives of Internal Medicine, 165(13), 1493–1499. https://doi.org/10.1001/archinte.165.13.1493
Hoogerheide, V., Deijkers, L., Loyens, S. M., & Heijltjes, A. (2016). Gaining from explaining: Learning improves from explaining to fictitious others on video, not from writing to them. Contemporary Educational Psychology, 44, 95–106.
Hoogerheide, V., Loyens, S. M. M., & Van Gog, T. (2014). Effects of creating video-based modeling examples on learning and transfer. Learning and Instruction, 33, 108–119. https://doi.org/10.1016/j.learninstruc.2014.04.005
Hoogerheide, V., Renkl, A., Fiorella, L., Paas, F., & Van Gog, T. (2019a). Enhancing example-based learning: Teaching on video increases arousal and improves problem-solving performance. Journal of Educational Psychology, 111(1), 45–56.
Hoogerheide, V., Visee, J., Lachner, A., & Van Gog, T. (2019b). Generating an instructional video as homework activity is both effective and enjoyable. Learning and Instruction, 64, 101226. https://doi.org/10.1016/j.learninstruc.2019.101226
Ibiapina, C., Mamede, S., Moura, A., Elói-Santos, S., & Van Gog, T. (2014). Effects of free, cued and modelled reflection on medical students’ diagnostic competence. Medical Education, 48, 796–805. https://doi.org/10.1111/medu.12435
Koh, A. W. L., Lee, S. C., & Lim, S. W. H. (2018). The learning benefits of teaching: A retrieval practice hypothesis. Applied Cognitive Psychology, 32(3), 401–410. https://doi.org/10.1002/acp.3410
Kuhn, J., van den Berg, P., Mamede, S., Zwaan, L., Diemers, A., et al. (2020). Can we teach reflective reasoning in general-practice training through example-based learning and learning by doing? Health Professions Education, 6(4), 506–515. https://doi.org/10.1016/j.hpe.2020.07.004
Lambe, K. A., Reilly, G., Kelly, B. D., & Curristan, S. (2016). Dual-process cognitive interventions to enhance diagnostic reasoning: A systematic review. BMJ Quality and Safety, 25(10), 808. https://doi.org/10.1136/bmjqs-2015-004417
Landis, J. R., & Koch, G. G. (1977). The Measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.
Mamede, S., Schmidt, H., Rikers, R., Custers, E., Splinter, T., et al. (2010a). Conscious thought beats deliberation without attention in diagnostic decision-making: At least when you are an expert. Psychological Research Psychologische Forschung, 74(6), 586–592.
Mamede, S., & Schmidt, H. G. (2014). Reflection in diagnostic reasoning: What really matters? Academic Medicine, 89(7), 959–960. https://doi.org/10.1097/acm.0000000000000306
Mamede, S., Schmidt, H. G., & Penaforte, J. C. (2008a). Effects of reflective practice on the accuracy of medical diagnoses. Medical Education, 42(5), 468–475.
Mamede, S., Schmidt, H. G., Rikers, R. M., Penaforte, J. C., & Coelho-Filho, J. M. (2008b). Influence of perceived difficulty of cases on physicians’ diagnostic reasoning. Academic Medicine, 83(12), 1210–1216. https://doi.org/10.1097/ACM.0b013e31818c71d7
Mamede, S., Schmidt, H. G., Rikers, R. M. J. P., Penaforte, J. C., & Coelho-Filho, J. M. (2007). Breaking down automaticity: Case ambiguity and the shift to reflective approaches in clinical reasoning. Medical Education, 41(12), 1185–1192. https://doi.org/10.1111/j.1365-2923.2007.02921.x
Mamede, S., Van Gog, T., Van den Berge, K., Rikers, R. M., Van Saase, J. L., et al. (2010b). Effect of availability bias and reflective reasoning on diagnostic accuracy among internal medicine residents. JAMA, 304(11), 1198–1203. https://doi.org/10.1001/jama.2010.1276
Mann, K., Gordon, J., & MacLeod, A. (2009). Reflection and reflective practice in health professions education: A systematic review. Advances in Health Science Education, 14(4), 595–621.
Meyer, B. J. F. (1975). The organization of prose and its effects on memory. (Amsterdam: North-Holland Publishing Co. American Elsevier Publishing Co.)
Meyer, A. N., Payne, V. L., Meeks, D. W., Rao, R., & Singh, H. (2013). Physicians’ diagnostic accuracy, confidence, and resource requests: A vignette study. JAMA Internal Medicine, 173(21), 1952–1958. https://doi.org/10.1001/jamainternmed.2013.10081
Monteiro, S., Sherbino, J., Sibbald, M., & Norman, G. (2020). Critical thinking, biases and dual processing: The enduring myth of generalisable skills. Medical Education, 54(1), 66–73. https://doi.org/10.1111/medu.13872
Ng, S. L., Kinsella, E. A., Friesen, F., & Hodges, B. (2015). Reclaiming a theoretical orientation to reflection in medical education research: A critical narrative review. Medical Education, 49(5), 461–475.
Norman, G. R. (1988). Problem-solving skills, solving problems and problem-based learning. Medical Education, 22(4), 279–286. https://doi.org/10.1111/j.1365-2923.1988.tb00754.x
Norman, G. R., Monteiro, S. D., Sherbino, J., Ilgen, J. S., Schmidt, H. G., et al. (2017). The causes of errors in clinical reasoning: Cognitive biases, knowledge deficits, and dual process thinking. Academic Medicine, 92(1), 23–30. https://doi.org/10.1097/acm.0000000000001421
Paas, F. G. W. C. (1992). Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. Journal of Educational Psychology, 84(4), 429–434.
Prakash, S., Sladek, R. M., & Schuwirth, L. (2019). Interventions to improve diagnostic decision making: A systematic review and meta-analysis on reflective strategies. Medical Teacher, 41(5), 517–524. https://doi.org/10.1080/0142159x.2018.1497786
Roediger, H. L., & Karpicke, J. D. (2006). The Power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1(3), 181–210.
Rummel, N., & Spada, H. (2005). Learning to collaborate: An instructional approach to promoting collaborative problem solving in computer-mediated settings. Journal of the Learning Sciences, 14(2), 201–241.
Schiefele, U. & Krapp, A. (1996). Topic interest and free recall of expository text. Learning and Individual Differences, 8 (2), 141–160. https://doi.org/10.1016/s1041-6080(96)90030-8
Schmidt, H. G., & Mamede, S. (2015). How to improve the teaching of clinical reasoning: A narrative review and a proposal. Medical Education, 49(10), 961–973. https://doi.org/10.1111/medu.12775
Schmidt, H. G., Mamede, S., Van Den Berge, K., Van Gog, T., Van Saase, J. L. C. M., et al. (2014). Exposure to media information about a disease can cause doctors to misdiagnose similar-looking clinical cases. Academic Medicine, 89(2).
Schmidt, H. G., Van Gog, T., Schuit, S. C. E., Van Den Berge, K., Van Daele, P. L. A., et al. (2017). Do patients’ disruptive behaviours influence the accuracy of a doctor’s diagnosis? A randomised experiment. BMJ Quality and Safety, 26(1), v19-23. https://doi.org/10.1136/bmjqs-2015-004109
Van Gog, T., & Paas, F. (2008). Instructional efficiency: Revisiting the original construct in educational research. Educational Psychologist, 43(1), 16–26. https://doi.org/10.1080/00461520701756248
Van Gog, T., & Rummel, N. (2010). Example-based learning: Integrating cognitive and social-cognitive research perspectives. Educational Psychology Review, 22(2), 155–174. https://doi.org/10.1007/s10648-010-9134-7
Van Gog, T., Rummel, N. & Renkl, A. (2019). Learning how to solve problems by studying examples. In: J. Dunlosky & K. A. Rawson (Eds.), The Cambridge Handbook of Cognition and Education. (pp. 183–208). Cambridge University Press)