Improved Accuracy in Optical Diagnosis of Colorectal Polyps Using Convolutional Neural Networks with Visual Explanations

Cronin, 2018, Annual report to the nation on the status of cancer, part i: national cancer statistics, Cancer, 124, 2785, 10.1002/cncr.31551 Sung, 2005, Increasing incidence of colorectal cancer in Asia: implications for screening, Lancet Oncol, 6, 871, 10.1016/S1470-2045(05)70422-8 Leslie, 2002, The colorectal adenoma-carcinoma sequence, Br J Surg, 89, 845, 10.1046/j.1365-2168.2002.02120.x Corley, 2014, Adenoma detection rate and risk of colorectal cancer and death, N Engl J Med, 370, 1298, 10.1056/NEJMoa1309086 Ponugoti, 2017, Risk of cancer in small and diminutive colorectal polyps, Dig Liver Dis, 49, 34, 10.1016/j.dld.2016.06.025 Lieberman, 2008, Polyp size and advanced histology in patients undergoing colonoscopy screening: implications for CT colonography, Gastroenterology, 135, 1100, 10.1053/j.gastro.2008.06.083 Rex, 2009, Narrow-band imaging without optical magnification for histologic analysis of colorectal polyps, Gastroenterology, 136, 1174, 10.1053/j.gastro.2008.12.009 Ponugoti, 2019, Disagreement between high confidence endoscopic adenoma prediction and histopathological diagnosis in colonic lesions </= 3 mm in size, Endoscopy, 51, 221, 10.1055/a-0831-2348 Shahidi, 2020, Use of endoscopic impression, artificial intelligence, and pathologist interpretation to resolve discrepancies from endoscopy and pathology analyses of diminutive colorectal polyps, Gastroenterology, 158, 783, 10.1053/j.gastro.2019.10.024 Hewett, 2012, Validation of a simple classification system for endoscopic diagnosis of small colorectal polyps using narrow-band imaging, Gastroenterology, 143, 599, 10.1053/j.gastro.2012.05.006 Ignjatovic, 2011, Development and validation of a training module on the use of narrow-band imaging in differentiation of small adenomas from hyperplastic colorectal polyps, Gastrointest Endosc, 73, 128, 10.1016/j.gie.2010.09.021 Vleugels, 2018, Effects of training and feedback on accuracy of predicting rectosigmoid neoplastic lesions and selection of surveillance intervals by endoscopists performing optical diagnosis of diminutive polyps, Gastroenterology, 154, 1682, 10.1053/j.gastro.2018.01.063 Misawa, 2016, Characterization of colorectal lesions using a computer-aided diagnostic system for narrow-band imaging endocytoscopy, Gastroenterology, 150, 1531, 10.1053/j.gastro.2016.04.004 Esteva, 2019, A guide to deep learning in healthcare, Nat Med, 25, 24, 10.1038/s41591-018-0316-z Litjens, 2017, A survey on deep learning in medical image analysis, Med Image Anal, 42, 60, 10.1016/j.media.2017.07.005 Shen, 2017, Deep learning in medical image analysis, Annu Rev Biomed Eng, 19, 221, 10.1146/annurev-bioeng-071516-044442 Topol, 2019, High-performance medicine: the convergence of human and artificial intelligence, Nat Med, 25, 44, 10.1038/s41591-018-0300-7 Mansour, 2018, Deep-learning-based automatic computer-aided diagnosis system for diabetic retinopathy, Biomed Eng Lett, 8, 41, 10.1007/s13534-017-0047-y Sayres, 2019, Using a deep learning algorithm and integrated gradients explanation to assist grading for diabetic retinopathy, Ophthalmology, 126, 552, 10.1016/j.ophtha.2018.11.016 Billah, 2018, Gastrointestinal polyp detection in endoscopic images using an improved feature extraction method, Biomed Eng Lett, 8, 69, 10.1007/s13534-017-0048-x Byrne, 2019, Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model, Gut, 68, 94, 10.1136/gutjnl-2017-314547 Chen, 2018, Accurate classification of diminutive colorectal polyps using computer-aided analysis, Gastroenterology, 154, 568, 10.1053/j.gastro.2017.10.010 Wang, 2018, Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy, Nat Biomed Eng, 2, 741, 10.1038/s41551-018-0301-3 Bae, 2019, Improved real-time optical diagnosis of colorectal polyps following a comprehensive training program, Clin Gastroenterol Hepatol, 17, 2479, 10.1016/j.cgh.2019.02.019 Pham H, Guan MY, Zoph B, et al. Efficient neural architecture search via parameter sharing. arXiv preprint 2018;arXiv:1802.03268. Selvaraju RR, Cogswell M, Das A, et al. Grad-cam: visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, 2017, pp. 618–626. Szegedy C, Vanhoucke V, Ioffe S, et al. Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, 2016, pp. 2818–2826. Ung Lee, 2019, Reliability and validity of Korean version of GRIT, Anxiety and Mood, 15, 53 Duckworth, 2007, Grit: perseverance and passion for long-term goals, J Pers Soc Psychol, 92, 1087, 10.1037/0022-3514.92.6.1087 Dam, 2019, The relationship between grit, burnout, and well-being in emergency medicine residents, AEM Educ Train, 3, 14, 10.1002/aet2.10311 Mori, 2016, Impact of an automated system for endocytoscopic diagnosis of small colorectal lesions: an international web-based study, Endoscopy, 48, 1110, 10.1055/s-0042-113609 Chaput, 2011, Risk factors for advanced adenomas amongst small and diminutive colorectal polyps: a prospective monocenter study, Dig Liver Dis, 43, 609, 10.1016/j.dld.2011.02.002 Mori, 2017, Computer-aided diagnosis for colonoscopy, Endoscopy, 49, 813, 10.1055/s-0043-109430 Deng J, Dong W, Socher R, et al. Imagenet:, 2009, 248 Wang, 2017, The effectiveness of data augmentation in image classification using deep learning, Convolutional Neural Networks Vis. Recognit, 11 Castro E, Cardoso JS, Pereira JC. Elastic deformations for data augmentation in breast cancer mass detection. IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Las Vegas, NV, 2018, pp. 230–234. Urban, 2018, Deep learning localizes and identifies polyps in real time with 96% accuracy in screening colonoscopy, Gastroenterology, 155, 1069, 10.1053/j.gastro.2018.06.037 Castelvecchi, 2016, Can we open the black box of AI?, Nature, 538, 20, 10.1038/538020a Poplin, 2018, Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning, Nat Biomed Eng, 2, 158, 10.1038/s41551-018-0195-0 Kuiper, 2012, Accuracy for optical diagnosis of small colorectal polyps in nonacademic settings, Clin Gastroenterol Hepatol, 10, 1016, 10.1016/j.cgh.2012.05.004 Rogart, 2008, Narrow-band imaging without high magnification to differentiate polyps during real-time colonoscopy: improvement with experience, Gastrointest Endosc, 68, 1136, 10.1016/j.gie.2008.04.035 Adebayo J, Gilmer J, Muelly M, et al. Sanity checks for saliency maps. In: Advances in Neural Information Processing Systems, 2018;9505-9515. Begoli, 2019, The need for uncertainty quantification in machine-assisted medical decision making, Nat Mach Intell, 1, 20, 10.1038/s42256-018-0004-1 Wagner J, Kohler JM, Gindele T, et al. Interpretable and fine-grained visual explanations for convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, 2019;9097-9107. Halliday, 2017, Grit and burnout in UK doctors: a cross-sectional study across specialties and stages of training, Postgrad Med J, 93, 389, 10.1136/postgradmedj-2015-133919 Miller-Matero, 2018, Grit: a predictor of medical student performance, Educ Health (Abingdon), 31, 109, 10.4103/efh.EfH_152_16 Salles, 2017, Grit as a predictor of risk of attrition in surgical residency, Am J Surg, 213, 288, 10.1016/j.amjsurg.2016.10.012 Kendall A, Gal Y. What uncertainties do we need in bayesian deep learning for computer vision? Advances in neural information processing systems, 2017;5574-5584. Castro E, Cardoso JS, Pereira JC. Elastic deformations for data augmentation i breast cancer mass detection. IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Las Vegas, NV, 2018, pp. 230–234. Zaremba W, Sutskever I, Vinyals O. Recurrent neural network regularization. arXiv preprint 2014;arXiv:1409.2329. Sutton, 1998 Zoph, 2018, Learning transferable architectures for scalable image recognition, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 8697 Kingma DP, Adam BJ. A method for stochastic optimization. arXiv preprint 2014;arXiv:1412.6980. Aurelio, 2019, Learning from imbalanced data sets with weighted cross-entropy function, Neural Processing Letters, 50, 1937, 10.1007/s11063-018-09977-1 Selvaraju RR, Cogswell M, Das A, et al. Grad-cam: visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, 2017, pp. 618–626. Maaten, 2008, Visualizing data using t-SNE, J Mach Learn Res, 9, 2579