An Embedded Multi-branch 3D Convolution Neural Network for False Positive Reduction in Lung Nodule Detection

Journal of Digital Imaging - Tập 33 - Trang 846-857 - 2020
Wangxia Zuo1,2, Fuqiang Zhou1, Yuzhu He1
1The School of Instrumentation and Optoelectronics Engineering, Beihang University, Beijing, China
2The College of Electrical Engineering, University of South China, Hengyang, China

Tóm tắt

Numerous lung nodule candidates can be produced through an automated lung nodule detection system. Classifying these candidates to reduce false positives is an important step in the detection process. The objective during this paper is to predict real nodules from a large number of pulmonary nodule candidates. Facing the challenge of the classification task, we propose a novel 3D convolution neural network (CNN) to reduce false positives in lung nodule detection. The novel 3D CNN includes embedded multiple branches in its structure. Each branch processes a feature map from a layer with different depths. All of these branches are cascaded at their ends; thus, features from different depth layers are combined to predict the categories of candidates. The proposed method obtains a competitive score in lung nodule candidate classification on LUNA16 dataset with an accuracy of 0.9783, a sensitivity of 0.8771, a precision of 0.9426, and a specificity of 0.9925. Moreover, a good performance on the competition performance metric (CPM) is also obtained with a score of 0.830. As a 3D CNN, the proposed model can learn complete and three-dimensional discriminative information about nodules and non-nodules to avoid some misidentification problems caused due to lack of spatial correlation information extracted from traditional methods or 2D networks. As an embedded multi-branch structure, the model is also more effective in recognizing the nodules of various shapes and sizes. As a result, the proposed method gains a competitive score on the false positive reduction in lung nodule detection and can be used as a reference for classifying nodule candidates.

Tài liệu tham khảo

Demir Ö, Yılmaz ÇA: Computer-aided detection of lung nodules using outer surface features. Biomed Mater Eng 26(s1):S1213–S1222, 2015 Teramoto A, Fujita H, Yamamuro O, Tamaki T: Automated detection of pulmonary nodules in PET/CT images: Ensemble false-positive reduction using a convolutional neural network technique. Med Phys 43(6):2821–2827, 2016 Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, van Riel S, Wille MW, Naqibullah M, Sanchez C, van Ginneken B: Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging,2016. https://doi.org/10.1109/TMI.2016.2536809 Setio AAA et al.: Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge. Med Image Anal 42:1–13, 2017 Le L, Devarakota P, Vikal S et al.: Computer Aided Diagnosis Using Multilevel Image Features on Large-Scale Evaluation. Lect Notes Comput Sci:161–174, 2013 Aggarwal P, Vig R, Sardana HK: Patient-Wise Versus Nodule-Wise Classification of Annotated Pulmonary Nodules using Pathologically Confirmed Cases. J Comput 8(9), 2013 Jacobs C, van Rikxoort EM, Twellmann T, Scholten ET, de Jong PA, Kuhnigk JM, Oudkerk M, de Koning HJ, Prokop M, Schaefer-Prokop C, van Ginneken B: Automatic detection of subsolid pulmonary nodules in thoracic computed tomography images. Med Image Anal 18:374–384, 2014 Setio AAA, Jacobs C, Gelderblom J, van Ginneken B: Automatic detection of large pulmonary solid nodules in thoracic CT images. Med Phys 42(10):5642–5653, 2015. https://doi.org/10.1118/1.4929562 Zagoruyko S, Komodakis N: Wide residual networks. arXiv preprint arXiv:arXiv:1605.07146, 2016 Anirudh R: Lung nodule detection using 3D convolutional neural networks trained on weakly labeled data[C]//. SPIE Medical Imaging:978532, 2016 Huang X, Shan J, Vaidya V: Lung nodule detection in CT using 3D convolutional neural networks[C]// IEEE, International Symposium on Biomedical Imaging. IEEE, 2017 Dou Q, Chen H, Yu L et al.: Multilevel contextual 3-D CNNs for false positive reduction in pulmonary nodule detection. IEEE Trans Biomed Eng 64(7):1558–1567, 2016 Ioffe S, Szegedy C: Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. 2015 Santurkar S, Tsipras D, Ilyas A, et al: How Does Batch Normalization Help Optimization?. 2018 Armato III, Samuel G, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP et al.: Data From LIDC-IDRI. Cancer Imaging Arch, 2015. https://doi.org/10.7937/K9/TCIA.2015.LO9QL9SX Armato, III SG, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, Zhao B, Aberle DR, Henschke CI, Hoffman EA, Kazerooni EA, MacMahon H, van Beek EJR, Yankelevitz D et al.: The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): A completed reference database of lung nodules on CT scans. Med Phys 38:915–931, 2011 Eman M, Nourhan Z, Mahmoud F: Automatic Classification of Normal and Cancer Lung CT Images Using Multiscale AM-FM Features. Int J Biomed Imaging 2015:1–7, 2015 Murphy K, van Ginneken B, Schilham AMR, de Hoop BJ, Gietema HA, Prokop M: A large scale evaluation of automatic pulmonary nodule detection in chest CT using local image features and k-nearest-neighbour classification. Med Image Anal 13:757–770, 2009 Shen W, Zhou M, Yang F, Yu D, Dong D, Yang C et al.: Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification. Pattern Recogn 61:663–673, 2017 Zhu W, et al: Deep lung: 3D deep convolutional nets for automated pulmonary nodule detection and classification, Arxiv 2017 [online]. Avaiable: arXiv: 1709.5538 Shen W, Zhou M, Yang F, Yang C, Tian J: Multi-scale Convolutional Neural Networks for Lung Nodule Classification. Inf Process Med Imaging 24:588–599, 2015 Yan X, Pang J, Qi H, Zhu Y, Bai C, Geng X, Liu M, Terzopoulos D, Ding X: Classification of lung nodule malignancy risk on computed tomography images using convolutional neural network: A comparison between 2d and 3d strategies. In ACCV, 2016 Farahani FV, Ahmadi A, Zarandi MHF: Lung nodule diagnosis from CT images based on ensemble learning[C]// Computational Intelligence in Bioinformatics & Computational Biology. IEEE, 2015 van Ginneken B, Armato SG, de Hoop B, van de Vorst S, Duindam T, Niemeijer M, Murphy K, Schilham AMR, Retico A, Fantacci ME, Camarlinghi N, Bagagli F, Gori I, Hara T, Fujita H, Gargano G, Belloti R, Carlo FD, Megna R, Tangaro S, Bolanos L, Cerello P, Cheran SC, Torres EL, Prokop M: Comparing and combining algorithms for computeraided detection of pulmonary nodules in computed tomography scans: the ANODE09 study. Med Image, 2010