Multi-Model Ensemble Deep Learning Method to Diagnose COVID-19 Using Chest Computed Tomography Images
Tóm tắt
Deep learning based analyses of computed tomography (CT) images contribute to automated diagnosis of COVID-19, and ensemble learning may commonly provide a better solution. Here, we proposed an ensemble learning method that integrates several component neural networks to jointly diagnose COVID-19. Two ensemble strategies are considered: the output scores of all component models that are combined with the weights adjusted adaptively by cost function back propagation; voting strategy. A database containing 8 347 CT slices of COVID-19, common pneumonia and normal subjects was used as training and testing sets. Results show that the novel method can reach a high accuracy of 99.37% (recall: 0.9981, precision: 0.989 3), with an increase of about 7% in comparison to single-component models. And the average test accuracy is 95.62% (recall: 0.958 7, precision: 0.955 9), with a corresponding increase of 5.2%. Compared with several latest deep learning models on the identical test set, our method made an accuracy improvement up to 10.88%. The proposed method may be a promising solution for the diagnosis of COVID-19.
Tài liệu tham khảo
AI T, YANG Z L, HOU H Y, et al. Correlation of chest CT and RT-PCR testing for coronavirus disease 2019 (COVID-19) in China: A report of 1014 cases [J]. Radiology, 2020, 296(2): E32–E40.
ZHANG N R, WANG L L, DENG X Q, et al. Recent advances in the detection of respiratory virus infection in humans [J]. Journal of Medical Virology, 2020, 92(4): 408–417.
HUANG C L, WANG Y M, LI X W, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China [J]. The Lancet, 2020, 395(10223): 497–506.
CHUNG M, BERNHEIM A, MEI X Y, et al. CT imaging features of 2019 novel coronavirus (2019-nCoV) [J]. Radiology, 2020, 295(1): 202–207.
ISMAEL A M, ŞENGÜR A. Deep learning approaches for COVID-19 detection based on chest X-ray images [J]. Expert Systems With Applications, 2021, 164: 114054.
OH Y, PARK S, YE J C. Deep learning COVID-19 features on CXR using limited training data sets [J]. IEEE Transactions on Medical Imaging, 2020, 39(8): 2688–2700.
LI L, QIN L, XU Z, et al. Using artificial intelligence to detect COVID-19 and community-acquired pneumonia based on pulmonary CT: Evaluation of the diagnostic accuracy [J]. Radiology, 2020, 296(2): E65–E71.
RAHIMZADEH M, ATTAR A, SAKHAEI S M. A fully automated deep learning-based network for detecting COVID-19 from a new and large lung CT scan dataset [J]. Biomedical Signal Processing and Control, 2021, 68: 102588.
SONG Y, ZHENG S J, LI L, et al. Deep learning enables accurate diagnosis of novel coronavirus (COVID-19) with CT images [J]. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 5361, PP(99): 1.
BAI H X, WANG R, XIONG Z, et al. Artificial intelligence augmentation of radiologist performance in distinguishing COVID-19 from pneumonia of other origin at chest CT [J]. Radiology, 2021, 299(1): E225.
SHI W Q, TONG L, ZHU Y D, et al. COVID-19 automatic diagnosis with radiographic imaging: Explainable attention transfer deep neural networks [J]. IEEE Journal of Biomedical and Health Informatics, 2021, 25(7): 2376–2387.
LI J P, ZHAO G M, TAO Y L, et al. Multi-task contrastive learning for automatic CT and X-ray diagnosis of COVID-19 [J]. Pattern Recognition, 2021, 114: 107848.
QIAN X L, FU H Z, SHI W Y, et al. M3 Lung-Sys: A deep learning system for multi-class lung pneumonia screening from CT imaging [J]. IEEE Journal of Biomedical and Health Informatics, 2020, 24(12): 3539–3550.
ZHANG K, LIU X, SHEN J, et al. Clinically applicable AI system for accurate diagnosis, quantitative measurements, and prognosis of COVID-19 pneumonia using computed tomography [J]. Cell, 2020, 181(6): 1423–1433.
POLIKAR R. Ensemble based systems in decision making [J]. IEEE Circuits and Systems Magazine, 2006, 6(3): 21–45.
FOLINO F, FOLINO G, GUARASCIO M, et al. On learning effective ensembles of deep neural networks for intrusion detection [J]. Information Fusion, 2021, 72: 48–69.
HANSEN L K, SALAMON P. Neural network ensembles [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990, 12(10): 993–1001.
GUNRAJ H, WANG L, WONG A. COVIDNeT-Ct: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest CT images [J]. Frontiers in Medicine, 2020, 7: 608525.
ZHAO J Y, HE X H, YANG X Y, et al. COVID-CT-dataset: A CT scan dataset about COVID-19 [EB/OL]. [2021-01-07]. https://arxiv.org/abs/2003.13865.
SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition [EB/OL]. [2021-01-07]. https://arxiv.org/abs/1409.1556.
HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition [C] //2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV: IEEE, 2016: 770–778.
HUANG G, LIU Z, VAN DER MAATEN L, et al. Densely connected convolutional networks [C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, HI: IEEE, 2017: 2261–2269.
HUANG G, LI Y X, PLEISS G, et al. Snapshot Ensembles: Train 1, get M for free [EB/OL]. [2021-01-07]. https://arxiv.org/abs/1704.00109.