Multi-Model Ensemble Deep Learning Method to Diagnose COVID-19 Using Chest Computed Tomography Images

Zhiming Wang1, Jingjing Dong2,3, Junpeng Zhang1
1College of Electrical Engineering, Sichuan University, Chengdu, China
2Key Laboratory of Aerospace Medicine of Ministry of Education, Air Force Medical University, Xi’an, China
3Lintong Rehabilitation and Recuperation Center, PLA Joint Logistic Support Force, Xi’an, China

Tóm tắt

Deep learning based analyses of computed tomography (CT) images contribute to automated diagnosis of COVID-19, and ensemble learning may commonly provide a better solution. Here, we proposed an ensemble learning method that integrates several component neural networks to jointly diagnose COVID-19. Two ensemble strategies are considered: the output scores of all component models that are combined with the weights adjusted adaptively by cost function back propagation; voting strategy. A database containing 8 347 CT slices of COVID-19, common pneumonia and normal subjects was used as training and testing sets. Results show that the novel method can reach a high accuracy of 99.37% (recall: 0.9981, precision: 0.989 3), with an increase of about 7% in comparison to single-component models. And the average test accuracy is 95.62% (recall: 0.958 7, precision: 0.955 9), with a corresponding increase of 5.2%. Compared with several latest deep learning models on the identical test set, our method made an accuracy improvement up to 10.88%. The proposed method may be a promising solution for the diagnosis of COVID-19.

Tài liệu tham khảo

AI T, YANG Z L, HOU H Y, et al. Correlation of chest CT and RT-PCR testing for coronavirus disease 2019 (COVID-19) in China: A report of 1014 cases [J]. Radiology, 2020, 296(2): E32–E40. ZHANG N R, WANG L L, DENG X Q, et al. Recent advances in the detection of respiratory virus infection in humans [J]. Journal of Medical Virology, 2020, 92(4): 408–417. HUANG C L, WANG Y M, LI X W, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China [J]. The Lancet, 2020, 395(10223): 497–506. CHUNG M, BERNHEIM A, MEI X Y, et al. CT imaging features of 2019 novel coronavirus (2019-nCoV) [J]. Radiology, 2020, 295(1): 202–207. ISMAEL A M, ŞENGÜR A. Deep learning approaches for COVID-19 detection based on chest X-ray images [J]. Expert Systems With Applications, 2021, 164: 114054. OH Y, PARK S, YE J C. Deep learning COVID-19 features on CXR using limited training data sets [J]. IEEE Transactions on Medical Imaging, 2020, 39(8): 2688–2700. LI L, QIN L, XU Z, et al. Using artificial intelligence to detect COVID-19 and community-acquired pneumonia based on pulmonary CT: Evaluation of the diagnostic accuracy [J]. Radiology, 2020, 296(2): E65–E71. RAHIMZADEH M, ATTAR A, SAKHAEI S M. A fully automated deep learning-based network for detecting COVID-19 from a new and large lung CT scan dataset [J]. Biomedical Signal Processing and Control, 2021, 68: 102588. SONG Y, ZHENG S J, LI L, et al. Deep learning enables accurate diagnosis of novel coronavirus (COVID-19) with CT images [J]. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 5361, PP(99): 1. BAI H X, WANG R, XIONG Z, et al. Artificial intelligence augmentation of radiologist performance in distinguishing COVID-19 from pneumonia of other origin at chest CT [J]. Radiology, 2021, 299(1): E225. SHI W Q, TONG L, ZHU Y D, et al. COVID-19 automatic diagnosis with radiographic imaging: Explainable attention transfer deep neural networks [J]. IEEE Journal of Biomedical and Health Informatics, 2021, 25(7): 2376–2387. LI J P, ZHAO G M, TAO Y L, et al. Multi-task contrastive learning for automatic CT and X-ray diagnosis of COVID-19 [J]. Pattern Recognition, 2021, 114: 107848. QIAN X L, FU H Z, SHI W Y, et al. M3 Lung-Sys: A deep learning system for multi-class lung pneumonia screening from CT imaging [J]. IEEE Journal of Biomedical and Health Informatics, 2020, 24(12): 3539–3550. ZHANG K, LIU X, SHEN J, et al. Clinically applicable AI system for accurate diagnosis, quantitative measurements, and prognosis of COVID-19 pneumonia using computed tomography [J]. Cell, 2020, 181(6): 1423–1433. POLIKAR R. Ensemble based systems in decision making [J]. IEEE Circuits and Systems Magazine, 2006, 6(3): 21–45. FOLINO F, FOLINO G, GUARASCIO M, et al. On learning effective ensembles of deep neural networks for intrusion detection [J]. Information Fusion, 2021, 72: 48–69. HANSEN L K, SALAMON P. Neural network ensembles [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990, 12(10): 993–1001. GUNRAJ H, WANG L, WONG A. COVIDNeT-Ct: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest CT images [J]. Frontiers in Medicine, 2020, 7: 608525. ZHAO J Y, HE X H, YANG X Y, et al. COVID-CT-dataset: A CT scan dataset about COVID-19 [EB/OL]. [2021-01-07]. https://arxiv.org/abs/2003.13865. SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition [EB/OL]. [2021-01-07]. https://arxiv.org/abs/1409.1556. HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition [C] //2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV: IEEE, 2016: 770–778. HUANG G, LIU Z, VAN DER MAATEN L, et al. Densely connected convolutional networks [C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, HI: IEEE, 2017: 2261–2269. HUANG G, LI Y X, PLEISS G, et al. Snapshot Ensembles: Train 1, get M for free [EB/OL]. [2021-01-07]. https://arxiv.org/abs/1704.00109.