Fully Automated Breast Density Segmentation and Classification Using Deep Learning

Diagnostics - Tập 10 Số 11 - Trang 988
Nasibeh Saffari1, Hatem A. Rashwan1, Mohamed Abdel‐Nasser2,1, Vivek Kumar Singh1, Meritxell Arenas3, Eleni Mangina4, Blas Herrera1, Domènec Puig1
1Intelligent Robotics and Computer Vision Group, Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, 43007 Tarragona, Spain
2Department of Electrical Engineering, Aswan University, Aswan 81542, Egypt
3Hospital Universitari Sant Joan de Reus, 43204, Reus, Spain
4School of Computer Science, University College Dublin, B2.05, Belfield, Dublin 4, Ireland

Tóm tắt

Breast density estimation with visual evaluation is still challenging due to low contrast and significant fluctuations in the mammograms’ fatty tissue background. The primary key to breast density classification is to detect the dense tissues in the mammographic images correctly. Many methods have been proposed for breast density estimation; nevertheless, most of them are not fully automated. Besides, they have been badly affected by low signal-to-noise ratio and variability of density in appearance and texture. This study intends to develop a fully automated and digitalized breast tissue segmentation and classification using advanced deep learning techniques. The conditional Generative Adversarial Networks (cGAN) network is applied to segment the dense tissues in mammograms. To have a complete system for breast density classification, we propose a Convolutional Neural Network (CNN) to classify mammograms based on the standardization of Breast Imaging-Reporting and Data System (BI-RADS). The classification network is fed by the segmented masks of dense tissues generated by the cGAN network. For screening mammography, 410 images of 115 patients from the INbreast dataset were used. The proposed framework can segment the dense regions with an accuracy, Dice coefficient, Jaccard index of 98%, 88%, and 78%, respectively. Furthermore, we obtained precision, sensitivity, and specificity of 97.85%, 97.85%, and 99.28%, respectively, for breast density classification. This study’s findings are promising and show that the proposed deep learning-based techniques can produce a clinically useful computer-aided tool for breast density analysis by digital mammography.

Từ khóa


Tài liệu tham khảo

Rashwan, 2015, Analysis of tissue abnormality and breast density in mammographic images using a uniform local directional pattern, Expert Syst. Appl., 42, 9499, 10.1016/j.eswa.2015.07.072

Abbas, 2016, DeepCAD: A computer-aided diagnosis system for mammographic masses using deep invariant features, Computers, 5, 28, 10.3390/computers5040028

Astley, 2018, A comparison of five methods of measuring mammographic density: A case-control study, Breast Cancer Res., 20, 10, 10.1186/s13058-018-0932-z

Keller, 2012, Estimation of breast percent density in raw and processed full field digital mammography images via adaptive fuzzy c-means clustering and support vector machine segmentation, Med. Phys., 39, 4903, 10.1118/1.4736530

Sprague, 2015, Benefits, harms, and cost-effectiveness of supplemental ultrasonography screening for women with dense breasts, Ann. Intern. Med., 162, 157, 10.7326/M14-0692

Wolfe, 1976, Breast patterns as an index of risk for developing breast cancer, Am. J. Roentgenol., 126, 1130, 10.2214/ajr.126.6.1130

Gram, 1997, The Tabar classification of mammographic parenchymal patterns, Eur. J. Radiol., 24, 131, 10.1016/S0720-048X(96)01138-2

McCormack, 2006, Breast density and parenchymal patterns as markers of breast cancer risk: A meta-analysis, Cancer Epidemiol. Prev. Biomarkers, 15, 1159, 10.1158/1055-9965.EPI-06-0034

Boyd, 1998, Mammographic densities and breast cancer risk, Cancer Epidemiol. Prev. Biomarkers, 7, 1133

Youk, 2016, Automated volumetric breast density measurements in the era of the BI-RADS fifth edition: A comparison with visual assessment, Am. J. Roentgenol., 206, 1056, 10.2214/AJR.15.15472

Lee, 2018, Automated mammographic breast density estimation using a fully convolutional network, Med. Phys., 45, 1178, 10.1002/mp.12763

Kwok, 2004, Automatic pectoral muscle segmentation on mediolateral oblique view mammograms, IEEE Trans. Med. Imaging, 23, 1129, 10.1109/TMI.2004.830529

Tzikopoulos, 2011, A fully automated scheme for mammographic segmentation and classification based on breast density and asymmetry, Comput. Methods Programs Biomed., 102, 47, 10.1016/j.cmpb.2010.11.016

Nickson, 2013, AutoDensity: An automated method to measure mammographic breast density that predicts breast cancer risk and screening outcomes, Breast Cancer Res., 15, R80, 10.1186/bcr3474

Kim, Y., Kim, C., and Kim, J.H. (2010). Automated Estimation of Breast Density on Mammogram Using Combined Information of Histogram Statistics and Boundary Gradients, International Society for Optics and Photonics. Medical Imaging 2010: Computer-Aided Diagnosis.

Rouhi, 2015, Benign and malignant breast tumors classification based on region growing and CNN segmentation, Expert Syst. Appl., 42, 990, 10.1016/j.eswa.2014.09.020

Nagi, J., Kareem, S.A., Nagi, F., and Ahmed, S.K. (December, January 30). Automated breast profile segmentation for ROI detection using digital mammograms. Proceedings of the 2010 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES), Kuala Lumpur, Malaysia.

Zwiggelaar, R. (2010). Local greylevel appearance histogram based texture segmentation. International Workshop on Digital Mammography, Springer.

Oliver, 2010, A statistical approach for breast density segmentation, J. Digit. Imaging, 23, 527, 10.1007/s10278-009-9217-5

Matsuyama, 2020, Using a Wavelet-Based and Fine-Tuned Convolutional Neural Network for Classification of Breast Density in Mammographic Images, Open J. Med Imaging, 10, 17, 10.4236/ojmi.2020.101002

Gandomkar, 2019, BI-RADS density categorization using deep neural networks, Medical Imaging 2019: Image Perception, Observer Performance, and Technology Assessment, Volume 10952, 109520N

Lehman, 2019, Mammographic breast density assessment using deep learning: Clinical implementation, Radiology, 290, 52, 10.1148/radiol.2018180694

Chan, H.P., and Helvie, M.A. (2019). Deep learning for mammographic breast density assessment and beyond. Radiology.

Byng, 1994, The quantitative analysis of mammographic densities, Phys. Med. Biol., 39, 1629, 10.1088/0031-9155/39/10/008

Sickles, E.A., D’Orsi, C.J., and Bassett, L.W. (2013). ACR BI-RADS® Mammography. ACR BI-RADS® Atlas, Breast Imaging Reporting and Data System, American College of Radiology.

Ciatto, 2012, A first evaluation of breast radiological density assessment by QUANTRA software as compared to visual classification, Breast, 21, 503, 10.1016/j.breast.2012.01.005

Highnam, R., Brady, M., Yaffe, M.J., Karssemeijer, N., and Harvey, J. (2010). Robust breast composition measurement-Volpara TM. International Workshop on Digital Mammography, Springer.

Seo, 2013, Automated volumetric breast density estimation: A comparison with visual assessment, Clin. Radiol., 68, 690, 10.1016/j.crad.2013.01.011

Byng, 1996, Automated analysis of mammographic densities, Phys. Med. Biol., 41, 909, 10.1088/0031-9155/41/5/007

Boyd, 2010, Breast tissue composition and susceptibility to breast cancer, J. Natl. Cancer Inst., 102, 1224, 10.1093/jnci/djq239

Kallenberg, 2016, Unsupervised deep learning applied to breast density segmentation and mammographic risk scoring, IEEE Trans. Med. Imaging, 35, 1322, 10.1109/TMI.2016.2532122

Litjens, 2017, Using deep learning to segment breast and fibroglandular tissue in MRI volumes, Med. Phys., 44, 533, 10.1002/mp.12079

Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.

Mohamed, 2018, Understanding clinical mammographic breast density assessment: A deep learning perspective, J. Digit. Imaging, 31, 387, 10.1007/s10278-017-0022-2

Mohamed, 2018, A deep learning method for classifying mammographic breast density categories, Med. Phys., 45, 314, 10.1002/mp.12683

Li, 2018, Computer-aided assessment of breast density: Comparison of supervised deep learning and feature-based statistical learning, Phys. Med. Biol., 63, 025005, 10.1088/1361-6560/aa9f87

Dubrovina, 2018, Computational mammography using deep neural networks, Comput. Methods Biomech. Biomed. Eng. Imaging Vis., 6, 243, 10.1080/21681163.2015.1131197

Ciritsis, 2019, Determination of mammographic breast density using a deep convolutional neural network, Br. J. Radiol., 92, 20180691, 10.1259/bjr.20180691

Moreno, 2016, Temporal mammogram image registration using optimized curvilinear coordinates, Comput. Methods Programs Biomed., 127, 1, 10.1016/j.cmpb.2016.01.019

Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21–26). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.

Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical Image Computing And Computer-Assisted Intervention, Springer.

Wang, 2004, Image quality assessment: From error visibility to structural similarity, IEEE Trans. Image Process., 13, 600, 10.1109/TIP.2003.819861

Moreira, 2012, Inbreast: Toward a full-field digital mammographic database, Acad. Radiol., 19, 236, 10.1016/j.acra.2011.09.014

Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.

Badrinarayanan, 2017, Segnet: A deep convolutional encoder-decoder architecture for image segmentation, IEEE Trans. Pattern Anal. Mach. Intell., 39, 2481, 10.1109/TPAMI.2016.2644615

Kerlikowske, 2015, Identifying women with dense breasts at high risk for interval cancer: A cohort study, Ann. Intern. Med., 162, 673, 10.7326/M14-1465