Self-co-attention neural network for anatomy segmentation in whole breast ultrasound

Medical Image Analysis - Tập 64 - Trang 101753 - 2020
Baiying Lei1, Shan Huang1, Hang Li1, Ran Li1, Cheng Bian1, Yi-Hong Chou2,3,4, Jing Qin5, Peng Zhou6, Xuehao Gong6, Jie-Zhi Cheng7
1the National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, 518060, China
2Department of Medical Imaging and Radiological Technology, Yuanpei University of Medical Technology, Hsinchu, Taiwan
3Department of Radiology, Taipei Veterans General Hospital, and School of Medicine, National Yang Ming University, Taipei, Taiwan
4Department of Radiology, Yee Zen General Hospital, Taoyuan, Taiwan
5Center for Smart Health, School of Nursing, The Hong Kong Polytechnic University, Hong Kong
6Department of Ultrasound, Shenzhen Second People's Hospital, First Affiliated Hospital of Shenzhen University, Second People's Hospital of Shenzhen, Shenzhen, 518035, China
7Shanghai United Imaging Intelligence Co., Ltd. (UII), Shanghai, China

Tài liệu tham khảo

Albert, 2014, Volumetric breast density estimation from full-field digital mammograms: a validation study, PLoS ONE, 9, e85952, 10.1371/journal.pone.0085952 Badrinarayanan, 2017, Segnet: a deep convolutional encoder-decoder architecture for image segmentation, Trans. Pattern Anal. Mach. Intell., 39, 2481, 10.1109/TPAMI.2016.2644615 Badrinarayanan, 2017, SegNet: a deep convolutional encoder-decoder architecture for image segmentation, IEEE Trans. Pattern Anal. Mach. Intell., 39, 2481, 10.1109/TPAMI.2016.2644615 Bian, 2017, Boundary regularized convolutional neural network for layer parsing of breast anatomy in automated whole breast ultrasound, 259 Boyd, 2011, Mammographic density and breast cancer risk: current understanding and future prospects, Breast CA. Res., 13, 223, 10.1186/bcr2942 Buades, 2005, A non-local algorithm for image denoising, 60 Chalana, 1997, A methodology for evaluation of boundary detection algorithms on medical images, IEEE Trans. Med. Imag., 23, 658 Chen, 2005, Cell-competition algorithm: a new segmentation algorithm for multiple objects with irregular boundaries in ultrasound images, Ultrasound Med Biol, 31, 1647, 10.1016/j.ultrasmedbio.2005.09.011 Chen, 2016, Breast density analysis with automated whole-breast ultrasound: comparison with 3-D magnetic resonance imaging, Ultrasound Med Biol, 42, 1211, 10.1016/j.ultrasmedbio.2015.12.015 Chen, 2009, Breast density analysis for whole breast ultrasound images, Med Phys, 36, 4933, 10.1118/1.3233682 Chen, 2018, Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs, IEEE Trans. Pattern Anal. Mach. Intell., 40, 834, 10.1109/TPAMI.2017.2699184 Chen, L.-C., Papandreou, G., Schroff, F., Adam, H., 2017. Rethinking atrous convolution for semanticimage segmentation. arXiv preprint arXiv:1706.05587. Chen, 2018, Encoder-decoder with atrous separable convolution for semantic image segmentation, In: Proc. ECCV. Cheng, 2010, Computer-aided US diagnosis of breast lesions by using cell-based contour grouping, Radiology, 255, 746, 10.1148/radiol.09090001 Cheng, 2010, ACCOMP: augmented cell competition algorithm for breast lesion demarcation in sonography, Med Phys, 37, 6240, 10.1118/1.3512799 Drukker, 2014, Computerized detection of breast cancer on automated breast ultrasound imaging of women with dense breasts, Med. Phys., 41, 1 Freer, 2015, Mammographic breast density: impact on breast cancer risk and implications for screening, Radiographics, 35, 302, 10.1148/rg.352140106 Gubern-Merida, 2015, Breast segmentation and density estimation in breast mri: a fully automatic framework, IEEE J. Biomed. Health. Inf., 19, 349, 10.1109/JBHI.2014.2311163 He, 2016, Deep residual learning for image recognition, 770 Hu, 2018, Squeeze-and-excitation networks, In: Proc. IEEE Conf. Comput. Vis. Pattern Recognit, 61, 7132 Huang, 2020, Segmentation of breast ultrasound image with semantic classification of superpixels, Med. Image Anal., 61, 10.1016/j.media.2020.101657 Hung, 2017, Scene parsing with global context embedding, 2650 Islami, 2018, Proportion and number of cancer cases and deaths attributable to potentially modifiable risk factors in the United States. CA, Cancer J. Clinicians, 68, 31, 10.3322/caac.21440 Joo, 2004, Computer-aided diagnosis of solid breast nodules: use of an artificial neural network based on multiple sonographic features, IEEE Trans. Med. Imag., 23, 1292, 10.1109/TMI.2004.834617 Kallenberg, 2016, Unsupervised deep learning applied to breast density segmentation and mammographic risk scoring, IEEE Trans. Med. Imag., 35, 1322, 10.1109/TMI.2016.2532122 Lee, 2012, Breast density legislation and opportunities for patient-centered outcomes research, Radiology, 264, 632, 10.1148/radiol.12120184 Lei, 2018, Segmentation of breast anatomy for automated whole breast ultrasound images with boundary regularized convolutional encoder–decoder network, Neurocomputing, 321, 178, 10.1016/j.neucom.2018.09.043 Li, 2018, Dense deconvolutional network for skin lesion segmentation, IEEE J. Biomed. Health. Inf. Liao, X., He, L., Yang, Z., 2018. Video-based person re-identification via 3d convolutional networks andnon-local attention. arXiv preprint arXiv:1807.05073. Lin, 2017, RefineNet: multi-path refinement networks for high-resolution semantic segmentation, 5168 Lin, 2018, Focal loss for dense object detection, Trans. Pattern Anal. Mach. Intell. Liu, W., Rabinovich, A., Berg, A.C., 2015. Parsenet: looking wider to see better. arXiv preprint arXiv:1506.04579. Lo, 2014, Multi-dimensional tumor detection in automated whole breast ultrasound using topographic watershed, IEEE Trans. Med. Imag., 33, 1503, 10.1109/TMI.2014.2315206 Long, 2015, Fully convolutional networks for semantic segmentation, 3431 Madabhushi, 2003, Combining low-, high-level and empirical domain knowledge for automated segmentation of ultrasonic breast lesions, IEEE Trans. Med. Imag., 22, 155, 10.1109/TMI.2002.808364 Moon, 2013, Computer-aided tumor detection based on multi-scale blob detection algorithm in automated breast ultrasound images, IEEE Trans. Med. Imag., 32, 1191, 10.1109/TMI.2012.2230403 Moon, 2011, Comparative study of density analysis using automated whole breast ultrasound and MRI, Med. Phys., 38, 382, 10.1118/1.3523617 Peng, 2017, Large kernel matters—Improve semantic segmentation by global convolutional network, 1743 Ren, 2017, End-to-end instance segmentation with recurrent attention, 21 Ronneberger, 2015, U-net: convolutional networks for biomedical image segmentation, 234 Roy, 2018, Recalibrating fully convolutional networks with spatial and channel 'squeeze & excitation' blocks Szegedy, 2017, Inception-v4, inception-resnet and the impact of residual connections on learning, 4278 Szegedy, 2015, Going deeper with convolutions, 1 Szegedy, 2016, Rethinking the inception architecture for computer vision, 2818 Tan, 2013, Computer-aided detection of cancer in automated 3-D breast ultrasound, IEEE Trans. Med. Imag., 32, 1698, 10.1109/TMI.2013.2263389 Wang, 2017, Residual attention network for image classification, 3156 Wang, 2018, Densely deep supervised networks with threshold loss for cancer detection in automated breast ultrasound, 641 Wang, 2018, Non-local neural networks, In: Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 7794 Xian, 2015, Fully automatic segmentation of breast ultrasound images based on breast characteristics in space and frequency domains, Pattern Recognit, 48, 485, 10.1016/j.patcog.2014.07.026 Xiao, 2002, Segmentation of ultrasound B-mode images with intensity inhomogeneity correction, IEEE Trans. Med. Imag., 21, 48, 10.1109/42.981233 Xie, 2017, Aggregated residual transformations for deep neural networks, 5987 Yap, 2018, Automated breast ultrasound lesions detection using convolutional neural networks, IEEE J. Biomed. Health. Inf., 22, 1218, 10.1109/JBHI.2017.2731873 Yu, 2017, Automated melanoma recognition in dermoscopy images via very deep residual networks, IEEE Trans. Med. Imag., 36, 994, 10.1109/TMI.2016.2642839 Zhang, 2018, Context encoding for semantic segmentation, 7151 Zhao, 2017, Pyramid scene parsing network, 2881 Zheng, 2015, Conditional random fields as recurrent neural networks, 1529