Cardiac substructure segmentation with deep learning for improved cardiac sparing
Tóm tắt
Radiation dose to cardiac substructures is related to radiation‐induced heart disease. However, substructures are not considered in radiation therapy planning (RTP) due to poor visualization on CT. Therefore, we developed a novel deep learning (DL) pipeline leveraging MRI’s soft tissue contrast coupled with CT for state‐of‐the‐art cardiac substructure segmentation requiring a single, non‐contrast CT input.
Thirty‐two left‐sided whole‐breast cancer patients underwent cardiac T2 MRI and CT‐simulation. A rigid cardiac‐confined MR/CT registration enabled ground truth delineations of 12 substructures (chambers, great vessels (GVs), coronary arteries (CAs), etc.). Paired MRI/CT data (25 patients) were placed into separate image channels to train a three‐dimensional (3D) neural network using the entire 3D image. Deep supervision and a Dice‐weighted multi‐class loss function were applied. Results were assessed pre/post augmentation and post‐processing (3D conditional random field (CRF)). Results for 11 test CTs (seven unique patients) were compared to ground truth and a multi‐atlas method (MA) via Dice similarity coefficient (DSC), mean distance to agreement (MDA), and Wilcoxon signed‐ranks tests. Three physicians evaluated clinical acceptance via consensus scoring (5‐point scale).
The model stabilized in ~19 h (200 epochs, training error <0.001). Augmentation and CRF increased DSC 5.0 ± 7.9% and 1.2 ± 2.5%, across substructures, respectively. DL provided accurate segmentations for chambers (DSC = 0.88 ± 0.03), GVs (DSC = 0.85 ± 0.03), and pulmonary veins (DSC = 0.77 ± 0.04). Combined DSC for CAs was 0.50 ± 0.14. MDA across substructures was <2.0 mm (GV MDA = 1.24 ± 0.31 mm). No substructures had statistical volume differences (
These promising results suggest DL poses major efficiency and accuracy gains for cardiac substructure segmentation offering high potential for rapid implementation into RTP for improved cardiac sparing.
Từ khóa
Tài liệu tham khảo
RonnebergerO FischerP BroxT.U‐net: Convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer‐assisted intervention. Springer. 2015. pp. 234–241.
ZhangZ YangL ZhengY.Translating and segmenting multimodal medical volumes with cycle‐ and shape‐consistency generative adversarial network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018. pp. 9242‐9251
Baughman DR, 2014, Neural networks in bioprocessing and chemical engineering
LeeC‐Y XieS GallagherP et al.Deeply‐supervised nets. Artificial intelligence and statistics. 2015;562–570.
Mao X, 2016, Image restoration using very deep convolutional encoder‐decoder networks with symmetric skip connections, Adv Neural Inf Process Syst, 29, 2802
MilletariF NavabN AhmadiS‐A.V‐net: Fully convolutional neural networks for volumetric medical image segmentation. 3D Vision (3DV) 2016 Fourth International Conference on. IEEE. 2016. pp. 565–571.
NairAA TranTD ReiterA et al.A deep learning based alternative to beamforming ultrasound images. 2018 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP). IEEE. 2018. pp. 3359–3363.
KingmaDP BaJ.Adam: A method for stochastic optimization. arXiv preprint arXiv.2014.
LongJ ShelhamerE DarrellT.Fully convolutional networks for semantic segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition. 2015. pp. 3431‐3440
Krähenbühl P, 2011, Efficient inference in fully connected CRFs with gaussian edge potentials, Adv Neural Inf Process Syst, 24, 109
ZhengS JayasumanaS Romera‐ParedesB et al.Conditional random fields as recurrent neural networks. Proceedings of the IEEE international conference on computer vision.2015. pp.1529–1537
ZhangJ NieH.A post‐processing method based on fully connected CRFs for chronic wound images segmentation and identification. NUDT.2018.
Aljabar P, 2001, The cutting edge: delineating contours with deep learning, Mach Learn, 2005, 2013
Ben‐CohenA KlangE AmitaiMM et al.Anatomical data augmentation for cnn based pixel‐wise classification. Biomedical Imaging (ISBI 2018) 2018 IEEE 15th International Symposium on. IEEE.2018. pp.1096–1099.
KjerlandØ.Segmentation of coronary arteries from ct‐scans of the heart using deep learning: MS Thesis. NTNU.2017.
Sudre CH, 2017, Proceedings of the MICCAI workshop on Deep Learning in Medical Image Analysis (DLMIA), 240
LiuZ LiX LuoP et al.Semantic image segmentation via deep parsing network. Proceedings of the IEEE international conference on computer vision. 2015. pp. 1377–1385
TrulloR PetitjeanC RuanS et al.Segmentation of organs at risk in thoracic ct images using a sharpmask architecture and conditional random fields. 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017). IEEE. 2017. pp. 1003–1006.
ZhuJ‐Y ParkT IsolaP et al.Unpaired image‐to‐image translation using cycle‐consistent adversarial networks. Proceedings of the IEEE international conference on computer vision. 2017. pp. 2223‐2232
HuangX LiY PoursaeedO et al.Stacked generative adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017. pp. 5077‐5086