Object recognition in medical images via anatomy-guided deep learning

Medical Image Analysis - Tập 81 - Trang 102527 - 2022
Chao Jin1, Jayaram K. Udupa1, Liming Zhao1, Yubing Tong1, Dewey Odhner1, Gargi Pednekar2, Sanghita Nag2, Sharon Lewis2, Nicholas Poole1, Sutirth Mannikeri1, Sudarshana Govindasamy1, Aarushi Singh1, Joe Camaratta2, Steve Owens2, Drew A. Torigian1
1Medical Image Processing Group, 602 Goddard building, 3710 Hamilton Walk, Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104, United States
2Quantitative Radiology Solutions, LLC, 3675 Market Street, Suite 200, Philadelphia, PA 19104, United States

Tài liệu tham khảo

Abadi, 2016, Tensorflow: a system for large-scale machine learning, 265 Ashburner, 2009, Computing average shaped tissue probability templates, Neuroimage, 45, 333, 10.1016/j.neuroimage.2008.12.008 Bochkovskiy, A., Wang, C.Y., & Liao, H.Y.M., 2020. YOLOv4: optimal Speed and Accuracy of Object Detection. arXiv preprint. Brouwer, 2015, CT-based delineation of organs at risk in the head and neck region: DAHANCA, EORTC, GORTEC, HKNPCSG, NCIC CTG, NCRI, NRG Oncology and TROG consensus guidelines, Radiother. Oncol., 117, 83, 10.1016/j.radonc.2015.07.041 Brouwer, 2015, CT-based delineation of organs at risk in the head and neck region: DAHANCA, EORTC, GORTEC, HKNPCSG, NCIC CTG, NCRI, NRG Oncology and TROG consensus guidelines, Radiother. Oncol., 117, 83, 10.1016/j.radonc.2015.07.041 Christensen, 1994, 3-D Brain Mapping Using a Deformable Neuroanatomy, Phys. Med. Biol., 39, 609, 10.1088/0031-9155/39/3/022 Cootes, 1995, Active shape models-their training and application, Comput. Vision Image Understanding, 61, 38, 10.1006/cviu.1995.1004 Criminisi, 2013, Regression forests for efficient anatomy detection and localization in computed tomography scans, Med. Image Anal., 17, 1293, 10.1016/j.media.2013.01.001 De Vos, 2016, 2D image classification for 3D anatomy localization: employing deep convolutional neural networks, 9784, 97841Y de Vos, 2017, ConvNet-based localization of anatomical structures in 3-D medical images, IEEE Trans. Med. Imaging, 36, 1470, 10.1109/TMI.2017.2673121 Du, 2020, Spinenet: learning scale-permuted backbone for recognition and localization, 11592 Duan, 2019, Centernet: keypoint triplets for object detection, 6569 Falcao, 1998, User-Steered Image Segmentation Paradigms: live Wire and Live Lane, Graphic. Mod. Image Process., 60, 233, 10.1006/gmip.1998.0475 Fu, 2019, Dual attention network for scene segmentation, 3146 Gauriau, 2015, Multi-organ localization with cascaded global-to-local regression and shape prior, Med. Image Anal., 23, 70, 10.1016/j.media.2015.04.007 Gee, 1993, Elastically Deforming 3D Atlas to Match Anatomical Brain Images, J. Comput. Assist. Tomogr., 17, 225, 10.1097/00004728-199303000-00011 Ghiasi, 2019, Nas-fpn: learning scalable feature pyramid architecture for object detection, 7036 Han, 2004, CRUISE: cortical reconstruction using implicit surface evolution, Neuroimage, 23, 997, 10.1016/j.neuroimage.2004.06.043 Hussain, 2017, Segmentation-free kidney localization and volume estimation using aggregated orthogonal decision CNNs, 612 Jin, 2016, 3d fast automatic segmentation of kidney based on modified aam and random forest, IEEE Trans. Med. Imaging, 35, 1395, 10.1109/TMI.2015.2512606 Lambert, 2020, SegTHOR: segmentation of thoracic organs at risk in CT images, 1 Li, 2021, SOMA: subject-, object-, and modality-adapted precision atlas approach for automatic anatomy recognition and delineation in medical images, Med. Phys., 48, 7806, 10.1002/mp.15308 Lin, 2017, Feature pyramid networks for object detection, 2117 Lin, 2017, Focal loss for dense object detection, IEEE Trans. Pattern Anal. Mach. Intellig., 99, 2999 Liu, 2019, Organ Localization in PET/CT Images using Hierarchical Conditional Faster R-CNN Method, 249 Liu, 2018, Path aggregation network for instance segmentation, 8759 Liu, 2020, Cbnet: a novel composite backbone network architecture for object detection, Proc. AAAI Conf. Artific. Intellig., 34, 11653 Mamani, 2017, Organ detection in thorax abdomen CT using multi-label convolutional neural networks, 10134 Mamani, 2018, Efficient organ localization using multi-label convolutional neural networks in thorax-abdomen CT scans, Phys. Med. Biol., 63 Niethammer, 2015, Active Mean Fields for Probabilistic Image Segmentation: connections with Chan–Vese and Rudin–Osher–Fatemi Models, SIAM J. Imag. Sci., 10, 1069, 10.1137/16M1058601 Oda, 2017, 3D FCN feature driven regression forest-based pancreas localization and segmentation, 222 Pauly, 2011, Fast multiple organ detection and localization in whole-body mr dixon sequences, Med. Image Comput. Comp.-Assist. Interven. – MICCAI, 2011, 239 Pizer, 2003, Deformable M-reps for 3D medical image segmentation, Int. J. Comput. Vision, 55, 85, 10.1023/A:1026313132218 Raudaschl, 2017, Evaluation of segmentation methods on head and neck CT: auto-segmentation challenge 2015, Med. Phys., 44, 2020, 10.1002/mp.12197 Redmon, J., & Farhadi, A., 2018. Yolov3: an incremental improvement. arXiv preprint. Roth, 2018, Spatial aggregation of holistically-nested convolutional neural networks for automated pancreas localization and segmentation, Med. Image Anal., 45, 94, 10.1016/j.media.2018.01.006 Samarakoon, 2017, Light random regression forests for automatic multi-organ localization in CT images, 371 Shattuck, 2008, Construction of a 3D probabilistic atlas of human cortical structures, Neuroimage, 39, 1064, 10.1016/j.neuroimage.2007.09.031 Shen, 2011, Active Volume Models for Medical Image Segmentation, IEEE Trans. Med. Imaging, 30, 774, 10.1109/TMI.2010.2094623 Song, 2020, Revisiting the sibling head in object detector, 11563 Staib, 1992, Boundary Finding with Parametrically Deformable Models, IEEE Trans. Pattern Anal. Mach. Intell., 14, 1061, 10.1109/34.166621 Tan, 2020, Efficientdet: scalable and efficient object detection, 10781 Tong, 2019, Disease Quantification in PET/CT Images without Explicit Object Delineation, Med. Image Anal., 51, 169, 10.1016/j.media.2018.11.002 Udupa, 2014, Body-wide hierarchical fuzzy modeling, recognition, and delineation of anatomy in medical images, Med. Image Anal., 18, 752, 10.1016/j.media.2014.04.003 Wang, 2018, Deep attentional features for prostate segmentation in ultrasound, 523 Wang, 2014, Direct estimation of cardiac biventricular volume with an adapted Bayesian formulation, IEEE Trans. Biomed. Eng., 61, 1251, 10.1109/TBME.2014.2299433 Wu, 2019, AAR-RT - A system for auto-contouring organs at risk on CT images for radiation therapy planning: principles, design, and large-scale evaluation on head-and-neck and thoracic cancer cases, Med. Image Anal., 54, 45, 10.1016/j.media.2019.01.008 Xu, 2020, AAR-LN-DQ: automatic Anatomy Recognition based Disease Quantification in Thoracic Lymph Node Zones via FDG PET/CT images without Nodal Delineation, Med. Phys., 47, 3467, 10.1002/mp.14240 Xu, 2019, Efficient multiple organ localization in ct image using 3d region proposal network, IEEE Trans. Med. Imaging, 38, 1885, 10.1109/TMI.2019.2894854 Xu, 2019, Multiple organ localization in ct image using triple-branch fully convolutional networks, IEEE Access, 7, 98083, 10.1109/ACCESS.2019.2930417 Zhao, 2020, Exploring self-attention for image recognition, 10076 Zhou, 2019, Automatic anatomy partitioning of the torso region on CT images by using a deep convolutional network with majority voting, 10950 Zhou, 2013, Automatic organ localization on 3D CT images by using majority-voting of multiple 2D detections based on local binary patterns and Haar-like features