Deep multispectral image registration network

Abramoff, 2010, Retinal imaging and image analysis, IEEE Rev. Biomed. Eng., 3, 169, 10.1109/RBME.2010.2084567 Alterini, 2019, Fast visible and extended near-infrared multispectral fundus camera, J. Biomed. Optics, 24, 096007 Alterovitz, 2006, Registration of mr prostate images with biomechanical modeling and nonlinear parameter estimation, Med. Phys., 33, 446, 10.1118/1.2163391 Arar, 2020 Avants, 2008, Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain, Med. Image Anal., 12, 26, 10.1016/j.media.2007.06.004 Balakrishnan, 2018, An unsupervised learning model for deformable medical image registration, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 9252 Bay, 2008, Speeded-up robust features (surf), Comput. Vis. Image Understand., 110, 346, 10.1016/j.cviu.2007.09.014 Blendowski, 2020, Multimodal 3d medical image registration guided by shape encoder-decoder networks, Int. J. Comput. Assist. Radiol. Surg., 15, 269, 10.1007/s11548-019-02089-8 Brox, 2011, Large displacement optical flow: descriptor matching in variational motion estimation, IEEE Trans. Pattern Anal. Mach. Intell., 33, 500, 10.1109/TPAMI.2010.143 Calcagni, 2011, Multispectral retinal image analysis: a novel non-invasive tool for retinal imaging, Eye, 25, 1562, 10.1038/eye.2011.202 Camara, 2007, Explicit incorporation of prior anatomical information into a nonrigid registration of thoracic and abdominal ct and 18-fdg whole-body emission pet images, IEEE Trans. Med. Imaging, 26, 164, 10.1109/TMI.2006.889712 Cao, 2017, Dual-core steered non-rigid registration for multi-modal images via bi-directional image synthesis, Med. Image Anal., 41, 18, 10.1016/j.media.2017.05.004 Cao, 2018, Deep learning based inter-modality image registration supervised by intra-modality similarity, International Workshop on Machine Learning in Medical Imaging, 55, 10.1007/978-3-030-00919-9_7 Deng, 2010, Retinal fundus image registration via vascular structure graph matching, Int. J. Biomed. Imaging, 2010, 14, 10.1155/2010/906067 Dice, 1945, Measures of the amount of ecologic association between species, Ecology, 26, 297, 10.2307/1932409 Diederik, 2014 Everdell, 2009, Multispectral imaging of the ocular fundus using led illumination, European Conference on Biomedical Optics Everdell, 2010, Multispectral imaging of the ocular fundus using light emitting diode illumination, Rev. Sci. Instrum., 81, 093706, 10.1063/1.3478001 Fan, 2019, Birnet: brain image registration using dual-supervised fully convolutional networks, Med. Image Anal., 54, 193, 10.1016/j.media.2019.03.006 Gallegopinazo, 2013, Choroidal lesions in neurofibromatosis detected by multispectral imaging, Retinal Cases Brief Rep., 7, 176, 10.1097/ICB.0b013e31828523a8 Greene, 2009, Constrained non-rigid registration for use in image-guided adaptive radiotherapy, Med. Image Anal., 13, 809, 10.1016/j.media.2009.07.004 Hajnal, 1995, A registration and interpolation procedure for subvoxel matching of serially acquired mr images, J. Comput. Assist. Tomogr., 19, 289, 10.1097/00004728-199503000-00022 Hervella, 2018, Multimodal registration of retinal images using domain-specific landmarks and vessel enhancement, Proc. Comput. Sci., 126, 97, 10.1016/j.procs.2018.07.213 Hu, 2018, Label-driven weakly-supervised learning for multimodal deformarle image registration, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), 1070, 10.1109/ISBI.2018.8363756 Jaderberg, 2015, Spatial transformer networks, Advances in Neural Information Processing Systems, 2017 Jiang, 2020, A multi-scale framework with unsupervised joint training of convolutional neural networks for pulmonary deformable image registration, Phys. Med. Biol., 65, 15011, 10.1088/1361-6560/ab5da0 Kim, 2016, Locally adaptive 2d-3d registration using vascular structure model for liver catheterization, Comput. Biol. Med., 70, 119, 10.1016/j.compbiomed.2016.01.009 Krebs, 2017, Robust non-rigid registration through agent-based action learning, International Conference on Medical Image Computing and Computer-Assisted Intervention, 344 Le Guyader, 2011, A combined segmentation and registration framework with a nonlinear elasticity smoother, Comput. Vis. Image Understand., 115, 1689, 10.1016/j.cviu.2011.05.009 Li, 2015, In vivo study of retinal transmission function in different sections of the choroidal structure using multispectral imaging, Investig. Ophthalmol. Vis. Sci., 56, 3731, 10.1167/iovs.14-15783 Li, 2011, Registration of oct fundus images with color fundus photographs based on blood vessel ridges, Optics Express, 19, 7, 10.1364/OE.19.000007 Lim, 2020, Different fundus imaging modalities and technical factors in ai screening for diabetic retinopathy: a review, Eye Vis. (Lond. Engl.), 7, 21, 10.1186/s40662-020-00182-7 Liu, 2011, Sift flow: dense correspondence across scenes and its applications, IEEE Trans. Pattern Anal. Mach. Intell., 33, 978, 10.1109/TPAMI.2010.147 Liu, 2019, Image synthesis-based multi-modal image registration framework by using deep fully convolutional networks, Med. Biol. Eng. Comput., 57, 1037, 10.1007/s11517-018-1924-y Long, 2015, Fully convolutional networks for semantic segmentation, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3431 Lowe, 1999, Object recognition from local scale-invariant features, The proceedings of the seventh IEEE international conference on Computer vision, 1999, vol. 2, 1150, 10.1109/ICCV.1999.790410 Ma, 2020, Novel observations in choroidal osteoma by multispectral imaging: a pilot case series, Int. Ophthalmol., 10.1007/s10792-020-01528-9 Maes, 1997, Multimodality image registration by maximization of mutual information, IEEE Trans. Med. Imaging, 16, 187, 10.1109/42.563664 Mccluskey, 2004, The eye in systemic inflammatory diseases, Lancet, 364, 2125, 10.1016/S0140-6736(04)17554-5 Nie, 2018, 3-d fully convolutional networks for multimodal isointense infant brain image segmentation, IEEE Trans. Cybern., 49, 1123, 10.1109/TCYB.2018.2797905 Ojala, 2002, Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, IEEE Trans. Pattern Anal. Mach. Intell., 24, 971, 10.1109/TPAMI.2002.1017623 Paszke, 2017 Pinazoduran, 2016, Eclectic ocular comorbidities and systemic diseases with eye involvement: a review, BioMed Res. Int., 2016, 6215745 Pohl, 2006, A bayesian model for joint segmentation and registration, NeuroImage, 31, 228, 10.1016/j.neuroimage.2005.11.044 Roche, 2001, Rigid registration of 3-d ultrasound with mr images: a new approach combining intensity and gradient information, IEEE Trans. Med. Imaging, 20, 1038, 10.1109/42.959301 Rohe, 2017, Svf-net: learning deformable image registration using shape matching, International Conference on Medical Image Computing and Computer-Assisted Intervention, 266 Ronneberger, 2015, U-net: convolutional networks for biomedical image segmentation, International Conference on Medical Image Computing and Computer-Assisted Intervention, 234 Rorden, 2000, Stereotaxic display of brain lesions, Behav. Neurol., 12, 191, 10.1155/2000/421719 Roy, 2014, Mr to ct registration of brains using image synthesis, Medical Imaging 2014: Image Processing volume 9034, 903419 Shahidi, 2013, Regional variation in human retinal vessel oxygen saturation, Exp. Eye Res., 113, 143, 10.1016/j.exer.2013.06.001 Sotiras, 2013, Deformable medical image registration: a survey, IEEE Trans. Med. Imaging, 32, 1153, 10.1109/TMI.2013.2265603 Tajbakhsh, 2016, Convolutional neural networks for medical image analysis: full training or fine tuning?, IEEE Trans. Med. Imaging, 35, 1299, 10.1109/TMI.2016.2535302 Tan, 2016, Advances in retinal imaging for diabetic retinopathy and diabetic macular edema, Indian J. Ophthalmol., 64, 76, 10.4103/0301-4738.178145 Thevenaz, 1998, A pyramid approach to subpixel registration based on intensity, IEEE Trans. Image Process., 7, 27, 10.1109/83.650848 Thirion, 1998, Image matching as a diffusion process: an analogy with Maxwell's demons, Med. Image Anal., 2, 243, 10.1016/S1361-8415(98)80022-4 Thévenaz, 1998, A pyramid approach to subpixel registration based on intensity, IEEE Trans. Image Process., 7, 27, 10.1109/83.650848 Wang, 2020, A segmentation based robust deep learning framework for multimodal retinal image registration, ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing. (ICASSP), 10.1109/ICASSP40776.2020.9054077 Wei, 2019, Synthesis and inpainting-based mr-ct registration for image-guided thermal ablation of liver tumors., 22nd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2019, 512, 10.1007/978-3-030-32254-0_57 Wein, 2008, Automatic ct-ultrasound registration for diagnostic imaging and image-guided intervention, Med. Image Anal., 12, 577, 10.1016/j.media.2008.06.006 Yang, 2017, Quicksilver: fast predictive image registration-a deep learning approach, NeuroImage, 158, 378, 10.1016/j.neuroimage.2017.07.008 Yang, 2020, Brain mr multimodal medical image registration based on image segmentation and symmetric self-similarity, Ksii Trans. Internet Inf. Syst., 14, 1167 Zhao, 2020, Unsupervised 3d end-to-end medical image registration with volume tweening network, IEEE J. Biomed. Health Inform., 24, 1394, 10.1109/JBHI.2019.2951024 Zheng, 2014, Landmark matching based retinal image alignment by enforcing sparsity in correspondence matrix, Med. Image Anal., 18, 903, 10.1016/j.media.2013.09.009 Zheng, 2017, Joint alignment of multispectral images via semidefinite programming, Biomed. Optics Express, 8, 890, 10.1364/BOE.8.000890 Zhu, 2020, Neurreg: neural registration and its application to image segmentation, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), 3617