Transformer-based cross-modal multi-contrast network for ophthalmic diseases diagnosis

Biocybernetics and Biomedical Engineering - Tập 43 - Trang 507-527 - 2023
Yang Yu1, Hongqing Zhu1
1School of Information Science and Engineering, East China University of Science and Technology, Shanghai, China

Tài liệu tham khảo

He, 2023, An interpretable transformer network for the retinal disease classification using optical coherence tomography, Sci Rep, 13, 3637, 10.1038/s41598-023-30853-z

Wu J, Fang H, Li F, Fu H, Lin F, Li J. et al. Gamma challenge: glaucoma grading from multi-modality images. arXiv preprint arXiv:220206511; 2022.

Wang, 2022, Learning two-stream cnn for multi-modal age-related macular degeneration categorization, IEEE J Biomed Health Informat, 26, 4111, 10.1109/JBHI.2022.3171523

Palanisamy, 2020, A hybrid feature preservation technique based on luminosity and edge based contrast enhancement in color fundus images, Biocybernet Biomed Eng, 40, 752, 10.1016/j.bbe.2020.02.006

Sambyal, 2020, Modified u-net architecture for semantic segmentation of diabetic retinopathy images, Biocybernet Biomed Eng, 40, 1094, 10.1016/j.bbe.2020.05.006

Xu, 2022, A dark and bright channel prior guided deep network for retinal image quality assessment, Biocybernet Biomed Eng, 42, 772, 10.1016/j.bbe.2022.06.002

Elsharkawy, 2022, A novel computer-aided diagnostic system for early detection of diabetic retinopathy using 3d-oct higher-order spatial appearance model, Diagnostics, 12, 10.3390/diagnostics12020461

He, 2021, Multi-modal retinal image classification with modality-specific attention network, IEEE Trans Med Imag, 40, 1591, 10.1109/TMI.2021.3059956

Bhati, 2023, Discriminative kernel convolution network for multi-label ophthalmic disease detection on imbalanced fundus image dataset, Comput Biol Med, 153, 10.1016/j.compbiomed.2022.106519

Wang, 2023, Combining convolutional neural networks and self-attention for fundus diseases identification, Sci Rep, 13, 76, 10.1038/s41598-022-27358-6

Kuntha Pin Jee Ho Chang, 2022, Comparative study of transfer learning models for retinal disease diagnosis from fundus images, Comput Mater Continua, 70, 5821, 10.32604/cmc.2022.021943

Hsu, 2022, Automatic segmentation of retinal fluid and photoreceptor layer from optical coherence tomography images of diabetic macular edema patients using deep learning and associations with visual acuity, Biomedicines, 10, 10.3390/biomedicines10061269

Meshkin, 2023, Effectiveness of a telemedicine program for triage and diagnosis of emergent ophthalmic conditions, Eye (Lond), 37, 325, 10.1038/s41433-022-01940-8

Hua, 2021, Convolutional network with twofold feature augmentation for diabetic retinopathy recognition from multi-modal images, IEEE J Biomed Health Informat, 25, 2686, 10.1109/JBHI.2020.3041848

Han, 2022, Classifying neovascular age-related macular degeneration with a deep convolutional neural network based on optical coherence tomography images, Sci Rep, 12, 2232, 10.1038/s41598-022-05903-7

Marrakchi Y, Makansi O, Brox T. Fighting class imbalance with contrastive learning. In: de Bruijne, M., Cattin, P.C., Cotin, S., Padoy, N., Speidel, S., Zheng, Y., et al., editors. Medical Image Computing and Computer Assisted Intervention – MICCAI 2021. Cham: Springer International Publishing; 2021, pp. 466–476. https://doi.org/10.1007/978-3-030-87199-4_44.

Li, 2020, Self-supervised feature learning via exploiting multi-modal data for retinal disease diagnosis, IEEE Trans Med Imag, 39, 4023, 10.1109/TMI.2020.3008871

He K, Fan H, Wu Y, Xie S, Girshick R. Momentum contrast for unsupervised visual representation learning. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2020, pp. 9726–9735. https://doi.org/10.1109/CVPR42600.2020.00975.

Lin, 2023, Contrastive pre-training and linear interaction attention-based transformer for universal medical reports generation, J Biomed Inform, 138, 10.1016/j.jbi.2023.104281

Chen X, He K. Exploring simple siamese representation learning. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2021, pp. 15745–15753. https://doi.org/10.1109/CVPR46437.2021.01549.

Deng, 2022, Rformer: Transformer-based generative adversarial network for real fundus image restoration on a new clinical benchmark, IEEE J Biomed Health Informat, 26, 4645, 10.1109/JBHI.2022.3187103

Philippi, 2023, A vision transformer architecture for the automated segmentation of retinal lesions in spectral domain optical coherence tomography images, Sci Rep, 13, 517, 10.1038/s41598-023-27616-1

Oh, 2023, Local selective vision transformer for depth estimation using a compound eye camera, Pattern Recogn Lett, 167, 82, 10.1016/j.patrec.2023.02.010

Domínguez, 2023, Binary and multi-class automated detection of age-related macular degeneration using convolutional- and transformer-based architectures, Comput Methods Programs Biomed, 229, 10.1016/j.cmpb.2022.107302

Gu Z, Li Y, Wang Z, Kan J, Shu J, Wang Q. et al. Classification of diabetic retinopathy severity in fundus images using the vision transformer and residual attention. Computat Intell Neurosci 2023;2023. https://doi.org/10.1155/2023/1305583.

Cai Z, Lin L, He H, Tang X. Corolla: An efficient multi-modality fusion framework with supervised contrastive learning for glaucoma grading. In: 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI); 2022, pp. 1–4. https://doi.org/10.1109/ISBI52829.2022.9761712.

Chen X, Xie S, He K. An empirical study of training self-supervised vision transformers. In: 2021 IEEE/CVF International Conference on Computer Vision (ICCV); 2021, pp. 9620–9629. https://doi.org/10.1109/ICCV48922.2021.00950.

Nawaz, 2022, An efficient deep learning approach to automatic glaucoma detection using optic disc and optic cup localization, Sensors, 22, 10.3390/s22020434

Malinowski, 2022, An iris segmentation using harmony search algorithm and fast circle fitting with blob detection, Biocybernet Biomed Eng, 42, 391, 10.1016/j.bbe.2022.02.010