Brain image fusion using the parameter adaptive-pulse coupled neural network (PA-PCNN) and non-subsampled contourlet transform (NSCT)

Multimedia Tools and Applications
Sa. I. Ibrahim1, Gh. S. El-Tawel2, Mohamed Makhlouf1
1Faculty Of Computers and Informatics, Suez Canal University, Information Systems Department, Ismailia, Egypt
2Faculty Of Computers and Informatics, Suez Canal University, Computer Science Department, Ismailia, Egypt

Tóm tắt

AbstractMedical imaging has played an essential role in medicine and disease diagnosis. Medical images from a single modality contain limited data about the organ. On the other hand, images from different modalities contain valuable structural and functio nal data about an organ. Medical image fusion (MIF) strategies integrate complementary information from two medical images captured using distinct modalities. This paper offered a new multimodal MIF approach using the parameter-adaptive pulse-coupled neural networks (PA-PCNN) within the non-subsampled contourlet transform (NSCT). The NSCT decomposes those images into high- and low-frequency bands. PA-PCNN combines those bands. The fused image was created using the inverse of the NSCT approach. To prove the proposed approach’s performance, we appoint a variety of medical images like computed tomography (CT), magnetic resonance imaging (MRI), single-photon emission CT (SPECT), and positron emission tomography (PET). Our experiments use five fusion metrics to validate the proposed approach’s performance, such as entropy (EN), mutual information (MI), weighted edge information (Q$$^{AB/F}$$ A B / F ), nonlinear correlation information entropy (Q$$_{ncie}$$ ncie ), and average gradient (AG). Outcomes show that the proposed approach achieves high overall performance in visual and objective characteristics when compared with five well-known MIF methods. The average values for EN, MI, Q$$^{AB/F}$$ A B / F , Q$$_{ncie}$$ ncie , and AG with the proposed approach are 5.2144,3.1282,.6600,.8071, and 8.9874, respectively.

Từ khóa


Tài liệu tham khảo

James AP, Dasarathy BV (2014) Medical image fusion: A survey of the state of the art. Information Fusion 19. https://doi.org/10.1016/j.inffus.2013.12.002

Zhu Z, Zheng M, Qi G, Wang D, Xiang Y (2019) A phase congruency and local laplacian energy based multi-modality medical image fusion method in nsct domain. IEEE Access 7. https://doi.org/10.1109/ACCESS.2019.2898111

Tawfik N, Elnemr HA, Fakhr M, Dessouky MI, El-Samie FEA (2021) Survey study of multimodality medical image fusion methods. Multimedia Tools and Applications 80. https://doi.org/10.1007/s11042-020-08834-5

Polinati S, Dhuli R (2019) A review on multi-model medical image fusion. In: 2019 International Conference on Communication and Signal Processing (ICCSP), p 0554–0558. IEEE. https://doi.org/10.1109/ICCSP.2019.8697906

Ding Z, Zhou D, Nie R, Hou R, Liu Y (2020) Brain medical image fusion based on dual-branch cnns in nsst domain. BioMed Research International 2020. https://doi.org/10.1155/2020/6265708

Huang B, Yang F, Yin M, Mo X, Zhong C (2020) A review of multimodal medical image fusion techniques. Computational and Mathematical Methods in Medicine 2020. https://doi.org/10.1155/2020/8279342

Hermessi H, Mourali O, Zagrouba E (2018) Convolutional neural network-based multimodal image fusion via similarity learning in the shearlet domain. Neural Comput & Applic 30:2029–2045. https://doi.org/10.1007/s00521-018-3441-1

Tan W, Tiwari P, Pandey HM, Moreira C, Jaiswal AK (2020) Multimodal medical image fusion algorithm in the era of big data. Neural Comput & Applic. https://doi.org/10.1007/s00521-020-05173-2

Tan W, Thitøn W, Xiang P, Zhou H (2021) Multi-modal brain image fusion based on multi-level edge-preserving filtering. Biomedical Signal Processing and Control 64. https://doi.org/10.1016/j.bspc.2020.102280

Du J, Li W, Lu K, Xiao B (2016) An overview of multi-modal medical image fusion. Neurocomputing 215:3–20. https://doi.org/10.1016/j.neucom.2015.07.160

Zhang Q, long Guo B, (2009) Multifocus image fusion using the nonsubsampled contourlet transform. Signal Process 89. https://doi.org/10.1016/j.sigpro.2009.01.012

Wang Z, Cui Z, Zhu Y (2020) Multi-modal medical image fusion by laplacian pyramid and adaptive sparse representation. Comput Biol Med 123. https://doi.org/10.1016/j.compbiomed.2020.103823

Burt PJ, Adelson EH (1983) The laplacian pyramid as a compact image code. IEEE Trans Commun 31. https://doi.org/10.1109/TCOM.1983.1095851

Liu Y, Chen X, Cheng J, Peng H (2017) A medical image fusion method based on convolutional neural networks. In: 2017 20th international conference on information fusion (Fusion), p 1–7. IEEE

Li S, Yang B, Hu J (2011) Performance comparison of different multi-resolution transforms for image fusion. Information Fusion 12(2):74–84

Liu Y, Liu S, Wang Z (2015) A general framework for image fusion based on multi-scale transform and sparse representation. Information fusion 24:147–164

Yin M, Liu X, Liu Y, Chen X (2019) Medical image fusion with parameter-adaptive pulse coupled neural network in nonsubsampled shearlet transform domain. IEEE Trans Instrum Meas 68(1):49–64. https://doi.org/10.1109/TIM.2018.2838778

Ibrahim SI, M AM, El-Tawel GS (2023) Multimodal medical image fusion algorithm based on pulse coupled neural networks and nonsubsampled contourlet transform. Med Biol Eng Comput 61(1):155–177. https://doi.org/10.1007/s11517-022-02697-8

Xia J, Lu Y, Tan L (2020) Research of multimodal medical image fusion based on parameter-adaptive pulse-coupled neural network and convolutional sparse representation. Computational and Mathematical Methods in Medicine 2020. https://doi.org/10.1155/2020/3290136

Vanitha K, Satyanarayana D, Prasad M (2020) Multi-modal medical image fusion algorithm based on spatial frequency motivated pa-pcnn in the nsst domain. Current Medical Imaging Formerly Current Medical Imaging Reviews 17:634–643. https://doi.org/10.2174/1573405616666201118123220

Li L, Ma H (2021) Pulse coupled neural network-based multimodal medical image fusion via guided filtering and wseml in nsct domain. Entropy 23. https://doi.org/10.3390/e23050591

Mei Q, Li M (2022) Nonsubsampled contourlet transform and adaptive pcnn for medical image fusion. Journal of Applied Science and Engineering 26:213–220. https://doi.org/10.6180/jase.202302_26(2).0007

Vanitha K, Satyanarayana D, Giri Prasad MN (2022) Medical image fusion based on energy attribute and pa-pcnn in nsst domain. In: Reddy VS, Prasad VK, Wang J, Reddy K (eds) Soft Computing and Signal Processing. Springer Nature Singapore, Singapore, pp 457–467

Eckhorn R, Reitboeck HJ, Arndt M, Dicke P (1990) Feature linking via synchronization among distributed assemblies: Simulations of results from cat visual cortex. Neural Comput 2(3):293–307

Li L, Si Y, Wang L, Jia Z, Ma H (2020) A novel approach for multi-focus image fusion based on sf-papcnn and isml in nsst domain. Multimedia Tools and Applications 79:24303–24328. https://doi.org/10.1007/s11042-020-09154-4

Johnson KA, Becker JA (2023) Whole brain atlas. http://www.med.harvard.edu/AANLIB/home.html. Accessed 3 June 2023

Tian Y, Li Y, Ye F (2016) Multimodal medical image fusion based on nonsubsampled contourlet transform using improved pcnn. In: 2016 IEEE 13th International Conference on Signal Processing (ICSP), p 799–804. IEEE

Kaur H, Koundal D, Kadyan V (2021) Image fusion techniques: a survey. Archives of Computational Methods in Engineering 1–23

Bavirisetti DP, Kollu V, Gang X, Dhuli R (2017) Fusion of mri and ct images using guided image filter and image statistics. Int J Imaging Syst Technol 27(3):227–237

Thông tin
Thông tin xuất bản

Multimedia Tools and Applications

Thông tin tác giả