Robust semi-supervised spatial picture fuzzy clustering with local membership and KL-divergence for image segmentation

Chengmao Wu1, Jiajia Zhang1
1School of Electronic Engineering, Xi’an University of Posts and Telecommunications, Xi’an, People’s Republic of China

Tóm tắt

Aiming at existing symmetric regularized picture fuzzy clustering with weak robustness, and it is difficult to meet the need for image segmentation in the presence of high noise. Hence, a robust dynamic semi-supervised symmetric regularized picture fuzzy clustering with KL-divergence and spatial information constraints is presented in this paper. Firstly, a weighted squared Euclidean distance from current pixel value, its neighborhood mean and median to clustering center is firstly proposed, and it is embedded into the objective function of symmetric regularized picture fuzzy clustering to obtain spatial picture fuzzy clustering. Secondly, the idea of maximum entropy fuzzy clustering is introduced into picture fuzzy clustering, and an entropy-based picture fuzzy clustering with clear physical meaning is constructed to avoid the problem of selecting weighted factors. Subsequently, the prior information of the current pixel is obtained by means of weighted local membership of neighborhood pixels, and it is embedded into the objective function of maximum entropy picture fuzzy clustering with multiple complementary spatial information constraints through KL-divergence, a robust dynamic semi-supervised picture fuzzy clustering optimization model and its iterative algorithm are given. In the end, this proposed algorithm is strictly proved to be convergent by Zangwill theorem. The experiments on various images and standard datasets illustrate how our proposed algorithm works. This proposed algorithm has excellent segmentation performance and anti-noise robustness, and outperforms eight state-of-the-art fuzzy or picture fuzzy clustering-related algorithms in the presence of high noise.

Tài liệu tham khảo

Xu G, Zhou J, Dong J, Chen C, Chen Y (2020) Multivariate morphological reconstruction based fuzzy clustering with a weighting multi-channel guided image filter for color image segmentation. Int J Mach Learn Cybern 11(3):2793–2806. https://doi.org/10.1007/s13042-020-01151-1 Yang X, Zhou YP, Zhou D, Hu YJ (2016) Image segmentation and proto-objects detection based visual tracking. Optik 131:1085–1094. https://doi.org/10.1016/j.ijleo.2016.11.197 Carata SV, Neagoe VE (2016) A pulse-coupled neural network approach for image segmentation and its pattern recognition application. In: 2016 International Conference on Communications (COMM), IEEE. https://doi.org/10.1109/ICComm.2016.7528317 Luo J, Wang Y, Wang QH, Zhai RF, Zong YH (2017) Automatic image segmentation of grape based on computer vision. Int Conf Intell Interact Syst Appl 541:365–370. https://doi.org/10.1007/978-3-319-49568-2_52 Cuevas E, Fausto F, Adrián G (2020) Locust search algorithm applied to multi-threshold segmentation. In: New advancements in swarm algorithms: operators and applications, vol 160. Intelligent Systems Reference Library, pp 211–240. https://doi.org/10.1007/978-3-030-16339-6_8 Pan HZ, Liu WQ, Li L, Zhou GL (2019) A novel level set approach for image segmentation with landmark constraints. Optik - Int J Light Electron Opt 182:257–268. https://doi.org/10.1016/j.ijleo.2019.01.009 Luo L, Liu S, Tong XY, Jiang PR, Yuan C, Zhao XH, Shang F (2019) Carotid artery segmentation using level set method with double adaptive threshold (DATLS) on TOF-MRA images. Magn Reson Imaging 63:123–130. https://doi.org/10.1016/j.mri.2019.08.002 Du M, Ding S, Xue Y (2017) A robust density peaks clustering algorithm using fuzzy neighborhood. Int J Mach Learn Cybern 9:1131–1140. https://doi.org/10.1007/s13042-017-0636-1 Ada N, Harsono T, Basuki A (2018) Cloud satellite image segmentation using Meng Hee Heng K-means and DBSCAN clustering. 2018 International electronics symposium on knowledge creation and intelligent computing (IES-KCIC), IEEE Press, pp 367–371. https://doi.org/10.1109/KCIC.2018.8628523 Goyal S, Kumar S, Zaveri MA, Shukla AK (2017) Fuzzy similarity measure based spectral clustering framework for noisy image segmentation. Int J Uncertain Fuzziness and Knowl-Based Syst 25(4):649–673. https://doi.org/10.1142/S0218488517500283 Gou SP, Db Li, Hai D, Chen WS, Du FF, Jiao LC (2018) Spectral clustering with eigenvalue similarity metric method for POL-SAR image segmentation of land cover. J Geogr Inf Syst 10:150–164. https://doi.org/10.4236/jgis.2018.101007 Ludwig SA (2015) MapReduce-based fuzzy c-means clustering algorithm: implementation and scalability. Int J Mach Learn Cybern 6(6):923–934. https://doi.org/10.1007/s13042-015-0367-0 Li QH, Ural S, Anderson J, Shan J (2016) A fuzzy mean-shift approach to Lidar waveform decomposition. IEEE Trans Geosci Remote Sens 54(12):7112–7121. https://doi.org/10.1109/TGRS.2016.2596105 Bezdek JC (1981) Pattern recognition with fuzzy objective function algorithms. Adv Appl Pattern Recogn. https://doi.org/10.1007/978-1-4757-0450-1 Bezdek JC, Ehrlich R, Full W (1984) FCM: the fuzzy c-means clustering algorithm. Comput Geosci 10(2–3):191–203. https://doi.org/10.1016/0098-3004(84)90020-7 Bezdek JC, Hathaway RJ, Sabin MJ, Tucker W (1987) Convergence theory for fuzzy c-means: counterexamples and repairs. IEEE Trans Syst Man Cybern 17(5):873–877. https://doi.org/10.1109/TSMC.1987.6499296 Chen SC, Zhang DQ (2004) Robust image segmentation using FCM with spatial constraints based on new kernel-induced distance measure. IEEE Trans Syst Man Cybern Part B (Cybern) 34(4):1907–1916. https://doi.org/10.1109/TSMCB.2004.831165 Chuang KS, Tzeng HL, Chen S, Wu J, Chen TJ (2006) Fuzzy c-means clustering with spatial information for image segmentation. Comput Med Imaging Graph 30(1):9–15. https://doi.org/10.1016/j.compmedimag.2005.10.001 Caldairou B, Passat N, Habas PA, Studholme C, Rousseau F (2011) A non-local fuzzy segmentation method: application to brain MRI. Pattern Recogn 44(9):1916–1927. https://doi.org/10.1016/j.patcog.2010.06.006 Zhang DQ, Chen SC (2004) A novel kernelized fuzzy C-means algorithm with application in medical image segmentation. Artif Intell Med 32:37–50. https://doi.org/10.1016/j.artmed.2004.01.012 Ichihashi H, Miyagishi K, Honda K (2001) Fuzzy c-means clustering with regularization by K-L Information. IEEE Int Conf Fuzzy Syst 2:924–927. https://doi.org/10.1109/FUZZ.2001.1009107 Chatzis SP, Varvarigou TA (2008) A fuzzy clustering approach toward hidden Markov random field models for enhanced spatially constrained image segmentation. IEEE Trans Fuzzy Syst 16(5):1351–1361. https://doi.org/10.1109/TFUZZ.2008.2005008 Gong MG, Su L, Jia M (2014) Fuzzy clustering with a modified MRF energy function for change detection in synthetic aperture radar image. IEEE Trans Fuzzy Syst 22(1):98–109. https://doi.org/10.1109/TFUZZ.2013.2249072 Zhang H, Wu QM, Zheng Y (2014) Effective fuzzy clustering algorithm with Bayesian model and mean template for image segmentation. IET Image Proc 8(10):571–581. https://doi.org/10.1049/iet-ipr.2013.0178 Gharieb RR, Gendy G (2015) Fuzzy c-means with local membership based weighted pixel distance and KL divergence for image segmentation. J Pattern Recogn Res 10(1):53–60. https://doi.org/10.13176/11.605 Son LH, Tuan TM (2016) A cooperative semi-supervised fuzzy clustering framework for dental X-ray image segmentation. Expert Syst Appl 46:380–393. https://doi.org/10.1016/j.eswa.2015.11.001 Son LH, Tuan TM (2017) Dental segmentation from X-ray images using semi-supervised fuzzy clustering with spatial constraints. Eng Appl Artif Intell 59:186–195. https://doi.org/10.1016/j.engappai.2017.01.003 Yang Y, Wu CM, Li YW, Zhang SW (2020) Robust semisupervised kernelized fuzzy local information C-means clustering for image segmentation. Math Probl Eng 2020(3):1–22. https://doi.org/10.1155/2020/5648206 Chaira T (2011) A novel intuitionistic fuzzy c-means clustering algorithm and its application to medical images. Appl Soft Comput 11(2):1711–1717. https://doi.org/10.1016/j.asoc.2010.05.005 Son LH (2015) DPFCM: a novel distributed picture fuzzy clustering method on picture fuzzy sets. Expert Syst Appl 42(1):51–66. https://doi.org/10.1016/j.eswa.2014.07.026 Thong PH, Son LH (2016) Picture fuzzy clustering: a new computational intelligence method. Soft Comput 20(9):3549–3562. https://doi.org/10.1007/s00500-015-1712-7 Sun JM, Wu CM (2019) Regularized picture fuzzy clustering and robust segmentation algorithm. Comput Eng Appl 55(11):179–186. https://doi.org/10.3778/j.issn.1002-8331.1803-0110 Wu CM, Sun JM (2019) Adaptive robust picture fuzzy clustering algorithm based on total divergence. Acta Armamentarii 40(9):1890–1901. https://doi.org/10.3969/j.issn.1000-1093.2019.09.014 Fu HJ, Wu XH, Mao HP, Wu B (2011) Fuzzy entropy clustering using possibilistic approach. Proc Eng 15:1993–1997. https://doi.org/10.1016/j.proeng.2011.08.372 Yin XS, Shu T, Huang Q (2012) Semi-supervised fuzzy clustering with metric learning and entropy regularization. Knowl-Based Syst 35:304–311. https://doi.org/10.1016/j.knosys.2012.05.016 Li QY, Ma YC, Smarandache F, Zhu SW (2018) Single-valued neutrosophic clustering algorithm based on tsallis entropy maximization. Axioms 7(3):57. https://doi.org/10.3390/axioms7030057 Gharieb RR, Gendy G (2014) Fuzzy C-means with a local membership KL distance for medical image segmentation. In: IEEE Proc., Cairo Int Biomed. Eng. Conf. (CIBEC), Egypt, Giza, pp 47–50. https://doi.org/10.1109/CIBEC.2014.7020912 Pedrycz W, Waletzky J (1997) Fuzzy clustering with partial supervision. IEEE Trans Syst Man Cybern B Cybern 27(5):787–795. https://doi.org/10.1109/3477.623232 Sahbi H, Boujemma N (2005) Fuzzy clustering: consistency of entropy regularization. In: Reusch B (ed) Computational intelligence, theory and applications, advances in soft computing, vol 33. Springer, pp 95–107. https://doi.org/10.1007/3-540-31182-3_9 Wu CM, Kang ZQ (2021) Robust entropy-based symmetric regularized picture fuzzy clustering for image segmentation. Digit Signal Process 110:102905. https://doi.org/10.1016/j.dsp.2020.102905 Salehi F, Keyvanpour MR, Sharifi A (2021) SMKFC-ER: semi-supervised multiple kernel fuzzy clustering based on entropy and relative entropy. Inf Sci 547:667–688. https://doi.org/10.1016/j.ins.2020.08.094 Zhao F, Liu HQ, Fan JL (2015) Multi-objective evolutionary clustering image segmentation based on complementary spatial information. J Electron Inf Technol 37(3):672–678. https://doi.org/10.11999/JEIT140371 Zhao QH, Jia SH, Gao J, Gao X (2019) Fuzzy clustering image segmentation combined with membership space constraints. Sci Surv Mapp 44(5):164–170. https://doi.org/10.16251/j.cnki.1009-2307.2019.05.025 Saha A, Das S (2019) Stronger convergence results for the center-based fuzzy clustering with convex divergence measure. IEEE Trans Cybern 49(12):4229–4242. https://doi.org/10.1109/TCYB.2018.2861211 Giordana N, Pieczynski W (1997) Estimation of generalized multisensor hidden Markov chains and unsupervised image segmentation. IEEE Trans Pattern Anal Mach Intell 19(5):465–475. https://doi.org/10.1109/34.589206 Guo YH, Sengur A (2013) A novel color image segmentation approach based on neutrosophic set and modified fuzzy c-Means. Circuits Syst Signal Process 32(4):1699–1723. https://doi.org/10.1007/s00034-012-9531-x Gharieb RR, Gendy G, Selim H (2018) A hard c-means clustering algorithm incorporating membership KL divergence and local data information for noisy image segmentation. Int J Pattern Recognit Artif Intell 32(4):758–769. https://doi.org/10.1016/j.asoc.2017.05.055 Kumar D, Verma H, Mehra A (2019) A modified intuitionistic fuzzy c-means clustering approach to segment human brain MRI image. Multimed Tools Appl 78(10):12663–12687. https://doi.org/10.1007/s11042-018-5954-0 Thong PH, Son LH (2016) A novel automatic picture fuzzy clustering method based on particle swarm optimization and picture composite cardinality. Knowl Based Syst 109:48–60. https://doi.org/10.1016/j.knosys.2016.06.023 Maulik U, Bandyopadhyay S (2002) Performance evaluation of some clustering algorithms and validity indices. IEEE Trans Pattern Anal Mach Intell 24(12):1650–1654. https://doi.org/10.1109/TPAMI.2002.1114856 Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings eighth IEEE international conference on computer vision, vol 2, pp 416–423. https://doi.org/10.1109/ICCV.2001.937655 Gan HT, Fan YL, Luo ZZ, Zhang QZ (2017) Local homogeneous consistent safe semi-supervised clustering. Expert Syst Appl 97:384–393. https://doi.org/10.1016/j.eswa.2017.12.046 Gan HT (2019) Safe semi-supervised fuzzy c-means clustering. IEEE Access 9:181976–181987. https://doi.org/10.1109/ACCESS.2019.2929307 Baselice F, Coppolino L, D'Antonio S, Ferraioli G, Sgaglione L (2015) A DBSCAN based approach for jointly segment and classify brain MR images. In: 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC), IEEE Press. Pp 2993–2996. https://doi.org/10.1109/EMBC.2015.7319021 Zhang Y, Bai X, Fan R, Wang Z (2019) Deviation-sparse fuzzy c-means with neighbor information constraint. IEEE Trans Fuzzy Syst 27(1):185–199. https://doi.org/10.1109/TFUZZ.2018.2883033 Lei T, Jia X, Zhang Y et al (2018) Significantly fast and robust fuzzy c-means clustering algorithm based on morphological reconstruction and membership filtering. IEEE Trans Fuzzy Syst 26(5):3027–3041. https://doi.org/10.1109/TFUZZ.2018.2796074 Zhang XF, Sun YJ, Liu H, Hou ZJ, Zhao F, Zhang CM (2021) Improved clustering algorithms for image segmentation based on non-local information and back projection. Inf Sci 550:129–144. https://doi.org/10.1016/j.ins.2020.10.039 Zhao F, Fan JL, Liu HQ (2014) Optimal-selection-based suppressed fuzzy c-means clustering algorithm with self-tuning non local spatial information for image segmentation. Expert Syst Appl 41(9):4083–4093. https://doi.org/10.1016/j.eswa.2014.01.003 László S, László L, David I (2020) A review on suppressed fuzzy c-means clustering models. Acta Universitatis Sapientiae, Informatica 12(2):302–324. https://doi.org/10.2478/ausi-2020-0018