Hypergraph network embedding for community detection
Tóm tắt
Using attribute graphs for node embedding to detect community structure has become a popular research topic. However, most of the existing algorithms mainly focus on the network structure and node features, which ignore the higher-order relationships between nodes. In addition, only adopting the original graph structure will suffer from sparsity problems, and will also result in suboptimal node clustering performance. In this paper, we propose a hypergraph network embedding (HGNE) for community detection to solve the above problems. Firstly, we construct potential connections based on the shared feature information of the nodes. By fusing the original topology with feature-based potential connections, both the explicit and implicit relationships are encoded into the node representations, thus alleviating the sparsity problem. Secondly, for integrating the higher-order relationship, we adopt hypergraph convolution to encode the higher-order correlations. To constrain the quality of the node embedding, the spectral hypergraph embedding loss is utilized. Furthermore, we design a dual-contrast mechanism, which draws similar nodes closer by comparing the representations of different views. This mechanism can efficiently prevent multi-node classes from distorting less-node classes. Finally, the dual-contrast mechanism is jointly optimized with self-training clustering to obtain more robust node representations, thus improving the clustering results. Extensive experiments on five datasets indicate the superiority and effectiveness of HGNE.
Từ khóa
Tài liệu tham khảo
Wu X, Xiong Y, Zhang Y, Jiao Y, Shan C, Sun Y, Zhu Y, Yu PS (2022) CLARE: a semi-supervised community detection algorithm. In: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 2059–2069. https://doi.org/10.1145/3534678.3539370
Zhuang J, Meng S, Zhang J, Sheng VS (2023) Contrastive learning based graph convolution network for social recommendation. ACM T Knowl Discov D. 17(8):1–21. https://doi.org/10.1145/3587268
Park S, Seok C (2022) Galaxywater-cnn: prediction of water positions on the protein structure by a 3d-convolutional neural network. J Chem Inf Model 62(13):3157–3168. https://doi.org/10.1021/acs.jcim.2c00306
Lei K, Ye H, Fang J, Chen P, Zhang L, Xiao J (2022) Gbrm: a graph embedding and blockchain-based resource management framework for 5g mec. J Supercomput 78(14):16266–16285
Naik D, Ramesh D, Gandomi AH, Gorojanam NB (2022) Parallel and distributed paradigms for community detection in social networks: a methodological review. Expert Syst Appl 187:115956. https://doi.org/10.1016/j.eswa.2021.115956
Sun G, Zhang X (2019) A novel framework for node/edge attributed graph embedding. In: Advances in Knowledge Discovery and Data Mining: 23rd Pacific-Asia Conference, PAKDD 2019, Macau, China, April 14–17, 2019, Proceedings, Part III 23, pp. 169–182. Springer
Xing S, Shan X, Fanzhen L, Jia W, Jian Y, Chuan Z, Wenbin H, Cecile P, Surya N, Di J et al (2022) A comprehensive survey on community detection with deep learning. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2021.3137396
Wang D, Cui P, Zhu W (2016) Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1225-1234. https://doi.org/10.1145/2939672.2939753
Kumar S, Mallik A, Sengar SS (2023) Community detection in complex networks using stacked autoencoders and crow search algorithm. J Supercomput 79(3):3329–3356
Cao S, Lu W, Xu Q (2016) Deep neural networks for learning graph representations. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence. AAAI Press, Phoenix, Arizona, pp. 1145–1152 https://doi.org/10.1609/aaai.v30i1.10179
Kipf TN, Welling M (2016) Variational graph auto-encoders. Preprint at arXiv:1611.07308
Zhang X, Liu H, Wu X, Zhang X, Liu X (2021) Spectral embedding network for attributed graph clustering. Neural Netw. https://doi.org/10.1016/j.neunet.2021.05.026
Zhengdao Chen, J.B. Lisha Li (2018) Supervised community detection with line graph neural networks. In: International Conference on Learning Representations. https://doi.org/10.48550/ARXIV.1705.08415
Cui G, Zhou J, Yang C, Liu Z (2020) Adaptive graph encoder for attributed graph embedding. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. Association for Computing Machinery, New York, NY, USA, pp. 976–985 https://doi.org/10.1145/3394486.3403140
Wang C, Pan S, Hu R, Long G, Jiang J, Zhang C (2019) Attributed graph clustering: a deep attentional embedding approach. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence. AAAI Press, Macao, China, pp. 3670–3676 https://doi.org/10.48550/ARXIV.1906.06532
Lin Guo QD (2022) Graph clustering via variational graph embedding. Pattern Recogn 122:108334
Pan E, Kang Z (2021) Multi-view contrastive graph clustering. In: Advances in Neural Information Processing Systems, vol. 34, pp. 2148–2159
Bo D, Wang X, Shi C, Zhu M, Lu E, Cui P (2020) Structural deep clustering network. In: Proceedings of The Web Conference, pp. 1400–1410. Association for Computing Machinery, Taipei, Taiwan. https://doi.org/10.1145/3366423.3380214
Zhou X, Su L, Li X, Zhao Z, Li C (2023) Community detection based on unsupervised attributed network embedding. Expert Syst Appl 213:118937
Wang Y, Duan Z, Liao B, Wu F, Zhuang Y (2019) Heterogeneous attributed network embedding with graph convolutional networks. In: Proceedings of the AAAI Conference on Artificial Intelligence, 33(1):10061–10062. https://doi.org/10.1609/aaai.v33i01.330110061
Duan Z, Xu H, Huang Y, Feng J, Wang Y (2022) Multivariate time series forecasting with transfer entropy graph. Tsinghua Sci Technol 28(1):2548–2566. https://doi.org/10.1109/TPAMI.2020.3039374
Gao Y, Zhang Z, Lin H, Zhao X, Du S, Zou C (2022) Hypergraph learning: methods and practices. IEEE Trans Patt Anal Mach Intell 44:2548–2566. https://doi.org/10.1109/TPAMI.2020.3039374
Jiang J, Wei Y, Feng Y, Cao J, Gao Y (2019) Dynamic hypergraph neural networks. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, pp. 2635–2641, https://doi.org/10.24963/ijcai.2019/366
Feng Y, You H, Zhang Z, Ji R, Gao Y (2019) Hypergraph neural networks. In: Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence. AAAI Press, Honolulu, Hawaii, USA. https://doi.org/10.1609/aaai.v33i01.33013558
Gao Y, Feng Y, Ji S, Ji R (2023) Hgnn\(^+\): general hypergraph neural networks. IEEE Trans Pattern Anal Mach Intell 45(3):3181–3199. https://doi.org/10.1109/TPAMI.2022.3182052
Hu Y, Li X, Wang Y, Wu Y, Zhao Y, Yan C, Yin J, Gao Y (2023) Adaptive hypergraph auto-encoder for relational data clustering. IEEE Trans Knowl Data Eng 35:2231–2242. https://doi.org/10.1109/TKDE.2021.3108192
Zhang Z, Feng Y, Ying S, Gao Y (2022) Deep hypergraph structure learning. Preprint at arXiv:2208.12547
Zhou P, Wang X, Du L, Li X (2022) Clustering ensemble via structured hypergraph learning. Inform Fusion 78:171–179. https://doi.org/10.1016/j.inffus.2021.09.003
Song Y, Gu Y, Li T, Qi J, Liu Z, Jensen CS, Yu G (2023) CHGNN: a semi-supervised contrastive hypergraph learning network. Preprint at arXiv:abs/2303.06213
Bai S, Zhang F, Torr PHS (2021) Hypergraph convolution and hypergraph attention. Patt Recognit 110:107637. https://doi.org/10.1016/j.patcog.2020.107637
Song X, Li J, Lei Q, Zhao W, Chen Y, Mian A (2022) Bi-clkt: bi-graph contrastive learning based knowledge tracing. Knowl-Based Syst 241:108274. https://doi.org/10.1016/j.knosys.2022.108274
Feng S, Jing B, Zhu Y, Tong H (2022) Adversarial graph contrastive learning with information regularization. In: Proceedings of the ACM Web Conference, Association for Computing Machinery, Virtual Event, Lyon, France, pp. 1362–1371. https://doi.org/10.1145/3485447.3512183
Li B, Jing B, Tong H (2022) Graph communal contrastive learning. In: Proceedings of the ACM Web Conference. Association for Computing Machinery, Virtual Event, Lyon, France. pp. 1203–1213, https://doi.org/10.1145/3485447.3512208
Tong Z, Yozen L, Leonardo N, Oliver W, Meng J, Neil S (2021) Data augmentation for graph neural networks. In: Proceedings of the AAAI conference on artificial intelligence, vol. 35, pp. 11015–11023. https://doi.org/10.1609/aaai.v35i12.17315
Yuning Y, Chen T, Shen Y, Wang Z (2021) Graph contrastive learning automated. In: International Conference on Machine Learning, pp. 12121–12132
You Y, Chen T, Sui Y, Chen T, Wang Z, Shen Y (2020) Graph contrastive learning with augmentations. Adv Neural Inf Process Syst 33:5812–5823
Zhao H, Yang X, Wang Z, Yang E, Deng C (2021) Graph debiased contrastive learning with joint representation clustering. In: IJCAI, pp. 3434–3440
Shen X, Sun D, Pan S, Zhou X, Yang LT (2023) Neighbor contrastive learning on learnable graph augmentation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, pp. 9782–9791. https://doi.org/10.1609/aaai.v37i8.26168
Cai H, Zheng VW, Chang KC-C (2018) A comprehensive survey of graph embedding: problems, techniques, and applications. IEEE Trans Knowl Data Eng 30(9):1616–1637. https://doi.org/10.1109/TKDE.2018.2807452
Fanseu Kamhoua B, Zhang L, Ma K, Cheng J, Li B, Han B (2023) Grace: a general graph convolution framework for attributed graph clustering. ACM Trans Knowl Discov Data 17(3):1–31. https://doi.org/10.1145/3544977
Zhou D, Huang J, Schölkopf B (2006) Learning with hypergraphs: clustering, classification, and embedding. Advances in neural information processing systems 19
Zhao J, Guo J, Sun Y, Gao J, Wang S, Yin B (2022) Adaptive graph convolutional clustering network with optimal probabilistic graph. Neural Netw 156:271–284. https://doi.org/10.1016/j.neunet.2022.09.017
Shaham U, Stanton K, Li H, Nadler B, Basri R, Kluger Y (2018) SpectralNet: spectral clustering using deep neural networks. Preprint at arXiv:1801.01587
Hassani K, Khasahmadi AH (2020) Contrastive multi-view representation learning on graphs. In: International Conference on Machine Learning, pp. 4116–4126. PMLR
Oord A, Li Y, Vinyals O (2018) Representation learning with contrastive predictive coding. Preprint at arXiv:1807.03748
Jin D, Li B, Jiao P, He D, Shan H (2019) Community detection via joint graph convolutional network embedding in attribute network. In: Artificial Neural Networks and Machine Learning–ICANN 2019: Workshop and Special Sessions: 28th International Conference on Artificial Neural Networks, Munich, Germany, September 17–19, 2019, Proceedings 28, pp. 594–606. Springer
Krishna K, Narasimha Murty M (1999) Genetic k-means algorithm. IEEE Trans Syst, Man, Cybern Part B (Cybern). 29(3):433–439. https://doi.org/10.1109/3477.764879
Perozzi B, Al-Rfou R, Skiena S (2014) Deepwalk: Online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 701–710
Yang C, Liu Z, Zhao D, Sun M, Chang EY (2015) Network representation learning with rich text information. In: IJCAI, vol. 2015, pp. 2111–2117
Wang C, Pan S, Long G, Zhu X, Jiang J (2017) MGAE: marginalized graph autoencoder for graph clustering. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 889-898. https://doi.org/10.1145/3132847.3132967
Pan S, Hu R, Fung S-F, Long G, Jiang J, Zhang C (2020) Learning graph embedding with adversarial training methods. IEEE Trans Cybern 50(6):2475–2487. https://doi.org/10.1109/TCYB.2019.2932096
Veličković P, Fedus W, Hamilton WL, Liò P, Bengio Y, Hjelm RD (2018) Deep graph infomax. Preprint at arXiv:1809.10341
Salehi A, Davulcu H (2019) Graph attention auto-encoders. Preprint at arXiv:1905.10715
Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9(86):2579–2605