Hybrid high-order semantic graph representation learning for recommendations
Tóm tắt
The amount of Internet data is increasing day by day with the rapid development of information technology. To process massive amounts of data and solve information overload, researchers proposed recommender systems. Traditional recommendation methods are mainly based on collaborative filtering algorithms, which have data sparsity problems. At present, most model-based collaborative filtering recommendation algorithms can only capture first-order semantic information and cannot process high-order semantic information. To solve the above issues, in this paper, we propose a hybrid graph neural network model based on heterogeneous graphs with high-order semantic information extraction, which models users and items respectively by learning low-dimensional representations for them. We introduced an attention mechanism to allow the model to understand the corresponding edge weights adaptively. Simultaneously, the model also integrates social information in the data to learn more abundant information. We performed some experiments on related datasets. Our method achieved better results than some current advanced models, which verified the proposed model’s effectiveness.
Tài liệu tham khảo
Ramlatchan A, Yang M, Liu Q, Li M, Wang J, Li Y. A survey of matrix completion methods for recommendation systems. Big Data Mining Anal. 2018;1(4):308–23.
Xiaoxiao M, Wu J, Shan X, Jian Y, Sheng Quan Z, Hui X, editors. A comprehensive survey on graph anomaly detection with deep learning. 2021. arXiv preprint arXiv:2106.07178.
Su X, Shan X, Fanzhen L, Wu J, Jian Y, Chuan Z, Hu W, Cecile P, Surya N, Di J, et al. In: A comprehensive survey on community detection with deep learning. arXiv preprint arXiv:2105.12584, 2021
Liu F, Xue S, Wu J, Zhou C, Hu W, Paris C, Nepal S, Yang J, Yu PS. Deep learning for community detection: progress, challenges and opportunities. arXiv preprint arXiv:2005.08225. 2020.
van den Berg R, Kipf TN, Welling M. Graph convolutional matrix completion. arXiv preprint arXiv:1706.02263. 2017.
Fan W, Ma Y, Li Q, He Y, Zhao E, Tang J, Yin D. Graph neural networks for social recommendation. In: The world wide web conference; 2019. pp 417–426.
Wu Q, Zhang H, Gao X, He P, Weng P, Gao H, Chen G. Dual graph attention networks for deep latent representation of multifaceted social effects in recommender systems. In: The world wide web conference; 2019. pp 2091–2102.
Roshan B, Deepak G. Recommending top n movies using content-based filtering and collaborative filtering with hadoop and hive framework. In: Recent developments in machine learning and data analytics. Springer; 2019. p. 109–18.
Chen R, Hua Q, Chang Y-S, Wang B, Zhang L, Kong X. A survey of collaborative filtering-based recommender systems: From traditional methods to hybrid methods based on social networks. IEEE Access. 2018;6:64301–20.
Koren Y, Bell R, Volinsky C. Matrix factorization techniques for recommender systems. Computer. 2009;42(8):30–7.
Yehuda K. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining; 2008. p. 426–34.
Mnih A, Salakhutdinov RR. Probabilistic matrix factorization. In: Advances in neural information processing systems; 2008. pp 1257–1264.
Hao M, Haixuan Y, Michael LR, Irwin K. Sorec: social recommendation using probabilistic matrix factorization. In: Proceedings of the 17th ACM conference on information and knowledge management; 2008. p. 931–40.
Hao M, Dengyong Z, Chao L, Michael LR, Irwin K. Recommender systems with social regularization. In: Proceedings of the fourth ACM international conference on Web search and data mining; 2011. p. 287–96.
Mohsen J, Martin E. A matrix factorization technique with trust propagation for recommendation in social networks. In: Proceedings of the fourth ACM conference on Recommender systems; 2010. p. 135–42.
Liu BYYLD, Liu J. Social collaborative filtering by trust. In: Proceedings of the twenty-third international joint conference on artificial intelligence, IEEE; 2013. Citeseer.
Guo G, Zhang J, Yorke-Smith N. Trustsvd: collaborative filtering with both the explicit and implicit influence of user trust and of item ratings. AAAI. 2015;15:123–5.
Bo Yang Yu, Lei JL, Li W. Social collaborative filtering by trust. IEEE Trans Pattern Anal Mach Intell. 2016;39(8):1633–47.
He X, Liao L, Zhang H, Nie L, Hu X, Chua T-S. Neural collaborative filtering. In: Proceedings of the 26th international conference on world wide web; 2017. pages 173–182.
Monti F, Bronstein M, Bresson X. Geometric matrix completion with recurrent multi-graph neural networks. In: Advances in neural information processing systems; 2017. pp 3697–3707.
Gao L, Wu J, Zhou C, Hu Y. Collaborative dynamic sparse topic regression with user profile evolution for item recommendation. In: Proceedings of the AAAI conference on artificial intelligence; 2017. volume 31.
Li G, Wu J, Zhi Q, Chuan Z, Hong Y, Hu Y. Collaborative social group influence for event recommendation. In: Proceedings of the 25th ACM international on conference on information and knowledge management; 2016. p. 1941–4.
Gori M, Monfardini G, Scarselli F. A new model for learning in graph domains. In: Proceedings 2005 IEEE international joint conference on neural networks, 2005. IEEE; 2005. volume 2, pp 729–734.
Micheli A. Neural network for graphs: a contextual constructive approach. IEEE Trans Neural Netw. 2009;20(3):498–511.
Scarselli F, Gori M, Tsoi AC, Hagenbuchner M, Monfardini G. The graph neural network model. IEEE Trans Neural Netw. 2008;20(1):61–80.
Bruna J, Zaremba W, Szlam A, LeCun Y. Spectral networks and locally connected networks on graphs. arXiv preprint arXiv:1312.6203, 2013.
Kipf TN, Welling M. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907, 2016.
Hamilton W, Ying Z, Leskovec J. Inductive representation learning on large graphs. In: Advances in neural information processing systems; 2017. pp 1024–1034.
Veličković P, Cucurull G, Casanova A, Romero A, Lio P, Bengio Y. Graph attention networks. arXiv preprint arXiv:1710.10903, 2017.
Guohao L, Matthias M, Ali T, Bernard G. Deepgcns: can gcns go as deep as cnns? In: Proceedings of the IEEE International Conference on Computer Vision; 2019. p. 9267–76.
Yu R, Wenbing H, Xu T, Junzhou H. Dropedge: towards deep graph convolutional networks on node classification. In: International conference on learning representations; 2019.
Chen M, Wei Z, Huang Z, Ding B, Li Y. Simple and deep graph convolutional networks. arXiv preprint arXiv:2007.02133, 2020.
Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781, 2013.
Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473, 2014.
Fangyu Z, Li S, Jie Z, Zhang W, Liu W. A sufficient condition for convergences of adam and rmsprop. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2019. p. 11127–35.
Kaiming H, Xiangyu Z, Shaoqing R, Jian S. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE international conference on computer vision; 2015. p. 1026–34.
Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R. Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res. 2014;15(1):1929–58.
Tang J, Gao H, Liu H. mtrust: discerning multi-faceted trust in a connected world. In: Proceedings of the fifth ACM international conference on Web search and data mining; 2012. pp. 93–102.
Jiezhong Q, Jian T, Hao M, Yuxiao D, Kuansan W, Jie T. Deepinf: social influence prediction with deep learning. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining; 2018. p. 2110–9.
Wenqi F, Qing L, Min C. Deep modeling of social relations for recommendation. Thirty-second AAAI conference on artificial intelligence (AAAI-18). AAAI press; 2018. p. 8075–6.
Aditya G, Jure L. node2vec: Scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining; 2016. p. 855–64.