An Interactive Network for End-to-End Review Helpfulness Modeling

Data Science and Engineering - Tập 5 Số 3 - Trang 261-279 - 2020
Jiahua Du1, Liping Zheng2, Jizhou He3, Jia Rong4, Hua Wang1, Yanchun Zhang1
1Institute of Sustainable Industries and Liveable Cities, Victoria University, Melbourne, VIC, Australia
2School of Computer Science and Technology, Fudan University, Shanghai, China
3Guangzhou Metro Group Co., Ltd., Guangzhou, Guangdong, China
4Faculty of Information Technology, Monash University, Clayton, VIC, Australia

Tóm tắt

AbstractReview helpfulness prediction aims to prioritize online reviews by quality. Existing methods largely combine review texts and star ratings for helpfulness prediction. However, star ratings are used in a way that has either little representation capacity or limited interaction with review texts. As a result, rating information has yet to be fully exploited during the combination. This paper aims to overcome the two drawbacks. A deep interactive architecture is proposed to learn the text–rating interaction (TRI) for helpfulness modeling. TRI enlarges the representation capacity of star ratings while enhancing the influence of rating information on review texts. TRI is evaluated on six real-world domains of the Amazon 5-Core dataset. Extensive experiments demonstrate that TRI can better predict review helpfulness and beat the state of the art. Ablation studies and qualitative analysis are provided to further understand model behaviors and the learned parameters.

Từ khóa


Tài liệu tham khảo

Baek H, Lee S, Oh S, Ahn JH (2015) Normative social influence and online review helpfulness: polynomial modeling and response surface analysis. J Electron Commer Res 16:290–306

Charrada EB (2016) Which one to read? Factors influencing the usefulness of online reviews for RE. In: 2016 IEEE 24th international requirements engineering conference workshops (REW), pp 46–52

Chen C, Qiu M, Yang Y, Zhou J, Huang J, Li X, Bao FS (2019) Multi-domain gated CNN for review helpfulness prediction. In: The world wide web conference, WWW ’19. ACM, New York, NY, USA, pp 2630–2636

Chen C, Yang Y, Zhou J, Li X, Bao FS (2018) Cross-domain review helpfulness prediction based on convolutional neural networks with auxiliary domain discriminators. In: Proceedings of the 2018 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 2 (short papers). Association for Computational Linguistics, New Orleans, Louisiana, pp 602–607

Chen C, Zhang M, Liu Y, Ma S (2018) Neural attentional rating regression with review-level explanations. In: Proceedings of the 2018 world wide web conference, WWW ’18. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, pp 1583–1592

Chiriatti G, Brunato D, Dell’Orletta F, Venturi G (2019) What makes a review helpful? predicting the helpfulness of Italian Tripadvisor reviews. In: Raffaella B, Roberto N, Giovanni S (eds) Italian Conference on Computational Linguistics (CLiC-it). CEUR, Bari, Italy

Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. ArXiv preprint arXiv:1406.1078

Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. J Mach Learn Res 12:2493–2537

Danescu-Niculescu-Mizil C, Kossinets G, Kleinberg J, Lee L (2009) How opinions are received by online communities: a case study on amazon.com helpfulness votes. In: Proceedings of the 18th international conference on world wide web, WWW ’09. ACM, New York, NY, USA, pp 141–150

Dauphin YN, Fan A, Auli M, Grangier D (2017) Language modeling with gated convolutional networks. In: Proceedings of the 34th international conference on machine learning, volume 70. JMLR.org, pp 933–941

Du J, Rong J, Michalska S, Wang H, Zhang Y (2019) Feature selection for helpfulness prediction of online product reviews: an empirical study. PLOS One 14(12):1–26

Du J, Rong J, Wang H, Zhang Y (2019) Helpfulness prediction for online reviews with explicit content–rating interaction. In: Web information systems engineering (WISE). Springer International Publishing, Hong Kong SAR, China, pp 795–809

Fan M, Feng Y, Sun M, Li P, Wang H, Wang J (2018) Multi-task neural learning architecture for end-to-end identification of helpful reviews. In: 2018 IEEE/ACM international conference on advances in social networks analysis and mining (ASONAM), pp 343–350

Fan M, Feng C, Guo L, Sun M, Li P (2019) Product-aware helpfulness prediction of online reviews. In: The world wide web conference, WWW ’19. ACM, New York, NY, USA, pp 2715–2721

Fang B, Ye Q, Kucukusta D, Law R (2016) Analysis of the perceived value of online tourism reviews: influence of readability and reviewer characteristics. Tour Manage 52:498–506

Ge S, Qi T, Wu C, Wu F, Xie X, Huang Y (2019) Helpfulness-aware review based neural recommendation. CCF transactions on pervasive computing and interaction

Ghose A, Ipeirotis PG (2011) Estimating the helpfulness and economic impact of product reviews: mining text and reviewer characteristics. IEEE Trans Knowl Data Eng 23(10):1498–1512

Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the thirteenth international conference on artificial intelligence and statistics, pp 249–256

Haque ME, Tozal ME, Islam A (2018) Helpfulness prediction of online product reviews. In: Proceedings of the ACM symposium on document engineering (2018) DocEng ’18. ACM, New York, NY, USA, pp 35:1–35:4

He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 770–778

He R, McAuley J (2016) Ups and downs: modeling the visual evolution of fashion trends with one-class collaborative filtering. In: Proceedings of the 25th international conference on world wide web, WWW ’16. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, pp 507–517

Hoffait A-S, Ittoo A, Schyns M (2018) Assessing and predicting review helpfulness: critical review, open challenges and research agenda. In: 29ème conférence européenne sur la recherche opérationnelle (EURO2018)

Huang AH, Chen K, Yen DC, Tran TP (2015) A study of factors that contribute to online review helpfulness. Comput Hum Behav 48:17–27

Kalchbrenner N, Grefenstette E, Blunsom P (2014) A convolutional neural network for modelling sentences. In: Proceedings of the 52nd annual meeting of the association for computational linguistics (volume 1: long papers). Association for Computational Linguistics, Baltimore, Maryland, pp 655–665

Kim S-M, Pantel P, Chklovski T, Pennacchiotti M (2006) Automatically assessing review helpfulness. In: Proceedings of the 2006 conference on empirical methods in natural language processing, EMNLP ’06. Association for Computational Linguistics, Stroudsburg, PA, USA, pp 423–430

Kim Y (2014) Convolutional neural networks for sentence classification. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, Doha, Qatar, pp 1746–1751

Kim Y, Jernite Y, Sontag D, Rush AM (2016) Character-aware neural language models. In: Proceedings of the thirtieth AAAI conference on artificial intelligence, AAAI’16. AAAI Press, pp 2741–2749

Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. CoRR, arXiv:abs/1412.6980

Korfiatis N, García-Bariocanal E, Sánchez-Alonso S (2012) Evaluating content quality and helpfulness of online product reviews: the interplay of review helpfulness vs. review content. Electron Commer Res Appl 11(3):205–217

Kozinets RV (2016) Amazonian forests and trees: multiplicity and objectivity in studies of online consumer-generated ratings and reviews, a commentary on De Langhe, Fernbach, and Lichtenstein. J Consum Res 42(6):834–839

Krishnamoorthy S (2015) Linguistic features for review helpfulness prediction. Expert Syst Appl 42(7):3751–3759

Lee S, Choeh JY (2014) Predicting the helpfulness of online reviews using multilayer perceptron neural networks. Expert Syst Appl 41(6):3041–3046

Lipton ZC, Berkowitz J, Elkan C (2015) A critical review of recurrent neural networks for sequence learning. ArXiv preprint arXiv:1506.00019

Liu J, Cao Y, Lin C-Y, Huang Y, Zhou M (2007) Low-quality product review detection in opinion summarization. In: Proceedings of the 2007 joint conference on empirical methods in natural language processing and computational natural language learning (EMNLP-CoNLL). Association for Computational Linguistics, Prague, Czech Republic, pp 334–342

Lu Y, Tsaparas P, Ntoulas A, Polanyi L (2010) Exploiting social context for review quality prediction. In: Proceedings of the 19th international conference on world wide web, WWW ’10. ACM New York, NY, USA, pp 691–700

Ma Y, Xiang Z, Qianzhou D, Fan W (2018) Effects of user-provided photos on hotel review helpfulness: an analytical approach with deep leaning. Int J Hosp Manage 71:120–131

Malik MSI, Hussain A (2017) Helpfulness of product reviews as a function of discrete positive and negative emotions. Comput Hum Behav 73:290–302

Martin L, Pu P (2014) Prediction of helpful reviews using emotions extraction. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, AAAI’14. AAAI Press, pp 1551–1557

Melián-González S, Bulchand-Gidumal J, López-Valcárcel BG (2013) Online customer reviews of hotels: as participation increases, better evaluation is obtained. Cornell Hosp Q 54(3):274–283

Matthias M, Nikolaos K, Zicari RV (2014) Using dependency bigrams and discourse connectives for predicting the helpfulness of online reviews. In: Hepp M, Hoffner Y (eds) E-commerce and web technologies. Springer, Cham, pp 146–152

Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, pp 3111–3119

Mudambi SM, Schuff D (2010) Research note: What makes a helpful online review? a study of customer reviews on amazon.com. MIS Q 34(1):185–200

Murphy R (2018) Local consumer review survey. https://www.brightlocal.com/research/local-consumer-review-survey/

Ocampo DG, Ng V (2018) Modeling and prediction of online product review helpfulness: a survey. In: Proceedings of the 56th annual meeting of the association for computational linguistics (volume 1: long papers). Association for Computational Linguistics, Melbourne, Australia, pp 698–708

Park S, Nicolau JL (2015) Asymmetric effects of online consumer reviews. Ann Tour Res 50:67–83

Park Y-J (2018) Predicting the helpfulness of online customer reviews across different product types. Sustainability 10(6):1735

Passon M, Lippi M, Serra G, Tasso C (2018) Predicting the usefulness of Amazon reviews using off-the-shelf argumentation mining. In: Proceedings of the 5th workshop on argument mining. Association for Computational Linguistics, Brussels, Belgium, pp 35–39

Paul D, Sarkar S, Chelliah M, Kalyan C, Nadkarni PPS (2017) Recommendation of high quality representative reviews in e-commerce. In: Proceedings of the eleventh ACM conference on recommender systems, RecSys ’17. ACM, New York, NY, USA, pp 311–315

Pennebaker JW, Boyd RL, Jordan K, Blackburn K (2015) The development and psychometric properties of LIWC2015. Technical report, The University of Texas at Austin

Pennington J, Socher R, Manning CD (2014) Glove: global vectors for word representation. In: Empirical methods in natural language processing (EMNLP), pp 1532–1543

Qu X, Li X, Rose JR (2018) Review helpfulness assessment based on convolutional neural network. CoRR, arXiv:abs/1808.09016

Quaschning S, Pandelaere M, Vermeir I (2015) When consistency matters: the effect of valence consistency on review helpfulness. J Comput Mediat Commun 20(2):136–152

Roy G, Datta B, Mukherjee S (2018) Role of electronic word-of-mouth content and valence in influencing online purchase behavior. J Mark Commun 25:661–684

Salehan M, Kim DJ (2016) Predicting the performance of online consumer reviews: a sentiment mining approach to big data analytics. Decis Support Syst 81:30–40

Saumya S, Singh JP, Dwivedi YK (2019) Predicting the helpfulness score of online reviews using convolutional neural network. Soft Comput. https://doi.org/10.1007/s00500-019-03851-5

Schuckert M, Liu X, Law R (2016) Insights into suspicious online ratings: direct evidence from TripAdvisor. Asia Pac J Tour Res 21(3):259–272

Shin S, Chung N, Xiang Z, Koo C (2019) Assessing the impact of textual content concreteness on helpfulness in online travel reviews. J Travel Res 58(4):579–593

Siering M, Muntermann J, Rajagopalan B (2018) Explaining and predicting online review helpfulness: the role of content and reviewer-related signals. Dec Support Syst 108:1–12

Stone PJ, Bales RF, Namenwirth JZ, Ogilvie DM (1966) The general inquirer: a computer system for content analysis and retrieval based on the sentence as a unit of information. Behav Sci 7(4):484–498

Tsang ASL, Prendergast G (2009) Is a “star” worth a thousand words? The interplay between product-review texts and rating valences. Eur J Mark 43(11/12):1269–1280

van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9:2579–2605

Xiang Z, Qianzhou D, Ma Y, Fan W (2017) A comparative analysis of major online review platforms: implications for social media analytics in hospitality and tourism. Tour Manage 58:51–65

Yang Y, Chen C, Bao FS (2016) Aspect-based helpfulness prediction for online product reviews. In: 2016 IEEE 28th international conference on tools with artificial intelligence (ICTAI), pp 836–843

Yang Y, Yan Y, Qiu M, Bao F (2015) Semantic analysis and helpfulness prediction of text for online product reviews. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (volume 2: short papers). Association for Computational Linguistics, Beijing, China, pp 38–44

Yin D, Bond SD, Zhang H (2014) Anxious or angry? Effects of discrete emotions on the perceived helpfulness of online reviews. MIS Q 38(2):539–560

Yin D, Mitra S, Zhang H (2016) Research note—when do consumers value positive vs. negative reviews? An empirical investigation of confirmation bias in online word of mouth. Inf Syst Res 27(1):131–144

Zhang R, Tran T, Mao Y (2012) Opinion helpfulness prediction in the presence of “words of few mouths”. World Wide Web 15(2):117–138

Zhou S, Guo B (2015) The interactive effect of review rating and text sentiment on review helpfulness. In: Stuckenschmidt H, Jannach D (eds) E-commerce and web technologies. Springer, Cham, pp 100–111