A critical empirical evaluation of deep learning models for solving aspect based sentiment analysis

P. R. Joe Dhanith1, K. Arun Prabha1
1School of Computer Science and Engineering, Vellore Institute of Technology, Chennai Campus, Chennai, India

Tóm tắt

Từ khóa


Tài liệu tham khảo

Ben Veyseh AP, Nouri N, Dernoncourt F, Tran QH, Dou D, Nguyen TH (2020) Improving aspect-based sentiment analysis with gated graph convolutional networks and syntax-based regulation. In: Find. Assoc. Comput. Linguist. Find. ACL EMNLP 2020, pp 4543–4548

Bhoi A, Joshi S (2018) Various approaches to aspect-based sentiment analysis.

Chen Y, Zhuang T, Guo K (2021) Memory network with hierarchical multi-head attention for aspect-based sentiment analysis. Appl Intell 51(7):4287–4304

Do BT (2018) Aspect-based sentiment analysis using bitmask bidirectional long short term memory networks. In: Proc. 31st Int. Florida Artif. Intell. Res. Soc. Conf. FLAIRS 2018, pp 259–264

Dong L, Wei F, Tan C, Tang D, Zhou M, Xu K (2014) Adaptive recursive neural network for target-dependent Twitter sentiment classification. In: 52nd Annu. Meet. Assoc. Comput. Linguist. ACL 2014 - Proc. Conf., vol 2, pp 49–54

Hou X, Huang J, Wang G, Qi P, He X, Zhou B (2021) Selective attention based graph convolutional networks for aspect-level sentiment classification. 83–93. arXiv:1910.10857

Hu M, Zhao S, Guo H, Cheng R, Su Z (2019) Learning to detect opinion snippet for aspect-based sentiment analysis. In: CoNLL 2019—proceedings of the 23rd conference on computational natural language learning, pp 970–979

Huang B, Ou Y, Carley KM (2018) Aspect level sentiment classification with attention-over-attention neural networks. In: Lecture notes computer science (including subseries lecture notes artificial intelligence lecture notes bioinformatics), vol 10899 LNCS, pp 197–206

Huang B, Carley KM (2020) Syntax-aware aspect level sentiment classification with graph attention networks. In: EMNLP-IJCNLP 2019 - 2019 Conf. Empir. Methods Nat. Lang. Process. 9th Int. Jt. Conf. Nat. Lang. Process. Proc. Conf., pp 5469–5477

Jiang Q, Chen L, Xu R, Ao X, Yang M (2019) A challenge dataset and effective models for aspect-based sentiment analysis. In: EMNLP-IJCNLP 2019—2019 Conf. Empir. Methods Nat. Lang. Process. 9th Int. Jt. Conf. Nat. Lang. Process. Proc. Conf., pp. 6280–6285

Karimi A, Rossi L, Prati A (2020) Improving BERT performance for aspect-based sentiment analysis. arXiv:2010.11731

Kumar A, Verma S, Sharan A (2021) ATE-SPD: simultaneous extraction of aspect-term and aspect sentiment polarity using Bi-LSTM-CRF neural network. J Exp Theor Artif Intell 33(3):487–508

Laddha A, Mukherjee A (2019) Aspect specific opinion expression extraction using attention based LSTM-CRF network, pp 1–12

Li L, Liu Y, Zhou A (2018) Hierarchical attention based position-aware network, CoNLL, no. CoNLL, pp 181–189

Li X, Bing L, Zhang W, Lam W (2019a) Exploiting Bert for end-to-end aspect-based sentiment analysis. In: W-NUT@EMNLP 2019—proceedings of the 5th workshop on noisy user-generated text, pp 34–41

Li Y et al (2019b) A joint model for aspect-category sentiment analysis with contextualized aspect embedding. arXiv:1908.11017

Liang Y, Meng F, Zhang J, Chen Y, Xu J, Zhou J (2020a) An iterative multi-knowledge transfer network for aspect-based sentiment analysis. arXiv:2004.01935

Liang Y, Meng F, Zhang J, Xu J, Chen Y, Zhou J (2020b) A novel aspect-guided deep transition model for aspect based sentiment analysis. In: EMNLP-IJCNLP 2019a—2019a Conf. Empir. Methods Nat. Lang. Process. 9th Int. Jt. Conf. Nat. Lang. Process. Proc. Conf., pp 5569–5580

Liang B, Du J, Xu R, Li B, Huang H (2020c) Context-aware embedding for targeted aspect-based sentiment analysis. In: ACL 2019b—proceedings of the 57th annual meeting of the association for computational linguistics, pp 4678–4683

Liang Y, Meng F, Zhang J, Chen Y, Xu J, Zhou J (2021) A dependency syntactic knowledge augmented interactive architecture for end-to-end aspect-based sentiment analysis. Neurocomputing 454:291–302

Liesting T, Frasincar F, Trusc MM (2021) Data augmentation in a hybrid approach for aspect-based sentiment analysis. Proc ACM Symp Appl Comput 1:828–835

Ligthart A, Catal C, Tekinerdogan B (2021) Systematic reviews in sentiment analysis: a tertiary study. Artif Intell Rev 54(7):1–57

Lin P, Yang M, Lai J (2021) Deep selective memory network with selective attention and inter-aspect modeling for aspect level sentiment classification. IEEE/ACM Trans Audio Speech Lang Process 29:1093–1106

Liu N, Shen B (2020) ReMemNN: a novel memory neural network for powerful interaction in aspect-based sentiment analysis. Neurocomputing 395:66–77

Liu H et al (2020) Aspect-based sentiment analysis: a survey of deep learning methods. IEEE Trans Comput Soc Syst 7(6):1358–1375

Luo H, Li T, Liu B, Wang B, Unger H (2019) Improving aspect term extraction with bidirectional dependency tree representation. IEEE/ACM Trans Audio Speech Lang Process 27(7):1201–1212

Luo H, Ji L, Li T, Duan N, Jiang D (2020) GRACE: Gradient harmonized and cascaded labeling for aspect-based sentiment analysis. Find Assoc Comput Linguist Find ACL EMNLP 2020:54–64

Ma HWD, Li S, Zhang X (2017) Interactive attention networks for aspect-level sentiment classification. In: Proceedings of the twenty-sixth international joint conference on artificial intelligence, pp 4068–4074

Ma Y, Peng H, Khan T, Cambria E, Hussain A (2018) Sentic LSTM: a hybrid network for targeted aspect-based sentiment analysis. Cognit Comput 10(4):639–650

Ma D, Li S, Wang H (2020) Joint learning for targeted sentiment analysis. In: Proc. 2018a Conf. Empir. Methods Nat. Lang. Process. EMNLP 2018a, pp 4737–4742

Ma F, Zhang C, Song D (2021) Exploiting position bias for robust aspect sentiment classification. 1352–1358. arXiv:2105.14210

Nazir A, Rao Y, Wu L, Sun L (2020) Issues and challenges of aspect-based sentiment analysis: a comprehensive survey. IEEE Trans Affect Comput 3045(c):1–20

Nguyen HT, Le Nguyen M (2018) Effective attention networks for aspect-level sentiment classification. In: Proceedings of 2018 10th international conference on knowledge and systems engineering, KSE 2018, pp 25–30

Nguyen TH, Shirai K (2015) PhraseRNN: phrase recursive neural network for aspect-based sentiment analysis. In: Conf. Proc.—EMNLP 2015 Conf. Empir. Methods Nat. Lang. Process., no. September, pp 2509–2514

Noh Y, Park S, Park SB (2019) Aspect-based sentiment analysis using aspect map. Appl Sci 9(16):1–16

Pham D-H, Le A-C (2018) Exploiting multiple word embeddings and one-hot character vectors for aspect-based sentiment analysis. Int J Approx Reason 103:1–10

Pontiki M, Galanis D, Pavlopoulos J, Papageorgiou H, Androutsopoulos I, Manandhar S (2015a) SemEval-2014 task 4: aspect based sentiment analysis, no. SemEval, pp 27–35

Pontiki M, Galanis D, Papageorgiou H, Manandhar S, Androutsopoulos I (2015b) SemEval-2015b task 12: aspect based sentiment analysis. In: Proceedings of the 9th international workshop on semantic evaluation, pp 486–495

Pontiki M et al (2016) SemEval-2016 task 5: aspect based sentiment analysis. In: SemEval 2016—proceedings of the 10th international workshop on semantic evaluation, vol Proceeding, pp 19–30

Ruder S, Ghaffari P, Breslin JG (2016) A hierarchical model of reviews for aspect-based sentiment analysis. In: EMNLP 2016—Conf. Empir. Methods Nat. Lang. Process. Proc., pp 999–1005

Sadr H, Pedram MM et al (2021) Convolutional neural network equipped with attention mechanism and transfer learning for enhancing performance of sentiment analysis. J AI Data

Saeidi M, Liakata M, Bouchard G, Riedel S (2016) SentiHood : targeted aspect based sentiment analysis dataset for urban neighbourhoods. 1546–1556. arXiv:1610.03771

Schmitt M, Steinheber S, Schreiber K, Roth B et al (2020) Joint aspect and polarity classification for aspect-based sentiment analysis with end-to-end neural networks. In: Proceedings of 2018 conference on empirical methods in natural language processing, EMNLP 2018, pp 1109–1114

Setiawan EI, Ferry F, Santoso J, Sumpeno S, Fujisawa K, Purnomo MH (2020) Bidirectional GRU for targeted aspect-based sentiment analysis based on character-enhanced token-embedding and multi-level attention. Int J Intell Eng Syst 13(5):392–407

Shu L, Xu H, Liu B (2019) Controlled CNN-based sequence labeling for aspect extraction. arXiv:1905.06407

Song Y, Wang J, Jiang T, Liu Z, Rao Y (2019) Targeted sentiment classification with attentional encoder network. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes bioinformatics), vol 11730 LNCS, pp 93–103

Song Y, Wang J, Liang Z, Liu Z, Jiang T (2020) Utilizing BERT intermediate layers for aspect based sentiment analysis and natural language inference. arXiv:2002.04815

Sun C, Huang L, Qiu X (2019) Utilizing BERT for aspect-based sentiment analysis via constructing auxiliary sentence. In: NAACL HLT 2019a—2019 Conf. North Am. Chapter Assoc. Comput. Linguist. Hum. Lang. Technol. - Proc. Conf., vol 1, pp 380–385

Sun K, Zhang R, Mensah S, Mao Y, Liu X (2020) Aspect-level sentiment analysis via convolution over dependency tree. In: EMNLP-IJCNLP 2019b—2019b Conf. Empir. Methods Nat. Lang. Process. 9th Int. Jt. Conf. Nat. Lang. Process. Proc. Conf., pp 5679–5688

Tang D, Qin B, Liu T (2016) Aspect level sentiment classification with deep memory network. In: EMNLP 2016—Conf. Empir. Methods Nat. Lang. Process. Proc., pp 214–224

Tang H, Ji D, Li C, Zhou Q (2020) Dependency graph enhanced dual-transformer structure for aspect-based sentiment classification. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 6578–6588

Wang Y, Huang M, Zhao L, Zhu X (2016) Attention-based LSTM for aspect-level sentiment classification. In: EMNLP 2016—Conf. Empir. Methods Nat. Lang. Process. Proc., pp 606–615

Wang X, Li F, Zhang Z, Xu G, Zhang J, Sun X (2021) A unified position-aware convolutional neural network for aspect based sentiment analysis. Neurocomputing 450:91–103

Wu H, Zhang Z, Shi S, Wu Q, Song H (2022) Phrase dependency relational graph attention network for aspect-based sentiment analysis. Knowledge-Based Syst 236:107736

Wu S, Fei H, Ren Y, Li B, Li F, Ji D (2021) High-order pair-wise aspect and opinion terms extraction with edge-enhanced syntactic graph convolution. IEEE/ACM Trans Audio Speech Lang Process 29:2396–2406

Xing B, et al (2019) Earlier attention? Aspect-aware LSTM for aspect-based sentiment analysis. In: IJCAI international joint conference on artificial intelligence, vol 2019-Augus, pp 5313–5319

Xu N, Mao W, Chen G (2019a) Multi-interactive memory network for aspect based multimodal sentiment analysis. In: 33rd AAAI Conf. Artif. Intell. AAAI 2019a, 31st Innov. Appl. Artif. Intell. Conf. IAAI 2019 9th AAAI Symp. Educ. Adv. Artif. Intell. EAAI 2019, pp 371–378

Xu H, Liu B, Shu L, Yu PS (2019b) BERT post-training for review reading comprehension and aspect-based sentiment analysis. In: NAACL HLT 2019b—2019 Conf. North Am. Chapter Assoc. Comput. Linguist. Hum. Lang. Technol. - Proc. Conf., vol 1, pp 2324–2335

Xu H, Liu B, Shu L, Yu PS (2020) DomBERT: domain-oriented language model for aspect-based sentiment analysis. Find Assoc Comput Linguist Find ACL EMNLP 2020:1725–1731

Yadav RK, Jiao L, Goodwin M, Granmo OC (2021) Positionless aspect based sentiment analysis using attention mechanism[Formula presented]. Knowledge-Based Syst 226:107136

Zeng J, Ma X, Zhou K (2019) Enhancing attention-based LSTM with position context for aspect-level sentiment classification. IEEE Access 7:20462–20471

Zhang Y, Xu B, Zhao T (2020a) Convolutional multi-head self-attention on memory for aspect sentiment classification. IEEE/CAA J Autom Sin 7(4):1038–1044

Zhang C, Li Q, Song D (2020b) Aspect-based sentiment classification with aspect-specific graph convolutional networks. In: EMNLP-IJCNLP 2019—2019 Conf. Empir. Methods Nat. Lang. Process. 9th Int. Jt. Conf. Nat. Lang. Process. Proc. Conf., no. Limitation 2, pp. 4568–4578

Zhao A, Yu Y (2021) Knowledge-enabled BERT for aspect-based sentiment analysis. Knowl-Based Syst 227

Zheng S, Xia R (2018) Left-center-right separated neural network for aspect-based sentiment analysis with rotatory attention.

Zhou J, Huang JX, Chen Q, Hu QV, Wang T, He L (2019) Deep learning for aspect-level sentiment classification: survey, vision, and challenges. IEEE Access 7:78454–78483

Zhou J, Huang JX, Hu QV, He L (2020) SK-GCN: modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification. Knowl-Based Syst 205:106292

Zhou Z, Liu F (2021) Filter gate network based on multi-head attention for aspect-level sentiment classification. Neurocomputing 441:214–225

Zhu X, Zhu L, Guo J, Liang S, Dietze S (2021) GL-GCN: global and local dependency guided graph convolutional networks for aspect-based sentiment classification. Expert Syst Appl 186:115712