Big data and sentiment analysis: A comprehensive and systematic literature review

Mahdi Hajiali1
1Department of Computer Science, University of Nevada, Las Vegas, Nevada, USA

Tóm tắt

SummarySentiment analysis can extract information from many text sources such as reviews, news, and blogs; then it classifies them based on their polarity. Moreover, big data is produced via mobile networks and social media. Applications of sentiment analysis on big data are used as a way of classifying the opinions into diverse sentiment. Accordingly, performing sentiment analysis on big data can be helpful for a business to take useful commercial insights from text‐oriented content. However, there are very few comprehensive investigations and profound argument in this context. The goal of this paper is to provide a comprehensive and systematic investigation of the state‐of‐the‐art techniques and highlight the directions for future research. In this paper, we used systematic literature review method and in the first step, we obtained 15 351 articles; then, based on different filters, 48 related articles were attained. We have selected 23 articles based on the year of publication, the relevance of the journal, the completeness of the text, the nonrepeatability of the title, and the page number. Also, we have categorized big data and sentiment analysis into two classifications: centralized and distributed platforms. Furthermore, the disadvantages and advantages of the investigated techniques are studied and their key issues are emphasized. Consequently, this study shows that a better analysis of textual big data in terms of sentiment increases efficiency, flexibility, and intelligence. By providing comparative information and analyzing the current developments in this area, this paper will directly support academics and practicing professionals for better handling of big data in the field of sentiment analysis. This study sheds some new light on using sentiment analysis and big data for public opinion estimation and prediction.

Từ khóa


Tài liệu tham khảo

DwivediA PantR KhariM PandeyS MohanL PandeM. E‐governance and big data framework for e‐governance and use of sentiment analysis. Available at SSRN 3382731. 2019.

RamanujamRS NancyamalaR NivedhaJ KokilaJ. Sentiment analysis using big data. Paper presented at: 2015 International Conference on Computation of Power Energy Information and Communication (ICCPEIC); 2015:0480‐0484.

DarbandiM HaghgooS HajialiM KhabirA. Prediction and estimation of next demands of cloud users based on their comments in CRM and previous usages. Paper presented at: 2018 International Conference on Communication Computing and Internet of Things (IC3IoT); 2018:81‐86.

BanićL MihanovićA BrakusM. Using big data and sentiment analysis in product evaluation. Paper presented at: 2013 36th International Convention on Information and Communication Technology Electronics and Microelectronics (MIPRO); 2013:1149‐1154.

Jinturkar M, 2016, Sentiment analysis of customer review data using big data: a survey, Int J Comput Appl, 975, 8887

10.1007/978-981-10-5699-4_72

Karimkhan M, 2014, Sentiment Analysis and Big Data Processing

10.1177/0165551515602846

Kurian D, 2015, Big data sentiment analysis using hadoop, Int J Innov Res Sci Technol, 1, 92

10.1016/j.jbi.2018.03.014

SehgalD AgarwalAK. Sentiment analysis of big data applications using Twitter Data with the help of HADOOP framework. Paper presented at: 2016 International Conference System Modeling and Advancement in Research Trends (SMART); 2016:251‐255.

10.1016/j.ins.2016.07.007

ChandanaR HarshithaD RamachandraA. Big data migration and sentiment analysis of real time events using hadoop ecosystem. Paper presented at: International Conference on Intelligent Data Communication Technologies and Internet of Things; 2018:764‐770.

RoshanfekrB KhadiviS RahmatiM. Sentiment analysis using deep learning on Persian texts. Paper presented at: 2017 Iranian Conference on Electrical Engineering (ICEE); 2017:1503‐1508.

Han Z, 2019, A review on sentiment discovery and analysis of educational big‐data, WIRES Data Min Knowl Discov, 10, e1328, 10.1002/widm.1328

10.1016/j.patcog.2013.07.022

Kaur P, 2016, A perspective: sentiment analysis and recent trend in opinion mining of Big Data, Int J Adv Computron Manag Studies, 1, 1

10.15680/IJIRCCE.2014.0212034

KeshavarzH AbadehMS AlmasiM. A new lexicon learning algorithm for sentiment analysis of big data. Paper presented at: 2017 IEEE 15th International Symposium on Intelligent Systems and Informatics (SISY); 2017:000249‐000254.

MinanovicA GabelicaH KrstićŽ. Big data and sentiment analysis using KNIME: online reviews vs. social media. Paper presented at: 2014 37th International Convention on Information and Communication Technology Electronics and Microelectronics (MIPRO); 2014:1464‐1468.

10.1186/s41044-016-0018-9

10.1016/j.jnca.2017.08.006

10.1186/s40537-015-0030-3

Sharef NM, 2016, Overview and future opportunities of sentiment analysis approaches for big data, JCS, 12, 153

Graham G, 2016, Sentiment Analysis Using KNIME: a Systematic Literature Review of Big Data Logistics

10.1007/978-3-319-30319-2_14

Dandannavar P, 2017, Sentiment analysis of real world big data—a review of general approaches, Int Sci Press, 10, 185

Sharma S, 2017, A survey on sentiment analysis for big data, Int J Adv Res Sci Eng, 6, 412

BalajiSN PaulPV SaravananR. Survey on sentiment analysis based stock prediction using big data analytics. Paper presented at: 2017 Innovations in Power and Advanced Computing Technologies (i‐PACT); 2017:1‐5.

10.1016/j.ijpe.2014.12.031

10.1186/s13634-016-0355-x

Russell S, 2010, Intelligence Artificielle: Avec plus de 500 Exercices

Nilsson NJ, 1998, Artificial Intelligence: a New Synthesis

10.4236/jcc.2015.35024

10.4018/IJSWIS.2017010102

10.1016/j.ijinfomgt.2018.05.004

10.1080/0144929X.2018.1502355

10.1111/poms.12737

ChenCIP ZhengJ. Improved big data analytics solution using deep learning model and real‐time sentiment data analysis approach. Paper presented at: International Conference on Brain Inspired Cognitive Systems; 2018:579‐588.

Martínez‐CastañoR PichelJC GamalloP. Polypus: a big data self‐deployable architecture for microblogging text extraction and real‐time sentiment analysis. arXiv Preprint arXiv:180103710;2018.

Khezr SN, 2015, MapReduce and its application in optimization algorithms: a comprehensive study, Majlesi J Multimedia Process, 4, 1

10.1145/1629175.1629198

Almeer MH, 2012, Cloud Hadoop map reduce for remote sensing image analysis, J Emerg Trend Comput Inform Sci, 3, 637

Nirmal VJ, 2015, Parallel implementation of big data pre‐processing algorithms for sentiment analysis of social networking data, Int J Fuzzy Math Arch, 6, 149

PovodaL BurgetR DuttaMK. Sentiment analysis based on support vector machine and big data. Paper presented at: 2016 39th International Conference on Telecommunications and Signal Processing (TSP); 2016:543‐545.

HtetH KhaingSS MyintYY. Tweets sentiment analysis for healthcare on big data processing and IoT architecture using maximum entropy classifier. Paper presented at: International Conference on Big Data Analysis and Deep Learning Applications; 2018:28‐38.

10.35940/ijrte.C5124.098319

10.3390/sym11010115

RahnamaAHA. Distributed real‐time sentiment analysis for big data social streams Paper presented at: 2014 International Conference on Control Decision and Information Technologies (CoDIT); 2014:789‐794.

LiuB BlaschE ChenY ShenD ChenG. Scalable sentiment classification for big data analysis using naive bayes classifier. Paper presented at: 2013 IEEE International Conference on Big Data; 2013:99‐104.