Machine Learning in Detecting COVID-19 Misinformation on Twitter

Future Internet - Tập 13 Số 10 - Trang 244
Mohammed N. Alenezi1, Zainab M. AlQenaei2
1Computer Science and Information Systems Department, The Public Authority for Applied Education and Training, Safat 13147, Kuwait
2Information Systems and Operations Management Department, Kuwait University, Safat 13055, Kuwait

Tóm tắt

Social media platforms such as Facebook, Instagram, and Twitter are an inevitable part of our daily lives. These social media platforms are effective tools for disseminating news, photos, and other types of information. In addition to the positives of the convenience of these platforms, they are often used for propagating malicious data or information. This misinformation may misguide users and even have dangerous impact on society’s culture, economics, and healthcare. The propagation of this enormous amount of misinformation is difficult to counter. Hence, the spread of misinformation related to the COVID-19 pandemic, and its treatment and vaccination may lead to severe challenges for each country’s frontline workers. Therefore, it is essential to build an effective machine-learning (ML) misinformation-detection model for identifying the misinformation regarding COVID-19. In this paper, we propose three effective misinformation detection models. The proposed models are long short-term memory (LSTM) networks, which is a special type of RNN; a multichannel convolutional neural network (MC-CNN); and k-nearest neighbors (KNN). Simulations were conducted to evaluate the performance of the proposed models in terms of various evaluation metrics. The proposed models obtained superior results to those from the literature.

Từ khóa


Tài liệu tham khảo

(2021, March 20). ITU—Facts and Figures 2020—Interactive Report. Available online: https://www.itu.int/en/ITU-D/Statistics/Pages/ff2020interactive.aspx.

Philander, 2016, Twitter sentiment analysis: Capturing sentiment from integrated resort tweets, Int. J. Hosp. Manag., 55, 16, 10.1016/j.ijhm.2016.02.001

Durier, F., Vieira, R., and Garcia, A.C. (2019, January 8–11). Can Machines Learn to Detect Fake News? A Survey Focused on Social Media. Proceedings of the 52nd Hawaii International Conference on System Sciences, HICSS, Grand Wailea, Maui, HI, USA.

Thota, 2018, Fake News Detection: A Deep Learning Approach, SMU Data Sci. Rev., 1, 10

Sun, 2015, Combining Online News Articles and Web Search to Predict the Fluctuation of Real Estate Market in Big Data Context, Pac. Asia J. Assoc. Inf. Syst., 6, 2

Alaei, 2019, Sentiment Analysis in Tourism: Capitalizing on Big Data, J. Travel Res., 58, 175, 10.1177/0047287517747753

Alnawas, A., and Arici, N. (2019). Sentiment Analysis of Iraqi Arabic Dialect on Facebook Based on Distributed Representations of Documents. ACM Trans. Asian Low-Resour. Lang. Inf. Process., 18.

Qawasmeh, 2018, Deep Recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews, J. Comput. Sci., 27, 386, 10.1016/j.jocs.2017.11.006

Hwang, S.Y., Lai, C., Jiang, J.J., and Chang, S. (2014). The Identification of Noteworthy Hotel Reviews for Hotel Management. Pac. Asia J. Assoc. Inf. Syst., 6.

Binder, M., Heinrich, B., Klier, M., Obermeier, A., and Schiller, A. (2019, January 8–14). Explaining the Stars: Aspect-based Sentiment Analysis of Online Customer Reviews. Proceedings of the 27th European Conference on Information Systems—Information Systems for a Sharing Society, ECIS, Stockholm and Uppsala, Sweden.

Ceron, 2015, Using Sentiment Analysis to Monitor Electoral Campaigns: Method Matters—Evidence From the United States and Italy, Soc. Sci. Comput. Rev., 33, 3, 10.1177/0894439314521983

Sandoval-Almazan, R., and Valle-Cruz, D. (2020). Sentiment Analysis of Facebook Users Reacting to Political Campaign Posts. Digit. Gov. Res. Pract., 1.

Davcheva, E. (2018, January 23–28). Text Mining Mental Health Forums-Learning From User Experiences. Proceedings of the ECIS 2018, Portsmouth, UK.

Deng, 2018, The Interaction between Microblog Sentiment and Stock Returns: An Empirical Examination, MIS Q., 42, 895, 10.25300/MISQ/2018/14268

Deng, S., Kwak, D.H., Wu, J., Sinha, A., and Zhao, H. (2018, January 13–16). Classifying Investor Sentiment in Microblogs: A Transfer Learning Approach. Proceedings of the International Conference on Information Systems (ICIS 2018), San Francisco, CA, USA.

Jost, 2019, How positive is “change” in climate change? A sentiment analysis, Environ. Sci. Policy, 96, 27, 10.1016/j.envsci.2019.02.007

Wollmer, 2013, YouTube Movie Reviews: Sentiment Analysis in an Audio-Visual Context, IEEE Intell. Syst., 28, 46, 10.1109/MIS.2013.34

Yan, Z., Xing, M., Zhang, D., Ma, B., and Wang, T. (2014, January 14–17). A Context-Dependent Sentiment Analysis of Online Product Reviews based on Dependency Relationships. Proceedings of the 35th International Conference on Information Systems: Building a Better World Through Information Systems, ICIS, Auckland, New Zealand.

Srivastava, 2017, Assessment, Implication, and Analysis of Online Consumer Reviews: A Literature Review, Pac. Asia J. Assoc. Inf. Syst., 9, 43

Lak, 2017, The Impact of Sentiment Analysis Output on Decision Outcomes: An Empirical Evaluation, AIS Trans. Hum. Comput. Interact., 9, 1, 10.17705/1thci.00086

Moravec, P.L., Kim, A., and Dennis, A.R. (2018, January 13–16). Flagging fake news: System 1 vs. System 2. Proceedings of the International Conference on Information Systems (ICIS 2018), San Francisco, CA, USA.

Abbott, 1968, Letters to the Editor: Gathering of Misleading Data with Little Regard for Privacy, Commun. ACM, 11, 377, 10.1145/363095.363135

Loftus, 1979, Reacting to blatantly contradictory information, Mem. Cogn., 7, 368, 10.3758/BF03196941

Wessel, M., Thies, F., and Benlian, A. (2015, January 26–29). A Lie Never Lives to be Old: The Effects of Fake Social Information on Consumer Decision-Making in Crowdfunding. Proceedings of the European Conference on Information Systems, Münster, Germany.

Allcott, 2017, Social Media and Fake News in the 2016 Election, J. Econ. Perspect., 31, 211, 10.1257/jep.31.2.211

Rosenberg, 2018, From Flawed Design to Misleading Information: The U.S. Department of Education’s Early Intervention Child Outcomes Evaluation, Am. J. Eval., 39, 350, 10.1177/1098214017732410

Bianchini, 2019, Avoiding misleading information: A study of complementary medicine online information for cancer patients, Libr. Inf. Sci. Res., 41, 67, 10.1016/j.lisr.2019.02.006

Commision, E. (2021, May 09). Tackling Online Disinformation. Available online: https://digital-strategy.ec.europa.eu/en/policies/online-disinformation.

UNESCO (2021, May 09). Fake News: Disinformation in Media. Available online: https://en.unesco.org/news/unesco-published-handbook-fake-news-and-disinformation-media.

Hou, R., Pérez-Rosas, V., Loeb, S., and Mihalcea, R. (2019, January 14–18). Towards Automatic Detection of Misinformation in Online Medical Videos. Proceedings of the 2019 International Conference on Multimodal Interaction, Suzhou, China.

Bautista, 2021, Healthcare professionals’ acts of correcting health misinformation on social media, Int. J. Med. Inform., 148, 104375, 10.1016/j.ijmedinf.2021.104375

2021, Prevalence of Health Misinformation on Social Media: Systematic Review, J. Med. Internet Res., 23, e17187, 10.2196/17187

Van Bavel, J., Boggio, P., Capraro, V., Cichocka, A., Cikara, M., Crockett, M., Crum, A., Douglas, K., Druckman, J., and Drury, J. (2020). Using social and behavioural science to support COVID-19 pandemic response. Nat. Hum. Behav., 460–471.

Venkatesan, S., Han, W., Kisekka, V., Sharman, R., Kudumula, V., and Jaswal, H.S. (2013, January 14). Misinformation in Online Health Communities. Proceedings of the Eighth Pre-ICIS Workshop on Information Security and Privacy, Milano, Italy.

Chou, W.S., Sciences, P., Cancer, N., Oh, A., Sciences, P., Cancer, N., Klein, W.M.P., Sciences, P., and Cancer, N. (2017). The Persistence and Peril of Misinformation. Am. Sci., 372.

Li, Y.J., Cheung, C.M., Shen, X.L., and Lee, M.K. (2019, January 8–12). Health Misinformation on Social Media: A Literature Review. Proceedings of the 23rd Pacific Asia Conference on Information Systems: Secure ICT Platform for the 4th Industrial Revolution, PACIS, Xi’an, China.

(2021, March 20). Coronavirus DISEASE (COVID-19) Pandemic. Available online: https://www.who.int/emergencies/diseases/novel-coronavirus-2019.

(2021, February 20). Munich Security Conference. Available online: https://www.who.int/director-general/speeches/detail/munich-security-conference.

Fell, L. (2020). Trust and COVID-19: Implications for Interpersonal, Workplace, Institutional, and Information-Based Trust. Digit. Gov. Res. Pract., 2.

Bode, 2017, See Something, Say Something: Correction of Global Health Misinformation on Social Media, Health Commun., 33, 1

Gu, R., and Li, M.X. (2021, August 19). Investigating the Psychological Mechanism of Individuals’ Health Misinformation Dissemination on Social Media. Available online: https://scholars.hkbu.edu.hk/en/publications/investigating-the-psychological-mechanism-of-individuals-health-m.

Lazer, 2020, Public Health and Online Misinformation: Challenges and Recommendations, Annu. Rev. Public Health, 41, 433, 10.1146/annurev-publhealth-040119-094127

Ghenai, A. (2017, January 7–11). Health Misinformation in Search and Social Media. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’17), Tokyo, Japan.

Khan, 2021, Fake news outbreak 2021: Can we stop the viral spread?, J. Netw. Comput. Appl., 190, 103112, 10.1016/j.jnca.2021.103112

Apuke, 2021, Social media affordances and information abundance: Enabling fake news sharing during the COVID-19 health crisis, Health Inform. J., 27, 14604582211021470, 10.1177/14604582211021470

Southwell, B., Niederdeppe, J., Cappella, J., Gaysynsky, A., Kelley, D., Oh, A., Peterson, E., and Chou, W.Y. (2019). Misinformation as a Misunderstood Challenge to Public Health. Am. J. Prev. Med., 57.

Tasnim, 2020, Impact of Rumors and Misinformation on COVID-19 in Social Media, J. Prev. Med. Public Health, 53, 171, 10.3961/jpmph.20.094

Vraga, E., and Bode, L. (2021). Addressing COVID-19 Misinformation on Social Media Preemptively and Responsively. Emerg. Infect. Dis., 27.

Zhou, X., and Zafarani, R. (2020). A Survey of Fake News: Fundamental Theories, Detection Methods, and Opportunities. ACM Comput. Surv., 53.

Obiala, 2021, COVID-19 misinformation: Accuracy of articles about coronavirus prevention mostly shared on social media, Health Policy Technol., 10, 182, 10.1016/j.hlpt.2020.10.007

Apuke, 2021, Fake news and COVID-19: Modelling the predictors of fake news sharing among social media users, Telemat. Inform., 56, 101475, 10.1016/j.tele.2020.101475

Jonathan, G.M., and Jonathan, G.M. (2021, August 19). Exploring Social Media Use during a Public Health Emergency in Africa: The COVID-19 Pandemic. Available online: https://www.researchgate.net/publication/345877480_Exploring_Social_Media_Use_During_a_Public_Health_Emergency_in_Africa_The_COVID-19_Pandemic.

Islam, 2020, Misinformation sharing and social media fatigue during COVID-19: An affordance and cognitive load perspective, Technol. Forecast. Soc. Chang., 159, 120201, 10.1016/j.techfore.2020.120201

Bastani, P., and Bahrami, M. (2020). COVID-19 Related Misinformation on Social Media: A Qualitative Study from Iran (Preprint). J. Med. Internet Res.

Chakraborty, 2020, Sentiment Analysis of COVID-19 tweets by Deep Learning Classifiers—A study to show how popularity is affecting accuracy in social media, Appl. Soft Comput., 97, 106754, 10.1016/j.asoc.2020.106754

Pennycook, 2020, Fighting COVID-19 Misinformation on Social Media: Experimental Evidence for a Scalable Accuracy-Nudge Intervention, Psychol. Sci., 31, 770, 10.1177/0956797620939054

Mejova, Y., and Kalimeri, K. (2020, January 15–17). COVID-19 on Facebook Ads: Competing Agendas around a Public Health Crisis. Proceedings of the 3rd ACM SIGCAS Conference on Computing and Sustainable Societies, Guayaquil, Ecuador.

Dimitrov, D., Baran, E., Fafalios, P., Yu, R., Zhu, X., Zloch, M., and Dietze, S. (2020, January 19–23). TweetsCOV19—A Knowledge Base of Semantically Annotated Tweets about the COVID-19 Pandemic. Proceedings of the 29th ACM International Conference on Information & Knowledge Management (CIKM’20), Online.

Aphiwongsophon, 2020, Identifying misinformation on Twitter with a support vector machine, Eng. Appl. Sci. Res., 47, 306

Deokate, S.B. (2019). Fake News Detection using Support Vector Machine learning Algorithm. Int. J. Res. Appl. Sci. Eng. Technol. (IJRASET), Available online: https://www.researchgate.net/publication/336465014_Fake_News_Detection_using_Support_Vector_Machine_learning_Algorithm.

Ciprian-Gabriel, C., Coca, G., and Iftene, A. (2018, January 22–23). Identifying Fake News on Twitter Using Naïve Bayes, Svm And Random Forest Distributed Algorithms. Proceedings of the 13th Edition of the International Conference on Linguistic Resources and Tools for Processing Romanian Language (ConsILR-2018), Bucharest, Romania.

Shmueli, G., Bruce, P.C., Gedeck, P., and Patel, N.R. (2019). Data Mining for Business Analytics: Concepts, Techniques and Applications in Python, John Wiley & Sons.

Kolbe, 2010, Efficient k-nearest neighbor searching in nonordered discrete data spaces, ACM Trans. Inf. Syst. (TOIS), 28, 1, 10.1145/1740592.1740595

Cunningham, 2021, k-Nearest Neighbour Classifiers-A Tutorial, ACM Comput. Surv. (CSUR), 54, 1, 10.1145/3459665

Ali, 2020, Semantic-k-NN algorithm: An enhanced version of traditional k-NN algorithm, Expert Syst. Appl., 151, 113374, 10.1016/j.eswa.2020.113374

Mokhtar, 2019, Fakebuster: Fake News Detection System Using Logistic Regression Technique In Machine Learning, Int. J. Eng. Adv. Technol. (IJEAT), 9, 2407, 10.35940/ijeat.A2633.109119

Ogdol, J.M.G., Samar, B.L.T., and Catarroja, C. (2018). Binary Logistic Regression based Classifier for Fake News. J. High. Educ. Res. Discip., Available online: http://www.nmsc.edu.ph/ojs/index.php/jherd/article/view/98.

Nada, 2019, Fake News Detection using Binary Logistic Regression, Int. Res. J. Eng. Technol. (IRJET), 8, 1705

Bharti, 2020, Fake News Detection Using Logistic Regression, Sentiment Analysis and Web Scraping, Int. J. Adv. Sci. Technol., 29, 1157

Ghosh, A., Sufian, A., Sultana, F., Chakrabarti, A., and De, D. (2020). Fundamental concepts of convolutional neural network. Recent Trends and Advances in Artificial Intelligence and Internet of Things, Springer.

Bai, 2020, Adversarial multi-view networks for activity recognition, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 4, 1

Chen, J., Yang, Y.t., Hu, K.k., Zheng, H.b., and Wang, Z. (2019, January 22–24). DAD-MCNN: DDoS attack detection via multi-channel CNN. Proceedings of the 2019 11th International Conference on Machine Learning and Computing, Zhuhai, China.

Bahdanau, D., Cho, K., and Bengio, Y. (2015). Neural Machine Translation by Jointly Learning to Align and Translate. arXiv.

Ruchansky, N., Seo, S., and Liu, Y. (2017, January 6–10). CSI: A Hybrid Deep Model for Fake News Detection. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (CIKM’17), Singapore.

Cui, L., Wang, S., and Lee, D. (2019, January 27–30). SAME: Sentiment-Aware Multi-Modal Embedding for Detecting Fake News. Proceedings of the 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM ’19), Vancouver, BC, Canada.

Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., and Hovy, E. (2016, January 12–17). Hierarchical Attention Networks for Document Classification. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.

Cui, L., Shu, K., Wang, S., Lee, D., and Liu, H. (2019, January 3–7). DEFEND: A System for Explainable Fake News Detection. Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM ’19), Beijing, China.

Cui, L., and Lee, D. (2020). CoAID: COVID-19 Healthcare Misinformation Dataset. arXiv.

Jamison, 2020, Adapting and extending a typology to identify vaccine misinformation on twitter, Am. J. Public Health, 110, S331, 10.2105/AJPH.2020.305940

Hartwig, K., and Reuter, C. (2019, January 23–27). TrustyTweet: An Indicator-based Browser-Plugin to Assist Users in Dealing with Fake News on Twitter. Proceedings of the WI 2019, the 14th International Conference on Business Informatics, AIS eLibrary, Siegen, Germany. Available online: https://aisel.aisnet.org/wi2019/specialtrack01/papers/5/.

Memon, S.A., and Carley, K.M. (2020). Characterizing COVID-19 Misinformation Communities Using a Novel Twitter Dataset. arXiv.

Shahi, 2020, An Exploratory Study of COVID-19 Misinformation on Twitter, Online Soc. Netw. Media, 22, 100104, 10.1016/j.osnem.2020.100104

Singh, L., Bansal, S., Bode, L., Budak, C., Chi, G., Kawintiranon, K., Padden, C., Vanarsdall, R., Vraga, E., and Wang, Y. (2020). A first look at COVID-19 information and misinformation sharing on Twitter. arXiv.

Alqurashi, S., Hamawi, B., Alashaikh, A., Alhindi, A., and Alanazi, E. (2021). Eating Garlic Prevents COVID-19 Infection: Detecting Misinformation on the Arabic Content of Twitter. arXiv.

Girgis, S., Amer, E., and Gadallah, M. (2018, January 18–19). Deep Learning Algorithms for Detecting Fake News in Online Text. Proceedings of the 2018 13th International Conference on Computer Engineering and Systems (ICCES), Cairo, Egypt.

Hossain, T., Logan IV, R.L., Ugarte, A., Matsubara, Y., Young, S., and Singh, S. (2021, August 19). COVIDLies: Detecting COVID-19 Misinformation on Social Media. Available online: https://openreview.net/pdf?id=FCna-s-ZaIE.

Shahi, G.K., and Nandini, D. (2020, January 8–11). FakeCovid—A Multilingual Cross-domain Fact Check News Dataset for COVID-19. Proceedings of the 14th International AAAI Conference on Web and Social Media, Atlanta, GA, USA.

Zhou, X., Mulay, A., Ferrara, E., and Zafarani, R. (2018, January 22–26). ReCOVery: A Multimodal Repository for COVID-19 News Credibility Research. Proceedings of the 29th ACM International Conference on Information & Knowledge Management (CIKM 20), Turin, Italy.

Hossin, 2015, A Review on Evaluation Metrics for Data Classification Evaluations, Int. J. Data Min. Knowl. Manag. Process, 5, 1, 10.5121/ijdkp.2015.5201

Ahmad, 2020, Fake News Detection Using Machine Learning Ensemble Methods, Complexity, 2020, 8885861, 10.1155/2020/8885861