COVID-19 vaccine hesitancy: a social media analysis using deep learning

Serge Nyawa1, Dieudonné Tchuente1, Samuel Fosso-Wamba1
1Department of Information, Operations and Management Sciences, TBS Business School, Toulouse, France

Tóm tắt

Hesitant attitudes have been a significant issue since the development of the first vaccines—the WHO sees them as one of the most critical global health threats. The increasing use of social media to spread questionable information about vaccination strongly impacts the population’s decision to get vaccinated. Developing text classification methods that can identify hesitant messages on social media could be useful for health campaigns in their efforts to address negative influences from social media platforms and provide reliable information to support their strategies against hesitant-vaccination sentiments. This study aims to evaluate the performance of different machine learning models and deep learning methods in identifying vaccine-hesitant tweets that are being published during the COVID-19 pandemic. Our concluding remarks are that Long Short-Term Memory and Recurrent Neural Network models have outperformed traditional machine learning models on detecting vaccine-hesitant messages in social media, with an accuracy rate of 86% against 83%.

Tài liệu tham khảo

Abd Rahim, N. H., & Rafie, S. H. M. (2020). Sentiment analysis of social media data in vaccination. International Journal, 8(9). Akyildirim E., Corbet S., Efthymiou M., Guiomard C., O’Connell J., & Sensoy A. (2020). The financial market effects of international aviation disasters. International Review of Financial Analysis, 69, 101468. Alam, S. T., Ahmed, S., Ali, S. M., Sarker, S., & Kabir, G. (2021). Challenges to COVID-19 vaccine supply chain: Implications for sustainable development goals. International Journal of Production Economics, 239, 108193. Alamoodi, A. H., Zaidan, B. B., Al-Masawa, M., Taresh, S. M., Noman, S., Ahmaro, I. Y. Y., Garfan, S., Chen, J., Ahmed, M. A., Zaidan, A. A., Albahri, O. S., Aickelin, U., Thamir, N. N., Fadhil, J. A., & Salahaldin, A. (2021). Multi-perspectives systematic review on the applications of sentiment analysis for vaccine hesitancy. Computers in Biology and Medicine, 139, 104957. Anparasan, A., & Lejeune, M. (2019). Resource deployment and donation allocation for epidemic outbreaks. Annals of Operations Research, 283(1), 9–32. Anthony, M., & Bartlett, P. L. (1999). Neural Network Learning: Theoretical Foundations. Cambridge University Press. Argyris, Y. A., Monu, K., Tan, P.-N., Aarts, C., Jiang, F., & Wiseley, K. A. (2021). Using machine learning to compare provaccine and antivaccine discourse among the public on social media: Algorithm development study. JMIR Public Health and Surveillance, 7(6), e23105. Bag, S., Gupta, S., Choi, T.-M., & Kumar, A. (2021). Roles of innovation leadership on using big data analytics to establish resilient healthcare supply chains to combat the COVID-19 pandemic: A multimethodological study. IEEE Transactions on Engineering Management. https://doi.org/10.1109/TEM.2021.3101590 Bar-Lev, S., Reichman, S., & Barnett-Itzhaki, Z. (2021). Prediction of vaccine hesitancy based on social media traffic among Israeli parents using machine learning strategies. Israel Journal of Health Policy Research, 10(1), 1–8. Bhopal, R. S. (2020). COVID-19 zugzwang: Potential public health moves towards population (herd) immunity. Public Health in Practice, 1, 100031. Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992). A training algorithm for optimal margin classifiers. In: Proceedings of the fifth annual workshop on Computational learning theory (pp. 144–152). Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32. Budd, J., Miller, B. S., Manning, E. M., et al. (2020). Digital technologies in the public-health response to COVID-19. Nature Medicine, 26, 1183–1192. Chen, B., Bai, R., Li, J., Liu, Y., Xue, N., & Ren, J. (2020). A multiobjective single bus corridor scheduling using machine learning-based predictive models. International Journal of Production Research. https://doi.org/10.1080/00207543.2020.1766716 Chevallier, C., Hacquin, A. S., & Mercier, H. (2021). COVID-19 vaccine hesitancy: Shortening the last mile. Trends in Cognitive Sciences, 25(5), 331–333. Cohen, M. C. (2018). Big data and service operations. Production and Operations Management, 27(9), 1709–1723. Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297. Cotfas, L.-A., Delcea, C., & Gherai, R. (2021). COVID-19 vaccine hesitancy in the month following the start of the vaccination process. International Journal of Environmental Research and Public Health, 18(19), 10438. Cover, T., & Hart, P. (1967). Nearest neighbor pattern classification. Information Theory, 13(1), 21–27. Cui, R., Gallino, S., Moreno, A., & Zhang, D. J. (2018). The operational value of social media information. Production and Operations Management, 27(10), 1749–1769. Devroye, L., Györfi, L., & Lugosi, G. (1996). A probabilistic theory of pattern recognition. Springer. Domek, G. J., O’Leary, S. T., Bull, S., Bronsert, M., Contreras-Roldan, I. L., Ventura, G. A., Kempe, A., & Asturias, E. J. (2018). Measuring vaccine hesitancy: Field testing the WHO SAGE working group on vaccine hesitancy survey tool in Guatemala. Vaccine, 36(35), 5273–5281. Du, J., Cunningham, R. M., Xiang, Y., et al. (2020). Leveraging deep learning to understand health beliefs about the Human Papillomavirus Vaccine from social media. NPJ Digital Medicine, 2–27. Dubé, E., Vivion, M., & MacDonald, N. E. (2015). Vaccine hesitancy, vaccine refusal and the antivaccine movement: influence, impact and implications. Expert Review of Vaccines, 14(1), 99–117. Dubé, È., Ward, J. K., Verger, P., & MacDonald, N. E. (2021). Vaccine hesitancy, acceptance, and anti-vaccination: trends and future prospects for public health. Annual Review of Public Health, 42, 175–191. Dubey, R., Altay, N., & Blome, C. (2019a). Swift trust and commitment: The missing links for humanitarian supply chain coordination? Annals of Operations Research, 283(1), 159–177. Dubey, R., Gunasekaran, A., & Papadopoulos, T. (2019b). Disaster relief operations: Past, present and future. Annals of Operations Research, 283(1), 1–8. DuHadway, S., Carnovale, S., & Hazen, B. (2019). Understanding risk management for intentional supply chain disruptions: Risk detection, risk mitigation, and risk recovery. Annals of Operations Research, 283(1), 179–198. Eachempati, P., Srivastava, P. R., Kumar, A., Tan, K. H., & Gupta, S. (2021). Validating the impact of accounting disclosures on stock market: A deep neural network approach. Technological Forecasting and Social Change, 170, 120903. ElonPoll. (2020). North Carolina willingness to take COVID-19 vaccine. The Charlotte Observer, The Durham Herald-Sun & The Raleigh News & Observer. Fast, S. M., Kim, L., Cohn, E. L., Mekaru, S. R., Brownstein, J. S., & Markuzon, N. (2018). Predicting social response to infectious disease outbreaks from internet-based news streams. Annals of Operations Research, 263(1), 551–564. Fornell, C., Larcker, D. F., & MacDonald, N. E. (2015). Vaccine hesitancy: Definition, scope and determinants. Journal of Marketing Research, 18(34), 4161–4164. Freeman, D., Waite, F., Rosebrock, L., Petit, A., Causier, C., East, A., & Lambe, S. (2022). Coronavirus conspiracy beliefs, mistrust, and compliance with government guidelines in England. Psychological Medicine, 52(2), 251–263. Freund, Y., & Schapire, R. E. (1995). A decision-theoretic generalization of on-line learning and an application to boosting. In European Conference on Computational Learning Theory, pp. 23–37. Furini, M. (2021). Identifying the features of ProVax and NoVax groups from social media conversations. Computers in Human Behavior, 120, 106751. Germani, F., & Biller-Andorno, N. (2021). The anti-vaccination infodemic on social media: A behavioral analysis. PLoS ONE, 16(3), e0247642. Graves, A., Mohamed, A., & Hinton, G. (2013). Speech recognition with deep recurrent neural networks. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), no. 3, pp. 6645–6649. Griffith, D. A., Boehmke, B., Bradley, R. V., Hazen, B. T., & Johnson, A. W. (2019). Embedded analytics: Improving decision support for humanitarian logistics operations. Annals of Operations Research, 283(1), 247–265. Gu, S., Kelly, B., & Xiu, D. (2020). Empirical asset pricing via machine learning. The Review of Financial Studies, 33, 2223–2273. Gupta, M., Shoja, A., & Mikalef, P. (2021). Toward the understanding of national culture in the success of non-pharmaceutical technological interventions in mitigating COVID-19 pandemic. Annals of Operations Research. https://doi.org/10.1007/s10479-021-03962-z Hussain, A., Tahir, A., Hussain, Z., Sheikh, Z., Gogate, M., Dashtipour, K., Ali, A., & Sheikh, A. (2021). Artificial intelligence–enabled analysis of public attitudes on facebook and twitter toward covid-19 vaccines in the united kingdom and the united states: Observational study. Journal of Medical Internet Research, 23(4), e26627. Ivanov, D., & Dolgui, A. (2020). Viability of intertwined supply networks: extending the supply chain resilience angles towards survivability. A position paper motivated by COVID-19 outbreak. International Journal of Production Research, 58(10), 2904–2915. Jiang, X., Su, M.-H., Hwang, J., Lian, R., Brauer, M., Kim, S., & Chin, J. (2021). Identifying false human papillomavirus (HPV) vaccine information and corresponding risk perceptions from twitter: advanced predictive models. Journal of Medical Internet Research, 23(9), 20563051211048412. Kapoor, K., Bigdeli, A. Z., Dwivedi, Y. K., & Raman, R. (2021). How is COVID-19 altering the manufacturing landscape? A literature review of imminent challenges and management interventions. Annals of Operations Research. https://doi.org/10.1007/s10479-021-04397-2 Karafillakis, E., Martin, S., Simas, C., Olsson, K., Takacs, J., Dada, S., & Larson, H. J. (2021). Methods for social media monitoring related to vaccination: Systematic scoping review. JMIR Public Health and Surveillance, 7(2), e17149. Karami, A., Zhu, M., Goldschmidt, B., Boyajieff, H. R., & Najafabadi, M. M. (2021). COVID-19 vaccine and social media in the US: Exploring emotions and discussions on twitter. Vaccines, 9(10), 1059. Kumar, A., Choi, T. M., Wamba, S. F., Gupta, S., & Tan, K. H. (2021a). Infection vulnerability stratification risk modelling of COVID-19 data: A deterministic SEIR epidemic model analysis. Annals of Operations Research, 4, 1–27. Kumar, A., Gopal, R. D., Shankar, R., & Tan, K. H. (2022). Fraudulent review detection model focusing on emotional expressions and explicit aspects: Investigating the potential of feature engineering. Decision Support Systems, 155, 113728. Kumar, A., Shankar, R., & Aljohani, N. (2020). A big data driven framework for demand-driven forecasting with effects of marketing-mix variables. Industrial Marketing Management, 90, 493–507. Kumar, A., Shankar, R., Choudhary, A., & Thakur, L. (2018). A big data MapReduce framework for fault diagnosis in cloud-based manufacturing. International Journal of Production Research, 27, 428–439. Kumar, A., Shankar, R., & Thakur, L. (2016). A big data driven sustainable manufacturing framework for condition-based maintenance prediction. Journal of Computational Science, 54, 7060–7073. Kumar, S., Xu, C., Ghildayal, N., Chandra, C., & Yang, M. (2021b). Social media effectiveness as a humanitarian response to mitigate influenza epidemic and COVID-19 pandemic. Annals of Operations Research. https://doi.org/10.1007/s10479-021-03955-y Kusiak, A. (2020). Convolutional and generative adversarial neural networks in manufacturing. International Journal of Production Research, 58(5), 1594–1604. Kwok, S. W. H., Vadde, S. K., & Wang, G. (2021). Twitter speaks: An analysis of Australian twitter users’ topics and sentiments about COVID-19 vaccination using machine learning. Journal of Medical Internet Research. https://doi.org/10.2196/26953 Lazarus, J. V., Ratzan, S. C., Palayew, A. Gostin, L. O., Larson, H. J., Rabin, K., Kimball, S., & El-Mohandes, A. (2021). A global survey of potential acceptance of a Covid-19 vaccine. Nature Medicine, 27, 225–228. Ma, P., Zeng-Treitler, Q., & Nelson, S. J. (2021). Use of two topic modeling methods to investigate covid vaccine hesitancy. International Conference on ICT, Society and Human Beings, 384, 221–226. Majumdar, P., Biswas, A., & Sahu S. (2020). COVID-19 pandemic and lockdown: Cause of sleep disruption, depression, somatic pain, and increased screen exposure of office workers and students of India. Chronobiology International, 37(8), 1191–1200. Martinez-Rojas, M., del Carmen Pardo-Ferreira, M., & Rubio-Romero, J. C. (2018). Twitter as a tool for the management and analysis of emergency situations: A systematic literature review. International Journal of Information Management, 43, 196–208. Mishra, N., & Singh, A. (2018). Use of twitter data for waste minimisation in beef supply chain. Annals of Operations Research, 270(1), 337–359. Moorhead, S. A., Hazlett, D. E., Harrison, L., Carroll, J. K., Irwin, A., & Hoving, C. (2013). A new dimension of health care: Systematic review of the uses, benefits, and limitations of social media for health communication. Journal of Medical Internet Research, 15(4), e1933. Narazaki, H., & Shigaki, I. (1999). A machine-learning approach for a sintering process using a neural network. Production Planning and Control, 10(8), 727–734. Odone, A., Gianfredi, V., Sorbello, S., Capraro, M., Frascella, B., Vigezzi, G. P., & Signorelli, C. (2021). The use of digital technologies to support vaccination programmes in Europe: State of the art and best practices from experts’ interviews. Vaccines, 9, 1126. Palamenghi, L., Barello, S., Boccia, S., & Graffigna, G. (2020). Mistrust in biomedical research and vaccine hesitancy: The forefront challenge in the battle against Covid-19 in Italy. European Journal of Epidemiology, 35(8), 785–788. Piedrahita-Valdés, H., Piedrahita-Castillo, D., Bermejo-Higuera, J., Guillem-Saiz, P., Bermejo-Higuera, J. R., Guillem-Saiz, J., Sicilia-Montalvo, J. A., & Machío-Regidor, F. (2021). Vaccine hesitancy on social media: Sentiment analysis from June 2011 to April 2019. Vaccines, 9(1), 28. Pujawan, I. N., & Bah, A. U. (2021). Supply chains under COVID-19 disruptions: literature review and research agenda. In Supply Chain Forum: An International Journal, pp. 1–15. Taylor & Francis. Qayyum, A., Razzak, I., Tanveer, M., & Kumar, A. (2021). Depth-wise dense neural network for automatic COVID19 infection detection and diagnosis. Annals of operations research. https://doi.org/10.1007/s10479-021-04154-5 Queiroz, M. M., Ivanov, D., Dolgui, A., & Wamba, S. F. (2020). Impacts of epidemic outbreaks on supply chains: Mapping a research agenda amid the COVID-19 pandemic through a structured literature review. Annals of Operations Research. https://doi.org/10.1007/s10479-020-03685-7 Quyen, T., To, K. G., Huynh, V. -A. N., Nguyen, N. T. Q., Ngo, D. T. N., Alley, S. J., Tran, A. N. Q., Tran, A. N. P., Pham, N. T. T., Bui, T. X., et al. (2021). Applying machine learning to identify anti-vaccination tweets during the COVID-19 pandemic. International Journal of Environmental Research and Public Health, 18, 4069. Reinhardt, A., & Rossmann, C. (2021). Age-related framing effects: Why vaccination against COVID-19 should be promoted differently in younger and older adults. Journal of Experimental Psychology: Applied, 27(4), 669–678. Researcher, C. Q. (2020). Issues for debate in american public policy: Selections from CQ researcher (pp. 22). SAGE Publications. Rodríguez-González, A., Tuñas, J. M., Prieto Santamaría, L., FernándezPeces-Barba, D., Menasalvas Ruiz, E., Jaramillo, A., Cotarelo, M., ConejoFernández, A. J., Arce, A., & Gil, A. (2020). Identifying polarity in tweets from an imbalanced dataset about diseases and vaccines using a meta-model based on machine learning techniques. Applied Sciences, 10(24), 9019. Sear, R. F., Velásquez, N., Leahy, R., Restrepo, N. J., El Oud, S., Gabriel, N., Lupu, Y., & Johnson, N. F. (2020). Quantifying COVID-19 content in the online health opinion war using machine learning. IEEE Access, 8, 91886–91893. Shalev-Shwartz, S., & Ben-David, S. (2014). Understanding machine learning: From theory to algorithms. Cambridge University Press. Singh, J. P., Dwivedi, Y. K., Rana, N. P., Kumar, A., & Kapoor, K. K. (2019). Event classification and location prediction from tweets during disasters. Annals of Operations Research, 283(1), 737–757. Skinner, G. (2020). Who’s least likely to say they’ll get a Covid-19 vaccine? Ipsos Mori. https://www.ipsos.com/ipsosmori/en-uk/whos-least-likely-say-theyll-get-covid-19-vaccine. Tavoschi, L., Quattrone, F., D’Andrea, E., Ducange, P., Vabanesi, M., Marcelloni, F., & Lopalco, P. L. (2020). Twitter as a sentinel tool to monitor public opinion on vaccination: An opinion mining analysis from September 2016 to August 2017 in Italy. Human Vaccines & Immunotherapeutics, 16(5), 1062–1069. Tchuente, D., & Nyawa, S. (2021). Real estate price estimation in French cities using geocoding and machine learning. Annals of Operations Research, 308(1), 571–608. Thelwall, M., Kousha, K., & Thelwall, S. (2021). Covid-19 vaccine hesitancy on English-language Twitter. Profesional de la información, 30(2), e300212. To, Q. G., To, K. G., Huynh, V. A., Nguyen, N. T., Ngo, D. T., Alley, S. J., Tran, A. N., Tran, A. N., Pham, N. T., Bui, T. X., & Vandelanotte, C. (2021). Applying machine learning to identify anti-vaccination tweets during the COVID-19 pandemic. International Journal of Environmental Research and Public Health, 18(8), 4069. Tomaszewski, T., Morales, A., Lourentzou, I., Caskey, R., Liu, B., Schwartz, A., & Chin, J. (2021). Identifying false human papillomavirus (HPV) vaccine information and corresponding risk perceptions from twitter: Advanced predictive models. Journal of Medical Internet Research, 23(9), e30451. Verelst, F., Kessels, R., Delva, W., Beutels, P., & Willem, L. (2019). Drivers of vaccine decision-making in South Africa: A discrete choice experiment. Vaccine, 37(15), 2079–2089. Wagner, A. L., Huang, Z., Ren, J., Laffoon, M., Ji, M., Pinckney, L. C., Sun, X., Prosser, L. A., Boulton, M. L., & Zikmund-Fisher, B. J. (2020). Vaccine hesitancy and concerns about vaccine safety and effectiveness in Shanghai, China. American Journal of Preventive Medicine, 60(1), S77–S86. Wamba, S. F., Edwards, A., & Akter, S. (2019). Social media adoption and use for improved emergency services operations: The case of the NSW SES. Annals of Operations Research, 283(1), 225–245. Wang, Z., Yin, Z., & Argyris, Y. A. (2020). Detecting medical misinformation on social media using multimodal deep learning. IEEE Journal of Biomedical and Health Informatics, 25(6), 2193–2203. Xiong, Y., Lam, H. K. S., Kumar, A., Ngai, E. W. T., Xiu, C., & Wang, X. (2021). The mitigating role of blockchain-enabled supply chains during the COVID-19 pandemic. International Journal of Operations & Production Management, 41(9), 1495–1521. Yuan, X., Schuchard, R. J., & Crooks, A. T. (2019). Examining emergent communities and social bots within the polarized online vaccination debate in Twitter. Social Media + Society, 5(3), 205630511986546. Zhang, S., Zhang, C., & Yang, Q. (2003). Data preparation for data mining. Applied Artificial Intelligence, 17, 375–381. Zhang, L., Fan, H., Peng, C., Rao, G., & Cong, Q. (2020). Sentiment analysis methods for HPV vaccines related tweets based on transfer learning. Healthcare, 8, 307. Zhou, X., Coiera, E., Tsafnat, G., Arachi, D., Ong, M.-S., & Dunn, A. G. (2015). Using social connection information to improve opinion mining: Identifying negative sentiment about HPV vaccines on Twitter.