Infodemic Signal Detection During the COVID-19 Pandemic: Development of a Methodology for Identifying Potential Information Voids in Online Conversations

JMIR Publications Inc. - Tập 1 Số 1 - Trang e30971
Tina D. Purnat, Paolo Vacca, Christine Czerniak, Sarah Ball, Stefano Burzo, Tim Zecchin, Amy Wright, Supriya Bezbaruah, Faizza Tanggol, Ève Dubé1, Fabienne Labbé2,1, Maude Dionne, Jaya Lamichhane, Avichal Mahajan, Sylvie Briand, Tim Nguyen
1Institut national de santé publique du Québec, Canada
2Centre de Recherche et de Documentation sur l'Océanie

Tóm tắt

Background The COVID-19 pandemic has been accompanied by an infodemic: excess information, including false or misleading information, in digital and physical environments during an acute public health event. This infodemic is leading to confusion and risk-taking behaviors that can be harmful to health, as well as to mistrust in health authorities and public health responses. The World Health Organization (WHO) is working to develop tools to provide an evidence-based response to the infodemic, enabling prioritization of health response activities. Objective In this work, we aimed to develop a practical, structured approach to identify narratives in public online conversations on social media platforms where concerns or confusion exist or where narratives are gaining traction, thus providing actionable data to help the WHO prioritize its response efforts to address the COVID-19 infodemic. Methods We developed a taxonomy to filter global public conversations in English and French related to COVID-19 on social media into 5 categories with 35 subcategories. The taxonomy and its implementation were validated for retrieval precision and recall, and they were reviewed and adapted as language about the pandemic in online conversations changed over time. The aggregated data for each subcategory were analyzed on a weekly basis by volume, velocity, and presence of questions to detect signals of information voids with potential for confusion or where mis- or disinformation may thrive. A human analyst reviewed and identified potential information voids and sources of confusion, and quantitative data were used to provide insights on emerging narratives, influencers, and public reactions to COVID-19–related topics. Results A COVID-19 public health social listening taxonomy was developed, validated, and applied to filter relevant content for more focused analysis. A weekly analysis of public online conversations since March 23, 2020, enabled quantification of shifting interests in public health–related topics concerning the pandemic, and the analysis demonstrated recurring voids of verified health information. This approach therefore focuses on the detection of infodemic signals to generate actionable insights to rapidly inform decision-making for a more targeted and adaptive response, including risk communication. Conclusions This approach has been successfully applied to identify and analyze infodemic signals, particularly information voids, to inform the COVID-19 pandemic response. More broadly, the results have demonstrated the importance of ongoing monitoring and analysis of public online conversations, as information voids frequently recur and narratives shift over time. The approach is being piloted in individual countries and WHO regions to generate localized insights and actions; meanwhile, a pilot of an artificial intelligence–based social listening platform is using this taxonomy to aggregate and compare online conversations across 20 countries. Beyond the COVID-19 pandemic, the taxonomy and methodology may be adapted for fast deployment in future public health events, and they could form the basis of a routine social listening program for health preparedness and response planning.

Từ khóa


Tài liệu tham khảo

10.2196/19659

Coronavirus disease 2019 (COVID-19) Situation Report 100: 29 April 2020World Health Organization202004292021-07-16https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200429-sitrep-100-covid-19.pdf?sfvrsn=bbfbf3d1_6

ShaneTNoelPData deficits: why we need to monitor the demand and supply of information in real timeFirst Draft News202009282021-07-16https://firstdraftnews.org/long-form-article/data-deficits/

Coronavirus disease 2019 (COVID-19) Situation Report 128: 27 May 2020World Health Organization202005272021-07-16https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200527-covid-19-sitrep-128.pdf?sfvrsn=11720c0a_2

ZecchinTWHO ad-hoc online consultation on managing the COVID-19 infodemicWorld Health Organization2021-07-16https://www.who.int/teams/risk-communication/infodemic-management/who-ad-hoc-online-consultation-on-managing-the-covid-19-infodemic

10.2196/jmir.1157

10.1016/S0002-9343(02)01473-0

WHO public health research agenda for managing infodemicsWorld Health Organization202102032021-07-16https://www.who.int/publications/i/item/9789240019508

10.1016/j.ipm.2020.102440

VicolDTannousNBelesiotisPTchakerianNHealth misinformation in Africa, Latin America and the UK: Impacts and possible solutionsFull Fact2020052021-07-16https://fullfact.org/media/uploads/en-tackling-health-misinfo.pdf

Risk communication and community engagement readiness and response to coronavirus disease (COVID-19): interim guidance, 19 March 2020World Health Organization202003192021-07-16https://www.who.int/publications-detail/risk-communication-and-community-engagement-readiness-and-initial-response-for-novel-coronaviruses-(-ncov)

WHO outbreak communication guidelinesWorld Health Organization202001152021-07-16https://www.who.int/publications/i/item/who-outbreak-communication-guidelines

PurnatTWilhelmEBuilding systems for respond to infodemics and build resilience to misinformationLinkedIn202012022021-07-16https://www.linkedin.com/pulse/building-systems-respond-infodemics-build-resilience-tina-d-purnat/

10.1111/hir.12247

10.1371/journal.pone.0014118

10.1371/journal.pone.0019467

10.1177/0268580920914755

10.1093/ofid/ofaa258

10.1016/s2589-7500(20)30315-0

10.2196/24425

10.1017/dmp.2020.347

10.1177/1075547017731776

10.1177/003335491613100312

10.1111/jcom.12166

SimpsonEConnerAFighting coronavirus misinformation and disinformation: preventive product recommendations for social media platformsCenter for American Progress202008182021-07-16https://www.americanprogress.org/issues/technology-policy/reports/2020/08/18/488714/fighting-coronavirus-misinformation-disinformation/

10.14763/2020.2.1481

Managing epidemics: key facts about deadly diseasesWorld Health Organization20182021-07-16https://www.who.int/emergencies/diseases/managing-epidemics-interactive.pdf

10.1177/107769900608300212

10.2196/jmir.4738

10.1177/1609406915624574

Media MeasurementCOVID-19 Infodemic Digital Intelligence Reports, 16-22 June 2021Google Docs2021062021-06-29https://drive.google.com/drive/folders/1G_72yWkmFg6q7kWmukGyFd6LRY5XeyPp?usp=sharing

10.5281/zenodo.4073131

Media MeasurementCOVID-19 Localized Infodemic Digital Intelligence: Philippines, 15 February – 11 April 2021Google Docs20212021-06-29https://drive.google.com/file/d/1At76iihKfz7HaxG8KVsDttRrPb80iwi7/view?usp=sharing

Media MeasurementCOVID-19 Localized Infodemic Digital Intelligence: Brunei Darussalam, Malaysia, Singapore, 1 January – 31 December 2020Google Docs20212021-06-29https://drive.google.com/file/d/1dC3NhjiCxFN2FpLpiPCkYGOUKns7lFLd/view?usp=sharing

Media MeasurementAnalyses des discours sur la COVID-19 dans les médias sociaux au Mali 18/01-18/04 2021Google Docs2021-06-29https://drive.google.com/file/d/1fXOkQl0Q-lzlIya3Ln4t2s1a9np5bgne/view?usp=sharing

ChouinardÉVaccins : les échanges sur les réseaux sociaux assombrissent le portrait de la réalitéRadio-Canada Québec2021-06-25https://ici.radio-canada.ca/nouvelle/1791421/internet-vaccins-reseaux-sociaux-etude-intelligence-artificielle-eve-dube

Early AI-supported Response with Social ListeningWorld Health Organization2021-07-16https://apps.who.int/ears

What are the data sources in Explore?Meltwater2021-07-16https://help.meltwater.com/en/articles/4064549-what-are-the-data-sources-in-explore

10.2196/26527

10.1080/00913367.2020.1809576

Samoilenko, SA, 2018, Handbook of Research on Deception, Fake News, and Misinformation Online

Thông tin
Thông tin xuất bản

JMIR Publications Inc.

Tập 1 Số 1

e30971

Thông tin tác giả