Identifying and addressing digital health risks associated with emergency pandemic response: Problem identification, scoping review, and directions toward evidence-based evaluation

Budd, 2020, Digital technologies in the public-health response to COVID-19, Nat. Med., 26, 1183, 10.1038/s41591-020-1011-4 Bakken, 2020, Informatics is a critical strategy in combating the COVID-19 pandemic, J. Am. Med. Inform. Assoc., 27, 843, 10.1093/jamia/ocaa101 Wosik, 2020, Telehealth transformation: COVID-19 and the rise of virtual care, J. Am. Med. Inform. Assoc., 27, 957, 10.1093/jamia/ocaa067 S.T. Liaw, C. Kuziemsky, R. Schreiber, J. Jonnagaddala, H. Liyanage, A. Chittalia et al., Primary Care Informatics Response to Covid-19 Pandemic: Adaptation, Progress, and Lessons from Four Countries with High ICT Development, Yearbook of medical informatics, 2021. Bogol, 2020, COVIDSafe was 'sunscreen' for coronavirus, until it wasn't. Have we chosen the right solution to the pandemic?, ABC News Commission Recommendation (EU) 2020/518 of 8 April 2020 on a common Union toolbox for the use of technology and data to combat and exit from the COVID-19 crisis, in particular concerning mobile applications and the use of anonymised mobility data. Publications Office of the European Union, 2020. Gerli, 2021, Beyond contact-tracing: The public value of eHealth application in a pandemic, Government Inform. Quart., 38, 101581, 10.1016/j.giq.2021.101581 R Niakan Kalhori, 2021, Digital health solutions to control the COVID-19 pandemic in countries with high disease prevalence: Literature review, J. Med. Internet Res., 23, e19473, 10.2196/19473 Wang, 2020, Response to COVID-19 in Taiwan: Big Data Analytics, New Technology, and Proactive Testing, JAMA, 323, 1341, 10.1001/jama.2020.3151 Koch, 2021, Digital Health during COVID-19: Informatics Dialogue with the World Health Organization, Yearbook Med. Inform., 30, 013, 10.1055/s-0041-1726480 Kaplan, 2020, Revisiting health information technology ethical, legal, and social issues and evaluation: telehealth/telemedicine and COVID-19, Int. J. Med. Inf., 143, 104239, 10.1016/j.ijmedinf.2020.104239 Houlding, 2021, Barriers to Use of Remote Monitoring Technologies Used to Support Patients With COVID-19: Rapid Review, JMIR Mhealth Uhealth., 9, e24743, 10.2196/24743 Peters, 2014, The application of systems thinking in health: why use systems thinking?, Health Res Policy Syst., 12, 51, 10.1186/1478-4505-12-51 Fagherazzi, 2020, Digital Health Strategies to Fight COVID-19 Worldwide: Challenges, Recommendations, and a Call for Papers, J. Med. Internet Res., 22, e19284, 10.2196/19284 HIMSS. Digital Health Indicator. Your Blueprint for Digital Health Advancement HIMSS2021 [cited 2021 31 Aug]. Available from: https://www.himss.org/what-we-do-solutions/digital-health-transformation/digital-health-indicator. Bakibinga-Gaswaga, 2020, Digital technologies in the COVID-19 responses in sub-Saharan Africa: policies, problems and promises, Pan African Med. J., 35, 38 Bayram, 2020, COVID-19 Digital Health Innovation Policy: A Portal to Alternative Futures in the Making, OMICS, 24, 460, 10.1089/omi.2020.0089 Bookman, 2021, Research informatics and the COVID-19 pandemic: Challenges, innovations, lessons learned, and recommendations, J. Clin. Transl. Sci., 5, 10.1017/cts.2021.26 da Silva, 2021, Rethinking approaches of science, technology, and innovation in healthcare during the COVID-19 pandemic: the challenge of translating knowledge infrastructures to public needs, Health Res Policy Syst., 19, 104, 10.1186/s12961-021-00760-8 Dubov, 2020, The Value and Ethics of Using Technology to Contain the COVID-19 Epidemic, Am. J. Bioeth., 20, W7, 10.1080/15265161.2020.1764136 Elkhodr, 2021, Technology, Privacy, and User Opinions of COVID-19 Mobile Apps for Contact Tracing: Systematic Search and Content Analysis, J. Med. Internet Res., 23, e23467, 10.2196/23467 Eruchalu, 2021, The Expanding Digital Divide: Digital Health Access Inequities during the COVID-19 Pandemic in New York City, J. Urban Health., 98, 183, 10.1007/s11524-020-00508-9 Gasteiger, 2021, The more the merrier! Barriers and facilitators to the general public's use of a COVID-19 contact tracing app in New Zealand, Inform. Health Soc. Care, 1–12 Mbunge, 2020, Integrating emerging technologies into COVID-19 contact tracing: Opportunities, challenges and pitfalls, Diabetes Metab Syndr., 14, 1631, 10.1016/j.dsx.2020.08.029 Pagliari, 2020, The ethics and value of contact tracing apps: International insights and implications for Scotland's COVID-19 response, J. Global Health., 10, 1, 10.7189/jogh.10.020103 Beaumont, 2020, Top US immunologist quits health role over Trump Covid response, The Guardian., 2020, 7 Ahmad, 2021, Macro level influences on strategic responses to the COVID-19 pandemic - an international survey and tool for national assessments, J. Glob Health., 11, 10.7189/jogh.11.05011 Cousins, 2020, New Zealand eliminates COVID-19, The Lancet., 395, 1474, 10.1016/S0140-6736(20)31097-7 Murdoch, 2020, COVID-19 and small island nations: what we can learn from New Zealand and Iceland, The Conversation. Taylor, 2020, Uruguay is winning against covid-19. This is how, BMJ (Clinical Research Ed.), 370, m3575 Advancing a Digital Healthcare Future for Ireland Economic & Social Research Institute, 2021. Available from: https://www.esri.ie/news/advancing-a-digital-healthcare-future-for-ireland. Gerke, 2020, Regulatory, safety, and privacy concerns of home monitoring technologies during COVID-19, Nat. Med., 26, 1176, 10.1038/s41591-020-0994-1 Greenspan, 2020, Position paper on COVID-19 imaging and AI: From the clinical needs and technological challenges to initial AI solutions at the lab and national level towards a new era for AI in healthcare, Med. Image Anal., 66, 101800, 10.1016/j.media.2020.101800 He, 2021, Information technology solutions, challenges, and suggestions for tackling the COVID-19 pandemic, Int. J. Inf. Manage., 57, 102287, 10.1016/j.ijinfomgt.2020.102287 Lenert, 2021, Informatics for public health and health system collaboration: Applications for the control of the current COVID-19 pandemic and the next one, J. Am. Med. Inform. Assoc., 28, 1807, 10.1093/jamia/ocab066 Nageshwaran, 2021, Review of the role of big data and digital technologies in controlling COVID-19 in Asia: Public health interest vs. privacy, Digit Health, 7 Pagliari, 2021, Digital health and primary care: Past, pandemic and prospects, J. Glob Health, 11, 01005, 10.7189/jogh.11.01005 Montanari Vergallo, 2021, The COVID-19 pandemic and contact tracing technologies, between upholding the right to health and personal data protection, Eur. Rev. Med. Pharmacol. Sci., 25, 2449 Peek, 2020, Digital health and care in pandemic times: impact of COVID-19, BMJ Health Care Inform., 27, e100166, 10.1136/bmjhci-2020-100166 Plasek, 2020, Following data as it crosses borders during the COVID-19 pandemic, J. American Med. Inform. Assoc., 10.1093/jamia/ocaa063 Eikey, 2015, Examining the role of collaboration in studies of health information technologies in biomedical informatics: A systematic review of 25 years of research, J. Biomed. Inform., 57, 263, 10.1016/j.jbi.2015.08.006 Kringos, 2020, Managing COVID-19 within and across health systems: why we need performance intelligence to coordinate a global response, Health Res Policy Syst., 18, 80, 10.1186/s12961-020-00593-x Welcome to OHDSI! Observational Health Data Sciences and Informatics (OHDSI), 2021 [Available from: https://ohdsi.org/]. Welcome to the European Health Data & Evidence Network (EHDEN), an IMI 2 consortium with 22 partners operating in Europe. European Health Data & Evidence Network (EHDEN), 2021 [Available from: https://www.ehden.eu/]. Andoni, 2020, NODE. Health Meeting Report and Panel Discussion - The FDA's Changing Regulatory Landscape for Digital Health Technologies and Digital Health Innovation during COVID-19: A Discussion with Eric Topol and Bakul Patel, Moderated by Aenor Sawyer, Digit Biomark., 4, 128, 10.1159/000512681 Humphreys, 2020, Digital health and COVID-19, Bull. World Health Organ., 98, 731, 10.2471/BLT.20.021120 Bressy, 2020, Technological devices in COVID-19 primary care management: the Italian experience, Fam. Pract., 37, 725, 10.1093/fampra/cmaa055 Feger, 2021, UK learning about digital health and COVID-19, BMJ Health Care Inform., 28, e100376, 10.1136/bmjhci-2021-100376 Fernez-Luque, 2020, Evidence-Based Health Informatics as the Foundation for the COVID-19 Response: A Joint Call for Action, Methods Inform. Med., 59, 183, 10.1055/s-0041-1726414 Idrees, 2021, Blockchain-Based Digital Contact Tracing Apps for COVID-19 Pandemic Management: Issues, Challenges, Solutions, and Future Directions, J. Med. Internet Res., 23 Lin, 2020, COVID-19 (Coronavirus Disease 2019): Opportunities and Challenges for Digital Health and the Internet of Medical Things in China, OMICS, 24, 231, 10.1089/omi.2020.0047 Mitgang, 2021, Digital Health in Response to COVID-19 in Low- and Middle-income Countries: Opportunities and Challenges, Glob. Policy, 12, 107, 10.1111/1758-5899.12880 European Union. European Health Data Space 2021 [Available from: https://ec.europa.eu/health/ehealth/dataspace_en. C. Gorey, Source code of Covid Tracker Ireland app goes global with Linux project Siliconrepublic, 2020 [Available from: https://www.siliconrepublic.com/enterprise/covid-tracker-ireland-app-source-code-glinux-project]. A. Bogol, COVIDSafe has been downloaded by millions, but yet to identify contacts (and authorities say that's a good thing), 2020 11 Jun. Armstrong, 2020, Covid-19: Deadline for roll out of UK's tracing app will be missed, BMJ, 369 Ming, 2020, Mobile Health Apps on COVID-19 Launched in the Early Days of the Pandemic: Content Analysis and Review, JMIR Mhealth Uhealth, 8, e19796, 10.2196/19796 Collado-Borrell, 2020, Features and Functionalities of Smartphone Apps Related to COVID-19: Systematic Search in App Stores and Content Analysis, J. Med. Internet Res., 22, e20334, 10.2196/20334 R. Raskar, G. Nadeau, J. Werner, R. Barbar, A. Mehra, G. Harp et al., COVID-19 Contact-Tracing Mobile Apps: Evaluation and Assessment for Decision Makers. arXiv preprint arXiv:200605812, 2020. Trang, 2020, One app to trace them all? Examining app specifications for mass acceptance of contact-tracing apps, European J. Inform. Syst., 29, 415, 10.1080/0960085X.2020.1784046 S. Davalbhakta, S. Advani, S. Kumar, V. Agarwal, S. Bhoyar, E. Fedirko et al., A systematic review of the smartphone applications available for coronavirus disease 2019 (COVID19) and their assessment using the mobile app rating scale (MARS). medRxiv: the preprint server for health sciences, 2020:2020.07.02.20144964. Collaborating to battle COVID-19 Linux Foundation Public Health2020 [Available from: https://www.lfph.io/]. Champion, 2019, A systems approach for modeling health information complexity, Int. J. Inf. Manage., 49, 343, 10.1016/j.ijinfomgt.2019.07.002 March 2020 SNOMED CT International Edition Interim Release: Up to date COVID-10 content available: SNOMED International; 2020 [updated 11 March; cited 2020]. Available from: https://www.snomed.org/news-and-events/articles/march-2020-interim-snomedct-release-COVID-19. WHO. Emergency use ICD codes for COVID-19 disease outbreak 2021 [Available from: https://www.who.int/standards/classifications/classification-of-diseases/emergency-use-icd-codes-for-covid-19-disease-outbreak]. Sass, 2020, The German Corona Consensus Dataset (GECCO): a standardized dataset for COVID-19 research in university medicine and beyond, BMC Med. Inf. Decis. Making, 20 O'Reilly-Shah, 2020, The COVID-19 Pandemic Highlights Shortcomings in US Health Care Informatics Infrastructure: A Call to Action, Anesth. Analg., 131, 340, 10.1213/ANE.0000000000004945 de Lissovoy, 2020, Codes, Coding, and COVID-19, Med. Care, 58, 1035, 10.1097/MLR.0000000000001430 Schriml, 2020, COVID-19 pandemic reveals the peril of ignoring metadata standards, Sci. Data, 7, 10.1038/s41597-020-0524-5 Chand, 2021, The use of careFiji app for contact tracing during the COVID-19 pandemic: Digital gap and challenges faced in Fiji, Int. J. Surgery (London, England), 92, 106023, 10.1016/j.ijsu.2021.106023 WHO. Transmission of SARS-CoV-2: implications for infection prevention precautions, 2020. Weiß, 2021, Analyzing the Essential Attributes of Nationally Issued COVID-19 Contact Tracing Apps: Open-Source Intelligence Approach and Content Analysis, JMIR Mhealth Uhealth., 9, e27232, 10.2196/27232 Tidman, 2020, Coronavirus: ‘Extraordinary’ flaw leaves NHS app unable to process tens of thousands of test results, Independent., 2020, 27 Countries Rolling Out Coronavirus Tracking Apps Show Why They Can’t Work, 2020 12 May. Luciano, 2020, Mind the App-Considerations on the Ethical Risks of COVID-19 Apps, Philos. Technol., 33, 167, 10.1007/s13347-020-00408-5 Wu, 2020, Application of Big Data Technology for COVID-19 Prevention and Control in China: Lessons and Recommendations, J. Med. Internet Res., 22, e21980, 10.2196/21980 Jones, 2020, Two metres or one: what is the evidence for physical distancing in covid-19?, BMJ, 370 Sommerstein, 2020, Risk of SARS-CoV-2 transmission by aerosols, the rational use of masks, and protection of healthcare workers from COVID-19, Antimicrobial Resistance Infection Control, 9, 10.1186/s13756-020-00763-0 Bahl, 2020, Droplets and Aerosols generated by singing and the risk of COVID-19 for choirs, Clin. Infect. Dis. Monitoring and Evaluating Digital Health Interventions, WHO, 2016. Magrabi, 2021, Managing Pandemic Responses with Health Informatics - Challenges for Assessing Digital Health Technologies, Yearb Med. Inform., 30, 056 Singer, 2020, Health policy and technology challenges in responding to the COVID-19 pandemic, Health Policy Technol., 9, 123, 10.1016/j.hlpt.2020.04.011 Kolaczyk, 2020, COVID-19 Shows Us We Need Rapid Response, Data Science Teams S. Meixner, Australia has COVIDSafe. Here is how other countries are using contact tracing apps in the fight against coronavirus, ABC News, 2020 28 Apr. Z. Zhao, Y. Ma, A. Mushtaq, A.M.A. Rajper, M. Shehab, A. Heybourne et al., Applications of Robotics, Artificial Intelligence, and Digital Technologies During COVID-19: A Review. Disaster Med Public Health Prep. 2021, 1-11. Davis, 2020, UK app aims to help researchers track spread of coronavirus, The Guardian. UK app aims to help researchers track spread of coronavirus. The Guardian, 2020 24 Mar. Novartis and CureVac collaborate on vaccine manufacturing. Pharmaceutical Commerce, 2021 5 March 2021. Crawford, 2020, Digital Health Equity and COVID-19: The Innovation Curve Cannot Reinforce the Social Gradient of Health, J. Med. Internet. Res., 22, e19361, 10.2196/19361 Ramsetty, 2020, Impact of the digital divide in the age of COVID-19, J. Am. Med. Inform. Assoc., 10.1093/jamia/ocaa078 Darwish, 2021, Integration of Advanced Health Technology Within the Healthcare System to Fight the Global Pandemic: Current Challenges and Future Opportunities, Innov. Clin. Neurosci., 18, 31 Gann, 2020, Combating Digital Health Inequality in the Time of Coronavirus, J. Consumer Health Internet, 24, 278, 10.1080/15398285.2020.1791670 Mac-Seing, 2021, Health inequities and technological solutions during the first waves of the COVID-19 pandemic in high-income countries, Glob Health Promot., 28, 67, 10.1177/1757975920984185 WHO. WHO global strategy on people-centred and integrated health services, 2015. Rigby, 1997, Building healthcare delivery and management systems centred on information about the human aspects, Comput. Methods Programs Biomed., 54, 93, 10.1016/S0169-2607(97)00038-2 Rigby, 2020, European Union initiatives in child immunization-the need for child centricity, e-health and holistic delivery, Eur. J. Public Health, 30, 449, 10.1093/eurpub/ckz199 Williams, 2020, COVID-19 and Health Equity-A New Kind of “Herd Immunity”, JAMA, 323, 2478, 10.1001/jama.2020.8051 Wong, 2017, Context Sensitive Health Informatics: Delivering 21st Century Healthcare - Building a Quality-and-Efficiency Driven System, Stud. Health Technol. Inform., 241, 1 Matthan, 2020, The Privacy Implications of Using Data Technologies in a Pandemic, J. Indian Inst. Sci., 1–11 Monasterio, 2021, Science, misinformation and digital technology during the Covid-19 pandemic, Hist. Philos. Life Sci., 43, 68, 10.1007/s40656-021-00424-4 Park, 2021, Development, Acceptance, and Concerns Surrounding App-Based Services to Overcome the COVID-19 Outbreak in South Korea: Web-Based Survey Study, JMIR Med. Inform., 9, e29315, 10.2196/29315 Zhao, 2021, Applications of Robotics, AI, and Digital Technologies During COVID-19: A Review, Disaster Med. Public Health Preparedness, 1 Marinelli, 2020, Intensive and pharmacological care in times of COVID-19: A “special ethics” for emergency?, BMC Med Ethics., 21, 117, 10.1186/s12910-020-00562-7 Seto, 2021, Adoption of COVID-19 Contact Tracing Apps: A Balance Between Privacy and Effectiveness, J. Med. Internet Res., 23, e25726, 10.2196/25726 Chan, 2021, Privacy concerns can explain unwillingness to download and use contact tracing apps when COVID-19 concerns are high, Comput. Hum. Behav., 119, 106718, 10.1016/j.chb.2021.106718 Du, 2020, COVID-19 Contact Tracing Apps: A Technologic Tower of Babel and the Gap for International Pandemic Control, JMIR Mhealth Uhealth., 8, e23194, 10.2196/23194 Seto, 2021, Adoption of COVID-19 Contact Tracing Apps: A Balance Between Privacy and Effectiveness, J. Med. Internet Res., 23, 10.2196/25726 Gerke, 2020, Germany's digital health reforms in the COVID-19 era: lessons and opportunities for other countries, NPJ Digit Med., 3, 94, 10.1038/s41746-020-0306-7 Talmon, 2009, STARE-HI–Statement on reporting of evaluation studies in Health Informatics, Int. J. Med. Inform., 78, 1, 10.1016/j.ijmedinf.2008.09.002 Magrabi, 2015, Identifying patient safety problems associated with information technology in general practice: an analysis of incident reports, BMJ Quality Saf. Chitungo, 2021, Digital technologies and covid-19: Reconsidering lockdown exit strategies for Africa, Pan African Med. J., 39, 10.11604/pamj.2021.39.93.29773 Ammenwerth, 2004, Visions and strategies to improve evaluation of health information systems. Reflections and lessons based on the HIS-EVAL workshop in Innsbruck, Int. J. Med. Inform., 73, 479, 10.1016/j.ijmedinf.2004.04.004 Nykänen, 2011, Guideline for good evaluation practice in health informatics (GEP-HI), Int. J. Med. Inform., 80, 815, 10.1016/j.ijmedinf.2011.08.004 Rigby, 2013, Evidence Based Health Informatics: 10 Years of Efforts to Promote the Principle. Joint Contribution of IMIA WG EVAL and EFMI WG EVAL, Yearb Med. Inform., 8, 34 Brender, 2006 P. Scott, N. Keizer, A. Georgiou, Applied Interdisciplinary Theory in Health Informatics, 2019. Rigby, 2016, Forward Outlook: The Need for Evidence and for Action in Health Informatics, Stud. Health Technol. Inform., 222, 355 COVID-19 and digital health: EHTEL Collaborating for Digital Health and Care in Europe; 2020 [Available from: https://www.ehtel.eu/covid-19-and-digital-health.html]. Rigby, 2001, Evaluation: 16 powerful reasons why not to do it–and 6 over-riding imperatives, Stud. Health Technol. Inform., 84, 1198