ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns

Healthcare - Tập 11 Số 6 - Trang 887
Malik Sallam1,2
1Department of Clinical Laboratories and Forensic Medicine, Jordan University Hospital, Amman 11942, Jordan
2Department of Pathology, Microbiology and Forensic Medicine, School of Medicine, The University of Jordan, Amman 11942, Jordan

Tóm tắt

ChatGPT is an artificial intelligence (AI)-based conversational large language model (LLM). The potential applications of LLMs in health care education, research, and practice could be promising if the associated valid concerns are proactively examined and addressed. The current systematic review aimed to investigate the utility of ChatGPT in health care education, research, and practice and to highlight its potential limitations. Using the PRIMSA guidelines, a systematic search was conducted to retrieve English records in PubMed/MEDLINE and Google Scholar (published research or preprints) that examined ChatGPT in the context of health care education, research, or practice. A total of 60 records were eligible for inclusion. Benefits of ChatGPT were cited in 51/60 (85.0%) records and included: (1) improved scientific writing and enhancing research equity and versatility; (2) utility in health care research (efficient analysis of datasets, code generation, literature reviews, saving time to focus on experimental design, and drug discovery and development); (3) benefits in health care practice (streamlining the workflow, cost saving, documentation, personalized medicine, and improved health literacy); and (4) benefits in health care education including improved personalized learning and the focus on critical thinking and problem-based learning. Concerns regarding ChatGPT use were stated in 58/60 (96.7%) records including ethical, copyright, transparency, and legal issues, the risk of bias, plagiarism, lack of originality, inaccurate content with risk of hallucination, limited knowledge, incorrect citations, cybersecurity issues, and risk of infodemics. The promising applications of ChatGPT can induce paradigm shifts in health care education, research, and practice. However, the embrace of this AI chatbot should be conducted with extreme caution considering its potential limitations. As it currently stands, ChatGPT does not qualify to be listed as an author in scientific articles unless the ICMJE/COPE guidelines are revised or amended. An initiative involving all stakeholders in health care education, research, and practice is urgently needed. This will help to set a code of ethics to guide the responsible use of ChatGPT among other LLMs in health care and academia.

Từ khóa


Tài liệu tham khảo

Sarker, 2022, AI-Based Modeling: Techniques, Applications and Research Issues Towards Automation, Intelligent and Smart Systems, SN Comput. Sci., 3, 158, 10.1007/s42979-022-01043-x

Korteling, 2021, Human- versus Artificial Intelligence, Front. Artif. Intell., 4, 622364, 10.3389/frai.2021.622364

McCarthy, 2006, A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955, AI Mag., 27, 12

Jordan, 2015, Machine learning: Trends, perspectives, and prospects, Science, 349, 255, 10.1126/science.aaa8415

Domingos, P. (2018). The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World, Basic Books, A Member of the Perseus Books Group. [1st ed.].

OpenAI (2023, January 14). OpenAI: Models GPT-3. Available online: https://beta.openai.com/docs/models.

Brown, 2020, Language models are few-shot learners, Adv. Neural Inf. Process. Syst., 33, 1877

Wogu, I.A.P., Olu-Owolabi, F.E., Assibong, P.A., Agoha, B.C., Sholarin, M., Elegbeleye, A., Igbokwe, D., and Apeh, H.A. (2017, January 29–31). Artificial intelligence, alienation and ontological problems of other minds: A critical investigation into the future of man and machines. Proceedings of the 2017 International Conference on Computing Networking and Informatics (ICCNI), Lagos, Nigeria.

Howard, 2019, Artificial intelligence: Implications for the future of work, Am. J. Ind. Med., 62, 917, 10.1002/ajim.23037

Tai, 2020, The impact of artificial intelligence on human society and bioethics, Tzu Chi. Med J., 32, 339, 10.4103/tcmj.tcmj_71_20

Deng, 2023, The Benefits and Challenges of ChatGPT: An Overview, Front. Comput. Intell. Syst., 2, 81, 10.54097/fcis.v2i2.4465

Tobore, 2019, On Energy Efficiency and the Brain’s Resistance to Change: The Neurological Evolution of Dogmatism and Close-Mindedness, Psychol. Rep., 122, 2406, 10.1177/0033294118792670

Stokel-Walker, C. (Nature, 2022). AI bot ChatGPT writes smart essays—Should professors worry?, Nature.

2023, What ChatGPT and generative AI mean for science, Nature, 614, 214, 10.1038/d41586-023-00340-6

Chatterjee, 2023, This new conversational AI model can be your friend, philosopher, and guide … and even your worst enemy, Patterns, 4, 100676, 10.1016/j.patter.2022.100676

Sallam, 2023, ChatGPT Output Regarding Compulsory Vaccination and COVID-19 Vaccine Conspiracy: A Descriptive Study at the Outset of a Paradigm Shift in Online Search for Information, Cureus, 15, e35029

Johnson, 2021, Precision Medicine, AI, and the Future of Personalized Health Care, Clin. Transl. Sci., 14, 86, 10.1111/cts.12884

Rajpurkar, 2022, AI in health and medicine, Nat. Med., 28, 31, 10.1038/s41591-021-01614-0

Paranjape, 2019, Introducing Artificial Intelligence Training in Medical Education, JMIR Med. Educ., 5, e16048, 10.2196/16048

Borji, A. (2023). A Categorical Archive of ChatGPT Failures. arXiv.

Moher, D., Liberati, A., Tetzlaff, J., and Altman, D.G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med., 6.

Harzing, A.-W. (2023, February 16). Publish or Perish. Available online: https://harzing.com/resources/publish-or-perish.

Chen, T.J. (2023, February 16). ChatGPT and Other Artificial Intelligence Applications Speed up Scientific Writing. Available online: https://journals.lww.com/jcma/Citation/9900/ChatGPT_and_other_artificial_intelligence.174.aspx.

Thorp, 2023, ChatGPT is fun, but not an author, Science, 379, 313, 10.1126/science.adg7879

Kitamura, F.C. (2023). ChatGPT Is Shaping the Future of Medical Writing but Still Requires Human Judgment. Radiology, 230171.

Lubowitz, J. (Arthroscopy, 2023). ChatGPT, An Artificial Intelligence Chatbot, Is Impacting Medical Literature, Arthroscopy, in press.

Nature editorial (2023). Tools such as ChatGPT threaten transparent science; here are our ground rules for their use. Nature, 613, 612.

Moons, P., and Van Bulck, L. (2023, February 08). ChatGPT: Can artificial intelligence language models be of value for cardiovascular nurses and allied health professionals. Available online: https://academic.oup.com/eurjcn/advance-article/doi/10.1093/eurjcn/zvad022/7031481.

Cahan, 2023, A conversation with ChatGPT on the role of computational systems biology in stem cell research, Stem. Cell. Rep., 18, 1, 10.1016/j.stemcr.2022.12.009

Ahn, 2023, Exploring ChatGPT for information of cardiopulmonary resuscitation, Resuscitation, 185, 109729, 10.1016/j.resuscitation.2023.109729

Gunawan, 2023, Exploring the future of nursing: Insights from the ChatGPT model, Belitung Nurs. J., 9, 1, 10.33546/bnj.2551

White, 2023, I Asked a ChatGPT to Write an Editorial About How We Can Incorporate Chatbots Into Neurosurgical Research and Patient Care, Neurosurgery, 92, 993

Gosak, 2023, Can ChatGPT Pass the Life Support Exams without Entering the American Heart Association Course?, Resuscitation, 185, 109732, 10.1016/j.resuscitation.2023.109732

Mbakwe, A.B., Lourentzou, I., Celi, L.A., Mechanic, O.J., and Dagan, A. (2023). ChatGPT passing USMLE shines a spotlight on the flaws of medical education. PLoS Digit. Health, 2.

Huh, 2023, Issues in the 3rd year of the COVID-19 pandemic, including computer-based testing, study design, ChatGPT, journal metrics, and appreciation to reviewers, J. Educ. Eval. Health Prof., 20, 5, 10.3352/jeehp.2023.20.5

2023, Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse?, Nurse Educ. Pract., 66, 103537, 10.1016/j.nepr.2022.103537

Shen, Y., Heacock, L., Elias, J., Hentel, K.D., Reig, B., Shih, G., and Moy, L. (2023). ChatGPT and Other Large Language Models Are Double-edged Swords. Radiology, 230163.

Gordijn, 2023, ChatGPT: Evolution or revolution?, Med. Health Care Philos., 26, 1, 10.1007/s11019-023-10136-0

Mijwil, M., Aljanabi, M., and Ali, A. (2023). ChatGPT: Exploring the Role of Cybersecurity in the Protection of Medical Information. Mesop. J. CyberSecurity, 18–21.

The Lancet Digital Health (2023). ChatGPT: Friend or foe?. Lancet Digit. Health, 5, e112–e114.

Aljanabi, 2023, ChatGpt: Open Possibilities, Iraqi J. Comput. Sci. Math., 4, 62

Kumar, 2023, Analysis of ChatGPT Tool to Assess the Potential of its Utility for Academic Writing in Biomedical Domain, Biol. Eng. Med. Sci. Rep., 9, 24, 10.5530/bems.9.1.5

Zielinski, 2023, Chatbots, ChatGPT, and Scholarly Manuscripts WAME Recommendations on ChatGPT and Chatbots in Relation to Scholarly Publications, Maced J. Med. Sci., 11, 83, 10.3889/oamjms.2023.11502

Biswas, S. (2023). ChatGPT and the Future of Medical Writing. Radiology, 223312.

2023, ChatGPT listed as author on research papers: Many scientists disapprove, Nature, 613, 620, 10.1038/d41586-023-00107-z

Bollen, 2023, ChatGPT: Five priorities for research, Nature, 614, 224, 10.1038/d41586-023-00288-7

Lund, B., and Wang, S. (Library Hi. Tech. News, 2023). Chatting about ChatGPT: How may AI and GPT impact academia and libraries?, Library Hi. Tech. News, ahead-of-print.

Liebrenz, 2023, Generating scholarly content with ChatGPT: Ethical challenges for medical publishing, Lancet Digit. Health, 5, e105, 10.1016/S2589-7500(23)00019-5

Manohar, 2023, Use of ChatGPT in Academic Publishing: A Rare Case of Seronegative Systemic Lupus Erythematosus in a Patient With HIV Infection, Cureus, 15, e34616

Akhter, 2023, Acute Pulmonary Edema After Hyperbaric Oxygen Treatment: A Case Report Written With ChatGPT Assistance, Cureus, 15, e34752

Holzinger, 2023, AI for life: Trends in artificial intelligence for biotechnology, N. Biotechnol., 74, 16, 10.1016/j.nbt.2023.02.001

Mann, 2023, Artificial Intelligence Discusses the Role of Artificial Intelligence in Translational Medicine: A JACC: Basic to Translational Science Interview With ChatGPT, J. Am. Coll. Cardiol. Basic Trans. Sci., 8, 221

Patel, 2023, ChatGPT: The future of discharge summaries?, Lancet Digit. Health, 5, e107, 10.1016/S2589-7500(23)00021-3

Zhavoronkov, 2022, Rapamycin in the context of Pascal’s Wager: Generative pre-trained transformer perspective, Oncoscience, 9, 82, 10.18632/oncoscience.571

Hallsworth, J.E., Udaondo, Z., Pedrós-Alió, C., Höfer, J., Benison, K.C., Lloyd, K.G., Cordero, R.J.B., de Campos, C.B.L., Yakimov, M.M., and Amils, R. (Microb. Biotechnol., 2023). Scientific novelty beyond the experiment, Microb. Biotechnol., Online ahead of print.

Huh, 2023, Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: A descriptive study, J. Educ. Eval. Health Prof., 20, 1

Khan, 2023, ChatGPT-Reshaping medical education and clinical management, Pak. J. Med. Sci., 39, 605, 10.12669/pjms.39.2.7653

Gilson, 2023, How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment, JMIR Med. Educ., 9, e45312, 10.2196/45312

Kung, T.H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., and Maningo, J. (2023). Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digit. Health, 2.

Marchandot, 2023, ChatGPT: The Next Frontier in Academic Writing for Cardiologists or a Pandora’s Box of Ethical Dilemmas, Eur. Heart J. Open, 3, oead007, 10.1093/ehjopen/oead007

Wang, S., Scells, H., Koopman, B., and Zuccon, G. (2023). Can ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?. arXiv.

Cotton, D., Cotton, P., and Shipway, J. (EdArXiv, 2023). Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT, EdArXiv, Preprint.

Gao, C.A., Howard, F.M., Markov, N.S., Dyer, E.C., Ramesh, S., Luo, Y., and Pearson, A.T. (2022). Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers. bioRxiv.

Polonsky, M., and Rotman, J. (SSRN, 2023). Should Artificial Intelligent (AI) Agents be Your Co-author? Arguments in favour, informed by ChatGPT, SSRN, Preprint.

Aczel, B., and Wagenmakers, E. (PsyArXiv, 2023). Transparency Guidance for ChatGPT Usage in Scientific Writing, PsyArXiv, Preprint.

De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G.P., Ferragina, P., Tozzi, A.E., and Rizzo, C. (SSRN, 2023). ChatGPT and the Rise of Large Language Models: The New AI-Driven Infodemic Threat in Public Health, SSRN, Preprint.

Benoit, J. (medRxiv, 2023). ChatGPT for Clinical Vignette Generation, Revision, and Evaluation, medRxiv, Preprint.

Sharma, G., and Thakur, A. (ChemRxiv, 2023). ChatGPT in Drug Discovery, ChemRxiv, Preprint.

Rao, A., Kim, J., Kamineni, M., Pang, M., Lie, W., and Succi, M.D. (2023). Evaluating ChatGPT as an Adjunct for Radiologic Decision-Making. medRxiv.

Antaki, F., Touma, S., Milad, D., El-Khoury, J., and Duval, R. (medRxiv, 2023). Evaluating the Performance of ChatGPT in Ophthalmology: An Analysis of its Successes and Shortcomings, medRxiv, Preprint.

Aydın, Ö., and Karaarslan, E. (SSRN, 2022). OpenAI ChatGPT generated literature review: Digital twin in healthcare, SSRN, Preprint.

Sanmarchi, F., Bucci, A., and Golinelli, D. (medRxiv, 2023). A step-by-step Researcher’s Guide to the use of an AI-based transformer in epidemiology: An exploratory analysis of ChatGPT using the STROBE checklist for observational studies, medRxiv, Preprint.

Duong, D., and Solomon, B.D. (medRxiv, 2023). Analysis of large-language model versus human performance for genetics questions, medRxiv, Preprint.

Yeo, Y.H., Samaan, J.S., Ng, W.H., Ting, P.-S., Trivedi, H., Vipani, A., Ayoub, W., Yang, J.D., Liran, O., and Spiegel, B. (medRxiv, 2023). Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma, medRxiv, Preprint.

Bašić, Ž., Banovac, A., Kružić, I., and Jerković, I. (arXiv, 2023). Better by You, better than Me? ChatGPT-3 as writing assistance in students’ essays, arXiv, Preprint.

Hisan, U., and Amri, M. (Researchgate, 2023). ChatGPT and Medical Education: A Double-Edged Sword, Researchgate, Preprint.

Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A.T., Topalis, J., Weber, T., Wesp, P., Sabel, B., and Ricke, J. (2022). ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports. arXiv.

Nisar, S., and Aslam, M. (SSRN, 2023). Is ChatGPT a Good Tool for T&CM Students in Studying Pharmacology?, SSRN, Preprint.

Lin, Z. (PsyArXiv, 2023). Why and how to embrace AI such as ChatGPT in your academic life, PsyArXiv, Preprint.

Taecharungroj, V. (2023). “What Can ChatGPT Do?”; Analyzing Early Reactions to the Innovative AI Chatbot on Twitter. Big Data Cogn. Comput., 7.

Cascella, 2023, Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios, J. Med. Syst., 47, 33, 10.1007/s10916-023-01925-4

Nachshon, 2023, When Palliative Care May Be the Only Option in the Management of Severe Burns: A Case Report Written With the Help of ChatGPT, Cureus, 15, e35649

Kim, 2023, Using ChatGPT for language editing in scientific articles, Maxillofac. Plast. Reconstr. Surg., 45, 13, 10.1186/s40902-023-00381-x

Ali, S.R., Dobbs, T.D., Hutchings, H.A., and Whitaker, I.S. (Lancet Digit. Health, 2023). Using ChatGPT to write patient clinic letters, Lancet Digit. Health, Online ahead of print.

Shahriar, S., and Hayawi, K. (2023). Let’s have a chat! A Conversation with ChatGPT: Technology, Applications, and Limitations. arXiv.

Alberts, I.L., Mercolli, L., Pyka, T., Prenosil, G., Shi, K., Rominger, A., and Afshar-Oromieh, A. (Eur. J. Nucl. Med. Mol. Imaging, 2023). Large language models (LLM) and ChatGPT: What will the impact on nuclear medicine be?, Eur. J. Nucl. Med. Mol. Imaging, Online ahead of print.

Sallam, M., Salim, N.A., Barakat, M., and Al-Tammemi, A.B. (2023). ChatGPT applications in medical, dental, pharmacy, and public health education: A descriptive study. Narra J., 3.

Gurgel, 2023, ChatGPT: The new panacea of the academic world, Rev. Soc. Bras. Med. Trop., 56, e0060

Homolak, 2023, Opportunities and risks of ChatGPT in medicine, science, and academic publishing: A modern Promethean dilemma, Croat. Med. J., 64, 1, 10.3325/cmj.2023.64.1

Checcucci, E., Verri, P., Amparore, D., Cacciamani, G.E., Fiori, C., Breda, A., and Porpiglia, F. (Minerva. Urol. Nephrol., 2023). Generative Pre-training Transformer Chat (ChatGPT) in the scientific community: The train has left the station, Minerva. Urol. Nephrol., Online ahead of print.

Smith, 2006, Peer review: A flawed process at the heart of science and journals, J. R. Soc. Med., 99, 178, 10.1177/014107680609900414

Mavrogenis, 2020, The good, the bad and the rude peer-review, Int. Orthop., 44, 413, 10.1007/s00264-020-04504-1

Margalida, 2016, Improving the peer-review process and editorial quality: Key errors escaping the review and editorial process in top scientific journals, PeerJ., 4, e1670, 10.7717/peerj.1670

Ollivier, M., Pareek, A., Dahmen, J., Kayaalp, M.E., Winkler, P.W., Hirschmann, M.T., and Karlsson, J. (Knee Surg. Sports Traumatol. Arthrosc., 2023). A deeper dive into ChatGPT: History, use and future perspectives for orthopaedic research, Knee Surg. Sports Traumatol. Arthrosc., Online ahead of print.

Nolan, C. (2014). Interstellar, Legendary Entertainment. 169 minutes.

Gerke, 2022, AI in the hands of imperfect users, Npj Digit. Med., 5, 197, 10.1038/s41746-022-00737-z