Prediction of major adverse cardiac events in the emergency department using an artificial neural network with a systematic grid search
Tóm tắt
The aim of our research was to design and evaluate an Artificial Neural Network (ANN) model using a systemic grid search for the early prediction of major adverse cardiac events (MACE) among patients presenting to the triage of an emergency department. This is a single-center, cross-sectional study using electronic health records from January 2017 to December 2020. The research population consists of adults coming to our emergency department triage at Aga Khan University Hospital. The MACE during hospitalization was the main outcome. To enhance the architecture of an ANN using triage data, we used a systematic grid search strategy. Four hidden ANN layers were used, followed by an output layer. Following each hidden layer was back normalization and a dropout layer. MACE was predicted using three binary classifiers: ANN, Random Forests (RF), and logistic regression (LR). The overall accuracy, sensitivity, specificity, precision, and recall of these models were examined. Each model was evaluated using the receiver operating characteristic curve (ROC) and an F1-score with a 95% confidence interval. A total of 97,333 emergency department visits were recorded during the study period, with 33% of patients having cardiovascular symptoms. The mean age was 54.08 (19.18) years old. The MACE was observed in 23,052 (23.7%) of the patients, in-hospital (up to 30 days) mortality in 10,888 (11.2%) patients, and cardiac arrest in 5483 (5.6%) patients. The data used for training and validation were 77,866 and 19,467 in an 80:20 ratio, respectively. The AUC score for MACE with ANN was 0.97, which was greater than RF (0.96) and LR (0.96). Similarly, the precision-recall curve for MACE utilizing ANN was greater (0.94 vs. 0.93 for RF and 0.93 for LR). The sensitivity for MACE prediction using ANN, RF, and LR classifiers was 99.3%, 99.4%, and 99.2%, respectively, with the specificities being 94.5%, 94.2%, and 94.2%, respectively. When triage data is used to predict MACE, death, and cardiac arrest, ANN with systemic grid search gives precise and valid outcomes and will benefit in predicting MACE in emergency rooms with limited resources that have to deal with a substantial number of patients.
Tài liệu tham khảo
Bayon Fernandez J, Alegria Ezquerra E, Bosch Genover X, Cabades OCA, Iglesias Garriz I, Jimenez Nacher J, et al. Grupo de Trabajo ad hoc de la Seccion de Cardiopatia Isquemica y Unidades Coronarias de la Sociedad Espanola de C. Chest pain units. Organization and protocol for the diagnosis of acute coronary syndromes. Rev Esp Cardiol. 2002;55(2):143–54.
Damman P, van’t Hof A, Ten Berg J, Jukema J, Appelman Y, Liem A, et al. 2015 ESC guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation: comments from the Dutch ACS working group. Netherlands Heart J. 2017;25(3):181–5.
Members WC, Anderson JL, Adams CD, Antman EM, Bridges CR, Califf RM, et al. 2012 ACCF/AHA focused update incorporated into the ACCF/AHA 2007 guidelines for the management of patients with unstable angina/non–ST-elevation myocardial infarction: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines. Circulation. 2013;127(23):e663–828.
Niska R, Bhuiya F, Xu J. National Hospital Ambulatory Medical Care Survey: 2007 emergency department summary. Hyattsville: National Center for Health Statistics; 2010. 2012.
Thygesen K, Alpert JS, Jaffe AS, Chaitman BR, Bax JJ, Morrow DA, et al. Fourth universal definition of myocardial infarction (2018). Eur Heart J. 2019;40(3):237–69.
Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJ. Global and regional burden of disease and risk factors, 2001: systematic analysis of population health data. Lancet. 2006;367(9524):1747–57.
Rassi A Jr, Rassi A, Little WC, Xavier SS, Rassi SG, Rassi AG, et al. Development and validation of a risk score for predicting death in Chagas’ heart disease. N Engl J Med. 2006;355(8):799–808.
DeLaney MC, Neth M, Thomas JJ. Chest pain triage: Current trends in the emergency departments in the United States. J Nucl Cardiol. 2017;24(6):2004–11.
Brady W, de Souza K. The HEART score: a guide to its application in the emergency department. Turkish J Emerg Med. 2018;18(2):47–51.
Fox KA, Eagle KA, Gore JM, Steg PG, Anderson F, GRACE, et al. The global registry of acute coronary events, 1999 to 2009–GRACE. Heart. 2010;96(14):1095–101.
Backus BE, Six AJ, Kelder JC, Mast TP, van den Akker F, Mast EG, et al. Chest pain in the emergency room: a multicenter validation of the HEART Score. Crit Pathw Cardiol. 2010;9(3):164–9.
Stewart J, Sprivulis P, Dwivedi G. Artificial intelligence and machine learning in emergency medicine. Emerg Med Australas. 2018;30(6):870–4.
Zhang P-I, Hsu C-C, Kao Y, Chen C-J, Kuo Y-W, Hsu S-L, et al. Real-time AI prediction for major adverse cardiac events in emergency department patients with chest pain. Scand J Trauma Resusc Emerg Med. 2020;28(1):1–7.
Deo RC. Machine learning in medicine. Circulation [Internet]. 2015;132(20):1920–30. Available from: https://doi.org/10.1161/circulationaha.115.001593
Kakadiaris IA, Vrigkas M, Yen AA, Kuznetsova T, Budoff M, Naghavi M. Machine Learning Outperforms ACC/AHA CVD Risk Calculator in MESA. J Am Heart Assoc. 2018;7(22):e009476. https://doi.org/10.1161/JAHA.118.009476.
Raita Y, Goto T, Faridi MK, Brown DF, Camargo CA, Hasegawa K. Emergency department triage prediction of clinical outcomes using machine learning models. Crit Care. 2019;23(1):1–13.
Zachariasse JM, Seiger N, Rood PP, Alves CF, Freitas P, Smit FJ, et al. Validity of the Manchester Triage System in emergency care: a prospective observational study. PLoS One. 2017;12(2).
Levin S, Toerper M, Hamrock E, Hinson JS, Barnes S, Gardner H, et al. Machine-learning-based electronic triage more accurately differentiates patients with respect to clinical outcomes compared with the emergency severity index. Ann Emerg Med. 2018;71(5):565–74. e2.
Christ M, Grossmann F, Winter D, Bingisser R, Platz E. Modern triage in the emergency department. Dtsch Arztebl Int. 2010;107(50):892.
Singh Y, Chauhan AS. Neural networks in data mining. J Theoretic Appl Inform Technol. 2009;5(1) 2018;7(22). Available from: https://doi.org/10.1161/jaha.118.009476.
Antman EM, Cohen M, Bernink PJ, McCabe CH, Horacek T, Papuchis G, et al. The TIMI risk score for unstable angina/non–ST elevation MI: a method for prognostication and therapeutic decision making. JAMA. 2000;284(7):835–42.
Pontes FJ, Amorim G, Balestrassi PP, Paiva A, Ferreira JR. Design of experiments and focused grid search for neural network parameter optimization. Neurocomputing. 2016;186:22–34.
So L, Evans D, Quan H. ICD-10 coding algorithms for defining comorbidities of acute myocardial infarction. BMC Health Serv Res. 2006;6(1):1–9.
Gilboy N, Tanabe P, Travers DA. The Emergency Severity Index Version 4: changes to ESI level 1 and pediatric fever criteria. J Emerg Nurs. 2005;31(4):357–62.
Fernandes M, Vieira SM, Leite F, Palos C, Finkelstein S, Sousa JM. Clinical decision support systems for triage in the emergency department using intelligent systems: a review. Artif Intell Med. 2020;1(102): 101762.
Jang DH, Kim J, Jo YH, Lee JH, Hwang JE, Park SM, Lee DK, Park I, Kim D, Chang H. Developing neural network models for early detection of cardiac arrest in emergency department. Am J Emerg Med. 2020;38(1):43–9.
Wu CC, Hsu WD, Islam MM, Poly TN, Yang HC, Nguyen PA, Wang YC, Li YC. An artificial intelligence approach to early predict non-ST-elevation myocardial infarction patients with chest pain. Comput Methods Programs Biomed. 2019;1(173):109–17.
Hong WS, Haimovich AD, Taylor RA. Predicting hospital admission at emergency department triage using machine learning. PLoS One. 2018;13(7): e0201016.
Goto T, Camargo CA, Faridi MK, Freishtat RJ, Hasegawa K. Machine learning–based prediction of clinical outcomes for children during emergency department triage. JAMA Network Open. 2019;2(1):e186937-.
Jafary MH, Samad A, Ishaq M, Jawaid SA, Ahmad M, Vohra EA. Profile of acute myocardial infarction (AMI) in Pakistan. Pakistan J Med Sci. 2007;23(4):485.
Patel B, Sengupta P. Machine learning for predicting cardiac events: what does the future hold? Expert Rev Cardiovasc Ther. 2020;18(2):77–84.
Sullivan HR, Schweikart SJ. Are current tort liability doctrines adequate for addressing injury caused by AI? AMA J Ethics. 2019;21(2):160–6.