Application and interpretation of machine learning models in predicting the risk of severe obstructive sleep apnea in adults
Tóm tắt
Obstructive sleep apnea (OSA) is a globally prevalent disease with a complex diagnostic method. Severe OSA is associated with multi-system dysfunction. We aimed to develop an interpretable machine learning (ML) model for predicting the risk of severe OSA and analyzing the risk factors based on clinical characteristics and questionnaires. This was a retrospective study comprising 1656 subjects who presented and underwent polysomnography (PSG) between 2018 and 2021. A total of 23 variables were included, and after univariate analysis, 15 variables were selected for further preprocessing. Six types of classification models were used to evaluate the ability to predict severe OSA, namely logistic regression (LR), gradient boosting machine (GBM), extreme gradient boosting (XGBoost), adaptive boosting (AdaBoost), bootstrapped aggregating (Bagging), and multilayer perceptron (MLP). All models used the area under the receiver operating characteristic curve (AUC) was calculated as the performance metric. We also drew SHapley Additive exPlanations (SHAP) plots to interpret predictive results and to analyze the relative importance of risk factors. An online calculator was developed to estimate the risk of severe OSA in individuals. Among the enrolled subjects, 61.47% (1018/1656) were diagnosed with severe OSA. Multivariate LR analysis showed that 10 of 23 variables were independent risk factors for severe OSA. The GBM model showed the best performance (AUC = 0.857, accuracy = 0.766, sensitivity = 0.798, specificity = 0.734). An online calculator was developed to estimate the risk of severe OSA based on the GBM model. Finally, waist circumference, neck circumference, the Epworth Sleepiness Scale, age, and the Berlin questionnaire were revealed by the SHAP plot as the top five critical variables contributing to the diagnosis of severe OSA. Additionally, two typical cases were analyzed to interpret the contribution of each variable to the outcome prediction in a single patient. We established six risk prediction models for severe OSA using ML algorithms. Among them, the GBM model performed best. The model facilitates individualized assessment and further clinical strategies for patients with suspected severe OSA. This will help to identify patients with severe OSA as early as possible and ensure their timely treatment. Retrospectively registered.
Tài liệu tham khảo
Gottlieb D, Punjabi NJJ. Diagnosis and management of obstructive sleep apnea: a review. JAMA. 2020;323(14):1389–400.
Benjafield AV, Ayas NT, Eastwood PR, Heinzer R, Ip MSM, Morrell MJ, et al. Estimation of the global prevalence and burden of obstructive sleep apnoea: a literature-based analysis. Lancet Respir Med. 2019;7(8):687–98.
Young T, Peppard PE, Gottlieb DJ. Epidemiology of obstructive sleep apnea: a population health perspective. Am J Respir Crit Care Med. 2002;165(9):1217–39.
Trzepizur W, Blanchard M, Ganem T, Balusson F, Feuilloy M, Girault J-M et al. Sleep apnea–specific hypoxic burden, symptom subtypes, and risk of cardiovascular events and all-cause mortality. 2022;205(1):108–17.
Rundo JV. Obstructive sleep apnea basics. Cleve Clin J Med. 2019;86(9 Suppl 1):2–9.
Kapur VK, Auckley DH, Chowdhuri S, Kuhlmann DC, Mehra R, Ramar K, et al. Clinical practice Guideline for Diagnostic Testing for Adult Obstructive Sleep Apnea: an American Academy of Sleep Medicine Clinical Practice Guideline. J Clin Sleep Med. 2017;13(3):479–504.
Surani S, Sheta A, Turabieh H, Park J, Mathur S, Katangur A. Diagnosis of Sleep Apnea using Artificial neural network and binary particle Swarm optimization for feature selection. Chest. 2019;156(4).
Kim YJ, Jeon JS, Cho SE, Kim KG, Kang SG. Prediction models for obstructive sleep apnea in Korean adults using machine learning techniques. Diagnostics (Basel). 2021;11(4).
Jonassen TM, Bjorvatn B, Saxvig IW, Eagan TM, Lehmann S. Clinical information predicting severe obstructive sleep apnea: a cross-sectional study of patients waiting for sleep diagnostics. Respir Med. 2022;197:106860.
Huo J, Quan SF, Roveda J, Li A. BASH-GN: a new machine learning-derived questionnaire for screening obstructive sleep apnea. Sleep Breath. 2022.
Huang WC, Lee PL, Liu YT, Chiang AA, Lai F. Support vector machine prediction of obstructive sleep apnea in a large-scale Chinese clinical sample. Sleep. 2020;43(7).
Holfinger SJ, Lyons MM, Keenan BT, Mazzotti DR, Mindel J, Maislin G, et al. Diagnostic performance of machine learning-derived OSA Prediction Tools in large clinical and community-based samples. Chest. 2022;161(3):807–17.
Bozkurt S, Bostanci A, Turhan M. Can statistical machine learning algorithms help for classification of obstructive sleep apnea severity to optimal utilization of Polysomnography resources? Methods Inf Med. 2017;56(4):308–18.
Srinivasulu A, Mohan S, H T, S P, R Y, editors. Apnea Event Detection Using Machine Learning Technique for the Clinical Diagnosis of Sleep Apnea Syndrome. 2021 3rd International Conference on Signal Processing and Communication (ICPSC); 2021 13–14 May 2021.
Rajesh K, Dhuli R, Kumar TS. Obstructive sleep apnea detection using discrete wavelet transform-based statistical features. Comput Biol Med. 2021;130:104199.
Lin CY, Wang YW, Setiawan F, Trang NTH, Lin CW. Sleep apnea classification Algorithm Development using a machine-learning Framework and Bag-of-features derived from Electrocardiogram Spectrograms. J Clin Med. 2021;11(1).
Sabil A, Vanbuis J, Baffet G, Feuilloy M, Le Vaillant M, Meslier N et al. Automatic identification of sleep and wakefulness using single-channel EEG and respiratory polygraphy signals for the diagnosis of obstructive sleep apnea. 2019;28(2):e12795.
Onargan A, Gavcar B, Çalışkan G, Akan A, editors. Prediction of Sleep Apnea using EEG signals and machine learning algorithms. IEEE; 2021. 2021 Medical Technologies Congress (TIPTEKNO).
Almuhammadi WS, Aboalayon KA, Faezipour M, editors. Efficient obstructive sleep apnea classification based on EEG signals. 2015 Long Island Systems, Applications and Technology. IEEE; 2015.
Magalang UJ, Dmochowski J, Veeramachaneni S, Draw A, Mador MJ, El-Solh A et al. Prediction of the apnea-hypopnea index from overnight pulse oximetry. 2003;124(5):1694–701.
Ganglberger W, Bucklin AA, Tesh RA, Da Silva Cardoso M, Sun H, Leone MJ et al. Sleep apnea and respiratory anomaly detection from a wearable band and oxygen saturation. 2022;26(3):1033–44.
Yu H, Deng C, Sun J, Chen Y, Cao YJS, Breathing. Cascading detection model for prediction of apnea-hypopnea events based on nasal flow and arterial blood oxygen saturation. 2020;24(2):483–90.
Young T, Skatrud J, Peppard PEJJ. Risk factors for obstructive sleep apnea in adults. 2004;291(16):2013–6.
Senaratna CV, Perret JL, Lodge CJ, Lowe AJ, Campbell BE, Matheson MC, et al. Prevalence of obstructive sleep apnea in the general population: a systematic review. Sleep Med Rev. 2017;34:70–81.
Tom C, Roy B, Vig R, Kang DW, Aysola RS, Woo MA, et al. Correlations between Waist and Neck circumferences and obstructive sleep apnea characteristics. Sleep Vigil. 2018;2(2):111–8.
Senaratna CV, English DR, Currier D, Perret JL, Lowe A, Lodge C, et al. Sleep apnoea in Australian men: Disease burden, co-morbidities, and correlates from the Australian longitudinal study on male health. BMC Public Health. 2016;16(Suppl 3):1029.
Deo RC. Machine learning in Medicine. Circulation. 2015;132(20):1920–30.
Ngiam KY, Khor WJTLO. Big data and machine learning algorithms for health-care delivery. 2019;20(5):e262–e73.
Bandyopadhyay A, Goldstein C. Clinical applications of artificial intelligence in sleep medicine: a sleep clinician’s perspective. Sleep Breath. 2022.
Watson NF, Fernandez CRJSMR. Artificial intelligence and sleep: advancing sleep medicine. 2021;59:101512.
Berry R, Brooks R, Gamaldo C, Harding S, Lloyd R, Quan S et al. AASM Scoring Manual Updates for 2017 (Version 2.4). 2017;13(5):665–6.
Johns MW. A New Method for Measuring Daytime Sleepiness: the Epworth Sleepiness Scale. Sleep. 1991;14(6):540–5.
Netzer N, Stoohs R, Netzer C, Clark K, Strohl KJA. Using the Berlin Questionnaire to identify patients at risk for the sleep apnea syndrome. 1999;131(7):485–91.
Chung F, Abdullah H, Liao PJC, STOP-Bang Questionnaire. A practical Approach to screen for obstructive. Sleep Apnea. 2016;149(3):631–8.
Bjurgert J, Valenzuela P. Rojas CJItonn, systems l. Adapt Boosting Syst Identif. 2018;29(9):4510–4.
Meurer W, Tolles JJJ. Logistic Regression Diagnostics: Understanding How Well a Model Predicts Outcomes. 2017;317(10):1068-9.
Silva F, Sanz M, Seixas J, Solano E, Omar YJNINNS. Perceptrons from Memristors. 2020;122:273–8.
Hothorn T, Lausen B, Benner A. Radespiel-Tröger MJSim. Bagging Survival Trees. 2004;23(1):77–91.
Zhang Z, Zhao Y, Canes A, Steinberg D, Lyashevska O. JAotm. Predictive analytics with gradient boosting in clinical medicine. 2019;7(7):152.
Torlay L, Perrone-Bertolotti M, Thomas E, Baciu MJB. Machine learning-XGBoost analysis of language networks to classify patients with Epilepsy. 2017;4(3):159–69.
Li X, Leung FHF, Su S, Ling SH. Sleep apnea detection using multi-error-reduction classification system with multiple bio-signals. Sens (Basel). 2022;22(15).
Zeng X, Ren Y, Wu K, Yang Q, Zhang S, Wang D et al. Association between smoking behavior and obstructive sleep apnea: a systematic review and meta-analysis. Nicotine Tob Res. 2022.
Maimon N, Hanly PJJJ. Does snoring intensity correlate with the severity of obstructive sleep apnea? 2010;6(5):475–8.
Chiu HY, Chen PY, Chuang LP, Chen NH, Tu YK, Hsieh YJ, et al. Diagnostic accuracy of the Berlin questionnaire, STOP-BANG, STOP, and Epworth sleepiness scale in detecting obstructive sleep apnea: a bivariate meta-analysis. Sleep Med Rev. 2017;36:57–70.
He S, Li Y, Xu W, Han D. Using clinical data to predict obstructive sleep apnea. J Thorac Dis. 2022;14(2):227–37.
Liu WT, Wu HT, Juang JN, Wisniewski A, Lee HC, Wu D, et al. Prediction of the severity of obstructive sleep apnea by anthropometric features via support vector machine. PLoS ONE. 2017;12(5):e0176991.
Laharnar N, Herberger S, Prochnow LK, Chen NH, Cistulli PA, Pack AI, et al. Simple and unbiased OSA prescreening: introduction of a new morphologic OSA prediction score. Nat Sci Sleep. 2021;13:2039–49.
Zhang L, Yan Y, Li S, Li H, Lin Y, Li N et al. Moderate to severe OSA screening based on support vector machine of the Chinese population faciocervical measurements dataset: a cross-sectional study. 2021;11(9):e048482.
Kuan Y, Hong C, Chen P, Liu W, Chung CJMb MBE. e. Logistic regression and artificial neural network-based simple predicting models for obstructive sleep apnea by age, sex, and body mass index. 2022;19(11):11409-21.
Rudin C. Stop Explaining Black Box Machine Learning Models for high stakes decisions and use interpretable models instead. Nat Mach Intell. 2019;1(5):206–15.
Gunning D, Stefik M, Choi J, Miller T, Stumpf S, Yang GZ. XAI-Explainable artificial intelligence. Sci Robot. 2019;4(37).
Hnin K, Mukherjee S, Antic NA, Catcheside P, Chai-Coetzer CL, McEvoy D, et al. The impact of ethnicity on the prevalence and severity of obstructive sleep apnea. Sleep Med Rev. 2018;41:78–86.