SleepLess: personalized sleep monitoring using smartphones and semi-supervised learning
Tóm tắt
Sleep affects our bodily functions and is critical in promoting every individual’s well-being. To that end, sleep health monitoring research has gained interest recently, including coupling data-driven AI techniques with mHealth adaptations of wearable, smartphone, and contactless-sensing modalities. Regardless, prior works, by and large, require gathering sufficient ground truth data to develop personalized and highly accurate sleep prediction models. This requirement inherently presents a challenge of such models underperforming when inferring sleep on new users without labeled data. In this paper, we propose SleepLess, which uses a semi-supervised learning pipeline over unlabeled data sensed from the user’s smartphone network activity to develop personalized models and detect their sleep duration for the night. Specifically, it uses a pre-trained model on an existing set of users to produce pseudo labels for unlabeled data of a new user and achieves personalization by fine-tuning over selectively picking the pseudo labels. Our IRB-approved user study found SleepLess model yielding around 96% accuracy, between 12–27 min of sleep time error and 18–25 min of wake time error. Comparison against other approaches that sought to predict with fewer labeled data found SleepLess, similarly yielding best performance. Our study demonstrates the feasibility of achieving personalized sleep prediction models by utilizing unlabeled data extracted from network activity of users’ smartphones, using a semi-supervised approach.
Tài liệu tham khảo
Ohayon MM (2011) Epidemiological overview of sleep disorders in the general population. Sleep Med Res 2(1):1–9
Krueger PM, Friedman EM (2009) Sleep duration in the United States: a cross-sectional population-based study. Am J Epidemiol 169(9):1052–1063
Google I (2022). https://www.fitbit.com/global/be/products/trackers/inspire. Accessed 27 Oct 2022
inc (2022). https://ouraring.com/. Accessed 27 Oct 2022
Rahman T, Adams AT, Ravichandran RV, Zhang M, Patel SN, Kientz JA, Choudhury T (2015) Dopplesleep: a contactless unobtrusive sleep sensing system using short-range Doppler radar. In: Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing, pp 39–50
Google I (2022). https://support.google.com/googlenest/answer/10388741?hl=en. Accessed 27 Oct 2022
Amazon I (2022). https://www.amazon.com/Paschar-LLC-Walabot-Sleep-Tracker/dp/B07C2HRYSX. Accessed 27 Oct 2022
Dixon M, Schneider L, Yu J, Hsu J, Pathak A, Shin D, Lee RS, Malhotra MR, Mixter K, McConnell M, Taylor J, Patel S (2021) Sleep-wake detection with a contactless, bedside radar sleep sensing system. Technical report
Abdullah S, Matthews M, Murnane EL, Gay G, Choudhury T (2014) Towards circadian computing: “early to bed and early to rise” makes some of us unhealthy and sleep deprived. In: Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing, pp 673–684
Zakaria C, Yilmaz G, Mammen P, Chee M, Shenoy P, Balan R (2022) Sleepmore: sleep prediction at scale via multi-device wifi sensing. arXiv preprint arXiv:2210.14152
Zhao Y, Liu H, Li H, Barnaghi P, Haddadi H (2020) Semi-supervised federated learning for activity recognition. arXiv preprint arXiv:2011.00851
Trivedi A, Zakaria C, Balan R, Becker A, Corey G, Shenoy P (2021) Wifitrace: network-based contact tracing for infectious diseases using passive wifi sensing. In: Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies, vol 5(1), pp 1–26
Min JK, Doryab A, Wiese J, Amini S, Zimmerman J, Hong JI (2014) Toss’n’turn: smartphone as sleep and sleep quality detector. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 477–486
inc A (2023). https://developers.google.com/location-context/sleep. Accessed 17 Aug 2023
inc (2023). http://autosleep.tantsissa.com/home. Accessed 17 Aug 2023
rise (2023). https://www.risescience.com/. Accessed 17 Aug 2023
Mammen PM, Zakaria C, Molom-Ochir T, Trivedi A, Shenoy P, Balan R (2021) Wisleep: inferring sleep duration at scale using passive wifi sensing. arXiv preprint arXiv:2102.03690
Dhamija AR, Günther M, Boult T (2018) Reducing network agnostophobia. In: Advances in neural information processing systems, vol 31
Python I (2022). https://www.python.org/. Accessed 27 Oct 2022
keras I (2022). https://keras.io/. Accessed 27 Oct 2022
Saeb S, Cybulski TR, Schueller SM, Kording KP, Mohr DC et al (2017) Scalable passive sleep monitoring using mobile phones: opportunities and obstacles. J Med Int Res 19(4):118
Chen M, Du Y, Zhang Y, Qian S, Wang C (2022) Semi-supervised learning with multi-head co-training. In: Proceedings of the AAAI conference on artificial intelligence, vol 36, pp 6278–6286
Bhattacharya S, Nurmi P, Hammerla N, Plötz T (2014) Using unlabeled data in a sparse-coding framework for human activity recognition. Pervasive Mob Comput 15:242–262
Haoran B, Guanze L (2021) Semi-supervised end-to-end automatic sleep stage classification based on pseudo-label. In: 2021 IEEE international conference on power electronics, computer applications (ICPECA), pp. 83–87. IEEE
Zhang C, Yu W, Li Y, Sun H, Zhang Y, De Vos M (2022) Cms2-net: semi-supervised sleep staging for diverse obstructive sleep apnea severity. IEEE J Biomed Health Inform 26(7):3447–3457
Li Y, Peng C, Zhang Y, Zhang Y, Lo B (2022) Adversarial learning for semi-supervised pediatric sleep staging with single-EEG channel. Methods 204:84–91
Munk AM, Olesen KV, Gangstad SW, Hansen LK (2018) Semi-supervised sleep-stage scoring based on single channel EEG. In: 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 2551–2555. IEEE
Gu W, Shangguan L, Yang Z, Liu Y (2015) Sleep hunter: towards fine grained sleep stage tracking with smartphones. IEEE Trans Mob Comput 15(6):1514–1527
Hao T, Xing G, Zhou G (2013) isleep: unobtrusive sleep quality monitoring using smartphones. In: Proceedings of the 11th ACM conference on embedded networked sensor systems, pp 1–14
Ren Y, Wang C, Yang J, Chen Y (2015) Fine-grained sleep monitoring: hearing your breathing with smartphones. In: 2015 IEEE conference on computer communications (INFOCOM), pp 1194–1202. IEEE
Cuttone A, Bakgaard P, Sekara V, Jonsson H, Larsen JE, Lehmann S (2017) Sensiblesleep: a bayesian model for learning sleep patterns from smartphone events. PloS One 12(1):e0169901
Zhenyu C, Lane N, Cardone G, Lin M, Choudhury T, Campbell A (2013) Unobtrusive sleep monitoring using smartphones. In: Proceedings of pervasive health
Wang R, Chen F, Chen Z, Li T, Harari G, Tignor S, Zhou X, Ben-Zeev D, Campbell AT (2014) Studentlife: assessing mental health, academic performance and behavioral trends of college students using smartphones. In: Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing, pp 3–14
Wang X, Huang R, Yang C, Mao S (2021) Smartphone sonar-based contact-free respiration rate monitoring. ACM Trans Comput Healthc 2(2):1–26
Tiron R, Lyon G, Kilroy H, Osman A, Kelly N, O’Mahony N, Lopes C, Coffey S, McMahon S, Wren M et al (2020) Screening for obstructive sleep apnea with novel hybrid acoustic smartphone app technology. J Thorac Dis 12(8):4476
Kim DH, Kim SW, Hwang SH (2022) Diagnostic value of smartphone in obstructive sleep apnea syndrome: a systematic review and meta-analysis. PLoS ONE 17(5):0268585
Hofman JM, Sharma A, Watts DJ (2017) Prediction and explanation in social systems. Science 355(6324):486–488
Rundo JV, Downey R III (2019) Polysomnography. Handb Clin Neurol 160:381–392
inc A (2022). https://www.apple.com/watch/. Accessed 27 Oct 2022
Witt DR, Kellogg RA, Snyder MP, Dunn J (2019) Windows into human health through wearables data analytics. Curr Opin Biomed Eng 9:28–46
Lee YS, Pathirana PN, Steinfort CL, Caelli T (2014) Monitoring and analysis of respiratory patterns using microwave Doppler radar. IEEE J Transl Eng Health Med 2:1–12
Gu C, Li C (2015) Assessment of human respiration patterns via noncontact sensing using Doppler multi-radar system. Sensors 15(3):6383–6398
Lin F, Zhuang Y, Song C, Wang A, Li Y, Gu C, Li C, Xu W (2016) Sleepsense: a noncontact and cost-effective sleep monitoring system. IEEE Trans Biomed Circuits Syst 11(1):189–202
Hong H, Zhang L, Zhao H, Chu H, Gu C, Brown M, Zhu X, Li C (2019) Microwave sensing and sleep: noncontact sleep-monitoring technology with microwave biomedical radar. IEEE Microw Mag 20(8):18–29
De Zambotti M, Cellini N, Goldstone A, Colrain IM, Baker FC (2019) Wearable sleep technology in clinical and research settings. Med Sci Sports Exerc 51(7):1538
Yalniz IZ, Jégou H, Chen K, Paluri M, Mahajan D (2019) Billion-scale semi-supervised learning for image classification. arXiv preprint arXiv:1905.00546
Zou Y, Yu Z, Kumar B, Wang J (2018) Unsupervised domain adaptation for semantic segmentation via class-balanced self-training. In: Proceedings of the European conference on computer vision (ECCV), pp 289–305
Zhang C, Bengio S, Hardt M, Recht B, Vinyals O (2021) Understanding deep learning (still) requires rethinking generalization. Commun ACM 64(3):107–115
Zhou Z-H, Li M (2010) Semi-supervised learning by disagreement. Knowl Inf Syst 24(3):415–439
Wang W, Zhou ZH (2007) Analyzing co-training style algorithms. In: European conference on machine learning, pp 454–465. Springer
Guan D, Yuan W, Lee YK, Gavrilov A, Lee S (2007) Activity recognition based on semi-supervised learning. In: 13th IEEE international conference on embedded and real-time computing systems and applications (RTCSA 2007), pp 469–475. IEEE
Faridee AZM, Chakma A, Misra A, Roy N (2022) Strangan: adversarially-learnt spatial transformer for scalable human activity recognition. Smart Health 23:100226
Gogna A, Majumdar A (2016) Semi supervised autoencoder. In: International conference on neural information processing, pp 82–89. Springer