Automatic Human Sleep Stage Scoring Using Deep Neural Networks

Alexander Malafeev1,2,3, Dmitry Laptev4, Stefan Bauer4,5, Ximena Omlin3,6, Aleksandra Wierzbicka7, Adam Wichniak8, Wojciech Jernajczyk7, Robert Riener1,3,6,9, Joachim M. Buhmann4, Peter Achermann1,2,3
1Center for Interdisciplinary Sleep Research, University of Zurich, Zurich, Switzerland
2Chronobiology and Sleep Research, Institute of Pharmacology and Toxicology, University of Zurich, Zurich, Switzerland
3Neuroscience Center Zurich, University of Zurich and ETH Zurich, Zurich, Switzerland
4Information Science and Engineering, Institute for Machine Learning, ETH Zurich, Zurich, Switzerland
5Max Planck Institute for Intelligent Systems, Tübingen, Germany
6Sensory-Motor Systems Lab, ETH Zurich, Zurich, Switzerland
7Sleep Disorders Center, Department of Clinical Neurophysiology, Institute of Psychiatry and Neurology in Warsaw, Warsaw, Poland
8Third Department of Psychiatry and Sleep Disorders Center, Institute of Psychiatry and Neurology in Warsaw, Warsaw, Poland
9University Hospital Balgrist (SCI Center), Medical Faculty, University of Zurich, Zurich, Switzerland

Tóm tắt

Từ khóa


Tài liệu tham khảo

Abadi, 2016, “TensorFlow: a system for large-scale machine learning,” in, Proceeding OSDI’16 Proceedings of the 12th USENIX conference on Operating Systems Design and Implementation, 265

Abdel-Hamid, 2014, Convolutional neural networks for speech recognition., IEEE/ACM Trans. Audio Speech Lang. Proc., 22, 1533, 10.1109/TASLP.2014.2339736

Achermann, 2014, Human sleep and its regulation., Kosmos, 2, 173

Agarwal, 2001, Computer-assisted sleep staging., IEEE Trans. Biomed. Eng., 48, 1412, 10.1109/10.966600

Al-Rfou, 2016, Theano: a python framework for fast computation of mathematical expressions.

Anderer, 2005, An E-health solution for automatic sleep classification according to Rechtschaffen and Kales: validation study of the Somnolyzer 24 × 7 utilizing the Siesta database., Neuropsychobiology, 51, 115, 10.1159/000085205

Babadi, 2014, A review of multitaper spectral analysis., IEEE Trans. Biomed. Eng., 61, 1555, 10.1109/TBME.2014.2311996

Bishop, 2016, Pattern Recognition and Machine Learning.

Breiman, 2001, Random forests., Mach. Learn., 45, 5, 10.1023/A:1010933404324

Breiman, 1984, Classification and Regression Trees.

Cecotti, 2008, “Convolutional neural network with embedded Fourier transform for EEG classification,” in, Pattern Recognition, 2008. ICPR 2008. 19th International Conference on: IEEE, 1

Chambon, 2018, A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time series., IEEE Trans. Neural Syst. Rehabil. Eng., 26, 758, 10.1109/TNSRE.2018.2813138

Chen, 2016, “Xgboost: a scalable tree boosting system,” in, Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and Data Mining: ACM, 785, 10.1145/2939672.2939785

Chollet, 2015, Keras.

Cohen, 1960, A coefficient of agreement for nominal scales., Edu. Psychosoc. Measure., 20, 37, 10.1177/001316446002000104

Danker-Hopfe, 2009, Interrater reliability for sleep scoring according to the Rechtschaffen & Kales and the new AASM standard., J. Sleep Res., 18, 74, 10.1111/j.1365-2869.2008.00700.x

Danker-Hopfe, 2004, Interrater reliability between scorers from eight European sleep laboratories in subjects with different sleep disorders., J. Sleep Res., 13, 63, 10.1046/j.1365-2869.2003.00375.x

Davidson, 2006, “Detecting behavioral microsleeps using EEG and LSTM recurrent neural networks,” in, Engineering in Medicine and Biology Society, 2005. IEEE-EMBS 2005. 27th Annual International Conference of the: IEEE, 5754

De Boer, 2005, A tutorial on the cross-entropy method., Ann. Operat. Res., 134, 19, 10.1007/s10479-005-5724-z

Dice, 1945, Measures of the amount of ecologic association between species., Ecology, 26, 297, 10.2307/1932409

Doroshenkov, 2007, Classification of human sleep stages based on EEG processing using hidden Markov models., Biomed. Eng., 41, 25, 10.1007/s10527-007-0006-5

Dos Santos, 2014, “Deep convolutional neural networks for sentiment analysis of short texts,” in, Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, 69

Farley, 1954, Simulation of self-organizing systems by digital computer., Trans. IRE Prof. Group Inform. Theory, 4, 76, 10.1109/TIT.1954.1057468

Fell, 1996, Discrimination of sleep stages: a comparison between spectral and nonlinear EEG measures., Electroencephalogr. Clin. Neurophysiol., 98, 401, 10.1016/0013-4694(96)95636-9

Fukushima, 1982, “Neocognitron: a self-organizing neural network model for a mechanism of visual pattern recognition,” in, Competition and Cooperation in Neural Nets, 267, 10.1007/978-3-642-46466-9_18

Gaillard, 1973, Principles of automatic analysis of sleep records with a hybrid system., Comput. Biomed. Res., 6, 1, 10.1016/0010-4809(73)90059-1

Gath, 1989, Unsupervised optimal fuzzy clustering., IEEE Trans. Pattern Anal. Mach. Intell., 11, 773, 10.1109/34.192473

Gevins, 1987, Methods of Analysis of Brain Electrical and Magnetic Signals.

Goodfellow, 2016, Deep Learning.

Graves, 2013, “Speech recognition with deep recurrent neural networks,” in, Acoustics, speech and signal processing (ICASSP), 2013 IEEE International Conference on: IEEE, 6645, 10.1109/ICASSP.2013.6638947

Grube, 2002, Unsupervised continuous sleep analysis., Methods Find. Exp. Clin. Pharmacol., 24, 51

He, 2016, “Deep residual learning for image recognition,” in, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 770, 10.1109/CVPR.2016.90

Ho, 1995, “Random decision forests,” in, Document Analysis and Recognition, 1995., Proceedings of the Third International Conference on: IEEE, 278

Hochreiter, 1997, Long short-term memory., Neural Comput., 9, 1735, 10.1162/neco.1997.9.8.1735

Hunt, 1966, Experiments in Induction.

Iber, 2007, The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications.

Ioffe, 2015, Batch normalization: accelerating deep network training by reducing internal covariate shift.

Itil, 1969, Digital computer classifications of EEG sleep stages., Electroencephalogr. Clin. Neurophysiol., 27, 76, 10.1016/0013-4694(69)90112-6

Ivakhnenko, 1967, Cybernetics and Forecasting Techniques.

Jouvet, 1960, Analyse électroencépholographique comparée du sommeil physiologique chez le chat et chez l’homme., Revue Neurologique, 103, 189D

Karpathy, 2015, “Deep visual-semantic alignments for generating image descriptions,” in, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3128, 10.1109/CVPR.2015.7298932

Klosh, 2001, The SIESTA project polygraphic and clinical database., IEEE Eng. Med. Biol. Mag., 20, 51, 10.1109/51.932725

Längkvist, 2012, Sleep stage classification using unsupervised feature learning., Adv. Artif. Neural Syst., 2012, 10.1155/2012/107046

Laptev, 2014, “Convolutional decision trees for feature learning and segmentation,” in, German Conference on Pattern Recognition, 95, 10.1007/978-3-319-11752-2_8

Laptev, 2015, “Transformation-invariant convolutional jungles,” in, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3043, 10.1109/CVPR.2015.7298923

Larsen, 1970, On automatic methods of sleep staging by EEG spectra., Electroencephalogr. Clin. Neurophysiol., 28, 459, 10.1016/0013-4694(70)90271-3

Lecun, 1989, Backpropagation applied to handwritten zip code recognition., Neural Comput., 1, 541, 10.1162/neco.1989.1.4.541

Libourel, 2015, Unsupervised online classifier in sleep scoring for sleep deprivation studies., Sleep, 38, 815, 10.5665/sleep.4682

Louis, 2004, Design and validation of a computer-based sleep-scoring algorithm., J. Neurosci. Methods, 133, 71, 10.1016/j.jneumeth.2003.09.025

Malafeev, 2018, Automatic artefact detection in single-channel sleep EEG recordings., J. Sleep Res., 10.1111/jsr.12679

Martin, 1972, Pattern recognition of EEG-EOG as a technique for all-night sleep stage scoring., Electroencephalogr. Clin. Neurophysiol., 32, 417, 10.1016/0013-4694(72)90009-0

Mayers, 2005, Antidepressants and their effect on sleep., Hum. Psychopharmacol. Clin. Exp., 20, 533, 10.1002/hup.726

Mccarley, 2007, Neurobiology of REM and NREM sleep., Sleep Med., 8, 302, 10.1016/j.sleep.2007.03.005

Mchugh, 2012, Interrater reliability: the kappa statistic., Biochem. Med., 22, 276, 10.11613/BM.2012.031

Mikolov, 2010, “Recurrent neural network based language model,” in, Eleventh Annual Conference of the International Speech Communication Association

Mirowski, 2008, “Comparing SVM and convolutional networks for epileptic seizure prediction from intracranial EEG,” in, Machine Learning for Signal Processing, 2008. MLSP 2008. IEEE Workshop on: IEEE, 244, 10.1109/MLSP.2008.4685487

Mitchell, 1997, Machine Learning.

Morgan, 1963, Problems in the analysis of survey data, and a proposal., J. Am. Stat. Assoc., 58, 415, 10.1080/01621459.1963.10500855

Omlin, 2018, The effect of a slowly rocking bed on sleep., Sci. Rep., 8, 10.1038/s41598-018-19880-3

Pan, 2012, A transition-constrained discrete hidden Markov model for automatic sleep staging., Biomed. Eng. Online, 11, 10.1186/1475-925X-11-52

Pardey, 1996, A new approach to the analysis of the human sleep/wakefulness continuum., J. Sleep Res., 5, 201, 10.1111/j.1365-2869.1996.00201.x

Park, 2000, Automated sleep stage scoring using hybrid rule-and case-based reasoning., Comput. Biomed. Res., 33, 330, 10.1006/cbmr.2000.1549

Pedregosa, 2011, Scikit-learn: machine learning in Python., J. Mach. Learn. Res., 12, 2825

Penzel, 2013, Inter-scorer reliability between sleep centers can teach us what to improve in the scoring rules., J. Clin. Sleep Med., 9, 89, 10.5664/jcsm.2352

Phan, 2018, Joint classification and prediction CNN framework for automatic sleep stage classification., 10.1109/TBME.2018.2872652

Powers, 2014, What the F-measure doesn’t measure: features, flaws, fallacies and fixes.

Rechtschaffen, 1968, A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects.

Rochester, 1956, Tests on a cell assembly theory of the action of the brain, using a large digital computer., IRE Trans. Inform. Theory, 2, 80, 10.1109/TIT.1956.1056810

Rosenberg, 2013, The american academy of sleep medicine inter-scorer reliability program: sleep stage scoring., J. Clin. Sleep Med., 9, 10.5664/jcsm.2350

Rosenblatt, 1958, The perceptron: a probabilistic model for information storage and organization in the brain., Psychol. Rev., 65, 10.1037/h0042519

Safavian, 1991, A survey of decision tree classifier methodology., IEEE Trans. Syst. Man Cybernet., 21, 660, 10.1109/21.97458

Schaltenbrand, 1993, Neural network model: application to automatic analysis of human sleep., Comput. Biomed. Res., 26, 157, 10.1006/cbmr.1993.1010

Sharpley, 1996, The effects of paroxetine and nefazodone on sleep: a placebo controlled trial., Psychopharmacology, 126, 50, 10.1007/BF02246410

Smith, 1971, EEG sleep stage scoring by an automatic hybrid system., Electroencephalogr. Clin. Neurophysiol., 31, 231, 10.1016/0013-4694(71)90092-7

Sørensen, 1948, A method of establishing groups of equal amplitude in plant sociology based on similarity of species and its application to analyses of the vegetation on Danish commons., Biol. Skr., 5, 1

Sors, 2018, A convolutional neural network for sleep stage scoring from raw single-channel EEG., Biomed. Signal Proc. Control, 42, 107, 10.1109/TNSRE.2017.2721116

Stanus, 1987, Automated sleep scoring: a comparative reliability study of two algorithms., Electroencephalogr. Clin. Neurophysiol., 66, 448, 10.1016/0013-4694(87)90214-8

Stratonovich, 1960, Conditional markov processes., Theory Probabil. Appl., 5, 156, 10.1137/1105015

Sun, 2017, Large-scale automated sleep staging., Sleep, 40, zsx139, 10.1093/sleep/zsx139

Sunagawa, 2013, FASTER: an unsupervised fully automated sleep staging method for mice., Genes Cells, 18, 502, 10.1111/gtc.12053

Supratak, 2017, DeepSleepNet: a model for automatic sleep stage scoring based on raw single-channel EEG., IEEE Trans. Neural. Syst. Rehabil. Eng., 25, 1998, 10.1109/TNSRE.2017.2721116

Takahara, 2009, Co-occurrence of sawtooth waves and rapid eye movements during REM sleep., Int. J. Bioelectromagn., 11, 144

Tinguely, 2014, Sleep habits, sleep quality and sleep medicine use of the Swiss population result., Ther. Umsch., 71, 637, 10.1024/0040-5930/a000604

Tsinalis, 2016, Automatic sleep stage scoring with single-channel EEG using convolutional neural networks.

Von Rotz, 2017, Neuronal oscillations and synchronicity associated with gamma-hydroxybutyrate during resting-state in healthy male volunteers., Psychopharmacology, 234, 1957, 10.1007/s00213-017-4603-z

Waibel, 1989, Phoneme recognition using time-delay neural networks., IEEE Trans. Acoust. Speech Signal Proc., 37, 328, 10.1109/29.21701

Welch, 1967, The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms., IEEE Trans. Audio Electroacoust., 15, 70, 10.1109/TAU.1967.1161901

Younes, 2018, Reliability of the American academy of sleep medicine rules for assessing sleep depth in clinical practice., J. Clin. Sleep Med., 14, 205, 10.5664/jcsm.6934

Younes, 2016, Staging sleep in polysomnograms: analysis of inter-scorer variability., J. Clin. Sleep Med., 12, 10.5664/jcsm.5894