A deep CNN approach to decode motor preparation of upper limbs from time–frequency maps of EEG signals at source level

Baillet, 2001, Electromagnetic brain mapping, IEEE Signal Processing Magazine, 18, 14, 10.1109/79.962275 Balasubramanian, 2018, Is EMG a viable alternative to BCI for detecting movement intention in severe stroke?, IEEE Transactions on Biomedical Engineering, 65, 2790, 10.1109/TBME.2018.2817688 Bengio, 2012, Practical recommendations for gradient-based training of deep architectures, 437 Brodmann, 2007 Daubechies, 1992 Deng, 2005, Classification of the intention to generate a shoulder versus elbow torque by means of a time–frequency synthesized spatial patterns BCI algorithm, Journal of Neural Engineering, 2, 131, 10.1088/1741-2560/2/4/009 Edelman, 2015, EEG source imaging enhances the decoding of complex right-hand motor imagery tasks, IEEE Transactions on Biomedical Engineering, 63, 4, 10.1109/TBME.2015.2467312 Gasparini, 2018, Information theoretic-based interpretation of a deep neural network approach in diagnosing psychogenic non-epileptic seizures, Entropy, 20, 43, 10.3390/e20020043 Grech, 2008, Review on solving the inverse problem in EEG source analysis, Journal of Neuroengineering and Rehabilitation, 5, 25, 10.1186/1743-0003-5-25 Grosse-Wentrup, 2011, What are the causes of performance variation in brain-computer interfacing?, International Journal of Bioelectromagnetism, 13, 115 Grosse-Wentrup, 2009, Beamforming in noninvasive brain-computer interfaces, IEEE Transactions on Biomedical Engineering, 56, 1209, 10.1109/TBME.2008.2009768 Ha, 2019, Motor imagery EEG classification using capsule networks, Sensors, 19, 2854, 10.3390/s19132854 Hammon, 2007, Predicting reaching targets from human EEG, IEEE Signal Processing Magazine, 25, 69, 10.1109/MSP.2008.4408443 Haufe, 2016, A simulation framework for benchmarking EEG-based brain connectivity estimation methodologies, Brain Topography, 1 Haufe, 2015, A highly detailed FEM volume conductor model based on the ICBM152 average head template for EEG source imaging and TCS targeting Henry, 2006, Electroencephalography: basic principles, clinical applications, and related fields, Neurology, 67, 2092, 10.1212/01.wnl.0000243257.85592.9a Hermes, 2011, Functional MRI-based identification of brain areas involved in motor imagery for implantable brain–computer interfaces, Journal of Neural Engineering, 8, 025007, 10.1088/1741-2560/8/2/025007 Ieracitano, 2019, A convolutional neural network approach for classification of dementia stages based on 2d-spectral representation of EEG recordings, Neurocomputing, 323, 96, 10.1016/j.neucom.2018.09.071 Kantak, 2012, Rewiring the brain: potential role of the premotor cortex in motor control, learning, and recovery of function following brain injury, Neurorehabilitation and Neural Repair, 26, 282, 10.1177/1545968311420845 Kasabov, 2014, Neucube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data, Neural Networks, 52, 62, 10.1016/j.neunet.2014.01.006 Kilicarslan, 2019, Characterization and real-time removal of motion artifacts from EEG signals, Journal of Neural Engineering, 16, 056027, 10.1088/1741-2552/ab2b61 Kim, 2019, Classification of movement intention using independent components of premovement EEG, Frontiers in Human Neuroscience, 13, 63, 10.3389/fnhum.2019.00063 Kingma, 2014 Krizhevsky, 2012, Imagenet classification with deep convolutional neural networks, 1097 Lancaster, 1997, Automated labeling of the human brain: A preliminary report on the development and evaluation of a forward-transform method, Human Brain Mapping, 5, 238, 10.1002/(SICI)1097-0193(1997)5:4<238::AID-HBM6>3.0.CO;2-4 Lancaster, 2007, Bias between MNI and talairach coordinates analyzed using the ICBM-152 brain template, Human Brain Mapping, 28, 1194, 10.1002/hbm.20345 Lancaster, 2000, Automated talairach atlas labels for functional brain mapping, Human Brain Mapping, 10, 120, 10.1002/1097-0193(200007)10:3<120::AID-HBM30>3.0.CO;2-8 Lew, 2012, Detection of self-paced reaching movement intention from EEG signals, Frontiers in Neuroengineering, 5, 13, 10.3389/fneng.2012.00013 López-Larraz, 2018, Brain-machine interfaces for rehabilitation in stroke: A review, NeuroRehabilitation, 43, 77, 10.3233/NRE-172394 Lotte, 2018, A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update, Journal of Neural Engineering, 15, 031005, 10.1088/1741-2552/aab2f2 Lotte, 2017, Online classification accuracy is a poor metric to study mental imagery-based BCI user learning: an experimental demonstration and new metrics, hal Lu, 2016, A deep learning scheme for motor imagery classification based on restricted boltzmann machines, IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25, 566, 10.1109/TNSRE.2016.2601240 Mammone, 2018, Brain network analysis of compressive sensed high-density EEG signals in AD and MCI subjects, IEEE Transactions on Industrial Informatics, 15, 527, 10.1109/TII.2018.2868431 Mammone, 2017, A permutation disalignment index-based complex network approach to evaluate longitudinal changes in brain-electrical connectivity, Entropy, 19, 548, 10.3390/e19100548 McFarland, 2011, Brain-computer interfaces for communication and control, Communications of the ACM, 54, 60, 10.1145/1941487.1941506 Millan, 2004, On the need for on-line learning in brain-computer interfaces, 2877 Morabito, 2016, Deep convolutional neural networks for classification of mild cognitive impaired and alzheimer’s disease patients from scalp EEG recordings, 1 Müller-Putz, 2016, From classic motor imagery to complex movement intention decoding: The noninvasive Graz-BCI approach, 39 Muthukumaraswamy, 2013, High-frequency brain activity and muscle artifacts in MEG/EEG: a review and recommendations, Frontiers in Human Neuroscience, 7, 138, 10.3389/fnhum.2013.00138 Nair, V., & Hinton, G. E. (2010). Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th international conference on machine learning (pp. 807–814). Nunez, 2006, Electric fields of the brain Ofner, 2017, Upper limb movements can be decoded from the time-domain of low-frequency EEG, PloS One, 12, 10.1371/journal.pone.0182578 Pereira, 2017, EEG neural correlates of goal-directed movement intention, Neuroimage, 149, 129, 10.1016/j.neuroimage.2017.01.030 Powers, 2011, Evaluation: from precision, recall and f-measure to roc, informedness, markedness and correlation, Journal of Machine Learning Technologies, 2(1), 37 Schirrmeister, 2017, Deep learning with convolutional neural networks for EEG decoding and visualization, Human Brain Mapping, 38, 5391, 10.1002/hbm.23730 Seeber, 2016, EEG oscillations are modulated in different behavior-related networks during rhythmic finger movements, Journal of Neuroscience, 36, 11671, 10.1523/JNEUROSCI.1739-16.2016 Shakeel, 2015, A review of techniques for detection of movement intention using movement-related cortical potentials, Computational and Mathematical Methods in Medicine, 346217 Shenoy, 2006, Towards adaptive classification for BCI, Journal of Neural Engineering, 3, R13, 10.1088/1741-2560/3/1/R02 Song, 2015, EEG source localization: sensor density and head surface coverage, Journal of Neuroscience Methods, 256, 9, 10.1016/j.jneumeth.2015.08.015 Spring, 2016, Movement-related cortical potential amplitude reduction after cycling exercise relates to the extent of neuromuscular fatigue, Frontiers in Human Neuroscience, 10, 257, 10.3389/fnhum.2016.00257 Sturm, 2016, Interpretable deep neural networks for single-trial EEG classification, Journal of Neuroscience Methods, 274, 141, 10.1016/j.jneumeth.2016.10.008 Tabar, 2016, A novel deep learning approach for classification of EEG motor imagery signals, Journal of Neural Engineering, 14, 016003, 10.1088/1741-2560/14/1/016003 Tadel, 2011, Brainstorm: a user-friendly application for MEG/EEG analysis, Computational Intelligence and Neuroscience, 8 Tang, 2019, Classification of EEG-based single-trial motor imagery tasks using a B-CSP method for BCI, Frontiers of Information Technology & Electronic Engineering, 20, 1087, 10.1631/FITEE.1800083 Tang, 2019, Single-trial classification of different movements on one arm based on ERD/ERS and corticomuscular coherence, IEEE Access, 7, 128185, 10.1109/ACCESS.2019.2940034 Tayeb, 2018, Gumpy: A python toolbox suitable for hybrid brain–computer interfaces, Journal of Neural Engineering, 15, 065003, 10.1088/1741-2552/aae186 Vecchiato, 2019, Electroencephalographic time-frequency patterns of braking and acceleration movement preparation in car driving simulation, Brain Research, 1716, 16, 10.1016/j.brainres.2018.09.004 Vourvopoulos, 2019, Effects of a brain-computer interface with virtual reality (vr) neurofeedback: A pilot study in chronic stroke patients, Frontiers in Human Neuroscience, 13, 210, 10.3389/fnhum.2019.00210 Wagner, 2016, Distinct β band oscillatory networks subserving motor and cognitive control during gait adaptation, Journal of Neuroscience, 36, 2212, 10.1523/JNEUROSCI.3543-15.2016 Yang, 2015, EEG activity during movement planning encodes upcoming peak speed and acceleration and improves the accuracy in predicting hand kinematics, IEEE Journal of Biomedical and Health Informatics, 19, 22, 10.1109/JBHI.2014.2327635 Yong, 2015, EEG classification of different imaginary movements within the same limb, PloS One, 10, 10.1371/journal.pone.0121896 Zhang, 2019, An EEG/EMG/EOG-based multimodal human-machine interface to real-time control of a soft robot hand, Frontiers in Neurorobotics, 13, 7, 10.3389/fnbot.2019.00007