A novel multi-scale convolutional neural network for motor imagery classification

Nicolas-Alonso, 2012, Brain computer interfaces: a review, Sensors, 12, 1211, 10.3390/s120201211 Abdulkader, 2015, Brain computer interfacing: applications and challenges, Egypt. Inf. J., 16, 213 Ortiz-Rosario, 2013, Brain–computer interface technologies: from signal to action, Rev. Neurosci., 24, 10.1515/revneuro-2013-0032 Klonowski, 2009, Everything you wanted to ask about EEG but were afraid to get the right answer, Nonlinear Biomed. Phys., 3, 2, 10.1186/1753-4631-3-2 Jeon, 2011, Event-related (de)synchronization (ERD/ERS) during motor imagery tasks: implications for brain–computer interfaces, Int. J. Ind. Ergon., 41, 428, 10.1016/j.ergon.2011.03.005 Pardey, 1996, A review of parametric modelling techniques for EEG analysis, Med. Eng. Phys., 18, 2, 10.1016/1350-4533(95)00024-0 Chatterjee, 2016, EEG based motor imagery classification using SVM and MLP, 2016 2nd International Conference on Computational Intelligence and Networks (CINE), 84, 10.1109/CINE.2016.22 Hjorth, 1970, EEG analysis based on time domain properties, Electroencephalogr. Clin. Neurophysiol., 29, 306, 10.1016/0013-4694(70)90143-4 Uyulan, 2016, Comparison of wavelet families for mental task classification, J. Neurobehavioral Sci., 3, 59, 10.5455/JNBS.1454666348 Gaur, 2018, A multi-class EEG-based BCI classification using multivariate empirical mode decomposition based filtering and Riemannian geometry, Expert Syst. Appl., 95, 201, 10.1016/j.eswa.2017.11.007 Tzallas, 2007, The use of time-frequency distributions for epileptic seizure detection in EEG recordings, Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2007, 3, 10.1109/IEMBS.2007.4352208 Vaid, 2015, EEG signal analysis for BCI interface: a review, 143 Horev, 2017, Geometry-aware principal component analysis for symmetric positive definite matrices, Mach. Learn., 106, 493, 10.1007/s10994-016-5605-5 Blankertz, 2008, Optimizing spatial filters for robust EEG single-trial analysis, IEEE Signal Process. Mag., 25, 41, 10.1109/MSP.2008.4408441 Ang, 2012, Filter bank common spatial pattern algorithm on BCI competition IV datasets 2a and 2b, Front. Neurosci., 6, 39, 10.3389/fnins.2012.00039 Barachant, 2012, Multiclass brain–computer interface classification by Riemannian geometry, IEEE Trans. Biomed. Eng., 59, 920, 10.1109/TBME.2011.2172210 Barachant, 2013, Classification of covariance matrices using a Riemannian-based kernel for BCI applications, Neurocomputing, 112, 172, 10.1016/j.neucom.2012.12.039 Lotte, 2018, A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update, J. Neural Eng., 15, 10.1088/1741-2552/aab2f2 Lotte, 2007, A review of classification algorithms for EEG-based brain–computer interfaces, J. Neural Eng., 4, R1, 10.1088/1741-2560/4/2/R01 Reuderink, 2008 LeCun, 2015, Deep learning, Nature, 521, 436, 10.1038/nature14539 Roy, 2019, Deep learning-based electroencephalography analysis: a systematic review, J. Neural Eng., 16, 051001, 10.1088/1741-2552/ab260c Schirrmeister, 2017, Deep learning with convolutional neural networks for EEG decoding and visualization: convolutional neural networks in EEG analysis, Hum. Brain Mapping, 38, 5391, 10.1002/hbm.23730 Lawhern, 2018, A compact convolutional neural network for EEG-based brain–computer interfaces, J. Neural Eng., 15, 056013, 10.1088/1741-2552/aace8c Amin, 2019, Deep learning for EEG motor imagery classification based on multi-layer CNNs feature fusion, Future Gen. Comput. Syst., 101, 542, 10.1016/j.future.2019.06.027 Wang, 2020, Temporal-spatial-frequency depth extraction of brain–computer interface based on mental tasks, Biomed. Signal Process. Control, 58, 101845, 10.1016/j.bspc.2020.101845 Sakhavi, 2018, Learning temporal information for brain–computer interface using convolutional neural networks, IEEE Trans. Neural Netw. Learn. Syst., 29, 5619, 10.1109/TNNLS.2018.2789927 A.G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, H. Adam, MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications, CoRR abs/1704.04861. Ioffe, 2015, Batch normalization: accelerating deep network training by reducing internal covariate shift, 448 Baldi, 2013, Understanding dropout, 2814 Goodfellow, 2016 Lecun, 1998, Gradient-based learning applied to document recognition, Proc. IEEE, 86, 2278, 10.1109/5.726791 Cecotti, 2011, Convolutional neural networks for P300 detection with application to brain–computer interfaces, IEEE Trans. Pattern Anal. Mach. Intell., 33, 433, 10.1109/TPAMI.2010.125 Tang, 2020, Motor imagery EEG recognition based on conditional optimization empirical mode decomposition and multi-scale convolutional neural network, Expert Syst. Appl., 149, 113285, 10.1016/j.eswa.2020.113285 Rapaport, 2019, EEGNAS: neural architecture search for electroencephalography data analysis and decoding, 3, 10.1007/978-981-15-1398-5_1 Pfurtscheller, 2006, Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks, NeuroImage, 31, 153, 10.1016/j.neuroimage.2005.12.003 Dose, 2018, An end-to-end deep learning approach to MI-EEG signal classification for BCIs, Expert Syst. Appl., 114, 532, 10.1016/j.eswa.2018.08.031 Jiang, 2019, Multiscale convolutional neural networks for fault diagnosis of wind turbine gearbox, IEEE Trans. Ind. Electron., 66, 3196, 10.1109/TIE.2018.2844805 Wu, 2019, A parallel multiscale filter bank convolutional neural networks for motor imagery EEG classification, Front. Neurosci., 13, 10.3389/fnins.2019.01275 Datta, 2019, Training multiscale-CNN for large microscopy image classification in one hour, 463 Srivastava, 2014, Dropout: a simple way to prevent neural networks from overfitting, J. Mach. Learn. Res., 15, 1929 Glorot, 2010, Understanding the difficulty of training deep feedforward neural networks, 249 Clevert, 2016, Fast and accurate deep network learning by exponential linear units (ELUs) Kingma, 2015, Adam: a method for stochastic optimization Tangermann, 2012, Review of the BCI competition IV, Front. Neurosci., 6, 55, 10.3389/fnins.2012.00055 Wilcoxon, 1945, Individual comparisons by ranking methods, Biometr. Bull., 1, 80, 10.2307/3001968 Bashashati, 2016, User-customized brain computer interfaces using Bayesian optimization, J. Neural Eng., 13, 026001, 10.1088/1741-2560/13/2/026001 Nguyen, 2018, EEG feature descriptors and discriminant analysis under Riemannian manifold perspective, Neurocomputing, 275, 1871, 10.1016/j.neucom.2017.10.013 Zheng, 2018, Multiclass support matrix machine for single trial EEG classification, Neurocomputing, 275, 869, 10.1016/j.neucom.2017.09.030 Luo, 2019, Class discrepancy-guided sub-band filter-based common spatial pattern for motor imagery classification, J. Neurosci. Methods, 323, 98, 10.1016/j.jneumeth.2019.05.011 López, 2019, An efficient multi-class MI based BCI scheme using statistical fusion techniques of classifiers, TENCON 2019–2019 IEEE Region 10 Conference (TENCON), 378, 10.1109/TENCON.2019.8929345 dos Santos, 2020, Improved motor imagery brain–computer interface performance via adaptive modulation filtering and two-stage classification, Biomed. Signal Process. Control, 57, 101812, 10.1016/j.bspc.2019.101812 Sakhavi, 2015, Parallel convolutional-linear neural network for motor imagery classification, 2015 23rd European Signal Processing Conference (EUSIPCO), 2736, 10.1109/EUSIPCO.2015.7362882 Zhao, 2019, Learning joint space–time-frequency features for EEG decoding on small labeled data, Neural Netw., 114, 67, 10.1016/j.neunet.2019.02.009 Batula, 2017, Comparison of brain activation during motor imagery and motor movement using fNIRS, Comput. Intell. Neurosci., 2017, 1, 10.1155/2017/5491296 K.G. Hartmann, R.T. Schirrmeister, T. Ball, EEG-GAN: Generative Adversarial Networks for Electroencephalograhic (EEG) Brain Signals, arXiv:1806.01875 [cs, eess, q-bio, stat].