A Hybrid BCI Based on SSVEP and EOG for Robotic Arm Control
Tóm tắt
Brain-computer interface (BCI) for robotic arm control has been studied to improve the life quality of people with severe motor disabilities. There are still challenges for robotic arm control in accomplishing a complex task with a series of actions. An efficient switch and a timely cancel command are helpful in the application of robotic arm. Based on the above, we proposed an asynchronous hybrid BCI in this study. The basic control of a robotic arm with six degrees of freedom was a steady-state visual evoked potential (SSVEP) based BCI with fifteen target classes. We designed an EOG-based switch which used a triple blink to either activate or deactivate the flash of SSVEP-based BCI. Stopping flash in the idle state can help to reduce visual fatigue and false activation rate (FAR). Additionally, users were allowed to cancel the current command simply by a wink in the feedback phase to avoid executing the incorrect command. Fifteen subjects participated and completed the experiments. The cue-based experiment obtained an average accuracy of 92.09%, and the information transfer rates (ITR) resulted in 35.98 bits/min. The mean FAR of the switch was 0.01/min. Furthermore, all subjects succeeded in asynchronously operating the robotic arm to grasp, lift, and move a target object from the initial position to a specific location. The results indicated the feasibility of the combination of EOG and SSVEP signals and the flexibility of EOG signal in BCI to complete a complicated task of robotic arm control.
Từ khóa
Tài liệu tham khảo
Allison, 2010, BCI demographics: how many (and what kinds of) people can use an SSVEP BCI?, IEEE Trans. Neural Syst. Rehabil. Eng., 18, 107, 10.1109/TNSRE.2009.2039495
Bin, 2009, An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method, J. Neural Eng., 6, 46002, 10.1088/1741-2560/6/4/046002
Chen, 2014, A high-ITR SSVEP-based BCI speller, Brain-Computer Interfaces, 1, 181, 10.1080/2326263X.2014.944469
Chen, , Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain–computer interface, J. Neural Eng., 12, 46008, 10.1088/1741-2560/12/4/046008
Chen, , High-speed spelling with a noninvasive brain–computer interface, Proc. Natl. Acad. Sci., 112, E6058, 10.1073/pnas.1508080112
Chen, 2017, A novel stimulation method for multi-class SSVEP-BCI using intermodulation frequencies, J. Neural Eng., 14, 26013, 10.1088/1741-2552/aa5989
Chen, 2019, Combination of high-frequency SSVEP-based BCI and computer vision for controlling a robotic arm, J. Neural Eng., 16, 26012, 10.1088/1741-2552/aaf594
Chen, 2018, Control of a 7-DOF Robotic Arm System With an SSVEP-Based BCI, Int. J. Neural Syst., 28, 1850018, 10.1142/S0129065718500181
Cheng, 2002, Design and implementation of a brain-computer interface with high transfer rates, IEEE Trans. Biomed. Eng., 49, 1181, 10.1109/TBME.2002.803536
Diez, 2011, Asynchronous BCI control using high-frequency SSVEP, J. Neuroeng. Rehabil., 8, 39, 10.1186/1743-0003-8-39
Farwell, 1988, Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials, Electroencephalogr. Clin. Neurophysiol., 70, 510, 10.1016/0013-4694(88)90149-6
Floriano, 2018, Evaluating the influence of chromatic and luminance stimuli on SSVEPs from behind-the-ears and occipital areas, Sensors, 18, 615, 10.3390/s18020615
Gao, 2017, Noninvasive electroencephalogram based control of a robotic arm for writing task using hybrid BCI system, Biomed Res. Int., 2017, 1, 10.1155/2017/8316485
He, 2017, A hybrid BCI web browser based on EEG and EOG signals,, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 1006, 10.1109/EMBC.2017.8036996
Herrmann, 2001, Human EEG responses to 1-100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena, Exp. brain Res., 137, 346, 10.1007/s002210100682
Huang, 2019, An EEG-/EOG-based hybrid brain-computer interface: application on controlling an integrated wheelchair robotic arm system, Front. Neurosci., 13, 1243, 10.3389/fnins.2019.01243
Khan, 2017, Hybrid EEG-fNIRS-based eight-command decoding for BCI: application to quadcopter control, Front. Neurorobot., 11, 6, 10.3389/fnbot.2017.00006
Li, 2018, A EOG-based switch and its application for “start/stop” control of a wheelchair, Neurocomputing, 275, 1350, 10.1016/j.neucom.2017.09.085
Ma, 2015, A novel EOG/EEG hybrid human–machine interface adopting eye movements and ERPs: application to robot control, IEEE Trans. Biomed. Eng., 62, 876, 10.1109/TBME.2014.2369483
Manyakov, 2013, Sampled sinusoidal stimulation profile and multichannel fuzzy logic classification for monitor-based phase-coded SSVEP brain–computer interfacing, J. Neural Eng., 10, 36011, 10.1088/1741-2560/10/3/036011
Nakanishi, 2013, Wheelchair control system by using electrooculogram signal processing,, The 19th Korea-Japan Joint Workshop on Frontiers of Computer Vision, 137, 10.1109/FCV.2013.6485476
Ortner, 2011, An SSVEP BCI to control a_ hand orthosis for persons with tetraplegia, IEEE Trans. Neural Syst. Rehabil. Eng., 19, 1, 10.1109/TNSRE.2010.2076364
Pan, 2013, Discrimination between control and idle states in asynchronous SSVEP-based brain switches: a pseudo-key-based approach, IEEE Trans. Neural Syst. Rehabil. Eng., 21, 435, 10.1109/TNSRE.2013.2253801
Pfurtscheller, , Self-paced Operation of an SSVEP-based orthosis with and without an imagery-based “brain switch:” a feasibility study towards a hybrid BCI, 18, 409, 10.1109/TNSRE.2010.2040837
Takano, 2009, Visual stimuli for the P300 brain-computer interface: a comparison of white/gray and green/blue flicker matrices, Clin. Neurophysiol., 120, 1562, 10.1016/j.clinph.2009.06.002
Tan, 2019, Autoencoder-based transfer learning in brain–computer interface for rehabilitation robot, Int. J. Adv. Robot. Syst., 16, 1, 10.1177/1729881419840860
Tayeb, 2018, Gumpy: a Python toolbox suitable for hybrid brain–computer interfaces, J. Neural Eng., 15, 65003, 10.1088/1741-2552/aae186
Tomita, 2014, Bimodal BCI using simultaneously NIRS and EEG, IEEE Trans. Biomed. Eng., 61, 1274, 10.1109/TBME.2014.2300492
Wang, 2014, An asynchronous wheelchair control by hybrid EEG–EOG brain–computer interface, Cogn. Neurodyn., 8, 399, 10.1007/s11571-014-9296-y
Wolpaw, 2000, Brain-computer interface technology: a review of the first international meeting, IEEE Trans. Rehabil. Eng., 8, 164, 10.1109/TRE.2000.847807
Wolpaw, 2002, Brain–computer interfaces for communication and control, Clin. Neurophysiol., 113, 767, 10.1016/S1388-2457(02)00057-3
Wolpaw, 1991, An EEG-based brain-computer interface for cursor control, Electroencephalogr. Clin. Neurophysiol., 78, 252, 10.1016/0013-4694(91)90040-B