An EEG/EOG-based hybrid brain-neural computer interaction (BNCI) system to control an exoskeleton for the paralyzed hand
Tóm tắt
The loss of hand function can result in severe physical and psychosocial impairment. Thus, compensation of a lost hand function using assistive robotics that can be operated in daily life is very desirable. However, versatile, intuitive, and reliable control of assistive robotics is still an unsolved challenge. Here, we introduce a novel brain/neural-computer interaction (BNCI) system that integrates electroencephalography (EEG) and electrooculography (EOG) to improve control of assistive robotics in daily life environments. To evaluate the applicability and performance of this hybrid approach, five healthy volunteers (HV) (four men, average age 26.5±3.8 years) and a 34-year-old patient with complete finger paralysis due to a brachial plexus injury (BPI) used EEG (condition 1) and EEG/EOG (condition 2) to control grasping motions of a hand exoskeleton. All participants were able to control the BNCI system (BNCI control performance HV: 70.24±16.71%, BPI: 65.93±24.27%), but inclusion of EOG significantly improved performance across all participants (HV: 80.65±11.28, BPI: 76.03±18.32%). This suggests that hybrid BNCI systems can achieve substantially better control over assistive devices, e.g., a hand exoskeleton, than systems using brain signals alone and thus may increase applicability of brain-controlled assistive devices in daily life environments.
Từ khóa
Tài liệu tham khảo
Soekadar, Clinical brain machine interfaces In editors Plasticity of cognition in neurologic disorders New York University Part Chapter pp ISBN, 15, 2015
Collinger, 2013, Functional priorities assistive technology computer interfaces after spinal cord injury, brain J Rehabil Res Dev, 145, 10.1682/JRRD.2011.11.0213
Ganguly, 2009, Cortical representation of ipsilateral arm movements in monkey and man, J Neurosci, 29, 12948, 10.1523/JNEUROSCI.2471-09.2009
Collinger, 2013, High - performance neuroprosthetic control by an individual with tetraplegia, Lancet, 381
Pons, 2004, The dextrous robotics upper limb prosthesis mechanical and manipulation aspects, HAND Auton Robot, 16, 143, 10.1023/B:AURO.0000016862.38337.f1
BNCI, Future a roadmap for future directions in brain / neuronal computer interaction research Future BNCI Program under the European Union Seventh Framework Programme grant http www brainable org Documents Future BNCI Roadmap pdf, 2007
Hargrove, 2013, Robotic leg control with EMG decoding in an amputee with nerve transfers, AM Young Engl J Med, 369
Millán, 2010, Combining brain computer interfaces and assistive technologies state of the art and challenges Front, Neurosci, 161
London, 1943, Medical Research Council to the investigation of peripheral nerve injuries nd ed Her Majesty s Stationery Office, Aids
Cempini, 2014, powered finger - thumb wearable hand exoskeleton with self - aligning joint axes, IEEE Trans, 99
Kiguchi, 2012, An EMG based control for an upper - limb power - assist exoskeleton robot, IEEE Trans Syst Man, 1064, 10.1109/TSMCB.2012.2185843
Müller, 2006, computer interfaces for control of neuroprostheses : from synchronous to asynchronous mode of operation computer interfaces zur steuerung von neuroprothesen : von der synchronen zur asynchronen funktionsweise, Brain Brain Biomed Tech, 51
Cempini, 2013, Kinematics and design of a portable and wearable exoskeleton for hand rehabilitation Rehab Robot, Proc IEEE Int Conf, 6650414
Collinger, 2013, High - performance neuroprosthetic control by an individual with tetraplegia, Lancet, 381
Cempini, 2014, powered finger - thumb wearable hand exoskeleton with self - aligning joint axes, IEEE Trans, 99
Müller, 2014, Motor imagery - induced EEG patterns in individuals with spinal cord injury and their impact on brain - computer interface accuracy, J Neural Eng, 11
Potvin, 1997, Effects of muscle kinematics on surface EMG amplitude and frequency during fatiguing dynamic contractions, J Appl Physiol, 144, 10.1152/jappl.1997.82.1.144
Buch, 2008, Think to move a neuromagnetic brain computer interface system for chronic stroke, Stroke, 39
Kiguchi, 2012, An EMG based control for an upper - limb power - assist exoskeleton robot, IEEE Trans Syst Man, 1064, 10.1109/TSMCB.2012.2185843
Soekadar, Clinical brain machine interfaces In editors Plasticity of cognition in neurologic disorders New York University Part Chapter pp ISBN, 15, 2015
Müller, 2005, - based neuroprosthesis control a step towards clinical practice, Neurosci Lett, 382
Vitiello, 2013, powered elbow exoskeleton of physical Robot, rehabilitation IEEE Trans, 29, 220
Micera, 2010, Control of hand prostheses using peripheral information, IEEE Rev Biomed Eng, 3
Ribeiro, 2013, Controlling assistive machines in paralysis using brain waves and other biosignals, Adv Hum Comput Interact, 369425
Millan, 2009, Del Asynchronous non - invasive brain - activated control of an intelligent wheelchair, Conf Proc IEEE Eng Med Biol Soc, 3361
Soekadar, machine interfaces in neurorehabilitation of stroke in press, Brain Neurobiol Dis, 2015
Rohm, 2013, Schneiders Müller Hybrid brain - computer interfaces and hybrid neuroprostheses for restoration of upper limb functions in individuals with high - level spinal cord injury, Artif Intell Med, 59
Potvin, 1997, Effects of muscle kinematics on surface EMG amplitude and frequency during fatiguing dynamic contractions, J Appl Physiol, 144, 10.1152/jappl.1997.82.1.144
Matsumoto, 2012, of EMG signals of patients with essential tremor focusing on the change of tremor frequency, Analysis Conf Proc IEEE Eng Med Biol Soc, 2244
Ganguly, 2009, Cortical representation of ipsilateral arm movements in monkey and man, J Neurosci, 29, 12948, 10.1523/JNEUROSCI.2471-09.2009
Vitiello, 2013, powered elbow exoskeleton of physical Robot, rehabilitation IEEE Trans, 29, 220
Rupp, 2013, Schneiders Think grasp controlled neuroprosthesis for the upper extremity in press, Biomed Tech, 10.1515/bmt-2013-4440
Pfurtscheller, 1979, Evaluation of event - related desynchronization preceding and following self - paced movement Electroencephalogr, Clin Neurophysiol, 138, 10.1016/0013-4694(79)90063-4
Cempini, 2013, Kinematics and design of a portable and wearable exoskeleton for hand rehabilitation Rehab Robot, Proc IEEE Int Conf, 6650414
Pons, 2004, The dextrous robotics upper limb prosthesis mechanical and manipulation aspects, HAND Auton Robot, 16, 143, 10.1023/B:AURO.0000016862.38337.f1
Müller, 2013, The hybrid brain - computer interface a bridge to assistive technology, Biomed Tech, 10.1515/bmt-2013-4435
Müller, 2013, The hybrid brain - computer interface a bridge to assistive technology, Biomed Tech, 10.1515/bmt-2013-4435
Buch, 2008, Think to move a neuromagnetic brain computer interface system for chronic stroke, Stroke, 39
Oldfield, 1971, The assessment and analysis of handedness the Edinburgh inventory, Neuropsychologia, 97, 10.1016/0028-3932(71)90067-4
Pfurtscheller, 2003, - control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia, Thought Neurosci Lett, 351
Micera, 2010, Control of hand prostheses using peripheral information, IEEE Rev Biomed Eng, 3
Pfurtscheller, 2000, oscillations control hand orthosis in a tetraplegic, Brain Neurosci Lett, 292
Soekadar, 2011, based online brain - machine interfaces BMI in the context of optimizing BMI learning and performance, neurorehabilitation IEEE, 19, 542
Müller, 2006, computer interfaces for control of neuroprostheses : from synchronous to asynchronous mode of operation computer interfaces zur steuerung von neuroprothesen : von der synchronen zur asynchronen funktionsweise, Brain Brain Biomed Tech, 51
Ribeiro, 2013, Controlling assistive machines in paralysis using brain waves and other biosignals, Adv Hum Comput Interact, 369425
Liyanage, 2013, Dynamically weighted ensemble classification for non - stationary EEG processing, J Neural Eng
Oldfield, 1971, The assessment and analysis of handedness the Edinburgh inventory, Neuropsychologia, 97, 10.1016/0028-3932(71)90067-4
Liyanage, 2013, Dynamically weighted ensemble classification for non - stationary EEG processing, J Neural Eng
London, 1943, Medical Research Council to the investigation of peripheral nerve injuries nd ed Her Majesty s Stationery Office, Aids
Pfurtscheller, 1979, Evaluation of event - related desynchronization preceding and following self - paced movement Electroencephalogr, Clin Neurophysiol, 138, 10.1016/0013-4694(79)90063-4
Soekadar, machine interfaces in neurorehabilitation of stroke in press, Brain Neurobiol Dis, 2015
Matsumoto, 2012, of EMG signals of patients with essential tremor focusing on the change of tremor frequency, Analysis Conf Proc IEEE Eng Med Biol Soc, 2244
Millan, 2009, Del Asynchronous non - invasive brain - activated control of an intelligent wheelchair, Conf Proc IEEE Eng Med Biol Soc, 3361
Collinger, 2013, Functional priorities assistive technology computer interfaces after spinal cord injury, brain J Rehabil Res Dev, 145, 10.1682/JRRD.2011.11.0213
Pfurtscheller, 2003, - control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia, Thought Neurosci Lett, 351
Pfurtscheller, 2000, oscillations control hand orthosis in a tetraplegic, Brain Neurosci Lett, 292
BNCI, Future a roadmap for future directions in brain / neuronal computer interaction research Future BNCI Program under the European Union Seventh Framework Programme grant http www brainable org Documents Future BNCI Roadmap pdf, 2007
Müller, 2005, - based neuroprosthesis control a step towards clinical practice, Neurosci Lett, 382
Rupp, 2013, Schneiders Think grasp controlled neuroprosthesis for the upper extremity in press, Biomed Tech, 10.1515/bmt-2013-4440
Soekadar, 2011, based online brain - machine interfaces BMI in the context of optimizing BMI learning and performance, neurorehabilitation IEEE, 19, 542
Müller, 2014, Motor imagery - induced EEG patterns in individuals with spinal cord injury and their impact on brain - computer interface accuracy, J Neural Eng, 11
Hargrove, 2013, Robotic leg control with EMG decoding in an amputee with nerve transfers, AM Young Engl J Med, 369
Rohm, 2013, Schneiders Müller Hybrid brain - computer interfaces and hybrid neuroprostheses for restoration of upper limb functions in individuals with high - level spinal cord injury, Artif Intell Med, 59
Millán, 2010, Combining brain computer interfaces and assistive technologies state of the art and challenges Front, Neurosci, 161