Effect of task-related continuous auditory feedback during learning of tracking motion exercises
Tóm tắt
This paper presents the results of a set of experiments in which we used continuous auditory feedback to augment motor training exercises. This feedback modality is mostly underexploited in current robotic rehabilitation systems, which usually implement only very basic auditory interfaces. Our hypothesis is that properly designed continuous auditory feedback could be used to represent temporal and spatial information that could in turn, improve performance and motor learning. We implemented three different experiments on healthy subjects, who were asked to track a target on a screen by moving an input device (controller) with their hand. Different visual and auditory feedback modalities were envisaged. The first experiment investigated whether continuous task-related auditory feedback can help improve performance to a greater extent than error-related audio feedback, or visual feedback alone. In the second experiment we used sensory substitution to compare different types of auditory feedback with equivalent visual feedback, in order to find out whether mapping the same information on a different sensory channel (the visual channel) yielded comparable effects with those gained in the first experiment. The final experiment applied a continuously changing visuomotor transformation between the controller and the screen and mapped kinematic information, computed in either coordinate system (controller or video), to the audio channel, in order to investigate which information was more relevant to the user. Task-related audio feedback significantly improved performance with respect to visual feedback alone, whilst error-related feedback did not. Secondly, performance in audio tasks was significantly better with respect to the equivalent sensory-substituted visual tasks. Finally, with respect to visual feedback alone, video-task-related sound feedback decreased the tracking error during the learning of a novel visuomotor perturbation, whereas controller-task-related sound feedback did not. This result was particularly interesting, as the subjects relied more on auditory augmentation of the visualized target motion (which was altered with respect to arm motion by the visuomotor perturbation), rather than on sound feedback provided in the controller space, i.e., information directly related to the effective target motion of their arm. Our results indicate that auditory augmentation of visual feedback can be beneficial during the execution of upper limb movement exercises. In particular, we found that continuous task-related information provided through sound, in addition to visual feedback can improve not only performance but also the learning of a novel visuomotor perturbation. However, error-related information provided through sound did not improve performance and negatively affected learning in the presence of the visuomotor perturbation.
Tài liệu tham khảo
Kwakkel G, Wagenaar RC, Twisk JW, Lankhorst GJ, Koetsier JC: Intensity of leg and arm training after primary middle-cerebral-artery stroke: a randomised trial. Lancet 1999, 354: 191-196. 10.1016/S0140-6736(98)09477-X
Reinkensmeyer DJ, Emken JL, Cramer SC: Post-stroke upper extremity rehabilitation: a review of robotic systems and clinical results. Annu Rev Biomed Eng 2004, 6: 497-525. 10.1146/annurev.bioeng.6.040803.140223
Riener R, Nef T, Colombo G: Robot-aided neurorehabilitation of the upper extremities. Med Biol Eng Comput 2005, 43: 2-10. 10.1007/BF02345116
Hesse S, Schmidt H, Werner C: Machines to support motor rehabilitation after stroke: 10 years of experience in Berlin. J Rehabil Res Dev 2006, 43: 671-678. 10.1682/JRRD.2005.02.0052
Krebs H: Robot-mediated Movement Therapy: a Tool for Training and Evaluation. In Proceedings of the European Symposium on Technical Aids for Rehabilitation 2007 Technical University of Berlin
Timmermans AA, Seelen HA, Willmann RD, Kingma H: Technology-assisted training of arm-hand skills in stroke: concepts on reacquisition of motor control and therapist guidelines for rehabilitation technology design. J NeuroEng Rehabil 2009, 6: 1. 10.1186/1743-0003-6-1
Marchal-Crespo L, Reinkensmeyer DJ: Review of control strategies for robotic movement training after neurologic injury. J NeuroEng Rehabil 2008, 6: 20.
Masiero S, Celia A, Armani M, Rosati G, Tavolato B, Ferraro C: Robot-aided intensive training in post-stroke recovery. Aging Clin Exp Res 2006,18(3):261-265.
Kwakkel G, Kollen BJ, Krebs HI: Effects of Robot-Assisted Therapy on Upper Limb Recovery After Stroke: a Systematic Review. Neurorehab Neural Repair 2008,22(2):111-121.
Mehrholz J, T TP, Kugler J, Pohl M: Electromechanical and robot-assisted arm training for improving arm function and activities of daily living after stroke. Cochrane Database Syst Rev 2008, 4: CD006876.
Prange G, Jannink M, Groothuis-Oudshoorn C, Hermens H, IJzerman M: Systematic review of the effect of robot-aided therapy on recovery of the hemiparetic arm after stroke. J Rehabil Res Dev 2006,43(2):171-183. 10.1682/JRRD.2005.04.0076
Masiero S, Armani M, Rosati G: Upper-limb robot-assisted therapy in rehabilitation of acute stroke patients: focused review and results of new randomized controlled trial. J Rehabil Res Dev 2011,48(4):355-366. 10.1682/JRRD.2010.04.0063
Rosati G: The place of robotics in post-stroke rehabilitation. Expert Rev Med Devices 2010,7(6):753-758. 10.1586/erd.10.49
Reinkensmeyer DJ, Galvez JA, Marchal L, Wolbrecht ET, Bobrow JE: Some Key Problems for Robot-Assisted Movement Therapy Research: A perspective from the University of California at Irvine. In Proceedings of IEEE 10th International Conference on Rehabilitation Robotics 2007. Noordwijk, the Netherlands; 2007:1009-1015.
Nudo RJ, Wise BM, SiFuentes F, Milliken GW: Neural substrates for the effects of rehabilitative training on motor recovery after ischemic infarct. Science 1996, 272: 1791-1794. 10.1126/science.272.5269.1791
Liepert J, Bauder H, Wolfgang HR, Miltner WH, Taub E, Weiller C: Treatment-induced cortical reorganization after stroke in humans. Stroke 2000, 31: 1210-6. 10.1161/01.STR.31.6.1210
Thoroughman KA, Shadmehr R: Learning of action through adaptive combination of motor primitives. Stroke 2000, 407: 742-7.
Emken J, Reinkensmeyer DJ: Robot-enhanced motor learning: Accelerating internal model formation during locomotion by transient dynamic amplification. IEEE Trans Neural Syst Rehabil Eng 2005, 99: 1-7.
Schmidt RA, Lee TD: Motor control and Learning: A behavioral Emphasis. Champaign, IL. USA: Human Kinetics Publishers; 2005.
Emken JL, Benitez R, Sideris A, Bobrow JE, Reinkensmeyer DJ: Motor adaptation as a greedy optimization of error and effort. J Neurophys 2007, 97: 3997-4006. 10.1152/jn.01095.2006
Scheidt RA, Conditt MA, Secco EL, Mussa-Ivaldi FA: Interaction of visual and proprioceptive feedback during adaptation of human reaching movements. J neurophys 2005,93(6):3200-13. 10.1152/jn.00947.2004
Sober SJ, Sabes PN: Multisensory integration during motor planning. J neurosci: off j Soc for Neurosci 2003,23(18):6982-92.
Flash T, Hogan N: The coordination of arm movements: an experimentally confirmed mathematical model. J neurosci: official j Soc Neurosci 1985,5(7):1688-703.
Morris D, Tan H, Barbagli F, Chang T, Salisbury K: Haptic Feedback Enhances Force Skill Learning. In Proceedings of the Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 2007. Tsukuba, Japan; 2007:21-26.
Johnson M, der Loos HV, Burgar C, Shor P, Leifer L: Design and evaluation of driver’s seat: a car steering simulation environment for upper limb stroke therapy. Robotica 2003, 21: 13-23.
Boian RF, Deutsch JE, Lee CS, Burdea GC, Lewis J: Haptic Effects for Virtual Reality-Based Post-Stroke Rehabilitation. Haptics 2003, 00: 247.
Nef T, Mihelj M, Kiefer G, Perndl C, Muller R, Riener R: ARMin - Exoskeleton for Arm Therapy in Stroke Patients. In Proceedings of IEEE 10th International Conference on Rehabilitation Robotics 2007. Noordwijk, the Netherlands; 2007:68-74.
Masiero S, Celia A, Rosati G, Armani M: Robotic-Assisted Rehabilitation of the Upper Limb After Acute Stroke. Arch Phys Med Rehabil 2007,88(2):142-149. 10.1016/j.apmr.2006.10.032
Colombo R, Pisano F, Micera S, Mazzone A, Delconte C, Carrozza MC, Dario P, Minuco G: Robotic Techniques for Upper Limb Evaluation and Rehabilitation of Stroke Patients. TNSRE 2005,13(3):311-324.
Molier BI, Prange GB, Buurke JH: The role of visual feedback in conventional therapy and future research. In Proceedings of the IEEE 12th International Conference on Virtual Rehabilitation 2011. Zurich, CH;
Maulucci R, Eckhouse R: Retraining reaching in chronic stroke with real-time auditory feedback. NeuroRehabil 2001, 16: 171-182.
Robertson JVG, Hoellinger T, Lindberg P, Bensmail D, Hanneton S, Roby-Brami A: Effect of auditory feedback differs according to side of hemiparesis: a comparative pilot study. J NeuroEng Rehabil 2009, 6: 45. 10.1186/1743-0003-6-45
Taylor JA, Thoroughman KA: Divided Attention Impairs Human Motor Adaptation But Not Feedback Control. J Neurophys 2007,98(1):317-326. 10.1152/jn.01070.2006
Rath M, Rocchesso D: Continuous sonic feedback from a rolling ball. Multimedia, IEEE 2005,12(2):60-69. 10.1109/MMUL.2005.24
Secoli R, Milot MH, Rosati G, Reinkensmeyer DJ: Effect of visual distraction and auditory feedback on patient effort during robot-assisted movement training after stroke. J NeuroEng Rehabil 2011, 8: 21. 10.1186/1743-0003-8-21
Seizova-Cajic T, Azzi R: A visual distracter task during adaptation reduces the proprioceptive movement aftereffect. Exp Brain Res 2010, 203: 213-219. 10.1007/s00221-010-2204-8
Massimino M: Improved force perception through sensory substitution. Control Eng Pract 1995,3(2):215-222. 10.1016/0967-0661(94)00079-V
Cenci S, Rosati G, Zanotto D, Oscari F, Rossi A: First test results of a haptic tele-operation system to enhance stability of telescopic handlers. In Proceedings of the ASME 10th Biennial Conference on Engineering Systems Design and Analysis 2010. Istanbul, Turkey;
Ronsse R, Miall RC, Swinnen SP: Multisensory integration in dynamical behaviors: maximum likelihood estimation across bimanual skill learning. J Neuroscience 2009,29(26):8419-28. 10.1523/JNEUROSCI.5734-08.2009
Bedford FL: Can a space-perception conflict be solved with three sense modalities? Perception 2007, 36: 508-515. 10.1068/p5632
Hemond C, Brown RM, Robertson EM: A Distraction Can Impair or Enhance Motor Performance. J Neurosci 2010,30(2):650-654. 10.1523/JNEUROSCI.4592-09.2010
Molier BI, Van Asseldonk EHF, Hermens HJ, Jannink MJA: Nature, timing, frequency and type of augmented feedback; does it influence motor relearning of the hemiparetic arm after stroke? A systematic review. Disabil Rehabil 2010,32(22):1799-809. 10.3109/09638281003734359