Processing of changes in visual speech in the human auditory cortex

Cognitive Brain Research - Tập 13 - Trang 417-425 - 2002
Riikka Möttönen1, Christina M. Krause1, Kaisa Tiippana1, Mikko Sams1
1Laboratory of Computational Engineering, Helsinki University of Technology, Espoo, Finland

Tài liệu tham khảo

Alho, 1995, Cerebral generators of mismatch negativity (MMN) and its magnetic counterpart (MMNm) elicited by sound changes, Ear Hear., 16, 38, 10.1097/00003446-199502000-00004 Alho, 1998, Processing of novel sounds and frequency changes in the human auditory cortex: magnetoencephalographic recordings, Psychophysiology, 35, 211, 10.1111/1469-8986.3520211 Binder, 2000, Human temporal lobe activation by speech and nonspeech sounds, Cereb. Cortex, 10, 512, 10.1093/cercor/10.5.512 Callan, 2001, Multimodal contribution to speech perception revealed by independent component analysis: a single-sweep EEG case study, Cogn. Brain Res., 10, 349, 10.1016/S0926-6410(00)00054-9 Calvert, 1999, Response amplification in sensory-specific cortices during crossmodal binding, Neuroreport, 10, 2619, 10.1097/00001756-199908200-00033 Calvert, 1997, Activation of auditory cortex during silent lipreading, Science, 276, 593, 10.1126/science.276.5312.593 Calvert, 2000, Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex, Curr. Biol., 10, 649, 10.1016/S0960-9822(00)00513-3 Calvert, 2001, Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the bold effect, Neuroimage, 14, 427, 10.1006/nimg.2001.0812 Campbell, 1980, Hearing by eye, Q. J. Exp. Psychol., 32, 85, 10.1080/00335558008248235 de Gelder, 1999, The combined perception of emotion from voice and face: early interaction revealed by human electric brain responses, Neurosci. Lett., 260, 133, 10.1016/S0304-3940(98)00963-X de Gelder, 2000, The perception of emotions by ear and by eye, Cogn. Emotion, 14, 289, 10.1080/026999300378824 Giard, 1999, Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study, J. Cogn. Neurosci., 11, 473, 10.1162/089892999563544 Green, 1998, The use of auditory and visual information during phonetic processing: implications for theories of speech perception Hari, 1990, The neuromagnetic method in the study of the human auditory cortex, Vol. 6, 222 Hari, 1984, Responses of the primary auditory cortex to pitch changes of tone pips: neuromagnetic recordings in man, Neurosci. Lett., 50, 127, 10.1016/0304-3940(84)90474-9 Hershenson, 1962, Reaction time as a measure of intersensory facilitation, J. Exp. Psychol., 63, 289, 10.1037/h0039516 Hämäläinen, 1993, Magnetoencephalography—theory, instrumentation, and applications to noninvasive studies of the working human brain, Rev. Mod. Phys., 65, 413, 10.1103/RevModPhys.65.413 Hämäläinen, 1994, Interpreting magnetic fields of the brain: Minimum norm estimates, Med. Biol. Eng. Comp., 32, 35, 10.1007/BF02512476 Jones, 1997, The effects of separating auditory and visual sources on audiovisual integration of speech, Can. Acoust., 25, 13 Kerzel, 2000, Motor activation from visible speech: evidence from stimulus response compatibility, J. Exp. Psychol. Hum. Percept. Perform., 26, 634, 10.1037/0096-1523.26.2.634 McGuire, 1996, Functional neuroanatomy of verbal self-monitoring, Brain, 119, 907, 10.1093/brain/119.3.907 McGurk, 1976, Hearing lips and seeing voices, Nature, 264, 746, 10.1038/264746a0 Näätänen, 2001, The perception of speech sounds by the human brain as reflected by the mismatch negativity (MMN) and its magnetic equivalent (MMNm), Psychophysiology, 38, 1, 10.1111/1469-8986.3810001 Näätänen, 1997, Language-specific phoneme representations revealed by electric and magnetic brain responses, Nature, 385, 432, 10.1038/385432a0 Neurobehavioral Systems, Inc., Presentation, http://www.neurobehavioralsystems.com, 2001. Numminen, 1995, Transformation of multichannel magnetocardiographic signals to standard grid form, IEEE Trans. Biomed. Eng., 40, 72, 10.1109/10.362916 Numminen, 1999, Differential effects of overt, covert and replayed speech on vowel-evoked responses of the human auditory cortex, Neurosci. Lett., 272, 29, 10.1016/S0304-3940(99)00573-X Nyman, 1990, Mismatch negativity (MMN) for sequences of auditory and visual stimuli: evidence for a mechanism specific to the auditory modality, Electroencephalogr. Clin. Neurophysiol., 77, 436, 10.1016/0168-5597(90)90004-W R. Näätänen, Attention and Brain Function, Lawrence Erlbaum Associates, Hillsdale, NJ, 1992, p. 494. Näätänen, 2001, The perception of speech sounds by the human brain as reflected by the mismatch negativity (MMN) and its magnetic equivalent (MMNm), Psychophysiology, 38, 1, 10.1111/1469-8986.3810001 Paus, 1996, Modulation of cerebral blood flow in the human auditory cortex during speech: role of motor-to-sensory discharges, Eur. J. Neurosci., 8, 2236, 10.1111/j.1460-9568.1996.tb01187.x Phillips, 2000, Auditory cortex accesses phonological categories: an MEG mismatch study, J. Cogn. Neurosci., 12, 1038, 10.1162/08989290051137567 Pourtois, 2000, The time-course of intermodal binding between seeing and hearing affective information, Neuroreport, 11, 1329, 10.1097/00001756-200004270-00036 Raij, 2000, Audiovisual integration of letters in the human brain, Neuron, 28, 617, 10.1016/S0896-6273(00)00138-0 Rizzolatti, 1996, Premotor cortex and the recognition of motor actions, Cogn. Brain Res., 3, 131, 10.1016/0926-6410(95)00038-0 Rosenblum, 1996, Point-light facial displays enhance comprehension of speech in noise, J. Speech Hear. Res., 39, 1159, 10.1044/jshr.3906.1159 Rosenblum, 1996, An Audio-visual test of kinematic primitives for visual speech perception, J. Exp. Psychol. Hum. Percept. Perform., 22, 318, 10.1037/0096-1523.22.2.318 Rosenblum, 1998, Time-varying information for visual speech perception Sams, 1985, Cerebral neuromagnetic responses evoked by short auditory stimuli, Electroencephalogr. Clin. Neurophysiol., 61, 254, 10.1016/0013-4694(85)91092-2 Sams, 1991, Seeing speech: visual information from lip movements modifies activity in the human auditory cortex, Neurosci. Lett., 127, 141, 10.1016/0304-3940(91)90914-F M. Sams, R. Möttönen, T. Sihvonen, Speech production modifies speech perception. A new illusion (submitted). Schröger, 1998, Speeded responses to audiovisual signal changes result from bimodal integration, Psychophysiology, 35, 755, 10.1111/1469-8986.3560755 Schwartz, 1998, Ten years after summerfield: a taxonomy of models for audiovisual fusion in speech perception Sharma, 1998, Exploration of the perceptual magnet effect using the mismatch negativity auditory evoked potential, J. Acoust. Soc. Am., 104, 511, 10.1121/1.423252 Stein, 1998, Neural mechanisms for synthesizing sensory information and producing adaptive behaviors, Exp. Brain Res., 123, 124, 10.1007/s002210050553 Sumby, 1954, Visual contribution to speech intelligibility in noise, J. Acoust. Soc. Am., 26, 212, 10.1121/1.1907309 Tales, 1999, Mismatch negativity in the visual modality, Neuroreport, 10, 3363, 10.1097/00001756-199911080-00020 Winkler, 1999, Brain responses reveal the learning of foreign language phonemes, Psychophysiology, 36, 638, 10.1111/1469-8986.3650638