Continuous speech processing

Current Opinion in Physiology - Tập 18 - Trang 25-31 - 2020
Christian Brodbeck1, Jonathan Z Simon1,2,3
1Institute for Systems Research, University of Maryland, College Park, MD 20742, USA
2Department of Electrical and Computer Engineering, University of Maryland, College Park, MD 20742, USA
3Department of Biology, University of Maryland, College Park, MD 20742, USA

Tài liệu tham khảo

Lalor, 2010, Neural responses to uninterrupted natural speech can be extracted with precise temporal resolution, Eur J Neurosci, 31, 189, 10.1111/j.1460-9568.2009.07055.x David, 2007, Estimating sparse spectro-temporal receptive fields with natural stimuli, Netw Comput Neural Syst, 18, 191, 10.1080/09548980701609235 Ding, 2012, Neural coding of continuous speech in auditory cortex during monaural and dichotic listening, J Neurophysiol, 107, 78, 10.1152/jn.00297.2011 Brodbeck, 2018, Neural source dynamics of brain responses to continuous stimuli: speech processing from acoustics to comprehension, NeuroImage, 172, 162, 10.1016/j.neuroimage.2018.01.042 Das, 2020, Neuro-current response functions: a unified approach to MEG source analysis under the continuous stimuli paradigm, NeuroImage, 211, 10.1016/j.neuroimage.2020.116528 Luo, 2007, Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex, Neuron, 54, 1001, 10.1016/j.neuron.2007.06.004 Viswanathan, 2019, Electroencephalographic signatures of the neural representation of speech during selective attention, eNeuro, 6, 10.1523/ENEURO.0057-19.2019 Obleser, 2019, Neural entrainment and attentional selection in the listening brain, Trends Cogn Sci, 23, 913, 10.1016/j.tics.2019.08.004 Vanthornhout, 2018, Speech intelligibility predicted from neural entrainment of the speech envelope, J Assoc Res Otolaryngol, 19, 181, 10.1007/s10162-018-0654-z Etard, 2019, Neural speech tracking in the theta and in the delta frequency band differentially encode clarity and comprehension of speech in noise, J Neurosci, 39, 5750, 10.1523/JNEUROSCI.1828-18.2019 Shannon, 1995, Speech recognition with primarily temporal cues, Science, 270, 303, 10.1126/science.270.5234.303 Verschueren, 2019, Neural envelope tracking as a measure of speech understanding in cochlear implant users, Hear Res, 373, 23, 10.1016/j.heares.2018.12.004 Riecke, 2017, Neural entrainment to speech modulates speech intelligibility, Curr Biol, 28, 161, 10.1016/j.cub.2017.11.033 Wilsch, 2018, Transcranial alternating current stimulation with speech envelopes modulates speech comprehension, NeuroImage, 172, 766, 10.1016/j.neuroimage.2018.01.038 Keshavarzi, 2020, Transcranial alternating current stimulation in the theta band but not in the delta band modulates the comprehension of naturalistic speech in noise, NeuroImage, 210, 10.1016/j.neuroimage.2020.116557 Presacco, 2016, Evidence of degraded representation of speech in noise, in the aging midbrain and cortex, J Neurophysiol, 116, 2346, 10.1152/jn.00372.2016 Decruy, 2019, Evidence for enhanced neural tracking of the speech envelope underlying age-related speech-in-noise difficulties, J Neurophysiol, 122, 601, 10.1152/jn.00687.2018 Brodbeck, 2018, Over-representation of speech in older adults originates from early response in higher order auditory cortex, Acta Acust United Acust, 104, 774, 10.3813/AAA.919221 Ding, 2012, Emergence of neural encoding of auditory objects while listening to competing speakers, Proc Natl Acad Sci USA, 109, 11854, 10.1073/pnas.1205381109 Miran, 2018, Real-time tracking of selective auditory attention from M/EEG: a Bayesian filtering approach, Front Neurosci, 12, 10.3389/fnins.2018.00262 O’Sullivan, 2015, Attentional selection in a cocktail party environment can be decoded from single-trial EEG, Cereb Cortex, 25, 1697, 10.1093/cercor/bht355 Lesenfants, 2020, The interplay of top-down focal attention and the cortical tracking of speech, Sci Rep, 10, 6922, 10.1038/s41598-020-63587-3 Keitel, 2018, Perceptually relevant speech tracking in auditory and motor cortex reflects distinct linguistic features, PLoS Biol, 16, 10.1371/journal.pbio.2004473 Lesenfants, 2019, Predicting individual speech intelligibility from the cortical tracking of acoustic- and phonetic-level speech representations, Hear Res, 380, 1, 10.1016/j.heares.2019.05.006 Cervantes Constantino, 2018, Restoration and efficiency of the neural processing of continuous speech are promoted by prior knowledge, Front Syst Neurosci, 12, 56, 10.3389/fnsys.2018.00056 Zou, 2019, Auditory and language contributions to neural encoding of speech features in noisy environments, NeuroImage, 192, 66, 10.1016/j.neuroimage.2019.02.047 Vanthornhout, 2019, Effect of task and attention on neural tracking of speech, Front Neurosci, 13, 977, 10.3389/fnins.2019.00977 Puvvada, 2017, Cortical representations of speech in a multitalker auditory scene, J Neurosci, 37, 9189, 10.1523/JNEUROSCI.0938-17.2017 O’Sullivan, 2019, Hierarchical encoding of attended auditory objects in multi-talker speech perception, Neuron, 104, 1195, 10.1016/j.neuron.2019.09.007 Paul, 2020, Poor early cortical differentiation of speech predicts perceptual difficulties of severely hearing-impaired listeners in multi-talker environments, Sci Rep, 10, 6141, 10.1038/s41598-020-63103-7 Fiedler, 2019, Late cortical tracking of ignored speech facilitates neural selectivity in acoustically challenging conditions, NeuroImage, 186, 33, 10.1016/j.neuroimage.2018.10.057 Ding, 2014, Cortical entrainment to continuous speech: functional roles and interpretations, Front Hum Neurosci, 8, 10.3389/fnhum.2014.00311 Zoefel, 2018, Phase entrainment of brain oscillations causally modulates neural responses to intelligible speech, Curr Biol, 28, 401, 10.1016/j.cub.2017.11.071 Zion Golumbic, 2013, Mechanisms underlying selective neuronal tracking of attended speech at a “cocktail party”, Neuron, 77, 980, 10.1016/j.neuron.2012.12.037 Daube, 2019, Simple acoustic features can explain phoneme-based predictions of cortical responses to speech, Curr Biol, 29, 1924, 10.1016/j.cub.2019.04.067 Di Liberto, 2015, Low-frequency cortical entrainment to speech reflects phoneme-level processing, Curr Biol, 25, 2457, 10.1016/j.cub.2015.08.030 Fiedler, 2017, Single-channel in-ear-EEG detects the focus of auditory attention to concurrent tone streams and mixed speech, J Neural Eng, 14, 10.1088/1741-2552/aa66dd Koning, 2012, The potential of onset enhancement for increased speech intelligibility in auditory prostheses, J Acoust Soc Am, 132, 2569, 10.1121/1.4748965 Stilp, 2010, Cochlea-scaled entropy, not consonants, vowels, or time, best predicts speech intelligibility, PNAS, 107, 12387, 10.1073/pnas.0913625107 Oganian, 2019, A speech envelope landmark for syllable encoding in human superior temporal gyrus, Sci Adv, 5, 10.1126/sciadv.aay6279 Brodbeck, 2018, Rapid transformation from auditory to linguistic representations of continuous speech, Curr Biol, 28, 3976, 10.1016/j.cub.2018.10.042 Hamilton, 2018, A spatial map of onset and sustained responses to speech in the human superior temporal gyrus, Curr Biol, 28, 1860, 10.1016/j.cub.2018.04.033 Drennan, 2019, Cortical tracking of complex sound envelopes: modeling the changes in response with intensity, eNeuro, 6, 10.1523/ENEURO.0082-19.2019 Tang, 2017, Intonational speech prosody encoding in the human auditory cortex, Science, 357, 797, 10.1126/science.aam8577 Teoh, 2019, Prosodic pitch processing is represented in delta‐band EEG and is dissociable from the cortical tracking of other acoustic and phonetic features, Eur J Neurosci, 50, 3831, 10.1111/ejn.14510 Sjerps, 2019, Speaker-normalized sound representations in the human auditory cortex, Nat Commun, 10, 10.1038/s41467-019-10365-z Wilson, 2018, Convergence of spoken and written language processing in the superior temporal sulcus, NeuroImage, 171, 62, 10.1016/j.neuroimage.2017.12.068 Ding, 2016, Cortical tracking of hierarchical linguistic structures in connected speech, Nat Neurosci, 19, 158, 10.1038/nn.4186 Ding, 2018, Attention is required for knowledge-based sequential grouping: insights from the integration of syllables into words, J Neurosci, 38, 1178, 10.1523/JNEUROSCI.2606-17.2017 Frank, 2018, Lexical representation explains cortical entrainment during speech comprehension, PLoS One, 13, 10.1371/journal.pone.0197304 Clark, 2013, Whatever next? Predictive brains, situated agents, and the future of cognitive science, Behav Brain Sci, 36, 181, 10.1017/S0140525X12000477 Kutas, 2011, Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP), Ann Rev Psychol, 62, 621, 10.1146/annurev.psych.093008.131123 Broderick, 2018, Electrophysiological correlates of semantic dissimilarity reflect the comprehension of natural, narrative speech, Curr Biol, 28, 803, 10.1016/j.cub.2018.01.080 Weissbart, 2020, Cortical tracking of surprisal during continuous speech comprehension, J Cogn Neurosci, 32, 155, 10.1162/jocn_a_01467 Koskinen, 2020, Brain activity reflects the predictability of word sequences in listened continuous speech, NeuroImage, 219, 10.1016/j.neuroimage.2020.116936 Broderick, 2019, Semantic context enhances the early auditory encoding of natural speech, J Neurosci, 39, 7564, 10.1523/JNEUROSCI.0584-19.2019 Frank, 2017, Word predictability and semantic similarity show distinct patterns of brain activity during language comprehension, Lang Cogn Neurosci, 32, 1192, 10.1080/23273798.2017.1323109 Brennan, 2019, Hierarchical structure guides rapid linguistic predictions during naturalistic listening, PLoS One, 14, 10.1371/journal.pone.0207741 Brennan, 2020, Localizing syntactic predictions using recurrent neural network grammars, Neuropsychologia, 146, 107479, 10.1016/j.neuropsychologia.2020.107479 Gagnepain, 2012, Temporal predictive codes for spoken words in auditory cortex, Curr Biol, 22, 615, 10.1016/j.cub.2012.02.015 Shannon, 1948, A mathematical theory of communication, Bell Syst Tech J, 27, 379, 10.1002/j.1538-7305.1948.tb01338.x Donhauser, 2020, Two distinct neural timescales for predictive speech processing, Neuron, 105, 385, 10.1016/j.neuron.2019.10.019 Meyer, 2019, Synchronous, but not entrained: exogenous and endogenous cortical rhythms of speech and language processing, Lang Cogn Neurosci, 1 Kösem, 2018, Neural entrainment determines the words we hear, Curr Biol, 28, 2867, 10.1016/j.cub.2018.07.023 Haegens, 2020, Entrainment revisited: a commentary on Meyer, Sun, and Martin, Lang Cogn Neurosci, 2020 Coffey, 2019, Evolving perspectives on the sources of the frequency-following response, Nat Commun, 10, 10.1038/s41467-019-13003-w Maddox, 2018, Auditory brainstem responses to continuous natural speech in human listeners, eNeuro, 5, 10.1523/ENEURO.0441-17.2018 Forte, 2017, The human auditory brainstem response to running speech reveals a subcortical mechanism for selective attention, eLife Sci, 6 Etard, 2019, Decoding of selective attention to continuous speech from the human auditory brainstem response, NeuroImage, 200, 1, 10.1016/j.neuroimage.2019.06.029 Saiz-Alía, 2019, Individual differences in the attentional modulation of the human auditory brainstem response to speech inform on speech-in-noise deficits, Sci Rep, 9, 14131, 10.1038/s41598-019-50773-1 Khalfa, 2001, Evidence of peripheral auditory activity modulation by the auditory cortex in humans, Neuroscience, 104, 347, 10.1016/S0306-4522(01)00072-0