Neurodevelopmental oscillatory basis of speech processing in noise

Developmental Cognitive Neuroscience - Tập 59 - Trang 101181 - 2023
Julie Bertels1,2, Maxime Niesen1,3, Florian Destoky1, Tim Coolen1,4, Marc Vander Ghinst1,3, Vincent Wens1,5, Antonin Rovai1,5, Nicola Trotta1,5, Martijn Baart6,7, Nicola Molinaro6,8, Xavier De Tiège1,5, Mathieu Bourguignon1,6,9
1Laboratoire de Neuroanatomie et Neuroimagerie translationnelles, UNI – ULB Neuroscience Institute, Université libre de Bruxelles (ULB), Brussels, Belgium
2ULBabyLab – Consciousness, Cognition and Computation group, UNI – ULB Neuroscience Institute, Université libre de Bruxelles (ULB), Brussels, Belgium
3Service d'ORL et de chirurgie cervico-faciale, CUB Hôpital Erasme, Université libre de Bruxelles (ULB), Brussels, Belgium
4Department of Radiology, CUB Hôpital Erasme, Université libre de Bruxelles (ULB), Brussels, Belgium
5Department of Functional Neuroimaging, Service of Nuclear Medicine, CUB Hôpital Erasme, Université libre de Bruxelles (ULB), Brussels, Belgium
6BCBL, Basque Center on Cognition, Brain, and Language, San Sebastian, Spain
7Department of Cognitive Neuropsychology, Tilburg University, Tilburg, The Netherlands
8IKERBASQUE, Basque Foundation for Science, Bilbao, Spain
9Laboratory of Neurophysiology and Movement Biomechanics, UNI – ULB Neuroscience Institute, Université libre de Bruxelles (ULB), Brussels, Belgium

Tài liệu tham khảo

Abrams, 2008, Right-hemisphere auditory cortex is dominant for coding syllable patterns in speech, J. Neurosci., 28, 3958, 10.1523/JNEUROSCI.0187-08.2008 Abrams, 2009, Abnormal cortical processing of the syllable rate of speech in poor readers, J. Neurosci., 29, 7686, 10.1523/JNEUROSCI.5242-08.2009 Ahissar, 2001, Speech comprehension is correlated with temporal response patterns recorded from auditory cortex, Proc. Natl. Acad. Sci. U. S. A., 98, 13367, 10.1073/pnas.201400998 Altman, 2006, The cost of dichotomising continuous variables, BMJ, 332, 1080, 10.1136/bmj.332.7549.1080 Anthony, 2005, Development of Phonological Awareness, Curr. Dir. Psychol. Sci., 14, 255, 10.1111/j.0963-7214.2005.00376.x Arnal, 2009, Dual neural routing of visual facilitation in speech processing, J. Neurosci., 29, 13445, 10.1523/JNEUROSCI.3194-09.2009 Ashburner, 1999, Nonlinear spatial normalization using basis functions, Hum. Brain Mapp., 7, 254, 10.1002/(SICI)1097-0193(1999)7:4<254::AID-HBM4>3.0.CO;2-G Ashburner, 1997, Incorporating prior knowledge into image registration, Neuroimage, 6, 344, 10.1006/nimg.1997.0299 Attaheri, 2021, Delta- and theta-band cortical tracking and phase-amplitude coupling to sung speech by infants, BioRxiv, 329326 Baart, 2015, Phonetic matching of auditory and visual speech develops during childhood: Evidence from sine-wave speech, Journal of Experimental Child Psychology, 129, 157, 10.1016/j.jecp.2014.08.002 Baart, 2017, Electrophysiological evidence for differences between fusion and combination illusions in audiovisual speech perception, Eur. J. Neurosci., 46, 2578, 10.1111/ejn.13734 Baillet, 2017, Magnetoencephalography for brain electrophysiology and imaging, Nat. Neurosci., 20, 327, 10.1038/nn.4504 Barutchu, 2010, Audiovisual integration in noise by children and adults, J. Exp. Child Psychol., 105, 38, 10.1016/j.jecp.2009.08.005 Biesmans, 2017, Auditory-inspired speech envelope extraction methods for improved EEG-based auditory attention detection in a cocktail party scenario, IEEE Trans. Neural Syst. Rehabil. Eng., 25, 402, 10.1109/TNSRE.2016.2571900 Bolia, 2000, A speech corpus for multitalker communications research, J. Acoust. Soc. Am., 107, 1065, 10.1121/1.428288 Bourguignon, 2013, The pace of prosodic phrasing couples the listener’s cortex to the reader's voice, Hum. Brain Mapp., 34, 314, 10.1002/hbm.21442 Bourguignon, 2018, Contrasting functional imaging parametric maps: The mislocation problem and alternative solutions, NeuroImage, 169, 200, 10.1016/j.neuroimage.2017.12.033 Bourguignon, 2019, Lip-reading enables the brain to synthesize auditory features of unknown silent speech, J. Neurosci. Bronkhorst, 2015, The cocktail-party problem revisited: early processing and selection of multi-talker speech, Atten. Percept. Psychophys., 77, 1465, 10.3758/s13414-015-0882-9 Brungart, 2001, Informational and energetic masking effects in the perception of two simultaneous talkers, J. Acoust. Soc. Am., 109, 1101, 10.1121/1.1345696 Cameron, 2018, The parsing syllable envelopes test for assessment of amplitude modulation discrimination skills in children: development, normative data, and test-retest reliability studies, J. Am. Acad. Audiol., 29, 151, 10.3766/jaaa.16146 Corbin, 2016, Development of open-set word recognition in children: speech-shaped noise and two-talker speech maskers, Ear Hear, 37, 55, 10.1097/AUD.0000000000000201 Corrêa, 1995, Corrêa, An alternative assessment of children’s comprehension of relative clauses, J. Psycholinguist. Res., 24, 183, 10.1007/BF02145355 Crosse, 2015, Congruent visual speech enhances cortical entrainment to continuous auditory speech in noise-free conditions, J. Neurosci., 35, 14195, 10.1523/JNEUROSCI.1829-15.2015 Crosse, 2016, Eye can hear clearly now: inverse effectiveness in natural audiovisual speech processing relies on long-term crossmodal temporal integration, J. Neurosci., 36, 9888, 10.1523/JNEUROSCI.1396-16.2016 Dale, 1993, Improved localization of cortical activity by combining EEG and MEG with MRI cortical surface reconstruction: a linear approach, J. Cogn. Neurosci., 5, 162, 10.1162/jocn.1993.5.2.162 Darwin, 1999, Auditory objects of attention: the role of interaural time differences, J. Exp. Psychol. Hum. Percept. Perform., 25, 617, 10.1037/0096-1523.25.3.617 Darwin, 2003, Effects of fundamental frequency and vocal-tract length changes on attention to one of two simultaneous talkers, J. Acoust. Soc. Am., 114, 2913, 10.1121/1.1616924 De Tiège, 2008, Recording epileptic activity with MEG in a light-weight magnetic shield, Epilepsy Res, 82, 227, 10.1016/j.eplepsyres.2008.08.011 Decruy, 2019, Evidence for enhanced neural tracking of the speech envelope underlying age-related speech-in-noise difficulties, J. Neurophysiol., 122, 601, 10.1152/jn.00687.2018 Demanez, 2003, Central auditory processing assessment: a French-speaking battery, Acta Otorhinolaryngol. Belg., 57, 275 Destoky, 2019, Comparing the potential of MEG and EEG to uncover brain tracking of speech temporal envelope, Neuroimage, 184, 201, 10.1016/j.neuroimage.2018.09.006 Destoky, 2020, Cortical tracking of speech in noise accounts for reading strategies in children, PLoS Biol., 18, 10.1371/journal.pbio.3000840 Destoky, 2022, The role of reading experience in atypical cortical tracking of speech and speech-in-noise in dyslexia, Neuroimage, 253, 10.1016/j.neuroimage.2022.119061 Ding, 2012, Emergence of neural encoding of auditory objects while listening to competing speakers, Proc. Natl. Acad. Sci. U. S. A., 109, 11854, 10.1073/pnas.1205381109 Ding, 2013, Adaptive temporal encoding leads to a background-insensitive cortical representation of speech, J. Neurosci., 33, 5728, 10.1523/JNEUROSCI.5297-12.2013 Ding, 2014, Cortical entrainment to continuous speech: functional roles and interpretations, Front. Hum. Neurosci., 8, 311, 10.3389/fnhum.2014.00311 Ding, 2016, Cortical tracking of hierarchical linguistic structures in connected speech, Nat. Neurosci., 19, 158, 10.1038/nn.4186 Dodd, 1979, Lip reading in infants: attention to speech presented in- and out-of-synchrony, Cogn. Psychol., 11, 478, 10.1016/0010-0285(79)90021-5 Donhauser, 2020, Two distinct neural timescales for predictive speech processing, Neuron, 105, 385, 10.1016/j.neuron.2019.10.019 Efron, 1994 Elliott, 1979, Performance of children aged 9 to 17 years on a test of speech intelligibility in noise using sentence material with controlled word predictability, J. Acoust. Soc. Am., 66, 651, 10.1121/1.383691 Fjell, 2015, Development and aging of cortical thickness correspond to genetic organization patterns, PNAS, 112, 15462, 10.1073/pnas.1508831112 Fuglsang, 2017, Noise-robust cortical tracking of attended speech in real-world acoustic scenes, Neuroimage, 156, 435, 10.1016/j.neuroimage.2017.04.026 Ghitza, 2013, The theta-syllable: a unit of speech information defined by cortical function, Front. Psychol., 4, 138, 10.3389/fpsyg.2013.00138 Giordano, 2017, Contributions of local speech encoding and functional connectivity to audio-visual speech perception, Elife, 6, 10.7554/eLife.24763 Giraud, 2012, Cortical oscillations and speech processing: emerging computational principles and operations, Nat. Neurosci., 15, 511, 10.1038/nn.3063 Giraud, 2013, Neurogenetics and auditory processing in developmental dyslexia, Curr. Opin. Neurobiol., 23, 37, 10.1016/j.conb.2012.09.003 Gogtay, 2004, Dynamic mapping of human cortical development during childhood through early adulthood, Proc. Natl. Acad. Sci. U. S. A., 101, 8174, 10.1073/pnas.0402680101 Gohel, 2017, Approximate Subject Specific Pseudo MRI from an Available MRI Dataset for MEG Source Imaging, Front. Neuroinformatics, 11, 10.3389/fninf.2017.00050 Gorba, 2019, Bidirectional influence on L1 Spanish and L2 English stop perception: The role of L2 experience, J. Acoust. Soc. Am., 145, EL587, 10.1121/1.5113808 Goswami, 2015, Sensory theories of developmental dyslexia: three challenges for research, Nat. Rev. Neurosci., 16, 43, 10.1038/nrn3836 Goswami, 2006, A developmental perspective on the neural code for written words, Trends Cogn. Sci., 10, 142, 10.1016/j.tics.2006.02.006 Gramfort, 2014, MNE software for processing MEG and EEG data, Neuroimage, 86, 446, 10.1016/j.neuroimage.2013.10.027 Gross, 2013, Speech rhythms and multiplexed oscillatory sensory coding in the human brain, PLoS Biol., 11, 10.1371/journal.pbio.1001752 Hall, 2002, Spondee recognition in a two-talker masker and a speech-shaped noise masker in adults and children, Ear Hear, 23, 159, 10.1097/00003446-200204000-00008 Hämäläinen, 1994, Interpreting magnetic fields of the brain: minimum norm estimates, Med. Biol. Eng. Comput., 32, 35, 10.1007/BF02512476 Hoen, 2007, Phonetic and lexical interferences in informational masking during speech-in-speech comprehension, Speech Commun., 49, 905, 10.1016/j.specom.2007.05.008 Holzgrefe-Lang, 2018, Infants’ processing of prosodic cues: electrophysiological evidence for boundary perception beyond pause detection, Lang. Speech, 61, 153, 10.1177/0023830917730590 Horton, 2013, Suppression of competing speech through entrainment of cortical oscillations, J. Neurophysiol., 109, 3082, 10.1152/jn.01026.2012 Kaufeld, 2020, Linguistic structure and meaning organize neural oscillations into a content-specific hierarchy, J. Neurosci., 40, 9467, 10.1523/JNEUROSCI.0302-20.2020 Keitel, 2018, Perceptually relevant speech tracking in auditory and motor cortex reflects distinct linguistic features, PLoS Biol., 16, 10.1371/journal.pbio.2004473 Kidd, 2002, English-speaking children’s comprehension of relative clauses: evidence for general-cognitive and language-specific constraints on development, J. Psycholinguist. Res, 31, 10.1023/A:1021265021141 Lallier, 2017, Amodal atypical neural oscillatory activity in dyslexia, Clin. Psychol. Sci., 5, 379, 10.1177/2167702616670119 Lalonde, 2021, Development of the mechanisms underlying audiovisual speech perception benefit, Brain Sci., 11, 10.3390/brainsci11010049 Lalor, 2010, Neural responses to uninterrupted natural speech can be extracted with precise temporal resolution, Eur. J. Neurosci., 31, 189, 10.1111/j.1460-9568.2009.07055.x Larson, 2017, The importance of properly compensating for head movements during MEG acquisition across different age groups, Brain Topogr., 30, 172, 10.1007/s10548-016-0523-1 Lee, 2020, Rhythm and syntax processing in school-age children, Dev. Psychol., 56, 1632, 10.1037/dev0000969 Leibold, 2017, Speech perception in complex acoustic environments: developmental effects, J. Speech Lang. Hear. Res., 60, 3001, 10.1044/2017_JSLHR-H-17-0070 Leibold, 2013, Children’s identification of consonants in a speech-shaped noise or a two-talker masker, J. Speech, Lang., Hear. Res., 56, 1144, 10.1044/1092-4388(2012/12-0011) Lizarazu, 2021, Language Proficiency Entails Tuning Cortical Activity to Second Language Speech, Cereb. Cortex, 31, 3820, 10.1093/cercor/bhab051 Luo, 2007, Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex, Neuron, 54, 1001, 10.1016/j.neuron.2007.06.004 Luo, 2010, Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation, PLoS Biol., 8, 10.1371/journal.pbio.1000445 MacCallum, 2002, On the practice of dichotomization of quantitative variables, Psychol. Methods, 7, 19, 10.1037/1082-989X.7.1.19 Mesgarani, 2012, Selective cortical representation of attended speaker in multi-talker speech perception, Nature, 485, 233, 10.1038/nature11020 Meyer, 2018, The neural oscillations of speech processing and language comprehension: state of the art and emerging mechanisms, Eur. J. Neurosci., 48, 2609, 10.1111/ejn.13748 Meyer, 2018, Synchronization of electrophysiological responses with speech benefits syntactic information processing, J. Cogn. Neurosci., 30, 1066, 10.1162/jocn_a_01236 Meyer, 2017, Linguistic bias modulates interpretation of speech via neural delta-band oscillations, Cereb. Cortex, 27, 4293 Molinaro, 2018, Delta(but not theta)-band cortical entrainment involves speech-specific processing, Eur. J. Neurosci., 48, 2642, 10.1111/ejn.13811 Molinaro, 2016, Out-of-synchrony speech entrainment in developmental dyslexia, Hum. Brain Mapp., 37, 2767, 10.1002/hbm.23206 Muzik, 2000, Statistical parametric mapping: assessment of application in children, Neuroimage, 12, 538, 10.1006/nimg.2000.0651 Myronenko, 2010, Point set registration: coherent point drift, IEEE Trans. Pattern Anal. Mach. Intell., 32, 2262, 10.1109/TPAMI.2010.46 Nichols, 2002, Nonparametric permutation tests for functional neuroimaging: a primer with examples, Hum. Brain Mapp., 15, 1, 10.1002/hbm.1058 O’Sullivan, 2014, Attentional selection in a cocktail party environment can be decoded from single-trial EEG, Cereb. Cortex, 25, 1697, 10.1093/cercor/bht355 Oostenveld, 2011, FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data, Comput. Intell. Neurosci., 2011 Ortiz Barajas, 2021, The origins and development of speech envelope tracking during the first months of life, Dev. Cogn. Neurosci., 48, 10.1016/j.dcn.2021.100915 Park, 2018, Representational interactions during audiovisual speech entrainment: Redundancy in left posterior superior temporal gyrus and synergy in left motor cortex, PLoS Biol., 16, 10.1371/journal.pbio.2006558 Patterson, 2003, Two-month-old infants match phonetic information in lips and voice, Dev. Sci., 6, 191, 10.1111/1467-7687.00271 Peelle, 2013, Phase-locked responses to speech in human auditory cortex are enhanced during comprehension, Cereb. Cortex, 23, 1378, 10.1093/cercor/bhs118 Poeppel, 2003, The analysis of speech in different temporal integration windows: cerebral lateralization as “asymmetric sampling in time, Speech Commun., 41, 245, 10.1016/S0167-6393(02)00107-3 Pollack, 1975, Auditory informational masking, J. Acoust. Soc. Am., 57, 10.1121/1.1995329 Power, 2016, Neural encoding of the speech envelope by children with developmental dyslexia, Brain Lang., 160, 1, 10.1016/j.bandl.2016.06.006 Puschmann, 2017, The right temporoparietal junction supports speech tracking during selective listening: evidence from concurrent EEG-fMRI, J. Neurosci., 37, 11505, 10.1523/JNEUROSCI.1007-17.2017 Reiss, 1996, Brain development, Gend. IQ Child. Brain, 119, 1763 Reuter, 2012, Within-subject template estimation for unbiased longitudinal image analysis, Neuroimage, 61, 1402, 10.1016/j.neuroimage.2012.02.084 Rimmele, 2015, The effects of selective attention and speech acoustics on neural speech-tracking in a multi-talker scene, Cortex, 68, 144, 10.1016/j.cortex.2014.12.014 Ríos‐López, 2020, Development of neural oscillatory activity in response to speech in children from 4 to 6 years old, Dev. Sci., 23, 10.1111/desc.12947 Ross, 2011, The development of multisensory speech perception continues into the late childhood years, Eur. J. Neurosci., 33, 2329, 10.1111/j.1460-9568.2011.07685.x Sanes, 2011, A behavioral framework to guide research on central auditory development and plasticity, Neuron, 72, 912, 10.1016/j.neuron.2011.12.005 Schwartz, 2004, Seeing to hear better: evidence for early audio-visual interactions in speech identification, Cognition, 93, B69, 10.1016/j.cognition.2004.01.006 Shield, 2008, The effects of environmental and classroom noise on the academic attainments of primary school children, J. Acoust. Soc. Am., 123, 133, 10.1121/1.2812596 Simon, 2015, The encoding of auditory objects in auditory cortex: insights from magnetoencephalography, Int. J. Psychophysiol., 95, 184, 10.1016/j.ijpsycho.2014.05.005 Skeide, 2016, The ontogeny of the cortical language network, Nat. Rev. Neurosci., 17, 323, 10.1038/nrn.2016.23 Speer, 2009, Prosody in first language acquisition - acquiring intonation as a tool to organize information in conversation, Lang. Linguist. Compass, 3, 90, 10.1111/j.1749-818X.2008.00103.x Stekelenburg, 2007, Neural correlates of multisensory integration of ecologically valid audiovisual events, J. Cogn. Neurosci., 19, 1964, 10.1162/jocn.2007.19.12.1964 Sumby, 1954, Visual contribution to speech intelligibility in noise, J. Acoust. Soc. Am., 26, 212, 10.1121/1.1907309 Sussman, 2007, The development of the perceptual organization of sound by frequency separation in 5–11-year-old children, Hear. Res., 225, 117, 10.1016/j.heares.2006.12.013 Taulu, 2006, Spatiotemporal signal space separation method for rejecting nearby interference in MEG measurements, Phys. Med. Biol., 51, 1759, 10.1088/0031-9155/51/7/008 Taulu, 2005, Applications of the signal space separation method, IEEE Trans. Signal Process, 53, 3359, 10.1109/TSP.2005.853302 Vander Ghinst, 2016, Left Superior Temporal Gyrus Is Coupled to Attended Speech in a Cocktail-Party Auditory Scene, J. Neurosci., 36, 1596, 10.1523/JNEUROSCI.1730-15.2016 Vander Ghinst, 2019, Cortical Tracking of Speech-in-Noise Develops from Childhood to Adulthood, J. Neurosci., 39, 2938, 10.1523/JNEUROSCI.1732-18.2019 Vanthornhout, 2018, Speech intelligibility predicted from neural entrainment of the speech envelope, J. Assoc. Res. Otolaryngol., 19, 181, 10.1007/s10162-018-0654-z Wens, 2015, A geometric correction scheme for spatial leakage effects in MEG/EEG seed-based functional connectivity mapping, Hum. Brain Mapp., 36, 4604, 10.1002/hbm.22943 Wightman, 2006, Informational masking of speech in children: auditory-visual integration, J. Acoust. Soc. Am., 119, 3940, 10.1121/1.2195121 Wightman, 2005, Informational masking of speech in children: effects of ipsilateral and contralateral distracters, J. Acoust. Soc. Am., 118, 3164, 10.1121/1.2082567 Wightman, 2010, Individual differences and age effects in a dichotic informational masking paradigm, J. Acoust. Soc. Am., 128, 270, 10.1121/1.3436536 Wilke, 2002, Assessment of spatial normalization of whole-brain magnetic resonance images in children, Hum. Brain Mapp., 17, 48, 10.1002/hbm.10053 Zion-Golumbic, 2012, Attention modulates “speech-tracking” at a cocktail party, Trends Cogn. Sci., 16, 363, 10.1016/j.tics.2012.05.004 Zion-Golumbic, 2013, Mechanisms underlying selective neuronal tracking of attended speech at a “cocktail party, Neuron, 77, 980, 10.1016/j.neuron.2012.12.037