Overnight changes to dual-memory processes reflected in speech-perceptual performance
Tóm tắt
Adults’ ability to attain and retain nonnative speech sound categories vary substantially among individuals. While we know that speech-perceptual skills play a role, we know less about how consolidation-related changes in acoustic-phonetic memory contribute to perceptual tasks. The goal of this investigation was to examine contributions of memory and perceptual skills to the perceptual performance on a trained nonnative speech contrast over two days. Twenty-one adult participants (ages 18–24) completed four different experiments. Three of these assessed learning and memory: visual statistical learning (implicit), visual object recognition (explicit), and nonnative (Hindi dental-retroflex) speech-sound training. Participants completed the learning tasks around 8 p.m., and performance was measured shortly after learning and again 12 hours later. On a separate day, participants completed a categorical perception task on a native (/a/–/e/) vowel continuum. Nonnative speech perception was associated with implicit learning performance when both were assessed shortly after learning, and associated with the retention of explicit memory when both were assessed after an overnight delay. Native speech-sounds were at least marginally associated with nonnative speech perception performance on both days, but with a stronger association observed with performance assessed on Day 2. These findings provide preliminary support for the interpretation that speech-sounds are encoded by at least two memory systems in parallel, but that perceptual performance may reflect acoustic-phonetic knowledge learned by different memory systems over time since exposure. Moreover, performance on speech perception tasks in both native and nonnative speech-sounds may rely on similar retrieval mechanisms for long-term storage of speech-sound information.
Tài liệu tham khảo
Bates, D., Maechler, M., Bolker, B., & Walker, S. (2015). lme4: Linear mixed-effects models using Eigen and S4 (R Package Version 1.1–7. 2014) [Computer software]. https://cran.r-project.org/web/packages/lme4/index.html
Bertels, J., Franco, A., & Destrebecqz, A. (2012). How implicit is visual statistical learning?. Journal of Experimental Psychology: Learning, Memory, and Cognition, 38(5), 1425.
Best, C. T. (1994). The emergence of native-language phonological influences in infants: A perceptual assimilation model. In J. C. Goodman & H. C. Nusbaum (Eds.), The development of speech perception: The transition from speech-sounds to spoken words (pp. 167–224). MIT Press.
Boersma, P. (2002). Praat: A system for doing phonetics by computer. Glot International, 5, 341-345.
Brown, M. W., & Aggleton, J. P. (2001). Recognition memory: What are the roles of the perirhinal cortex and hippocampus?. Nature Reviews Neuroscience, 2(1), 51–61.
Burnham, K. P., & Anderson, D. R (2002). Model selection and multimodel inference: A practical information-theoretic approach (2nd ed.). Springer.
Chandrasekaran, B., Koslov, S. R., & Maddox, W. T. (2014a). Toward a dual-learning systems model of speech category learning. Frontiers in Psychology, 5, 825.
Chandrasekaran, B., Yi, H. G., & Maddox, W. T. (2014b). Dual-learning systems during speech category learning. Psychonomic bulletin & review, 21(2), 488-495.
Chandrasekaran, B., Yi, H. G., Smayda, K. E., & Maddox, W. T. (2016). Effect of explicit dimensional instruction on speech category learning. Attention, Perception, & Psychophysics, 78(2), 566–582.
Cornelissen, K., Laine, M., Renvall, K., Saarinen, T., Martin, N., & Salmelin, R. (2004). Learning new names for new objects: Cortical effects as measured by magnetoencephalography. Brain and Language, 89(3), 617–622.
de Leeuw, J. R. (2015). JsPsych: A JavaScript library for creating behavioral experiments in a web browser. Behavior Research Methods, 47(1), 1–12. https://doi.org/10.3758/s13428-014-0458-y
Díaz, B., Baus, C., Escera, C., Costa, A., & Sebastián-Gallés, N. (2008). Brain potentials to native phoneme discrimination reveal the origin of individual differences in learning the sounds of a second language. Proceedings of the National Academy of Sciences, 105(42), 16083–16088.
Diekelmann, S., & Born, J. (2010). The memory function of sleep. Nature Reviews Neuroscience, 11(2), 114.
Dudai, Y. (2012). The restless engram: consolidations never end. Annual Review of Neuroscience, 35, 227–247.
Eals, M., & Silverman, I. (1994). The hunter-gatherer theory of spatial sex differences: Proximate factors mediating the female advantage in recall of object arrays. Ethology and Sociobiology, 15(2), 95–105. https://doi.org/10.1016/0162-3095(94)90020-5
Earle, F. S., & Myers, E. B. (2014). Building phonetic categories: An argument for the role of sleep. Frontiers in Psychology, 5, 1192.
Earle, F. S., & Myers, E. B. (2015a). Overnight consolidation promotes generalization across talkers in the identification of nonnative speech-sounds. The Journal of the Acoustical Society of America, 137(1), EL91–EL97.
Earle, F. S., & Myers, E. B. (2015b). Sleep and native language interference affect nonnative speech sound learning. Journal of Experimental Psychology: Human Perception and Performance, 41(6), 1680.
Earle, F. S., Landi, N., & Myers, E. B. (2017). Sleep duration predicts behavioral and neural differences in adult speech sound learning. Neuroscience Letters, 636, 77–82.
Earle, F. S., Landi, N., & Myers, E. B. (2018). Adults with specific language impairment fail to consolidate speech-sounds during sleep. Neuroscience letters, 666, 58–63.
Eisner, F., & McQueen, J. M. (2006). Perceptual learning in speech: Stability over time. The Journal of the Acoustical Society of America, 119(4), 1950–1953.
Fenn, K. M., Nusbaum, H. C., & Margoliash, D. (2003). Consolidation during sleep of perceptual learning of spoken language. Nature, 425(6958), 614.
Flege, J. E. (1993). Production and perception of a novel, second-language phonetic contrast. The Journal of the Acoustical Society of America, 93, 1589–608.
Francis, A. L., & Nusbaum, H. C. (2002). Selective attention and the acquisition of new phonetic categories. Journal of Experimental Psychology: Human Perception and Performance, 28(2), 349.
Fuhrmeister, P., & Myers, E. (2017). Perception of native language speech-sounds does not predict nonnative speech sound learning. The Journal of the Acoustical Society of America, 141(5), 3516–3516.
Gabay, Y., & Holt, L. L. (2015). Incidental learning of sound categories is impaired in developmental dyslexia. Cortex, 73, 131–143.
Hedenius, M., Ullman, M. T., Alm, P., Jennische, M., & Persson, J. (2013). Enhanced recognition memory after incidental encoding in children with developmental dyslexia. PLOS ONE, 8(5), e63998. https://doi.org/10.1371/journal.pone.0063998
Hillenbrand, J., Getty, L. A., Clark, M. J., & Wheeler, K. (1995). Acoustic characteristics of American English vowels. The Journal of the Acoustical society of America, 97(5), 3099–3111.
Hu, P., Stylos-Allan, M., & Walker, M. P. (2006). Sleep facilitates consolidation of emotional declarative memory. Psychological Science, 17(10), 891–898.
Iverson, P., & Kuhl, P. K. (1995). Mapping the perceptual magnet effect for speech using signal detection theory and multidimensional scaling. The Journal of the Acoustical Society of America, 97(1), 553–562.
Jaeger, B. (2017). r2glmm: Computes R Squared for Mixed (Multilevel) Models [Computer software]. https://CRAN.R-project.org/package=r2glmm
Janacsek, K., & Nemeth, D. (2012). Predicting the future: from implicit learning to consolidation. International Journal of Psychophysiology, 83(2), 213–221.
Kalra, P. B., Gabrieli, J. D., & Finn, A. S. (2019). Evidence of stable individual differences in implicit learning. Cognition, 190, 199–211.
Kuhl, P. K. (1992). Psychoacoustics and speech perception: Internal standards, perceptual anchors, and prototypes. In L. A. Werner & E. W. Rubel (Eds.), Developmental psychoacoustics (pp. 293–332). American Psychological Association. https://doi.org/10.1037/10119-012
Liberman, A. M. (1970). Some characteristics of perception in the speech mode. Perception and Its Disorders, 48, 238–254.
Little, T. D. (2013). Longitudinal structural equation modeling (methodology in the social sciences). .
Macmillan, N. A., & Creelman, C. D. (2004). Detection theory: A user’s guide. Psychology Press.
McClelland, J. L., McNaughton, B. L., & O’Reilly, R. C. (1995). Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102(3), 419.
Moeller, J. (2015). A word on standardization in longitudinal studies: don't. Frontiers in Psychology, 6, 1389. https://doi.org/10.3389/fpsyg.2015.01389
Nomura, E. M., Maddox, W. T., Filoteo, J. V., Ing, A. D., Gitelman, D. R., Parrish, T. B., Mesulam, M.M., & Reber, P. J. (2007). Neural correlates of rule-based and information-integration visual category learning. Cerebral Cortex, 17(1), 37–43.
Peterson, G. E., & Barney, H. L. (1952). Control methods used in a study of the vowels. The Journal of the Acoustical Society of America, 24(2), 175–184.
Qi, Z., Araujo, Y. S., Georgan, W. C., Gabrieli, J. D. E., & Arciuli, J. (2019a). Hearing matters more than seeing: A cross-modality study of statistical learning and reading ability. Scientific Studies of Reading, 23(1), 101–115.
Qi, Z., Han, M., Wang, Y., de los Angeles, C., Liu, Q., Garel, K., Chen, E.S., Whitfield-Gabrieli, S., Gabrieli, J.D.E., & Perrachione, T. K. (2019b). Speech processing and plasticity in the right hemisphere predict variation in adult foreign language learning. NeuroImage, 192, 76–87.
Qi, Z., Sanchez Araujo, Y., Nguyen, A., Hu, A., Georgan, W., Kozloff, V., & Robbins, P. (2020, May 17). An online platform for visual and auditory statistical learning for school-aged children (Version 1.0.0). https://doi.org/10.5281/ZENODO.3820620
Qin, Z., & Zhang, C. (2019). The effect of overnight consolidation in the perceptual learning of nonnative tonal contrasts. bioRxiv, 731042.
Quam, C., Wang, A., Maddox, W. T., Golisch, K., & Lotto, A. (2018). Procedural-memory, working-memory, and declarative-memory skills are each associated with dimensional integration in sound-category learning. Frontiers in Psychology, 9, 1828.
Rasch, B., Büchel, C., Gais, S., & Born, J. (2007). Odor cues during slow-wave sleep prompt declarative memory consolidation. Science, 315(5817), 1426–1429.
Simor, P., Zavecz, Z., Horváth, K., Éltető, N., Török, C., Pesthy, O., Gombos, F., Janacsek, K., & Nemeth, D. (2019). Deconstructing procedural memory: Different learning trajectories and consolidation of sequence and statistical learning. Frontiers in Psychology, 9, 2708.
Snodgrass, J. G., & Vanderwart, M. (1980). A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. Journal of Experimental Psychology: Human Learning and Memory, 6(2), 174. https://doi.org/10.1037/0278-7393.6.2.174
Strange, W. (Ed.). (1995). Speech perception and linguistic experience: Issues in cross-language research. York Press.
Tarr, M. J. (n.d.) Fribbles [Images]. Courtesy of Michael J. Tarr, Center for the Neural Basis of Cognition and Department of Psychology, Carnegie Mellon University. http://www.tarrlab.org/
Team, R. C. (2016). R: a language and environment for statistical computing. R Development Core Team, Vienna.
Turk-Browne, N. B., Scholl, B. J., Chun, M. M., & Johnson, M. K. (2009). Neural evidence of statistical learning: Efficient detection of visual regularities without awareness. Journal of Cognitive Neuroscience, 21(10), 1934–1945.
Ullman, M. T., Earle, F. S., Walenski, M., & Janacsek, K. (2020). The neurocognition of developmental disorders of language. Annual Review of Psychology, 71, 389–417. https://doi.org/10.1146/annurev-psych-122216-011555
van Buuren, S., Groothuis-Oudshoorn, K., Robitzsch, A., Vink, G., Doove, L., & Jolani, S. (2015). Package ‘mice’ [Computer software]. https://cran.r-project.org/web/packages/mice/index.html
VanLeeuwen, D. M., Murray, L. W., & Urquhart, N. S. (1996). A mixed model with both fixed and random trend components across time. Journal of Agricultural, Biological, and Environmental Statistics, 1(4), 435–453.
Wang, W. C., & Yonelinas, A. P. (2012). Familiarity is related to conceptual implicit memory: An examination of individual differences. Psychonomic Bulletin & Review, 19(6), 1154–1164.
Wechsler, D. (2008). Wechsler Adult Intelligence Scale (4th ed.; WAIS–IV). Pearson.
Werker, J. F., & Tees, R. C. (1984). Cross-language speech perception: Evidence for perceptual reorganization during the first year of life. Infant Behavior And Development, 7(1), 49–63.
Williams, P., & Tarr, M. J. (1997). Structural processing and implicit memory for possible and impossible figures. Journal of Experimental Psychology: Learning, Memory, and Cognition, 23(6), 1344.
Xie, X., Earle, F. S., & Myers, E. B. (2018). Sleep facilitates generalisation of accent adaptation to a new talker. Language, Cognition and Neuroscience, 33(2), 196–210.
Zeileis A., Hothorn T. (2002). Diagnostic Checking in Regression Relationships. R News, 2(3), 7–10. https://CRAN.R-project.org/doc/Rnews/.
Zhang, Y., Kuhl, P. K., Imada, T., Kotani, M., & Tohkura, Y. I. (2005). Effects of language experience: neural commitment to language-specific auditory patterns. NeuroImage, 26(3), 703–720.