Emerging methods for conceptual modelling in neuroimaging
Tóm tắt
Some open theoretical questions are addressed on how the mind and brain represent and process concepts, particularly as they are instantiated in particular human languages. Recordings of neuroimaging data should provide a suitable empirical basis for investigating this topic, but the complexity and variety of language demands appropriate data-driven approaches. In this review we argue for a particular suite of methodologies, based on multivariate classification techniques which have proven to be powerful tools for distinguishing neural and cognitive states in fMRI. A combination of larger scale neuroimaging studies are introduced with different monolingual and bilingual populations, and hybrid computational analyses that use encoded implementations of existing theories of conceptual organisation to probe those data. We develop a suite of methodologies that holds the promise of being able to holistically elicit, record and model neural processing during language comprehension and production.
Tài liệu tham khảo
Akama H, Murphy B, Li N, Shimizu Y, Poesio M (2012) Decoding semantics across fMRI sessions with different stimulus modalities: a practical MVPA study. Frontiers Neuroinformatics 6:24
Akama H, Murphy B, Lei MM, Poesio M (2014) Cross-participant modelling based on joint or disjoint feature selection: an fMRI conceptual decoding study. In: Applied Informatics, vol 1, no 1. Springer, New York, p 1
Anderson AJ, Binder J, Fernandino L, Humphries C, Conant L, Aguilar M, Wang X, Doko D, Raizada RDS (2016) Predicting neural activity patterns associated with sentences using a neurobiologically motivated model of semantic representation. Cereb Cortex. doi:10.1093/cercor/bhw240 (Advance Online Publication)
Brennan J, Nir Y, Hasson U, Malach R, Heeger DJ, Pylkkänen L (2012) Syntactic structure building in the anterior temporal lobe during natural story listening. Brain Lang 120(2):163–173
Buchweitz A, Keller TA, Meyler A, Just MA (2012) Brain activation for language dual‐tasking: listening to two people speak at the same time and a change in network timing. Hum Brain Mapp 33:1868–1882
Carlson A, Betteridge J, Kisiel B, Settles B, Hruschka ER, Mitchell TM (2010) Toward an architecture for never-ending language learning. Artif Intell 2(4):3
Charest I, Kievit RA, Schmitz TW, Deca D, Kriegeskorte N (2014) Unique semantic space in the brain of each beholder predicts perceived similarity. Proc Natl Acad Sci USA 111(40):14565–14570
Chomsky N (1981) Lectures on government and binding: the Pisa lectures. Walter de Gruyter, USA
Dmochowski JP, Sajda P, Dias J, Parra LC (2012) Correlated components of ongoing EEG point to emotionally laden attention—a possible marker of engagement? Front Human Neurosci 6:112
Fairhall SL, Caramazza A (2013) Brain regions that represent amodal conceptual knowledge. J Neurosci 33(25):10552–10558
Fernandino L, Humphries CJ, Seidenberg MS, Gross WL, Conant LL, Binder JR (2015) Predicting brain activation patterns associated with individual lexical concepts based on five sensory-motor attributes. Neuropsychologia 76:17–26
Fernandino L, Binder JR, Desai RH, Pendl SL, Humphries CJ, Gross WL, Conant LL, Seidenberg MS (2016) Concept representation reflects multimodal abstraction: a framework for embodied semantics. Cereb Cortex 26(5):2018–2034
Frank MC, Everett DL, Fedorenko E, Gibson E (2008) Number as a cognitive technology: evidence from Pirahã language and cognition. Cognition 108(3):819–824
Friston KJ, Holmes AP, Worsley KJ, Poline JP, Frith CD, Frackowiak RS (1994) Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp 2(4):189–210
Fyshe A, Wehbe L, Talukdar P, Murphy B, Mitchell T (2015) A Compositional and Interpretable Semantic Space. In: Proceedings of NAACL, pp 32–41
Griffiths TL, Steyvers M, Tenenbaum JB (2007) Topics in semantic representation. Psychol Rev 114(2):211–244
Hanke M, Halchenko YO, Sederberg PB, Hanson SJ, Haxby JV, Pollmann S (2009) PyMVPA: a python toolbox for multivariate pattern analysis of fMRI data. Neuroinformatics 7(1):37–53
Hasson U, Landesman O, Knappmeyer B, Vallines I, Rubin N, Heeger DJ (2008) Neurocinematics: the neuroscience of film. Projections 2(1):1–26
Haxby JV, Gobbini MI, Furey ML, Ishai A, Schouten JL, Pietrini P (2001) Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293(5539):2425–2430
Haxby JV, Guntupalli JS, Connolly AC, Halchenko YO, Conroy BR, Gobbini MI, Hanke M, Ramadge PJ (2011) A common, high-dimensional model of the representational space in human ventral temporal cortex. Neuron 72(2):404–416
Kriegeskorte N, Goebel R, Bandettini P (2006) Information-based functional brain mapping. Proc Natl Acad Sci USA 103(10):3863–3868
Kriegeskorte N, Mur M, Bandettini P (2008a) Representational similarity analysis–connecting the branches of systems neuroscience. Front Syst Neurosci 2:4
Kriegeskorte N, Mur M, Ruff DA, Kiani R, Bodurka J, Esteky H, Tanaka K, Bandettini PA (2008b) Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron 60(6):1126–1141
Kriegeskorte N, Simmons WK, Bellgowan PS, Baker CI (2009) Circular analysis in systems neuroscience: the dangers of double dipping. Nat Neurosci 12(5):535–540
Landauer T, Dumais S (1997) A solution to Plato’s problem: the latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychol Rev 104(2):211–240
Lei M, Akama H, Murphy B (2014) Neural basis of language switching in the brain: fMRI evidence from Korean–Chinese early bilinguals. Brain Lang 138:12–18
Liuzzi AG, Bruffaerts R, Dupont P, Adamczuk K, Peeters R, De Deyne S, Storms G, Vandenberghe R (2015) Left perirhinal cortex codes for similarity in meaning between written words: comparison with auditory word input. Neuropsychologia 76:4–16
Lund K, Burgess C (1996) Producing high-dimensional semantic spaces from lexical co-occurrence. Behav Res Methods Instrum Comput 28:203–208
Meteyard L, Cuadrado SR, Bahrami B, Vigliocco G (2012) Coming of age: a review of embodiment and the neuroscience of semantics. Cortex 48(7):788–804
Mitchell TM, Shinkareva SV, Carlson A, Chang KM, Malave VL, Mason RA, Just MA (2008) Predicting human brain activity associated with the meanings of nouns. Science 320(5880):1191–1195
Murphy G (2004) The big book of concepts. MIT Press, USA, p 555
Murphy B, Poesio M, Bovolo F, Bruzzone L, Dalponte M, Lakany H (2011) EEG decoding of semantic category reveals distributed representations for single concepts. Brain Lang 117(1):12–22
Murphy B, Talukdar P, Mitchell T (2012a) Selecting corpus-semantic models for neurolinguistic decoding. In: Proceedings of First Joint Conference on Lexical and Computational Semantics (*SEM). Association for Computational Linguistics, pp 114–123
Murphy B, Talukdar PP, Mitchell TM (2012b) Learning Effective and Interpretable Semantic Models using Non-Negative Sparse Embedding. In: COLING. pp 1933–1950
Nevins A, Pesetsky D, Rodrigues C (2009) Pirahã exceptionality: a reassessment. Language 85(2):355–404
Newell A (1973) You can’t play 20 questions with nature and win: Projective comments on the papers of this symposium
Pliatsikas C, Luk G (2016) Executive control in bilinguals: a concise review on fMRI studies. Language and Cognition, Bilingualism, pp 1–7
Pulvermüller F (2005) Brain mechanisms linking language and action. Nat Rev Neurosci 6:576–582
Raizada RD, Connolly AC (2012) What makes different people’s representations alike: neural similarity space solves the problem of across-subject fMRI decoding. J Cogn Neurosci 24(4):868–877
Regier T, Kay P, Khetarpal N (2007) Color naming reflects optimal partitions of color space. Proc Natl Acad Sci USA 104:1436–1441
Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N et al (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15(1):273–289
Wehbe L, Murphy B, Talukdar P, Fyshe A, Ramdas A, Mitchell T (2014a) Simultaneously uncovering the patterns of brain regions involved in different story reading subprocesses. PLoS One 9(11):e112575
Wehbe L, Vaswani A, Knight K, Mitchell T (2014b) Aligning context-based statistical models of language with brain activity during reading. Proceedings of EMNLP
Wilkins J (1668) An essay towards a real character, and a philosophical language. English linguistics, a collection of facsimile reprints, no. 119. Scholar Press, Germany, pp 1500–1800
Zinszer BD, Anderson AJ, Kang O, Wheatley T, Raizada RD (2016) Semantic structural alignment of neural representational spaces enables translation between English and Chinese words. J Cogn Neurosci. doi:10.1162/jocn_a_01000 (Advance Online Publication)