Catching the news: Processing strategies in listening to dialogs as measured by ERPs
Tóm tắt
The online segmentation of spoken single sentences has repeatedly been associated with a particular event-related brain potential. The brain response could be attributed to the perception of major prosodic boundaries, and was termed Closure Positive Shift (CPS). However, verbal exchange between humans is mostly realized in the form of cooperative dialogs instead of loose strings of single sentences. The present study investigated whether listeners use prosodic cues for structuring larger contextually embedded utterances (i.e. dialogs) like in single sentence processing. ERPs were recorded from listeners (n = 22) when presented with question-answer dialogs in German. The prosody of the answer (target sentence) either matched the context provided by a question or did not match the context question. CPS responses to the processing of the target sentences are elicited, first, when listeners encounter information comprising 'novelties', i.e. information not mentioned in the preceding question but facts corrected between context and target. Thereby it is irrelevant whether the actual prosody of the target sentence is in congruence with the informative status or not. Second, when listeners encounter target sentences which do not convey any novelties but only previously 'given' already known information, the structuring of the speech input is driven by prosody again. The CPS is then elicited when listeners perceive major prosodic boundaries similar as for the processing of context-free single sentences. The study establishes a link between the on-line structuring of context-free (single sentences) and context-embedded utterances (dialogs) as measured by ERPs. Moreover, the impact of prosodic phrasing and accentuation on the perception of spoken utterances on and beyond sentence level is discussed.
Tài liệu tham khảo
Paul H: Prinzipien der Sprachgeschichte. 1880, Tübingen: Niemeyer
Halliday MAK: Notes on Transitivity and Theme in English (Part 2). Journal of Linguistics. 1967, 3: 199-244.
Grosz B, Sidner CL: Attention, intentions, and the structure of discourse. Computational Linguistics. 1986, 12 (3): 175-204.
Toepel U: Contrastive Topic and Focus Information in Discourse – Prosodic Realisation and Electrophysiological Brain Correlates. MPI Series in Human Cognitive and Brain Sciences 66;. 2006
Cutler A, Fodor JA: Semantic focus and sentence comprehension. Cognition. 1979, 7: 49-59. 10.1016/0010-0277(79)90010-6.
Cutler A, Dahan D, van Donselaar W: Prosody in the comprehension of spoken language: A literature review. Lang Speech. 1997, 40: 141-201.
Nooteboom SG, Kruyt JG: Accents, focus distribution, and the perceived distribution of given and new information: An experiment. J Acoust Soc Am. 1987, 82 (5): 1512-1524. 10.1121/1.395195.
Birch S, Clifton C: Focus, Accent, and Argument Structure: Effects on Language Comprehension. Lang Speech. 1995, 38 (4): 365-391.
Price PJ, Ostendorf M, Shattuck-Hufnagel S, Fong C: The use of prosody in syntactic disambiguation. J Acoust Soc Am. 1991, 90: 2956-2970. 10.1121/1.401770.
Schafer A, Carlson K, Clifton C, Frazier L: Focus and the interpretation of Pitch Accent: Disambiguating embedded questions. Lang Speech. 2000, 43: 75-105.
Carlson K: The effects of parallelism and prosody on the processing of gapping structures. Lang Speech. 2001, 44: 1-26.
Steinhauer K, Alter K, Friederici AD: Brain potentials indicate immediate use of prosodic cues in natural speech processing. Nat Neurosci. 1999, 2 (2): 191-196. 10.1038/5757.
Steinhauer K, Friederici AD: Prosodic boundaries, comma rules, and brain responses: The Closure Positive Shift in ERPs as a universal marker for prosodic phrasing in listeners and readers. J Psycholinguist Res. 2001, 30: 267-295. 10.1023/A:1010443001646.
Isel F, Alter K, Friederici AD: Influence of prosodic information on the processing of split particles: ERP evidence from spoken German. J Cogn Neurosci. 2005, 17 (1): 154-167. 10.1162/0898929052880075.
Pannekamp A, Toepel U, Alter K, Hahne A, Friederici AD: Prosody-driven sentence processing. J Cogn Neurosci. 2005, 17 (39): 407-421. 10.1162/0898929053279450.
Selkirk EO: Phonology and Syntax: The relation between sound and structure. 1984, Cambridge, MA: MIT Press
Hruska C, Alter K: How prosody can influence sentence perception. Information structure: Theoretical and Empirical Aspects. Edited by: Steube A. 2004, Berlin: Mouton de Gruyter, 211-226.
Hruska C, Alter K, Steinhauer K, Steube A: Misleading dialogs: Human's brain reaction to prosodic information. Orality and gestures. Interactions et comportements multimodaux dans la communication. Edited by: Cave C, Guaitella I, Santi S. 2001, Paris: L'Hartmattan, 425-430.
Bornkessel I, Schlesewsky M, Friederici AD: Contextual information modulates initial processes of syntactic integration: The role of inter- vs. intrasentential predictions. J Exp Psychol Learn Mem Cogn. 2003, 29 (5): 871-882. 10.1037/0278-7393.29.5.871.
Heim S, Alter K: Prosodic pitch accents in language comprehension and production: ERP data and acoustic analyses. Acta Neurobiol Exp (Wars). 2006, 66 (1): 55-68.
Mietz A, Toepel U, Ischebeck A, Alter K: Inadequate and infrequent are not alike: ERPs to deviant prosodic patterns in spoken sentence comprehension. Brain Lang. 2007
Ito K, Garnsey S: Brain responses to focus-related prosodic mismatches in Japanese. Proceedings of Speech Prosody. 2004, 609-612.
Magne C, Astésano C, Lacharet-Dujour A, Morel M, Alter K, Besson M: On-line Processing of "Pop-Out" Words in spoken French Dialogues. J Cogn Neurosci. 2005, 17 (5): 740-756. 10.1162/0898929053747667.
Nieuwland MS, Van Berkum JJ: When peanuts fall in love: N400 evidence for the power of discourse. J Cogn Neurosci. 2006, 18 (7): 1098-111. 10.1162/jocn.2006.18.7.1098.
Hagoort P, van Berkum JJ: Beyond the sentence given. Philos Trans R Soc Lond B Biol Sci. 2007, 362 (1481): 801-11. 10.1098/rstb.2007.2089.
Hagoort P, Hald L, Bastiaansen M, Petersson KM: Integration of word meaning and world knowledge in language comprehension. Science. 2004, 304 (5669): 438-41. 10.1126/science.1095455.
Ladd DR: Intonational Phonology. 1996, Cambridge: Cambridge University Press: Cambridge
Schafer AJ, Jun SA: Effects of contrastive focus on prosodic cues to clause boundaries. Proceedings of the 18th Annual CUNY Conference of Human Sentence Processing. 2005, Tucson, AZ
Oldfield RC: The assessment and analysis of handedness: The Edinburgh Inventory. Neuropsychologia. 1971, 9: 97-113. 10.1016/0028-3932(71)90067-4.
Jasper HH: Report of the committee on the methods of clinical examination in electroencephalography. Electroencephalogr Clin Neurophysiol. 1958, 10: 370-375. 10.1016/0013-4694(58)90053-1.
Birch S, Clifton C: Focus, Accent, and Argument Structure: Effects on Language Comprehension. Lang Speech. 1995, 38 (4): 365-391.
Grice H: Logic and conversation. Syntax and Semantics, Speech Acts. Edited by: Cole P, Morgan J. 1975, New York: Academic Press, 3: 41-58.
Twente Medical Systems International. http://www.tmsi.com