“Looking at” Negation: Faster Processing for Symbolic Rather Than Iconic Representations

Journal of Psycholinguistic Research - Tập 50 - Trang 1417-1436 - 2021
Isabel Orenes1
1Departamento de Psicología Básica I, Universidad Nacional de Educación a Distancia (UNED), Madrid, Spain

Tóm tắt

Many studies have shown the double processing of negation, suggesting that negation integration into sentence meaning is delayed. This contrasts with some researches that have found that such integration is rather immediate. The present study contributes to this debate. Affirmative and negative compound sentences (e.g., “because he was not hungry, he did not order a salad”) were presented orally in a visual world paradigm while four printed words were on the screen: salad, no salad, soup, and no soup. The eye-tracking data showed two different fixation patterns for negative causal assertions, which are linked to differences in the representation and inferential demands. One indicates that negation is integrated immediately, as people look at the explicit negation (e.g., no salad) very early. The other, in which people look at the alternate (e.g., soup) much later, indicates that what is delayed in time is the representation of the alternate. These results support theories that combine iconic and symbolic representations, such as the model theory.

Tài liệu tham khảo

Altmann, G. T. M., & Kamide, Y. (1999). Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 73, 247–264. Anderson, S., Huette, S., Matlock, T., & Spivey, M. (2010). On the temporal dynamics of negated perceptual simulations. In F. Parrill, V. Tobin, & M. Turner (Eds.), Meaning Form and Body (pp. 1–20). CSLI Publications. Barsalou, L. W. (2012). The Human conceptual system. In M. J. Spivey, K. Mcrae, & M. F. Joanisse (Eds.), The Cambridge Handbook of Psycholinguistics (pp. 239–258). University Press. Barton, S. B., & Sanford, A. J. (1993). A case study of anomaly detection: Shallow semantic processing and cohesion establishment. Memory and Cognition, 2, 477–487. Beltrán, D., Liu, B., & de Vega, M. (2021). Inhibitory mechanisms in the processing of negations: A neural reuse hypothesis. Journal of Psycholinguistic Research (in this special issue). Beltrán, D., Morera, Y., García-Marco, E., & de Vega, M. (2019) Brain inhibitory mechanisms are involved in the processing of sentential negation, regardless of its content. Evidence from EEG Theta and Beta Rhythms. Frontiers in Psychology 10:1782. Beltrán, D., Orenes, I., & Santamaría, C. (2008). Context effects on the spontaneous production of negation. Intercultural Pragmatics, 5(4), 409–419. Byrne, R. M. J. (2005). The rational imagination: How people create alternatives to reality. MIT Press. Byrne, R. M. J. (2016). Counterfactual thought. Annual Review of Psychology, 67, 135–157. Carpenter, P. A., & Just, M. A. (1975). Sentence comprehension: A psycholinguistic processing model of verification. Psychological Review, 82, 45–73. Clark, H. H., & Chase, W. G. (1972). On the process of comparing sentences against pictures. Cognitive Psychology, 3, 472–517. Cooper, R. M. (1974). The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology, 6, 84–107. Darley, E. J., Kent, C., & Kazanina, N. (2020). A 'no' with a trace of 'yes': A mouse-tracking study of negative sentence processing. Cognition 198, 104084. de Vega, M., Morera, Y., León, I., Beltrán, D., Casado, P., & Martín-Loeches, M. (2016). Sentential negation might share neurophysiological mechanisms with action inhibition. Evidence from frontal theta rhythm. Journal of Neuroscience, 36, 6002–6016. de Vega, M., Urrutia, M., & Riffo, B. (2007). Canceling updating in the comprehension of counterfactuals embedded in narratives. Memory & Cognition, 35, 1410–1421. Dudschig, C., & Kaup, B. (2018). How does “Not Left” become “Right”? Electrophysiological evidence for a dynamic conflict-bound negation processing account. Journal of Experimental Psychology: Human Perception and Performance, 44(5), 716–728. Dudschig, C., & Kaup, B. (2020a). Can We Prepare to Negate? Negation as a Reversal Operator. Journal of Cognition 3(1), 32, 1–11. Dudschig, C., & Kaup, B. (2020b). Negation as conflict: Conflict adaptation following negating vertical spatial words. Brain and Language 210, 104842. Duñabeitia, J. A., Avilés, A., Afonso, O., Scheepers, C., & Carreiras, M. (2009). Qualitative differences in the representation of abstract versus concrete words: Evidence from the visual-world paradigm. Cognition, 110, 284–292. Erickson, T. A., & Mattson, M. E. (1981). From words to meaning: A semantic illusion. Journal of Verbal Learning and Verbal Behavior 20, 540–552. Espino, O., & Byrne, R. M. J. (2018). Thinking about the opposite of what is said: Counterfactual conditionals and symbolic or alternate simulations of negation. Cognitive Science, 42, 2459–2501. Evans, J. S. B. T., Legrenzi, P., & Girotto, V. (1999). The influence of linguistic form on reasoning: The case of matching bias. The Quarterly Journal of Experimental Psychology, 52, 185–216. Farshchi, S., Andersson, R., van de Weijer, J., & Paradis, C. (2019). Processing negation in a miniature artificial language. Cognitive Science 43(3), e12720. Ferreira, F., Bailey, K. G. D., & Ferraro, V. (2002). Good-enough representations in language comprehension. Current Directions in Psychological Science, 11, 11–15. Fillenbaum, S. (1966). Memory for gist: Some relevant variables. Language and Speech, 9, 217–227. García-Marco, E., Morera, Y., Beltrán, D., de Vega, M., Herrera, E., Sedeño, L., Ibáñez, A., & García, A. M. (2019). Negation markers inhibit motor routines during typing of manual action verbs. Cognition, 182, 286–293. Genovese, C. R., Lazar, N. A., & Nichols, T. (2002). Thresholding of statistical maps in functional neuroimaging using the false discovery rate. NeuroImage, 15, 870–878. Giora, R. (2006). Anything negatives can do affirmatives can do just as well, except for some metaphors. Journal of Pragmatics, 38, 981–1014. Giora, R., Fein, O., Aschkenazi, K., & Alkabets-Zlozover, I. (2007). Negation in context: A functional approach to suppression. Discourse Processes, 43(2), 153–172. Giora, R., Heruti, V., Metuki, N., & Fein, O. (2009). “When we say no we mean no” Interpreting negation in vision and language. Journal of Pragmatics, 41, 2222–2239. Glenberg, A. M., Robertson, D. A., Jansen, J. L., & Johnson-Glenberg, M. C. (1999). Not propositions. Journal of Cognitive Systems Research, 1, 19–33. Greco, M. (2020). On the syntax of surprise negation sentences: A case study on expletive negation. Natural Language & Linguistic Theory, 38, 775–825. Hasson, U., & Glucksberg, S. (2006). Does understanding negation entail affirmation? An examination of negated metaphors. Journal of Pragmatics, 38, 1015–1032. Huette, S., & Anderson, S. (2012). Negation without symbols: The importance of recurrence and context in linguistic negation. Journal of Integrative Neuroscience, 11, 295–312. Huettig, F., & Altmann, G. T. (2011). ‘Looking at anything that is green when hearing “frog”: How object surface colour and stored object colour knowledge influence language-mediated overt attention. The Quarterly Journal of Experimental Psychology, I, 1–24. Huettig, F., & McQueen, J. M. (2011). The nature of the visual environment induces implicit biases during language-mediated visual search. Memory and Cognition, 39, 1068–1084. Huettig, F., Rommers, J., & Meyer, A. S. (2011). Using the visual world paradigm to study language processing: A review and critical evaluation. Acta Psychologica, 137, 151–171. Ito, A. (2019). Prediction of orthographic information during listening comprehension: A printed-word visual world study. The Quarterly Journal of Experimental Psychology, 72(11), 2584–2596. Johnson-Laird, P. N. (1983). Mental models: Towards a cognitive science of language, inference, and consciousness. Harvard University Press. Johnson-Laird, P. N. (2006). How we reason. Oxford University Press. Johnson-Laird, P. N., & Tridgell, J. M. (1972). When negation is easier than affirmation. The Quarterly Journal of Experimental Psychology, 24(1), 87–91. Just, M. A., & Carpenter, P. A. (1976). Eye fixations and cognitive processes. Cognitive Psychology, 8, 441–480. Kaup, B. (2001). Negation and its impact on the accessibility of text information. Memory & Cognition, 20, 960–967. Kaup, B., & Dudschig, C. (2020). Understanding negation: Issues in the processing of negation. In V. Deprez & T. Espinal (Eds.), The Oxford Handbook of Negation (pp. 635–655). Oxford University Press. Kaup, B., Lüdtke, J., & Zwaan, R. A. (2006). Processing negated sentences with contradictory predicates: Is a door that is not open mentally closed? Journal of Pragmatics, 38, 1033–1050. Kaup, B., & Zwaan, R. A. (2003). Effects of negation and situational presence on the accessibility of text information. Journal of Experimental Psychology: Learning, Memory and Cognition, 29, 439–446. Khemlani, S., Orenes, I., & Johnson-Laird, P. N. (2012). Negation: A Theory of its meaning, representation, and use. Journal of Cognitive Psychology, 24, 541–559. Khemlani, S., Orenes, I., & Johnson-Laird, P. N. (2014). The negations of conjunctions, conditionals, and disjunctions. Acta Psychologica, 151, 1–7. Knauff, M., & Johnson-Laird, P. N. (2002). Imagery can impede inference. Memory & Cognition, 30, 363–371. Lea, R. B., & Mulligan, E. J. (2002). The effect of negation on deductive inferences. Journal of Experimental Psychology: Learning, Memory, and Cognition, 28(2), 303–317. Liu, B., Wang, H., Beltrán, D., Gu, B., Liang, T., Wang, X., & de Vega, M. (2020a). The generalizability of inhibition-related processes in the comprehension of linguistic negation. ERP evidence from the Mandarin language. Language, Cognition and Neuroscience 35(7), 885–895. Liu, B., Gu, B., Beltrán, D., Wang, H., & de Vega, M. (2020b). Presetting an inhibitory state modifies the neural processing of negated action sentences. An ERP study. Brain and Cognition 143 105598. MacDonald, M. C., & Just, M. A. (1989). Changes in activation levels with negation. Journal of Experimental Psychology: Learning, Memory and Cognition, 15(4), 633–642. Martin, E., Shao, K. C., & Boff, K. R. (1993). Saccadic over-head: Information-processing time with and without saccades. Perception & Psychophysics 53, 372–380. Mayo, R., Schul, Y., & Rosenthal, M. (2014). If you negate, you may forget: Negated repetitions impair memory compared with affirmative repetitions. Journal of Experimental Psychology: General, 143(4), 1541–1552. Meteyard, L., Rodriguez Cuadrado, S., Bahrami, B., & Vigliocco, G. (2012). Coming of age: A review of embodiment and the neuroscience of semantics. Cortex, 48, 788–804. McQueen, J. M., & Viebahn, M. C. (2007). Tracking recognition of spoken words by tracking looks to printed words. The Quarterly Journal of Experimental Psychology, 60, 661–671. Miller, G. A. (1962). Some psychological studies of grammar. American Psychologist, 17, 748–762. Mirman, D. (2014). Growth Curve Analysis and Visualization Using R. Chapman and Hall. Morey, R. D. (2008). Confidence intervals from normalized data: A correction to cousineau (2005). Tutorials in Quantitative Methods for Psycholog 4, 61–64. Nieuwland M. S. (2016). Quantification, prediction, and the online impact of sentence truth-value: Evidence from event-related potentials. Journal of Experimental Psychology. Learning, Memory, and Cognition 42(2), 316–334. Nieuwland, M. S., & Kuperberg, G. R. (2008). When the truth is not too hard to handle: An event-related potential study on the pragmatics of negation. Psychological Science, 19(12), 1213–1218. O’Brien, F., & Cousineau, D. (2014). Representing error bars in within-subject designs in typical software packages. Tutorials in Quantitative Methods for Psychology 10, 56–67. Orenes, I., Beltrán, D., & Santamaría, C. (2014). How negation is understood: Evidence from the visual world paradigm. Journal of Memory and Language, 74, 36–45. Orenes, I., Espino, O., & Byrne, R. M. J. (2021). Similarities and differences in understanding negative and affirmative counterfactuals and causal assertions: Evidence from eye-tracking. Quarterly Journal of Experimental Psychology. Orenes, I., García-Madruga, J. A., Gómez-Veiga, I., Espino, O., & Byrne, R. M. J. (2019). The Comprehension of Counterfactual Conditionals: Evidence from Eye-Tracking in the Visual World Paradigm. Frontiers in Psychology, 10, 1172. Orenes, I., Moxey, L., Scheepers, C., & Santamaría, C. (2015). Negation in context evidence from the visual world paradigm. The Quarterly Journal of Experimental Psychology, 69, 1082–1092. Orenes, I., & Santamaría, C. (2014). Visual content of words delays negation. Acta Psychologica, 153, 107–112. Peirce, C. S. (1931–1958). Collected papers of Charles Sanders Peirce. (8 Vols.; C. Hartshorne, P. Weiss, & A. Burks, Eds.). Cambridge, MA.: Harvard University Press. Primativo, S., Sebastian, J. R., & Crutch, J. (2016). Conceptual Feature ratings predict gaze within written word arrays: Evidence from a visual Wor(l)d paradigm. Cognitive Science, 41, 659–685. Russell, B. A. W. (1948). Human Knowledge: Its Scope and Limits. George Allen & Unwin. Salverda, A. P., & Tanenhaus, M. K. (2010). Tracking the time course of orthographic information in spoken-word recognition. Journal of Experimental Psychology. Learning, Memory, and Cognition, 36, 1108–1117. Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268, 1632–1634. Thompson, V., & Byrne, R. M. J. (2002). Reasoning counterfactually: Making inferences about things that didn’t happen Journal of Experimental Psychology: Learning, Memory, and Cognition 28, 1154–1170. Tian, Y., & Breheny, R. (2018). Pragmatics and negative sentence processing. In N. Katsos & C. Cummins (Eds.), Handbook of Experimental Pragmatics. Oxford University Press. Tian, Y., Breheny, R., & Ferguson, H. J. (2010). Why we stimulate negated information: A dynamic pragmatic account. Quarterly Journal of Experimental Psychology, 63, 2305–2312. Trabasso, T., Rollins, H., & Shaughnessy, E. (1971). Storage and verification stages in processing concepts. Cognitive Psychology, 2, 239–289. Wason, P. C., & Johnson-Laird, P. N. (1972). Psychology of reasoning: Structure and content. Harvard University Press. Wason, P. C., & Jones, S. (1963). Negatives: Denotation and connation. British Journal of Psychology, 54, 299–307. Wason, P. C. (1965). The contexts of plausible denial. Journal of Verbal Learning and Verbal Behavior, 4, 7–11. Xiang, M., Kramer, A., & Nordmeyer, A. (2020). An informativity-based account of negation complexity. Journal of Experimental Psycholy: Learning, Memory, and Cognition, 46(10), 1857–1867. Zwaan, R. A., & Radvansky, G. A. (1998). Situation models in language comprehension and memory. Psychological Bulletin, 123(2), 162–185.