From hands to minds: Gestures promote understanding

Seok-Min Kang1, Barbara Tversky2
1Wisconsin Center for Education Research, University of Wisconsin–Madison, Educational Sciences Building, 1025 West Johnson Street, Madison, WI, 53706, USA
2Department of Psychology, Stanford University, Stanford, CA, USA

Tóm tắt

Từ khóa


Tài liệu tham khảo

Alibali, M. W., & DiRusso, A. A. (1999). The function of gesture in learning to count: more than keeping track. Cognitive Development, 14, 37–56.

Alibali, M. W., Spencer, R., Knox, L., & Kita, S. (2011). Spontaneous gestures influence strategy choices in problem solving. Psychological Science, 22, 1138–1144.

Alibali, M., Bassok, M., Solomon, K., Syc, S., & Goldin-Meadow, S. (1999). Illuminating mental representations through speech and gesture. Psychological Science, 10, 327–333.

Atit, K., Gagnier, K., & Shipley, T. F. (2014). Student gestures aid penetrative thinking. Journal of Geoscience Education, 63, 66–72.

Bavelas, J. B. (1994). Gestures as part of speech: Methodological implications. Research on Language and Social Interaction, 27, 201–221.

Beattie, G., & Shovelton, H. (1999). Do iconic hand gestures really contribute anything to the semantic information conveyed by speech? An experimental investigation. Semiotica, 123, 1–30.

Beilock, S. L., & Goldin-Meadow, S. (2010). Gesture changes thought by grounding it in action. Psychological Science, 21, 1605–1611.

Call, J., & Tomasello, M. (2007). The gestural communication of apes and monkeys. New York, NY: Taylor & Francis Group/Lawrence Erlbaum Associates.

Card, S. K., Mackinlay, J. D., & Shneiderman, B. (1999). Readings in information visualization: Using vision to think. San Francisco: Morgan Kaufman.

Carlson, R. A., Avraamides, M. N., Cary, M., & Strasberg, S. (2007). What do the hands externalize in simple arithmetic? Journal of Experimental Psychology: Learning, Memory, and Cognition, 33, 747–756.

Cartmill, E. A., Beilock, S. L., & Goldin-Meadow, S. (2012). A word in the hand: Human gesture links representations to actions. Philosophical Transactions of the Royal Society B, 367, 129–143.

Chu, M., & Kita, S. (2011). The nature of gestures’ beneficial role in spatial problem solving. Journal of Experimental Psychology, 140, 102–116.

Church, R. B., Ayman-Nolley, S., & Mahootian, S. (2004). The role of gesture in bilingual education: Does gesture enhance learning? Bilingual Education and Bilingualism, 7, 303–319.

Church, R. B., & Goldin-Meadow, S. (1986). The mismatch between gesture and speech as an index of transitional knowledge. Cognition, 23, 43–71.

Clark, H. H. (1996). Using language. Cambridge, England: Cambridge University Press.

Cook, S. W., Duffy, R. G., & Fenn, K. M. (2013). Consolidation and transfer of learning after observing hand gesture. Child Development, 84, 1863–1871.

Cook, S. W., & Goldin-Meadow, S. (2006). The role of gesture in learning: Do children use their hands to change their minds? Journal of Cognition and Development, 7, 211–232.

Daniel, M.-P., & Tversky, B. (2012). How to put things together. Cognitive Processing., 13(4), 303–319. doi: 10.1007/s10339-012-0521-5

Decety, J., Grezes, J., Costes, N., Perani, D., Jeannerod, M., Procyk, E., Grassi, F., & Fazio, F. (1997). Brain activity during observation of actions. Influence of action content and subject’s strategy. Brain, 120, 1763–1777.

Denis, M. (1997). The description of routes: A cognitive approach to the production of spatial discourse. Current Psychology of Cognition, 16, 409–458.

Ehrlich, S., Levine, S. C., & Goldin-Meadow, S. (2006). The importance of gesture in children’s spatial reasoning. Developmental Psychology, 42, 1259–1268.

Emmorey, K., Tversky, B., & Taylor, H. (2000). Using space to describe space: Perspective in speech, sign, and gesture. Journal of Spatial Cognition and Computation, 2, 157–180.

Enfield, N. J. (2003). Producing and editing diagrams using co-speech gesture: Spatializing non-spatial relations in explanations of kinship in Laos. Journal of Linguistic Anthropology, 13, 7–50.

Engle, R. A. (1998). Not channels but composite signals: Speech, gesture, diagrams, and object demonstrations are integrated in multimodal explanations. In M. A. Gernsbacher & S. J. Derry (Eds.), Proceedings of the 20th Annual Conference of the Cognitive Science Society (pp. 321–326). Mahwah, NJ: Erlbaum.

Fadiga, L., & Craighero, L. (2006). Hand actions and speech representation in Broca’s Area. Cortex, 42, 486–490. doi: 10.1016/S0010-9452(08)70383-6

Fadiga, L., Craighero, L., Fabbri Destro, M., Finos, L., Cotilon-Williams, N., Smith, A. T., & Castiello, U. (2006). Language in shadow. Social Neuroscience, 1, 77–89. doi: 10.1080/17470910600976430

Field, J. (2005). Intelligibility and the listener: The role of lexical stress. TESOL Quarterly, 39, 399–423.

Garber, P., Alibali, M. W., & Goldin-Meadow, S. (1998). Knowledge conveyed in gesture is not tied to the hands. Child Development, 69, 75–84.

Goldin-Meadow, S. (2003). Hearing gesture: How our hands help us think. Cambridge, MA: Harvard University Press.

Goldin-Meadow, S., & Alibali, M. W. (1999). Does the hand reflect implicit knowledge? Yes and no. Behavioral and Brain Sciences, 22, 766–767.

Goldin-Meadow, S., & Beilock, S. L. (2010). Action’s influence on thought: The case of gesture. Perspectives on Psychological Science, 5, 664–674.

Goldin-Meadow, S., Kim, S., & Singer, M. (1999). What the teacher’s hands tell the student’s mind about math. Journal of Educational Psychology, 91, 720–730.

Goldin-Meadow, S., Nusbaum, H., Kelly, S., & Wagner, S. (2001). Explaining math: Gesturing lightens the load. Psychological Science, 12, 516–522.

Gukson, T., Goldin-Meadow, S., Newcombe, N., & Shipley, T. (2013). Individual differences in mental rotation: What does gesture tell us? Cognitive Processing, 14, 153–162.

Hegarty, M. (2011). The cognitive science of visual-spatial displays: Implications for design. Topics in Cognitive Science, 3, 446–474. doi: 10.1111/j.1756-8765.2011.01150.x

Heiser, J., Tversky, B., & Silverman, M. (2004). Sketches for and from collaboration. In J. S. Gero, B. Tversky, & T. Knight (Eds.), Visual and spatial reasoning in design III (pp. 69–78). Sydney: Key Centre for Design Research.

Heiser, J., & Tversky, B. (2006). Arrows in comprehending and producing mechanical diagrams. Cognitive Science, 30, 581–592.

Hmelo-Silver, C. E., & Pfeffer, M. G. (2004). Comparing expert and novice understanding of a complex system from the perspective of structures, behaviors, and functions. Cognitive Science, 1, 127–138.

Holler, J., & Wilkin, K. (2011). Co-Speech gesture mimicry in the process of collaborative referring during face-to-face dialogue. Journal of Nonverbal Behavior, 35, 133–153.

Holler, J., & Beattie, G. (2003). How iconic gestures and speech interact in the representation of meaning: are both aspects really integral to the process? Semiotica, 146, 81–116.

Hostetter, A. B., & Alibali, M. (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15, 459–514.

Iacoboni, M., Woods, R. P., Brass, M., Bekkering, H., Mazziotta, J. C., & Rizzolatti, G. (1999). Cortical mechanisms of human imitation. Science, 286, 2526–2528.

Iverson, J. M., & Goldin-Meadow, S. (2005). Gesture paves the way for language development. Psychological Science, 16, 367–371. doi: 10.1111/j.0956-7976.2005.01542

Jamalian, A., Giardino, V., & Tversky, B. (2013). Gestures for thinking. In M. Knauff, M. Pauen, N. Sabaenz, & I. Wachsmuth (Eds.), Proceedings of the 35th Annual Conference of the Cognitive Science Society. Austin, TX: Cognitive Science Society.

Jamalian, A., & Tversky, B. (2012). Gestures alter thinking about time. In N. Miyake, D. Peebles, & R. P. Cooper (Eds.), Proceedings of the 34th Annual Conference of the Cognitive Science Society (pp. 551–557). Austin TX: Cognitive Science Society.

Kang, S., Tversky, B., & Black, J. B. (2014). Gesture and speech in explanations to experts and novices. Spatial Cognition and Computation, 15, 1–26. doi: 10.1080/13875868.2014.958837

Kirsh, D. (2013). Embodied cognition and the magical future of interaction design. ACM Transactions on Computer-Human Interaction, 20(1), 30. doi: 10.1145/2442106.2442109

Kita, S., & Özyürek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Cognition, 48, 16–32.

Krauss, R. M. (1998). Why do we gesture when we speak? Current Directions in Psychological Science, 7, 54–60.

Larkin, J. H., & Simon, H. A. (1987). Why a diagram is (sometimes) worth ten thousand words. Cognitive Science, 11, 65–100. doi: 10.1111/j.1551-6708.1987.tb00863.x

Mayer, R. (2005). The Cambridge handbook of multimedia learning. Cambridge: Cambridge.

McGregor, K. K., Rohlfing, K. J., Bean, A., & Marschner, E. (2009). Gesture as support for word learning: The case of under. Journal of Child Language, 36, 807–828.

McNeill, D. (1992). Hand and mind. Chicago: University of Chicago Press.

Mol, L., Krahmer, E., Maes, A., & Swerts, M. (2012). Adaptation in gesture: Converging hands or converging minds? Journal of Memory and Language, 66, 240–264.

Molenberghs, P., Cunnington, R., & Mattingly, J. B. (2012). Brain regions with mirror properties: A meta-analysis of 124 human fMRI studies. Neuroscience and Biobehavioral Reviews, 36, 341–349.

Netz, R. (1999). Linguistic formulae as cognitive tools. Pragmatics and Cognition, 7, 147–176.

Ping, R., & Goldin-Meadow, S. (2008). Hands in the air: Using ungrounded iconic gestures to teach children conservation of quantity. Developmental Psychology, 44, 1277–1287.

Richland, L. E., & McDonough, I. M. (2010). Learning by analogy: Discriminating between potential analogs. Contemporary Educational Psychology, 35, 28–43.

Rizzolatti, G., & Arbib, M. A. (1998). Language within our grasp. Trends in Neurosciences, 21, 188–194.

Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169–192.

Rizzolatti, G., Fogasse, L., & Gallese, V. (2001). Neurophysiological mechanisms underlying the understanding and imitation of action. Nature Reviews: Neuroscience, 2, 661–670. doi: 10.1038/35090060

Schon, D. A. (1983). The reflective practitioner. NY: Harper Collins.

Schwartz, D. L., & Black, J. B. (1996). Shuttling between depictive models and abstract rules. Cognitive Science, 20, 457–497.

Segal, A., Tversky, B., & Black, J. B. (2014). Conceptually congruent actions can promote thought. Journal of Research in Memory and Applied Cognition. dx.doi.org/ 10.1016/j.jarmac.2014.06.004

Singer, M. A., & Goldin-Meadow, S. (2005). Children learn when their teachers’ gestures and speech differ. Psychological Science, 16, 85–89.

Talmy, L. (1983). How language structures space. In H. L. Pick Jr. & L. P. Acredolo (Eds.), Spatial orientation: Theory, research and application (pp. 225–282). NY: Plenum.

Talmy, L. (1988). Force dynamics in language and cognition. Cognitive Science, 12, 49–100.

Talmy, L. (2000). Toward a cognitive semantics (Vol. 1 & 2). Cambridge, MA: MIT Press.

Taylor, H. A., & Tversky, B. (1992). Spatial mental models derived from survey and route descriptions. Journal of Memory and Language, 31, 261–282.

Thompson, L. A., Driscoll, D., & Markson, L. (1998). Memory for visual-spoken language in children and adults. Journal of Nonverbal Behavior, 22, 167–187.

Tufte, E. R. (1983). The visual display of quantitative information. Cheshire, CT: Graphics Press.

Tversky, B. (2015). The cognitive design of tools of thought. Review of Philosophy and Psychology. Special issue on pictorial and diagrammatic representation, 6, 99–116. doi: 10.1007/s13164-014-0214-3

Tversky, B., Heiser, J., & Morrison, J. (2013). Space, time, and story. In B. H. Ross (Ed.), The psychology of learning and motivation (pp. 47–76). Oxford: Elsevier.

Tversky, B. (2001). Spatial schemas in depictions. In M. Gattis (Ed.), Spatial schemas and abstract thought (pp. 79–111). Cambridge: MIT Press.

Tversky, B. (2011). Visualizations of thought. Topics in Cognitive Science, 3, 499–535.

Tversky, B., Heiser, J., Lee, P., & Daniel, M. P. (2009). Explanations in gesture, diagram, and word. In K. R. Coventry, T. Tenbrink, & J. Bateman (Eds.), Spatial language and dialogue. Oxford: Oxford University Press.

Tversky, B., Heiser, J., MacKenzie, R., Lozano, S., & Morrison, J. B. (2007). Enriching animations. In R. Lowe & W. Schnotz (Eds.), Learning with animation: Research implications for design (pp. 263–285). NY: Cambridge University Press.

Tversky, B., & Lee, P. U. (1998). How space structures language. In C. Freksa, C. Habel, & K. F. Wender (Eds.), Spatial cognition: An interdisciplinary approach to representation and processing of spatial knowledge (pp. 157–175). Berlin: Springer-Verlag.

Tversky, B., Morrison, J. B., & Betrancourt, M. (2002). Animation: Can it facilitate? International Journal of Human Computer Studies, 57, 247–262.

Tversky, B., Zacks, J. M., & Hard, B. M. (2008). The structure of experience. In T. Shipley & J. M. Zacks (Eds.), Understanding events (pp. 436–464). Oxford: Oxford University Press.

Tversky, B., & Kessell, A. M. (2014). Thinking in action. Special issue on Diagrammatic Reasoning. Pragmatics and Cognition, 22, 206–223. doi: 10.175/pc22.2.03tve

Utihol, S., van Rooij, I., Bekkering, H., & Haselager, P. (2011). Understanding motor resonance. Social Neuroscience, 6, 388–97.

Valenzeno, L., Alibali, M. W., & Klatzky, R. (2003). Teachers’ gestures facilitate students’ learning: A lesson in symmetry. Contemporary Educational Psychology, 28, 187–204.

van Heuven, V. J. (1988). Effects of stress and accent on the human recognition of word fragments in spoken context: gating and shadowing. In W. A. Ainsworth & J. N. Holmes (Eds.), Proceedings of the 7th FASE/Speech-88 Symposium (pp. 811–818). Edinburgh: Institute of Acoustics.