Skip to main content
Erschienen in: Journal of Nonverbal Behavior 2/2014

01.06.2014 | Original Paper

Lending a Hand to Imagery? The Impact of Visuospatial Working Memory Interference Upon Iconic Gesture Production in a Narrative Task

verfasst von: Lisa Smithson, Elena Nicoladis

Erschienen in: Journal of Nonverbal Behavior | Ausgabe 2/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Visuospatial working memory is thought to be responsible for imagery generation (Cattaneo et al. in Imagery and spatial cognition: methods, models and cognitive assessment, John Benjamins Publishing Company, Amsterdam, 2006). This memory system was manipulated by varying visual perceptual input (see Baddeley and Andrade in Theories of memory, Psychology Press, Hove, 1998) in a narrative task in order to investigate the association between iconic gesture production and visuospatial working memory interference. Participants watched two short cartoon clips and were asked to relay a narrative about what they had seen in the videos to an experimenter. Participants were randomly assigned to relay their narrative while wearing video glasses with either a simple or complex moving image (unrelated to the cartoons) projected onto the lenses. It was hypothesized that if gesture production plays a role in facilitating visuospatial working memory resource activation, then participants in the complex visual distractor condition would display a higher rate of gesture production. Participants in the complex visual distractor condition gestured significantly more than participants in the simple visual distractor condition. These results are interpreted as lending support to the argument that iconic gestures may play a functional role in activating visuospatial working memory resources during a narrative task. Since visuospatial working memory is thought to support imagery, these results also suggest that gesture production may facilitate imagery generation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
In the ‘In the Pink of the Night’ cartoon, participants in the Complex visual distractor Condition (M = 2.20, SD = 2.37) had higher iconic gesture rates than participants in the Simple visual distractor condition (M = 0.62, SD = 1.12) [t (33) = 2.487, p = 0.018]. In the ‘Jet Pink’ cartoon, participants in the complex visual distractor Condition (M = 1.94, SD = 2.59) had higher iconic gesture rates than participants in the simple visual distractor condition (M = 0.33, SD = 0.71) [t (33) = 2.486, p = 0.018].
 
Literatur
Zurück zum Zitat Alibali, M. W. (2005). Gesture in spatial cognition: Expressing, communicating, and thinking about spatial information. Spatial Cognition & Computation, 5, 307–331.CrossRef Alibali, M. W. (2005). Gesture in spatial cognition: Expressing, communicating, and thinking about spatial information. Spatial Cognition & Computation, 5, 307–331.CrossRef
Zurück zum Zitat Alibali, M. W., Heath, D. C., & Myers, H. J. (2001). Effects of visibility between speaker and listener on gesture production: Some gestures are meant to be seen. Journal of Memory and Language, 44, 169–188.CrossRef Alibali, M. W., Heath, D. C., & Myers, H. J. (2001). Effects of visibility between speaker and listener on gesture production: Some gestures are meant to be seen. Journal of Memory and Language, 44, 169–188.CrossRef
Zurück zum Zitat Alloway, T. P. (2007). Automated working memory assessment. London: Harcourt Assessment. Alloway, T. P. (2007). Automated working memory assessment. London: Harcourt Assessment.
Zurück zum Zitat Baddeley, A. (2003). Working memory: Looking back and looking forward. Nature Reviews Neuroscience, 4, 829–839.CrossRefPubMed Baddeley, A. (2003). Working memory: Looking back and looking forward. Nature Reviews Neuroscience, 4, 829–839.CrossRefPubMed
Zurück zum Zitat Baddeley, A., & Andrade, J. (1998). Working memory and consciousness: An empirical approach. In M. Conway, S. Gathercole, & C. Cornoldi (Eds.), Theories of memory (Vol. 2, pp. 1–23). Hove: Psychology Press. Baddeley, A., & Andrade, J. (1998). Working memory and consciousness: An empirical approach. In M. Conway, S. Gathercole, & C. Cornoldi (Eds.), Theories of memory (Vol. 2, pp. 1–23). Hove: Psychology Press.
Zurück zum Zitat Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577–609.PubMed Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577–609.PubMed
Zurück zum Zitat Broaders, S. C., Wagner-Cook, S., Mitchell, Z., & Goldin-Meadow, S. (2007). Making children gesture brings out implicit knowledge and leads to learning. Journal of Experimental Psychology: General, 136(4), 539–550.CrossRef Broaders, S. C., Wagner-Cook, S., Mitchell, Z., & Goldin-Meadow, S. (2007). Making children gesture brings out implicit knowledge and leads to learning. Journal of Experimental Psychology: General, 136(4), 539–550.CrossRef
Zurück zum Zitat Buccino, G., Binkofski, F., Fink, G. R., Fadiga, L., Fogassi, L., Gallese, V., et al. (2001). Action observation activates premotor and parietal areas in a somatotopic manner: An fMRI study. European Journal of Neuroscience, 13, 400–404.PubMed Buccino, G., Binkofski, F., Fink, G. R., Fadiga, L., Fogassi, L., Gallese, V., et al. (2001). Action observation activates premotor and parietal areas in a somatotopic manner: An fMRI study. European Journal of Neuroscience, 13, 400–404.PubMed
Zurück zum Zitat Buccino, G., Binkofski, F., & Riggio, L. (2004a). The mirror neuron system and action recognition. Brain and Language, 89, 370–376.CrossRefPubMed Buccino, G., Binkofski, F., & Riggio, L. (2004a). The mirror neuron system and action recognition. Brain and Language, 89, 370–376.CrossRefPubMed
Zurück zum Zitat Buccino, G., Lui, F., Canessa, N., et al. (2004b). Neural circuits involved in the recognition of actions performed by nonconspecifics: An fMRI study. Journal of Cognitive Neuroscience, 16, 114–126.CrossRefPubMed Buccino, G., Lui, F., Canessa, N., et al. (2004b). Neural circuits involved in the recognition of actions performed by nonconspecifics: An fMRI study. Journal of Cognitive Neuroscience, 16, 114–126.CrossRefPubMed
Zurück zum Zitat Cattaneo, Z., Fastame, M. C., Vecchi, T., & Cornoldi, C. (2006). Working memory, imagery and visuo-spatial mechanisms. In T. Vecchi & G. Bottini (Eds.), Imagery and spatial cognition: Methods, models and cognitive assessment (pp. 101–137). Amsterdam: John Benjamins Publishing Company.CrossRef Cattaneo, Z., Fastame, M. C., Vecchi, T., & Cornoldi, C. (2006). Working memory, imagery and visuo-spatial mechanisms. In T. Vecchi & G. Bottini (Eds.), Imagery and spatial cognition: Methods, models and cognitive assessment (pp. 101–137). Amsterdam: John Benjamins Publishing Company.CrossRef
Zurück zum Zitat Chu, M., & Kita, S. (2011). The nature of gestures’ beneficial role in spatial problem solving. Journal of Experimental Psychology: General, 140(1), 102–115.CrossRef Chu, M., & Kita, S. (2011). The nature of gestures’ beneficial role in spatial problem solving. Journal of Experimental Psychology: General, 140(1), 102–115.CrossRef
Zurück zum Zitat Colletta, J. M., Pellenq, C., & Guidetti, M. (2010). Age-related changes in co-speech gesture and narrative: Evidence from French children and adults. Speech Communication, 52, 565–576.CrossRef Colletta, J. M., Pellenq, C., & Guidetti, M. (2010). Age-related changes in co-speech gesture and narrative: Evidence from French children and adults. Speech Communication, 52, 565–576.CrossRef
Zurück zum Zitat Demir, O.E. (2009). A tale of two hands: Development of narrative structure in children’s speech and gesture and its relation to later reading skill. Dissertation, The University of Chicago. Demir, O.E. (2009). A tale of two hands: Development of narrative structure in children’s speech and gesture and its relation to later reading skill. Dissertation, The University of Chicago.
Zurück zum Zitat Demiris, Y., & Simmons, G. (2006). Perceiving the unusual: Temporal properties of hierarchical motor representations for action perception. Neural Networks: Official Journal of the International Neural Network Society, 19, 272–284.CrossRef Demiris, Y., & Simmons, G. (2006). Perceiving the unusual: Temporal properties of hierarchical motor representations for action perception. Neural Networks: Official Journal of the International Neural Network Society, 19, 272–284.CrossRef
Zurück zum Zitat Frick-Horbury, D., & Guttentag, R. E. (1998). The effects of restricting hand gesture production on lexical retrieval and free recall. American Journal of Psychology, 111(1), 43–62.CrossRef Frick-Horbury, D., & Guttentag, R. E. (1998). The effects of restricting hand gesture production on lexical retrieval and free recall. American Journal of Psychology, 111(1), 43–62.CrossRef
Zurück zum Zitat Gazzola, V., Aziz-Zadeh, L., & Keysers, C. (2006). Empathy and the somatotopic auditory mirror system in humans. Current Biology, 16, 1824–1829.CrossRefPubMed Gazzola, V., Aziz-Zadeh, L., & Keysers, C. (2006). Empathy and the somatotopic auditory mirror system in humans. Current Biology, 16, 1824–1829.CrossRefPubMed
Zurück zum Zitat Glenberg, A. M. (1997). What memory is for. Behavioral and Brain Sciences, 20, 1–55.PubMed Glenberg, A. M. (1997). What memory is for. Behavioral and Brain Sciences, 20, 1–55.PubMed
Zurück zum Zitat Glenberg, A. M. (2008). Toward the integration of bodily states, language, and action. In G. R. Semin & E. R. Smith (Eds.), Embodied grounding: Social, cognitive, affective, and neuroscientific approaches (pp. 43–70). Cambridge: Cambridge University Press.CrossRef Glenberg, A. M. (2008). Toward the integration of bodily states, language, and action. In G. R. Semin & E. R. Smith (Eds.), Embodied grounding: Social, cognitive, affective, and neuroscientific approaches (pp. 43–70). Cambridge: Cambridge University Press.CrossRef
Zurück zum Zitat Goldenberg, G., & Karnath, H. O. (2006). The neural basis of imitation is body part specific. The Journal of Neuroscience, 26, 6282–6287.CrossRefPubMed Goldenberg, G., & Karnath, H. O. (2006). The neural basis of imitation is body part specific. The Journal of Neuroscience, 26, 6282–6287.CrossRefPubMed
Zurück zum Zitat Graham, J. A., & Heywood, S. (1975). The effects of elimination of hand gestures and of verbal codability on speech performance. European Journal of Social Psychology, 5, 185–195.CrossRef Graham, J. A., & Heywood, S. (1975). The effects of elimination of hand gestures and of verbal codability on speech performance. European Journal of Social Psychology, 5, 185–195.CrossRef
Zurück zum Zitat Hadar, U., & Butterworth, B. (1997). Iconic gestures, imagery, and word retrieval in speech. Semiotica, 115, 147–172.CrossRef Hadar, U., & Butterworth, B. (1997). Iconic gestures, imagery, and word retrieval in speech. Semiotica, 115, 147–172.CrossRef
Zurück zum Zitat Hostetter, A. B., & Alibalil, M. W. (2007). Raise your hand if you’re spatial: Relations between verbal and spatial skills and gesture production. Gesture, 7(1), 73–95.CrossRef Hostetter, A. B., & Alibalil, M. W. (2007). Raise your hand if you’re spatial: Relations between verbal and spatial skills and gesture production. Gesture, 7(1), 73–95.CrossRef
Zurück zum Zitat Kosslyn, S. M. (2005). Mental images and the brain. Cognitive Neuropsychology, 22(3/4), 333–347.CrossRefPubMed Kosslyn, S. M. (2005). Mental images and the brain. Cognitive Neuropsychology, 22(3/4), 333–347.CrossRefPubMed
Zurück zum Zitat Krauss, R. M., Chen, Y., & Gottesman, R. F. (2000). Lexical gestures and lexical access: A process model. In D. McNeill (Ed.), Language and gesture (pp. 261–283). New York: Cambridge University Press.CrossRef Krauss, R. M., Chen, Y., & Gottesman, R. F. (2000). Lexical gestures and lexical access: A process model. In D. McNeill (Ed.), Language and gesture (pp. 261–283). New York: Cambridge University Press.CrossRef
Zurück zum Zitat Laeng, B., & Teodorescu, D. (2002). Eye scanpaths during visual imagery reenact those of perception of the same visual scene. Cognitive Science, 26, 207–231.CrossRef Laeng, B., & Teodorescu, D. (2002). Eye scanpaths during visual imagery reenact those of perception of the same visual scene. Cognitive Science, 26, 207–231.CrossRef
Zurück zum Zitat Logie, R. H. (1986). Visuo-spatial processing in working memory. The Quarterly Journal of Experimental Psychology, 38A, 229–247.CrossRef Logie, R. H. (1986). Visuo-spatial processing in working memory. The Quarterly Journal of Experimental Psychology, 38A, 229–247.CrossRef
Zurück zum Zitat MacWhinney, B. (2000). The CHILDES project: Tools for analyzing talk (3rd ed.). Mahwah, NJ: Lawrence Erlbaum Associates. MacWhinney, B. (2000). The CHILDES project: Tools for analyzing talk (3rd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
Zurück zum Zitat Mar, R. A. (2004). The neuropsychology of narrative: Story comprehension, story production and their interrelation. Neuropsychologia, 42, 1414–1434.CrossRefPubMed Mar, R. A. (2004). The neuropsychology of narrative: Story comprehension, story production and their interrelation. Neuropsychologia, 42, 1414–1434.CrossRefPubMed
Zurück zum Zitat McNeill, D. (1992). Hand and mind. Chicago and London: The University of Chicago Press. McNeill, D. (1992). Hand and mind. Chicago and London: The University of Chicago Press.
Zurück zum Zitat Morrel-Samuels, P., & Krauss, R. M. (1992). Word familiarity predicts temporal asynchrony of hand gestures and speech. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 615–623. Morrel-Samuels, P., & Krauss, R. M. (1992). Word familiarity predicts temporal asynchrony of hand gestures and speech. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 615–623.
Zurück zum Zitat Morsella, E., & Krauss, R. M. (2004). The role of gestures in spatial working memory and speech. The American Journal of Psychology, 117, 411–424.CrossRefPubMed Morsella, E., & Krauss, R. M. (2004). The role of gestures in spatial working memory and speech. The American Journal of Psychology, 117, 411–424.CrossRefPubMed
Zurück zum Zitat Pine, K. J., Bird, H., & Kirk, E. (2007). The effects of prohibiting gestures on children’s lexical retrieval ability. Developmental Science, 10(6), 747–754.CrossRefPubMed Pine, K. J., Bird, H., & Kirk, E. (2007). The effects of prohibiting gestures on children’s lexical retrieval ability. Developmental Science, 10(6), 747–754.CrossRefPubMed
Zurück zum Zitat Rauscher, F. H., Krauss, R. M., & Chen, Y. (1996). Gesture, speech, and lexical access: The role of lexical movements in speech production. Psychological Science, 7, 226–231.CrossRef Rauscher, F. H., Krauss, R. M., & Chen, Y. (1996). Gesture, speech, and lexical access: The role of lexical movements in speech production. Psychological Science, 7, 226–231.CrossRef
Zurück zum Zitat Rimé, B., Shiaratura, L., Hupet, M., & Ghysselinckx, A. (1984). Effects of relative immobilization on the speaker’s nonverbal behavior and on the dialogue imagery level. Motivation and Emotion, 8, 311–325.CrossRef Rimé, B., Shiaratura, L., Hupet, M., & Ghysselinckx, A. (1984). Effects of relative immobilization on the speaker’s nonverbal behavior and on the dialogue imagery level. Motivation and Emotion, 8, 311–325.CrossRef
Zurück zum Zitat Semin, G. R., & Smith, E. R. (2008). Introducing embodied grounding. In G. R. Semin & E. R. Smith (Eds.), Embodied grounding: Social, cognitive, affective, and neuroscientific approaches (pp. 43–70). Cambridge: Cambridge University Press.CrossRef Semin, G. R., & Smith, E. R. (2008). Introducing embodied grounding. In G. R. Semin & E. R. Smith (Eds.), Embodied grounding: Social, cognitive, affective, and neuroscientific approaches (pp. 43–70). Cambridge: Cambridge University Press.CrossRef
Zurück zum Zitat Stevanoni, E., & Salmon, K. (2005). Giving memory a hand: Instructing children to gesture enhances their event recall. Journal of Nonverbal Behavior, 29(4), 217–233.CrossRef Stevanoni, E., & Salmon, K. (2005). Giving memory a hand: Instructing children to gesture enhances their event recall. Journal of Nonverbal Behavior, 29(4), 217–233.CrossRef
Zurück zum Zitat Thomas, N. J. T. (1999). Are theories of imagery theories of imagination? An active perception approach to conscious mental content. Cognitive Science, 23(2), 207–245.CrossRef Thomas, N. J. T. (1999). Are theories of imagery theories of imagination? An active perception approach to conscious mental content. Cognitive Science, 23(2), 207–245.CrossRef
Zurück zum Zitat Wesp, R., Hesse, J., Keutmann, D., & Wheaton, K. (2001). Gestures maintain spatial imagery. American Journal of Psychology, 114, 591–600.CrossRefPubMed Wesp, R., Hesse, J., Keutmann, D., & Wheaton, K. (2001). Gestures maintain spatial imagery. American Journal of Psychology, 114, 591–600.CrossRefPubMed
Zurück zum Zitat Wilson, M. (2002). Theoretical and review articles: Six views of embodied cognition. Psychonomic Bulletin & Review, 9(4), 625–636.CrossRef Wilson, M. (2002). Theoretical and review articles: Six views of embodied cognition. Psychonomic Bulletin & Review, 9(4), 625–636.CrossRef
Metadaten
Titel
Lending a Hand to Imagery? The Impact of Visuospatial Working Memory Interference Upon Iconic Gesture Production in a Narrative Task
verfasst von
Lisa Smithson
Elena Nicoladis
Publikationsdatum
01.06.2014
Verlag
Springer US
Erschienen in
Journal of Nonverbal Behavior / Ausgabe 2/2014
Print ISSN: 0191-5886
Elektronische ISSN: 1573-3653
DOI
https://doi.org/10.1007/s10919-014-0176-2

Weitere Artikel der Ausgabe 2/2014

Journal of Nonverbal Behavior 2/2014 Zur Ausgabe