Skip to main content
Erschienen in: Cognitive Neurodynamics 2/2020

05.12.2019 | Research Article

A spiking neural network model of spatial and visual mental imagery

verfasst von: Sean N. Riley, Jim Davies

Erschienen in: Cognitive Neurodynamics | Ausgabe 2/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Mental imagery has long been of interest to the cognitive and neurosciences, but how it manifests itself in the mind and brain still remains unresolved. In pursuit of this, we built a spiking neural model that can perform mental rotation and mental map scanning using strategies informed by the psychology and neuroscience literature. Results: When performing mental map scanning, reaction times (RTs) for our model closely match behavioural studies (approx. 50 ms/cm), and replicate the cognitive penetrability of the task. When performing mental rotation, our model’s RTs once again closely match behavioural studies (model: 55–65°/s; studies: 60°/s), and performed the task using the same task strategy (whole unit rotation of simple and familiar objects through intermediary points). Overall, our model suggests: (1) vector-based approaches to neuro-cognitive modelling are well equipped to re-produce behavioural findings, and (2) the cognitive (in)penetrability of imagery tasks may depend on whether or not the task makes use of (non)symbolic processing.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Anderson JR (1996) Act: a simple theory of complex cognition. Am Psychol 51(4):355CrossRef Anderson JR (1996) Act: a simple theory of complex cognition. Am Psychol 51(4):355CrossRef
Zurück zum Zitat Bekolay T, Bergstra J, Hunsberger E, DeWolf T, Stewart TC, Rasmussen D, Choo X, Voelker A, Eliasmith C (2014) Nengo: a python tool for building large-scale functional brain models. Front Neuroinform 7:48CrossRefPubMedPubMedCentral Bekolay T, Bergstra J, Hunsberger E, DeWolf T, Stewart TC, Rasmussen D, Choo X, Voelker A, Eliasmith C (2014) Nengo: a python tool for building large-scale functional brain models. Front Neuroinform 7:48CrossRefPubMedPubMedCentral
Zurück zum Zitat Bethell-Fox CE, Shepard RN (1988) Mental rotation: effects of stimulus complexity and familiarity. J Exp Psychol Hum Percept Perform 14(1):12CrossRef Bethell-Fox CE, Shepard RN (1988) Mental rotation: effects of stimulus complexity and familiarity. J Exp Psychol Hum Percept Perform 14(1):12CrossRef
Zurück zum Zitat Borst G, Kievit RA, Thompson WL, Kosslyn SM (2011) Mental rotation is not easily cognitively penetrable. J Cognit Psychol 23(1):60–75CrossRef Borst G, Kievit RA, Thompson WL, Kosslyn SM (2011) Mental rotation is not easily cognitively penetrable. J Cognit Psychol 23(1):60–75CrossRef
Zurück zum Zitat Borst JP, Nijboer M, Taatgen N, Anderson JR (2013) A data-driven mapping of five act-r modules on the brain. In: Proceedings of the international conference on cognitive modeling (ICCM), vol 5, p 10 Borst JP, Nijboer M, Taatgen N, Anderson JR (2013) A data-driven mapping of five act-r modules on the brain. In: Proceedings of the international conference on cognitive modeling (ICCM), vol 5, p 10
Zurück zum Zitat Burgess N (2002) The hippocampus, space, and viewpoints in episodic memory. Q J Exp Psychol Sect A 55(4):1057–1080CrossRef Burgess N (2002) The hippocampus, space, and viewpoints in episodic memory. Q J Exp Psychol Sect A 55(4):1057–1080CrossRef
Zurück zum Zitat Cohen MS, Kosslyn SM, Breiter HC, DiGirolamo GJ, Thompson WL, Anderson A, Bookheimer S, Rosen BR, Belliveau J (1996) Changes in cortical activity during mental rotation a mapping study using functional mri. Brain 119(1):89–100CrossRefPubMed Cohen MS, Kosslyn SM, Breiter HC, DiGirolamo GJ, Thompson WL, Anderson A, Bookheimer S, Rosen BR, Belliveau J (1996) Changes in cortical activity during mental rotation a mapping study using functional mri. Brain 119(1):89–100CrossRefPubMed
Zurück zum Zitat Cooper LA (1976) Demonstration of a mental analog of an external rotation. Percept Psychophys 19(4):296–302CrossRef Cooper LA (1976) Demonstration of a mental analog of an external rotation. Percept Psychophys 19(4):296–302CrossRef
Zurück zum Zitat Denis M, Cocude M (1997) On the metric properties of visual images generated from verbal descriptions: evidence for the robustness of the mental scanning effect. Eur J Cognit Psychol 9(4):353–380CrossRef Denis M, Cocude M (1997) On the metric properties of visual images generated from verbal descriptions: evidence for the robustness of the mental scanning effect. Eur J Cognit Psychol 9(4):353–380CrossRef
Zurück zum Zitat Denis M, Gonc MR, Memmi D et al (1995) Mental scanning of visual images generated from verbal descriptions: towards a model of image accuracy. Neuropsychologia 33(11):1511–1530CrossRefPubMed Denis M, Gonc MR, Memmi D et al (1995) Mental scanning of visual images generated from verbal descriptions: towards a model of image accuracy. Neuropsychologia 33(11):1511–1530CrossRefPubMed
Zurück zum Zitat Eliasmith C (2013) How to build a brain: a neural architecture for biological cognition. Oxford University Press, OxfordCrossRef Eliasmith C (2013) How to build a brain: a neural architecture for biological cognition. Oxford University Press, OxfordCrossRef
Zurück zum Zitat Eliasmith C, Trujillo O (2014) The use and abuse of large-scale brain models. Curr Opin Neurobiol 25:1–6CrossRefPubMed Eliasmith C, Trujillo O (2014) The use and abuse of large-scale brain models. Curr Opin Neurobiol 25:1–6CrossRefPubMed
Zurück zum Zitat Eliasmith C, Stewart TC, Choo X, Bekolay T, DeWolf T, Tang Y, Rasmussen D (2012) A large-scale model of the functioning brain. Science 338(6111):1202–1205CrossRefPubMed Eliasmith C, Stewart TC, Choo X, Bekolay T, DeWolf T, Tang Y, Rasmussen D (2012) A large-scale model of the functioning brain. Science 338(6111):1202–1205CrossRefPubMed
Zurück zum Zitat Eliasmith C, Gosmann J, Choo X (2016) Biospaun: a large-scale behaving brain model with complex neurons. arXiv preprint arXiv:160205220 Eliasmith C, Gosmann J, Choo X (2016) Biospaun: a large-scale behaving brain model with complex neurons. arXiv preprint arXiv:​160205220
Zurück zum Zitat Farah MJ, Hammond KM, Levine DN, Calvanio R (1988) Visual and spatial mental imagery: Dissociable systems of representation. Cogn Psychol 20(4):439–462CrossRefPubMed Farah MJ, Hammond KM, Levine DN, Calvanio R (1988) Visual and spatial mental imagery: Dissociable systems of representation. Cogn Psychol 20(4):439–462CrossRefPubMed
Zurück zum Zitat Hegarty M, Waller D (2004) A dissociation between mental rotation and perspective-taking spatial abilities. Intelligence 32(2):175–191CrossRef Hegarty M, Waller D (2004) A dissociation between mental rotation and perspective-taking spatial abilities. Intelligence 32(2):175–191CrossRef
Zurück zum Zitat Hölscher C, Tenbrink T, Wiener JM (2011) Would you follow your own route description? Cognitive strategies in urban route planning. Cognition 121(2):228–247CrossRefPubMed Hölscher C, Tenbrink T, Wiener JM (2011) Would you follow your own route description? Cognitive strategies in urban route planning. Cognition 121(2):228–247CrossRefPubMed
Zurück zum Zitat Hummel JE, Holyoak KJ (2003) Relational reasoning in a neurally-plausible cognitive architecture: an overview of the lisa project. Cognit Stud 10(1):58–75 Hummel JE, Holyoak KJ (2003) Relational reasoning in a neurally-plausible cognitive architecture: an overview of the lisa project. Cognit Stud 10(1):58–75
Zurück zum Zitat Hummel JE, Holyoak KJ (2005) Relational reasoning in a neurally plausible cognitive architecture: an overview of the lisa project. Curr Dir Psychol Sci 14(3):153–157CrossRef Hummel JE, Holyoak KJ (2005) Relational reasoning in a neurally plausible cognitive architecture: an overview of the lisa project. Curr Dir Psychol Sci 14(3):153–157CrossRef
Zurück zum Zitat Isomura Y, Harukuni R, Takekawa T, Aizawa H, Fukai T (2009) Microcircuitry coordination of cortical motor information in self-initiation of voluntary movements. Nat Neurosci 12(12):1586CrossRefPubMed Isomura Y, Harukuni R, Takekawa T, Aizawa H, Fukai T (2009) Microcircuitry coordination of cortical motor information in self-initiation of voluntary movements. Nat Neurosci 12(12):1586CrossRefPubMed
Zurück zum Zitat Jolicoeur P (1990) Identification of disoriented objects: a dual-systems theory. Mind Lang 5(4):387–410CrossRef Jolicoeur P (1990) Identification of disoriented objects: a dual-systems theory. Mind Lang 5(4):387–410CrossRef
Zurück zum Zitat Just MA, Carpenter PA (1985) Cognitive coordinate systems: accounts of mental rotation and individual differences in spatial ability. Psychol Rev 92(2):137CrossRefPubMed Just MA, Carpenter PA (1985) Cognitive coordinate systems: accounts of mental rotation and individual differences in spatial ability. Psychol Rev 92(2):137CrossRefPubMed
Zurück zum Zitat Kajić I, Gosmann J, Stewart TC, Wennekers T, Eliasmith C (2017) A spiking neuron model of word associations for the remote associates test. Front psychol 8:99CrossRefPubMedPubMedCentral Kajić I, Gosmann J, Stewart TC, Wennekers T, Eliasmith C (2017) A spiking neuron model of word associations for the remote associates test. Front psychol 8:99CrossRefPubMedPubMedCentral
Zurück zum Zitat Kemps E (1999) Effects of complexity on visuo-spatial working memory. Eur J Cognit Psychol 11(3):335–356CrossRef Kemps E (1999) Effects of complexity on visuo-spatial working memory. Eur J Cognit Psychol 11(3):335–356CrossRef
Zurück zum Zitat Kemps E (2001) Complexity effects in visuo-spatial working memory: implications for the role of long-term memory. Memory 9(1):13–27CrossRefPubMed Kemps E (2001) Complexity effects in visuo-spatial working memory: implications for the role of long-term memory. Memory 9(1):13–27CrossRefPubMed
Zurück zum Zitat Komer B, Stewart TC, Voelker AR, Eliasmith C (2019) A neural representation of continuous space using fractional binding. In: 41st annual meeting of the Cognitive Science Society, Cognitive Science Society, Montreal, QC, pp 2038–2044 Komer B, Stewart TC, Voelker AR, Eliasmith C (2019) A neural representation of continuous space using fractional binding. In: 41st annual meeting of the Cognitive Science Society, Cognitive Science Society, Montreal, QC, pp 2038–2044
Zurück zum Zitat Kosslyn SM (1987) Seeing and imagining in the cerebral hemispheres: a computational approach. Psychol Rev 94(2):148CrossRefPubMed Kosslyn SM (1987) Seeing and imagining in the cerebral hemispheres: a computational approach. Psychol Rev 94(2):148CrossRefPubMed
Zurück zum Zitat Kosslyn SM, Ball TM, Reiser BJ (1978) Visual images preserve metric spatial information: evidence from studies of image scanning. J Exp Psychol Hum Percept Perform 4(1):47CrossRefPubMed Kosslyn SM, Ball TM, Reiser BJ (1978) Visual images preserve metric spatial information: evidence from studies of image scanning. J Exp Psychol Hum Percept Perform 4(1):47CrossRefPubMed
Zurück zum Zitat Kosslyn SM, Koenig O, Barrett A, Cave CB, Tang J, Gabrieli JD (1989) Evidence for two types of spatial representations: hemispheric specialization for categorical and coordinate relations. J Exp Psychol Hum Percept Perform 15(4):723CrossRefPubMed Kosslyn SM, Koenig O, Barrett A, Cave CB, Tang J, Gabrieli JD (1989) Evidence for two types of spatial representations: hemispheric specialization for categorical and coordinate relations. J Exp Psychol Hum Percept Perform 15(4):723CrossRefPubMed
Zurück zum Zitat Kosslyn SM, Thompson WL, Ganis G (2006) The case for mental imagery. Oxford University Press, OxfordCrossRef Kosslyn SM, Thompson WL, Ganis G (2006) The case for mental imagery. Oxford University Press, OxfordCrossRef
Zurück zum Zitat Lambrey S, Amorim MA, Samson S, Noulhiane M, Hasboun D, Dupont S, Baulac M, Berthoz A (2008) Distinct visual perspective-taking strategies involve the left and right medial temporal lobe structures differently. Brain 131(2):523–534CrossRefPubMed Lambrey S, Amorim MA, Samson S, Noulhiane M, Hasboun D, Dupont S, Baulac M, Berthoz A (2008) Distinct visual perspective-taking strategies involve the left and right medial temporal lobe structures differently. Brain 131(2):523–534CrossRefPubMed
Zurück zum Zitat Lund JS, Yoshioka T, Levitt JB (1993) Comparison of intrinsic connectivity in different areas of macaque monkey cerebral cortex. Cereb Cortex 3(2):148–162CrossRefPubMed Lund JS, Yoshioka T, Levitt JB (1993) Comparison of intrinsic connectivity in different areas of macaque monkey cerebral cortex. Cereb Cortex 3(2):148–162CrossRefPubMed
Zurück zum Zitat Marmor GS, Zaback LA (1976) Mental rotation by the blind: does mental rotation depend on visual imagery? J Exp Psychol Hum Percept Perform 2(4):515CrossRefPubMed Marmor GS, Zaback LA (1976) Mental rotation by the blind: does mental rotation depend on visual imagery? J Exp Psychol Hum Percept Perform 2(4):515CrossRefPubMed
Zurück zum Zitat McKinstry JL, Fleischer JG, Chen Y, Gall WE, Edelman GM (2016) Imagery may arise from associations formed through sensory experience: a network of spiking neurons controlling a robot learns visual sequences in order to perform a mental rotation task. PLoS ONE 11(9):e0162155CrossRefPubMedPubMedCentral McKinstry JL, Fleischer JG, Chen Y, Gall WE, Edelman GM (2016) Imagery may arise from associations formed through sensory experience: a network of spiking neurons controlling a robot learns visual sequences in order to perform a mental rotation task. PLoS ONE 11(9):e0162155CrossRefPubMedPubMedCentral
Zurück zum Zitat Mellet E, Bricogne S, Tzourio-Mazoyer N, Ghaem O, Petit L, Zago L, Etard O, Berthoz A, Mazoyer B, Denis M (2000) Neural correlates of topographic mental exploration: the impact of route versus survey perspective learning. Neuroimage 12(5):588–600CrossRefPubMed Mellet E, Bricogne S, Tzourio-Mazoyer N, Ghaem O, Petit L, Zago L, Etard O, Berthoz A, Mazoyer B, Denis M (2000) Neural correlates of topographic mental exploration: the impact of route versus survey perspective learning. Neuroimage 12(5):588–600CrossRefPubMed
Zurück zum Zitat Mora-Sánchez A, Dreyfus G, Vialatte FB (2019) Scale-free behaviour and metastable brain-state switching driven by human cognition, an empirical approach. In: Cognitive neurodynamics, 1–16 Mora-Sánchez A, Dreyfus G, Vialatte FB (2019) Scale-free behaviour and metastable brain-state switching driven by human cognition, an empirical approach. In: Cognitive neurodynamics, 1–16
Zurück zum Zitat Morrison RG, Doumas LA, Richland LE (2011) A computational account of children’s analogical reasoning: balancing inhibitory control in working memory and relational representation. Dev Sci 14(3):516–529CrossRefPubMed Morrison RG, Doumas LA, Richland LE (2011) A computational account of children’s analogical reasoning: balancing inhibitory control in working memory and relational representation. Dev Sci 14(3):516–529CrossRefPubMed
Zurück zum Zitat Murray JE (1997) Flipping and spinning: spatial transformation procedures in the identification of rotated natural objects. Memory Cognit 25(1):96–105CrossRef Murray JE (1997) Flipping and spinning: spatial transformation procedures in the identification of rotated natural objects. Memory Cognit 25(1):96–105CrossRef
Zurück zum Zitat Putrino D, Brown EN, Mastaglia FL, Ghosh S (2010) Differential involvement of excitatory and inhibitory neurons of cat motor cortex in coincident spike activity related to behavioral context. J Neurosci 30(23):8048–8056CrossRefPubMedPubMedCentral Putrino D, Brown EN, Mastaglia FL, Ghosh S (2010) Differential involvement of excitatory and inhibitory neurons of cat motor cortex in coincident spike activity related to behavioral context. J Neurosci 30(23):8048–8056CrossRefPubMedPubMedCentral
Zurück zum Zitat Pylyshyn ZW (1981) The imagery debate: analogue media versus tacit knowledge. Psychol Rev 88(1):16CrossRef Pylyshyn ZW (1981) The imagery debate: analogue media versus tacit knowledge. Psychol Rev 88(1):16CrossRef
Zurück zum Zitat Pylyshyn ZW (2003) Seeing and visualizing: It’s not what you think. MIT press, BostonCrossRef Pylyshyn ZW (2003) Seeing and visualizing: It’s not what you think. MIT press, BostonCrossRef
Zurück zum Zitat Richter W, Somorjai R, Summers R, Jarmasz M, Menon RS, Gati JS, Georgopoulos AP, Tegeler C, Ugurbil K, Kim SG (2000) Motor area activity during mental rotation studied by time-resolved single-trial fmri. J Cogn Neurosci 12(2):310–320CrossRefPubMed Richter W, Somorjai R, Summers R, Jarmasz M, Menon RS, Gati JS, Georgopoulos AP, Tegeler C, Ugurbil K, Kim SG (2000) Motor area activity during mental rotation studied by time-resolved single-trial fmri. J Cogn Neurosci 12(2):310–320CrossRefPubMed
Zurück zum Zitat Rosenbloom PS (2011a) Mental imagery in a graphical cognitive architecture. In: BICA, pp 314–323 Rosenbloom PS (2011a) Mental imagery in a graphical cognitive architecture. In: BICA, pp 314–323
Zurück zum Zitat Rosenbloom PS (2011b) Rethinking cognitive architecture via graphical models. Cogn Syst Res 12(2):198–209CrossRef Rosenbloom PS (2011b) Rethinking cognitive architecture via graphical models. Cogn Syst Res 12(2):198–209CrossRef
Zurück zum Zitat Shepard RN, Metzler J (1971) Mental rotation of three-dimensional objects. Science 171(3972):701–703CrossRefPubMed Shepard RN, Metzler J (1971) Mental rotation of three-dimensional objects. Science 171(3972):701–703CrossRefPubMed
Zurück zum Zitat Stewart TC, Choo X, Eliasmith C, et al. (2010) Dynamic behaviour of a spiking model of action selection in the basal ganglia. In: Proceedings of the 10th international conference on cognitive modeling, Citeseer, pp 235–40 Stewart TC, Choo X, Eliasmith C, et al. (2010) Dynamic behaviour of a spiking model of action selection in the basal ganglia. In: Proceedings of the 10th international conference on cognitive modeling, Citeseer, pp 235–40
Zurück zum Zitat Stewart TC, Tang Y, Eliasmith C (2011) A biologically realistic cleanup memory: autoassociation in spiking neurons. Cogn Syst Res 12(2):84–92CrossRef Stewart TC, Tang Y, Eliasmith C (2011) A biologically realistic cleanup memory: autoassociation in spiking neurons. Cogn Syst Res 12(2):84–92CrossRef
Zurück zum Zitat Tarr MJ (1995) Rotating objects to recognize them: a case study on the role of viewpoint dependency in the recognition of three-dimensional objects. Psychon Bull Rev 2(1):55–82CrossRefPubMed Tarr MJ (1995) Rotating objects to recognize them: a case study on the role of viewpoint dependency in the recognition of three-dimensional objects. Psychon Bull Rev 2(1):55–82CrossRefPubMed
Zurück zum Zitat Tarr MJ, Pinker S (1989) Mental rotation and orientation-dependence in shape recognition. Cogn Psychol 21(2):233–282CrossRefPubMed Tarr MJ, Pinker S (1989) Mental rotation and orientation-dependence in shape recognition. Cogn Psychol 21(2):233–282CrossRefPubMed
Zurück zum Zitat Thompson WL, Slotnick SD, Burrage MS, Kosslyn SM (2009) Two forms of spatial imagery: neuroimaging evidence. Psychol Sci 20(10):1245–1253CrossRefPubMed Thompson WL, Slotnick SD, Burrage MS, Kosslyn SM (2009) Two forms of spatial imagery: neuroimaging evidence. Psychol Sci 20(10):1245–1253CrossRefPubMed
Zurück zum Zitat Xie S, Tu Z (2015) Holistically-nested edge detection. In: Proceedings of the IEEE international conference on computer vision, pp 1395–1403 Xie S, Tu Z (2015) Holistically-nested edge detection. In: Proceedings of the IEEE international conference on computer vision, pp 1395–1403
Zurück zum Zitat Zacks JM (2008) Neuroimaging studies of mental rotation: a meta-analysis and review. J Cogn Neurosci 20(1):1–19CrossRefPubMed Zacks JM (2008) Neuroimaging studies of mental rotation: a meta-analysis and review. J Cogn Neurosci 20(1):1–19CrossRefPubMed
Zurück zum Zitat Zhang T, Pan X, Xu X, Wang R (2019) A cortical model with multi-layers to study visual attentional modulation of neurons at the synaptic level. In: Cognitive neurodynamics, pp 1–21 Zhang T, Pan X, Xu X, Wang R (2019) A cortical model with multi-layers to study visual attentional modulation of neurons at the synaptic level. In: Cognitive neurodynamics, pp 1–21
Metadaten
Titel
A spiking neural network model of spatial and visual mental imagery
verfasst von
Sean N. Riley
Jim Davies
Publikationsdatum
05.12.2019
Verlag
Springer Netherlands
Erschienen in
Cognitive Neurodynamics / Ausgabe 2/2020
Print ISSN: 1871-4080
Elektronische ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-019-09566-5

Weitere Artikel der Ausgabe 2/2020

Cognitive Neurodynamics 2/2020 Zur Ausgabe

Neuer Inhalt