Skip to main content
Top
Published in: Neural Computing and Applications 14/2020

23-10-2019 | Original Article

Revisiting the XOR problem: a neurorobotic implementation

Authors: André Cyr, Frédéric Thériault, Sylvain Chartier

Published in: Neural Computing and Applications | Issue 14/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The exclusive-or (XOR) classification task still represents a challenge in the study of cognition since the precise neural circuit sustaining the general ability to learn nonlinear problems remains to be discovered in natural organisms. As such, this paper focuses on a neurorobotic application embedding a specific spiking neural network built to solve these types of tasks. This experiment proposes a 2-bit task (XOR) with visual compound binary images acting as inputs and a left/right action for the output. The robot learns to solve it in both virtual and real environments from an operant conditioning procedure. Furthermore, the robot also adapts its behavior from learning all other simpler associative rules, even when switching them at runtime. Finally, this study explores the impact on the neural architecture, when passing from a 2-bit to a 3-bit task.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Behrends A, Scheiner R (2012) Octopamine improves learning in newly emerged bees but not in old foragers. J Exp Biol 215(7):1076–1083CrossRef Behrends A, Scheiner R (2012) Octopamine improves learning in newly emerged bees but not in old foragers. J Exp Biol 215(7):1076–1083CrossRef
2.
go back to reference Bi G, Poo M (1998) Activity-induced synaptic modifications in hippocampal culture: dependence on spike timing, synaptic strength and cell type. J Neurosci 18:10464–10472CrossRef Bi G, Poo M (1998) Activity-induced synaptic modifications in hippocampal culture: dependence on spike timing, synaptic strength and cell type. J Neurosci 18:10464–10472CrossRef
3.
go back to reference Caporale N, Dan Y (2008) Spike timing-dependent plasticity: a Hebbian learning rule. Annu Rev Neurosci 31:25–46CrossRef Caporale N, Dan Y (2008) Spike timing-dependent plasticity: a Hebbian learning rule. Annu Rev Neurosci 31:25–46CrossRef
4.
go back to reference Casacuberta D, Ayala S, Vallverdú J (2012) Embodying cognition: a morphological perspective. In: Machine learning: concepts, methodologies, tools and applications. IGI Global, pp 1798–1818 Casacuberta D, Ayala S, Vallverdú J (2012) Embodying cognition: a morphological perspective. In: Machine learning: concepts, methodologies, tools and applications. IGI Global, pp 1798–1818
5.
go back to reference Cyr A, Boukadoum M, Poirier P (2009) Ai-SIMCOG: a simulator for spiking neurons and multiple animat’s behaviours. Neural Comput Appl 18(5):431–446CrossRef Cyr A, Boukadoum M, Poirier P (2009) Ai-SIMCOG: a simulator for spiking neurons and multiple animat’s behaviours. Neural Comput Appl 18(5):431–446CrossRef
6.
go back to reference Cyr A, Boukadoum M, Thériault F (2014) Operant conditioning: a minimal components requirement in artificial spiking neurons designed for bio-inspired robot’s controller. Front Neurorobot 8:1–13CrossRef Cyr A, Boukadoum M, Thériault F (2014) Operant conditioning: a minimal components requirement in artificial spiking neurons designed for bio-inspired robot’s controller. Front Neurorobot 8:1–13CrossRef
7.
go back to reference Deisig N, Lachnit H, Giurfa M, Hellstern F (2001) Configural olfactory learning in honeybees: negative and positive patterning discrimination. Learn Mem 8(2):70–78CrossRef Deisig N, Lachnit H, Giurfa M, Hellstern F (2001) Configural olfactory learning in honeybees: negative and positive patterning discrimination. Learn Mem 8(2):70–78CrossRef
8.
go back to reference El-Laithy K, Bogdan M (2011) A reinforcement learning framework for spiking networks with dynamic synapses. Comput Intell Neurosci 2011:4CrossRef El-Laithy K, Bogdan M (2011) A reinforcement learning framework for spiking networks with dynamic synapses. Comput Intell Neurosci 2011:4CrossRef
9.
go back to reference Frémaux N, Sprekeler H, Gerstner W (2010) Functional requirements for reward-modulated spike-timing-dependent plasticity. J Neurosci 30(40):13326–13337CrossRef Frémaux N, Sprekeler H, Gerstner W (2010) Functional requirements for reward-modulated spike-timing-dependent plasticity. J Neurosci 30(40):13326–13337CrossRef
10.
11.
go back to reference Gerstner W, Kistler W (2002) Spiking neuron models: single neurons, populations, plasticity. Cambridge University Press, CambridgeMATHCrossRef Gerstner W, Kistler W (2002) Spiking neuron models: single neurons, populations, plasticity. Cambridge University Press, CambridgeMATHCrossRef
12.
go back to reference Ghosh-Dastidar S, Adeli H (2009) Spiking neural networks. Int J Neural Syst 19(04):295–308CrossRef Ghosh-Dastidar S, Adeli H (2009) Spiking neural networks. Int J Neural Syst 19(04):295–308CrossRef
13.
go back to reference Giurfa M, Zhang S, Jenett A, Menzel R, Srinivasan MV (2001) The concepts of ‘sameness’ and ‘difference’in an insect. Nature 410(6831):930–933CrossRef Giurfa M, Zhang S, Jenett A, Menzel R, Srinivasan MV (2001) The concepts of ‘sameness’ and ‘difference’in an insect. Nature 410(6831):930–933CrossRef
14.
go back to reference Grand C, Honey RC (2008) Solving XOR. J Exp Psychol Anim Behav Process 34(4):486CrossRef Grand C, Honey RC (2008) Solving XOR. J Exp Psychol Anim Behav Process 34(4):486CrossRef
15.
go back to reference Hammer M (1997) The neural basis of associative reward learning in honeybees. Trends Neurosci 20(6):245–252CrossRef Hammer M (1997) The neural basis of associative reward learning in honeybees. Trends Neurosci 20(6):245–252CrossRef
17.
go back to reference Jitsumori M, Ohkita M, Ushitani T (2011) The learning of basic-level categories by pigeons: the prototype effect, attention, and effects of categorization. Learn Behav 39(3):271CrossRef Jitsumori M, Ohkita M, Ushitani T (2011) The learning of basic-level categories by pigeons: the prototype effect, attention, and effects of categorization. Learn Behav 39(3):271CrossRef
19.
go back to reference Maass W (1997) Networks of spiking neurons: the third generation of neural network models. Neural Netw 10(9):1659–1671CrossRef Maass W (1997) Networks of spiking neurons: the third generation of neural network models. Neural Netw 10(9):1659–1671CrossRef
20.
go back to reference Markram H, Lubke J, Frotscher M, Sakmann B (1997) Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275:213–215CrossRef Markram H, Lubke J, Frotscher M, Sakmann B (1997) Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275:213–215CrossRef
21.
go back to reference Minsky M, Papert S (1969) An introduction to computational geometry. Cambridge tiass., HIT Minsky M, Papert S (1969) An introduction to computational geometry. Cambridge tiass., HIT
22.
go back to reference Paul C (2006) Morphological computation: a basis for the analysis of morphology and control requirements. Robot Auton Syst 54(8):619–630CrossRef Paul C (2006) Morphological computation: a basis for the analysis of morphology and control requirements. Robot Auton Syst 54(8):619–630CrossRef
23.
go back to reference Pawlak V, Wickens JR, Kirkwood A, Kerr JN (2010) Timing is not everything: neuromodulation opens the STDP gate. Front Synaptic Neurosci 2:138CrossRef Pawlak V, Wickens JR, Kirkwood A, Kerr JN (2010) Timing is not everything: neuromodulation opens the STDP gate. Front Synaptic Neurosci 2:138CrossRef
24.
go back to reference Pezzulo G, Barsalou LW, Cangelosi A, Fischer MH, Spivey M, McRae K (2011) The mechanics of embodiment: a dialog on embodiment and computational modeling. Front Psychol 2:5CrossRef Pezzulo G, Barsalou LW, Cangelosi A, Fischer MH, Spivey M, McRae K (2011) The mechanics of embodiment: a dialog on embodiment and computational modeling. Front Psychol 2:5CrossRef
25.
go back to reference Reljan-Delaney M, Wall J (2017) Solving the linearly inseparable XOR problem with spiking neural networks. In: 2017 computing conference. IEEE, pp 701–705 Reljan-Delaney M, Wall J (2017) Solving the linearly inseparable XOR problem with spiking neural networks. In: 2017 computing conference. IEEE, pp 701–705
26.
go back to reference Rumelhart DE, Hinton GE, Williams RJ (1988) Learning representations by back-propagating errors. Cognit Model 5(3):1MATH Rumelhart DE, Hinton GE, Williams RJ (1988) Learning representations by back-propagating errors. Cognit Model 5(3):1MATH
27.
go back to reference Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80(1):1–27CrossRef Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80(1):1–27CrossRef
28.
go back to reference Seung HS (2003) Learning in spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron 40(6):1063–1073CrossRef Seung HS (2003) Learning in spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron 40(6):1063–1073CrossRef
29.
go back to reference Smith JD, Coutinho MV, Couchman JJ (2011) The learning of exclusive-or categories by monkeys (Macaca mulatta) and humans (homo sapiens). J Exp Psychol Anim Behav Process 37(1):20CrossRef Smith JD, Coutinho MV, Couchman JJ (2011) The learning of exclusive-or categories by monkeys (Macaca mulatta) and humans (homo sapiens). J Exp Psychol Anim Behav Process 37(1):20CrossRef
30.
go back to reference Unoki S, Matsumoto Y, Mizunami M (2006) Roles of octopaminergic and dopaminergic neurons in mediating reward and punishment signals in insect visual learning. Eur J Neurosci 24(7):2031–2038CrossRef Unoki S, Matsumoto Y, Mizunami M (2006) Roles of octopaminergic and dopaminergic neurons in mediating reward and punishment signals in insect visual learning. Eur J Neurosci 24(7):2031–2038CrossRef
31.
go back to reference Vassiliades V, Christodoulou C (2016) Behavioral plasticity through the modulation of switch neurons. Neural Netw 74:35–51CrossRef Vassiliades V, Christodoulou C (2016) Behavioral plasticity through the modulation of switch neurons. Neural Netw 74:35–51CrossRef
32.
go back to reference Zbeda R, Nathan P (2005) Multilayer neural network with back propagation: hardware solution to learning XOR. J Comput Sci Coll 20(5):144–146 Zbeda R, Nathan P (2005) Multilayer neural network with back propagation: hardware solution to learning XOR. J Comput Sci Coll 20(5):144–146
33.
go back to reference Zeigler B, Muzy A (2017) Temporal modeling of neural net input/output behaviors: the case of XOR. Systems 5(1):7CrossRef Zeigler B, Muzy A (2017) Temporal modeling of neural net input/output behaviors: the case of XOR. Systems 5(1):7CrossRef
Metadata
Title
Revisiting the XOR problem: a neurorobotic implementation
Authors
André Cyr
Frédéric Thériault
Sylvain Chartier
Publication date
23-10-2019
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 14/2020
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04522-0

Other articles of this Issue 14/2020

Neural Computing and Applications 14/2020 Go to the issue

Premium Partner