Skip to main content
Top
Published in: Neural Computing and Applications 4/2010

01-06-2010 | Original Article

Chaotic neural network controlled by particle swarm with decaying chaotic inertia weight for pattern recognition

Author: Moayed Daneshyari

Published in: Neural Computing and Applications | Issue 4/2010

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This study introduces a new type of chaotic neural network, which is built upon perturbed Duffing oscillator. The neurons in this network behave collectively based on a modified version of Duffing map. The proposed neural processor can act chaotically at some areas of the state space. The network has some parameters, which can be adjusted for the system to behave either chaotically or periodically. This nonlinear network adopts the bifurcating behavior of the chaotic Duffing map for the most covered search in the neuronal search space. The neuron’s search space is controlled by swarming in the parameter space to settle the parameters of the network into the critical parameters. Swarming of the parameters is based on particle swarm optimization heuristic. The modified particle swarm adopts a decaying inertia weight based on chaotic logistic map to fast settle down into the attractors of periodic solutions. At last, the swarm-controlled neurochaotic processor is applied to build three models to control parameters of the network. Each model is trained to recognize a set of binary patterns that are as the form of alphabetic letters as a classical pattern recognition problem. A comparison study is then conducted among these three models, Hopfield network and a modified Hopfield model, which demonstrate all three models outperform Hopfiled model and are competitive and in most cases outperform the modified Hopfield model.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Babloyantz A, Destexhe A (1986) Low-dimensional chaos in an instance of epilepsy. Proc Natl Acad Sci USA 83:3513–3517CrossRef Babloyantz A, Destexhe A (1986) Low-dimensional chaos in an instance of epilepsy. Proc Natl Acad Sci USA 83:3513–3517CrossRef
2.
go back to reference Aradi I, Barna G, Erdi P, Grobler T (1995) Chaos and learning in the olfactory bulb. Int J Intell Syst 10:89–117MATHCrossRef Aradi I, Barna G, Erdi P, Grobler T (1995) Chaos and learning in the olfactory bulb. Int J Intell Syst 10:89–117MATHCrossRef
3.
go back to reference Baird B (1986) Nonlinear dynamics of pattern formation and pattern recognition in the rabbit olfactory bulb. Physica D 22:150–175CrossRefMathSciNet Baird B (1986) Nonlinear dynamics of pattern formation and pattern recognition in the rabbit olfactory bulb. Physica D 22:150–175CrossRefMathSciNet
5.
go back to reference Freeman WJ (1992) Tutorial on neurobiology: from single neurons to brain chaos. Int J Bifurcat Chaos 2:451–482MATHCrossRef Freeman WJ (1992) Tutorial on neurobiology: from single neurons to brain chaos. Int J Bifurcat Chaos 2:451–482MATHCrossRef
6.
go back to reference Guevara MR, Glass L, Mackey MC, Shrier A (1983) Chaos in neurobiology. IEEE Trans Syst Man Cybern 13:790–798MATH Guevara MR, Glass L, Mackey MC, Shrier A (1983) Chaos in neurobiology. IEEE Trans Syst Man Cybern 13:790–798MATH
8.
go back to reference Skarda CA, Freeman WJ (1987) How brains make chaos in order to make sense of the world. Behav Brain Sci 10:161–165CrossRef Skarda CA, Freeman WJ (1987) How brains make chaos in order to make sense of the world. Behav Brain Sci 10:161–165CrossRef
9.
go back to reference Freeman WJ, Yao Y, Burke B (1988) Central pattern generating and recognizing in olfactory bulb: a correlation learning rule. Neural Netw 1:277–288CrossRef Freeman WJ, Yao Y, Burke B (1988) Central pattern generating and recognizing in olfactory bulb: a correlation learning rule. Neural Netw 1:277–288CrossRef
10.
go back to reference Birbaumer N, Lutzenberger W, Rau H, Braun C, Mayer-Kress G (1996) Perception of music and dimensional complexity of brain activity. Int J Bifurcat Chaos 6:267–278CrossRef Birbaumer N, Lutzenberger W, Rau H, Braun C, Mayer-Kress G (1996) Perception of music and dimensional complexity of brain activity. Int J Bifurcat Chaos 6:267–278CrossRef
11.
go back to reference Chay TR, Fan YS (1995) Bursting, spiking, chaos, fractal, and universality in biological rhythms. Int J Bifurcat Chaos 5:595–635MATHCrossRef Chay TR, Fan YS (1995) Bursting, spiking, chaos, fractal, and universality in biological rhythms. Int J Bifurcat Chaos 5:595–635MATHCrossRef
12.
go back to reference Fuchs A, Kelso JAS, Haken H (1992) Phase transition in human brain: spatial mode dynamics. Int J Bifurcat Chaos 2:917–939MATHCrossRef Fuchs A, Kelso JAS, Haken H (1992) Phase transition in human brain: spatial mode dynamics. Int J Bifurcat Chaos 2:917–939MATHCrossRef
13.
go back to reference Liebovitch LS, Czegledy FP (1991) A model of ion channel kinetics based on deterministic chaotic motion in a potential with two local minima. Ann Biomed Eng 20:517–531CrossRef Liebovitch LS, Czegledy FP (1991) A model of ion channel kinetics based on deterministic chaotic motion in a potential with two local minima. Ann Biomed Eng 20:517–531CrossRef
14.
go back to reference Freeman WJ (1987) Simulation of chaotic EEG patterns with a dynamic model of the olfactory system. Biol Cybern 56:139–150CrossRef Freeman WJ (1987) Simulation of chaotic EEG patterns with a dynamic model of the olfactory system. Biol Cybern 56:139–150CrossRef
15.
go back to reference Yao Y, Freeman WJ (1990) Model of biological pattern recognition with spatially chaotic dynamics. Neural Netw 3:153–170CrossRef Yao Y, Freeman WJ (1990) Model of biological pattern recognition with spatially chaotic dynamics. Neural Netw 3:153–170CrossRef
16.
go back to reference Chang-song Z, Tian-lin C, Wu-qun H (1997) Chaotic neural network with nonlinear self-feedback and its application in optimization. Neurocomputing 14:209–222CrossRef Chang-song Z, Tian-lin C, Wu-qun H (1997) Chaotic neural network with nonlinear self-feedback and its application in optimization. Neurocomputing 14:209–222CrossRef
17.
go back to reference Chen L, Aihara K (1995) Chaotic simulated annealing by a neural network model with transient chaos. Neural Netw 8:915–930CrossRef Chen L, Aihara K (1995) Chaotic simulated annealing by a neural network model with transient chaos. Neural Netw 8:915–930CrossRef
18.
go back to reference Adachi M, Aihara K (1997) Associative dynamics in a chaotic neural network. Neural Netw 10:83–98CrossRef Adachi M, Aihara K (1997) Associative dynamics in a chaotic neural network. Neural Netw 10:83–98CrossRef
20.
go back to reference Albers DJ, Sprott JC, Dechert WD (1998) Routes to chaos in neural networks with random weight. Int J Bifurcat Chaos 8:1463–1478MATHCrossRef Albers DJ, Sprott JC, Dechert WD (1998) Routes to chaos in neural networks with random weight. Int J Bifurcat Chaos 8:1463–1478MATHCrossRef
21.
go back to reference Kaneko K (1990) Clustering, coding, switching, hierarchical ordering, and control in a network of chaotic elements. Physica D 41:137–172MATHCrossRefMathSciNet Kaneko K (1990) Clustering, coding, switching, hierarchical ordering, and control in a network of chaotic elements. Physica D 41:137–172MATHCrossRefMathSciNet
22.
go back to reference Andreyev YV, Dmitriev AS, Starkov SO (1997) Information processing in 1-D systems with chaos. IEEE Trans Circuits Syst 44:21–28CrossRef Andreyev YV, Dmitriev AS, Starkov SO (1997) Information processing in 1-D systems with chaos. IEEE Trans Circuits Syst 44:21–28CrossRef
23.
go back to reference Dmitriev AS, Kuminov DA (1994) Chaotic scanning and recognition of images in neuron-like systems with learning. J Commun Tech Electron 39:118–127 Dmitriev AS, Kuminov DA (1994) Chaotic scanning and recognition of images in neuron-like systems with learning. J Commun Tech Electron 39:118–127
24.
go back to reference Grossberg S (1988) Nonlinear neural networks: principles, mechanisms, and architectures. Neural Netw 1:17–61CrossRef Grossberg S (1988) Nonlinear neural networks: principles, mechanisms, and architectures. Neural Netw 1:17–61CrossRef
25.
go back to reference Hayakawa Y, Marumoto A, Sawada Y (1995) Effects of the chaotic noise on the performance of a neural network model for optimization problems. Phys Rev E 51:R2693–R2696CrossRef Hayakawa Y, Marumoto A, Sawada Y (1995) Effects of the chaotic noise on the performance of a neural network model for optimization problems. Phys Rev E 51:R2693–R2696CrossRef
26.
go back to reference Ishii S, Fukumizu K, Watanabe S (1996) A network of chaotic elements for information processing. Neural Netw 9:25–40CrossRef Ishii S, Fukumizu K, Watanabe S (1996) A network of chaotic elements for information processing. Neural Netw 9:25–40CrossRef
27.
go back to reference Kwok T, Smith KA (1999) A unified framework for chaotic neural network approach to combinatorial optimization. IEEE Trans Neural Netw 10:978–981CrossRef Kwok T, Smith KA (1999) A unified framework for chaotic neural network approach to combinatorial optimization. IEEE Trans Neural Netw 10:978–981CrossRef
28.
go back to reference Zak M (1989) Terminal attractors in neural networks. Neural Netw 2:259–274CrossRef Zak M (1989) Terminal attractors in neural networks. Neural Netw 2:259–274CrossRef
29.
go back to reference Nakagawa M (1999) A chaos associative model with a sinusoidal activation function. Chaos Solitons Fractals 10:1437–1452MATHCrossRef Nakagawa M (1999) A chaos associative model with a sinusoidal activation function. Chaos Solitons Fractals 10:1437–1452MATHCrossRef
31.
go back to reference Tan Z, Ali MK (1998) Pattern recognition in a neural network with chaos. Phys Rev E 58:3649–3653CrossRef Tan Z, Ali MK (1998) Pattern recognition in a neural network with chaos. Phys Rev E 58:3649–3653CrossRef
32.
go back to reference Tan Z, Ali MK (2001) Associative memory using synchronization in a chaotic neural network. Int J Modern Phys C 12:19–29CrossRef Tan Z, Ali MK (2001) Associative memory using synchronization in a chaotic neural network. Int J Modern Phys C 12:19–29CrossRef
33.
go back to reference Tan Z, Hepburn BS, Tucker C, Ali MK (1998) Pattern recognition using chaotic neural networks. Discrete Dyn Nature Soc 2:243–247MATHCrossRef Tan Z, Hepburn BS, Tucker C, Ali MK (1998) Pattern recognition using chaotic neural networks. Discrete Dyn Nature Soc 2:243–247MATHCrossRef
34.
go back to reference Tsuda I (1992) Dynamic link of memory–chaotic memory map in nonequilibrium neural networks. Neural Netw 5:13–326CrossRef Tsuda I (1992) Dynamic link of memory–chaotic memory map in nonequilibrium neural networks. Neural Netw 5:13–326CrossRef
35.
go back to reference Hiura E, Tanaka T (2007) A chaotic neural network with duffing’s equation. In: Proceedings of international joint conference on neural networks, Orlando, pp 997–1001 Hiura E, Tanaka T (2007) A chaotic neural network with duffing’s equation. In: Proceedings of international joint conference on neural networks, Orlando, pp 997–1001
36.
go back to reference Song Y, Chen ZQ, Yuan ZZ (2007) New chaotic PSO-based neural network predictive control for nonlinear process. IEEE Trans Neural Netw 18:595–600CrossRef Song Y, Chen ZQ, Yuan ZZ (2007) New chaotic PSO-based neural network predictive control for nonlinear process. IEEE Trans Neural Netw 18:595–600CrossRef
37.
go back to reference Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci USA 79:2554–2558CrossRefMathSciNet Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci USA 79:2554–2558CrossRefMathSciNet
38.
go back to reference Parker TS, Chua LO (1987) Chaos: a tutorial for engineers. In: Proceedings of the IEEE special issue on chaotic systems, pp 982–1008 Parker TS, Chua LO (1987) Chaos: a tutorial for engineers. In: Proceedings of the IEEE special issue on chaotic systems, pp 982–1008
39.
go back to reference Yang J, Qu Z, Hu G (1996) Duffing equation with two periodic forcings: the phase effect. Physical Rev E 53(5):4402–4413CrossRefMathSciNet Yang J, Qu Z, Hu G (1996) Duffing equation with two periodic forcings: the phase effect. Physical Rev E 53(5):4402–4413CrossRefMathSciNet
40.
go back to reference Daneshyari M (2008) A neurochaotic PSO-guided network based upon perturbed duffing oscillator. In: Proceedings of international joint conference on neural networks, Hong Kong, pp 2315–2320 Daneshyari M (2008) A neurochaotic PSO-guided network based upon perturbed duffing oscillator. In: Proceedings of international joint conference on neural networks, Hong Kong, pp 2315–2320
41.
go back to reference Yen GG, Daneshyari M (2006) Diversity-based information exchange among multiple swarms in particle swarm optimization. In: Proceedings of the IEEE congress on evolutionary computation, Vancouver, pp 1686–1693 Yen GG, Daneshyari M (2006) Diversity-based information exchange among multiple swarms in particle swarm optimization. In: Proceedings of the IEEE congress on evolutionary computation, Vancouver, pp 1686–1693
42.
go back to reference Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of international joint conference on neural networks, Perth, pp 1942–1948 Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of international joint conference on neural networks, Perth, pp 1942–1948
43.
go back to reference Daneshyari M, Yen GG (2008) Cultural MOPSO: a cultural framework to adapt parameters of multiobjective particle swarm optimization. In: Proceedings of the IEEE congress on evolutionary computation, Hong Kong, pp 1325–1332 Daneshyari M, Yen GG (2008) Cultural MOPSO: a cultural framework to adapt parameters of multiobjective particle swarm optimization. In: Proceedings of the IEEE congress on evolutionary computation, Hong Kong, pp 1325–1332
44.
go back to reference Shi Y, Eberhart RC (1998) A modified particle swarm optimizer. In: Proceedings of the IEEE international conference on evolutionary computation, pp 69–73 Shi Y, Eberhart RC (1998) A modified particle swarm optimizer. In: Proceedings of the IEEE international conference on evolutionary computation, pp 69–73
45.
go back to reference Banks A, Vincent J, Anyakoha C (2007) A review of particle swarm optimization, part I: background and development. Nat Comput 6(4):467–484MATHCrossRefMathSciNet Banks A, Vincent J, Anyakoha C (2007) A review of particle swarm optimization, part I: background and development. Nat Comput 6(4):467–484MATHCrossRefMathSciNet
46.
go back to reference Hu CLJ (2003) Design and noniterative learning of multiple pattern storage in a modified hopfield net. In: Proceedings of SPIE, vol 5106, pp 154–160 Hu CLJ (2003) Design and noniterative learning of multiple pattern storage in a modified hopfield net. In: Proceedings of SPIE, vol 5106, pp 154–160
47.
go back to reference Fogel DB, Fogel LJ, Atmar JW (1991) Meta-evolutionary programming. In: Proceedings of the 25th asilomar conference on signals, systems and computers, Pacific Grove, California, pp 540–545 Fogel DB, Fogel LJ, Atmar JW (1991) Meta-evolutionary programming. In: Proceedings of the 25th asilomar conference on signals, systems and computers, Pacific Grove, California, pp 540–545
Metadata
Title
Chaotic neural network controlled by particle swarm with decaying chaotic inertia weight for pattern recognition
Author
Moayed Daneshyari
Publication date
01-06-2010
Publisher
Springer-Verlag
Published in
Neural Computing and Applications / Issue 4/2010
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-009-0322-7

Other articles of this Issue 4/2010

Neural Computing and Applications 4/2010 Go to the issue

Premium Partner