Skip to main content
Erschienen in: Neural Computing and Applications 2/2019

08.07.2017 | Original Article

A novel optimized GA–Elman neural network algorithm

verfasst von: Weikuan Jia, Dean Zhao, Yuanjie Zheng, Sujuan Hou

Erschienen in: Neural Computing and Applications | Ausgabe 2/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The Elman neural network has good dynamic properties and strong global stability, being most widely used to deal with nonlinear, dynamic, and complex data. However, as an optimization of the backpropagation (BP) neural network, the Elman model inevitably inherits some of its inherent deficiencies, influencing the recognition precision and operating efficiency. Many improvements have been proposed to resolve these problems, but it has proved difficult to balance the many relevant features such as storage space, algorithm efficiency, recognition precision, etc. Also, it is difficult to obtain a permanent solution from a temporary solution simultaneously. To address this, a genetic algorithm (GA) can be introduced into the Elman algorithm to optimize the connection weights and thresholds, which can prevent the neural network from becoming trapped in local minima and improve the training speed and success rate. The structure of the hidden layer can also be optimized using the GA, which can solve the difficult problem of determining the number of neurons. Most previous studies on such evolutionary Elman algorithms optimized the connection weights or network structure individually, which represents a slight deficiency. We propose herein a novel optimized GA–Elman neural network algorithm where the connection weights are real-encoded, while the neurons of the hidden layer also adopt real-coding but with the addition of binary control genes. In this new algorithm, the connection weights and the number of hidden neurons are optimized using hybrid encoding and evolution simultaneously, greatly improving the performance of the resulting novel GA–Elman algorithm. The results of three experiments show that this new GA–Elman model is superior to the traditional model in terms of all calculated indexes.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Arriandiaga A, Portillo E, Sánchez JA et al (2016) A new approach for dynamic modelling of energy consumption in the grinding process using recurrent neural networks. Neural Comput Appl 27(6):1577–1592CrossRef Arriandiaga A, Portillo E, Sánchez JA et al (2016) A new approach for dynamic modelling of energy consumption in the grinding process using recurrent neural networks. Neural Comput Appl 27(6):1577–1592CrossRef
2.
Zurück zum Zitat Raghu S, Sriraam N, Kumar GP (2017) Classification of epileptic seizures using wavelet packet log energy and norm entropies with recurrent Elman neural network classifier. Cogn Neurodyn 11(1):51–56CrossRef Raghu S, Sriraam N, Kumar GP (2017) Classification of epileptic seizures using wavelet packet log energy and norm entropies with recurrent Elman neural network classifier. Cogn Neurodyn 11(1):51–56CrossRef
3.
Zurück zum Zitat Lu JJ, Chen H (2006) Researching development on BP neural networks. Control Eng China 13(5):449–451 (in Chinese) Lu JJ, Chen H (2006) Researching development on BP neural networks. Control Eng China 13(5):449–451 (in Chinese)
4.
Zurück zum Zitat Zhang HX, Lu J (2010) Creating ensembles of classifiers via fuzzy clustering and deflection. Fuzzy Sets Syst 161(13):1790–1802MathSciNetCrossRef Zhang HX, Lu J (2010) Creating ensembles of classifiers via fuzzy clustering and deflection. Fuzzy Sets Syst 161(13):1790–1802MathSciNetCrossRef
5.
Zurück zum Zitat Ltaief M, Bezine H, Alimi AM (2016) A spiking neural network model with fuzzy learning rate application for complex handwriting movements generation. Adv Intell Syst Comput 552:403–412 Ltaief M, Bezine H, Alimi AM (2016) A spiking neural network model with fuzzy learning rate application for complex handwriting movements generation. Adv Intell Syst Comput 552:403–412
6.
Zurück zum Zitat Lo TH, Gui Y, Peng Y (2015) The normalized risk-averting error criterion for avoiding nonglobal local minima in training neural networks. Neurocomputing 149:3–12CrossRef Lo TH, Gui Y, Peng Y (2015) The normalized risk-averting error criterion for avoiding nonglobal local minima in training neural networks. Neurocomputing 149:3–12CrossRef
8.
Zurück zum Zitat Jia WK, Zhao DA, Ding L (2016) An optimized RBF neural network algorithm based on partial least squares and genetic algorithm for classification of small sample. Appl Soft Comput 48:373–384CrossRef Jia WK, Zhao DA, Ding L (2016) An optimized RBF neural network algorithm based on partial least squares and genetic algorithm for classification of small sample. Appl Soft Comput 48:373–384CrossRef
9.
Zurück zum Zitat Sivaraj R, Ravichandran DT (2011) A review of selection methods in genetic algorithm. Int J Eng Sci Technol 3(5):3792–3797 Sivaraj R, Ravichandran DT (2011) A review of selection methods in genetic algorithm. Int J Eng Sci Technol 3(5):3792–3797
10.
Zurück zum Zitat Qi F, Liu XY, Ma YH (2012) Synthesis of neural tree models by improved breeder genetic programming. Neural Comput Appl 21(3):515–521CrossRef Qi F, Liu XY, Ma YH (2012) Synthesis of neural tree models by improved breeder genetic programming. Neural Comput Appl 21(3):515–521CrossRef
11.
Zurück zum Zitat Yao X (1999) Evolving artificial neural networks. Proc IEEE 87(9):1423–1447CrossRef Yao X (1999) Evolving artificial neural networks. Proc IEEE 87(9):1423–1447CrossRef
12.
Zurück zum Zitat Ding SF, Li H, Su CY et al (2013) Evolutionary artificial neural networks: a review. Artif Intell Rev 39(3):251–260CrossRef Ding SF, Li H, Su CY et al (2013) Evolutionary artificial neural networks: a review. Artif Intell Rev 39(3):251–260CrossRef
13.
Zurück zum Zitat Kalinli A (2012) Simulated annealing algorithm-based Elman network for dynamic system identification. Turk J Electr Eng Comput Sci 20(4):569–582 Kalinli A (2012) Simulated annealing algorithm-based Elman network for dynamic system identification. Turk J Electr Eng Comput Sci 20(4):569–582
14.
Zurück zum Zitat Sheikhan M, Arabi MA, Gharavian D (2015) Structure and weights optimisation of a modified Elman network emotion classifier using hybrid computational intelligence algorithms: a comparative study. Connect Sci 27(4):1–18CrossRef Sheikhan M, Arabi MA, Gharavian D (2015) Structure and weights optimisation of a modified Elman network emotion classifier using hybrid computational intelligence algorithms: a comparative study. Connect Sci 27(4):1–18CrossRef
15.
Zurück zum Zitat Chen H, Zeng Z, Tang H (2015) Landslide deformation prediction based on recurrent neural network. Neural Process Lett 41(2):1–10CrossRef Chen H, Zeng Z, Tang H (2015) Landslide deformation prediction based on recurrent neural network. Neural Process Lett 41(2):1–10CrossRef
16.
Zurück zum Zitat Chandra R, Zhang MJ (2012) Cooperative coevolution of Elman recurrent neural networks for chaotic time series prediction. Neurocomputing 86(1):116–123CrossRef Chandra R, Zhang MJ (2012) Cooperative coevolution of Elman recurrent neural networks for chaotic time series prediction. Neurocomputing 86(1):116–123CrossRef
17.
Zurück zum Zitat Nate K, Risto M (2009) Evolving neural networks for strategic decision-making problems. Neural Netw 22(3):326–337CrossRef Nate K, Risto M (2009) Evolving neural networks for strategic decision-making problems. Neural Netw 22(3):326–337CrossRef
18.
Zurück zum Zitat Ding SF, Zhang YN, Chen JR et al (2013) Research on using genetic algorithms to optimize Elman neural networks. Neural Comput Appl 23(2):293–297CrossRef Ding SF, Zhang YN, Chen JR et al (2013) Research on using genetic algorithms to optimize Elman neural networks. Neural Comput Appl 23(2):293–297CrossRef
19.
Zurück zum Zitat Zhang YM (2003) The application of artificial neural network in the forecasting of wheat midge. Master's thesis, Northwest A&F University, Xi'an, China Zhang YM (2003) The application of artificial neural network in the forecasting of wheat midge. Master's thesis, Northwest A&F University, Xi'an, China
22.
Zurück zum Zitat Zheng XW, Lu DJ, Wang XG et al (2015) A cooperative coevolutionary biogeography-based optimizer. Appl Intell 43(1):1–17CrossRef Zheng XW, Lu DJ, Wang XG et al (2015) A cooperative coevolutionary biogeography-based optimizer. Appl Intell 43(1):1–17CrossRef
23.
Zurück zum Zitat Azali S, Sheikhan M (2016) Intelligent control of photovoltaic system using BPSO-GSA-optimized neural network and fuzzy-based PID for maximum power point tracking. Appl Intell 44(1):1–23CrossRef Azali S, Sheikhan M (2016) Intelligent control of photovoltaic system using BPSO-GSA-optimized neural network and fuzzy-based PID for maximum power point tracking. Appl Intell 44(1):1–23CrossRef
24.
Zurück zum Zitat Hou SJ, Chen L, Tao D et al (2017) Multi-layer multi-view topic model for classifying advertising video. Pattern Recognit 68:66–81CrossRef Hou SJ, Chen L, Tao D et al (2017) Multi-layer multi-view topic model for classifying advertising video. Pattern Recognit 68:66–81CrossRef
25.
Zurück zum Zitat Pareek NK, Patidar V (2016) Medical image protection using genetic algorithm operations. Soft Comput 20(2):763–772CrossRef Pareek NK, Patidar V (2016) Medical image protection using genetic algorithm operations. Soft Comput 20(2):763–772CrossRef
26.
Zurück zum Zitat Song XM, Ju HP (2017) Linear optimal estimation for discrete-time measurement delay systems with multichannel multiplicative noise. IEEE Trans Circuits Syst II Express Briefs 64(2):156–160CrossRef Song XM, Ju HP (2017) Linear optimal estimation for discrete-time measurement delay systems with multichannel multiplicative noise. IEEE Trans Circuits Syst II Express Briefs 64(2):156–160CrossRef
27.
Metadaten
Titel
A novel optimized GA–Elman neural network algorithm
verfasst von
Weikuan Jia
Dean Zhao
Yuanjie Zheng
Sujuan Hou
Publikationsdatum
08.07.2017
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 2/2019
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-017-3076-7

Weitere Artikel der Ausgabe 2/2019

Neural Computing and Applications 2/2019 Zur Ausgabe