Top

Soft Computing

Published in:

01-08-2014 | Methodologies and Application

Memetic cooperative coevolution of Elman recurrent neural networks

Author: Rohitash Chandra

Published in: Soft Computing | Issue 8/2014

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Cooperative coevolution decomposes an optimisation problem into subcomponents and collectively solves them using evolutionary algorithms. Memetic algorithms provides enhancement to evolutionary algorithms with local search. Recently, the incorporation of local search into a memetic cooperative coevolution method has shown to be efficient for training feedforward networks on pattern classification problems. This paper applies the memetic cooperative coevolution method for training recurrent neural networks on grammatical inference problems. The results show that the proposed method achieves better performance in terms of optimisation time and robustness.

previous article Metaheuristic algorithms for the design of multiplier-less non-uniform filter banks based on frequency response masking

next article A generalized computing paradigm based on artificial dynamic models for mathematical programming

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Acampora G, Cadenas J, Loia V, Ballester E (2011) Achieving memetic adaptability by means of agent-based machine learning. IEEE Trans Indus Inform 7(4):557–569CrossRef

Acampora G, Gaeta M, Loia V (2011) Combining multi-agent paradigm and memetic computing for personalized and adaptive learning experiences. Comput Intell 27(2):141–165CrossRefMathSciNet

Acampora G, Loia V, Salerno S, Vitiello A (2012) A hybrid evolutionary approach for solving the ontology alignment problem. Int J Intell Syst 27(3):189–216CrossRef

Chandra R, Frean M, Zhang M (2010) An encoding scheme for cooperative coevolutionary neural networks. In: 23rd Australian joint conference on artificial intelligence. Lecture notes in artificial intelligence. Springer, Adelaide, Australia, in Press

Chandra R, Frean M, Zhang M (2011a) A memetic framework for cooperative coevolution of recurrent neural networks. In: The 2011 international joint conference on neural networks (IJCNN), pp 673–680

Chandra R, Frean M, Zhang M (2011b) Modularity adaptation in cooperative coevolution of feedforward neural networks. In: The 2011 international joint conference on neural networks (IJCNN), pp 681–688

Chandra R, Frean M, Zhang M, Omlin CW (2011c) Encoding subcomponents in cooperative co-evolutionary recurrent neural networks. Neurocomputing 74(17):3223–3234CrossRef

Chandra R, Frean M, Zhang M (2012a) Adapting modularity during learning in cooperative co-evolutionary recurrent neural networks. Soft Comput Fusion Found Methodol Appl 16(6):1009–1020

Chandra R, Frean M, Zhang M (2012b) Crossover-based local search in cooperative co-evolutionary feedforward neural networks. Appl Soft Comput 12(9):2924–2932CrossRef

Chandra R, Frean M, Zhang M (2012c) On the issue of separability for problem decomposition in cooperative neuro-evolution. Neurocomputing 87:33–40CrossRef

Deb K, Anand A, Joshi D (2002) A computationally efficient evolutionary algorithm for real-parameter optimization. Evol Comput 10(4):371–395CrossRef

Elman JL (1990) Finding structure in time. Cogn Sci 14:179–211CrossRef

Giles CL, Horne BG, Lin T (1995) Learning a class of large finite state machines with a recurrent neural network. Neural Netw 8(9):1359–1365CrossRef

Glover FW, Kochenberger GA (2003) Handbook of metaheuristics. Springer, BerlinMATH

Gomez F, Mikkulainen R (1997) Incremental evolution of complex general behavior. Adapt Behav 5(3–4):317–342CrossRef

Gomez F, Schmidhuber J, Miikkulainen R (2008) Accelerated neural evolution through cooperatively coevolved synapses. J Mach Learn Res 9:937–965MATHMathSciNet

Gomez FJ (2003) Robust non-linear control through neuroevolution. Technical Report AI-TR-03-303, PhD thesis, Department of Computer Science, The University of Texas at Austin

Haykin S, Principe J, Sejnowski T, McWhirter J (2006) New directions in statistical signal processing: from systems to brain. MIT Press, Cambridge

Kazarlis SA, Papadakis SE, Theocharis IB, Petridis V (2001) Microgenetic algorithms as generalized hill-climbing operators for ga optimization. IEEE Trans Evolut Comput 5(3):204–217CrossRef

Kolen J, Kremer S (2001) A field guide to dynamical recurrent networks. IEEE Press, Piscataway, NJ, USA

Kremer S (1995) On the computational power of elman-style recurrent networks. IEEE Trans Neural Netw 6(4):1000–1004CrossRef

Lin C-J, Chen C-H, Lin C-T (January 2009) A hybrid of cooperative particle swarm optimization and cultural algorithm for neural fuzzy networks and its prediction applications. Trans Syst Man Cyber Part C 39:55–68

Lozano M, Herrera F, Krasnogor N, Molina D (2004) Real-coded memetic algorithms with crossover hill-climbing. Evol Comput 12:273–302

Lozano M, Herrera F, Krasnogor N, Molina D (2004) Real-coded memetic algorithms with crossover hill-climbing. Evol Comput 12(3):273–302CrossRef

Manolios P, Fanelli R (1994) First-order recurrent neural networks and deterministic finite state automata. Neural Comput 6(6):1155–1173CrossRef

Medsker L, Jain L (1999) Recurrent neural networks: design and application, computer intelligence. CRC Press, Florida, USACrossRef

Molina D, Lozano M, Garca-Martnez C, Herrera F (2010) Memetic algorithms for continuous optimisation based on local search chains. Evol Comput 18(1):27–63CrossRef

Moscato P (1989) On evolution, search, optimization, genetic algorithms and martial arts: towards memetic algorithms. Tech Rep

Moscato P (1989) On evolution, search, optimization, genetic algorithms and martial arts: towards memetic algorithms. Technical Report 826, Caltech Concurrent Computation Program

Moscato P (2003) A gentle introduction to memetic algorithms. In: Handbook of Metaheuristics. Kluwer Academic Publishers, Dordrecht, pp 105–144

Nguyen QH, Ong Y-S, Lim MH (2009) A probabilistic memetic framework. IEEE Trans Evolut Comput 13(3):604–623CrossRef

Ong YS, Keane A (2004) Meta-lamarckian learning in memetic algorithms. IEEE Trans Evolut Comput 8(2):99–110CrossRef

Pham DT, Karaboga D (1999) Training elman and jordan networks for system identification using genetic algorithms. Artif Intell Eng 13(2):107–117CrossRef

Potter MA, De Jong KA (2000) Cooperative coevolution: An architecture for evolving coadapted subcomponents. Evol Comput 8(1):1–29CrossRef

Potter MA, Jong KAD (1994) A cooperative coevolutionary approach to function optimization. Proceedings of the International Conference on Evolutionary Computation. The Third Conference on Parallel Problem Solving from Nature. Springer, London, UK, PPSN III, pp 249–257

Pošik P (2009) Bbob-benchmarking the generalized generation gap model with parent centric crossover. In: Proceedings of the 11th annual conference companion on genetic and evolutionary computation conference: late breaking papers. GECCO ’09, pp 2321–2328

Robinson T (1994) An application of recurrent nets to phone probability estimation. IEEE Trans Neural Netw 5:298–305CrossRef

Seyab RA, Cao Y (2008) Nonlinear system identification for predictive control using continuous time recurrent neural networks and automatic differentiation. J Process Control 18(6):568–581CrossRef

Smith J (2007) Coevolving memetic algorithms: a review and progress report. IEEE Trans Syst Man Cybern Part B Cybern 37(1):6–17CrossRef

Tang J, Lim MH, Ong YS (2007) Diversity-adaptive parallel memetic algorithm for solving large scale combinatorial optimization problems. Soft Comput 11(9):873–888CrossRef

Tomita M (1982) Dynamic construction of finite automata from examples using hill-climbing. Proceedings of the fourth annual cognitive science Conference. MI, Ann Arbor, pp 105–108

Watts DJ (1999) Small worlds: The dynamics of networks between order and randomness. Princeton University Press, Princeton

Zhou Z, Ong YS, Lim MH, Lee BS (2007) Memetic algorithm using multi-surrogates for computationally expensive optimization problems. Soft Comput 11(10):957–971

Title: Memetic cooperative coevolution of Elman recurrent neural networks
Author: Rohitash Chandra
Publication date: 01-08-2014
Publisher: Springer Berlin Heidelberg
Published in: Soft Computing / Issue 8/2014
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI: https://doi.org/10.1007/s00500-013-1160-1

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Other articles of this Issue 8/2014

Using MOEA/D for optimizing ontology alignments

An implementation of improved harmony search algorithm for scenario-based transmission expansion planning

Metaheuristic algorithms for the design of multiplier-less non-uniform filter banks based on frequency response masking

Neural-network-based approach to finite-time optimal control for a class of unknown nonlinear systems

A generalized computing paradigm based on artificial dynamic models for mathematical programming

Robust on-line neural learning classifier system for data stream classification tasks

Premium Partner