Top

Soft Computing

Published in:

01-02-2011 | Original Paper

Integration of supervised ART-based neural networks with a hybrid genetic algorithm

Authors: Shing Chiang Tan, Chee Peng Lim

Published in: Soft Computing | Issue 2/2011

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In this paper, two evolutionary artificial neural network (EANN) models that are based on integration of two supervised adaptive resonance theory (ART)-based artificial neural networks with a hybrid genetic algorithm (HGA) are proposed. The search process of the proposed EANN models is guided by a knowledge base established by ART with respect to the training data samples. The EANN models explore the search space for “coarse” solutions, and such solutions are then refined using the local search process of the HGA. The performances of the proposed EANN models are evaluated and compared with those from other classifiers using more than ten benchmark data sets. The applicability of the EANN models to a real medical classification task is also demonstrated. The results from the experimental studies demonstrate the effectiveness and usefulness of the proposed EANN models in undertaking pattern classification problems.

next article A neural network-based multi-agent classifier system with a Bayesian formalism for trust measurement

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Ang JH, Tan KC, Mamum AA (2010) An evolutionary memetic algorithm for rule extraction. Expert Syst Appl 37:1302–1315CrossRef

Angeline PJ, Saunders GM, Pollack JB (1994) An evolutionary algorithm that constructs recurrent neural networks. IEEE Trans Neural Netw 5:54–65CrossRef

Asuncion A, Newman DJ (2007) UCI machine learning repository. (http://www.ics.uci.edu/~mlearn/MLRepository.html). University of California, School of Information and Computer Science, Irvine

Baskar S, Subraraj P, Rao MVC (2001) Performance of hybrid real coded genetic algorithms. Int J Comput Eng Sci 2:583–602CrossRef

Battiti R, Tecchiolli G (1995) Training neural nets with the reactive tabu search. IEEE Trans Neural Netw 6:1185–1200CrossRef

Caponio A, Cascella GL, Neri F, Salvatore N, Sumner M (2007) A fast adaptive memetic algorithm for online and offline control design of pmsm drives. IEEE Trans Syst Man Cybern Part B Cybern 37:28–41CrossRef

Carpenter GA, Grossberg S (1987) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Graph Image Process 37:54–115CrossRef

Carpenter GA, Grossberg S (1988) The ART of adaptive pattern recognition by a self-organising neural network. IEEE Comput 21:77–88

Carpenter GA, Grossberg S, Markuzon N, Reynolds J, Rosen D (1992) Fuzzy ARTMAP: a neural network architecture for incremental learning of analog multidimensional maps. IEEE Trans Neural Netw 3:698–713CrossRef

Créput J-C, Koukam A (2008) The memetic self-organizing map approach to the vehicle routing problem. Soft Comput 12:1125–1141CrossRef

De Falco I, Iazzetta A, Natale P, Tarantino E (1998) Evolutionary neural networks for nonlinear dynamics modeling. In: Parallel problem solving from nature 98. Lectures Notes in Computer Science, vol 1498, Springer, Berlin, pp 593–602

Efron B (1979) Bootstrap methods: another look at the Jackknife. Ann Stat 7:1–26MATHCrossRefMathSciNet

Funabiki N, Kitamichi J, Nishikawa S (1998) An evolutionary neural network approach for module orientation problems. IEEE Trans Syst Man Cybernet B 28:849–855CrossRef

Gallardo JE, Cotta C, Fernández AJ (2007) On the hybridization of memetic algorithms with branch-and-bound techniques. IEEE Trans Syst Man Cybern Part B Cybern 37:77–83CrossRef

García-Pedrajas N, Ortiz-Boyer D, Hervás-Martínez C (2006) An alternative approach for neural network evolution with a genetic algorithm: crossover by combinatorial optimization. Neural Netw 19:514–528MATHCrossRef

Gen M, Yun YS (2006) Soft computing approach for reliability optimization: state-of-the-art survey. Reliab Eng Syst Saf 91:1008–1026CrossRef

González J, Rojas I, Ortega J, Pomares H, Fernández FJ, Diaz AF (2003) Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation. IEEE Trans Neural Netw 14:1478–1495CrossRef

Guo L, Huang D-S, Zhao W (2003) Combining genetic optimization with hybrid learning algorithm for radial basis function neural networks. Electron Lett 39:1600–1601

Holland JH (1962) Outline for a logical theory of adaptive systems. J ACM 3:297–314CrossRef

Huber K-P, Berthold MR (1995) Building precise classifiers with automatic rule extraction. Proc IEEE Int Conf Neural Netw 3:1263–1268CrossRef

Jin Y-C, Branke J (2005) Evolutionary optimization in uncertain environments—a survey. IEEE Trans Evol Comput 9:303–317CrossRef

Karzarlis SA, Papadakis SE, Theocharis JB, Petridis V (2001) Microgenetic algorithms as generalized hill-climbing operators for GA optimization. IEEE Trans Evol Comput 5:204–217CrossRef

Krasnogor N, Smith J (2005) A tutorial for competent memetic algorithms: model, taxonomy, and design issues. IEEE Trans Evol Comput 9:474–487CrossRef

Leung FHF, Lam HK, Ling SH, Tam PKS (2003) Tuning of the structure and parameters of a neural network using an improved genetic algorithm. IEEE Trans Neural Netw 14:79–88CrossRef

Lim CP, Harrison RF (1997) An incremental adaptive network for on-line supervised learning and probability estimation. Neural Netw 10:925–939CrossRef

Lim CP, Quek SS, Peh KK (2003) Prediction of drug release profiles using an intelligent learning system: an experimental study in transdermal iontophoresis. J Pharm Biomed Anal 31:159–168CrossRef

Ling SH, Leung FHF (2007) An improved genetic algorithm with average-bound crossover and wavelet mutation operations. Soft Comput 11:7–31MATHCrossRef

Ling SH, Leung FHF, Lam HK (2007) Input-dependent neural network trained by real-coded genetic algorithm and its industrial applications. Soft Comput 11:1033–1052CrossRef

Liu Z-J, Liu A-X, Wang C-Y, Niu Z (2004) Evolving neural network using real coded genetic algorithm (GA) for multispectral image classification. Future Gener Comput Syst 20:1119–1129CrossRef

Liu B, Wang L, Jin Y-H (2007a) An effective pso-based memetic algorithm for flow shop scheduling. IEEE Trans Syst Man Cybern Part B Cybern 37:18–27CrossRef

Liu D, Tan KC, Goh CK, Ho WK (2007b) A multiobjective memetic algorithm based on particle swarm optimization. IEEE Trans Syst Man Cybern Part B Cybern 37:42–50CrossRef

Montgomery DC (1997) Design and analysis of experiments. Arizona State University, WileyMATH

Muni DP, Pal NR, Das J (2006) Genetic programming for simultaneous feature selection and classifier design. IEEE Trans Syst Man Cybernet B 36:106–117CrossRef

Negnevitsky M (2005) Artificial intelligence: a guide to intelligent systems, 2nd edn. Addison, Wesley

Nguyen HD, Yoshihara I, Yamamori K, Yasunaga M (2007) Implementation of an effective hybrid ga for large-scale travelling salesman problems. IEEE Trans Syst Man Cybern Part B Cybern 37:92–99CrossRef

O’Neill M, Brabazon A (2008) Self-organising swarm (SOSwarm). Soft Comput 12:1073–1080CrossRef

Oh S-K, Pedrycz W, Pak H-S (2004) Hybrid identification in fuzzy-neural networks. Fuzzy Set Syst 138:399–426CrossRef

Ong Y-S, Keane AJ (2004) Meta-Lamarckian learning in memetic algorithm. IEEE Trans Evol Comput 8:99–110CrossRef

Ong Y-S, Nair PB, Keane AJ (2003) Evolutionary optimization of computationally expensive problems via surrogate modelling. Am Inst Aeron Astron J 41:687–696

Ong Y-S, Lim MH, Zhu N, Wong KW (2006) Classification of adaptive memetic algorithms: a comparative study. IEEE Trans Syst Man Cybern Part B Cybern 36:141–152

Paetz J (2004) Reducing the number of neurons in radial basis function networks with dynamic decay adjustment. Neurocomputing 62:79–91CrossRef

Perez CA, Salinas CA, Estevez PA, Valenzuela PM (2003) Genetic design of biologically inspired receptive fields for neural pattern recognition. IEEE Trans Syst Man Cybernet B 33:258–270CrossRef

Rao HS, Ggorpade VG, Mukherjee A (2006) A genetic algorithm based back propagation network for simulation of stress-strain response of ceramic-matrix-composites. Comput Struct 84:330–339CrossRef

Salcedo-Sanz S, Bousoño-Calzón C (2001) A portable and scalable algorithm for a class of constrained combinatorial optimization problems. Comput Oper Res 32:2671–2687CrossRef

Salcedo-Sanz S, Santiago-Mozos R, Bousono-Calzon C (2004) A hybrid Hopfield network-simulated annealing approach for frequency assignment in satellite communications systems. IEEE Trans Syst Man Cybern Part B Cybern 34:1108–1116CrossRef

Smith JE (2007) Coevolving memetic algorithms: a review and progress report. IEEE Trans Syst Man Cybern Part B Cybern 37:6–17CrossRef

Stanley KO, Miillulainen R (2002) Evolving neural networks through augmenting topologies. Evol Comput 10:99–127CrossRef

Tan SC, Rao MVC, Lim CP (2008) Fuzzy artmap dynamic decay adjustment: an improved fuzzy artmap model with a conflict resolving facility. Appl Soft Comput 8:543–554CrossRef

Tang M, Yao X (2007) A memetic algorirhm for VLSI floorplanning. IEEE Trans Syst Man Cybern Part B Cybern 37:62–69CrossRef

Tenne Y, Armfield SW (2009) A framework for memetic optimization using variable global and local surrogate models. Soft Comput 13:781–793CrossRef

Tse S-M, Liang Y, Leung K-S, Lee K-H, Mok TS-K (2007) A memetic algorithm for multiple-drug cancer chemotherapy schedule optimization. IEEE Trans Syst Man Cybern Part B Cybern 37:84–91CrossRef

Yao X (1999) Evolving artificial neural networks. Proc IEEE 87:1423–1447CrossRef

Yao X, Liu Y (1998) Making use of population information in evolutionary artificial neural networks. IEEE Trans Syst Man Cybernet B 28:417–425

Zhang Q, Sun J, Xiao G, Tsang E (2007) Evolutionary algorithms refining a heuristic: a hybrid method for shared-path protections in wdm networks under srlg constraints. IEEE Trans Syst Man Cybern Part B Cybern 37:51–61MATHCrossRef

Zhao X-Q, Huang D-S (2007) A mended hybrid learning algorithm for radial basis function networks to improve generalization capability. Appl Math Model 31:1271–1281MATHCrossRef

Zhu Z, Ong Y-S, Dash M (2007) Wrapper-filter feature selection algorithm using a memetic framework. IEEE Trans Syst Man Cybern Part B Cybern 37:70–76CrossRef

Title: Integration of supervised ART-based neural networks with a hybrid genetic algorithm
Authors: Shing Chiang Tan
Chee Peng Lim
Publication date: 01-02-2011
Publisher: Springer-Verlag
Published in: Soft Computing / Issue 2/2011
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI: https://doi.org/10.1007/s00500-010-0679-7

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Other articles of this Issue 2/2011

State operators on GMV algebras

Solving multiple instances at once: the role of search and adaptation

Erratum to: A definition for I-fuzzy partitions

Automata theory based on lattice-ordered semirings

Heuristic search for optimizing diffusion of influence in a social network under the resource constraint

Learning a tensor subspace for semi-supervised dimensionality reduction

Premium Partner