nach oben

Soft Computing

Erschienen in:

01.02.2011 | Original Paper

Integration of supervised ART-based neural networks with a hybrid genetic algorithm

verfasst von: Shing Chiang Tan, Chee Peng Lim

Erschienen in: Soft Computing | Ausgabe 2/2011

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

In this paper, two evolutionary artificial neural network (EANN) models that are based on integration of two supervised adaptive resonance theory (ART)-based artificial neural networks with a hybrid genetic algorithm (HGA) are proposed. The search process of the proposed EANN models is guided by a knowledge base established by ART with respect to the training data samples. The EANN models explore the search space for “coarse” solutions, and such solutions are then refined using the local search process of the HGA. The performances of the proposed EANN models are evaluated and compared with those from other classifiers using more than ten benchmark data sets. The applicability of the EANN models to a real medical classification task is also demonstrated. The results from the experimental studies demonstrate the effectiveness and usefulness of the proposed EANN models in undertaking pattern classification problems.

Nächster Artikel A neural network-based multi-agent classifier system with a Bayesian formalism for trust measurement

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Ang JH, Tan KC, Mamum AA (2010) An evolutionary memetic algorithm for rule extraction. Expert Syst Appl 37:1302–1315CrossRef

Angeline PJ, Saunders GM, Pollack JB (1994) An evolutionary algorithm that constructs recurrent neural networks. IEEE Trans Neural Netw 5:54–65CrossRef

Asuncion A, Newman DJ (2007) UCI machine learning repository. (http://www.ics.uci.edu/~mlearn/MLRepository.html). University of California, School of Information and Computer Science, Irvine

Baskar S, Subraraj P, Rao MVC (2001) Performance of hybrid real coded genetic algorithms. Int J Comput Eng Sci 2:583–602CrossRef

Battiti R, Tecchiolli G (1995) Training neural nets with the reactive tabu search. IEEE Trans Neural Netw 6:1185–1200CrossRef

Caponio A, Cascella GL, Neri F, Salvatore N, Sumner M (2007) A fast adaptive memetic algorithm for online and offline control design of pmsm drives. IEEE Trans Syst Man Cybern Part B Cybern 37:28–41CrossRef

Carpenter GA, Grossberg S (1987) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Graph Image Process 37:54–115CrossRef

Carpenter GA, Grossberg S (1988) The ART of adaptive pattern recognition by a self-organising neural network. IEEE Comput 21:77–88

Carpenter GA, Grossberg S, Markuzon N, Reynolds J, Rosen D (1992) Fuzzy ARTMAP: a neural network architecture for incremental learning of analog multidimensional maps. IEEE Trans Neural Netw 3:698–713CrossRef

Créput J-C, Koukam A (2008) The memetic self-organizing map approach to the vehicle routing problem. Soft Comput 12:1125–1141CrossRef

De Falco I, Iazzetta A, Natale P, Tarantino E (1998) Evolutionary neural networks for nonlinear dynamics modeling. In: Parallel problem solving from nature 98. Lectures Notes in Computer Science, vol 1498, Springer, Berlin, pp 593–602

Efron B (1979) Bootstrap methods: another look at the Jackknife. Ann Stat 7:1–26MATHCrossRefMathSciNet

Funabiki N, Kitamichi J, Nishikawa S (1998) An evolutionary neural network approach for module orientation problems. IEEE Trans Syst Man Cybernet B 28:849–855CrossRef

Gallardo JE, Cotta C, Fernández AJ (2007) On the hybridization of memetic algorithms with branch-and-bound techniques. IEEE Trans Syst Man Cybern Part B Cybern 37:77–83CrossRef

García-Pedrajas N, Ortiz-Boyer D, Hervás-Martínez C (2006) An alternative approach for neural network evolution with a genetic algorithm: crossover by combinatorial optimization. Neural Netw 19:514–528MATHCrossRef

Gen M, Yun YS (2006) Soft computing approach for reliability optimization: state-of-the-art survey. Reliab Eng Syst Saf 91:1008–1026CrossRef

González J, Rojas I, Ortega J, Pomares H, Fernández FJ, Diaz AF (2003) Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation. IEEE Trans Neural Netw 14:1478–1495CrossRef

Guo L, Huang D-S, Zhao W (2003) Combining genetic optimization with hybrid learning algorithm for radial basis function neural networks. Electron Lett 39:1600–1601

Holland JH (1962) Outline for a logical theory of adaptive systems. J ACM 3:297–314CrossRef

Huber K-P, Berthold MR (1995) Building precise classifiers with automatic rule extraction. Proc IEEE Int Conf Neural Netw 3:1263–1268CrossRef

Jin Y-C, Branke J (2005) Evolutionary optimization in uncertain environments—a survey. IEEE Trans Evol Comput 9:303–317CrossRef

Karzarlis SA, Papadakis SE, Theocharis JB, Petridis V (2001) Microgenetic algorithms as generalized hill-climbing operators for GA optimization. IEEE Trans Evol Comput 5:204–217CrossRef

Krasnogor N, Smith J (2005) A tutorial for competent memetic algorithms: model, taxonomy, and design issues. IEEE Trans Evol Comput 9:474–487CrossRef

Leung FHF, Lam HK, Ling SH, Tam PKS (2003) Tuning of the structure and parameters of a neural network using an improved genetic algorithm. IEEE Trans Neural Netw 14:79–88CrossRef

Lim CP, Harrison RF (1997) An incremental adaptive network for on-line supervised learning and probability estimation. Neural Netw 10:925–939CrossRef

Lim CP, Quek SS, Peh KK (2003) Prediction of drug release profiles using an intelligent learning system: an experimental study in transdermal iontophoresis. J Pharm Biomed Anal 31:159–168CrossRef

Ling SH, Leung FHF (2007) An improved genetic algorithm with average-bound crossover and wavelet mutation operations. Soft Comput 11:7–31MATHCrossRef

Ling SH, Leung FHF, Lam HK (2007) Input-dependent neural network trained by real-coded genetic algorithm and its industrial applications. Soft Comput 11:1033–1052CrossRef

Liu Z-J, Liu A-X, Wang C-Y, Niu Z (2004) Evolving neural network using real coded genetic algorithm (GA) for multispectral image classification. Future Gener Comput Syst 20:1119–1129CrossRef

Liu B, Wang L, Jin Y-H (2007a) An effective pso-based memetic algorithm for flow shop scheduling. IEEE Trans Syst Man Cybern Part B Cybern 37:18–27CrossRef

Liu D, Tan KC, Goh CK, Ho WK (2007b) A multiobjective memetic algorithm based on particle swarm optimization. IEEE Trans Syst Man Cybern Part B Cybern 37:42–50CrossRef

Montgomery DC (1997) Design and analysis of experiments. Arizona State University, WileyMATH

Muni DP, Pal NR, Das J (2006) Genetic programming for simultaneous feature selection and classifier design. IEEE Trans Syst Man Cybernet B 36:106–117CrossRef

Negnevitsky M (2005) Artificial intelligence: a guide to intelligent systems, 2nd edn. Addison, Wesley

Nguyen HD, Yoshihara I, Yamamori K, Yasunaga M (2007) Implementation of an effective hybrid ga for large-scale travelling salesman problems. IEEE Trans Syst Man Cybern Part B Cybern 37:92–99CrossRef

O’Neill M, Brabazon A (2008) Self-organising swarm (SOSwarm). Soft Comput 12:1073–1080CrossRef

Oh S-K, Pedrycz W, Pak H-S (2004) Hybrid identification in fuzzy-neural networks. Fuzzy Set Syst 138:399–426CrossRef

Ong Y-S, Keane AJ (2004) Meta-Lamarckian learning in memetic algorithm. IEEE Trans Evol Comput 8:99–110CrossRef

Ong Y-S, Nair PB, Keane AJ (2003) Evolutionary optimization of computationally expensive problems via surrogate modelling. Am Inst Aeron Astron J 41:687–696

Ong Y-S, Lim MH, Zhu N, Wong KW (2006) Classification of adaptive memetic algorithms: a comparative study. IEEE Trans Syst Man Cybern Part B Cybern 36:141–152

Paetz J (2004) Reducing the number of neurons in radial basis function networks with dynamic decay adjustment. Neurocomputing 62:79–91CrossRef

Perez CA, Salinas CA, Estevez PA, Valenzuela PM (2003) Genetic design of biologically inspired receptive fields for neural pattern recognition. IEEE Trans Syst Man Cybernet B 33:258–270CrossRef

Rao HS, Ggorpade VG, Mukherjee A (2006) A genetic algorithm based back propagation network for simulation of stress-strain response of ceramic-matrix-composites. Comput Struct 84:330–339CrossRef

Salcedo-Sanz S, Bousoño-Calzón C (2001) A portable and scalable algorithm for a class of constrained combinatorial optimization problems. Comput Oper Res 32:2671–2687CrossRef

Salcedo-Sanz S, Santiago-Mozos R, Bousono-Calzon C (2004) A hybrid Hopfield network-simulated annealing approach for frequency assignment in satellite communications systems. IEEE Trans Syst Man Cybern Part B Cybern 34:1108–1116CrossRef

Smith JE (2007) Coevolving memetic algorithms: a review and progress report. IEEE Trans Syst Man Cybern Part B Cybern 37:6–17CrossRef

Stanley KO, Miillulainen R (2002) Evolving neural networks through augmenting topologies. Evol Comput 10:99–127CrossRef

Tan SC, Rao MVC, Lim CP (2008) Fuzzy artmap dynamic decay adjustment: an improved fuzzy artmap model with a conflict resolving facility. Appl Soft Comput 8:543–554CrossRef

Tang M, Yao X (2007) A memetic algorirhm for VLSI floorplanning. IEEE Trans Syst Man Cybern Part B Cybern 37:62–69CrossRef

Tenne Y, Armfield SW (2009) A framework for memetic optimization using variable global and local surrogate models. Soft Comput 13:781–793CrossRef

Tse S-M, Liang Y, Leung K-S, Lee K-H, Mok TS-K (2007) A memetic algorithm for multiple-drug cancer chemotherapy schedule optimization. IEEE Trans Syst Man Cybern Part B Cybern 37:84–91CrossRef

Yao X (1999) Evolving artificial neural networks. Proc IEEE 87:1423–1447CrossRef

Yao X, Liu Y (1998) Making use of population information in evolutionary artificial neural networks. IEEE Trans Syst Man Cybernet B 28:417–425

Zhang Q, Sun J, Xiao G, Tsang E (2007) Evolutionary algorithms refining a heuristic: a hybrid method for shared-path protections in wdm networks under srlg constraints. IEEE Trans Syst Man Cybern Part B Cybern 37:51–61MATHCrossRef

Zhao X-Q, Huang D-S (2007) A mended hybrid learning algorithm for radial basis function networks to improve generalization capability. Appl Math Model 31:1271–1281MATHCrossRef

Zhu Z, Ong Y-S, Dash M (2007) Wrapper-filter feature selection algorithm using a memetic framework. IEEE Trans Syst Man Cybern Part B Cybern 37:70–76CrossRef

Titel: Integration of supervised ART-based neural networks with a hybrid genetic algorithm
verfasst von: Shing Chiang Tan
Chee Peng Lim
Publikationsdatum: 01.02.2011
Verlag: Springer-Verlag
Erschienen in: Soft Computing / Ausgabe 2/2011
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI: https://doi.org/10.1007/s00500-010-0679-7

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 2/2011

Automata theory based on lattice-ordered semirings

State operators on GMV algebras

A neural network-based multi-agent classifier system with a Bayesian formalism for trust measurement

Minimax mean-variance models for fuzzy portfolio selection

Learning a tensor subspace for semi-supervised dimensionality reduction

A memetic algorithm for the cyclic antibandwidth maximization problem