Skip to main content
Erschienen in: Evolutionary Intelligence 1-2/2009

01.11.2009 | Special Issue

Evolutionary parallel and gradually distributed lateral tuning of fuzzy rule-based systems

verfasst von: I. Robles, R. Alcalá, J. M. Benítez, F. Herrera

Erschienen in: Evolutionary Intelligence | Ausgabe 1-2/2009

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The tuning of Fuzzy Rule-Based Systems is often applied to improve their performance as a post-processing stage once an initial set of fuzzy rules has been extracted. This optimization problem can become a hard one when the size of the considered system in terms of the number of variables, rules and, particularly, data samples is big. Distributed Genetic Algorithms are excellent optimization algorithms which exploit the nowadays available parallel hardware (multicore microprocessors and clusters) and could help to alleviate this growth in complexity. In this work, we present a study on the use of the Distributed Genetic Algorithms for the tuning of Fuzzy Rule-Based Systems. To this end, we analyze the application of a specific Gradual Distributed Real-Coded Genetic Algorithm which employs eight subpopulations in a hypercube topology and local parallelization at each subpopulation. We tested our approach on nine real-world datasets of different sizes and with different numbers of variables. The empirical performance in solution quality and computing time is assessed by comparing its results with those from a highly effective sequential tuning algorithm. The results show that the distributed approach achieves better results in terms of quality and execution time as the complexity of the problem grows.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Driankow D, Hellendoorn H, Reinfrank M (1993) An introduction to fuzzy control. Springer, Berlin Driankow D, Hellendoorn H, Reinfrank M (1993) An introduction to fuzzy control. Springer, Berlin
2.
Zurück zum Zitat Ishibuchi H, Nakashima T, Nii M (2004) Classification and modeling with linguistic information granules: advances approaches to linguistic data mining. Springer, Berlin Ishibuchi H, Nakashima T, Nii M (2004) Classification and modeling with linguistic information granules: advances approaches to linguistic data mining. Springer, Berlin
3.
Zurück zum Zitat Palm R, Driankov D, Hellendoorn (1997) Model based fuzzy control. Springer, Berlin Palm R, Driankov D, Hellendoorn (1997) Model based fuzzy control. Springer, Berlin
4.
Zurück zum Zitat Pedrycz W (1996) Fuzzy modelling: paradigms and practice. Kluwer, NorwellMATH Pedrycz W (1996) Fuzzy modelling: paradigms and practice. Kluwer, NorwellMATH
6.
Zurück zum Zitat Zadeh LA (1973) Outline of a new approach to the analysis of complex systems and decision processes. IEEE Trans Syst Man Cybern 3: 28–44MATHMathSciNet Zadeh LA (1973) Outline of a new approach to the analysis of complex systems and decision processes. IEEE Trans Syst Man Cybern 3: 28–44MATHMathSciNet
7.
Zurück zum Zitat Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, New YorkMATH Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, New YorkMATH
8.
Zurück zum Zitat Holland JH (1992) Adaptation in natural and artificial systems (The University of Michigan Press 1975). MIT, London Holland JH (1992) Adaptation in natural and artificial systems (The University of Michigan Press 1975). MIT, London
9.
Zurück zum Zitat Cordón O, Gomide F, Herrera F, Hoffmann F, Magdalena L (2004) Ten years of genetic fuzzy systems: current work and new trends. Fuzzy Sets Syst 141(1): 5–31MATHCrossRef Cordón O, Gomide F, Herrera F, Hoffmann F, Magdalena L (2004) Ten years of genetic fuzzy systems: current work and new trends. Fuzzy Sets Syst 141(1): 5–31MATHCrossRef
10.
Zurück zum Zitat Cordón O, Herrera F, Hoffmann F, Magdalena L (2001) Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases. World Scientific, SingaporeMATH Cordón O, Herrera F, Hoffmann F, Magdalena L (2001) Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases. World Scientific, SingaporeMATH
11.
Zurück zum Zitat Herrera F (2008) Genetic fuzzy systems: taxonomy, current research trends and prospects. Evol Intell 1: 27–46CrossRef Herrera F (2008) Genetic fuzzy systems: taxonomy, current research trends and prospects. Evol Intell 1: 27–46CrossRef
12.
Zurück zum Zitat Eiben AE, Smith JE (2003) Introduction to evolutionary computation. Springer, Berlin Eiben AE, Smith JE (2003) Introduction to evolutionary computation. Springer, Berlin
13.
Zurück zum Zitat Zadeh LA (1975) The concept of a linguistic variable and its applications to approximate reasoning, parts i, ii and iii. Inf Sci 8(8 and 9):199–249, 301–357, 43–80 Zadeh LA (1975) The concept of a linguistic variable and its applications to approximate reasoning, parts i, ii and iii. Inf Sci 8(8 and 9):199–249, 301–357, 43–80
14.
Zurück zum Zitat Alcalá R, Alcalá-Fdez J, Casillas J, Cordón O, Herrera F (2006) Hybrid learning models to get the interpretability-accuracy trade-off in fuzzy modeling. Soft Comput 10(9):717–734CrossRef Alcalá R, Alcalá-Fdez J, Casillas J, Cordón O, Herrera F (2006) Hybrid learning models to get the interpretability-accuracy trade-off in fuzzy modeling. Soft Comput 10(9):717–734CrossRef
15.
Zurück zum Zitat Alcalá R, Alcalá-Fdez J, Herrera F (2007) A proposal for the genetic lateral tuning of linguistic fuzzy systems and its interaction with rule selection. IEEE Trans Fuzzy Syst 15(4):616–635CrossRef Alcalá R, Alcalá-Fdez J, Herrera F (2007) A proposal for the genetic lateral tuning of linguistic fuzzy systems and its interaction with rule selection. IEEE Trans Fuzzy Syst 15(4):616–635CrossRef
16.
Zurück zum Zitat Casillas J, Cordón O, del Jesus MJ, Herrera F (2003) Accuracy improvements in linguistic fuzzy modeling. Springer, BerlinMATH Casillas J, Cordón O, del Jesus MJ, Herrera F (2003) Accuracy improvements in linguistic fuzzy modeling. Springer, BerlinMATH
17.
Zurück zum Zitat Casillas J, Cordón O, del Jesus MJ, Herrera F (2005) Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction. IEEE Trans Fuzzy Syst 13(1):13–29CrossRef Casillas J, Cordón O, del Jesus MJ, Herrera F (2005) Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction. IEEE Trans Fuzzy Syst 13(1):13–29CrossRef
18.
Zurück zum Zitat Herrera F, Lozano M, Verdegay JL (1995) Tuning fuzzy logic controllers by genetic algorithms. Int J Approx Reason 12:299–315MATHCrossRefMathSciNet Herrera F, Lozano M, Verdegay JL (1995) Tuning fuzzy logic controllers by genetic algorithms. Int J Approx Reason 12:299–315MATHCrossRefMathSciNet
19.
Zurück zum Zitat Karr C (1991) Genetic algorithms for fuzzy controllers. AI Expert 6(2):26–33 Karr C (1991) Genetic algorithms for fuzzy controllers. AI Expert 6(2):26–33
20.
Zurück zum Zitat Alba E (2005) Parallel metaheuristics: a new class of algorithms. Wiley, New YorkMATH Alba E (2005) Parallel metaheuristics: a new class of algorithms. Wiley, New YorkMATH
21.
Zurück zum Zitat Cantu-Paz E (2000) Efficient and accurate parallel genetic algorithms. Kluwer, NorwellMATH Cantu-Paz E (2000) Efficient and accurate parallel genetic algorithms. Kluwer, NorwellMATH
22.
Zurück zum Zitat de Vega FF, Cantu-Paz E (2008) Special issue on distributed bioinspired algorithms. Soft Comput 12(12):1143–1144CrossRef de Vega FF, Cantu-Paz E (2008) Special issue on distributed bioinspired algorithms. Soft Comput 12(12):1143–1144CrossRef
23.
Zurück zum Zitat Dowd K, Severance C (1998) High performance computing. O’Reilly, Sebastopol Dowd K, Severance C (1998) High performance computing. O’Reilly, Sebastopol
24.
Zurück zum Zitat Spector DHM (2000) Building Linux clusters. O’Reilly, Sebastopol Spector DHM (2000) Building Linux clusters. O’Reilly, Sebastopol
25.
Zurück zum Zitat Sterling T, Becker DJ, Savarese DF (1999) How to build a beowulf: a guide to the implementation and application of PC clusters. MIT, Cambridge Sterling T, Becker DJ, Savarese DF (1999) How to build a beowulf: a guide to the implementation and application of PC clusters. MIT, Cambridge
26.
Zurück zum Zitat Robles I, Alcalá R, Benítez JM, Herrera F (2009) Distributed genetic tuning of fuzzy rule-based systems. In: Proceedings of the international fuzzy systems association—European society for fuzzy logic and technology (IFSA-EUSFLAT) congress (in press) Robles I, Alcalá R, Benítez JM, Herrera F (2009) Distributed genetic tuning of fuzzy rule-based systems. In: Proceedings of the international fuzzy systems association—European society for fuzzy logic and technology (IFSA-EUSFLAT) congress (in press)
27.
Zurück zum Zitat Herrera F, Lozano M (2000) Gradual distributed real-coded genetic algorithms. IEEE Trans Evol Comput 4(1): 43–63CrossRef Herrera F, Lozano M (2000) Gradual distributed real-coded genetic algorithms. IEEE Trans Evol Comput 4(1): 43–63CrossRef
28.
Zurück zum Zitat Herrera F, Martínez L (2000) A 2-tuple fuzzy linguistic representation model for computing with words. IEEE Trans Fuzzy Syst 8(6): 746–752CrossRef Herrera F, Martínez L (2000) A 2-tuple fuzzy linguistic representation model for computing with words. IEEE Trans Fuzzy Syst 8(6): 746–752CrossRef
29.
Zurück zum Zitat Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNet Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNet
30.
Zurück zum Zitat García S, Fernández A, Luengo J, Herrera F (2009) A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability. Soft Comput 13(10):959–977CrossRef García S, Fernández A, Luengo J, Herrera F (2009) A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability. Soft Comput 13(10):959–977CrossRef
31.
Zurück zum Zitat García S, Herrera F (2008) An extension on “statistical comparisons of classifiers over multiple data sets” for all pairwise comparisons. J Mach Learn Res 9: 2579–2596 García S, Herrera F (2008) An extension on “statistical comparisons of classifiers over multiple data sets” for all pairwise comparisons. J Mach Learn Res 9: 2579–2596
32.
Zurück zum Zitat García S, Molina D, Lozano M, Herrera F (2009) A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 special session on real parameter optimization. J Heuristics (in press). doi:10.1007/s10732-008-9080-4 García S, Molina D, Lozano M, Herrera F (2009) A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 special session on real parameter optimization. J Heuristics (in press). doi:10.​1007/​s10732-008-9080-4
33.
Zurück zum Zitat Bäck T, Beielstein T (1995) User’s group meeting. In: Proceedings of the EuroPVM95: second European PVM, pp 277–282 Bäck T, Beielstein T (1995) User’s group meeting. In: Proceedings of the EuroPVM95: second European PVM, pp 277–282
34.
Zurück zum Zitat Punch W, Goodman E, Pei M, Chai-shun L, Hovland P, Enbody R (1993) Further research on feature selection and classification using genetic algorithms. In: Forrest S (ed) Proceedings of the fifth international conference on genetic algorithms, pp 557–564 Punch W, Goodman E, Pei M, Chai-shun L, Hovland P, Enbody R (1993) Further research on feature selection and classification using genetic algorithms. In: Forrest S (ed) Proceedings of the fifth international conference on genetic algorithms, pp 557–564
35.
Zurück zum Zitat Alba E, Dorronsoro B (2008) Cellular genetic algorithms. Springer, BerlinMATH Alba E, Dorronsoro B (2008) Cellular genetic algorithms. Springer, BerlinMATH
36.
Zurück zum Zitat Alba E, Luna F, Nebro A, Troya JM (2004) Parallel heterogeneous genetic algorithms for continuous optimization. Parallel Comput 30(5): 699–719CrossRef Alba E, Luna F, Nebro A, Troya JM (2004) Parallel heterogeneous genetic algorithms for continuous optimization. Parallel Comput 30(5): 699–719CrossRef
37.
Zurück zum Zitat Lin SC, III, WFP, Goodman ED (1994) Coarse-grain parallel genetic algorithms: categorization and new approach. In: Proceedings of the sixth IEEE parallel and distributed processing, pp 28–37 Lin SC, III, WFP, Goodman ED (1994) Coarse-grain parallel genetic algorithms: categorization and new approach. In: Proceedings of the sixth IEEE parallel and distributed processing, pp 28–37
38.
Zurück zum Zitat Mülhlenbein H, Schomisch M, Born J (1991) The parallel genetic algorithm as function optimizer. Parallel Comput 17(6): 619–632CrossRef Mülhlenbein H, Schomisch M, Born J (1991) The parallel genetic algorithm as function optimizer. Parallel Comput 17(6): 619–632CrossRef
39.
Zurück zum Zitat Schlierkamp-Voosen D, Mülhlenbein H (1994) Strategy adaptation by competing subpopulations. In: Parallel solving from nature (PPSN III). Springer, Berlin, pp 199–208 Schlierkamp-Voosen D, Mülhlenbein H (1994) Strategy adaptation by competing subpopulations. In: Parallel solving from nature (PPSN III). Springer, Berlin, pp 199–208
40.
Zurück zum Zitat Schnecke V, Vornberger O (1996) An adaptative parallel algorithm for vlsi-layout optimization. In: Parallel problem solving from nature (PPSN IV), pp 22–27 Schnecke V, Vornberger O (1996) An adaptative parallel algorithm for vlsi-layout optimization. In: Parallel problem solving from nature (PPSN IV), pp 22–27
41.
Zurück zum Zitat Tanase R (1989) Distributed genetic algorithms. In: Proceedings of the third international conference on genetic algorithms, pp 434–439 Tanase R (1989) Distributed genetic algorithms. In: Proceedings of the third international conference on genetic algorithms, pp 434–439
42.
Zurück zum Zitat Cohoon JP, Hedge S, Martin W (1987) Punctuated equilibria: a parallel genetic algorithm. In: Proceedings of the 2nd international conference on genetic algorithms and their applications, pp 148–154 Cohoon JP, Hedge S, Martin W (1987) Punctuated equilibria: a parallel genetic algorithm. In: Proceedings of the 2nd international conference on genetic algorithms and their applications, pp 148–154
43.
Zurück zum Zitat Tanase R (1987) Parallel genetic algorithm for a hypercube. In: Proceedings of the 2nd international conference on genetic algorithms and their applications, pp 177–183 Tanase R (1987) Parallel genetic algorithm for a hypercube. In: Proceedings of the 2nd international conference on genetic algorithms and their applications, pp 177–183
44.
Zurück zum Zitat Ryan C (1995) Niche and species formation in genetic algorithms. In: Chambers L (ed) Practical handbook of genetic algorithms: applications. CRC Press, Boca Raton, pp 57–74 Ryan C (1995) Niche and species formation in genetic algorithms. In: Chambers L (ed) Practical handbook of genetic algorithms: applications. CRC Press, Boca Raton, pp 57–74
45.
Zurück zum Zitat Gürocak HB (1999) A genetic-algorithm-based method for tuning fuzzy logic controllers. Fuzzy Sets Syst 108(1): 39–47MATHCrossRef Gürocak HB (1999) A genetic-algorithm-based method for tuning fuzzy logic controllers. Fuzzy Sets Syst 108(1): 39–47MATHCrossRef
46.
Zurück zum Zitat Mamdani EH, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man Mach Stud 7: 1–13MATHCrossRef Mamdani EH, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man Mach Stud 7: 1–13MATHCrossRef
47.
Zurück zum Zitat Eshelman LJ (1991) The CHC adaptive search algorithm: how to have safe search when engaging in nontraditional genetic recombination. In: Rawlin G (ed) Foundations of genetic algorithms, vol 1. Morgan Kaufman, pp 265–283 Eshelman LJ (1991) The CHC adaptive search algorithm: how to have safe search when engaging in nontraditional genetic recombination. In: Rawlin G (ed) Foundations of genetic algorithms, vol 1. Morgan Kaufman, pp 265–283
48.
Zurück zum Zitat Eshelman L, Schaffer J (1993) Real-coded genetic algorithms and interval-schemata. Found Genet algorithm 2:187–202 Eshelman L, Schaffer J (1993) Real-coded genetic algorithms and interval-schemata. Found Genet algorithm 2:187–202
49.
Zurück zum Zitat Kröger B, Schwenderling P, Vornberger O (1993) Parallel genetic packing on transputers. Parallel genetic algorithms: theory and applications, pp 151–186 Kröger B, Schwenderling P, Vornberger O (1993) Parallel genetic packing on transputers. Parallel genetic algorithms: theory and applications, pp 151–186
50.
Zurück zum Zitat Alcalá-Fdez J, Sánchez L, García S, del Jesus M, Ventura S, Garrell J, Otero J, Romero C, Bacardit J, Rivas V, Fernández J, Herrera F (2009) KEEL: a software tool to assess evolutionary algorithms to data mining problems. Soft Comput 13(3): 307–318CrossRef Alcalá-Fdez J, Sánchez L, García S, del Jesus M, Ventura S, Garrell J, Otero J, Romero C, Bacardit J, Rivas V, Fernández J, Herrera F (2009) KEEL: a software tool to assess evolutionary algorithms to data mining problems. Soft Comput 13(3): 307–318CrossRef
51.
Zurück zum Zitat Wang LX, Mendel JM (1992) Generating fuzzy rules by learning from examples. IEEE Trans Syst Man Cybern 22(6): 1414–1427CrossRefMathSciNet Wang LX, Mendel JM (1992) Generating fuzzy rules by learning from examples. IEEE Trans Syst Man Cybern 22(6): 1414–1427CrossRefMathSciNet
52.
Zurück zum Zitat Sheskin D (2003) Handbook of parametric and nonparametric statistical procedures. Chapman & Hall/CRC, Boca Raton Sheskin D (2003) Handbook of parametric and nonparametric statistical procedures. Chapman & Hall/CRC, Boca Raton
53.
Zurück zum Zitat Wilcoxon F (1945) Individual comparisons by ranking methods. Biometrics 1:80–83CrossRef Wilcoxon F (1945) Individual comparisons by ranking methods. Biometrics 1:80–83CrossRef
54.
Zurück zum Zitat Zar J (1999) Biostatistical analysis. Prentice-Hall, Upper Saddle River Zar J (1999) Biostatistical analysis. Prentice-Hall, Upper Saddle River
Metadaten
Titel
Evolutionary parallel and gradually distributed lateral tuning of fuzzy rule-based systems
verfasst von
I. Robles
R. Alcalá
J. M. Benítez
F. Herrera
Publikationsdatum
01.11.2009
Verlag
Springer-Verlag
Erschienen in
Evolutionary Intelligence / Ausgabe 1-2/2009
Print ISSN: 1864-5909
Elektronische ISSN: 1864-5917
DOI
https://doi.org/10.1007/s12065-009-0025-0

Weitere Artikel der Ausgabe 1-2/2009

Evolutionary Intelligence 1-2/2009 Zur Ausgabe