Skip to main content
Erschienen in: Soft Computing 5/2009

01.03.2009 | Focus

Parallel distributed genetic fuzzy rule selection

verfasst von: Yusuke Nojima, Hisao Ishibuchi, Isao Kuwajima

Erschienen in: Soft Computing | Ausgabe 5/2009

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Genetic fuzzy rule selection has been successfully used to design accurate and compact fuzzy rule-based classifiers. It is, however, very difficult to handle large data sets due to the increase in computational costs. This paper proposes a simple but effective idea to improve the scalability of genetic fuzzy rule selection to large data sets. Our idea is based on its parallel distributed implementation. Both a training data set and a population are divided into subgroups (i.e., into training data subsets and sub-populations, respectively) for the use of multiple processors. We compare seven variants of the parallel distributed implementation with the original non-parallel algorithm through computational experiments on some benchmark data sets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Abraham A, Jain L, Goldberg R (eds) (2005) Evolutionary multiobjective optimization. Springer, LondonMATH Abraham A, Jain L, Goldberg R (eds) (2005) Evolutionary multiobjective optimization. Springer, LondonMATH
Zurück zum Zitat Agrawal R, Mannila H, Srikant R, Toivonen H, Verkamo AI (1996) Fast discovery of association rules. In: Fayyad UM et al (eds) Advances in knowledge discovery and data mining. AAAI Press, Menlo Park, pp 307–328 Agrawal R, Mannila H, Srikant R, Toivonen H, Verkamo AI (1996) Fast discovery of association rules. In: Fayyad UM et al (eds) Advances in knowledge discovery and data mining. AAAI Press, Menlo Park, pp 307–328
Zurück zum Zitat Alba E, Tomassini M (2002) Parallelism and evolutionary algorithms. IEEE Trans Evol Comput 6(5):443–462CrossRef Alba E, Tomassini M (2002) Parallelism and evolutionary algorithms. IEEE Trans Evol Comput 6(5):443–462CrossRef
Zurück zum Zitat Araujo DLA, Lopes HS, Freitas AA (2000) Rule discovery with a parallel genetic algorithm. In: Proceedings of GECCO Workshop on Data Mining with Evolutionary Computation, pp 89–92 Araujo DLA, Lopes HS, Freitas AA (2000) Rule discovery with a parallel genetic algorithm. In: Proceedings of GECCO Workshop on Data Mining with Evolutionary Computation, pp 89–92
Zurück zum Zitat Cano JR, Herrera F, Lozano M (2005) Stratification for scaling up evolutionary prototype selection. Pattern Recognit Lett 26(7):953–963CrossRef Cano JR, Herrera F, Lozano M (2005) Stratification for scaling up evolutionary prototype selection. Pattern Recognit Lett 26(7):953–963CrossRef
Zurück zum Zitat Cano JR, Herrera F, Lozano M (2006) On the combination of evolutionary algorithms and stratified strategies for training set selection in data mining. Appl Soft Comput 6(3):323–332CrossRef Cano JR, Herrera F, Lozano M (2006) On the combination of evolutionary algorithms and stratified strategies for training set selection in data mining. Appl Soft Comput 6(3):323–332CrossRef
Zurück zum Zitat Cantu-Paz E (1997) A survey of parallel genetic algorithms, IlliGAL Report No. 95003 Cantu-Paz E (1997) A survey of parallel genetic algorithms, IlliGAL Report No. 95003
Zurück zum Zitat Casillas J, Cordon O, Herrera F, Magdalena L (eds) (2003a) Interpretability issues in fuzzy modeling. Springer, BerlinMATH Casillas J, Cordon O, Herrera F, Magdalena L (eds) (2003a) Interpretability issues in fuzzy modeling. Springer, BerlinMATH
Zurück zum Zitat Casillas J, Cordon O, Herrera F, Magdalena L (eds) (2003b) Accuracy improvements in linguistic fuzzy modeling. Springer, BerlinMATH Casillas J, Cordon O, Herrera F, Magdalena L (eds) (2003b) Accuracy improvements in linguistic fuzzy modeling. Springer, BerlinMATH
Zurück zum Zitat Coello CAC (1999) A comprehensive survey of evolutionary-based multiobjective optimization techniques. Knowl Inform Syst 1(3):269–308 Coello CAC (1999) A comprehensive survey of evolutionary-based multiobjective optimization techniques. Knowl Inform Syst 1(3):269–308
Zurück zum Zitat Coello CAC, van Veldhuizen DA, Lamont GB (2002) Evolutionary algorithms for solving multi-objective problems. Kluwer, BostonMATH Coello CAC, van Veldhuizen DA, Lamont GB (2002) Evolutionary algorithms for solving multi-objective problems. Kluwer, BostonMATH
Zurück zum Zitat Cordon O, del Jesus MJ, Herrera F (1999) A proposal on reasoning methods in fuzzy rule-based classification systems. Int J Approx Reason 20(1):21–45 Cordon O, del Jesus MJ, Herrera F (1999) A proposal on reasoning methods in fuzzy rule-based classification systems. Int J Approx Reason 20(1):21–45
Zurück zum Zitat Cordon O, Herrera F, Hoffman F, Magdalena L (2001) Genetic fuzzy systems. World Scientific, Singapore Cordon O, Herrera F, Hoffman F, Magdalena L (2001) Genetic fuzzy systems. World Scientific, Singapore
Zurück zum Zitat Cordon O, Gomide F, Herrera F, Hoffmann F, Magdalena L (2004) Ten years of genetic fuzzy systems: current framework and new trends. Fuzzy Sets Syst 141(1):5–31MATHCrossRefMathSciNet Cordon O, Gomide F, Herrera F, Hoffmann F, Magdalena L (2004) Ten years of genetic fuzzy systems: current framework and new trends. Fuzzy Sets Syst 141(1):5–31MATHCrossRefMathSciNet
Zurück zum Zitat Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, ChichesterMATH Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, ChichesterMATH
Zurück zum Zitat Freitas AA (2002) Data mining and knowledge discovery with evolutionary algorithms. Springer, BerlinMATH Freitas AA (2002) Data mining and knowledge discovery with evolutionary algorithms. Springer, BerlinMATH
Zurück zum Zitat Herrera F (2005) Genetic fuzzy systems: Status, critical considerations and future directions. Int J Comput Intell Res 1(1):59–67 Herrera F (2005) Genetic fuzzy systems: Status, critical considerations and future directions. Int J Comput Intell Res 1(1):59–67
Zurück zum Zitat Ishibuchi H. Nojima Y, Kuwajima I (2006) Genetic rule selection as a postprocessing procedure in fuzzy data mining. In: Proceedings of 2006 International Symposium on Evolving Fuzzy Systems, pp 286–291 Ishibuchi H. Nojima Y, Kuwajima I (2006) Genetic rule selection as a postprocessing procedure in fuzzy data mining. In: Proceedings of 2006 International Symposium on Evolving Fuzzy Systems, pp 286–291
Zurück zum Zitat Ishibuchi H (2007) Evolutionary multiobjective design of fuzzy rule-based systems. In: Proceedings of First IEEE Symposium on Foundations of Computational Intelligence, pp 9–16 Ishibuchi H (2007) Evolutionary multiobjective design of fuzzy rule-based systems. In: Proceedings of First IEEE Symposium on Foundations of Computational Intelligence, pp 9–16
Zurück zum Zitat Ishibuchi H, Nakashima T (2001) Effect of rule weights in fuzzy rule-based classification systems. IEEE Trans Fuzzy Syst 9(4):506–515CrossRef Ishibuchi H, Nakashima T (2001) Effect of rule weights in fuzzy rule-based classification systems. IEEE Trans Fuzzy Syst 9(4):506–515CrossRef
Zurück zum Zitat Ishibuchi H, Yamamoto T (2004) Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining. Fuzzy Sets Syst 141(1):59–88MATHCrossRefMathSciNet Ishibuchi H, Yamamoto T (2004) Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining. Fuzzy Sets Syst 141(1):59–88MATHCrossRefMathSciNet
Zurück zum Zitat Ishibuchi H, Nozaki K, Tanaka H (1992) Distributed representation of fuzzy rules and its application to pattern classification. Fuzzy Sets Syst 52(1):21–32CrossRef Ishibuchi H, Nozaki K, Tanaka H (1992) Distributed representation of fuzzy rules and its application to pattern classification. Fuzzy Sets Syst 52(1):21–32CrossRef
Zurück zum Zitat Ishibuchi H, Nozaki K, Yamamoto N, Tanaka H (1995) Selecting fuzzy if-then rules for classification problems using genetic algorithms. IEEE Trans Fuzzy Syst 3(3):260–270CrossRef Ishibuchi H, Nozaki K, Yamamoto N, Tanaka H (1995) Selecting fuzzy if-then rules for classification problems using genetic algorithms. IEEE Trans Fuzzy Syst 3(3):260–270CrossRef
Zurück zum Zitat Ishibuchi H, Murata T, Turksen IB (1997) Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems. Fuzzy Sets Syst 89(2):135–150CrossRef Ishibuchi H, Murata T, Turksen IB (1997) Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems. Fuzzy Sets Syst 89(2):135–150CrossRef
Zurück zum Zitat Ishibuchi H, Nakashima T, Morisawa T (1999) Voting in fuzzy rule-based systems for pattern classification problems. Fuzzy Sets Syst 103(2):223–238CrossRef Ishibuchi H, Nakashima T, Morisawa T (1999) Voting in fuzzy rule-based systems for pattern classification problems. Fuzzy Sets Syst 103(2):223–238CrossRef
Zurück zum Zitat Ishibuchi H, Nakashima T, Murata T (2001) Three-objective genetics-based machine learning for linguistic rule extraction. Inform Sci 136(1–4):109–133MATHCrossRef Ishibuchi H, Nakashima T, Murata T (2001) Three-objective genetics-based machine learning for linguistic rule extraction. Inform Sci 136(1–4):109–133MATHCrossRef
Zurück zum Zitat Ishibuchi H, Nakashima T, Nii M (2004) Classification and modeling with linguistic information granules: advanced approaches to linguistic data mining. Springer, Berlin Ishibuchi H, Nakashima T, Nii M (2004) Classification and modeling with linguistic information granules: advanced approaches to linguistic data mining. Springer, Berlin
Zurück zum Zitat Ishibuchi H, Kuwajima I, Nojima Y (2007) Use of Pareto-optimal and near Pareto-optimal rules as candidate rules in genetic fuzzy rule selection. In: Melin P et al (eds) Analysis and design of intelligent systems using soft computing techniques (Advances in Soft Computing 41). Springer, Berlin, pp 387–396CrossRef Ishibuchi H, Kuwajima I, Nojima Y (2007) Use of Pareto-optimal and near Pareto-optimal rules as candidate rules in genetic fuzzy rule selection. In: Melin P et al (eds) Analysis and design of intelligent systems using soft computing techniques (Advances in Soft Computing 41). Springer, Berlin, pp 387–396CrossRef
Zurück zum Zitat Jin Y (ed) (2006) Multi-objective machine learning. Springer, BerlinMATH Jin Y (ed) (2006) Multi-objective machine learning. Springer, BerlinMATH
Zurück zum Zitat Liu H, Motoda H (1998a) Feature selection for knowledge discovery and data mining. Kluwer, Dordrecht Liu H, Motoda H (1998a) Feature selection for knowledge discovery and data mining. Kluwer, Dordrecht
Zurück zum Zitat Liu H, Motoda H (1998b) Instance selection and construction for data mining. Kluwer, Dordrecht Liu H, Motoda H (1998b) Instance selection and construction for data mining. Kluwer, Dordrecht
Zurück zum Zitat Llora X, Garrell JM (2001) Knowledge-independent data mining with fine-grained parallel evolutionary algorithms. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp 461–468 Llora X, Garrell JM (2001) Knowledge-independent data mining with fine-grained parallel evolutionary algorithms. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp 461–468
Zurück zum Zitat Llora X, Garrell JM (2002) Coevolving different knowledge representations with fine-grained parallel learning classifier systems. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp 934–941 Llora X, Garrell JM (2002) Coevolving different knowledge representations with fine-grained parallel learning classifier systems. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp 934–941
Zurück zum Zitat Nojima Y, Ishibuchi H (2008) Computational efficiency of parallel distributed genetic fuzzy rule selection for large data sets. In: Proceedings of Information Processing and Management of Uncertainty in Knowledge-Based Systems, pp 1137–1142 Nojima Y, Ishibuchi H (2008) Computational efficiency of parallel distributed genetic fuzzy rule selection for large data sets. In: Proceedings of Information Processing and Management of Uncertainty in Knowledge-Based Systems, pp 1137–1142
Zurück zum Zitat Nojima Y, Ishibuchi H, Kuwajima I (2006) Comparison of search ability between genetic fuzzy rule selection and fuzzy genetics-based machine learning In: Proceedings of 2006 International Symposium on Evolving Fuzzy Systems, pp 125–130 Nojima Y, Ishibuchi H, Kuwajima I (2006) Comparison of search ability between genetic fuzzy rule selection and fuzzy genetics-based machine learning In: Proceedings of 2006 International Symposium on Evolving Fuzzy Systems, pp 125–130
Zurück zum Zitat Sheskin D (2007) Handbook of parametric and nonparametric statistical procedures, 4th edn. Chapman & Hall, London Sheskin D (2007) Handbook of parametric and nonparametric statistical procedures, 4th edn. Chapman & Hall, London
Metadaten
Titel
Parallel distributed genetic fuzzy rule selection
verfasst von
Yusuke Nojima
Hisao Ishibuchi
Isao Kuwajima
Publikationsdatum
01.03.2009
Verlag
Springer-Verlag
Erschienen in
Soft Computing / Ausgabe 5/2009
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-008-0365-1

Weitere Artikel der Ausgabe 5/2009

Soft Computing 5/2009 Zur Ausgabe

Premium Partner