Skip to main content
Erschienen in: Granular Computing 1/2016

01.03.2016 | Original Paper

Multi-objective evolutionary design of granular rule-based classifiers

verfasst von: Michela Antonelli, Pietro Ducange, Beatrice Lazzerini, Francesco Marcelloni

Erschienen in: Granular Computing | Ausgabe 1/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the last years, rule-based systems have been widely employed in several different application domains. The performance of these systems is strongly affected by the process of information granulation, which defines in terms of specific information granules such as sets, fuzzy sets and rough sets, the labels used in the rules. Generally, information granules are either provided by an expert, when possible, or extracted from the available data. In the framework of rule-based classifiers, we investigate the importance of determining an effective information granulation from data, preserving the comprehensibility of the granules. We show how the accuracies of rule-based classifiers can be increased by learning number and parameters of the granules, which partition the involved variables. To perform this analysis, we exploit a multi-objective evolutionary approach to the classifier generation we have recently proposed. We discuss different levels of information granulation optimization employing both the learning of the number of granules per variable and the tuning of each granule during the evolutionary process. We show and discuss the results obtained on several classification benchmark datasets using fuzzy sets and intervals as types of information granules.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
 
Literatur
Zurück zum Zitat Alcalá-Fdez J, Fernández A, Luengo J, Derrac J, García S, Sánchez L, Herrera F (2011) Keel data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. Multiple Valued Logic Soft Comput 17(2–3):255–287 Alcalá-Fdez J, Fernández A, Luengo J, Derrac J, García S, Sánchez L, Herrera F (2011) Keel data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. Multiple Valued Logic Soft Comput 17(2–3):255–287
Zurück zum Zitat Alonso JM, Magdalena L, González-Rodríguez G (2009) Looking for a good fuzzy system interpretability index: an experimental approach. Int J Approx Reason 51(1):115–134CrossRef Alonso JM, Magdalena L, González-Rodríguez G (2009) Looking for a good fuzzy system interpretability index: an experimental approach. Int J Approx Reason 51(1):115–134CrossRef
Zurück zum Zitat Antonelli M, Ducange P, Lazzerini B, Marcelloni F (2009a) Multi-objective evolutionary learning of granularity, membership function parameters and rules of Mamdani fuzzy systems. Evol Intell 2(1–2):21–37CrossRef Antonelli M, Ducange P, Lazzerini B, Marcelloni F (2009a) Multi-objective evolutionary learning of granularity, membership function parameters and rules of Mamdani fuzzy systems. Evol Intell 2(1–2):21–37CrossRef
Zurück zum Zitat Antonelli M, Ducange P, Lazzerini B, Marcelloni F (2009b) Learning concurrently partition granularities and rule bases of mamdani fuzzy systems in a multi-objective evolutionary framework. Int J Approx Reason 50(7):1066–1080CrossRef Antonelli M, Ducange P, Lazzerini B, Marcelloni F (2009b) Learning concurrently partition granularities and rule bases of mamdani fuzzy systems in a multi-objective evolutionary framework. Int J Approx Reason 50(7):1066–1080CrossRef
Zurück zum Zitat Antonelli M, Ducange P, Lazzerini B, Marcelloni F (2011a) Learning concurrently data and rule bases of Mamdani fuzzy rule-based systems by exploiting a novel interpretability index. Soft Comput 15(10):1981–1998CrossRef Antonelli M, Ducange P, Lazzerini B, Marcelloni F (2011a) Learning concurrently data and rule bases of Mamdani fuzzy rule-based systems by exploiting a novel interpretability index. Soft Comput 15(10):1981–1998CrossRef
Zurück zum Zitat Antonelli M, Ducange P, Lazzerini B, Marcelloni F (2011b) Learning knowledge bases of multi-objective evolutionary fuzzy systems by simultaneously optimizing accuracy, complexity and partition integrity. Soft Comput 15(12):2335–2354CrossRef Antonelli M, Ducange P, Lazzerini B, Marcelloni F (2011b) Learning knowledge bases of multi-objective evolutionary fuzzy systems by simultaneously optimizing accuracy, complexity and partition integrity. Soft Comput 15(12):2335–2354CrossRef
Zurück zum Zitat Antonelli M, Ducange P, Marcelloni F (2012) Genetic training instance selection in multi-objective evolutionary fuzzy systems: a co-evolutionary approach. IEEE Trans Fuzzy Syst 20(2):276–290CrossRef Antonelli M, Ducange P, Marcelloni F (2012) Genetic training instance selection in multi-objective evolutionary fuzzy systems: a co-evolutionary approach. IEEE Trans Fuzzy Syst 20(2):276–290CrossRef
Zurück zum Zitat Antonelli M, Ducange P, Marcelloni F (2014) An experimental study on evolutionary fuzzy classifiers designed for managing imbalanced datasets. Neurocomputing 146:125–136CrossRef Antonelli M, Ducange P, Marcelloni F (2014) An experimental study on evolutionary fuzzy classifiers designed for managing imbalanced datasets. Neurocomputing 146:125–136CrossRef
Zurück zum Zitat Botta A, Lazzerini B, Marcelloni F, Stefanescu DC (2009) Context adaptation of fuzzy systems through a multi-objective evolutionary approach based on a novel interpretability index. Soft Comput 13(5):437–449CrossRef Botta A, Lazzerini B, Marcelloni F, Stefanescu DC (2009) Context adaptation of fuzzy systems through a multi-objective evolutionary approach based on a novel interpretability index. Soft Comput 13(5):437–449CrossRef
Zurück zum Zitat Bustince Sola H, Fernandez J, Hagras H, Herrera F, Pagola M, Barrenechea E (2015) Interval type-2 fuzzy sets are generalization of interval-valued fuzzy sets: towards a wider view on their relationship. IEEE Trans Fuzzy Syst (in press) Bustince Sola H, Fernandez J, Hagras H, Herrera F, Pagola M, Barrenechea E (2015) Interval type-2 fuzzy sets are generalization of interval-valued fuzzy sets: towards a wider view on their relationship. IEEE Trans Fuzzy Syst (in press)
Zurück zum Zitat Castillo O, Melin P (2012a) Optimization of type-2 fuzzy systems based on bio-inspired methods: a concise review. Inf Sci 205:1–19CrossRefMathSciNet Castillo O, Melin P (2012a) Optimization of type-2 fuzzy systems based on bio-inspired methods: a concise review. Inf Sci 205:1–19CrossRefMathSciNet
Zurück zum Zitat Castillo O, Melin P (2012b) A review on the design and optimization of interval type-2 fuzzy controllers. Appl Soft Comput 12(4):1267–1278CrossRef Castillo O, Melin P (2012b) A review on the design and optimization of interval type-2 fuzzy controllers. Appl Soft Comput 12(4):1267–1278CrossRef
Zurück zum Zitat Cococcioni M, Ducange P, Lazzerini B, Marcelloni F (2007) A Pareto-based multi-objective evolutionary approach to the identification of Mamdani fuzzy systems. Soft Comput 11(11):1013–1031CrossRef Cococcioni M, Ducange P, Lazzerini B, Marcelloni F (2007) A Pareto-based multi-objective evolutionary approach to the identification of Mamdani fuzzy systems. Soft Comput 11(11):1013–1031CrossRef
Zurück zum Zitat Cordon O, del Jesus MJ, Herrera F (1999) A proposal on reasoning methods in fuzzy rule-based classification systems. Int J Approx Reason 20(1):21–45CrossRef Cordon O, del Jesus MJ, Herrera F (1999) A proposal on reasoning methods in fuzzy rule-based classification systems. Int J Approx Reason 20(1):21–45CrossRef
Zurück zum Zitat Ducange P, Marcelloni F (2011) Multi-objective evolutionary fuzzy systems. Lecture notes in computer science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol 6857 LNAI, pp 83–90 Ducange P, Marcelloni F (2011) Multi-objective evolutionary fuzzy systems. Lecture notes in computer science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol 6857 LNAI, pp 83–90
Zurück zum Zitat Fazzolari M, Alcalá R, Herrera F (2014) A multi-objective evolutionary method for learning granularities based on fuzzy discretization to improve the accuracy-complexity trade-off of fuzzy rule-based classification systems: D-mofarc algorithm. Appl Soft Comput 24:470–481CrossRef Fazzolari M, Alcalá R, Herrera F (2014) A multi-objective evolutionary method for learning granularities based on fuzzy discretization to improve the accuracy-complexity trade-off of fuzzy rule-based classification systems: D-mofarc algorithm. Appl Soft Comput 24:470–481CrossRef
Zurück zum Zitat Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32(200):675–701CrossRef Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32(200):675–701CrossRef
Zurück zum Zitat Gacto MJ, Alcalá R, Herrera F (2010) Integration of an index to preserve the semantic interpretability in the multiobjective evolutionary rule selection and tuning of linguistic fuzzy systems. IEEE Trans Fuzzy Syst 18(3):515–531CrossRef Gacto MJ, Alcalá R, Herrera F (2010) Integration of an index to preserve the semantic interpretability in the multiobjective evolutionary rule selection and tuning of linguistic fuzzy systems. IEEE Trans Fuzzy Syst 18(3):515–531CrossRef
Zurück zum Zitat Gacto MJ, Alcalá R, Herrera F (2011) Interpretability of linguistic fuzzy rule-based systems: an overview of interpretability measures. Inf Sci 181(20):4340–4360CrossRef Gacto MJ, Alcalá R, Herrera F (2011) Interpretability of linguistic fuzzy rule-based systems: an overview of interpretability measures. Inf Sci 181(20):4340–4360CrossRef
Zurück zum Zitat Gorzałczany MB (1987) A method of inference in approximate reasoning based on interval-valued fuzzy sets. Fuzzy Sets Syst 21(1):1–17CrossRefMATH Gorzałczany MB (1987) A method of inference in approximate reasoning based on interval-valued fuzzy sets. Fuzzy Sets Syst 21(1):1–17CrossRefMATH
Zurück zum Zitat Guillaume S (2001) Designing fuzzy inference systems from data: an interpretability-oriented review. IEEE Trans Fuzzy Syst 9(3):426–443CrossRefMathSciNet Guillaume S (2001) Designing fuzzy inference systems from data: an interpretability-oriented review. IEEE Trans Fuzzy Syst 9(3):426–443CrossRefMathSciNet
Zurück zum Zitat Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6:65–70MathSciNetMATH Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6:65–70MathSciNetMATH
Zurück zum Zitat Iman RL, Davenport JM (1980) Approximations of the critical region of the fbietkan statistic. Commun Stat 9(6):571–595CrossRef Iman RL, Davenport JM (1980) Approximations of the critical region of the fbietkan statistic. Commun Stat 9(6):571–595CrossRef
Zurück zum Zitat Ishibuchi H, Nakashima T, Nii M (2004) Classification and modeling with linguistic information granules: advanced approaches to linguistic data mining (advanced information processing). Springer, Secaucus Ishibuchi H, Nakashima T, Nii M (2004) Classification and modeling with linguistic information granules: advanced approaches to linguistic data mining (advanced information processing). Springer, Secaucus
Zurück zum Zitat Klawonn F (2006) Reducing the number of parameters of a fuzzy system using scaling functions. Soft Comput 10(9):749–756CrossRef Klawonn F (2006) Reducing the number of parameters of a fuzzy system using scaling functions. Soft Comput 10(9):749–756CrossRef
Zurück zum Zitat Knowles JD, Corne DW (2000) Approximating the nondominated front using the Pareto archived evolution strategy. Evol Comput 8(2):149–172CrossRef Knowles JD, Corne DW (2000) Approximating the nondominated front using the Pareto archived evolution strategy. Evol Comput 8(2):149–172CrossRef
Zurück zum Zitat Liang Q, Mendel JM (2000) Interval type-2 fuzzy logic systems: theory and design. IEEE Trans Fuzzy Syst 8(5):535–550CrossRef Liang Q, Mendel JM (2000) Interval type-2 fuzzy logic systems: theory and design. IEEE Trans Fuzzy Syst 8(5):535–550CrossRef
Zurück zum Zitat Mencar C, Fanelli AM (2008) Interpretability constraints for fuzzy information granulation. Inf Sci 178(24):4585–4618CrossRefMathSciNet Mencar C, Fanelli AM (2008) Interpretability constraints for fuzzy information granulation. Inf Sci 178(24):4585–4618CrossRefMathSciNet
Zurück zum Zitat Mendel JM, John RIB (2002) Type-2 fuzzy sets made simple. IEEE Trans Fuzzy Syst 10(2):117–127CrossRef Mendel JM, John RIB (2002) Type-2 fuzzy sets made simple. IEEE Trans Fuzzy Syst 10(2):117–127CrossRef
Zurück zum Zitat Miller GA (1956) The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol Rev 63(2):81–97. doi:10.1037/h0043158 CrossRef Miller GA (1956) The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol Rev 63(2):81–97. doi:10.​1037/​h0043158 CrossRef
Zurück zum Zitat Moore RE (1966) Interval analysis, vol 4. Prentice-Hall Englewood Cliffs Moore RE (1966) Interval analysis, vol 4. Prentice-Hall Englewood Cliffs
Zurück zum Zitat Pedrycz W, Al-Hmouz R, Morfeq A, Balamash AS (2014) Building granular fuzzy decision support systems. Knowl Based Syst 58:3–10CrossRef Pedrycz W, Al-Hmouz R, Morfeq A, Balamash AS (2014) Building granular fuzzy decision support systems. Knowl Based Syst 58:3–10CrossRef
Zurück zum Zitat Pedrycz W, Vukovich G (2002) Granular computing with shadowed sets. Int J Intell Syst 17(2):173–197CrossRefMATH Pedrycz W, Vukovich G (2002) Granular computing with shadowed sets. Int J Intell Syst 17(2):173–197CrossRefMATH
Zurück zum Zitat Pedrycz W, Succi G, Sillitti A, Joana I (2015) A general framework of information granules. Knowl Based Syst Data Descr Pedrycz W, Succi G, Sillitti A, Joana I (2015) A general framework of information granules. Knowl Based Syst Data Descr
Zurück zum Zitat Pedrycz W (2013) Granular computing: analysis and design of intelligent systems. CRC Press Pedrycz W (2013) Granular computing: analysis and design of intelligent systems. CRC Press
Zurück zum Zitat Rafael A, Ducange P, Herrera F, Lazzerini B, Marcelloni F (2009) A multiobjective evolutionary approach to concurrently learn rule and data bases of linguistic fuzzy-rule-based systems. IEEE Trans Fuzzy Syst 17(5):1106–1122CrossRef Rafael A, Ducange P, Herrera F, Lazzerini B, Marcelloni F (2009) A multiobjective evolutionary approach to concurrently learn rule and data bases of linguistic fuzzy-rule-based systems. IEEE Trans Fuzzy Syst 17(5):1106–1122CrossRef
Zurück zum Zitat Sanz JA, Bernardo D, Herrera F, Bustince H, Hagras H (2015) A compact evolutionary interval-valued fuzzy rule-based classification system for the modeling and prediction of real-world financial applications with imbalanced data. IEEE Trans Fuzzy Syst 23(4):973–990CrossRef Sanz JA, Bernardo D, Herrera F, Bustince H, Hagras H (2015) A compact evolutionary interval-valued fuzzy rule-based classification system for the modeling and prediction of real-world financial applications with imbalanced data. IEEE Trans Fuzzy Syst 23(4):973–990CrossRef
Zurück zum Zitat Sanz JA, Fernandez A, Bustince H, Herrera F (2013) Ivturs: a linguistic fuzzy rule-based classification system based on a new interval-valued fuzzy reasoning method with tuning and rule selection. IEEE Trans Fuzzy Syst 21(3):399–411CrossRef Sanz JA, Fernandez A, Bustince H, Herrera F (2013) Ivturs: a linguistic fuzzy rule-based classification system based on a new interval-valued fuzzy reasoning method with tuning and rule selection. IEEE Trans Fuzzy Syst 21(3):399–411CrossRef
Zurück zum Zitat Sanz JA, Fernánde A, Bustince H, Herrera F (2010) Improving the performance of fuzzy rule-based classification systems with interval-valued fuzzy sets and genetic amplitude tuning. Inf Sci 180(19):3674–3685CrossRef Sanz JA, Fernánde A, Bustince H, Herrera F (2010) Improving the performance of fuzzy rule-based classification systems with interval-valued fuzzy sets and genetic amplitude tuning. Inf Sci 180(19):3674–3685CrossRef
Zurück zum Zitat Sanz J, Fernández A, Bustince H, Herrera F (2011) A genetic tuning to improve the performance of fuzzy rule-based classification systems with interval-valued fuzzy sets: degree of ignorance and lateral position. Int J Approx Reason 52(6):751–766CrossRef Sanz J, Fernández A, Bustince H, Herrera F (2011) A genetic tuning to improve the performance of fuzzy rule-based classification systems with interval-valued fuzzy sets: degree of ignorance and lateral position. Int J Approx Reason 52(6):751–766CrossRef
Zurück zum Zitat Valente de Oliveira J (1999) Semantic constraints for membership function optimization. IEEE Trans Syst Man Cybern Part A Syst Hum 29(1):128–138CrossRef Valente de Oliveira J (1999) Semantic constraints for membership function optimization. IEEE Trans Syst Man Cybern Part A Syst Hum 29(1):128–138CrossRef
Zurück zum Zitat Villar P, Fernandez A, Carrasco RA, Herrera F (2012) Feature selection and granularity learning in genetic fuzzy rule-based classification systems for highly imbalanced data-sets. Int J Uncert Fuzziness Knowl Based Syst 20(03):369–397CrossRefMATH Villar P, Fernandez A, Carrasco RA, Herrera F (2012) Feature selection and granularity learning in genetic fuzzy rule-based classification systems for highly imbalanced data-sets. Int J Uncert Fuzziness Knowl Based Syst 20(03):369–397CrossRefMATH
Zurück zum Zitat Wu D, Mendel JM (2009) A comparative study of ranking methods, similarity measures and uncertainty measures for interval type-2 fuzzy sets. Inf Sci 179(8):1169–1192CrossRefMathSciNet Wu D, Mendel JM (2009) A comparative study of ranking methods, similarity measures and uncertainty measures for interval type-2 fuzzy sets. Inf Sci 179(8):1169–1192CrossRefMathSciNet
Zurück zum Zitat Yao JT, Vasilakos AV, Pedrycz W (2013) Granular computing: perspectives and challenges. IEEE Trans Cybern 43(6): 1977–1989 Yao JT, Vasilakos AV, Pedrycz W (2013) Granular computing: perspectives and challenges. IEEE Trans Cybern 43(6): 1977–1989
Zurück zum Zitat Yao Y (2009) Interval sets and interval-set algebras. In: ICCI’09. 8th IEEE international conference on cognitive informatics. IEEE, pp 307–314 Yao Y (2009) Interval sets and interval-set algebras. In: ICCI’09. 8th IEEE international conference on cognitive informatics. IEEE, pp 307–314
Zurück zum Zitat Zadeh LA (1997) Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90(2):111–127CrossRefMathSciNetMATH Zadeh LA (1997) Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90(2):111–127CrossRefMathSciNetMATH
Zurück zum Zitat Zhou SM, Gan JQ (2008) Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy system modelling. Fuzzy Sets Syst 159(23):3091–3131CrossRefMathSciNet Zhou SM, Gan JQ (2008) Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy system modelling. Fuzzy Sets Syst 159(23):3091–3131CrossRefMathSciNet
Metadaten
Titel
Multi-objective evolutionary design of granular rule-based classifiers
verfasst von
Michela Antonelli
Pietro Ducange
Beatrice Lazzerini
Francesco Marcelloni
Publikationsdatum
01.03.2016
Verlag
Springer International Publishing
Erschienen in
Granular Computing / Ausgabe 1/2016
Print ISSN: 2364-4966
Elektronische ISSN: 2364-4974
DOI
https://doi.org/10.1007/s41066-015-0004-z

Weitere Artikel der Ausgabe 1/2016

Granular Computing 1/2016 Zur Ausgabe

Premium Partner