Skip to main content
Erschienen in: Neural Computing and Applications 15/2020

11.12.2019 | Original Article

Axiomatic fuzzy set theory-based fuzzy oblique decision tree with dynamic mining fuzzy rules

verfasst von: Yuliang Cai, Huaguang Zhang, Shaoxin Sun, Xianchang Wang, Qiang He

Erschienen in: Neural Computing and Applications | Ausgabe 15/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a novel classification technology—fuzzy rule-based oblique decision tree (FRODT). The neighborhood rough sets-based FAST feature selection (NRS_FS_FAST) is first introduced to reduce attributes. In the axiomatic fuzzy set theory framework, the fuzzy rule extraction algorithm is then proposed to dynamically extract fuzzy rules. And these rules are regarded as the decision function during the tree construction. The FRODT is developed by expanding the unique non-leaf node in each layer of the tree, which results in a new tree structure with linguistic interpretation. Moreover, the genetic algorithm is implemented on \(\sigma \) to obtain the balanced results between classification accuracy and tree size. A series of comparative experiments are carried out with five classical classification algorithms (C4.5, BFT, LAD, SC and NBT), and recently proposed decision tree HHCART on 20 UCI data sets. Experiment results show that the FRODT exhibits better classification performance on accuracy and tree size than those of the rival algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat López-Chau A, Cervantes J, López-Garca L, Lamont FG (2013) Fisher’s decision tree. Expert Syst Appl 40(16):6283–6291CrossRef López-Chau A, Cervantes J, López-Garca L, Lamont FG (2013) Fisher’s decision tree. Expert Syst Appl 40(16):6283–6291CrossRef
2.
Zurück zum Zitat Mirzamomen Z, Kangavari MR (2017) A framework to induce more stable decision trees for pattern classification. Pattern Anal Appl 20(4):991–1004MathSciNetCrossRef Mirzamomen Z, Kangavari MR (2017) A framework to induce more stable decision trees for pattern classification. Pattern Anal Appl 20(4):991–1004MathSciNetCrossRef
3.
Zurück zum Zitat Manwani N, Sastry PS (2012) Geometric decision tree. IEEE Trans Syst Man Cybernet Part B (Cybernet) 42(1):181–192CrossRef Manwani N, Sastry PS (2012) Geometric decision tree. IEEE Trans Syst Man Cybernet Part B (Cybernet) 42(1):181–192CrossRef
4.
Zurück zum Zitat Kevric J, Jukic S, Subasi A (2017) An effective combining classifier approach using tree algorithms for network intrusion detection. Neural Comput Appl 28(1):1051–1058CrossRef Kevric J, Jukic S, Subasi A (2017) An effective combining classifier approach using tree algorithms for network intrusion detection. Neural Comput Appl 28(1):1051–1058CrossRef
5.
Zurück zum Zitat Breiman L (2017) Classification and regression trees. Routledge, AbingdonCrossRef Breiman L (2017) Classification and regression trees. Routledge, AbingdonCrossRef
6.
Zurück zum Zitat Azar AT, El-Metwally SM (2013) Decision tree classifiers for automated medical diagnosis. Neural Comput Appl 23(7–8):2387–2403CrossRef Azar AT, El-Metwally SM (2013) Decision tree classifiers for automated medical diagnosis. Neural Comput Appl 23(7–8):2387–2403CrossRef
7.
Zurück zum Zitat Quinlan JR (2014) C4.5: programs for machine learning. Elsevier, Amsterdam Quinlan JR (2014) C4.5: programs for machine learning. Elsevier, Amsterdam
8.
Zurück zum Zitat Sok HK, Ooi MP, Kuang YC (2016) Multivariate alternating decision trees. Pattern Recogn 50:195–209CrossRef Sok HK, Ooi MP, Kuang YC (2016) Multivariate alternating decision trees. Pattern Recogn 50:195–209CrossRef
9.
Zurück zum Zitat Kumar PS, Yung Y, Huan TL (2017) Neural network based decision trees using machine learning for alzheimer’s diagnosis. Int J Comput Inf Sci 4(11):63–72 Kumar PS, Yung Y, Huan TL (2017) Neural network based decision trees using machine learning for alzheimer’s diagnosis. Int J Comput Inf Sci 4(11):63–72
10.
Zurück zum Zitat Wu CC, Chen YL, Liu YH (2016) Decision tree induction with a constrained number of leaf nodes. Appl Intell 45(3):673–685CrossRef Wu CC, Chen YL, Liu YH (2016) Decision tree induction with a constrained number of leaf nodes. Appl Intell 45(3):673–685CrossRef
11.
Zurück zum Zitat Shukla SK, Tiwari MK (2012) GA guided cluster based fuzzy decision tree for reactive ion etching modeling: a data mining approach. IEEE Trans Semicond Manuf 25(1):45–56CrossRef Shukla SK, Tiwari MK (2012) GA guided cluster based fuzzy decision tree for reactive ion etching modeling: a data mining approach. IEEE Trans Semicond Manuf 25(1):45–56CrossRef
12.
Zurück zum Zitat Liu X, Feng X, Pedrycz W (2013) Extraction of fuzzy rules from fuzzy decision trees: an axiomatic fuzzy sets (AFS) approach. Data Knowl Eng 84:1–25CrossRef Liu X, Feng X, Pedrycz W (2013) Extraction of fuzzy rules from fuzzy decision trees: an axiomatic fuzzy sets (AFS) approach. Data Knowl Eng 84:1–25CrossRef
13.
Zurück zum Zitat Segatori A, Marcelloni F, Pedrycz W (2018) On distributed fuzzy decision trees for big data. IEEE Trans Fuzzy Syst 26(1):174–192CrossRef Segatori A, Marcelloni F, Pedrycz W (2018) On distributed fuzzy decision trees for big data. IEEE Trans Fuzzy Syst 26(1):174–192CrossRef
14.
Zurück zum Zitat Han NM, Hao NC (2016) An algorithm to building a fuzzy decision tree for data classification problem based on the fuzziness intervals matching. J Comput Sci Cybernet 32(4):367–380 Han NM, Hao NC (2016) An algorithm to building a fuzzy decision tree for data classification problem based on the fuzziness intervals matching. J Comput Sci Cybernet 32(4):367–380
15.
Zurück zum Zitat Sardari S, Eftekhari M, Afsari F (2017) Hesitant fuzzy decision tree approach for highly imbalanced data classification. Appl Soft Comput 61:727–741CrossRef Sardari S, Eftekhari M, Afsari F (2017) Hesitant fuzzy decision tree approach for highly imbalanced data classification. Appl Soft Comput 61:727–741CrossRef
16.
Zurück zum Zitat Tan PJ, Dowe DL (2006) Decision forests with oblique decision trees. In: Mexican international conference on artificial intelligence, Springer, Berlin, Heidelberg, pp 593–603 Tan PJ, Dowe DL (2006) Decision forests with oblique decision trees. In: Mexican international conference on artificial intelligence, Springer, Berlin, Heidelberg, pp 593–603
17.
Zurück zum Zitat Cantu-Paz E, Kamath C (2003) Inducing oblique decision trees with evolutionary algorithms. IEEE Trans Evol Comput 7(1):54–68CrossRef Cantu-Paz E, Kamath C (2003) Inducing oblique decision trees with evolutionary algorithms. IEEE Trans Evol Comput 7(1):54–68CrossRef
18.
Zurück zum Zitat Do TN, Lenca P, Lallich S (2015) Classifying many-class high-dimensional fingerprint datasets using random forest of oblique decision trees. Vietnam J Comput Sci 2(1):3–12CrossRef Do TN, Lenca P, Lallich S (2015) Classifying many-class high-dimensional fingerprint datasets using random forest of oblique decision trees. Vietnam J Comput Sci 2(1):3–12CrossRef
19.
Zurück zum Zitat Barros RC, Jaskowiak PA, Cerri R (2014) A framework for bottom-up induction of oblique decision trees. Neurocomputing 135:3–12CrossRef Barros RC, Jaskowiak PA, Cerri R (2014) A framework for bottom-up induction of oblique decision trees. Neurocomputing 135:3–12CrossRef
20.
Zurück zum Zitat Patil SP, Badhe SV (2015) Geometric approach for induction of oblique decision tree. Int J Comput Sci Inf Technol 5(1):197–201 Patil SP, Badhe SV (2015) Geometric approach for induction of oblique decision tree. Int J Comput Sci Inf Technol 5(1):197–201
21.
Zurück zum Zitat Rivera-Lopez R, Canul-Reich J (2017) A global search approach for inducing oblique decision trees using differential evolution. In: Canadian conference on artificial intelligence, Springer, Cham, pp 27–38 Rivera-Lopez R, Canul-Reich J (2017) A global search approach for inducing oblique decision trees using differential evolution. In: Canadian conference on artificial intelligence, Springer, Cham, pp 27–38
22.
23.
Zurück zum Zitat Wang C, Shao M, He Q, Qian Y, Qi Y (2016) Feature subset selection based on fuzzy neighborhood rough sets. Knowl-Based Syst 111:173–179CrossRef Wang C, Shao M, He Q, Qian Y, Qi Y (2016) Feature subset selection based on fuzzy neighborhood rough sets. Knowl-Based Syst 111:173–179CrossRef
24.
Zurück zum Zitat He Q, Xie Z, Hu Q, Wu C (2011) Neighborhood based sample and feature selection for svm classification learning. Neurocomputing 74(10):1585–1594CrossRef He Q, Xie Z, Hu Q, Wu C (2011) Neighborhood based sample and feature selection for svm classification learning. Neurocomputing 74(10):1585–1594CrossRef
25.
Zurück zum Zitat Zhang DW, Wang P, Qiu JQ, Jiang Y (2010) An improved approach to feature selection. In: International conference on machine learning and cybernetics, pp 488–493 Zhang DW, Wang P, Qiu JQ, Jiang Y (2010) An improved approach to feature selection. In: International conference on machine learning and cybernetics, pp 488–493
26.
27.
Zurück zum Zitat Liu X, Chai T, Wang W, Liu W (2007) Approaches to the representations and logic operations of fuzzy concepts in the framework of axiomatic fuzzy set theory i. Inf Sci 177(4):1007–1026MathSciNetMATHCrossRef Liu X, Chai T, Wang W, Liu W (2007) Approaches to the representations and logic operations of fuzzy concepts in the framework of axiomatic fuzzy set theory i. Inf Sci 177(4):1007–1026MathSciNetMATHCrossRef
28.
Zurück zum Zitat Wang B, Liu XD, Wang LD (2015) Mining fuzzy association rules in the framework of AFS theory. Ann Data Sci 2(3):261–270CrossRef Wang B, Liu XD, Wang LD (2015) Mining fuzzy association rules in the framework of AFS theory. Ann Data Sci 2(3):261–270CrossRef
29.
Zurück zum Zitat Menga E, Dan A, Lu J, Liu X (2015) Ranking alternative strategies by SWOT analysis in the framework of the axiomatic fuzzy set theory and the ER approach. J Intell Fuzzy Syst 28(4):1775–1784CrossRef Menga E, Dan A, Lu J, Liu X (2015) Ranking alternative strategies by SWOT analysis in the framework of the axiomatic fuzzy set theory and the ER approach. J Intell Fuzzy Syst 28(4):1775–1784CrossRef
30.
Zurück zum Zitat Burra LR, Poosapati P (2016) A study of notations and illustrations of axiomatic fuzzy set theory. Int J Comput Appl 134(11):7–12 Burra LR, Poosapati P (2016) A study of notations and illustrations of axiomatic fuzzy set theory. Int J Comput Appl 134(11):7–12
31.
Zurück zum Zitat Li Z, Duan X, Zhang Q, Wang C, Wang Y, Liu W (2017) Multi-ethnic facial features extraction based on axiomatic fuzzy set theory. Neurocomputing 242:161–177CrossRef Li Z, Duan X, Zhang Q, Wang C, Wang Y, Liu W (2017) Multi-ethnic facial features extraction based on axiomatic fuzzy set theory. Neurocomputing 242:161–177CrossRef
32.
Zurück zum Zitat Zadeh LA (1997) Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90(2):111–127MathSciNetMATHCrossRef Zadeh LA (1997) Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90(2):111–127MathSciNetMATHCrossRef
33.
Zurück zum Zitat Agrawal R, Imielinski T, Swami A (1993) Database mining: a performance perspective. IEEE Trans Knowl Data Eng 5(6):914–925CrossRef Agrawal R, Imielinski T, Swami A (1993) Database mining: a performance perspective. IEEE Trans Knowl Data Eng 5(6):914–925CrossRef
34.
Zurück zum Zitat Wang X, Liu X, Pedrycz W, Zhu X, Hu G (2012) Mining axiomatic fuzzy set association rules for classification problems. Eur J Oper Res 218(1):202–210MathSciNetMATHCrossRef Wang X, Liu X, Pedrycz W, Zhu X, Hu G (2012) Mining axiomatic fuzzy set association rules for classification problems. Eur J Oper Res 218(1):202–210MathSciNetMATHCrossRef
35.
Zurück zum Zitat Shi H (2007) Best-first decision tree learning. University of Waikato, Hamilton Shi H (2007) Best-first decision tree learning. University of Waikato, Hamilton
36.
Zurück zum Zitat Holmes G, Pfahringer B, Kirkby R, Frank E, Hall M (2002) Multiclass alternating decision trees. Springer, BerlinMATHCrossRef Holmes G, Pfahringer B, Kirkby R, Frank E, Hall M (2002) Multiclass alternating decision trees. Springer, BerlinMATHCrossRef
37.
Zurück zum Zitat Kohavi R (1996) Scaling up the accuracy of naive-bayes classifiers:a decision-tree hybrid. In: Second international conference on knowledge discovery and data mining Kohavi R (1996) Scaling up the accuracy of naive-bayes classifiers:a decision-tree hybrid. In: Second international conference on knowledge discovery and data mining
38.
Zurück zum Zitat Witten IH, Frank E, Hall MA, Pal CJ (2016) Data mining: practical machine learning tools and techniques. Morgan Kaufmann, Burlington Witten IH, Frank E, Hall MA, Pal CJ (2016) Data mining: practical machine learning tools and techniques. Morgan Kaufmann, Burlington
39.
Zurück zum Zitat Ar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7(1):1–30MathSciNet Ar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7(1):1–30MathSciNet
40.
Zurück zum Zitat Creamer G, Freund Y (2010) Using boosting for financial analysis and performance prediction: application to s&p 500 companies, latin american adrs and banks. Comput Econ 36(2):133–151CrossRef Creamer G, Freund Y (2010) Using boosting for financial analysis and performance prediction: application to s&p 500 companies, latin american adrs and banks. Comput Econ 36(2):133–151CrossRef
41.
Zurück zum Zitat Liu C, Sun K, Rather ZH, Chen Z, Bak CL, Thøgersen P, Lund P (2013) A systematic approach for dynamic security assessment and the corresponding preventive control scheme based on decision trees. IEEE Trans Power Syst 29(2):717–730CrossRef Liu C, Sun K, Rather ZH, Chen Z, Bak CL, Thøgersen P, Lund P (2013) A systematic approach for dynamic security assessment and the corresponding preventive control scheme based on decision trees. IEEE Trans Power Syst 29(2):717–730CrossRef
42.
Zurück zum Zitat Al Snousy MB, El-Deeb HM, Badran K, Al Khlil IA (2011) Suite of decision tree-based classification algorithms on cancer gene expression data. Egypt Inform J 12(2):73–82CrossRef Al Snousy MB, El-Deeb HM, Badran K, Al Khlil IA (2011) Suite of decision tree-based classification algorithms on cancer gene expression data. Egypt Inform J 12(2):73–82CrossRef
43.
Zurück zum Zitat Sindhu SSS, Geetha S, Kannan A (2012) Decision tree based light weight intrusion detection using a wrapper approach. Expert Syst Appl 39(1):129–141CrossRef Sindhu SSS, Geetha S, Kannan A (2012) Decision tree based light weight intrusion detection using a wrapper approach. Expert Syst Appl 39(1):129–141CrossRef
44.
Zurück zum Zitat Yu Z, Haghighat F, Fung BC, Yoshino H (2010) A decision tree method for building energy demand modeling. Energy Build 42(10):1637–1646CrossRef Yu Z, Haghighat F, Fung BC, Yoshino H (2010) A decision tree method for building energy demand modeling. Energy Build 42(10):1637–1646CrossRef
Metadaten
Titel
Axiomatic fuzzy set theory-based fuzzy oblique decision tree with dynamic mining fuzzy rules
verfasst von
Yuliang Cai
Huaguang Zhang
Shaoxin Sun
Xianchang Wang
Qiang He
Publikationsdatum
11.12.2019
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 15/2020
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04649-0

Weitere Artikel der Ausgabe 15/2020

Neural Computing and Applications 15/2020 Zur Ausgabe

Premium Partner