Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 4/2013

01.08.2013 | Original Article

Consistency-preserving attribute reduction in fuzzy rough set framework

verfasst von: Yuhua Qian, Jiye Liang, Wei Wei

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 4/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Attribute reduction (feature selection) has become an important challenge in areas of pattern recognition, machine learning, data mining and knowledge discovery. Based on attribute reduction, one can extract fuzzy decision rules from a fuzzy decision table. As consistency is one of several criteria for evaluating the decision performance of a decision-rule set, in this paper, we devote to present a consistency-preserving attribute reduction in fuzzy rough set framework. Through constructing the membership function of an object, we first introduce a consistency measure to assess the consistencies of a fuzzy target set and a fuzzy decision table, which underlies a foundation for attribute reduction algorithm. Then, we derive two attribute significance measures based on the proposed consistency measure and design a forward greedy algorithm (ARBC) for attribute reduction from both numerical and nominal data sets. Numerical experiments show the validity of the proposed algorithm from search strategy and heuristic function in the meaning of consistency. Number of the selected features is the least for a given threshold of consistency measure.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Beynon M (2001) Reducts within the variable precision rough sets model: a further investigation. Eur J Oper Res 134(3):592–605MATHCrossRef Beynon M (2001) Reducts within the variable precision rough sets model: a further investigation. Eur J Oper Res 134(3):592–605MATHCrossRef
2.
Zurück zum Zitat Bhatt RB, Gopal M (2005) On the compact computational domain of fuzzy rough sets. Pattern Recognit Lett 26:965–975CrossRef Bhatt RB, Gopal M (2005) On the compact computational domain of fuzzy rough sets. Pattern Recognit Lett 26:965–975CrossRef
3.
Zurück zum Zitat Cock MD, Cornelis C, Kerre EE (2007) Fuzzy rough sets: the forgotten step. IEEE Trans Fuzzy Syst 15(1):121–130CrossRef Cock MD, Cornelis C, Kerre EE (2007) Fuzzy rough sets: the forgotten step. IEEE Trans Fuzzy Syst 15(1):121–130CrossRef
4.
Zurück zum Zitat Düntsch I, Gediga G (1998) Uncertainty measures of rough set prediction. Artif Intell 106:109–137MATHCrossRef Düntsch I, Gediga G (1998) Uncertainty measures of rough set prediction. Artif Intell 106:109–137MATHCrossRef
5.
Zurück zum Zitat Dübois D, Prade H (1990) Rough fuzzy sets and fuzzy rough sets. Int J Gen Syst 17:191–209CrossRef Dübois D, Prade H (1990) Rough fuzzy sets and fuzzy rough sets. Int J Gen Syst 17:191–209CrossRef
7.
Zurück zum Zitat Feng S, Xu L (1999) Decision support for fuzzy comprehensive evaluation of urban development. Fuzzy Sets Syst 105(1):1–12CrossRef Feng S, Xu L (1999) Decision support for fuzzy comprehensive evaluation of urban development. Fuzzy Sets Syst 105(1):1–12CrossRef
8.
Zurück zum Zitat Feng QR, Miao DQ, Cheng Y (2009) Hierarchical decision rules mining. Expert Syst Appl 37(3):2081–2091CrossRef Feng QR, Miao DQ, Cheng Y (2009) Hierarchical decision rules mining. Expert Syst Appl 37(3):2081–2091CrossRef
9.
Zurück zum Zitat Greco S, Pawlak Z, Slowinski R (2004) Can Bayesian confirmation measures be useful for rough set decision rules? Eng Appl Artif Intell 17:345–361CrossRef Greco S, Pawlak Z, Slowinski R (2004) Can Bayesian confirmation measures be useful for rough set decision rules? Eng Appl Artif Intell 17:345–361CrossRef
10.
Zurück zum Zitat Hong TP, Wang TT, Wang SL (2007) Mining fuzzy \(\beta \)-certain and \(\beta \)-possible rules from quantitative data based on the variable precision rough-set model. Expert Syst Appl 32:223–232CrossRef Hong TP, Wang TT, Wang SL (2007) Mining fuzzy \(\beta \)-certain and \(\beta \)-possible rules from quantitative data based on the variable precision rough-set model. Expert Syst Appl 32:223–232CrossRef
11.
Zurück zum Zitat Hu QH, Yu DR, Xie ZX, Liu JF (2006) Fuzzy probabilistic approximation spaces and their information measures. IEEE Trans Fuzzy Syst 14(2):191–201CrossRef Hu QH, Yu DR, Xie ZX, Liu JF (2006) Fuzzy probabilistic approximation spaces and their information measures. IEEE Trans Fuzzy Syst 14(2):191–201CrossRef
12.
Zurück zum Zitat Hu QH, Xie ZX, Yu DR (2007) Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation. Pattern Recognit 40:3509–3521MATHCrossRef Hu QH, Xie ZX, Yu DR (2007) Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation. Pattern Recognit 40:3509–3521MATHCrossRef
13.
Zurück zum Zitat Hu XH, Cercone N (1995) Learning in relational databases: a rough set approach. Int J Comput Intell 11(2):323–338 Hu XH, Cercone N (1995) Learning in relational databases: a rough set approach. Int J Comput Intell 11(2):323–338
14.
Zurück zum Zitat Huysmans J, Baesens B, Vanthienen J (2007) A new approach for measuring rule set consistency. Data Knowl Eng 63(1):167–182CrossRef Huysmans J, Baesens B, Vanthienen J (2007) A new approach for measuring rule set consistency. Data Knowl Eng 63(1):167–182CrossRef
15.
Zurück zum Zitat Jensen R, Shen Q (2007) Fuzzy-rough sets assisted attribute selection. IEEE Trans Fuzzy Syst 17(1):73–89CrossRef Jensen R, Shen Q (2007) Fuzzy-rough sets assisted attribute selection. IEEE Trans Fuzzy Syst 17(1):73–89CrossRef
16.
Zurück zum Zitat Jensen R, Shen Q (2004) Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches. IEEE Trans Knowl Data Eng 16(12):1457–1471CrossRef Jensen R, Shen Q (2004) Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches. IEEE Trans Knowl Data Eng 16(12):1457–1471CrossRef
19.
Zurück zum Zitat Kwak N, Choi CH (2002) Input feature selection for classification problems. IEEE Trans Neural Netw 13:143–159CrossRef Kwak N, Choi CH (2002) Input feature selection for classification problems. IEEE Trans Neural Netw 13:143–159CrossRef
20.
Zurück zum Zitat Li DY, Zhang B, Leung Y (2004) On knowledge reduction in inconsistent decision information systems. Int J Uncertain Fuzziness Knowl Based Syst 12(5):651–672MathSciNetMATHCrossRef Li DY, Zhang B, Leung Y (2004) On knowledge reduction in inconsistent decision information systems. Int J Uncertain Fuzziness Knowl Based Syst 12(5):651–672MathSciNetMATHCrossRef
21.
Zurück zum Zitat Liang JY, Qian YH, Chu CY, Li DY, Wang JH (2005) Rough set approximation based on dynamic granulation. Lect Notes Comput Sci 3641:701–708CrossRef Liang JY, Qian YH, Chu CY, Li DY, Wang JH (2005) Rough set approximation based on dynamic granulation. Lect Notes Comput Sci 3641:701–708CrossRef
22.
Zurück zum Zitat Liang JY, Dang CY, Chin KS, Yam Richard CM (2002) A new method for measuring uncertainty and fuzziness in rough set theory. Int J Gen Syst 31(4):331–342MathSciNetMATHCrossRef Liang JY, Dang CY, Chin KS, Yam Richard CM (2002) A new method for measuring uncertainty and fuzziness in rough set theory. Int J Gen Syst 31(4):331–342MathSciNetMATHCrossRef
23.
Zurück zum Zitat Liang JY, Shi ZZ, Li DY, Wierman MJ (2006) The information entropy, rough entropy and knowledge granulation in incomplete information system. Int J Gen Syst 35(6):641–654MathSciNetMATHCrossRef Liang JY, Shi ZZ, Li DY, Wierman MJ (2006) The information entropy, rough entropy and knowledge granulation in incomplete information system. Int J Gen Syst 35(6):641–654MathSciNetMATHCrossRef
24.
Zurück zum Zitat Mi JS, Wu WZ, Zhang WX (2004) Approaches to knowledge reduction based on variable precision rough set model. Inf Sci 159:255–272MathSciNetMATHCrossRef Mi JS, Wu WZ, Zhang WX (2004) Approaches to knowledge reduction based on variable precision rough set model. Inf Sci 159:255–272MathSciNetMATHCrossRef
25.
Zurück zum Zitat Mi JS, Wu WZ, Zhang WX (2003) Comparative studies of knowledge reductions in inconsistent systems. Fuzzy Syst Math 17(3):54–60MathSciNet Mi JS, Wu WZ, Zhang WX (2003) Comparative studies of knowledge reductions in inconsistent systems. Fuzzy Syst Math 17(3):54–60MathSciNet
26.
Zurück zum Zitat Pavlenko T (2003) On feature selection, curse-of-dimensionality and error probability in discriminant analysis. J Stat Plan Inference 115:565–584MathSciNetMATHCrossRef Pavlenko T (2003) On feature selection, curse-of-dimensionality and error probability in discriminant analysis. J Stat Plan Inference 115:565–584MathSciNetMATHCrossRef
27.
Zurück zum Zitat Pawlak Z (ed) (1991) Rough Sets: theoretical aspects of reasoning about data. Kluwer Academic Publishers, DordrechtMATH Pawlak Z (ed) (1991) Rough Sets: theoretical aspects of reasoning about data. Kluwer Academic Publishers, DordrechtMATH
28.
Zurück zum Zitat Qian YH, Liang JY (2006) Rough set model based on multi-granulations. In: Proceedings of 5th IEEE Conference on Cognitive Informatics. China I, pp 297–304 Qian YH, Liang JY (2006) Rough set model based on multi-granulations. In: Proceedings of 5th IEEE Conference on Cognitive Informatics. China I, pp 297–304
29.
Zurück zum Zitat Qian YH, Liang JY, Dang CY (2010) Incomplete multi-granulation rough set. IEEE Trans Syst Man Cybern Part A 40(2):420–431CrossRef Qian YH, Liang JY, Dang CY (2010) Incomplete multi-granulation rough set. IEEE Trans Syst Man Cybern Part A 40(2):420–431CrossRef
30.
Zurück zum Zitat Qian YH, Dang CY, Liang JY, Zhang HY, Ma JM (2008) On the evaluation of the decision performance of an incomplete decision table. Data Knowl Eng 65:373–400CrossRef Qian YH, Dang CY, Liang JY, Zhang HY, Ma JM (2008) On the evaluation of the decision performance of an incomplete decision table. Data Knowl Eng 65:373–400CrossRef
31.
Zurück zum Zitat Qian YH, Liang JY, Li DY, Zhang HY, Dang CY (2008) Measures for evaluating the decision performance of a decision table in rough set theory. Inf Sci 178:181–202MATHCrossRef Qian YH, Liang JY, Li DY, Zhang HY, Dang CY (2008) Measures for evaluating the decision performance of a decision table in rough set theory. Inf Sci 178:181–202MATHCrossRef
32.
Zurück zum Zitat Qian YH, Liang JY, Dang CY (2008) Converse approximation and rule extracting from decision tables in rough set theory. Comput Math Appl 55:1754–1765MathSciNetMATHCrossRef Qian YH, Liang JY, Dang CY (2008) Converse approximation and rule extracting from decision tables in rough set theory. Comput Math Appl 55:1754–1765MathSciNetMATHCrossRef
33.
Zurück zum Zitat Qian YH, Liang JY, Dang CY (2008) Consistency measure, inclusion degree and fuzzy measure in decision tables. Fuzzy Sets Syst 159:2353–2377MathSciNetMATHCrossRef Qian YH, Liang JY, Dang CY (2008) Consistency measure, inclusion degree and fuzzy measure in decision tables. Fuzzy Sets Syst 159:2353–2377MathSciNetMATHCrossRef
34.
Zurück zum Zitat Qiu GF, Li HZ, Xu LD, Zhang WX (2003) A knowledge processing method for intelligent systems based on inclusion degree. Expert Syst 20(4):187–195CrossRef Qiu GF, Li HZ, Xu LD, Zhang WX (2003) A knowledge processing method for intelligent systems based on inclusion degree. Expert Syst 20(4):187–195CrossRef
35.
36.
38.
39.
Zurück zum Zitat Swiniarski RW, Skowron A (2003) Rough set methods in feature selection and recognition. Pattern Recognit Lett 24:833–849MATHCrossRef Swiniarski RW, Skowron A (2003) Rough set methods in feature selection and recognition. Pattern Recognit Lett 24:833–849MATHCrossRef
40.
Zurück zum Zitat Wang XZ, Zhai JH, Lu SX (2008) Induction of multiple fuzzy decision trees based on rough set technique. Inf Sci 178(16):3188–3202MathSciNetMATHCrossRef Wang XZ, Zhai JH, Lu SX (2008) Induction of multiple fuzzy decision trees based on rough set technique. Inf Sci 178(16):3188–3202MathSciNetMATHCrossRef
41.
Zurück zum Zitat Wang XZ, Tsand E, Zhao SY, Chen DG, Yeung D (2007) Learning fuzzy rules from fuzzy examples based on rough set techniques. Inf Sci 177(20):4493–4514MATHCrossRef Wang XZ, Tsand E, Zhao SY, Chen DG, Yeung D (2007) Learning fuzzy rules from fuzzy examples based on rough set techniques. Inf Sci 177(20):4493–4514MATHCrossRef
42.
Zurück zum Zitat Wu WZ, Zhang M, Li HZ, Mi JS (2005) Knowledge reduction in random information systems via dempster-shafer theory of evedence. Inf Sci 174:143–164MathSciNetMATHCrossRef Wu WZ, Zhang M, Li HZ, Mi JS (2005) Knowledge reduction in random information systems via dempster-shafer theory of evedence. Inf Sci 174:143–164MathSciNetMATHCrossRef
43.
Zurück zum Zitat Wu WZ, Leung Y, Mi JS (2009) On generalized fuzzy belief functions in infinite spaces. IEEE Trans Fuzzy Syst 17(2):385–397CrossRef Wu WZ, Leung Y, Mi JS (2009) On generalized fuzzy belief functions in infinite spaces. IEEE Trans Fuzzy Syst 17(2):385–397CrossRef
44.
Zurück zum Zitat Wu WZ, Leung Y, Mi JS (2009) Granular computing and knowledge reduction in formal contexts. IEEE Trans Knowl Data Eng 21(10):1461–1474CrossRef Wu WZ, Leung Y, Mi JS (2009) Granular computing and knowledge reduction in formal contexts. IEEE Trans Knowl Data Eng 21(10):1461–1474CrossRef
46.
Zurück zum Zitat Xu WH, Zhang WX (2007) Measuring roughness of generalized rough sets induced by a covering. Fuzzy Sets Syst 158:2443–2455MATHCrossRef Xu WH, Zhang WX (2007) Measuring roughness of generalized rough sets induced by a covering. Fuzzy Sets Syst 158:2443–2455MATHCrossRef
47.
Zurück zum Zitat Xu ZB, Liang JY, Dang CY, Chin KS (2002) Inclusion degree: a perspective on measures for rough set data analysis. Inf Sci 141:227–236MathSciNetMATHCrossRef Xu ZB, Liang JY, Dang CY, Chin KS (2002) Inclusion degree: a perspective on measures for rough set data analysis. Inf Sci 141:227–236MathSciNetMATHCrossRef
48.
Zurück zum Zitat Yu DR, Hu QH, Wu CX (2007) Uncertainty measures on fuzzy relations and their applications. Appl Soft Comput 7:1135–1143CrossRef Yu DR, Hu QH, Wu CX (2007) Uncertainty measures on fuzzy relations and their applications. Appl Soft Comput 7:1135–1143CrossRef
49.
Zurück zum Zitat Zhang WX, Leung Y (eds) (1996) The uncertainty reasoning principles. Xian Jiaotong University Press, China Zhang WX, Leung Y (eds) (1996) The uncertainty reasoning principles. Xian Jiaotong University Press, China
50.
Zurück zum Zitat Zhang WX, Leung Y (1996) Theory of inclusion degrees and its applications to uncertainty inferences. Soft Comput IEEE Intell Syst Inf Process, New York, pp 496–501 Zhang WX, Leung Y (1996) Theory of inclusion degrees and its applications to uncertainty inferences. Soft Comput IEEE Intell Syst Inf Process, New York, pp 496–501
51.
Zurück zum Zitat Zheng P, Germano R, Ariën J, Qin KY, Xu Y (2006) Interpreting and extracting fuzzy decision rules from fuzzy information systems and their inference. Inf Sci 176:1869–1897MATHCrossRef Zheng P, Germano R, Ariën J, Qin KY, Xu Y (2006) Interpreting and extracting fuzzy decision rules from fuzzy information systems and their inference. Inf Sci 176:1869–1897MATHCrossRef
52.
Zurück zum Zitat Zhu W, Wang FY (2003) Reduction and axiomization of covering generalized rough sets. Inf Sci 152:217–230MATHCrossRef Zhu W, Wang FY (2003) Reduction and axiomization of covering generalized rough sets. Inf Sci 152:217–230MATHCrossRef
Metadaten
Titel
Consistency-preserving attribute reduction in fuzzy rough set framework
verfasst von
Yuhua Qian
Jiye Liang
Wei Wei
Publikationsdatum
01.08.2013
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 4/2013
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-012-0090-z

Weitere Artikel der Ausgabe 4/2013

International Journal of Machine Learning and Cybernetics 4/2013 Zur Ausgabe

Neuer Inhalt