Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 5/2021

02.01.2021 | Original Article

Entropy based optimal scale combination selection for generalized multi-scale information tables

verfasst von: Han Bao, Wei-Zhi Wu, Jia-Wen Zheng, Tong-Jun Li

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 5/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In many real-life applications, data are often hierarchically structured at different levels of granulations. A multi-scale information table is a special hierarchical data set in which each object can take on as many values as there are scales under the same attribute. An important issue in such a data set is to select optimal scale combination in order to keep certain condition for final decision. In this paper, by employing Shannon’s entropy, we study the selection of optimal scale combination to maintain uncertain measure of a knowledge from a generalized multi-scale information table. We first review the concept of entropy and its basic properties in information tables. We then introduce the notion of scale combinations in a generalized multi-scale information table. We further define entropy optimal scale combination in generalized multi-scale information tables and generalized multi-scale decision tables. Finally, we examine relationship between the entropy optimal scale combination and the classical optimal scale combination. We show that, in either a generalized multi-scale information table or a consistent generalized multi-scale decision table, the entropy optimal scale combination and the classical optimal scale combination are equivalent. And in an inconsistent generalized multi-scale decision table, a scale combination is generalized decision optimal if and only if it is a generalized decision entropy optimal.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Beaubouef T, Petry FE, Arora G (1998) Information-theoretic measures of uncertainty for rough sets and rough relational databases. Inf Sci 109:185–195CrossRef Beaubouef T, Petry FE, Arora G (1998) Information-theoretic measures of uncertainty for rough sets and rough relational databases. Inf Sci 109:185–195CrossRef
2.
Zurück zum Zitat Bianucci B, Cattaneo G, Ciucci D (2007) Entropies and co-entropies of coverings with application to incomplete information systems. Fundam Inf 75:77–105MathSciNetMATH Bianucci B, Cattaneo G, Ciucci D (2007) Entropies and co-entropies of coverings with application to incomplete information systems. Fundam Inf 75:77–105MathSciNetMATH
3.
Zurück zum Zitat Chen YS, Li JJ, Huang JX (2019) Matrix method for the optimal scale selection of multi-scale information decision systems. Mathematics 7:290CrossRef Chen YS, Li JJ, Huang JX (2019) Matrix method for the optimal scale selection of multi-scale information decision systems. Mathematics 7:290CrossRef
4.
Zurück zum Zitat Chen PCL, Zhang CY (2014) Data intensive applications, challenges, techniques and technologies: a survey on big data. Inf Sci 275:314–347CrossRef Chen PCL, Zhang CY (2014) Data intensive applications, challenges, techniques and technologies: a survey on big data. Inf Sci 275:314–347CrossRef
5.
Zurück zum Zitat Gu SM, Wu WZ (2013) On knowledge acquisition in multi-scale decision systems. Int J Mach Learn Cybern 4:477–486CrossRef Gu SM, Wu WZ (2013) On knowledge acquisition in multi-scale decision systems. Int J Mach Learn Cybern 4:477–486CrossRef
6.
Zurück zum Zitat Hao C, Li JH, Fan M, Liu WQ, Tsang ECC (2017) Optimal scale selection in dynamic multi-scale decision tables based on sequential three-way decisions. Inf Sci 415:213–232CrossRef Hao C, Li JH, Fan M, Liu WQ, Tsang ECC (2017) Optimal scale selection in dynamic multi-scale decision tables based on sequential three-way decisions. Inf Sci 415:213–232CrossRef
7.
Zurück zum Zitat Huang ZH, Li JJ, Dai WZ, Lin RD (2019) Generalized multi-scale decision tables with multi-scale decision attributes. Int J Approx Reason 115:194–208MathSciNetCrossRef Huang ZH, Li JJ, Dai WZ, Lin RD (2019) Generalized multi-scale decision tables with multi-scale decision attributes. Int J Approx Reason 115:194–208MathSciNetCrossRef
8.
Zurück zum Zitat Huang B, Li HX, Feng GF, Zhou XZ (2019) Dominance-based rough sets in multi-scale intuitionistic fuzzy decision tables. Appl Math Comput 348:487–512MathSciNetMATH Huang B, Li HX, Feng GF, Zhou XZ (2019) Dominance-based rough sets in multi-scale intuitionistic fuzzy decision tables. Appl Math Comput 348:487–512MathSciNetMATH
9.
Zurück zum Zitat Huang B, Wu WZ, Yan JJ, Li HX, Zhou XZ (2020) Inclusion measure-based multi-granulation decision-theoretic rough sets in multi-scale intuitionistic fuzzy information tables. Inf Sci 507:421–448CrossRef Huang B, Wu WZ, Yan JJ, Li HX, Zhou XZ (2020) Inclusion measure-based multi-granulation decision-theoretic rough sets in multi-scale intuitionistic fuzzy information tables. Inf Sci 507:421–448CrossRef
10.
Zurück zum Zitat Komorowski J, Pawlak Z, Polkowski L, Skowron A (1999) Rough sets: tutorial. In: Pal SK, Skowron A (eds) Rough fuzzy hybridization, a new trend in decision making. Springer, Berlin, pp 3–98 Komorowski J, Pawlak Z, Polkowski L, Skowron A (1999) Rough sets: tutorial. In: Pal SK, Skowron A (eds) Rough fuzzy hybridization, a new trend in decision making. Springer, Berlin, pp 3–98
11.
Zurück zum Zitat Li F, Hu BQ (2017) A new approach of optimal scale selection to multi-scale decision tables. Inf Sci 381:193–208CrossRef Li F, Hu BQ (2017) A new approach of optimal scale selection to multi-scale decision tables. Inf Sci 381:193–208CrossRef
12.
Zurück zum Zitat Li F, Hu BQ, Wang J (2017) Stepwise optimal scale selection for multi-scale decision tables via attribute significance. Knowl-Based Syst 129:4–16CrossRef Li F, Hu BQ, Wang J (2017) Stepwise optimal scale selection for multi-scale decision tables via attribute significance. Knowl-Based Syst 129:4–16CrossRef
13.
Zurück zum Zitat Li JH, Ren Y, Mei CL, Qian YH, Yang XB (2016) A comparative study of multigranulation rough sets and concept lattices via rule acquisition. Knowl-Based Syst 91:152–164CrossRef Li JH, Ren Y, Mei CL, Qian YH, Yang XB (2016) A comparative study of multigranulation rough sets and concept lattices via rule acquisition. Knowl-Based Syst 91:152–164CrossRef
14.
Zurück zum Zitat Li ZW, Zhang GQ, Wu WZ, Xie NX (2020) Measures of uncertainty for knowledge bases. Knowl Inf Syst 62:611–637CrossRef Li ZW, Zhang GQ, Wu WZ, Xie NX (2020) Measures of uncertainty for knowledge bases. Knowl Inf Syst 62:611–637CrossRef
15.
Zurück zum Zitat Liang JY, Li DY (2005) Uncertainty and knowledge acquisition in information systems (in Chinese). Science Press, Beijing Liang JY, Li DY (2005) Uncertainty and knowledge acquisition in information systems (in Chinese). Science Press, Beijing
16.
Zurück zum Zitat Liang JY, Qian YH, Li DY, Hu QH (2015) Theory and method of granular computing for big data mining. Sci Sin Inf 45:1355–1369CrossRef Liang JY, Qian YH, Li DY, Hu QH (2015) Theory and method of granular computing for big data mining. Sci Sin Inf 45:1355–1369CrossRef
17.
Zurück zum Zitat Liang JY, Shi ZZ (2004) The information entropy, rough entropy and knowledge granulation in rough set theory. Int J Uncertain, Fuzz Knowl-Based Syst 12:37–46MathSciNetCrossRef Liang JY, Shi ZZ (2004) The information entropy, rough entropy and knowledge granulation in rough set theory. Int J Uncertain, Fuzz Knowl-Based Syst 12:37–46MathSciNetCrossRef
18.
Zurück zum Zitat Luo C, Li TR, Huang YY, Fujita H (2019) Updating three-way decisions in incomplete multi-scale information systems. Inf Sci 476:274–289CrossRef Luo C, Li TR, Huang YY, Fujita H (2019) Updating three-way decisions in incomplete multi-scale information systems. Inf Sci 476:274–289CrossRef
19.
Zurück zum Zitat Miao DQ, Li DY, Yao YY et al (2011) Uncertainty and granular computing. Science Press, Beijing Miao DQ, Li DY, Yao YY et al (2011) Uncertainty and granular computing. Science Press, Beijing
20.
Zurück zum Zitat Miao DQ, Wang J (2011) On the relationships between information entropy and roughness of knowledge in rough set theory. Pattern Recognit Artif Intell 11:34–40 Miao DQ, Wang J (2011) On the relationships between information entropy and roughness of knowledge in rough set theory. Pattern Recognit Artif Intell 11:34–40
21.
Zurück zum Zitat Pawlak Z (1991) Rough sets: theoretical aspects of reasoning about data. Kluwer Academic Publishers, BostonCrossRef Pawlak Z (1991) Rough sets: theoretical aspects of reasoning about data. Kluwer Academic Publishers, BostonCrossRef
22.
Zurück zum Zitat Qian YH, Liang JY, Dang CY (2010) Incomplete multigranulation rough set. IEEE Trans Syst, Man Cybern-Part A 40:420–431CrossRef Qian YH, Liang JY, Dang CY (2010) Incomplete multigranulation rough set. IEEE Trans Syst, Man Cybern-Part A 40:420–431CrossRef
23.
25.
Zurück zum Zitat She YH, Li JH, Yang HL (2015) A local approach to rule induction in multi-scale decision tables. Knowl-Based Syst 89:398–410CrossRef She YH, Li JH, Yang HL (2015) A local approach to rule induction in multi-scale decision tables. Knowl-Based Syst 89:398–410CrossRef
26.
Zurück zum Zitat Sun L, Zhang XY, Qian YH, Xu JC, Zhang SG (2019) Feature selection using neighborhood entropy-based uncertainty measures for gene expression data classification. Inf Sci 502:18–41MathSciNetCrossRef Sun L, Zhang XY, Qian YH, Xu JC, Zhang SG (2019) Feature selection using neighborhood entropy-based uncertainty measures for gene expression data classification. Inf Sci 502:18–41MathSciNetCrossRef
27.
Zurück zum Zitat Wang GY (2003) Rough reduction in algebra view and information view. Int J Intell Syst 18:679–688CrossRef Wang GY (2003) Rough reduction in algebra view and information view. Int J Intell Syst 18:679–688CrossRef
28.
Zurück zum Zitat Wang GY, Yu H, Yang DC (2002) Decision table reduction based on conditional information entropy. Chin J Comput 25:759–766MathSciNet Wang GY, Yu H, Yang DC (2002) Decision table reduction based on conditional information entropy. Chin J Comput 25:759–766MathSciNet
29.
Zurück zum Zitat Wu WZ, Chen CJ, Li TJ, Xu YH (2016) Comparative study on optimal granularities in inconsistent multi-granular labeled decision systems. Pattern Recognit Artif Intell 29:1103–1111 Wu WZ, Chen CJ, Li TJ, Xu YH (2016) Comparative study on optimal granularities in inconsistent multi-granular labeled decision systems. Pattern Recognit Artif Intell 29:1103–1111
30.
Zurück zum Zitat Wu WZ, Leung Y (2020) A comparison study of optimal scale combination selection in generalized multi-scale decision tables. Int J Mach Learn Cyber 11:961–972CrossRef Wu WZ, Leung Y (2020) A comparison study of optimal scale combination selection in generalized multi-scale decision tables. Int J Mach Learn Cyber 11:961–972CrossRef
31.
Zurück zum Zitat Wu WZ, Leung Y (2011) Theory and applications of granular labelled partitions in multi-scale decision tables. Inf Sci 181:3878–3897CrossRef Wu WZ, Leung Y (2011) Theory and applications of granular labelled partitions in multi-scale decision tables. Inf Sci 181:3878–3897CrossRef
32.
Zurück zum Zitat Wu WZ, Leung Y (2013) Optimal scale selection for multi-scale decision tables. Int J Approx Reason 54:1107–1129MathSciNetCrossRef Wu WZ, Leung Y (2013) Optimal scale selection for multi-scale decision tables. Int J Approx Reason 54:1107–1129MathSciNetCrossRef
33.
Zurück zum Zitat Wu WZ, Qian YH, Li TJ, Gu SM (2017) On rule acquisition in incomplete multi-scale decision tables. Inf Sci 378:282–302MathSciNetCrossRef Wu WZ, Qian YH, Li TJ, Gu SM (2017) On rule acquisition in incomplete multi-scale decision tables. Inf Sci 378:282–302MathSciNetCrossRef
34.
Zurück zum Zitat Xie JP, Yang MH, Li JH, Zheng Z (2018) Rule acquisition and optimal scale selection in multi-scale formal decision contexts and their applications to smart city. Future Gener Comput Syst 83:564–581CrossRef Xie JP, Yang MH, Li JH, Zheng Z (2018) Rule acquisition and optimal scale selection in multi-scale formal decision contexts and their applications to smart city. Future Gener Comput Syst 83:564–581CrossRef
35.
Zurück zum Zitat Xu YH, Wu WZ, Tan AH (2017) Optimal scale selections in consistent generalized multi-scale decision tables. In: Proceedings of International Joint Conference on Rough Sets, July 3-7, 2017, Olsztyn, Poland. Lecture Notes in Artificial Intelligence. Springer, Berlin, 10313: 185–198 Xu YH, Wu WZ, Tan AH (2017) Optimal scale selections in consistent generalized multi-scale decision tables. In: Proceedings of International Joint Conference on Rough Sets, July 3-7, 2017, Olsztyn, Poland. Lecture Notes in Artificial Intelligence. Springer, Berlin, 10313: 185–198
36.
Zurück zum Zitat Zadeh LA (1997) Towards a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90:111–127MathSciNetCrossRef Zadeh LA (1997) Towards a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90:111–127MathSciNetCrossRef
37.
Zurück zum Zitat Zhang GQ, Li ZW, Wu WZ, Liu XF, Xie NX (2018) Information structures and uncertainty measures in a fully fuzzy information system. Int J Approx Reason 101:119–149MathSciNetCrossRef Zhang GQ, Li ZW, Wu WZ, Liu XF, Xie NX (2018) Information structures and uncertainty measures in a fully fuzzy information system. Int J Approx Reason 101:119–149MathSciNetCrossRef
38.
Zurück zum Zitat Zhang QH, Wang GY, Hu J (2013) Multigranularity knowledge acquisition and uncertainty measurement (in Chinese). Science Press, Beijing Zhang QH, Wang GY, Hu J (2013) Multigranularity knowledge acquisition and uncertainty measurement (in Chinese). Science Press, Beijing
39.
Zurück zum Zitat Zhang XQ, Zhang QH, Cheng YL, Wang GY (2020) Optimal scale selection by integrating uncertainty and cost-sensitive learning in multi-scale decision tables. Int J Mach Learn Cybern 11:1095–1114CrossRef Zhang XQ, Zhang QH, Cheng YL, Wang GY (2020) Optimal scale selection by integrating uncertainty and cost-sensitive learning in multi-scale decision tables. Int J Mach Learn Cybern 11:1095–1114CrossRef
Metadaten
Titel
Entropy based optimal scale combination selection for generalized multi-scale information tables
verfasst von
Han Bao
Wei-Zhi Wu
Jia-Wen Zheng
Tong-Jun Li
Publikationsdatum
02.01.2021
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 5/2021
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-020-01243-y

Weitere Artikel der Ausgabe 5/2021

International Journal of Machine Learning and Cybernetics 5/2021 Zur Ausgabe

Neuer Inhalt