Skip to main content
Top

2020 | OriginalPaper | Chapter

Rough Set Based Supervised Machine Learning Approaches: Survey and Application

Authors : Abdelkhalek Hadrani, Karim Guennoun, Rachid Saadane, Mohammed Wahbi

Published in: Innovations in Smart Cities Applications Edition 3

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Despite the availability of real, diverse and knowledge-rich data in all domains, they are generally likely to be uncertain, inaccurate, and incomplete. Attracted by the performances and the strong mathematical underpinnings of the Rough Set Theory (RST), many researchers have suggested new efficient methods and algorithms implying RST and able to deal with these aspects characterizing real data. In this paper, we present a survey of rough set based supervised machine learning approaches allowing to induce deterministic or probabilistic decision rules and their different involved methods. The various models of these approaches have been experimentally evaluated and compared in term of prediction accuracy, quality and compactness of the generated decision rules sets when applied to the community-acquired meningitis diagnosis.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
These two concepts will be introduced and discussed in Subsect. 3.2.
 
Literature
1.
go back to reference Ministère de la Santé, Maroc. Guide de la lutte contre les méningites bactériennes communautaires (2010) Ministère de la Santé, Maroc. Guide de la lutte contre les méningites bactériennes communautaires (2010)
2.
go back to reference Bazan, J.G., Nguyen, H.S., Nguyen, S.H., Synak, P., Wróblewski, J.: Rough set algorithms in classification problem. In: Kacprzyk, J., Polkowski, L., Tsumoto, S., Lin, T.Y. (eds.) Rough Set Methods and Applications, vol. 56, pp. 49–88. Physica-Verlag HD, Heidelberg (2000)MATHCrossRef Bazan, J.G., Nguyen, H.S., Nguyen, S.H., Synak, P., Wróblewski, J.: Rough set algorithms in classification problem. In: Kacprzyk, J., Polkowski, L., Tsumoto, S., Lin, T.Y. (eds.) Rough Set Methods and Applications, vol. 56, pp. 49–88. Physica-Verlag HD, Heidelberg (2000)MATHCrossRef
3.
go back to reference Cervone, G., Panait, L., Michalski, R.: The development of the AQ20 learning system and initial experiments. In: Kłopotek, M.A., Michalewicz, M., Wierzchoń, S.T. (eds.) Intelligent Information Systems 2001, Advances in Intelligent and Soft Computing, vol. 10, pp. 13–29. Physica-Verlag, Heidelberg (2001) Cervone, G., Panait, L., Michalski, R.: The development of the AQ20 learning system and initial experiments. In: Kłopotek, M.A., Michalewicz, M., Wierzchoń, S.T. (eds.) Intelligent Information Systems 2001, Advances in Intelligent and Soft Computing, vol. 10, pp. 13–29. Physica-Verlag, Heidelberg (2001)
4.
go back to reference Clark, P., Niblett, T.: The CN2 induction algorithm. Mach. Learn. 3(4), 261–283 (1989) Clark, P., Niblett, T.: The CN2 induction algorithm. Mach. Learn. 3(4), 261–283 (1989)
5.
go back to reference Collège des universitaires de Maladies Infectieuses et Tropicales: Maladies infectieuses et tropicales, ecn.pilly 2018 - 5ème édition edn. ALINEA Plus, 8, rue Froidevaux - Paris (2017) Collège des universitaires de Maladies Infectieuses et Tropicales: Maladies infectieuses et tropicales, ecn.pilly 2018 - 5ème édition edn. ALINEA Plus, 8, rue Froidevaux - Paris (2017)
6.
go back to reference Dash, R., Paramguru, R.L., Dash, R.: Comparative analysis of supervised and unsupervised discretization techniques. Int. J. Adv. Sci. Technol. 2(3), 29–37 (2011) Dash, R., Paramguru, R.L., Dash, R.: Comparative analysis of supervised and unsupervised discretization techniques. Int. J. Adv. Sci. Technol. 2(3), 29–37 (2011)
7.
8.
go back to reference Dougherty, J., Kohavi, R., Sahami, M.: Supervised and unsupervised discretization of continuous features. In: Proceedings of the Twelfth International Conference on International Conference on Machine Learning, ICML 1995, pp. 194–202. Morgan Kaufmann Publishers Inc., San Francisco (1995) Dougherty, J., Kohavi, R., Sahami, M.: Supervised and unsupervised discretization of continuous features. In: Proceedings of the Twelfth International Conference on International Conference on Machine Learning, ICML 1995, pp. 194–202. Morgan Kaufmann Publishers Inc., San Francisco (1995)
9.
go back to reference Dubois, D., Prade, H.: Rough fuzzy sets and fuzzy rough sets. Int. J. Gen. Syst. 17(2–3), 191–209 (1990)MATHCrossRef Dubois, D., Prade, H.: Rough fuzzy sets and fuzzy rough sets. Int. J. Gen. Syst. 17(2–3), 191–209 (1990)MATHCrossRef
10.
go back to reference Fayyad, U., Irani, K.: Multi-interval discretization of continuous-valued attributes for classification learning. In: Proceedings of the 13th International Joint Conference on Artificial Intelligence, vol. 2, pp. 1022–1027. Morgan Kaufmann, Chambery (1993) Fayyad, U., Irani, K.: Multi-interval discretization of continuous-valued attributes for classification learning. In: Proceedings of the 13th International Joint Conference on Artificial Intelligence, vol. 2, pp. 1022–1027. Morgan Kaufmann, Chambery (1993)
13.
go back to reference Janusz, A., Stawicki, S.: Applications of approximate reducts to the feature selection problem. In: Proceedings of the 6th International Conference on Rough Sets and Knowledge Technology, RSKT 2011, pp. 45–50. Springer-Verlag, Heidelberg (2011) Janusz, A., Stawicki, S.: Applications of approximate reducts to the feature selection problem. In: Proceedings of the 6th International Conference on Rough Sets and Knowledge Technology, RSKT 2011, pp. 45–50. Springer-Verlag, Heidelberg (2011)
14.
go back to reference Janusz, A., Ślȩzak, D.: Utilization of attribute clustering methods for scalable computation of reducts from high-dimensional data. In: Proceedings of the 2012 Federated Conference on Computer Science and Information Systems (FedCSIS), pp. 295–302. IEEE, Wroclaw (2012) Janusz, A., Ślȩzak, D.: Utilization of attribute clustering methods for scalable computation of reducts from high-dimensional data. In: Proceedings of the 2012 Federated Conference on Computer Science and Information Systems (FedCSIS), pp. 295–302. IEEE, Wroclaw (2012)
15.
go back to reference Janusz, A., Ślȩzak, D.: Random probes in computation and assessment of approximate reducts. In: Kryszkiewicz, M., Cornelis, C., Ciucci, D., Medina-Moreno, J., Motoda, H., Raś, Z.W. (eds.) Rough Sets and Intelligent Systems Paradigms, vol. 8537, pp. 53–64. Springer International Publishing, Cham (2014)CrossRef Janusz, A., Ślȩzak, D.: Random probes in computation and assessment of approximate reducts. In: Kryszkiewicz, M., Cornelis, C., Ciucci, D., Medina-Moreno, J., Motoda, H., Raś, Z.W. (eds.) Rough Sets and Intelligent Systems Paradigms, vol. 8537, pp. 53–64. Springer International Publishing, Cham (2014)CrossRef
16.
go back to reference Jiang, F., Sui, Y.: A novel approach for discretization of continuous attributes in rough set theory. Knowl.-Based Syst. 73, 324–334 (2015)CrossRef Jiang, F., Sui, Y.: A novel approach for discretization of continuous attributes in rough set theory. Knowl.-Based Syst. 73, 324–334 (2015)CrossRef
17.
go back to reference Jiang, F., Zhao, Z., Ge, Y.: A supervised and multivariate discretization algorithm for rough sets. In: Yu, J., Greco, S., Lingras, P., Wang, G., Skowron, A. (eds.) Rough Set and Knowledge Technology, RSKT 2010. Lecture Notes in Computer Science, vol. 6401, pp. 596–603. Springer, Heidelberg (2010) Jiang, F., Zhao, Z., Ge, Y.: A supervised and multivariate discretization algorithm for rough sets. In: Yu, J., Greco, S., Lingras, P., Wang, G., Skowron, A. (eds.) Rough Set and Knowledge Technology, RSKT 2010. Lecture Notes in Computer Science, vol. 6401, pp. 596–603. Springer, Heidelberg (2010)
18.
go back to reference Liu, H., Hussain, F., Tan, C.L., Dash, M.: Discretization: an enabling technique. Data Min. Knowl. Disc. 6, 393–423 (2002)MathSciNetCrossRef Liu, H., Hussain, F., Tan, C.L., Dash, M.: Discretization: an enabling technique. Data Min. Knowl. Disc. 6, 393–423 (2002)MathSciNetCrossRef
19.
go back to reference Liu, H., Setiono, R.: Chi2: feature selection and discretization of numeric attributes. In: Proceedings of the Seventh International Conference on Tools with Artificial Intelligence, pp. 388–391. IEEE, Herndon (1995) Liu, H., Setiono, R.: Chi2: feature selection and discretization of numeric attributes. In: Proceedings of the Seventh International Conference on Tools with Artificial Intelligence, pp. 388–391. IEEE, Herndon (1995)
20.
go back to reference Michalski, R.S., Kaufman, K., Wnek, J.: The AQ family of learning programs: a review of recent developments and an exemplary application. Reports of Machine Learning and Inference Laboratory MLI 91-11, School of Information Technology and Engineering, George Mason University, Fairfax, VA (1991) Michalski, R.S., Kaufman, K., Wnek, J.: The AQ family of learning programs: a review of recent developments and an exemplary application. Reports of Machine Learning and Inference Laboratory MLI 91-11, School of Information Technology and Engineering, George Mason University, Fairfax, VA (1991)
21.
go back to reference Nguyen, H.S.: Discretization problem for rough sets methods. In: Polkowski, L., Skowron, A. (eds.) Rough Sets and Current Trends in Computing. Lecture Notes in Computer Science, vol. 1424, pp. 545–552. Springer, Berlin Heidelberg (1998)CrossRef Nguyen, H.S.: Discretization problem for rough sets methods. In: Polkowski, L., Skowron, A. (eds.) Rough Sets and Current Trends in Computing. Lecture Notes in Computer Science, vol. 1424, pp. 545–552. Springer, Berlin Heidelberg (1998)CrossRef
22.
go back to reference Nguyen, H.S.: On efficient handling of continuous attributes in large data bases. Fundamenta Informaticae 48(1), 61–81 (2001)MathSciNetMATH Nguyen, H.S.: On efficient handling of continuous attributes in large data bases. Fundamenta Informaticae 48(1), 61–81 (2001)MathSciNetMATH
23.
go back to reference Øhrn, A., Ohno-Machado, L., Rowland, T.: Building manageable rough set classifiers. In: Proceedings of AMIA Annual Fall Symposium, Orlando, USA, pp. 543–547 (1998) Øhrn, A., Ohno-Machado, L., Rowland, T.: Building manageable rough set classifiers. In: Proceedings of AMIA Annual Fall Symposium, Orlando, USA, pp. 543–547 (1998)
25.
go back to reference Pawlak, Z.: Rough Sets: Theoretical Aspects of Reasoning about Data. Springer, Netherlands, Dordrecht (1991)MATHCrossRef Pawlak, Z.: Rough Sets: Theoretical Aspects of Reasoning about Data. Springer, Netherlands, Dordrecht (1991)MATHCrossRef
26.
go back to reference Pawlak, Z., Skowron, A.: Rough membership functions: a tool for reasoning with uncertainty. Banach Cent. Publ. 28(1), 135–150 (1993)MathSciNetMATHCrossRef Pawlak, Z., Skowron, A.: Rough membership functions: a tool for reasoning with uncertainty. Banach Cent. Publ. 28(1), 135–150 (1993)MathSciNetMATHCrossRef
27.
go back to reference Polkowski, L., Skowron, A.: Rough mereology: a new paradigm for approximate reasoning. Int. J. Approximate Reasoning 15(4), 333–365 (1996)MathSciNetMATHCrossRef Polkowski, L., Skowron, A.: Rough mereology: a new paradigm for approximate reasoning. Int. J. Approximate Reasoning 15(4), 333–365 (1996)MathSciNetMATHCrossRef
28.
go back to reference Pottecher, T., Balabaud-Pichon, V.: Méningites nosocomiales de l’adulte. Annales Françaises d’Anesthésie et de Réanimation 18(5), 558–566 (1999)CrossRef Pottecher, T., Balabaud-Pichon, V.: Méningites nosocomiales de l’adulte. Annales Françaises d’Anesthésie et de Réanimation 18(5), 558–566 (1999)CrossRef
29.
go back to reference Quinlan, J.R.: Induction of decision trees. Mach. Learn. 1(1), 81–106 (1986) Quinlan, J.R.: Induction of decision trees. Mach. Learn. 1(1), 81–106 (1986)
30.
go back to reference Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco (1993) Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco (1993)
32.
go back to reference Riza, L.S., Janusz, A., Bergmeir, C., Cornelis, C., Herrera, F., Ślȩzak, D., Benítez, J.M.: Implementing algorithms of rough set theory and fuzzy rough set theory in the R package “RoughSets”. Inf. Sci. 287, 68–89 (2014)CrossRef Riza, L.S., Janusz, A., Bergmeir, C., Cornelis, C., Herrera, F., Ślȩzak, D., Benítez, J.M.: Implementing algorithms of rough set theory and fuzzy rough set theory in the R package “RoughSets”. Inf. Sci. 287, 68–89 (2014)CrossRef
33.
go back to reference Shen, Q., Chouchoulas, A.: A modular approach to generating fuzzy rules with reduced attributes for the monitoring of complex systems. Eng. Appl. Artif. Intell. 13(3), 263–278 (2000)CrossRef Shen, Q., Chouchoulas, A.: A modular approach to generating fuzzy rules with reduced attributes for the monitoring of complex systems. Eng. Appl. Artif. Intell. 13(3), 263–278 (2000)CrossRef
34.
go back to reference Stefanowski, J., Wilk, S.: Rough sets for handling imbalanced data: combining filtering and rule-based classifiers. Fundamenta Informaticae 72(1–3), 379–391 (2006)MATH Stefanowski, J., Wilk, S.: Rough sets for handling imbalanced data: combining filtering and rule-based classifiers. Fundamenta Informaticae 72(1–3), 379–391 (2006)MATH
35.
go back to reference Viallon, A., Bothelo-Nevers, E., Zeni, F.: Clinical decision rules for acute bacterial meningitis: current insights. Open Access Emerg. Med. 8, 7–16 (2016)CrossRef Viallon, A., Bothelo-Nevers, E., Zeni, F.: Clinical decision rules for acute bacterial meningitis: current insights. Open Access Emerg. Med. 8, 7–16 (2016)CrossRef
36.
go back to reference Wojtusiak, J., Michalski, R.S., Kaufman, K.A., Pietrzykowski, J.: The AQ21 natural induction program for pattern discovery: initial version and its novel features. In: Proceedings of the 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2006), Arlington, VA, USA, pp. 523–526 (2006) Wojtusiak, J., Michalski, R.S., Kaufman, K.A., Pietrzykowski, J.: The AQ21 natural induction program for pattern discovery: initial version and its novel features. In: Proceedings of the 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2006), Arlington, VA, USA, pp. 523–526 (2006)
37.
go back to reference Wróblewski, J.: Ensembles of classifiers based on approximate reducts. Fundamenta Informaticae 47(3–4), 351–360 (2001)MathSciNetMATH Wróblewski, J.: Ensembles of classifiers based on approximate reducts. Fundamenta Informaticae 47(3–4), 351–360 (2001)MathSciNetMATH
38.
go back to reference Yao, Y.: Decision-theoretic rough set models. In: Yao, J., Lingras, P., Wu, W.Z., Szczuka, M., Cercone, N.J., Ślȩzak, D. (eds.) Rough Sets and Knowledge Technology. Lecture Notes in Computer Science, pp. 1–12. Springer, Heidelberg (2007)CrossRef Yao, Y.: Decision-theoretic rough set models. In: Yao, J., Lingras, P., Wu, W.Z., Szczuka, M., Cercone, N.J., Ślȩzak, D. (eds.) Rough Sets and Knowledge Technology. Lecture Notes in Computer Science, pp. 1–12. Springer, Heidelberg (2007)CrossRef
39.
go back to reference Yao, Y., Wong, S.: A decision theoretic framework for approximating concepts. Int. J. Man Mach. Stud. 37(6), 793–809 (1992)CrossRef Yao, Y., Wong, S.: A decision theoretic framework for approximating concepts. Int. J. Man Mach. Stud. 37(6), 793–809 (1992)CrossRef
41.
go back to reference Zeeman, E.C.: The topology of the brain and visual perception. In: Fort Jr., M.K. (ed.) Topology of 3-Manifolds and related topics, pp. 240–256. Prentice Hall, Englewood Cliffs (1962) Zeeman, E.C.: The topology of the brain and visual perception. In: Fort Jr., M.K. (ed.) Topology of 3-Manifolds and related topics, pp. 240–256. Prentice Hall, Englewood Cliffs (1962)
42.
go back to reference Zhang, Q., Xie, Q., Wang, G.: A survey on rough set theory and its applications. CAAI Trans. Intell. Technol. 1(4), 323–333 (2016)CrossRef Zhang, Q., Xie, Q., Wang, G.: A survey on rough set theory and its applications. CAAI Trans. Intell. Technol. 1(4), 323–333 (2016)CrossRef
Metadata
Title
Rough Set Based Supervised Machine Learning Approaches: Survey and Application
Authors
Abdelkhalek Hadrani
Karim Guennoun
Rachid Saadane
Mohammed Wahbi
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-37629-1_30

Premium Partner