Skip to main content
Top

2013 | OriginalPaper | Chapter

98. A New Criterion of Mutual Information Using R-value

Authors : Taegoon Han, Youngbok Hong, Sejong Oh

Published in: Future Information Communication Technology and Applications

Publisher: Springer Netherlands

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Mutual information has wide area of application including feature selection and classification. To calculate mutual information, statistical equation of information theory has been used. In this paper, we propose a new criterion for mutual information. It is based on R-value which captures overlapping areas among classes in variables (features). Overlapping area of classes reflects uncertainty of the variables; it corresponds to the meaning of entropy. We compare traditional mutual information and R-value on the context of feature selection. From the experiment we confirm that proposed method shows better performance than traditional mutual information.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Guiasu S (1977) Information theory with applications. McGraw-Hill, New YorkMATH Guiasu S (1977) Information theory with applications. McGraw-Hill, New YorkMATH
2.
go back to reference Anastassiou D (2007) Computational analysis of the synergy among multiple interacting genes. Mol Sys Biol 3(83):1–8 Anastassiou D (2007) Computational analysis of the synergy among multiple interacting genes. Mol Sys Biol 3(83):1–8
4.
go back to reference Liu H, Yu L (2005) Toward integrating feature selection algorithms for classification and clustering. IEEE Trans Knowl Data Eng 17:491–502 Liu H, Yu L (2005) Toward integrating feature selection algorithms for classification and clustering. IEEE Trans Knowl Data Eng 17:491–502
5.
go back to reference Saeys Y, Inza I, Larranaga P (2007) A review of feature selection techniques in bioinformatics. Bioinfo 23(19):2507–2517CrossRef Saeys Y, Inza I, Larranaga P (2007) A review of feature selection techniques in bioinformatics. Bioinfo 23(19):2507–2517CrossRef
6.
go back to reference Berrar DP, Dubitzky W, Granzow M (2009) A practical approach to microarray data analysis. Springer Publishing Company, Incorporated Berrar DP, Dubitzky W, Granzow M (2009) A practical approach to microarray data analysis. Springer Publishing Company, Incorporated
8.
go back to reference Tourassia GD, Frederick ED, Markey MK, Floyd CE (2001) Application of the mutual information criterion for feature selection in computer-aided diagnosis. Med Phys 28(12):2394–2402CrossRef Tourassia GD, Frederick ED, Markey MK, Floyd CE (2001) Application of the mutual information criterion for feature selection in computer-aided diagnosis. Med Phys 28(12):2394–2402CrossRef
9.
go back to reference Oh S (2011) A new dataset evaluation method based on category overlap. Comput Biol Med 41:115–122CrossRef Oh S (2011) A new dataset evaluation method based on category overlap. Comput Biol Med 41:115–122CrossRef
10.
go back to reference Battiti R (1994) Using mutual information for selecting features in supervised neural net learning. IEEE Trans Neural Netw 5:537–550CrossRef Battiti R (1994) Using mutual information for selecting features in supervised neural net learning. IEEE Trans Neural Netw 5:537–550CrossRef
11.
go back to reference Zheng Y, Kwoh CK (2011) A feature subset selection method based on high-dimensional mutual information. Entropy 13:860–901 doi:10.3390/e13040860 Zheng Y, Kwoh CK (2011) A feature subset selection method based on high-dimensional mutual information. Entropy 13:860–901 doi:10.​3390/​e13040860
13.
go back to reference Can-Tao L (2009) Mutual information based on Renyi’s entropy feature selection. IEEE international conference on intelligent computing and intelligent systems, 2009. ICIS 2009, vol 1, pp 816–820 Can-Tao L (2009) Mutual information based on Renyi’s entropy feature selection. IEEE international conference on intelligent computing and intelligent systems, 2009. ICIS 2009, vol 1, pp 816–820
14.
go back to reference Jakulin A, Bratko I, Smrke D, Demsar J, Zupan B (2003) Attribute interactions in medical data analysis. AI in Medicine in Europe (AIME), pp 229–238 Jakulin A, Bratko I, Smrke D, Demsar J, Zupan B (2003) Attribute interactions in medical data analysis. AI in Medicine in Europe (AIME), pp 229–238
15.
go back to reference Lee J, Batnyam N, Oh S RFS: efficient feature selection method based on R-value. Comput Biol Med (In press) Lee J, Batnyam N, Oh S RFS: efficient feature selection method based on R-value. Comput Biol Med (In press)
Metadata
Title
A New Criterion of Mutual Information Using R-value
Authors
Taegoon Han
Youngbok Hong
Sejong Oh
Copyright Year
2013
Publisher
Springer Netherlands
DOI
https://doi.org/10.1007/978-94-007-6516-0_98