Top

International Journal of Speech Technology

Published in:

01-06-2014

An improved feature transformation method using mutual information

Authors: Seyed Milad Bassir, Ahmad Akbari, Babak Nassersharif

Published in: International Journal of Speech Technology | Issue 2/2014

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The feature transformation is a very important step in pattern recognition systems. A feature transformation matrix can be obtained using different criteria such as discrimination between classes or feature independence or mutual information between features and classes. The obtained matrix can also be used for feature reduction. In this paper, we propose a new method for finding a feature transformation-based on Mutual Information (MI). For this purpose, we suppose that the Probability Density Function (PDF) of features in classes is Gaussian, and then we use the gradient ascent to maximize the mutual information between features and classes. Experimental results show that the proposed MI projection consistently outperforms other methods for a variety of cases. In the UCI Glass database we improve the classification accuracy up to 7.95 %. Besides, the improvement of phoneme recognition rate is 3.55 % on TIMIT.

previous article GMM based language identification system using robust features

next article A perceptually motivated stationary wavelet packet filterbank using improved spectral over-subtraction for enhancement of speech in various noise environments

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Available only for authorised users

Probability Density Function.

Comprehensive Medicinal Chemistry.

Hidden Markov Model.

Mel Frequency Cepstral Coefficient.

Signal-to-Noise Ratio.

Blake, C., Keogh, E., & Merz, C. J. (1998). In UCI repository of machine learning databases.

Duda, R. O., & Hart, P. E. (2001). In Pattern classification (2nd ed.). New York: Wiley-Interscience.

Fukunaga, K. (1990). Introduction to statistical pattern recognition. New York: Academic Press. MATH

Hall, M., Frank, E., & Holmes, G. (2009). In The WEKA data mining software: an update.

Hild, K. E. II, Erdogmus, D., Torkkola, K., & Principe, J. C. (2006). Feature extraction using information-theoretic learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(9), 1385–1392. CrossRef

Kumar, N., & Andreou, A. G. (1998). Heteroscedastic discriminant analysis and reduced rank HMM’s for improved speech recognition. Speech Communication, 26, 283–297. CrossRef

Lee, K., & Hon, H. (1988). Speaker-independent phone recognition using hidden Markov model. IEEE Transactions on Acoustics, Speech, and Signal.

Padmanabhan, M., & Dharanipragada, S. (2005). Maximizing information content in feature extraction. IEEE Transactions on Speech and Audio Processing, 13(4).

Siohan, O. (1998). On the robustness of linear discrimination analysis as a preprocessing step for noisy speech recognition. In IEEE international conference on acoustics, speech, and signal processing (pp. 125–128).

Torkkola, K. (2003). Feature extraction by non-parametric mutual information maximization. Journal of Machine Learning Research, 3(7–8), 1415–1438. MATHMathSciNet

Torkkola, K., & Campbell, W. M. (2000). Mutual information in learning feature transformations. In Proceedings of the 17th international conference on machine learning, Stanford, CA, USA (pp. 1015–1022).

Title: An improved feature transformation method using mutual information
Authors: Seyed Milad Bassir
Ahmad Akbari
Babak Nassersharif
Publication date: 01-06-2014
Publisher: Springer US
Published in: International Journal of Speech Technology / Issue 2/2014
Print ISSN: 1381-2416
Electronic ISSN: 1572-8110
DOI: https://doi.org/10.1007/s10772-013-9211-7

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 2/2014

Audio watermarking in transform domain based on singular value decomposition and Cartesian-polar transformation

A perceptually motivated stationary wavelet packet filterbank using improved spectral over-subtraction for enhancement of speech in various noise environments

Tone modelling in Ibibio speech synthesis

GMM based language identification system using robust features

Recent developments in spoken term detection: a survey

Methods for applying VAD in Kazakh speech recognition systems