Skip to main content
Top

2021 | OriginalPaper | Chapter

From Bottom to Top: A Coordinated Feature Representation Method for Speech Recognition

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This article introduces a novel coordinated representation method, termed MFCC aided sparse representation (MSR), for speech recognition. The proposed MSR combines a top level sparse representation feature with the conventional MFCC, i.e., a bottom level feature of speech, so that complex information of various hidden attributes in the speech can be contained. A neural network architecture with attention mechanism has also been designed to validate the effective of the proposed MSR for speech recognition. Experiments on the TIMIT database show that significant performance improvements, in terms of recognition accuracy, can be obtained by the proposed MSR compared with the scenarios that adopt the MFCC or the sparse representation solely.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Jaitly, N., Hinton, G.: Learning a better representation of speech soundwaves using restricted Boltzmann machines. In: 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2011) Jaitly, N., Hinton, G.: Learning a better representation of speech soundwaves using restricted Boltzmann machines. In: 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2011)
2.
go back to reference Palaz, D., Collobert, R., Doss, M.M.: Estimating phoneme class conditional probabilities from raw speech signal using convolutional neural networks. Computer Science (2013) Palaz, D., Collobert, R., Doss, M.M.: Estimating phoneme class conditional probabilities from raw speech signal using convolutional neural networks. Computer Science (2013)
3.
go back to reference Palaz, D., Magimai.-Doss, M., Collobert, R.: Convolutional neural networks-based continuous speech recognition using raw speech signal. In: IEEE International Conference on Acoustics (2015) Palaz, D., Magimai.-Doss, M., Collobert, R.: Convolutional neural networks-based continuous speech recognition using raw speech signal. In: IEEE International Conference on Acoustics (2015)
4.
go back to reference Kim, C., Stern, R.M.: Feature extraction for robust speech recognition based on maximizing the sharpness of the power distribution and on power flooring. In: 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 4574–4577 (2010). https://doi.org/10.1109/ICASSP.2010.5495570 Kim, C., Stern, R.M.: Feature extraction for robust speech recognition based on maximizing the sharpness of the power distribution and on power flooring. In: 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 4574–4577 (2010). https://​doi.​org/​10.​1109/​ICASSP.​2010.​5495570
5.
go back to reference Sailor, H.B., Patil, H.A.: Novel unsupervised auditory filter bank learning using convolutional RBM for speech recognition. IEEE/ACM Trans. Audio Speech Lang. Process. PP(12), 1 (2016) Sailor, H.B., Patil, H.A.: Novel unsupervised auditory filter bank learning using convolutional RBM for speech recognition. IEEE/ACM Trans. Audio Speech Lang. Process. PP(12), 1 (2016)
6.
go back to reference Kanevsky, D., Nahamoo, D., Ramabhadran, B., Sainath, T.N.: Sparse representation features for speech recognition (2012) Kanevsky, D., Nahamoo, D., Ramabhadran, B., Sainath, T.N.: Sparse representation features for speech recognition (2012)
7.
go back to reference Sharma, P., Abrol, V., Dileep, A.D., Sao, A.K.: Sparse coding based features for speech units classification. Comput. Speech Lang. 47, 333–350 (2017)CrossRef Sharma, P., Abrol, V., Dileep, A.D., Sao, A.K.: Sparse coding based features for speech units classification. Comput. Speech Lang. 47, 333–350 (2017)CrossRef
8.
go back to reference Sharma, P., Abrol, V., Sao, A.K.: Deep sparse representation based features for speech recognition. IEEE/ACM Trans. Audio Speech Lang. Process. PP(11), 1 (2017) Sharma, P., Abrol, V., Sao, A.K.: Deep sparse representation based features for speech recognition. IEEE/ACM Trans. Audio Speech Lang. Process. PP(11), 1 (2017)
9.
go back to reference Tripathi, K., Rao, K.S.: Analysis of sparse representation based feature on speech mode classification. In: INTERSPEECH (2018) Tripathi, K., Rao, K.S.: Analysis of sparse representation based feature on speech mode classification. In: INTERSPEECH (2018)
11.
go back to reference Aharon, M., Elad, M., Bruckstein, A.: K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process. 54, 4311–4322 (2006)CrossRef Aharon, M., Elad, M., Bruckstein, A.: K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process. 54, 4311–4322 (2006)CrossRef
13.
go back to reference Yılmaz, E., Gemmeke, J.F., Hamme, H.V.: Noise-robust speech recognition with exemplar-based sparse representations using alpha-beta divergence. In: IEEE International Conference on Acoustics (2014) Yılmaz, E., Gemmeke, J.F., Hamme, H.V.: Noise-robust speech recognition with exemplar-based sparse representations using alpha-beta divergence. In: IEEE International Conference on Acoustics (2014)
14.
go back to reference Gemmeke, J.F., Virtanen, T., Hurmalainen, A.: Exemplar-based sparse representations for noise robust automatic speech recognition. IEEE Trans. Audio Speech Lang. Process. 19(7), 2067–2080 (2011)CrossRef Gemmeke, J.F., Virtanen, T., Hurmalainen, A.: Exemplar-based sparse representations for noise robust automatic speech recognition. IEEE Trans. Audio Speech Lang. Process. 19(7), 2067–2080 (2011)CrossRef
15.
go back to reference Smit, W.J.: Sparse coding for speech recognition. In: IEEE International Conference on Acoustics Speech & Signal Processing (2008) Smit, W.J.: Sparse coding for speech recognition. In: IEEE International Conference on Acoustics Speech & Signal Processing (2008)
17.
go back to reference Chan, W., Jaitly, N., Le, Q., Vinyals, O.: Listen, attend and spell: a neural network for large vocabulary conversational speech recognition. In: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2016) Chan, W., Jaitly, N., Le, Q., Vinyals, O.: Listen, attend and spell: a neural network for large vocabulary conversational speech recognition. In: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2016)
18.
go back to reference Garofolo, J.S., Lamel, L.F., Fisher, W.M., Fiscus, J.G., Pallett, D.S., Dahlgren, N.L.: Darpa timit acoustic-phonetic continuous speech corpus cd-rom TIMIT Garofolo, J.S., Lamel, L.F., Fisher, W.M., Fiscus, J.G., Pallett, D.S., Dahlgren, N.L.: Darpa timit acoustic-phonetic continuous speech corpus cd-rom TIMIT
Metadata
Title
From Bottom to Top: A Coordinated Feature Representation Method for Speech Recognition
Authors
Lixia Zhou
Jun Zhang
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-68780-9_33

Premium Partner