Skip to main content
Top

2021 | OriginalPaper | Chapter

Voice Conversion Using Spectral Mapping and TD-PSOLA

Authors : Srinivasan Kannan, Pooja. R. Raju, R. Sai Surya Madhav, Shikha Tripathi

Published in: Advances in Computing and Network Communications

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we propose a novel approach for a voice conversion system that makes effective use of spectral characteristics and excitation information, to optimally morph voice. This work addresses some key issues that are not adequately addressed in reported literature and achieves a more holistic voice conversion system. This is achieved using a strategic combination of line spectral frequencies (LSFs) to minimize the effects of over smoothing, a neural network for performing nonlinear spectral mapping and time-domain pitch synchronous overlap add to account for the interaction of excitation signal with the vocal tract. Within this proposed system, two different methods of pitch modification have been suggested, and the performance of these is compared with existing models of comparable complexity. The proposed methods have an average LSF performance index of 0.4082 and 0.4008, respectively, which is higher than existing similar work reported.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
3.
5.
go back to reference Hashimoto, M., Higuchi, N.:Training data selection for voice conversion using speaker selection and vector field smoothing. In: Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP ’96, Philadelphia, PA, USA, vol. 3, pp. 1397–1400 (1996). https://doi.org/10.1109/ICSLP.1996.607875 Hashimoto, M., Higuchi, N.:Training data selection for voice conversion using speaker selection and vector field smoothing. In: Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP ’96, Philadelphia, PA, USA, vol. 3, pp. 1397–1400 (1996). https://​doi.​org/​10.​1109/​ICSLP.​1996.​607875
6.
go back to reference Kim, E.-K., Lee, S., Oh Y.-H.: Hidden Markov model based voice conversion using dynamic characteristics of speaker. In: EUROSPEECH-1997, pp. 2519–2522 (1997) Kim, E.-K., Lee, S., Oh Y.-H.: Hidden Markov model based voice conversion using dynamic characteristics of speaker. In: EUROSPEECH-1997, pp. 2519–2522 (1997)
7.
go back to reference Desai, S., Raghavendra, E.V., Yegnanarayana, B., Black, A.W., Prahallad, K.: Voice conversion using artificial neural networks. In: 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, Taipei, pp. 3893–3896 (2009). https://doi.org//ICASSP.2009.4960478 Desai, S., Raghavendra, E.V., Yegnanarayana, B., Black, A.W., Prahallad, K.: Voice conversion using artificial neural networks. In: 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, Taipei, pp. 3893–3896 (2009). https://​doi.​org/​/​ICASSP.​2009.​4960478
9.
go back to reference Bhuyan, A.K., Nirmal, J.H.: Comparative study of voice conversion framework with line spectral frequency and Mel-frequency cepstral coefficients as features using artificial neural networks. In: 2015 International Conference on Computers, Communications, and Systems (ICCCS), Kanyakumari, pp. 230–235 (2015). https://doi.org/10.1109/CCOMS.2015.7562906 Bhuyan, A.K., Nirmal, J.H.: Comparative study of voice conversion framework with line spectral frequency and Mel-frequency cepstral coefficients as features using artificial neural networks. In: 2015 International Conference on Computers, Communications, and Systems (ICCCS), Kanyakumari, pp. 230–235 (2015). https://​doi.​org/​10.​1109/​CCOMS.​2015.​7562906
12.
go back to reference Koolagudi, S.G., Vishwanath, B.K., Akshatha, M., Murthy, Y.V.S.: Performance analysis of LPC and MFCC features in voice conversion using artificial neural networks. In: Satapathy, S., Bhateja, V., Joshi, A. (eds.) Proceedings of the International Conference on Data Engineering and Communication Technology. Advances in Intelligent Systems and Computing, vol. 469. Springer, Singapore (2017) Koolagudi, S.G., Vishwanath, B.K., Akshatha, M., Murthy, Y.V.S.: Performance analysis of LPC and MFCC features in voice conversion using artificial neural networks. In: Satapathy, S., Bhateja, V., Joshi, A. (eds.) Proceedings of the International Conference on Data Engineering and Communication Technology. Advances in Intelligent Systems and Computing, vol. 469. Springer, Singapore (2017)
13.
go back to reference Avarachan, A., Vekkot, S., Tripathi, S.: Glottal excitation and spectral mapping for voice conversion. In: International Conference on Signal and Image Processing (ICSIP 2017) (2017) Avarachan, A., Vekkot, S., Tripathi, S.: Glottal excitation and spectral mapping for voice conversion. In: International Conference on Signal and Image Processing (ICSIP 2017) (2017)
14.
go back to reference Yathigiri, A., Bathula, M., Kothapalli, S., Vekkot, S., Tripathi, S.: Voice transformation using pitch and spectral mapping. In: 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Udupi, pp. 1540–1544 (2017). https://doi.org/10.1109/ICACCI.2017.8126060 Yathigiri, A., Bathula, M., Kothapalli, S., Vekkot, S., Tripathi, S.: Voice transformation using pitch and spectral mapping. In: 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Udupi, pp. 1540–1544 (2017). https://​doi.​org/​10.​1109/​ICACCI.​2017.​8126060
15.
go back to reference Mitra, S.K.: Digital Signal Processing: A Computer-Based Approach. McGraw-Hill, New York (2013) Mitra, S.K.: Digital Signal Processing: A Computer-Based Approach. McGraw-Hill, New York (2013)
16.
go back to reference Rabiner, L.R., Schafer, R.W.: Theory and Applications of Digital Speech Processing. Pearson Publications (2010 ) Rabiner, L.R., Schafer, R.W.: Theory and Applications of Digital Speech Processing. Pearson Publications (2010 )
17.
go back to reference McLoughlin, I.: Applied Speech And Audio Processing With MATLAB Examples. Cambridge University Press, Cambridge (2009)CrossRef McLoughlin, I.: Applied Speech And Audio Processing With MATLAB Examples. Cambridge University Press, Cambridge (2009)CrossRef
Metadata
Title
Voice Conversion Using Spectral Mapping and TD-PSOLA
Authors
Srinivasan Kannan
Pooja. R. Raju
R. Sai Surya Madhav
Shikha Tripathi
Copyright Year
2021
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-33-6987-0_17