nach oben

Erschienen in:

2020 | OriginalPaper | Buchkapitel

Towards Automatic Determination of Critical Gestures for European Portuguese Sounds

verfasst von : Samuel Silva, Conceição Cunha, António Teixeira, Arun Joseph, Jens Frahm

Erschienen in: Computational Processing of the Portuguese Language

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Technologies, such as electromagnetic midsagittal articulography (EMA) and real-time magnetic resonance (RT-MRI), can contribute to improve our understanding of the static and dynamic aspects of speech, namely by providing information regarding which articulators are essential (critical) in producing specific sounds and how (gestures). Previous work has successfully demonstrated the possibility to determine critical articulators considering vocal tract data obtained from RT-MRI. However, these works have adopted a conservative approach by considering vocal tract representations analogous to the flash points obtained with EMA data, i.e., landmarks fixed over the articulators, e.g., tongue. To move towards a data-driven method able to determine gestural scores, e.g., driving articulatory speech synthesis, one important step is to move into a representation aligned with Articulatory Phonology and Task Dynamics. This article advances towards this goal by exploring critical articulators determination considering a vocal tract representation aligned with this framework is adopted and presents first results considering 50 Hz RTMRI data for two speakers of European Portuguese.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Nächstes Kapitel Comparison of Heterogeneous Feature Sets for Intonation Verification

Ananthakrishnan, G., Engwall, O.: Important regions in the articulator trajectory. In: Proceedings of the ISSP, Strasbourg, France, pp. 305–308 (2008)

Black, M.P., et al.: Automated evaluation of non-native English pronunciation quality: combining knowledge-and data-driven features at multiple time scales. In: Proceedings of the INTERSPEECH, pp. 493–497 (2015)

Browman, C.P., Goldstein, L.: Some notes on syllable structure in articulatory phonology. Phonetica 45(2–4), 140–155 (1988)CrossRef

Chao, Q.: Data-driven approaches to articulatory speech processing. Ph.D. thesis, University of California, Merced (2011)

Cunha, C.: Die Organisation von Konsonantenclustern und CVC-Sequenzen in zwei portugiesischen Varietäten. Ph.D. thesis, LMU (2012)

Cunha, C.: Portuguese lexical clusters and CVC sequences in speech perception and production. Phonetica 72(2–3), 138–161 (2015)CrossRef

Feng, G., Castelli, E.: Some acoustic features of nasal and nasalized vowels: a target for vowel nasalization. J. Acoust. Soc. Am. 99(6), 3694–3706 (1996)CrossRef

Goldstein, L., Byrd, D., Saltzman, E.: The role of vocal tract gestural action units in understanding the evolution of phonology. In: Arbib, M.A. (ed.) Action to Language via the Mirror Neuron System, pp. 215–249. Cambridge University Press, Cambridge (2006)CrossRef

Hall, N.: Articulatory phonology. Lang. Linguist. Compass 4(9), 818–830 (2010). https://doi.org/10.1111/j.1749-818X.2010.00236.xCrossRef

10.

Jackson, P.J., Singampalli, V.D.: Statistical identification of critical, dependent and redundant articulators. J. Acoust. Soc. Am. 123(5), 3321 (2008). https://doi.org/10.1121/1.2933798CrossRef

11.

Jackson, P.J., Singampalli, V.D.: Statistical identification of articulation constraints in the production of speech. Speech Commun. 51(8), 695–710 (2009). https://doi.org/10.1016/j.specom.2009.03.007CrossRef

12.

Johnson, R.A., Wichern, D.W.: Applied Multivariate Statistical Analysis, 6th edn. Pearson Prentice Hall, Upper Saddle River (2007)MATH

13.

Kim, J., Toutios, A., Lee, S., Narayanan, S.S.: A kinematic study of critical and non-critical articulators in emotional speech production. J. Acoust. Soc. Am. 137(3), 1411–1429 (2015). https://doi.org/10.1121/1.4908284CrossRef

14.

Lammert, A.C., Proctor, M.I., Narayanan, S.S., et al.: Data-driven analysis of realtime vocal tract MRI using correlated image regions. In: Proceedings of the INTERSPEECH, pp. 1572–1575 (2010)

15.

Marin, S., Pouplier, M.: Temporal organization of complex onsets and codas in American English: testing the predictions of a gestural coupling model. Mot. Control 14(3), 380–407 (2010)CrossRef

16.

Martins, P., Oliveira, C., Silva, S., Teixeira, A.: Velar movement in European Portuguese nasal vowels. In: Proceedings of the IberSPEECH, pp. 231–240 (2012)

17.

Oliveira, C.: From grapheme to gesture. Linguistic contributions for an articulatory based text-to-speech system. Ph.D. thesis, University of Aveiro (2009)

18.

Oliveira, C., Teixeira, A.: On gestures timing in European Portuguese nasals. In: Proceedings of the ICPhS, Saarbrücken, Germany (2007)

19.

Parkinson, S.: Portuguese nasal vowels as phonological diphthongs. Lingua 61(2–3), 157–177 (1983)CrossRef

20.

Prasad, A., Ghosh, P.K.: Information theoretic optimal vocal tract region selection from real time magnetic resonance images for broad phonetic class recognition. Comput. Speech Lang. 39, 108–128 (2016). https://doi.org/10.1016/j.csl.2016.03.003CrossRef

21.

Ramanarayanan, V., Segbroeck, M.V., Narayanan, S.S.: Directly data-derived articulatory gesture-like representations retain discriminatory information about phone categories. Comput. Speech Lang. 36, 330–346 (2016). https://doi.org/10.1016/j.csl.2015.03.004CrossRef

22.

Rao, M., Seth, S., Xu, J., Chen, Y., Tagare, H., Príncipe, J.C.: A test of independence based on a generalized correlation function. Sign. Proces. 91(1), 15–27 (2011)CrossRef

23.

Saltzman, E.L., Munhall, K.G.: A dynamical approach to gestural patterning in speech production. Ecol. Psychol. 1(4), 333–382 (1989)CrossRef

24.

Scott, A.D., Wylezinska, M., Birch, M.J., Miquel, M.E.: Speech MRI: morphology and function. Physica Med. 30(6), 604–618 (2014). https://doi.org/10.1016/j.ejmp.2014.05.001CrossRef

25.

Sepulveda, A., Castellanos-Domínguez, G., Guido, R.C.: Time-frequency relevant features for critical articulators movement inference. In: Proceedings of the 20th European Signal Processing Conference (EUSIPCO), pp. 2802–2806, August 2012

26.

Silva, S., Teixeira, A.: Unsupervised segmentation of the vocal tract from real-time MRI sequences. Comput. Speech Lang. 33(1), 25–46 (2015). https://doi.org/10.1016/j.csl.2014.12.003CrossRef

27.

Silva, S., Teixeira, A.: Quantitative systematic analysis of vocal tract data. Comput. Speech Lang. 36, 307–329 (2016). https://doi.org/10.1016/j.csl.2015.05.004CrossRef

28.

Silva, S., Teixeira, A., Orvalho, V.: Articulatory-based audiovisual speech synthesis: proof of concept for European Portuguese. In: Proceedings of the IberSPEECH, Lisbon, Portugal, pp. 119–126 (2016)

29.

Silva, S., Teixeira, A.J.: Critical articulators identification from RT-MRI of the vocal tract. In: INTERSPEECH, pp. 626–630 (2017)

30.

Silva, S., Teixeira, A., Cunha, C., Almeida, N., Joseph, A.A., Frahm, J.: Exploring critical articulator identification from 50Hz RT-MRI data of the vocal tract. In: Proceedings of the INTERSPEECH, pp. 874–878 (2019). https://doi.org/10.21437/Interspeech.2019-2897

31.

Teixeira, A., Vaz, F., Príncipe, J.C.: Nasal vowels after nasal consonants. In: 5th Seminar on Speech Production: Models and Data, Kloster Seon, Alemanha, May 2000

32.

Teixeira, A., Vaz, F.: European Portuguese nasal vowels: an EMMA study. In: Proceedings of the INTERSPEECH, Aalborg, Denmark, pp. 1483–1486 (2001)

Titel: Towards Automatic Determination of Critical Gestures for European Portuguese Sounds
verfasst von: Samuel Silva
Conceição Cunha
António Teixeira
Arun Joseph
Jens Frahm
Verlag: Springer International Publishing
Buch: Computational Processing of the Portuguese Language
Print ISBN: 978-3-030-41504-4

Electronic ISBN: 978-3-030-41505-1

Copyright-Jahr: 2020
DOI: https://doi.org/10.1007/978-3-030-41505-1_1

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner