nach oben

International Journal of Speech Technology

Erschienen in:

Open Access 22.01.2020

The perception of emotional cues by children in artificial background noise

verfasst von: Emilia Parada-Cabaleiro, Anton Batliner, Alice Baird, Björn Schuller

Erschienen in: International Journal of Speech Technology | Ausgabe 1/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Most typically developed individuals have the ability to perceive emotions encoded in speech; yet, factors such as age or environmental conditions can restrict this inherent skill. Noise pollution and multimedia over-stimulation are common components of contemporary society, and have shown to particularly impair a child’s interpersonal skills. Assessing the influence of such features on the perception of emotion over different developmental stages will advance child-related research. The presented work evaluates how background noise and emotionally connoted visual stimuli affect a child’s perception of emotional speech. A total of 109 subjects from Spain and Germany (4–14 years) evaluated 20 multi-modal instances of nonsense emotional speech, under several environmental and visual conditions. A control group of 17 Spanish adults performed the same perception test. Results suggest that visual stimulation, gender, and the two sub-cultures with different language background do not influence a child’s perception; yet, background noise does compromise their ability to correctly identify emotion in speech—a phenomenon that seems to decrease with age.

Vorheriger Artikel Enhancements in automatic Kannada speech recognition system by background noise elimination and alternate acoustic modelling

Nächster Artikel Twin identification from speech: linear and non-linear cepstral features and models

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Realised in GEMEP as the sub-category ‘elation’.

Realised in GEMEP as the sub-category ‘hot anger’.

https://www.typeform.com/.

These two stimuli were the emotionally connoted drawings mentioned above, which were evaluated in the same perception test as the other stimuli.

Different from the definition of the stages given in Sect. 2, the years of each stage are disjunct, for obvious reasons.

Consent to use the anonymised responses of each child for research purposes only was obtained through caregivers’ signed consent, and under the approval of the TUM IRB ethics committee (Hantke et al. 2016).

Note that Reinforcement might also be considered as an ordinal variable: for instance, 1 (negative), 2 (none), and 3 (positive); yet, since we want to consider ‘no reinforcement’ as a reference for the dummy coding, we have chosen to identify this variable as a nominal.

https://amzn.to/2KQFEGV.

Unweighted Average Recall is the unweighted (by number of instances in each class) mean of percent correctly classified in the diagonal of the confusion matrix. Chance level is only defined by the number of classes (50 % for two classes, 33.3 % for three classes, and so on) and not by the number of cases per class which varies across experiments (Schuller and Batliner 2014).

Both features (F0 range and energy range) were extracted from the ComParE feature set (Schuller et al. 2013) by the openSMILE feature extractor (Eyben et al. 2010).

Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59(4), 390–412.CrossRef

Bänziger, T., & Scherer, K. R. (2010). Introducing the Geneva multimodal emotion portrayal (GEMEP) corpus. In K. R. Scherer, T. Bänziger, & E. B. Roesch (Eds.), Blueprint for affective computing: A sourcebook (pp. 271–294). Oxford: Oxford University Press.

Bänziger, T., Pirker, H., & Scherer, K. (2006). GEMEP-GEneva multimodal emotion portrayals: A corpus for the study of multimodal emotional expressions. In: Proceedings of the LREC’06 Workshop on Corpora for Research on Emotion and Affect, ELRA, Genova, Italy, pp. 15–19.

Batliner, A., Schuller, B., Schaeffler, S., & Steidl, S. (2008). Mothers, adults, children, pets: Towards the acoustics of intimacy. In: Proceedings of the International conference on acoustics, speech and signal processing, IEEE, Las Vegas, NV, pp. 4497–4500.

Bent, T., & Holt, R. F. (2018). Shhh... I need quiet! Children’s understanding of American, British, and Japanese-accented English speakers. Language and Speech, 61(4), 657–673.CrossRef

Borenstein, M., Hedges, L. V., Higgins, J., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester: Wiley Online Library.CrossRef

Corporation IBM (2012). IBM SPSS statistics for windows, version 21.0.

Darwin, C. (1872). The expression of the emotions in man and animals. London: John Murray.CrossRef

Eyben, F., Wöllmer, M., & Schuller, B. (2010). Opensmile: The Munich versatile and fast open-source audio feature extractor. In: Proceedings of the ACM Multimedia, ACM, Florence, pp. 1459–1462.

Finkelstein, S.L., Nickel, A., Harrison, L., Suma, E.A., & Barnes, T. (2009). cMotion: A new game design to teach emotion recognition and programming logic to children using virtual humans. In: Proceedings of the Virtual reality conference, IEEE, Lafayette, LA, pp. 249–250.

Friend, M., & Bryant, J. B. (2000). A developmental lexical bias in the interpretation of discrepant messages. Merrill-Palmer Quarterly, 46, 342–369.

Friend, M., & Farrar, M. J. (1994). A comparison of content-masking procedures for obtaining judgments of discrete affective states. The Journal of the Acoustical Society of America, 96, 1283–1290.CrossRef

Fritschi, L., Brown, A., Kim, R., Schwela, D., & Kephalopoulos, S. (2011). Burden of disease from environmental noise: Quantification of healthy life years lost in Europe. Bonn: World Health Organization.

Grant, R. L. (2014). Converting an odds ratio to a range of plausible relative risks for better communication of research findings. British Medical Journal, 348, 1–7.

Gumenyuk, V., Korzyukov, O., Alho, K., Escera, C., Schröger, E., Ilmoniemi, R. J., et al. (2001). Brain activity index of distractibility in normal school-age children. Neuroscience Letters, 314, 147–150.CrossRef

Hantke, S., Weninger, F., Kurle, R., Ringeval, F., Batliner, A., Mousa, A. E. D., et al. (2016). I hear you eat and speak: Automatic recognition of eating condition and food type, use-cases, and impact on asr performance. PLoS ONE, 11(5), e0154486.CrossRef

Heck, R. H., Thomas, S., & Tabata, L. (2013). Multilevel modeling of categorical outcomes using IBM SPSS. New York, NY: Routledge.CrossRef

House, D. (2009). On the perception of mood in speech: Implications for the hearing impaired. Lund Working Papers in Linguistics, 36, 99–108.

Ives, S. W. (1984). The development of expressivity in drawing. British Journal of Educational Psychology, 54(2), 152–159.CrossRef

Klorer, P. G. (2009). The effects of technological overload on children: An art therapist’s perspective. Art Therapy, 26(2), 80–82.CrossRef

Lahaye, M., Mikolajczak, M., Rieffe, C., Villanueva, L., Van Broeck, N., Bodart, E., et al. (2011). Cross-validation of the emotion awareness questionnaire for children in three populations. Journal of Psychoeducational Assessment, 29(5), 418–427.CrossRef

Mathworks, Inc. (2014). MATLAB: R2014a. Natick, MA: Mathworks, Inc.

Matsumoto, D., & Kishimoto, H. (1983). Developmental characteristics in judgments of emotion from nonverbal vocal cues. International Journal of Intercultural Relations, 7(4), 415–424.CrossRef

McCluskey, K. W., & Albas, D. C. (1981). Perception of the emotional content of speech by canadian and mexican children, adolescents, and adults. International Journal of Psychology, 16(1–4), 119–132.CrossRef

Misailidi, P., & Bonoti, F. (2008). Emotion in children’s art: Do young children understand the emotions expressed in other children’s drawings? Journal of Early Childhood Research, 6(2), 189–200.CrossRef

Morton, J. B., & Trehub, S. E. (2001). Children’s understanding of emotion in speech. Child Development, 72(3), 834–843.CrossRef

Morton, J. B., Trehub, S. E., & Zelazo, P. D. (2003). Sources of inflexibility in 6-year-olds’ understanding of emotion in speech. Child Development, 74(6), 1857–1868.CrossRef

Most, T., & Michaelis, H. (2012). Auditory, visual, and auditory–visual perceptions of emotions by young children with hearing loss versus children with normal hearing. Journal of Speech, Language, and Hearing Research, 55(4), 1148–1162.CrossRef

Öster, A. M., & Risberg, A. (1986). The identification of the mood of a speaker by hearing impaired listeners. Speech Transmission Laboratory Quarterly Progress and Status Reports, 4, 79–90.

Parada-Cabaleiro, E., Baird, A., Batliner, A., Cummins, N., Hantke, S., & Schuller, B. (2017). The perception of emotions in noisified non-sense speech. In: Proceedings of the Interspeech, Annual Conference of the International Speech Cassociation, ISCA, Stockholm, pp. 3246–3250.

Parada-Cabaleiro, E., Costantini, G., Batliner, A., Baird, A., & Schuller, B. (2018). Categorical vs dimensional perception of Italian emotional speech. In: Proceedings of the Interspeech, Annual Conference of the International Speech Communication Association, ISCA, Hyderabad, pp. 3638–3642.

Piaget, J. (1962). The relation of affectivity to intelligence in the mental development of the child. Bulletin of the Menninger Clinic, 26(3), 129–137.

Piaget, J. (2000). Piaget’s theory. In K. Lee (Ed.), Childhood cognitive development: The essential readings (pp. 33–47). Malden, MA: Blackwell.

Quam, C., & Swingley, D. (2012). Development in children’s interpretation of pitch cues to emotions. Child Development, 83(1), 236–250.CrossRef

Richardson, H., Lisandrelli, G., Riobueno-Naylor, A., & Saxe, R. (2018). Development of the social brain from age three to twelve years. Nature Communications, 9(1027), 1–12.

Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161–1178.CrossRef

Sánchez-Pérez, N., Fuentes, L. J., Jolliffe, D., & González-Salinas, C. (2014). Assessing children’s empathy through a Spanish adaptation of the basic empathy scale: Parent’s and child’s report forms. Frontiers in Psychology, 5(1438), 1–13.

Scharenborg, O., Kakouros, S., Koemans, J., et al. (2018). The effect of noise on emotion perception in an unknown language. In: Proceedings of the International Conference on Speech Prosody, pp. 364–368.

Scherer, K. R. (1984). Expression and the nature of emotion. In K. R. Scherer & P. Ekman (Eds.), Approaches to emotion (Vol. 3, pp. 319–344). Hilsdale, NJ: Erlbaum.

Scherer, K. R., Banse, R., & Wallbott, H. G. (2001). Emotion inferences from vocal expression correlate across languages and cultures. Journal of Cross-cultural Psychology, 32, 76–92.CrossRef

Schuller, B., & Batliner, A. (2014). Computational paralinguistics: Emotion, affect and personality in speech and language processing. Chichester: Wiley.

Schuller, B., Steidl, S., Batliner, A., Vinciarelli, A., Scherer, K., Ringeval, F., Chetouani, M., Weninger, F., Eyben, F., Marchi, E., Mortillaro, M., Salamin, H., Polychroniou, A., Valente, F., & Kim, S. (2013). The Interspeech 2013 computational paralinguistics challenge: Social signals, conflict, emotion, autism. In: Proceedings of the Interspeech, Annual Conference of the International Speech Communication Association, ISCA, Lyon, pp. 148–152.

Shackman, J. E., & Pollak, S. D. (2005). Experiential influences on multimodal perception of emotion. Child Development, 76(5), 1116–1126.CrossRef

Song, M., Yang, Z., Baird, A., Parada-Cabaleiro, E., Zhang, Z., Zhao, Z., & Schuller, B. (2019). Audiovisual analysis for recognising frustration during game-play: Introducing the multimodal game frustration database. In: Proceedings of the ACII, International Conference on Affective Computing and Intelligent Interaction, IEEE, Cambridge, pp. 517–523.

Wasserstein, R. L., & Lazar, N. A. (2016). The ASA’s statement on p-values: Context, process, and purpose. The American Statistician, 70, 129–133.MathSciNetCrossRef

Waxer, M., & Morton, J. B. (2011). Children’s judgments of emotion from conflicting cues in speech: Why 6-year-olds are so inflexible. Child Development, 82(5), 1648–1660.CrossRef

Winston, A. S., Kenyon, B., Stewardson, J., & Lepine, T. (1995). Children’s sensitivity to expression of emotion in drawings. Visual Arts Research, 21(1), 1–14.

Titel: The perception of emotional cues by children in artificial background noise
verfasst von: Emilia Parada-Cabaleiro
Anton Batliner
Alice Baird
Björn Schuller
Publikationsdatum: 22.01.2020
Verlag: Springer US
Erschienen in: International Journal of Speech Technology / Ausgabe 1/2020
Print ISSN: 1381-2416
Elektronische ISSN: 1572-8110
DOI: https://doi.org/10.1007/s10772-020-09675-1

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Weitere Artikel der Ausgabe 1/2020

High speed low area OBC DA based decimation filter for hearing aids application

Phonological similarity-based backoff smoothing to boost a bigram syllable boundary detection

A deep learning approach for speaker recognition

Predictive analytics using cross media features in precision farming

Construction of intelligent building sky-eye system based on multi-camera and speech recognition

Enhancements in automatic Kannada speech recognition system by background noise elimination and alternate acoustic modelling