Skip to main content
Top

2024 | OriginalPaper | Chapter

Human Perception of Emotional Responses to Changes in Auditory Attributes of Humanoid Agents

Authors : Zhao Zou, Fady Alnajjar, Michael Lwin, Abdullah Al Mahmud, Muhammed Swavaf, Aila Khan, Omar Mubin

Published in: Social Robotics

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Human-robot interaction has emerged as an increasingly prominent discourse within the domain of robotic technologies. In this context, the interaction of both visual and verbal cues assumes an essential role in shaping user experiences. The research problem of this study revolves around investigating the potential impact of auditory attribute alterations in humanoid agents, namely robots and avatars, on users’ emotional responses. The study recruited a participant cohort comprising 14 individuals, aged 18 to 35, to engage in an experimental process of observing avatar videos with distinctive auditory attributes. These attributes encompassed two voice pitches, specifically alto voice and bass voice, as well as two speech styles denoted as frozen style and casual style. Through data collection, a repository of 13,600 data points was amassed from the participants, and subsequently subjected to rigorous analysis via the ANOVA methodology. The empirical findings demonstrate that users reveal sensitive, emotional responsiveness when faced with avatar videos characterized by varying auditory attributes. This pilot study establishes a foundational framework poised to guide future research undertakings aimed at inspiring user experiences through the deliberate manipulation of auditory attributes inherent in humanoid robots and avatars.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Bartneck, C., Belpaeme, T., Eyssel, F., Kanda, T., Keijsers, M., Šabanović, S.: Human-Robot Interaction: An Introduction. Cambridge University Press, Cambridge (2020)CrossRef Bartneck, C., Belpaeme, T., Eyssel, F., Kanda, T., Keijsers, M., Šabanović, S.: Human-Robot Interaction: An Introduction. Cambridge University Press, Cambridge (2020)CrossRef
3.
go back to reference Mataric, M., Scassellati, B.: Socially Assistive Robotics. In: Siciliano, B., Khatib, O., Kroger, T. (eds.) Springer Handbook of Robotics, vol. 200, pp. 1973–1988. Springer, Berlin (2008) Mataric, M., Scassellati, B.: Socially Assistive Robotics. In: Siciliano, B., Khatib, O., Kroger, T. (eds.) Springer Handbook of Robotics, vol. 200, pp. 1973–1988. Springer, Berlin (2008)
4.
go back to reference Walters, M.L., et al.: Evaluating the robot personality and verbal behavior of domestic robots using video-based studies. Adv. Robot. 25(18), 2233–2254 (2011)CrossRef Walters, M.L., et al.: Evaluating the robot personality and verbal behavior of domestic robots using video-based studies. Adv. Robot. 25(18), 2233–2254 (2011)CrossRef
5.
go back to reference Shank, D.B., Graves, C., Gott, A., Gamez, P., Rodriguez, S.: Feeling our way to machine minds: People’s emotions when perceiving mind in artificial intelligence. Comput. Hum. Behav. 1(98), 256–266 (2019)CrossRef Shank, D.B., Graves, C., Gott, A., Gamez, P., Rodriguez, S.: Feeling our way to machine minds: People’s emotions when perceiving mind in artificial intelligence. Comput. Hum. Behav. 1(98), 256–266 (2019)CrossRef
6.
go back to reference Mathur, M.B., et al.: Uncanny but not confusing: Multisite study of perceptual category confusion in the Uncanny Valley. Comput. Hum. Behav. 1(103), 21–30 (2020)CrossRef Mathur, M.B., et al.: Uncanny but not confusing: Multisite study of perceptual category confusion in the Uncanny Valley. Comput. Hum. Behav. 1(103), 21–30 (2020)CrossRef
7.
go back to reference Zhou, H., Huang, M., Zhang, T., Zhu, X., Liu, B.: Emotional chatting machine: emotional conversation generation with internal and external memory. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32, no. 1 (2018) Zhou, H., Huang, M., Zhang, T., Zhu, X., Liu, B.: Emotional chatting machine: emotional conversation generation with internal and external memory. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32, no. 1 (2018)
8.
go back to reference Mindoro, J.N., Pilueta, N.U., Austria, Y.D., Lacatan, L.L., Dellosa, R.M.: Capturing students’ attention through visible behavior: a prediction utilizing YOLOv3 approach. In: 2020 11th IEEE control and system graduate research colloquium (ICSGRC), pp. 328–333. IEEE (2020) Mindoro, J.N., Pilueta, N.U., Austria, Y.D., Lacatan, L.L., Dellosa, R.M.: Capturing students’ attention through visible behavior: a prediction utilizing YOLOv3 approach. In: 2020 11th IEEE control and system graduate research colloquium (ICSGRC), pp. 328–333. IEEE (2020)
9.
go back to reference Nepal, U., Eslamiat, H.: Comparing YOLOv3, YOLOv4 and YOLOv5 for autonomous landing spot detection in faulty UAVs. Sensors 22(2), 464 (2022)CrossRef Nepal, U., Eslamiat, H.: Comparing YOLOv3, YOLOv4 and YOLOv5 for autonomous landing spot detection in faulty UAVs. Sensors 22(2), 464 (2022)CrossRef
10.
go back to reference Jiang, Y.: COTS recognition and detection based on Improved YOLO v5 model. In: 2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP), pp. 830–833. IEEE (2022) Jiang, Y.: COTS recognition and detection based on Improved YOLO v5 model. In: 2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP), pp. 830–833. IEEE (2022)
11.
go back to reference Mollahosseini, A., Hasani, B., Mahoor, M.H.: AffectNet: a database for facial expression, valence, and arousal computing in the wild. IEEE Trans. Affect. Comput. 10(1), 18–31 (2017)CrossRef Mollahosseini, A., Hasani, B., Mahoor, M.H.: AffectNet: a database for facial expression, valence, and arousal computing in the wild. IEEE Trans. Affect. Comput. 10(1), 18–31 (2017)CrossRef
12.
go back to reference Trabelsi, Z., Alnajjar, F., Parambil, M.M., Gochoo, M., Ali, L.: Real-time attention monitoring system for classroom: a deep learning approach for student’s behavior recognition. Big Data Cogn. Comput. 7(1), 48 (2023)CrossRef Trabelsi, Z., Alnajjar, F., Parambil, M.M., Gochoo, M., Ali, L.: Real-time attention monitoring system for classroom: a deep learning approach for student’s behavior recognition. Big Data Cogn. Comput. 7(1), 48 (2023)CrossRef
13.
go back to reference Louie, W.Y., McColl, D., Nejat, G.: Acceptance and attitudes toward a human-like socially assistive robot by older adults. Assist. Technol. 26(3), 140–150 (2014)CrossRef Louie, W.Y., McColl, D., Nejat, G.: Acceptance and attitudes toward a human-like socially assistive robot by older adults. Assist. Technol. 26(3), 140–150 (2014)CrossRef
Metadata
Title
Human Perception of Emotional Responses to Changes in Auditory Attributes of Humanoid Agents
Authors
Zhao Zou
Fady Alnajjar
Michael Lwin
Abdullah Al Mahmud
Muhammed Swavaf
Aila Khan
Omar Mubin
Copyright Year
2024
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-99-8715-3_2

Premium Partner