Top

Published in:

2022 | OriginalPaper | Chapter

Visualization of Physiological Response in the Context of Emotion Recognition

Authors : Kristián Fodor, Zoltán Balogh, Jan Francisti

Published in: Progress in Artificial Intelligence

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Emotion recognition relies heavily on physiological responses and facial expressions. Using current technology, it is possible to use a set of measuring instruments to create a complex sensory network that is able to acquire physiological response and recognize emotions based on the facial features of the user by using facial recognition software. It is also important to automate these devices and the acquisition of sensory data to make it easy to use without the need of further user input. The aim of this work is to describe an experiment, where physiological functions are collected using low-cost, common and non-invasive Internet of Things (IoT) devices, and the sensory data is automatically sent to a server for further processing. From the measured values a dataset is created and in order to understand the data, descriptive statistics is used. The data are visualized with the help of well-known Python libraries such Pandas, Matplotlib or Seaborn.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter A Review on Supervised Learning Methodologies for Detecting Eating Habits of Diabetic Patients

next chapter Effective Communication in Transition Care During Shift Change

Kumar, J., Kumar, J.A.: Machine learning approach to classify emotions using GSR. Adv. Res. Electr. Electron. Eng. 2, 72–76 (2015)

Kaya, H., Gurpinar, F., Salah, A.A.: Video-based emotion recognition in the wild using deep transfer learning and score fusion (2017)

Fang, J., Yuan, Y., Lu, X., Feng, Y.: Muti-stage learning for gender and age prediction. Neurocomputing 334, 114–124 (2019). https://doi.org/10.1016/J.NEUCOM.2018.12.073CrossRef

Zeng, N., Zhang, H., Song, B., Liu, W., Li, Y., Dobaie, A.M.: Facial expression recognition via learning deep sparse autoencoders. Neurocomputing 273, 643–649 (2018)CrossRef

Ménard, M., Richard, P., Hamdi, H., Daucé, B., Yamaguchi, T.: Emotion recognition based on heart rate and skin conductance. In: PhyCS 2015 - 2nd International Conference on Physiological Computing Systems, pp. 26–32 (2015). https://doi.org/10.5220/0005241100260032

Nandi, A., Xhafa, F.: A federated learning method for real-time emotion state classification from multi-modal streaming. Methods (2022). https://doi.org/10.1016/J.YMETH.2022.03.005

Ayata, D., Yaslan, Y., Kamasak, M.: Emotion recognition via random forest and galvanic skin response: comparison of time based feature sets, window sizes and wavelet approaches. In: 2016 Medical Technologies National Conference, TIPTEKNO 2016 (2017). https://doi.org/10.1109/TIPTEKNO.2016.7863130

Ayata, D., Yaslan, Y., Kamasak, M.E.: Emotion recognition from multimodal physiological signals for emotion aware healthcare systems. J. Med. Biol. Eng. 40, 149–157 (2020). https://doi.org/10.1007/S40846-019-00505-7/FIGURES/5CrossRef

Islam, M.R., Ahmad, M.: Wavelet analysis based classification of emotion from EEG signal. In: International Conference on Electrical, Computer and Communication Engineering, ECCE 2019 (2019). https://doi.org/10.1109/ECACE.2019.8679156

10.

Sun, Y., Sebe, N., Lew, M.S., Gevers, T.: Authentic emotion detection in real-time video. In: Sebe, N., Lew, M., Huang, T.S. (eds.) CVHCI 2004, vol. 3058, pp. 94–104. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-24837-8_10CrossRef

11.

Canento, F., Fred, A., Silva, H., Gamboa, H., Lourenço, A.: Multimodal biosignal sensor data handling for emotion recognition. Proc. IEEE Sensors. 647–650 (2011). https://doi.org/10.1109/ICSENS.2011.6127029

12.

Fodor, K., Balogh, Z.: Process modelling and creating predictive models of sensory networks using fuzzy petri nets. Procedia Comput. Sci. 9 (2021)

13.

Fodor, K., Balogh, Z.: Sensory monitoring of physiological functions using IoT based on a model in petri nets. In: Zhang, W., Zou, L., Maamar, Z., Chen, Lu. (eds.) WISE 2021, vol. 13081, pp. 435–443. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-91560-5_32CrossRef

14.

Haag, A., Goronzy, S., Schaich, P., Williams, J.: Emotion recognition using bio-sensors: first steps towards an automatic system. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds.) Affective Dialogue Systems, vol. 3068, pp. 36–48. Springer, Cham (2004). https://doi.org/10.1007/978-3-540-24842-2_4CrossRef

15.

Kim, J., André, E.: Fusion of multichannel biosignals towards automatic emotion recognition. In: Hahn, H., Ko, H., Lee, S. (eds.) Multisensor Fusion and Integration for Intelligent Systems, vol. 35, pp. 55–68. Springer, Cham (2009)CrossRef

16.

Munera, E., Poza-Lujan, J.L., Posadas-Yagüe, J.L., Simó-Ten, J.E., Noguera, J.F.B.: Dynamic reconfiguration of a RGBD sensor based on QoS and QoC requirements in distributed systems. Sensors 15, 18080–18101 (2015). https://doi.org/10.3390/S150818080CrossRef

17.

Castillo, J.C., et al.: Software architecture for smart emotion recognition and regulation of the ageing adult. Cogn. Comput. 8(2), 357–367 (2016). https://doi.org/10.1007/s12559-016-9383-yCrossRef

18.

Fernández-Caballero, A., et al.: Smart environment architecture for emotion detection and regulation. J. Biomed. Inform. 64, 55–73 (2016). https://doi.org/10.1016/J.JBI.2016.09.015CrossRef

19.

Vavrinsky, E., Stopjakova, V., Kopani, M., Kosnacova, H.: The Concept of Advanced Multi-Sensor Monitoring of Human Stress (2021). https://doi.org/10.3390/s21103499

20.

Ekman, P.: Basic emotions. In: Dalgleish, T., Power, M. (eds.) Handbook of Cognition and Emotion, vol. 39, pp. 125–127. Wiley, Sussex (1999)

21.

Schaefer, A., Nils, F., Sanchez, X., Philippot, P.: Assessing the effectiveness of a large database of emotion-eliciting films: a new tool for emotion researchers. Cogn. Emot. 24, 1153–1172 (2010). https://doi.org/10.1080/02699930903274322CrossRef

22.

Fodor, K., Balogh, Z., Francisti, J.: Emotion Recognition Dataset (GitHub Repository). https://github.com/KristianFodor/EmotionRecognition. Accessed 06 June 2022

Title: Visualization of Physiological Response in the Context of Emotion Recognition
Authors: Kristián Fodor
Zoltán Balogh
Jan Francisti
Publisher: Springer International Publishing
Book: Progress in Artificial Intelligence
Print ISBN: 978-3-031-16473-6

Electronic ISBN: 978-3-031-16474-3

Copyright Year: 2022
DOI: https://doi.org/10.1007/978-3-031-16474-3_32

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner