Skip to main content

2019 | OriginalPaper | Buchkapitel

Two-Layer Feature Selection Algorithm for Recognizing Human Emotions from 3D Motion Analysis

verfasst von : Ferdous Ahmed, Marina L. Gavrilova

Erschienen in: Advances in Computer Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Research on automatic recognition of human emotion from motion is gaining momentum, especially in the areas of virtual reality, robotics, behavior modeling, and biometric identity recognition. One of the challenges is to identify emotion-specific features from a vast number of expressive descriptors of human motion. In this paper, we have developed a novel framework for emotion classification using motion features. We combined a filter-based feature selection algorithm and a genetic algorithm to recognize four basic emotions: happiness, sadness, fear, and anger. The validity of the proposed framework was confirmed on a dataset containing 30 subjects performing expressive walking sequences. Our proposed framework achieved a very high recognition rate outperforming existing state-of-the-art methods in the literature.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Adey, P.: Facing airport security: affect, biopolitics, and the preemptive securitisation of the mobile body. Environ. Plann. D: Soc. Space 27(2), 274–295 (2009)CrossRef Adey, P.: Facing airport security: affect, biopolitics, and the preemptive securitisation of the mobile body. Environ. Plann. D: Soc. Space 27(2), 274–295 (2009)CrossRef
2.
Zurück zum Zitat Ahmed, F., Paul, P.P., Gavrilova, M.L.: DTW-based kernel and rank-level fusion for 3D gait recognition using kinect. Vis. Comput. 31(6–8), 915–924 (2015)CrossRef Ahmed, F., Paul, P.P., Gavrilova, M.L.: DTW-based kernel and rank-level fusion for 3D gait recognition using kinect. Vis. Comput. 31(6–8), 915–924 (2015)CrossRef
3.
Zurück zum Zitat Ahmed, F., Sieu, B., Gavrilova, M.L.: Score and rank-level fusion for emotion recognition using genetic algorithm. In: ICCI*CC 2018, pp. 46–53. IEEE (2018) Ahmed, F., Sieu, B., Gavrilova, M.L.: Score and rank-level fusion for emotion recognition using genetic algorithm. In: ICCI*CC 2018, pp. 46–53. IEEE (2018)
4.
Zurück zum Zitat Battiti, R.: Using mutual information for selecting features in supervised neural net learning. IEEE Trans. Neural Netw. 5(4), 537–550 (1994)CrossRef Battiti, R.: Using mutual information for selecting features in supervised neural net learning. IEEE Trans. Neural Netw. 5(4), 537–550 (1994)CrossRef
5.
Zurück zum Zitat Bianchi-Berthouze, N., Kleinsmith, A.: A categorical approach to affective gesture recognition. Connect. Sci. 15(4), 259–269 (2003)CrossRef Bianchi-Berthouze, N., Kleinsmith, A.: A categorical approach to affective gesture recognition. Connect. Sci. 15(4), 259–269 (2003)CrossRef
6.
Zurück zum Zitat Camurri, A., Lagerlöf, I., Volpe, G.: Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques. Int. J. Hum.-Comput. Stud. 59(1–2), 213–225 (2003)CrossRef Camurri, A., Lagerlöf, I., Volpe, G.: Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques. Int. J. Hum.-Comput. Stud. 59(1–2), 213–225 (2003)CrossRef
7.
Zurück zum Zitat De Gelder, B.: Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Biol. Sci. 364(1535), 3475–3484 (2009)CrossRef De Gelder, B.: Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Biol. Sci. 364(1535), 3475–3484 (2009)CrossRef
8.
Zurück zum Zitat Durupinar, F., Kapadia, M., Deutsch, S., Neff, M., Badler, N.I.: Perform: perceptual approach for adding ocean personality to human motion using laban movement analysis. ACM Trans. Graph. (TOG) 36(1), 6 (2017) Durupinar, F., Kapadia, M., Deutsch, S., Neff, M., Badler, N.I.: Perform: perceptual approach for adding ocean personality to human motion using laban movement analysis. ACM Trans. Graph. (TOG) 36(1), 6 (2017)
9.
Zurück zum Zitat Fourati, N., Pelachaud, C.: Toward new expressive movement characterizations. In: Proceedings of Motion in Games (2012) Fourati, N., Pelachaud, C.: Toward new expressive movement characterizations. In: Proceedings of Motion in Games (2012)
10.
Zurück zum Zitat Fragopanagos, N., Taylor, J.G.: Emotion recognition in human-computer interaction. Neural Netw. 18(4), 389–405 (2005)CrossRef Fragopanagos, N., Taylor, J.G.: Emotion recognition in human-computer interaction. Neural Netw. 18(4), 389–405 (2005)CrossRef
11.
12.
Zurück zum Zitat Glowinski, D., Dael, N., Camurri, A., Volpe, G., Mortillaro, M., Scherer, K.: Toward a minimal representation of affective gestures. IEEE Trans. Affect. Comput. 2(2), 106–118 (2011)CrossRef Glowinski, D., Dael, N., Camurri, A., Volpe, G., Mortillaro, M., Scherer, K.: Toward a minimal representation of affective gestures. IEEE Trans. Affect. Comput. 2(2), 106–118 (2011)CrossRef
13.
Zurück zum Zitat Greene, C.S., Penrod, N.M., Kiralis, J., Moore, J.H.: Spatially uniform reliefF (SURF) for computationally-efficient filtering of gene-gene interactions. BioData Min. 2(1), 5 (2009)CrossRef Greene, C.S., Penrod, N.M., Kiralis, J., Moore, J.H.: Spatially uniform reliefF (SURF) for computationally-efficient filtering of gene-gene interactions. BioData Min. 2(1), 5 (2009)CrossRef
14.
Zurück zum Zitat Kapadia, M., et al.: Efficient motion retrieval in large motion databases. In: Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, pp. 19–28. ACM (2013) Kapadia, M., et al.: Efficient motion retrieval in large motion databases. In: Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, pp. 19–28. ACM (2013)
15.
Zurück zum Zitat Kira, K., Rendell, L.A.: The feature selection problem: traditional methods and a new algorithm. In: Aaai, vol. 2, pp. 129–134 (1992) Kira, K., Rendell, L.A.: The feature selection problem: traditional methods and a new algorithm. In: Aaai, vol. 2, pp. 129–134 (1992)
16.
Zurück zum Zitat Kollias, D., et al.: Deep affect prediction in-the-wild: Aff-wild database and challenge, deep architectures, and beyond. arXiv preprint arXiv:1804.10938 (2018) Kollias, D., et al.: Deep affect prediction in-the-wild: Aff-wild database and challenge, deep architectures, and beyond. arXiv preprint arXiv:​1804.​10938 (2018)
17.
Zurück zum Zitat Larboulette, C., Gibet, S.: A review of computable expressive descriptors of human motion. In: Proceedings of the 2nd International Workshop on Movement and Computing, pp. 21–28. ACM (2015) Larboulette, C., Gibet, S.: A review of computable expressive descriptors of human motion. In: Proceedings of the 2nd International Workshop on Movement and Computing, pp. 21–28. ACM (2015)
18.
19.
Zurück zum Zitat Noroozi, F., Corneanu, C.A., Kamińska, D., Sapiński, T., Escalera, S., Anbarjafari, G.: Survey on emotional body gesture recognition. arXiv preprint arXiv:1801.07481 (2018) Noroozi, F., Corneanu, C.A., Kamińska, D., Sapiński, T., Escalera, S., Anbarjafari, G.: Survey on emotional body gesture recognition. arXiv preprint arXiv:​1801.​07481 (2018)
20.
Zurück zum Zitat Pollick, F.E., Paterson, H.M., Bruderlin, A., Sanford, A.J.: Perceiving affect from arm movement. Cognition 82(2), B51–B61 (2001)CrossRef Pollick, F.E., Paterson, H.M., Bruderlin, A., Sanford, A.J.: Perceiving affect from arm movement. Cognition 82(2), B51–B61 (2001)CrossRef
21.
Zurück zum Zitat Robnik-Šikonja, M., Kononenko, I.: Theoretical and empirical analysis of reliefF and RReliefF. Mach. Learn. 53(1–2), 23–69 (2003)CrossRef Robnik-Šikonja, M., Kononenko, I.: Theoretical and empirical analysis of reliefF and RReliefF. Mach. Learn. 53(1–2), 23–69 (2003)CrossRef
22.
Zurück zum Zitat Ross, B.C.: Mutual information between discrete and continuous data sets. PloS One 9(2), e87357 (2014)CrossRef Ross, B.C.: Mutual information between discrete and continuous data sets. PloS One 9(2), e87357 (2014)CrossRef
23.
Zurück zum Zitat Saha, S., Datta, S., Konar, A., Janarthanan, R.: A study on emotion recognition from body gestures using kinect sensor. In: 2014 International Conference on Communication and Signal Processing, pp. 056–060. IEEE (2014) Saha, S., Datta, S., Konar, A., Janarthanan, R.: A study on emotion recognition from body gestures using kinect sensor. In: 2014 International Conference on Communication and Signal Processing, pp. 056–060. IEEE (2014)
24.
Zurück zum Zitat Senecal, S., Cuel, L., Aristidou, A., Magnenat-Thalmann, N.: Continuous body emotion recognition system during theater performances. Comput. Animat. Virtual Worlds 27(3–4), 311–320 (2016)CrossRef Senecal, S., Cuel, L., Aristidou, A., Magnenat-Thalmann, N.: Continuous body emotion recognition system during theater performances. Comput. Animat. Virtual Worlds 27(3–4), 311–320 (2016)CrossRef
25.
Zurück zum Zitat Sultana, M., Paul, P.P., Gavrilova, M.: Social behavioral biometrics: an emerging trend. Int. J. Pattern Recognit. Artif. Intell. 29(08), 1556013 (2015)MathSciNetCrossRef Sultana, M., Paul, P.P., Gavrilova, M.: Social behavioral biometrics: an emerging trend. Int. J. Pattern Recognit. Artif. Intell. 29(08), 1556013 (2015)MathSciNetCrossRef
26.
Zurück zum Zitat Tahir, Y., Dauwels, J., Thalmann, D., Magnenat Thalmann, N.: A user study of a humanoid robot as a social mediator for two-person conversations. Int. J. Soc. Robot. 14(4), 1–14 (2018) Tahir, Y., Dauwels, J., Thalmann, D., Magnenat Thalmann, N.: A user study of a humanoid robot as a social mediator for two-person conversations. Int. J. Soc. Robot. 14(4), 1–14 (2018)
27.
Zurück zum Zitat Tarnowski, P., Kołodziej, M., Majkowski, A., Rak, R.J.: Emotion recognition using facial expressions. Procedia Comput. Sci. 108, 1175–1184 (2017)CrossRef Tarnowski, P., Kołodziej, M., Majkowski, A., Rak, R.J.: Emotion recognition using facial expressions. Procedia Comput. Sci. 108, 1175–1184 (2017)CrossRef
28.
Zurück zum Zitat Wallbott, H.G.: Bodily expression of emotion. Eur. J. Soc. Psychol. 28(6), 879–896 (1998)CrossRef Wallbott, H.G.: Bodily expression of emotion. Eur. J. Soc. Psychol. 28(6), 879–896 (1998)CrossRef
29.
Zurück zum Zitat Wang, H., Khoshgoftaar, T.M., Van Hulse, J.: A comparative study of threshold-based feature selection techniques. In: 2010 IEEE International Conference on Granular Computing (GRC), pp. 499–504. IEEE (2010) Wang, H., Khoshgoftaar, T.M., Van Hulse, J.: A comparative study of threshold-based feature selection techniques. In: 2010 IEEE International Conference on Granular Computing (GRC), pp. 499–504. IEEE (2010)
30.
Zurück zum Zitat Yanushkevich, S.N., Stoica, A., Srihari, S.N., Shmerko, V.P., Gavrilova, M.: Simulation of biometric information: the new generation of biometric systems. In: Proceedings of International Workshop Modeling and Simulation in Biometric Technology, pp. 87–98 (2004) Yanushkevich, S.N., Stoica, A., Srihari, S.N., Shmerko, V.P., Gavrilova, M.: Simulation of biometric information: the new generation of biometric systems. In: Proceedings of International Workshop Modeling and Simulation in Biometric Technology, pp. 87–98 (2004)
Metadaten
Titel
Two-Layer Feature Selection Algorithm for Recognizing Human Emotions from 3D Motion Analysis
verfasst von
Ferdous Ahmed
Marina L. Gavrilova
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-22514-8_5