Skip to main content
Erschienen in: International Journal of Social Robotics 4/2014

01.11.2014

Recognizing Emotions Conveyed by Human Gait

verfasst von: Gentiane Venture, Hideki Kadone, Tianxiang Zhang, Julie Grèzes, Alain Berthoz, Halim Hicheur

Erschienen in: International Journal of Social Robotics | Ausgabe 4/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Humans convey emotions through different ways. Gait is one of them. Here we propose to use gait data to highlight features that characterize emotions. Gait analysis study usually focuses on stance phase, frequency, footstep length. Here the study is based on the joint angles obtained from inverse kinematics computation from the 3D motion-capture data using a combination of degrees of freedom (DOF) out of a 34DOF human body model obtained from inverse kinematics of markers 3D position. The candidates are four professional actors, and five emotional states are simulated: Neutral, Joy, Anger, Sadness, and Fear. The paper presents first a psychological approach which results are used to propose numerical approaches. The first study provides psychological results on motion perception and the possibility of emotion recognition from gait by 32 observers. Then, the motion data is studied using a feature vector approach to verify the numerical identifiability of the emotions. Finally each motion is tested against a database of reference motions to identify the conveyed emotion. Using the first and second study results, we utilize a 6DOF model then a 12DOF model. The experimental results show that by using the gait characteristics it is possible to characterize each emotion with good accuracy for intra-subject data-base. For inter-subject database results show that recognition is more prone to error, suggesting strong inter-personal differences in emotional features.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat de Gelder B, Vroomer J (2000) The perception of emotions by ear and eye. Cognit Emot 14(3):289–311CrossRef de Gelder B, Vroomer J (2000) The perception of emotions by ear and eye. Cognit Emot 14(3):289–311CrossRef
2.
Zurück zum Zitat Janssen D, Schollhorn W, Lubienetzki J, Folling K, Kokenge H, Davids K (2008) Recognition of emotions in gait patterns by means of artificial neural nets. J Nonverbal Behav 32:79–92CrossRef Janssen D, Schollhorn W, Lubienetzki J, Folling K, Kokenge H, Davids K (2008) Recognition of emotions in gait patterns by means of artificial neural nets. J Nonverbal Behav 32:79–92CrossRef
3.
Zurück zum Zitat Troje NF (2002) Decomposing biological motion: a framework for analysis and synthesis of human gait patterns. J Vis 2(5):371–387CrossRef Troje NF (2002) Decomposing biological motion: a framework for analysis and synthesis of human gait patterns. J Vis 2(5):371–387CrossRef
4.
Zurück zum Zitat Atkinson A, Dittrich W, Gemmell A, Young A (2004) Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33:717–746CrossRef Atkinson A, Dittrich W, Gemmell A, Young A (2004) Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33:717–746CrossRef
5.
Zurück zum Zitat Janssen D, Schollhorn W, Lubienetzki J, Folling K, Kokenge H, Davids K (2008) Recognition of emotions in gait patterns by means of artificial neural nets. J Nonverbal Behav 32:79–92CrossRef Janssen D, Schollhorn W, Lubienetzki J, Folling K, Kokenge H, Davids K (2008) Recognition of emotions in gait patterns by means of artificial neural nets. J Nonverbal Behav 32:79–92CrossRef
6.
Zurück zum Zitat Loula F, Prasad S, Harber K, Shiffrar M (2005) Recognizing people from their movement. J Exp Psychol 31(1):210–220 Loula F, Prasad S, Harber K, Shiffrar M (2005) Recognizing people from their movement. J Exp Psychol 31(1):210–220
7.
Zurück zum Zitat Jokisch D, Daum I, Troje N (2006) Self recognition versus recognition of others by biological motion: viewpoint-depedent effects. Perception 35:911–920CrossRef Jokisch D, Daum I, Troje N (2006) Self recognition versus recognition of others by biological motion: viewpoint-depedent effects. Perception 35:911–920CrossRef
8.
Zurück zum Zitat Cutting J, Kozlowski L (1977) Recognizing friends by their walk: gait perception withouit familiarity cues. Bull Psychon Soc 9(5):353–356CrossRef Cutting J, Kozlowski L (1977) Recognizing friends by their walk: gait perception withouit familiarity cues. Bull Psychon Soc 9(5):353–356CrossRef
9.
Zurück zum Zitat Jain A, Bolle J, Pankanti S (2002) Biometrics-personal identification in networked society. Springer, New York Jain A, Bolle J, Pankanti S (2002) Biometrics-personal identification in networked society. Springer, New York
10.
Zurück zum Zitat Biometrics and Identity Management, vol. 5372 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, (2008) Biometrics and Identity Management, vol. 5372 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, (2008)
11.
12.
Zurück zum Zitat Kleinsmith A, Bianchi-Berthouze N, Steed A (2011) Automatic recognition of non-acted affective postures. IEEE Trans Syst Man Cybern Part B 41(4):1027–1038CrossRef Kleinsmith A, Bianchi-Berthouze N, Steed A (2011) Automatic recognition of non-acted affective postures. IEEE Trans Syst Man Cybern Part B 41(4):1027–1038CrossRef
13.
Zurück zum Zitat Handri S, Nomura S, Nakamura K (2011) Determination of age and gender based on features of human motion using AdaBoost algorithms. Int J Soc Robot 3(3):233–241CrossRef Handri S, Nomura S, Nakamura K (2011) Determination of age and gender based on features of human motion using AdaBoost algorithms. Int J Soc Robot 3(3):233–241CrossRef
14.
Zurück zum Zitat Murray P, Drought B, Kory R (1964) Walking patterns of normal men. J Bone Joint Surg 46(2):335–360 Murray P, Drought B, Kory R (1964) Walking patterns of normal men. J Bone Joint Surg 46(2):335–360
15.
Zurück zum Zitat Boyd J, Little J (2005) Advanced studies in biometrics. Lecture Notes in Computer Science, Springer, Berlin/Heidelberg Boyd J, Little J (2005) Advanced studies in biometrics. Lecture Notes in Computer Science, Springer, Berlin/Heidelberg
16.
Zurück zum Zitat de Gelder B (2006) Towards the neurobiology of emotional body language. Nat Rev Neurosci 7:242–249CrossRef de Gelder B (2006) Towards the neurobiology of emotional body language. Nat Rev Neurosci 7:242–249CrossRef
17.
Zurück zum Zitat Roether C, Omlor L, Christensen A, Giese M (2009) Critical features for the perception of emotion from gait. J Vis 9(6):1–32CrossRef Roether C, Omlor L, Christensen A, Giese M (2009) Critical features for the perception of emotion from gait. J Vis 9(6):1–32CrossRef
18.
Zurück zum Zitat Beck A, Canamero L, Hiolle A, Damiano L, Cosi P, Tesser F, Sommavilla G (2013) Interpretation of emotional body language displayed by a humanoid robot: a case study with children. Int J Soc Robot 5(3):325–334CrossRef Beck A, Canamero L, Hiolle A, Damiano L, Cosi P, Tesser F, Sommavilla G (2013) Interpretation of emotional body language displayed by a humanoid robot: a case study with children. Int J Soc Robot 5(3):325–334CrossRef
19.
Zurück zum Zitat McColl D, Nejat G (2014) Recognizing emotional body language displayed by a human-like social robot. Int J Soc Robot 6(2):261–280CrossRef McColl D, Nejat G (2014) Recognizing emotional body language displayed by a human-like social robot. Int J Soc Robot 6(2):261–280CrossRef
20.
Zurück zum Zitat Izard CE (2009) Emotion theory and research: highlights, unanswered questions, and emerging issues. Ann Rev Psychol 60:1–25CrossRef Izard CE (2009) Emotion theory and research: highlights, unanswered questions, and emerging issues. Ann Rev Psychol 60:1–25CrossRef
21.
Zurück zum Zitat Venture G, Ayusawa K, Nakamura Y (2009) Real-time identification and visualization of human segment parameters. In: Proceedings of the IEEE international conference on engineering in medicine and biology, pp 3983–3986 Venture G, Ayusawa K, Nakamura Y (2009) Real-time identification and visualization of human segment parameters. In: Proceedings of the IEEE international conference on engineering in medicine and biology, pp 3983–3986
22.
Zurück zum Zitat Wua G, van der Helmb F, Veegerc H, Makhsouse M, Van Royf P, Angling C, Nagelsh J, Kardunai A, McQuadej K, Wangk X, Wernerl F, Buchholz B (2002) Isb recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion.part i: ankle, hip, and spine. J Biomech 35:543–548CrossRef Wua G, van der Helmb F, Veegerc H, Makhsouse M, Van Royf P, Angling C, Nagelsh J, Kardunai A, McQuadej K, Wangk X, Wernerl F, Buchholz B (2002) Isb recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion.part i: ankle, hip, and spine. J Biomech 35:543–548CrossRef
23.
Zurück zum Zitat Wua G, van der Helmb F, Veegerc H, Makhsouse M, Van Royf P, Angling C, Nagelsh J, Kardunai A, McQuadej K, Wangk X, Wernerl F, Buchholz B (2005) Isb recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion.part ii: shoulder, elbow, wrist and hand. J Biomech 38:981–992CrossRef Wua G, van der Helmb F, Veegerc H, Makhsouse M, Van Royf P, Angling C, Nagelsh J, Kardunai A, McQuadej K, Wangk X, Wernerl F, Buchholz B (2005) Isb recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion.part ii: shoulder, elbow, wrist and hand. J Biomech 38:981–992CrossRef
24.
Zurück zum Zitat Kadone H, Nakamura Y (2006) Segmentation, memorization, recognition and abstraction of humanoid motions based on correlations and associative memory. In: IEEE/RAS proceedings of the international conference on humanoid robots, pp 1–6 Kadone H, Nakamura Y (2006) Segmentation, memorization, recognition and abstraction of humanoid motions based on correlations and associative memory. In: IEEE/RAS proceedings of the international conference on humanoid robots, pp 1–6
25.
Zurück zum Zitat Kadone H, Nakamura Y (2008) Symbolic memory of motion patterns by an associative memory dynamics with self-organizing nonmonotonicity. Neural Inf Process 4985(2008):203–213CrossRef Kadone H, Nakamura Y (2008) Symbolic memory of motion patterns by an associative memory dynamics with self-organizing nonmonotonicity. Neural Inf Process 4985(2008):203–213CrossRef
26.
Zurück zum Zitat Hicheur H, Kadone H, Grezes J, Berthoz A (2013) The combined role of motion-related cues and upper body posture for the expression of emotions during human walking. In: Mombaur K, Berns K (eds) Modeling, simulation and optimization of bipedal walking, vol 18. Springer, Berlin Heidelberg, pp 71–85CrossRef Hicheur H, Kadone H, Grezes J, Berthoz A (2013) The combined role of motion-related cues and upper body posture for the expression of emotions during human walking. In: Mombaur K, Berns K (eds) Modeling, simulation and optimization of bipedal walking, vol 18. Springer, Berlin Heidelberg, pp 71–85CrossRef
27.
Zurück zum Zitat Karg M, Jenke R, Seiberl W, Kuuhnlenz K, Schwirtz A, Buss M (2009) ‘A comparison of pca, kpca and lda for feature extraction to recognize affect in gait kinematics. In: Proceedings of the international conference on affective computing and intelligent interaction and workshops, pp 1–6 Karg M, Jenke R, Seiberl W, Kuuhnlenz K, Schwirtz A, Buss M (2009) ‘A comparison of pca, kpca and lda for feature extraction to recognize affect in gait kinematics. In: Proceedings of the international conference on affective computing and intelligent interaction and workshops, pp 1–6
28.
Zurück zum Zitat Roether C, Omlor L, Giese M (2008) Lateral asymmetry of bodily emotion expression. Curr Biol 18(8):R329–R330CrossRef Roether C, Omlor L, Giese M (2008) Lateral asymmetry of bodily emotion expression. Curr Biol 18(8):R329–R330CrossRef
29.
Zurück zum Zitat Venture G (2010) Human characterization and emotion characterization from gait. In: Proceedings of the IEEE international conference engineering in medicine and biology, pp 1292–1295 Venture G (2010) Human characterization and emotion characterization from gait. In: Proceedings of the IEEE international conference engineering in medicine and biology, pp 1292–1295
Metadaten
Titel
Recognizing Emotions Conveyed by Human Gait
verfasst von
Gentiane Venture
Hideki Kadone
Tianxiang Zhang
Julie Grèzes
Alain Berthoz
Halim Hicheur
Publikationsdatum
01.11.2014
Verlag
Springer Netherlands
Erschienen in
International Journal of Social Robotics / Ausgabe 4/2014
Print ISSN: 1875-4791
Elektronische ISSN: 1875-4805
DOI
https://doi.org/10.1007/s12369-014-0243-1

Weitere Artikel der Ausgabe 4/2014

International Journal of Social Robotics 4/2014 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.