Skip to main content

2011 | OriginalPaper | Buchkapitel

12. Feasibility of Using a Head-Mounted Camera to Capture Dynamic Facial Expressions During Body Movement

verfasst von : Elizabeth A. Crane, M. Melissa Gross, Barbara L. Fredrickson

Erschienen in: Whole Body Interaction

Verlag: Springer London

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this study, we tested the feasibility of capturing video of facial ­expressions while concurrently capturing motion capture and video of bodily expressions. To collect facial expression data, we used a custom designed head-mount for a video camera that provided images for facial expression microanalysis but did not limit freedom of movement. We assessed the effect of the head-mount on emotion elicitation, emotion recognition, qualitative aspects of body movement, and quantitative aspects of body movement. The results indicate that while the head-mount may slightly constrain arm movement, wearing the head-mounted camera during motion capture is a valid method for collecting facial and bodily data.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ambadar, Z., Schooler, J.W., Cohn, J.F.: Deciphering the enigmatic face. The importance of facial dynamics in interpreting subtle facial expressions. Psychol. Sci. 16, 403–410 (2005)CrossRef Ambadar, Z., Schooler, J.W., Cohn, J.F.: Deciphering the enigmatic face. The importance of facial dynamics in interpreting subtle facial expressions. Psychol. Sci. 16, 403–410 (2005)CrossRef
2.
Zurück zum Zitat Atkinson, A.P., Dittrich, W.H., Gemmell, A.J., Young, A.W.: Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33, 717–746 (2004)CrossRef Atkinson, A.P., Dittrich, W.H., Gemmell, A.J., Young, A.W.: Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33, 717–746 (2004)CrossRef
3.
Zurück zum Zitat Bachorowski, J.-A.: Vocal expression and perception of emotion. Curr. Dir. Psychol. Sci. 8, 53–57 (1999)CrossRef Bachorowski, J.-A.: Vocal expression and perception of emotion. Curr. Dir. Psychol. Sci. 8, 53–57 (1999)CrossRef
4.
Zurück zum Zitat Banse, R., Scherer, K.R.: Acoustic profiles in vocal emotion expression. J. Pers. Soc. Psychol. 70, 614–636 (1996)CrossRef Banse, R., Scherer, K.R.: Acoustic profiles in vocal emotion expression. J. Pers. Soc. Psychol. 70, 614–636 (1996)CrossRef
5.
Zurück zum Zitat Castellano, G. Kessous, L., Caridakis, G.: Emotion recognition through multiple modalities: face, body gesture, speech. In: Peter C., Beale R. (eds.) Affect and Emotion in Human–Computer Interaction, vol. 4868. Springer, Heidelberg (2008) Castellano, G. Kessous, L., Caridakis, G.: Emotion recognition through multiple modalities: face, body gesture, speech. In: Peter C., Beale R. (eds.) Affect and Emotion in Human–Computer Interaction, vol. 4868. Springer, Heidelberg (2008)
6.
Zurück zum Zitat Chi, D.M.: A motion control scheme for animating expressive arm movements. University of Pennsylvania (1999) Chi, D.M.: A motion control scheme for animating expressive arm movements. University of Pennsylvania (1999)
7.
Zurück zum Zitat Chi, D., Costa, M., Zhao, L., Badler, N.: The EMOTE model for effort and shape. In: Proceedings of the 27th annual conference on Computer Graphics and Interactive Techniques, pp. 173–182 (2000) Chi, D., Costa, M., Zhao, L., Badler, N.: The EMOTE model for effort and shape. In: Proceedings of the 27th annual conference on Computer Graphics and Interactive Techniques, pp. 173–182 (2000)
8.
Zurück zum Zitat Cohn, J.F., Kanade, T.: Use of automated facial image analysis for measurement of emotion expression. In: Coan, J.A., Allen, J.J.B. (eds.) Handbook of Emotion Elicitation and Assessment, pp. 222–238. Oxford University Press, Oxford (2007) Cohn, J.F., Kanade, T.: Use of automated facial image analysis for measurement of emotion expression. In: Coan, J.A., Allen, J.J.B. (eds.) Handbook of Emotion Elicitation and Assessment, pp. 222–238. Oxford University Press, Oxford (2007)
9.
Zurück zum Zitat Coulson, M.: Attributing emotion to static body postures: recognition accuracy confusions, and viewpoint dependence. J. Nonverbal Behav. 28, 117–139 (2004)CrossRef Coulson, M.: Attributing emotion to static body postures: recognition accuracy confusions, and viewpoint dependence. J. Nonverbal Behav. 28, 117–139 (2004)CrossRef
10.
Zurück zum Zitat De Silva, P.R.: Therapeutic tool for develop child nonverbal communication skills through interactive game. In: International Conference on Computational Intelligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA’06), pp. 33–33 (2006) De Silva, P.R.: Therapeutic tool for develop child nonverbal communication skills through interactive game. In: International Conference on Computational Intelligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA’06), pp. 33–33 (2006)
11.
Zurück zum Zitat Ekman, P.: Facial expression and emotion. Am. Psychol. 48, 384–392 (1993)CrossRef Ekman, P.: Facial expression and emotion. Am. Psychol. 48, 384–392 (1993)CrossRef
12.
Zurück zum Zitat Ekman, P., Friesen, W.V.: The facial action coding system. Consulting Psychologists Press, Palo Alto (1978) Ekman, P., Friesen, W.V.: The facial action coding system. Consulting Psychologists Press, Palo Alto (1978)
13.
Zurück zum Zitat Ellgring, H., Scherer, K.: Vocal indicators of mood change in depression. J. Nonverbal Behav. 20, 83–110 (1996)CrossRef Ellgring, H., Scherer, K.: Vocal indicators of mood change in depression. J. Nonverbal Behav. 20, 83–110 (1996)CrossRef
14.
Zurück zum Zitat Gray, E.K., Watson, D.: Assessing positive and negative affect via self-report. In: Coan, J.A., Allen, J.J.B. (eds.) Handbook of Emotion Elicitation and Assessment, pp. 171–183. Oxford University Press, Oxford (2007) Gray, E.K., Watson, D.: Assessing positive and negative affect via self-report. In: Coan, J.A., Allen, J.J.B. (eds.) Handbook of Emotion Elicitation and Assessment, pp. 171–183. Oxford University Press, Oxford (2007)
15.
Zurück zum Zitat Janssen, D., Schöllhorn, W., Lubienetzki, J., Fölling, K., Kokenge, H., Davids, K.: Recognition of emotions in gait patterns by means of artificial neural nets. J. Nonverbal Behav. 32, 79–92 (2008)CrossRef Janssen, D., Schöllhorn, W., Lubienetzki, J., Fölling, K., Kokenge, H., Davids, K.: Recognition of emotions in gait patterns by means of artificial neural nets. J. Nonverbal Behav. 32, 79–92 (2008)CrossRef
16.
Zurück zum Zitat Karg, M., Hnlenz, K., Buss, M.: Recognition of affect based on gait patterns, part B: cybernetics. IEEE Trans. Syst. Man Cybern. 40, 1050–1061 (2010)CrossRef Karg, M., Hnlenz, K., Buss, M.: Recognition of affect based on gait patterns, part B: cybernetics. IEEE Trans. Syst. Man Cybern. 40, 1050–1061 (2010)CrossRef
17.
Zurück zum Zitat Labouvie-Vief, G., Lumley, M.A., Jain, E., Heinze, H.: Age and gender differences in cardiac reactivity and subjective emotion responses to emotional autobiographical memories. Emotion 3, 115–126 (2003)CrossRef Labouvie-Vief, G., Lumley, M.A., Jain, E., Heinze, H.: Age and gender differences in cardiac reactivity and subjective emotion responses to emotional autobiographical memories. Emotion 3, 115–126 (2003)CrossRef
18.
Zurück zum Zitat Larsen, R.J., Fredrickson, B.L.: Measurement issues in emotion research. In: Kahneman, D., Diener, E., Schwarz, N. (eds.) Well-Being: The Foundations of Hedonic Psychology. Russell Sage, New York (1999) Larsen, R.J., Fredrickson, B.L.: Measurement issues in emotion research. In: Kahneman, D., Diener, E., Schwarz, N. (eds.) Well-Being: The Foundations of Hedonic Psychology. Russell Sage, New York (1999)
19.
Zurück zum Zitat Levenson, R., Cartensen, L., Friesen, W., Ekman, P.: Emotion, physiology and expression in old age. Psychol. Aging 6, 28–35 (1991)CrossRef Levenson, R., Cartensen, L., Friesen, W., Ekman, P.: Emotion, physiology and expression in old age. Psychol. Aging 6, 28–35 (1991)CrossRef
20.
Zurück zum Zitat Montepare, J., Goldstein, S.B., Clausen, A.: The identification of emotions from gait information. J. Nonverbal Behav. 11, 33–42 (1987)CrossRef Montepare, J., Goldstein, S.B., Clausen, A.: The identification of emotions from gait information. J. Nonverbal Behav. 11, 33–42 (1987)CrossRef
21.
Zurück zum Zitat Pollick, F.E., Paterson, H.M., Bruderlin, A., Sanford, A.J.: Perceiving affect from arm movement. Cognition 82, B51–B61 (2001)CrossRef Pollick, F.E., Paterson, H.M., Bruderlin, A., Sanford, A.J.: Perceiving affect from arm movement. Cognition 82, B51–B61 (2001)CrossRef
22.
Zurück zum Zitat Scherer, K., Ellgring, H.: Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? Emotion 7, 113–130 (2007)CrossRef Scherer, K., Ellgring, H.: Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? Emotion 7, 113–130 (2007)CrossRef
23.
Zurück zum Zitat Scherer, K., Ellgring, H.: Multimodal expression of emotion: affect programs or componential appraisal patterns? Emotion 7, 158–171 (2007)CrossRef Scherer, K., Ellgring, H.: Multimodal expression of emotion: affect programs or componential appraisal patterns? Emotion 7, 158–171 (2007)CrossRef
24.
Zurück zum Zitat Torresani, L., Hackney, P., Bregler, C.: Learning motion style synthesis from perceptual observations. In: Conference Proceedings of Neural Information Processing Systems, Vancouver (2007) Torresani, L., Hackney, P., Bregler, C.: Learning motion style synthesis from perceptual observations. In: Conference Proceedings of Neural Information Processing Systems, Vancouver (2007)
25.
Zurück zum Zitat Vural, E., Cetin, M., Ercil, A., Littlewort, G. Bartlett, M., Movellan, J.: Drowsy driver detection through facial movement analysis. In: ICCV Workshop on Human Computer Interaction Rio de Janeiro, Brazil (2007) Vural, E., Cetin, M., Ercil, A., Littlewort, G. Bartlett, M., Movellan, J.: Drowsy driver detection through facial movement analysis. In: ICCV Workshop on Human Computer Interaction Rio de Janeiro, Brazil (2007)
26.
Zurück zum Zitat Wallbott, H.G.: Bodily expression of emotion. Eur. J. Soc. Psychol. 28, 879–896 (1998)CrossRef Wallbott, H.G.: Bodily expression of emotion. Eur. J. Soc. Psychol. 28, 879–896 (1998)CrossRef
27.
Zurück zum Zitat Zhan, C., Li, W., Ogunbona, P., Safaei, F.: A real-time facial expression recognition system for online games. Int. J. Comput. Game. Technol. 2008, 7 (2008) Zhan, C., Li, W., Ogunbona, P., Safaei, F.: A real-time facial expression recognition system for online games. Int. J. Comput. Game. Technol. 2008, 7 (2008)
Metadaten
Titel
Feasibility of Using a Head-Mounted Camera to Capture Dynamic Facial Expressions During Body Movement
verfasst von
Elizabeth A. Crane
M. Melissa Gross
Barbara L. Fredrickson
Copyright-Jahr
2011
Verlag
Springer London
DOI
https://doi.org/10.1007/978-0-85729-433-3_12

Neuer Inhalt