Skip to main content
Top

2011 | OriginalPaper | Chapter

12. Feasibility of Using a Head-Mounted Camera to Capture Dynamic Facial Expressions During Body Movement

Authors : Elizabeth A. Crane, M. Melissa Gross, Barbara L. Fredrickson

Published in: Whole Body Interaction

Publisher: Springer London

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this study, we tested the feasibility of capturing video of facial ­expressions while concurrently capturing motion capture and video of bodily expressions. To collect facial expression data, we used a custom designed head-mount for a video camera that provided images for facial expression microanalysis but did not limit freedom of movement. We assessed the effect of the head-mount on emotion elicitation, emotion recognition, qualitative aspects of body movement, and quantitative aspects of body movement. The results indicate that while the head-mount may slightly constrain arm movement, wearing the head-mounted camera during motion capture is a valid method for collecting facial and bodily data.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ambadar, Z., Schooler, J.W., Cohn, J.F.: Deciphering the enigmatic face. The importance of facial dynamics in interpreting subtle facial expressions. Psychol. Sci. 16, 403–410 (2005)CrossRef Ambadar, Z., Schooler, J.W., Cohn, J.F.: Deciphering the enigmatic face. The importance of facial dynamics in interpreting subtle facial expressions. Psychol. Sci. 16, 403–410 (2005)CrossRef
2.
go back to reference Atkinson, A.P., Dittrich, W.H., Gemmell, A.J., Young, A.W.: Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33, 717–746 (2004)CrossRef Atkinson, A.P., Dittrich, W.H., Gemmell, A.J., Young, A.W.: Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33, 717–746 (2004)CrossRef
3.
go back to reference Bachorowski, J.-A.: Vocal expression and perception of emotion. Curr. Dir. Psychol. Sci. 8, 53–57 (1999)CrossRef Bachorowski, J.-A.: Vocal expression and perception of emotion. Curr. Dir. Psychol. Sci. 8, 53–57 (1999)CrossRef
4.
go back to reference Banse, R., Scherer, K.R.: Acoustic profiles in vocal emotion expression. J. Pers. Soc. Psychol. 70, 614–636 (1996)CrossRef Banse, R., Scherer, K.R.: Acoustic profiles in vocal emotion expression. J. Pers. Soc. Psychol. 70, 614–636 (1996)CrossRef
5.
go back to reference Castellano, G. Kessous, L., Caridakis, G.: Emotion recognition through multiple modalities: face, body gesture, speech. In: Peter C., Beale R. (eds.) Affect and Emotion in Human–Computer Interaction, vol. 4868. Springer, Heidelberg (2008) Castellano, G. Kessous, L., Caridakis, G.: Emotion recognition through multiple modalities: face, body gesture, speech. In: Peter C., Beale R. (eds.) Affect and Emotion in Human–Computer Interaction, vol. 4868. Springer, Heidelberg (2008)
6.
go back to reference Chi, D.M.: A motion control scheme for animating expressive arm movements. University of Pennsylvania (1999) Chi, D.M.: A motion control scheme for animating expressive arm movements. University of Pennsylvania (1999)
7.
go back to reference Chi, D., Costa, M., Zhao, L., Badler, N.: The EMOTE model for effort and shape. In: Proceedings of the 27th annual conference on Computer Graphics and Interactive Techniques, pp. 173–182 (2000) Chi, D., Costa, M., Zhao, L., Badler, N.: The EMOTE model for effort and shape. In: Proceedings of the 27th annual conference on Computer Graphics and Interactive Techniques, pp. 173–182 (2000)
8.
go back to reference Cohn, J.F., Kanade, T.: Use of automated facial image analysis for measurement of emotion expression. In: Coan, J.A., Allen, J.J.B. (eds.) Handbook of Emotion Elicitation and Assessment, pp. 222–238. Oxford University Press, Oxford (2007) Cohn, J.F., Kanade, T.: Use of automated facial image analysis for measurement of emotion expression. In: Coan, J.A., Allen, J.J.B. (eds.) Handbook of Emotion Elicitation and Assessment, pp. 222–238. Oxford University Press, Oxford (2007)
9.
go back to reference Coulson, M.: Attributing emotion to static body postures: recognition accuracy confusions, and viewpoint dependence. J. Nonverbal Behav. 28, 117–139 (2004)CrossRef Coulson, M.: Attributing emotion to static body postures: recognition accuracy confusions, and viewpoint dependence. J. Nonverbal Behav. 28, 117–139 (2004)CrossRef
10.
go back to reference De Silva, P.R.: Therapeutic tool for develop child nonverbal communication skills through interactive game. In: International Conference on Computational Intelligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA’06), pp. 33–33 (2006) De Silva, P.R.: Therapeutic tool for develop child nonverbal communication skills through interactive game. In: International Conference on Computational Intelligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA’06), pp. 33–33 (2006)
11.
go back to reference Ekman, P.: Facial expression and emotion. Am. Psychol. 48, 384–392 (1993)CrossRef Ekman, P.: Facial expression and emotion. Am. Psychol. 48, 384–392 (1993)CrossRef
12.
go back to reference Ekman, P., Friesen, W.V.: The facial action coding system. Consulting Psychologists Press, Palo Alto (1978) Ekman, P., Friesen, W.V.: The facial action coding system. Consulting Psychologists Press, Palo Alto (1978)
13.
go back to reference Ellgring, H., Scherer, K.: Vocal indicators of mood change in depression. J. Nonverbal Behav. 20, 83–110 (1996)CrossRef Ellgring, H., Scherer, K.: Vocal indicators of mood change in depression. J. Nonverbal Behav. 20, 83–110 (1996)CrossRef
14.
go back to reference Gray, E.K., Watson, D.: Assessing positive and negative affect via self-report. In: Coan, J.A., Allen, J.J.B. (eds.) Handbook of Emotion Elicitation and Assessment, pp. 171–183. Oxford University Press, Oxford (2007) Gray, E.K., Watson, D.: Assessing positive and negative affect via self-report. In: Coan, J.A., Allen, J.J.B. (eds.) Handbook of Emotion Elicitation and Assessment, pp. 171–183. Oxford University Press, Oxford (2007)
15.
go back to reference Janssen, D., Schöllhorn, W., Lubienetzki, J., Fölling, K., Kokenge, H., Davids, K.: Recognition of emotions in gait patterns by means of artificial neural nets. J. Nonverbal Behav. 32, 79–92 (2008)CrossRef Janssen, D., Schöllhorn, W., Lubienetzki, J., Fölling, K., Kokenge, H., Davids, K.: Recognition of emotions in gait patterns by means of artificial neural nets. J. Nonverbal Behav. 32, 79–92 (2008)CrossRef
16.
go back to reference Karg, M., Hnlenz, K., Buss, M.: Recognition of affect based on gait patterns, part B: cybernetics. IEEE Trans. Syst. Man Cybern. 40, 1050–1061 (2010)CrossRef Karg, M., Hnlenz, K., Buss, M.: Recognition of affect based on gait patterns, part B: cybernetics. IEEE Trans. Syst. Man Cybern. 40, 1050–1061 (2010)CrossRef
17.
go back to reference Labouvie-Vief, G., Lumley, M.A., Jain, E., Heinze, H.: Age and gender differences in cardiac reactivity and subjective emotion responses to emotional autobiographical memories. Emotion 3, 115–126 (2003)CrossRef Labouvie-Vief, G., Lumley, M.A., Jain, E., Heinze, H.: Age and gender differences in cardiac reactivity and subjective emotion responses to emotional autobiographical memories. Emotion 3, 115–126 (2003)CrossRef
18.
go back to reference Larsen, R.J., Fredrickson, B.L.: Measurement issues in emotion research. In: Kahneman, D., Diener, E., Schwarz, N. (eds.) Well-Being: The Foundations of Hedonic Psychology. Russell Sage, New York (1999) Larsen, R.J., Fredrickson, B.L.: Measurement issues in emotion research. In: Kahneman, D., Diener, E., Schwarz, N. (eds.) Well-Being: The Foundations of Hedonic Psychology. Russell Sage, New York (1999)
19.
go back to reference Levenson, R., Cartensen, L., Friesen, W., Ekman, P.: Emotion, physiology and expression in old age. Psychol. Aging 6, 28–35 (1991)CrossRef Levenson, R., Cartensen, L., Friesen, W., Ekman, P.: Emotion, physiology and expression in old age. Psychol. Aging 6, 28–35 (1991)CrossRef
20.
go back to reference Montepare, J., Goldstein, S.B., Clausen, A.: The identification of emotions from gait information. J. Nonverbal Behav. 11, 33–42 (1987)CrossRef Montepare, J., Goldstein, S.B., Clausen, A.: The identification of emotions from gait information. J. Nonverbal Behav. 11, 33–42 (1987)CrossRef
21.
go back to reference Pollick, F.E., Paterson, H.M., Bruderlin, A., Sanford, A.J.: Perceiving affect from arm movement. Cognition 82, B51–B61 (2001)CrossRef Pollick, F.E., Paterson, H.M., Bruderlin, A., Sanford, A.J.: Perceiving affect from arm movement. Cognition 82, B51–B61 (2001)CrossRef
22.
go back to reference Scherer, K., Ellgring, H.: Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? Emotion 7, 113–130 (2007)CrossRef Scherer, K., Ellgring, H.: Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? Emotion 7, 113–130 (2007)CrossRef
23.
go back to reference Scherer, K., Ellgring, H.: Multimodal expression of emotion: affect programs or componential appraisal patterns? Emotion 7, 158–171 (2007)CrossRef Scherer, K., Ellgring, H.: Multimodal expression of emotion: affect programs or componential appraisal patterns? Emotion 7, 158–171 (2007)CrossRef
24.
go back to reference Torresani, L., Hackney, P., Bregler, C.: Learning motion style synthesis from perceptual observations. In: Conference Proceedings of Neural Information Processing Systems, Vancouver (2007) Torresani, L., Hackney, P., Bregler, C.: Learning motion style synthesis from perceptual observations. In: Conference Proceedings of Neural Information Processing Systems, Vancouver (2007)
25.
go back to reference Vural, E., Cetin, M., Ercil, A., Littlewort, G. Bartlett, M., Movellan, J.: Drowsy driver detection through facial movement analysis. In: ICCV Workshop on Human Computer Interaction Rio de Janeiro, Brazil (2007) Vural, E., Cetin, M., Ercil, A., Littlewort, G. Bartlett, M., Movellan, J.: Drowsy driver detection through facial movement analysis. In: ICCV Workshop on Human Computer Interaction Rio de Janeiro, Brazil (2007)
26.
go back to reference Wallbott, H.G.: Bodily expression of emotion. Eur. J. Soc. Psychol. 28, 879–896 (1998)CrossRef Wallbott, H.G.: Bodily expression of emotion. Eur. J. Soc. Psychol. 28, 879–896 (1998)CrossRef
27.
go back to reference Zhan, C., Li, W., Ogunbona, P., Safaei, F.: A real-time facial expression recognition system for online games. Int. J. Comput. Game. Technol. 2008, 7 (2008) Zhan, C., Li, W., Ogunbona, P., Safaei, F.: A real-time facial expression recognition system for online games. Int. J. Comput. Game. Technol. 2008, 7 (2008)
Metadata
Title
Feasibility of Using a Head-Mounted Camera to Capture Dynamic Facial Expressions During Body Movement
Authors
Elizabeth A. Crane
M. Melissa Gross
Barbara L. Fredrickson
Copyright Year
2011
Publisher
Springer London
DOI
https://doi.org/10.1007/978-0-85729-433-3_12