Meeran Byun
ABSTRACT
We propose a control mechanism for facial expressions by applying a few carefully chosen parametric modifications to pre-existing expression data streams. This approach applies to any facial animation resource expressed in the general MPEG-4 form, whether taken from a library of preset facial expressions, captured from live performance, or entirely manually created. The MPEG-4 Facial Animation Parameters (FAPs) represent a facial expression as a set of parameterized muscle actions, given as intensity of individual muscle movements over time. Our system varies expressions by changing the intensities and scope of sets of MPEG-4 FAPs. It creates variations in "expressiveness" across the face model rather than simply scale, interpolate, or blend facial mesh node positions. The parameters are adapted from the Effort parameters of Laban Movement Analysis (LMA); we developed a mapping from their values onto sets of FAPs. The FacEMOTE parameters thus perturb a base expression to create a wide range of expressions. Such an approach could allow real-time face animations to change underlying speech or facial expression shapes dynamically according to current agent affect or user interaction needs.
- BARTENIEFF, I. AND DAVIS, M. A. 1972. Effort-Shape analysis of movement: The unity of expression and function, Research approaches to movement and personality (Body Movement: Perspectives in Research), M. Davis, Ed., Arno Press.Google Scholar
- BARTENIEFF, I. AND LEWIS, D. 1980. Body Movement: Coping with the Environment, Gordon and Breach Science Publishers, Inc.Google Scholar
- BLANZ, V. AND VETTER, T. 2000. A morphable model for the synthesis of 3D faces, In Proceedings of ACM SIGGRAPH 2000, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, ACM, 187-194. Google ScholarDigital Library
- CHI, D., COSTA, M., ZHAO, L., AND BADLER, N. I. 2000. The EMOTE model for Effort and Shape, In Proceedings of ACM SIGGRAPH 2000, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, ACM, 173-182. Google ScholarDigital Library
- DELL, C. 1977. A Primer for Movement Description using Effort-Shape and Supplementary Concepts, Dance Notation Bureau Press.Google Scholar
- EKMAN, P. AND FRIESEN, W. V. 1977. Manual for the Facial Action Coding System, Consulting Psychologists Press.Google Scholar
- ESSA, I. AND PENTLAND, A. 1997. Coding, analysis, interpretation, and recognition of facial expressions, IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):757-763. Google ScholarDigital Library
- FAIGIN, G. 1990. The Artist's Complete Guide to Facial Expression, Watson-Guptill Publications.Google Scholar
- FRIJDA, N. H. AND TCHERKASSOF, A. 1997. Facial action as action readiness, The Psychology of Facial Expression, Russel, J. A. and Fernandez-Dols, J. M. Eds., Cambridge University Press.Google Scholar
- ISBISTER, K. AND NASS, C. 2000. Consistency of personality in interactive characters: Verbal cues, non-verbal cues, and user characteristics, Int. Journal of Human-Computer Studies. Google ScholarDigital Library
- KALRA, P., MANGILI, A., MAGNANAT-THALMANN, N., AND THALMANN, D. 1992. Simulation of facial muscle actions based on rational free form deformations, Eurographics, 59-69.Google Scholar
- KNAPP, M. L. Ed., 1992. Nonverbal Communication in Human Interaction, 3rd Ed., Holt, Rinehart and Winston, Inc.Google Scholar
- LASSETER, J. 1987. Principles of traditional animation applied to 3D computer animation, In Proceedings of ACM SIGGRAPH 1987, ACM Press / ACM SIGGRAPH, New York, Computer Graphics Proceedings, Annual Conference Series, ACM, 35-44. Google ScholarDigital Library
- LEE, S. P., BADLER, J., AND BADLER, N. I. 2002. Eyes alive, To appear, In Proceedings of ACM SIGGRAPH 2002, ACM Press / ACM SIGGRAPH, New York, Computer Graphics Proceedings, Annual Conference Series, ACM. Google ScholarDigital Library
- LEE, W. AND MAGNANAT-THALMANN, N. 2000. Fast head modeling for animation, Eurographics.Google Scholar
- LEE, Y., TERZOPOULOS, D., AND WATERS, K. 1995. Realistic modeling for facial animation, In Proceedings of ACM SIGGRAPH 1995, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, ACM, 55-62. Google ScholarDigital Library
- LIPSINC, http://www.lipsinc.comGoogle Scholar
- MPEG-4 SNHC. 1998. Information technology-generic coding of audio-visual objects part 2: Visual, ISO/IEC 14996-2, Final draft of international standard, ISO/IEC JTCI/SC29/WG11 N2501.Google Scholar
- NOH, J. AND NEUMANN, U. 2001. Expression cloning, In Proceedings of ACM SIGGRAPH 2001, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, ACM, 277-286. Google ScholarDigital Library
- OSTERMANN, J. 1998. Animation of synthetic faces in MPEG-4, Computer Animation, 49-55. Google ScholarDigital Library
- PARKE, F. I. 1974. A parametric model for human faces, PhD Thesis, University of Utah. Google ScholarDigital Library
- PARKE, F. I. AND WATERS, K. 1996. Computer Facial Animation. A. K. Peters Ltd. Google ScholarDigital Library
- PECK, S. R. 1990. Atlas of facial expression: An account of facial expression for artists, actors, and writers, Oxford University Press.Google Scholar
- PERLIN, K. http://www.mrl.nyu.edu/~perlin/facedemo/Google Scholar
- PIGHIN, F., AUSLANDER, J., LISCHINSKI, D., SALESIN, D. H., AND SZELISKI, R. 1998. Synthesizing realistic facial expressions from photographs, In Proceedings of ACM SIGGRAPH 1998, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, ACM, 75-84. Google ScholarDigital Library
- PLATT, S. M., AND BADLER, N. I. 1981. Animating facial expressions, In Proceedings of ACM SIGGRAPH 1981, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, ACM, 245-252. Google ScholarDigital Library
- TERZOPOULOS, D., AND WATERS, K. 1991. Techniques for realistic facial modeling and animation. Computer Animation. Magnanat-Thalmann N., and Thalmann, D. Eds., Springer-Verlag. Ch. 5. 59-73.Google Scholar
- THOMAS, F., AND JOHNSTON, O. 1981. The Illusion of Life, Abbeyville Press.Google Scholar
- WATERS, K. 1987. A muscle model for animating three-dimensional facial expression, In Proceedings of ACM SIGGRAPH 1987, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, ACM, 17-24. Google ScholarDigital Library
- WEHRLE, T., KAISER, S., SCHMIDT, S., AND SCHERER, K. R. 2000. Studying the dynamics of emotional expression using synthesized facial muscle movements, Journal of Personality and Social Psychology, 105-119.Google ScholarCross Ref
- WILLIAMS, P. L., WARWICK, R., DYSON, M., AND BANNISTER, L. H. 1989. Gray's Anatomy, 37th Ed., Churchill Livingstone.Google Scholar
- FacEMOTE: qualitative parametric modifiers for facial animations
Recommendations
Facial animation retargeting and control based on a human appearance space
Expressive facial animations are essential to enhance the realism and the credibility of virtual characters. Parameter-based animation methods offer a precise control over facial configurations while performance-based animation benefits from the ...
Geometry-Driven Photorealistic Facial Expression Synthesis
Expression mapping (also called performance driven animation) has been a popular method for generating facial animations. A shortcoming of this method is that it does not generate expression details such as the wrinkles due to skin deformations. In this ...
Expressive expression mapping with ratio images
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniquesFacial expressions exhibit not only facial feature motions, but also subtle changes in illumination and appearance (e.g., facial creases and wrinkles). These details are important visual cues, but they are difficult to synthesize. Traditional expression ...
Comments