Byoungwon Choe
ABSTRACT
We present a performance-driven facial animation system for analyzing captured expressions to find muscle actuation and synthesizing expressions with the actuation values. Significantly different approach of our work is that we let artists sculpt the initial draft of the actuation basis---the basic facial shapes corresponding to the isolated actuation of individual muscles, instead of calculating skin surface deformation entirely relying on the mathematical models such as finite element methods. We synthesize expressions by linear combinations of the basis elements, and analyze expressions by finding the weights for the combinations. Even though the hand-generated actuation basis represents the essence of the subject's characteristic expressions, it is not accurate enough to be used in the subsequent computational procedures. We also describe an iterative algorithm to increase the accuracy of the actuation basis. The experimental results suggest that our artist-in-the-loop method produces more predictable and controllable outcome than pure mathematical models, thus can be a quite useful tool in animation productions.
- B. Choe, H. Lee, and H.-S. Ko. Performance-driven musclebased facial animation. The Journal of Visualization and Computer Animation, 12(2):67--79, May 2001.Google Scholar
Cross Ref
- C. D. Clemente. Anatomy: A Regional Atlas of the Human Body, 2nd edition. Urban and Schwarzenberg, 1981.Google Scholar
- P. Eisert and B. Girod. Analyzing facial expression for virtual conferencing. IEEE Computer Graphics & Applications, 18(5):70--78, September - October 1998. ISSN 0272- 1716. Google ScholarDigital Library
- P. Ekman and W. V. Friesen. Facial Action Coding System. Consulting Psychologists Press, Inc., 1978.Google Scholar
- I. Essa, S. Basu, T. Darrell, and A. Pentland. Modeling, tracking and interactive animation of faces and heads using input from video. In Proceedings of Computer Animation '96 Conference, June 1996. Geneva, Switzerland. Google ScholarDigital Library
- I. A. Essa and A. P. Pentland. Coding, analysis, interpretation and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):757--763, July 1997. Google ScholarDigital Library
- G. Faigin. The Artist's Complete Guide to Facial Expression. Watson-Guptill Publications, 1990.Google Scholar
- M. K. Greenwald, E. W. C. III, and P. J. Lang. Affective judgment and psychophysiological response: dimensional covariation in the evaluation of pictorial stimuli. Journal of Pyschophysiology, 3:51--64, 1989.Google Scholar
- B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin. Making faces. In SIGGRAPH 98 Conference Proceedings, Annual Conference Series, pages 55--66. ACMSIGGRAPH, Addison Wesley, July 1998. Google ScholarDigital Library
- R. M. Koch, M. H. Gross, and A. Bosshard. Emotion editing using finite elements. Computer Graphics Forum, 17(3):295--302, 1998. ISSN 1067-7055.Google ScholarCross Ref
- R. M. Koch, M. H. Gross, F. R. Carls, D. F. von Buren, G. Fankhauser, and Y. Parish. Simulating facial surgery using finite element methods. In SIGGRAPH 96 Conference Proceedings, Annual Conference Series, pages 421-- 428. ACM SIGGRAPH, Addison Wesley, Aug. 1996. Google ScholarDigital Library
- C. Kouadio, P. Poulin, and P. Lachapelle. Real-time facial animation based upon a bank of 3D facial expressions. In Proceedings of Computer Animation '98 Conference. IEEE Computer Society Press, 1998. Google ScholarDigital Library
- Y. Lee, D. Terzopoulos, and K. Waters. Realistic face modeling for animation. In SIGGRAPH 95 Conference Proceedings, Annual Conference Series, pages 55--62. ACM SIGGRAPH, Addison Wesley, Aug. 1995. Google ScholarDigital Library
- J. P. Lewis, M. Cordner, and N. Fong. Pose space deformations: A unified approach to shape interpolation a nd skeleton-driven deformation. Proceedings of SIGGRAPH 2000, pages 165--172, July 2000. ISBN 1-58113-208-5. Google ScholarDigital Library
- D. G. Luenberger. Linear and Nonlinear Programming. Addison-Wesley, 2nd edition, 1984.Google Scholar
- G. M. Nielson. Scattered data modeling. IEEE Computer Graphics and Applications, 13(1):60--70, Jan. 1993. Google ScholarDigital Library
- F. I. Parke and K. Waters. Computer Facial Animation. AK Peters, 1996. ISBN 1-56881-014-8. Google ScholarDigital Library
- F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. H. Salesin. Synthesizing realistic facial expressions from photographs. In SIGGRAPH 98 Conference Proceedings, Annual Conference Series, pages 75--84. ACM SIGGRAPH, Addison Wesley, July 1998. Google ScholarDigital Library
- F. Pighin, R. Szeliski, and D. H. Salesin. Resynthesizing facial animation through 3D model-based tracking. In Seventh International Conference on Computer Vision (ICCV '99) Conference Proceedings, pages 143--150, September 1999. Corfu, Greece.Google ScholarCross Ref
- D. Terzopoulos and K.Waters. Physically-based facial modelling, analysis, and animation. The Journal of Visualization and Computer Animation, 1:73--80, 1990.Google ScholarCross Ref
- D. Terzopoulos and K. Waters. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(6):569--579, June 1993. Google ScholarDigital Library
- K.Waters. A muscle model for animating three-dimensional facial expression. Computer Graphics (Proceedings of SIGGRAPH 87), 21(4):17--24, July 1987. Held in Anaheim, California. Google ScholarDigital Library
- L. Williams. Performance-driven facial animation. Computer Graphics (Proceedings of SIGGRAPH 90), 24(4):235-- 242, August 1990. ISBN 0-201-50933-4. Held in Dallas, Texas. Google ScholarDigital Library
- J. yong Noh and U. Neumann. Expression cloning. Proceedings of SIGGRAPH 2001, pages 277--288, August 2001. ISBN 1-58113-292-1. Google ScholarDigital Library
Index Terms
- Analysis and synthesis of facial expressions with hand-generated muscle actuation basis
Recommendations
Analysis and synthesis of facial expressions with hand-generated muscle actuation basis
SIGGRAPH '05: ACM SIGGRAPH 2005 CoursesWe present a performance-driven facial animation system for analyzing captured expressions to find muscle actuation and synthesizing expressions with the actuation values. Significantly different approach of our work is that we let artists sculpt the ...
Geometry-Driven Photorealistic Facial Expression Synthesis
Expression mapping (also called performance driven animation) has been a popular method for generating facial animations. A shortcoming of this method is that it does not generate expression details such as the wrinkles due to skin deformations. In this ...
Comments