Matthew Cong
ABSTRACT
We present a physically based facial retargeting algorithm that is suitable for use in high-end production. Given an actor's facial performance, we first run a targeted muscle simulation on the actor in order to determine the actor blendshape muscles that best match the performance. The deformation of the actor blendshape muscles are then transferred onto the creature to obtain the corresponding creature blendshape muscles. Finally, the resulting creature blendshape muscles are used to drive a creature muscle simulation which yields the retargeted performance. In order to ensure the anatomically correct placement of the muscles, cranium, and jaw, we introduce novel anatomically motivated constraints during the transfer process. Compared to previous approaches, these constraints not only improve the expressiveness of the retargeted creature performance to the actor performance but also eliminate spurious visual artifacts.
- Mario Botsch, Mark Pauly, Markus Gross, and Leif Kobbelt. 2006. Deformation Transfer for Detail-Preserving Surface Editing. Vision, Modeling, and Visualization (2006), 357--364.Google Scholar
- Matthew Cong, Michael Bao, Jane L. E, Kiran S. Bhat, and Ronald Fedkiw. 2015. Fully Automatic Generation of Anatomical Face Simulation Models. In Proc. of the 14th ACM SIGGRAPH / Eurographics Symposium on Computer Animation. 175--183. Google ScholarDigital Library
- Matthew Cong, Kiran S. Bhat, and Ronald Fedkiw. 2016. Art-Directed Muscle Simulation for High-End Facial Animation. In Proc. of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 119--127. Google ScholarDigital Library
- Matthew Cong, Lana Lan, and Ronald Fedkiw. 2017. Muscle Simulation for Facial Animation in Kong: Skull Island. In ACM SIGGRAPH 2017 Talks (SIGGRAPH '17). ACM, New York, NY, USA, Article 21, 2 pages. Google ScholarDigital Library
- Lana Lan, Matthew Cong, and Ronald Fedkiw. 2017. Lessons from the Evolution of an Anatomical Facial Muscle Model. In Proceedings of the ACM SIGGRAPH Digital Production Symposium (DigiPro '17). ACM, New York, NY, USA, Article 11, 3 pages. Google ScholarDigital Library
- R. Sumner and J. Popović. 2004. Deformation Transfer for Triangle Meshes. In ACM Trans. on Graph. (Proc. ACM SIGGRAPH), Vol. 23. 399--405. Google ScholarDigital Library
Index Terms
- Muscle-based facial retargeting with anatomical constraints
Recommendations
Facial retargeting with automatic range of motion alignment
While facial capturing focuses on accurate reconstruction of an actor's performance, facial animation retargeting has the goal to transfer the animation to another character, such that the semantic meaning of the animation remains. Because of the ...
Artist friendly facial animation retargeting
This paper presents a novel facial animation retargeting system that is carefully designed to support the animator's workflow. Observation and analysis of the animators' often preferred process of key-frame animation with blendshape models informed our ...
Artist friendly facial animation retargeting
SA '11: Proceedings of the 2011 SIGGRAPH Asia ConferenceThis paper presents a novel facial animation retargeting system that is carefully designed to support the animator's workflow. Observation and analysis of the animators' often preferred process of key-frame animation with blendshape models informed our ...
Comments