Keith Grochow
Abstract
This paper presents an inverse kinematics system based on a learned model of human poses. Given a set of constraints, our system can produce the most likely pose satisfying those constraints, in real-time. Training the model on different input data leads to different styles of IK. The model is represented as a probability distribution over the space of all possible poses. This means that our IK system can generate any pose, but prefers poses that are most similar to the space of poses in the training data. We represent the probability with a novel model called a Scaled Gaussian Process Latent Variable Model. The parameters of the model are all learned automatically; no manual tuning is required for the learning component of the system. We additionally describe a novel procedure for interpolating between styles.Our style-based IK can replace conventional IK, wherever it is used in computer animation and computer vision. We demonstrate our system in the context of a number of applications: interactive character posing, trajectory keyframing, real-time motion capture with missing markers, and posing from a 2D image.
Supplemental Material
Available for Download
- ARIKAN, O., AND FORSYTH, D. A. 2002. Synthesizing Constrained Motions from Examples. ACM Transactions on Graphics 21, 3 (July), 483--490. (Proc. of ACM SIGGRAPH 2002). Google Scholar
Digital Library
- ARIKAN, O., FORSYTH, D. A., AND O'BRIEN, J. F. 2003. Motion Synthesis From Annotations. ACM Transactions on Graphics 22, 3 (July), 402--408. (Proc. SIGGRAPH 2003). Google ScholarDigital Library
- BISHOP, C. M. 1995. Neural Networks for Pattern Recognition. Oxford University Press. Google ScholarDigital Library
- BODENHEIMER, B., ROSE, C., ROSENTHAL, S., AND PELLA, J. 1997. The process of motion capture -- dealing with the data. In Computer Animation and Simulation '97, Springer-Verlag Wien New York, D. Thalmann and M. van de Panne, Eds., Eurographics, 3--18.Google ScholarCross Ref
- BRAND, M., AND HERTZMANN, A. 2000. Style machines. Proceedings of SIGGRAPH 2000 (July), 183--192. Google ScholarDigital Library
- BRAND, M. 1999. Shadow Puppetry. In Proc. ICCV, vol. 2, 1237--1244. Google ScholarDigital Library
- BRUDERLIN, A., AND WILLIAMS, L. 1995. Motion signal processing. Proceedings of SIGGRAPH 95 (Aug.), 97--104. Google ScholarDigital Library
- ELKOURA, G., AND SINGH, K. 2003. Handrix: Animating the Human Hand. Proc. SCA, 110--119. Google ScholarDigital Library
- GIRARD, M., AND MACIEJEWSKI, A. A. 1985. Computational Modeling for the Computer Animation of Legged Figures. In Computer Graphics (Proc. of SIGGRAPH 85), vol. 19, 263--270. Google ScholarDigital Library
- GRASSIA, F. S. 2000. Believable Automatically Synthesized Motion by Knowledge-Enhanced Motion Transformation. PhD thesis, CMU Computer Science. Google ScholarDigital Library
- GRAUMAN, K., SHAKHNAROVICH, G., AND DARRELL, T. 2003. Inferring 3D Structure with a Statistical Image-Based Shape Model. In Proc. ICCV, 641--648. Google ScholarDigital Library
- GULLAPALLI, V., GELFAND, J. J., AND LANE, S. H. 1996. Synergy-based learning of hybrid position/force control for redundant manipulators. In Proceedings of IEEE Robotics and Automation Conference, 3526--3531.Google ScholarCross Ref
- HOWE, N. R., LEVENTON, M. E., AND FREEMAN, W. T. 2000. Bayesian Reconstructions of 3D Human Motion from Single-Camera Video. In Proc. NIPS 12, 820--826.Google Scholar
- KOVAR, L., AND GLEICHER, M. 2004. Automated Extraction and Parameterization of Motions in Large Data Sets. ACM Transactions on Graphics 23, 3 (Aug.). In these proceedings. Google ScholarDigital Library
- KOVAR, L., GLEICHER, M., AND PIGHIN, F. 2002. Motion Graphs. ACM Transactions on Graphics 21, 3 (July), 473--482. (Proc. SIGGRAPH 2002). Google ScholarDigital Library
- LAWRENCE, N., SEEGER, M., AND HERBRICH, R. 2003. Fast Sparse Gaussian Process Methods: The Informative Vector Machine. Proc. NIPS 15, 609--616.Google Scholar
- LAWRENCE, N. D. 2004. Gaussian Process Latent Variable Models for Visualisation of High Dimensional Data. Proc. NIPS 16.Google Scholar
- LEE, J., CHAI, J., REITSMA, P. S. A., HODGINS, J. K., AND POLLARD, N. S. 2002. Interactive Control of Avatars Animated With Human Motion Data. ACM Transactions on Graphics 21, 3 (July), 491--500. (Proc. SIGGRAPH 2002). Google ScholarDigital Library
- LI, Y., WANG, T., AND SHUM, H.-Y. 2002. Motion Texture: A Two-Level Statistical Model for Character Motion Synthesis. ACM Transactions on Graphics 21, 3 (July), 465--472. (Proc. SIGGRAPH 2002). Google ScholarDigital Library
- MACKAY, D. J. C. 1998. Introduction to Gaussian processes. In Neural Networks and Machine Learning, C. M. Bishop, Ed., NATO ASI Series. Kluwer Academic Press, 133--166.Google Scholar
- NEAL, R. M. 1996. Bayesian Learning for Neural Networks. Lecture Notes in Statistics No. 118. Springer-Verlag. Google ScholarDigital Library
- NOCEDAL, J., AND WRIGHT, S. J. 1999. Numerical Optimization. Springer-Verlag.Google Scholar
- O'HAGAN, A. 1978. Curve Fitting and Optimal Design for Prediction. J. of the Royal Statistical Society, ser. B 40, 1--42.Google Scholar
- POPOVIĆ, Z., AND WITKIN, A. P. 1999. Physically Based Motion Transformation. Proceedings of SIGGRAPH 99 (Aug.), 11--20. Google ScholarDigital Library
- PULLEN, K., AND BREGLER, C. 2002. Motion Capture Assisted Animation: Texturing and Synthesis. ACM Transactions on Graphics 21, 3 (July), 501--508. (Proc. of ACM SIGGRAPH 2002). Google ScholarDigital Library
- RAMANAN, D., AND FORSYTH, D. A. 2004. Automatic annotation of everyday movements. In Proc. NIPS 16.Google Scholar
- REDNER, R. A., AND WALKER, H. F. 1984. Mixture Densities, Maximum Likelihood and the EM Algorithm. SIAM Review 26, 2 (Apr.), 195--202.Google ScholarDigital Library
- ROSALES, R., AND SCLAROFF, S. 2002. Learning Body Pose Via Specialized Maps. In Proc. NIPS 14, 1263--1270.Google Scholar
- ROSE, C., COHEN, M. F., AND BODENHEIMER, B. 1998. Verbs and Adverbs: Multidimensional Motion Interpolation. IEEE Computer Graphics & Applications 18, 5, 32--40. Google ScholarDigital Library
- ROSE III, C. F., SLOAN, P.-P. J., AND COHEN, M. F. 2001. Artist-Directed Inverse-Kinematics Using Radial Basis Function Interpolation. Computer Graphics Forum 20, 3, 239--250.Google ScholarCross Ref
- SIDENBLADH, H., BLACK, M. J., AND SIGAL, L. 2002. Implicit probabilistic models of human motion for synthesis and tracking. In Proc. ECCV, LNCS 2353, vol. 1, 784--800. Google ScholarDigital Library
- SNELSON, E., RASMUSSEN, C. E., AND GHAHRAMANI, Z. 2004. Warped Gaussian Processes. Proc. NIPS 16.Google Scholar
- TAYLOR, C. J. 2000. Reconstruction of Articulated Objects from Point Correspondences in a Single Image. In Proc. CVPR, 677--684.Google ScholarCross Ref
- WELMAN, C. 1993. Inverse Kinematics and Geometric Constraints for Articulated Figure Manipulation. PhD thesis, Simon Fraser University.Google Scholar
- WILEY, D. J., AND HAHN, J. K. 1997. Interpolation Synthesis of Articulated Figure Motion. IEEE Computer Graphics & Applications 17, 6 (Nov.), 39--45. Google ScholarDigital Library
- WILLIAMS, C. K. I., AND RASMUSSEN, C. E. 1996. Gaussian Processes for Regression. Proc. NIPS 8, 514--520.Google Scholar
- WILSON, A. D., AND BOBICK, A. F. 1999. Parametric Hidden Markov Models for Gesture Recognition. IEEE Trans. PAMI 21, 9 (Sept.), 884--900. Google ScholarDigital Library
- WITKIN, A., AND POPOVIĆ, Z. 1995. Motion Warping. Proceedings of SIGGRAPH 95 (Aug.), 105--108. Google ScholarDigital Library
- YAMANE, K., AND NAKAMURA, Y. 2003. Natural motion animation through constraining and deconstraining at will. IEEE Transactions on Visualization and Computer Graphics 9, 3 (July), 352--360. Google ScholarDigital Library
- ZHAO, L., AND BADLER, N. 1998. Gesticulation Behaviors for Virtual Humans. In Pacific Graphics '98, 161--168. Google ScholarDigital Library
Index Terms
- Style-based inverse kinematics
Recommendations
Style-based inverse kinematics
SIGGRAPH '04: ACM SIGGRAPH 2004 PapersThis paper presents an inverse kinematics system based on a learned model of human poses. Given a set of constraints, our system can produce the most likely pose satisfying those constraints, in real-time. Training the model on different input data ...
Real-time motion retargeting to highly varied user-created morphologies
Character animation in video games---whether manually keyframed or motion captured---has traditionally relied on codifying skeletons early in a game's development, and creating animations rigidly tied to these fixed skeleton morphologies. This paper ...
Learning physics-based motion style with nonlinear inverse optimization
SIGGRAPH '05: ACM SIGGRAPH 2005 PapersThis paper presents a novel physics-based representation of realistic character motion. The dynamical model incorporates several factors of locomotion derived from the biomechanical literature, including relative preferences for using some muscles more ...
Comments