Perttu Hämäläinen
Abstract
We present a Model-Predictive Control (MPC) system for online synthesis of interactive and physically valid character motion. Our system enables a complex (36-DOF) 3D human character model to balance in a given pose, dodge projectiles, and improvise a get up strategy if forced to lose balance, all in a dynamic and unpredictable environment. Such contact-rich, predictive and reactive motions have previously only been generated offline or using a handcrafted state machine or a dataset of reference motions, which our system does not require.
For each animation frame, our system generates trajectories of character control parameters for the near future --- a few seconds --- using Sequential Monte Carlo sampling. Our main technical contribution is a multimodal, tree-based sampler that simultaneously explores multiple different near-term control strategies represented as parameter splines. The strategies represented by each sample are evaluated in parallel using a causal physics engine. The best strategy, as determined by an objective function measuring goal achievement, fluidity of motion, etc., is used as the control signal for the current frame, but maintaining multiple hypotheses is crucial for adapting to dynamically changing environments.
Supplemental Material
Available for Download
Supplemental material.
- Al Borno, M., de Lasa, M., and Hertzmann, A. 2013. Trajectory optimization for full-body movements with complex contacts. IEEE Transactions on Visualization and Computer Graphics 19, 8, 1405--1414. Google Scholar
Digital Library
- Arulampalam, M., Maskell, S., Gordon, N., and Clapp, T. 2002. A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking. IEEE Transactions on Signal Processing 50, 2, 174--188. Google ScholarDigital Library
- Cohen, M. F. 1992. Interactive spacetime control for animation. In Proc. SIGGRAPH '92, ACM, New York, NY, USA, 293--302. Google ScholarDigital Library
- Da Silva, M., Abe, Y., and Popović, J. 2008. Simulation of human motion data using short-horizon model-predictive control. Computer Graphics Forum 27, 2, 371--380.Google ScholarCross Ref
- da Silva, M., Durand, F., and Popović, J. 2009. Linear bellman combination for control of character animation. In Proc. SIGGRAPH 2009, ACM, New York, NY, USA, 82:1--82:10. Google ScholarDigital Library
- de Villiers, J. P., Godsill, S. J., and Singh, S. S. 2011. Particle predictive control. Journal of Statistical Planning and Inference 141, 5 (May), 1753--1763.Google ScholarCross Ref
- Deutscher, J., Blake, A., and Reid, I. 2000. Articulated body motion capture by annealed particle filtering. In IEEE Conference on Computer Vision and Pattern Recognition, 2000. Proceedings, vol. 2, 126--133 vol. 2.Google Scholar
- Doucet, A., and Johansen, A. M. 2009. A tutorial on particle filtering and smoothing: Fifteen years later. Handbook of Nonlinear Filtering 12, 656--704.Google Scholar
- Erez, T., Lowrey, K., Tassa, Y., Kumar, V., Kolev, S., and Todorov, E. 2013. An integrated system for real-time model-predictive control of humanoid robots. In Proc. IEEE/RAS International Conference on Humanoid Robots (HUMANOIDS), HUMANOIDS.Google Scholar
- Fang, A. C., and Pollard, N. S. 2003. Efficient synthesis of physically valid human motion. ACM Trans. Graph. 22, 3, 417--426. Google ScholarDigital Library
- Geijtenbeek, T., Pronost, N., Egges, A., and Overmars, M. H. 2011. Interactive character animation using simulated physics. Eurographics-State of the Art Reports 2.Google Scholar
- Geijtenbeek, T., van de Panne, M., and van der Stappen, A. F. 2013. Flexible muscle-based locomotion for bipedal creatures. ACM Trans. Graph. 32, 6 (Nov.), 206:1--206:11. Google ScholarDigital Library
- Heck, R., and Gleicher, M. 2007. Parametric motion graphs. In Proceedings of the 2007 symposium on Interactive 3D graphics and games, ACM, New York, NY, USA, I3D '07, 129--136. Google ScholarDigital Library
- Hämäläinen, P., Aila, T., Takala, T., and Alander, J. 2006. Mutated kd-tree importance sampling. In Proc. SCAI 2006, 39--45.Google Scholar
- Ihler, A. T., Sudderth, E. B., Freeman, W. T., and Willsky, A. S. 2003. Efficient multiscale sampling from products of gaussian mixtures. Advances in Neural Information Processing Systems 16, 1--8.Google Scholar
- Jain, S., Ye, Y., and Liu, C. K. 2009. Optimization-based interactive motion synthesis. ACM Trans. Graph. 28, 1 (Feb.), 10:1--10:12. Google ScholarDigital Library
- Kajiya, J. T. 1986. The rendering equation. In Proc. SIGGRAPH '86, ACM, New York, NY, USA, 143--150. Google ScholarDigital Library
- Kantas, N., Maciejowski, J. M., and Lecchini-Visintini, A. 2009. Sequential monte carlo for model predictive control. In Nonlinear Model Predictive Control, L. Magni, D. M. Raimondo, and F. Allgöwer, Eds., no. 384 in Lecture Notes in Control and Information Sciences. Springer Berlin Heidelberg, Jan., 263--273.Google Scholar
- Lasseter, J. 1987. Principles of traditional animation applied to 3D computer animation. In Proc. SIGGRAPH '87, ACM, New York, NY, USA, 35--44. Google ScholarDigital Library
- Liu, L., Yin, K., van de Panne, M., Shao, T., and Xu, W. 2010. Sampling-based contact-rich motion control. ACM Trans. Graph. 29, 4, 128:1--128:10. Google ScholarDigital Library
- Mordatch, I., Todorov, E., and Popović, Z. 2012. Discovery of complex behaviors through contact-invariant optimization. ACM Trans. Graph. 31, 4 (July), 43:1--43:8. Google ScholarDigital Library
- Muico, U., Lee, Y., Popović, J., and Popović, Z. 2009. Contact-aware nonlinear control of dynamic characters. ACM Trans. Graph. 28, 3, 81:1--81:9. Google ScholarDigital Library
- Muja, M., and Lowe, D. G. 2009. Fast approximate nearest neighbors with automatic algorithm configuration. In Proc. VISAPP (1), 331--340.Google Scholar
- Ngo, J. T., and Marks, J. 1993. Spacetime constraints revisited. In Proc. SIGGRAPH '93, ACM, New York, NY, USA, 343--350. Google ScholarDigital Library
- Pejsa, T., and Pandzic, I. 2010. State of the art in example-based motion synthesis for virtual characters in interactive applications. Computer Graphics Forum 29, 1, 202--226.Google ScholarCross Ref
- Reil, T., and Husbands, P. 2002. Evolution of central pattern generators for bipedal walking in a real-time physics environment. IEEE Transactions on Evolutionary Computation 6, 2, 159--168. Google ScholarDigital Library
- Rudoy, D., and Wolfe, P. 2006. Monte carlo methods for multimodal distributions. In Proc. Fortieth Asilomar Conference on Signals, Systems and Computers, 2006. ACSSC '06, 2019--2023.Google Scholar
- Safonova, A., Hodgins, J. K., and Pollard, N. S. 2004. Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces. ACM Trans. Graph. 23, 3, 514--521. Google ScholarDigital Library
- Schmidt, J., Fritsch, J., and Kwolek, B. 2006. Kernel particle filter for real-time 3D body tracking in monocular color images. In Proc. 7th International Conference on Automatic Face and Gesture Recognition, 2006. FGR 2006, 567--572. Google ScholarDigital Library
- Sims, K. 1994. Evolving virtual creatures. In Proc. SIGGRAPH '94, ACM, New York, NY, USA, 15--22. Google ScholarDigital Library
- Stahl, D., and Hauth, J. 2011. PF-MPC: particle filter-model predictive control. Syst Control Lett 60, 8, 632--643.Google ScholarCross Ref
- Tassa, Y., Erez, T., and Todorov, E. 2012. Synthesis and stabilization of complex behaviors through online trajectory optimization. In Proc. 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, IROS'12, 4906--4913.Google Scholar
- Thrun, S., Fox, D., and Burgard, W. 2000. Monte carlo localization with mixture proposal distribution. In Proc. AAAI/IAAI, 859--865. Google ScholarDigital Library
- Van Welbergen, H., Van Basten, B. J. H., Egges, A., Ruttkay, Z. M., and Overmars, M. H. 2010. Real time animation of virtual humans: A trade-off between naturalness and control. Computer Graphics Forum 29, 8, 2530--2554.Google ScholarCross Ref
- Wampler, K., and Popović, Z. 2009. Optimal gait and form for animal locomotion. In ACM Trans. Graph., vol. 28, 60. Google ScholarDigital Library
- Witkin, A., and Kass, M. 1988. Spacetime constraints. In Proc. SIGGRAPH '88, ACM, New York, NY, USA, 159--168. Google ScholarDigital Library
Index Terms
- Online motion synthesis using sequential Monte Carlo
Recommendations
Motion capture assisted animation: texturing and synthesis
SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniquesWe discuss a method for creating animations that allows the animator to sketch an animation by setting a small number of keyframes on a fraction of the possible degrees of freedom. Motion capture data is then used to enhance the animation. Detail is ...
Motion synthesis from annotations
This paper describes a framework that allows a user to synthesize human motion while retaining control of its qualitative properties. The user paints a timeline with annotations --- like walk, run or jump --- from a vocabulary which is freely chosen by ...
Motion capture assisted animation: texturing and synthesis
We discuss a method for creating animations that allows the animator to sketch an animation by setting a small number of keyframes on a fraction of the possible degrees of freedom. Motion capture data is then used to enhance the animation. Detail is ...
Comments