Dragomir Anguelov
Daphne Koller
ABSTRACT
We introduce the SCAPE method (Shape Completion and Animation for PEople)---a data-driven method for building a human shape model that spans variation in both subject shape and pose. The method is based on a representation that incorporates both articulated and non-rigid deformations. We learn a pose deformation model that derives the non-rigid surface deformation as a function of the pose of the articulated skeleton. We also learn a separate model of variation based on body shape. Our two models can be combined to produce 3D surface models with realistic muscle deformation for different people in different poses, when neither appear in the training set. We show how the model can be used for shape completion --- generating a complete surface mesh given a limited set of markers specifying the target shape. We present applications of shape completion to partial view completion and motion capture animation. In particular, our method is capable of constructing a high-quality animated surface model of a moving person, with realistic muscle deformation, using just a single static scan and a marker motion capture sequence of the person.
Supplemental Material
- Allen, B., Curless, B., and Popović, Z. 2002. Articulated body deformation from range scan data. ACM Transactions on Graphics, 21(3), 612--619. Google Scholar
Digital Library
- Allen, B., Curless, B., and Popović, Z. 2003. The space of human body shapes: reconstruction and parameterization from range scans. ACM Transactions on Graphics, 22(3), 587--594. Google ScholarDigital Library
- Anguelov, D., Koller, D., Pang, H., Srinivasan, P., and Thrun, S. 2004. Recovering articulated object models from 3D range data. In Proceedings of the 20th conference on Uncertainty in artificial intelligence, 18--26. Google ScholarDigital Library
- Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Pang, H., and Davis, J. 2005. The correlated correspondence algorithm for unsupervised registration of nonrigid surfaces. In Advances in Neural Information Processing Systems 17, 33--40.Google Scholar
- Cheung, K. M., Baker, S., and Kanade, T. 2003. Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture. In Conference on Computer Vision and Pattern Recognition (CVPR), 77--84. Google ScholarDigital Library
- Curless, B., and Levoy, M. 1996. A volumetric method of building complex models from range images. Proceedings of SIGGRAPH 1996, 303--312. Google ScholarDigital Library
- Davis, J., Marschner, S., Garr, M., and Levoy, M. 2002. Filling holes in complex surfaces using volumetric diffusion. In Symposium on 3D Data Processing, Visualization, and Transmission.Google Scholar
- Garland, M., and Heckbert, P. S. 1997. Surface simplification using quadric error metrics. In Proceedings of SIGGRAPH 97, 209-216. Google ScholarDigital Library
- Hähnel, D., Thrun, S., and Burgard, W. 2003. An extension of the ICP algorithm for modeling nonrigid objects with mobile robots. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI). Google ScholarDigital Library
- Hilton, A., Starck, J., and Collins, G. 2002. From 3d shape capture to animated models. In First International Symposion on 3D Data Processing. Visualization and Transmission (3DVPT2002).Google Scholar
- Kähler, K., Haber, J., Yamauchi, H., and Seidel, H.-P. 2002. Head shop: generating animated head models with anatomical structure. In ACM SIGGRAPH Symposium on Computer Animation, 55--64. Google ScholarDigital Library
- Lewis, J. P., Cordner, M., and Fong, N. 2000. Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation. Proceedings of ACM SIGGRAPH 2000, 165--172. Google ScholarDigital Library
- Liepa, P. 2003. Filling holes in meshes. In Proc. of the Eurographics/ACM SIGGRAPH symposium on Geometry processing, 200--205. Google ScholarDigital Library
- Ma, Y., Soatto, S., Kosecka, J., and Sastry, S. 2004. An Invitation to 3D Vision. Springer Verlag.Google Scholar
- Mohr, A., and Gleicher, M. 2003. Building efficient, accurate character skins from examples. ACM Transactions on Graphics, 22(3), 562--568. Google ScholarDigital Library
- Noh, J., and Neumann, U. 2001. Expression cloning. Proceedings of ACM SIGGRAPH 2001, 277--288. Google ScholarDigital Library
- Popović, Z., Grochow, K., Martin, S. L., and Hertzmann, A. 2004. Style-based inverse kinematics. ACM Transactions on Graphics, 23(3), 522--531. Google ScholarDigital Library
- Sand, P., McMillan, L., and Popović, J. 2003. Continuous capture of skin deformation. ACM Transactions on Graphics, 22(3), 578--586. Google ScholarDigital Library
- Seo, H., and Magnenat-Thalmann, N. 2003. An automatic modeling of human bodies from sizing parameters. In ACM Symposium on Interactive 3D Graphics, 19--26. Google ScholarDigital Library
- Sloan, P.-P. J., Rose, C. F., and Cohen, M. F. 2001. Shape by example. In 2001 Symposium on Interactive 3D Graphics, 135--144. Google ScholarDigital Library
- Sumner, R. W., and Popović, J. 2004. Deformation transfer for triangle meshes. Proceedings of ACM SIGGRAPH 2004, 23(3), 399--405. Google ScholarDigital Library
- Szeliski, R., and Lavallee, S. 1996. Matching 3-d anatomical surfaces with non-rigid deformations using using octree-splines. International Journal of Computer Vision 18, 2, 171--186. Google ScholarDigital Library
- Vasilescu, M., and Terzopoulos, D. 2002. Multilinear analysis of image ensembles: Tensorfaces. In European Conference on Computer Vision (ECCV), 447--460. Google ScholarDigital Library
- Vlasic, D., Pfister, H., Brand, M., and Popović, J. 2004. Multilinear models for facial synthesis. In SIGGRAPH Research Sketch. Google ScholarDigital Library
- Wang, X. C., and Phillips, C. 2002. Multi-weight enveloping: least-squares approximation techniques for skin animation. In ACM SIGGRAPH Symposium on Computer Animation, 129--138. Google ScholarDigital Library
Index Terms
- SCAPE: shape completion and animation of people
Recommendations
SCAPE: shape completion and animation of people
We introduce the SCAPE method (Shape Completion and Animation for PEople)---a data-driven method for building a human shape model that spans variation in both subject shape and pose. The method is based on a representation that incorporates both ...
The space of human body shapes: reconstruction and parameterization from range scans
We develop a novel method for fitting high-resolution template meshes to detailed human body range scans with sparse 3D markers. We formulate an optimization problem in which the degrees of freedom are an affine transformation at each template vertex. ...
SCAPE: Shape Completion and Animation of People
Seminal Graphics Papers: Pushing the Boundaries, Volume 2We introduce the SCAPE method (Shape Completion and Animation for PEople)-a data-driven method for building a human shape model that spans variation in both subject shape and pose. The method is based on a representation that incorporates both ...
Comments