Abstract
Example-based shape deformation allows a mesh to be easily manipulated or animated with simple inputs. As the user pulls parts of the shape, the rest of the mesh automatically changes in an intuitive way by drawing from a set of exemplars. This provides a way for virtual shapes or characters to be easily authored and manipulated, or for a set of drawings to be animated with simple inputs. We describe a new approach for example-based inverse kinematic mesh manipulation which generates high quality deformations for a wide range of inputs, and in particular works well even when provided stylized or "cartoony" examples. This approach is fast enough to run in real time, reliably uses the artist's input shapes in an intuitive way even for highly nonphysical deformations, and provides added expressiveness by allowing the input shapes to be utilized in a way which spatially varies smoothly across the resulting deformed mesh. This allows for rich and detailed deformations to be created from a small set of input shapes, and gives an easy way for a set of sketches to be brought alive with simple click-and-drag inputs.
Supplemental Material
Available for Download
Supplemental file.
- Alexa, M., Cohen-Or, D., and Levin, D. 2000. As-rigid-as-possible shape interpolation. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, SIGGRAPH '00, 157--164. Google ScholarDigital Library
- Baran, I., and Popović, J. 2007. Automatic rigging and animation of 3d characters. ACM Trans. Graph. 26, 3 (July). Google ScholarDigital Library
- Bergeron, P., and Lachapelle, P. 1985. Controlling facial expressions and body movements in the computer generated animated short 'Tony de Peltrie'. In SigGraph '85 Tutorial Notes, Advanced Computer Animation Course.Google Scholar
- Botsch, M., and Sorkine, O. 2008. On linear variational surface deformation methods. IEEE Transactions on Visualization and Computer Graphics 14, 1 (Jan.), 213--230. Google ScholarDigital Library
- Boyd, S., and Vandenberghe, L. 2004. Convex Optimization. Cambridge University Press, New York, NY, USA. Google ScholarDigital Library
- Chao, I., Pinkall, U., Sanan, P., and Schröder, P. 2010. A simple geometric model for elastic deformations. ACM Trans. Graph. 29, 4 (July), 38:1--38:6. Google ScholarDigital Library
- Der, K. G., Sumner, R. W., and Popović, J. 2006. Inverse kinematics for reduced deformable models. In ACM SIGGRAPH 2006 Papers, ACM, New York, NY, USA, SIGGRAPH '06, 1174--1179. Google ScholarDigital Library
- Feng, W.-W., Kim, B.-U., and Yu, Y. 2008. Real-time data driven deformation using kernel canonical correlation analysis. ACM Transactions on Graphics (TOG) 27, 3, 91. Google ScholarDigital Library
- Fröhlich, S., and Botsch, M. 2011. Example-driven deformations based on discrete shells. Computer Graphics Forum 30, 8, 2246--2257.Google ScholarCross Ref
- Gao, L., Lai, Y.-K., Huang, Q.-X., and Hu, S.-M. 2013. A data-driven approach to realistic shape morphing. In Computer graphics forum, vol. 32, Wiley Online Library, 449--457.Google Scholar
- Gill, P. E., Murray, W., and Saunders, M. A. 1997. Snopt: An sqp algorithm for large-scale constrained optimization. SIAM JOURNAL ON OPTIMIZATION 12, 979--1006. Google ScholarDigital Library
- Grochow, K., Martin, S. L., Hertzmann, A., and Popović, Z. 2004. Style-based inverse kinematics. ACM Trans. Graph. 23, 3 (Aug.), 522--531. Google ScholarDigital Library
- Hahn, F., Thomaszewski, B., Coros, S., Sumner, R. W., Cole, F., Meyer, M., DeRose, T., and Gross, M. 2014. Subspace clothing simulation using adaptive bases. ACM Trans. Graph. 33, 4 (July), 105:1--105:9. Google ScholarDigital Library
- Huang, H., Zhao, L., Yin, K., Qi, Y., Yu, Y., and Tong, X. 2011. Controllable hand deformation from sparse examples with rich details. In Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, New York, NY, USA, SCA '11, 73--82. Google ScholarDigital Library
- Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-rigid-as-possible shape manipulation. ACM Trans. Graph. 24, 3 (July), 1134--1141. Google ScholarDigital Library
- Jacobson, A., Baran, I., Popović, J., and Sorkine, O. 2011. Bounded biharmonic weights for real-time deformation. ACM Transactions on Graphics (proceedings of ACM SIGGRAPH) 30, 4, 78:1--78:8. Google ScholarDigital Library
- Jacobson, A., Baran, I., Kavan, L., Popović, J., and Sorkine, O. 2012. Fast automatic skinning transformations. ACM Transactions on Graphics (proceedings of ACM SIGGRAPH) 31, 4, 77:1--77:10. Google ScholarDigital Library
- Jacobson, A., Weinkauf, T., and Sorkine, O. 2012. Smooth shape-aware functions with controlled extrema. Computer Graphics Forum (proceedings of EUROGRAPHICS/ACM SIGGRAPH Symposium on Geometry Processing) 31, 5, 1577--1586. Google ScholarDigital Library
- Jones, B., Popovic, J., McCann, J., Li, W., and Bargteil, A. 2013. Dynamic sprites. In Proceedings of Motion on Games, ACM, New York, NY, USA, MIG '13, 17:39--17:46. Google ScholarDigital Library
- Jones, B., Thuerey, N., Shinar, T., and Bargteil, A. W. 2016. Example-based plastic deformation of rigid bodies. ACM Trans. on Graphics 35, 4 (July). Google ScholarDigital Library
- Kilian, M., Mitra, N. J., and Pottmann, H. 2007. Geometric modeling in shape space. ACM Trans. Graph. 26, 3 (July). Google ScholarDigital Library
- Koyama, Y., Takayama, K., Umetani, N., and Igarashi, T. 2012. Real-time example-based elastic deformation. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '12, 19--24. Google ScholarDigital Library
- Levi, Z., and Gotsman, C. 2015. Smooth rotation enhanced as-rigid-as-possible mesh animation. 264--277.Google Scholar
- Lewis, J. P., and Anjyo, K.-i. 2010. Direct manipulation blend-shapes. IEEE Comput. Graph. Appl. 30, 4 (July), 42--50. Google ScholarDigital Library
- Lewis, J. P., Cordner, M., and Fong, N. 2000. Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., 165--172. Google ScholarDigital Library
- Liu, L., Zhang, L., Xu, Y., Gotsman, C., and Gortler, S. J. 2008. A local/global approach to mesh parameterization. In Proceedings of the Symposium on Geometry Processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP '08, 1495--1504. Google ScholarDigital Library
- Martin, S., Thomaszewski, B., Grinspun, E., and Gross, M. 2011. Example-based elastic materials. ACM Trans. Graph. 30, 4 (July), 72:1--72:8. Google ScholarDigital Library
- Milliez, A., Wand, M., Cani, M.-P., and Seidel, H.-P. 2013. Mutable elastic models for sculpting structured shapes. In Computer Graphics Forum, vol. 32, Wiley Online Library, 21--30.Google Scholar
- Nieto, J., and Susn, A. 2013. Cage based deformations: A survey. In Deformation Models, M. Gonzlez Hidalgo, A. Mir Torres, and J. Varona Gmez, Eds., vol. 7 of Lecture Notes in Computational Vision and Biomechanics. Springer Netherlands, 75--99.Google Scholar
- Schumacher, C., Thomaszewski, B., Coros, S., Martin, S., Sumner, R., and Gross, M. 2012. Efficient simulation of example-based materials. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '12, 1--8. Google ScholarDigital Library
- Sederberg, T. W., and Parry, S. R. 1986. Free-form deformation of solid geometric models. SIGGRAPH Comput. Graph. 20, 4 (Aug.), 151--160. Google ScholarDigital Library
- Seo, J., Irving, G., Lewis, J. P., and Noh, J. 2011. Compression and direct manipulation of complex blendshape models. ACM Trans. Graph. 30, 6 (Dec.), 164:1--164:10. Google ScholarDigital Library
- Sheffer, A., and Kraevoy, V. 2004. Pyramid coordinates for morphing and deformation. In Proceedings of the 3D Data Processing, Visualization, and Transmission, 2Nd International Symposium, IEEE Computer Society, Washington, DC, USA, 3DPVT '04, 68--75. Google ScholarDigital Library
- Sloan, P.-P. J., Rose III, C. F., and Cohen, M. F. 2001. Shape by example. In Proceedings of the 2001 symposium on Interactive 3D graphics, ACM, 135--143. Google ScholarDigital Library
- Song, C., Zhang, H., Wang, X., Han, J., and Wang, H. 2014. Fast corotational simulation for example-driven deformation. Computers & Graphics 40, 49--57. Google ScholarDigital Library
- Sorkine, O., and Alexa, M. 2007. As-rigid-as-possible surface modeling. In Proceedings of the Fifth Eurographics Symposium on Geometry Processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP '07, 109--116. Google ScholarDigital Library
- Sumner, R. W., and Popović, J. 2004. Deformation transfer for triangle meshes. ACM Trans. Graph. 23, 3 (Aug.), 399--405. Google ScholarDigital Library
- Sumner, R. W., Zwicker, M., Gotsman, C., and Popović, J. 2005. Mesh-based inverse kinematics. In ACM SIGGRAPH 2005 Papers, ACM, New York, NY, USA, SIGGRAPH '05, 488--495. Google ScholarDigital Library
- Twigg, C. D., and Kačić-Alesić, Z. 2010. Point cloud glue: Constraining simulations using the procrustes transform. In Proceedings of the 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '10, 45--54. Google ScholarDigital Library
- Wang, Y., Jacobson, A., Barbic, J., and Kavan, L. 2015. Linear subspace design for real-time shape deformation. ACM Trans. Graph. 34, 4. Google ScholarDigital Library
- Wareham, R., and Lasenby, J. 2008. Bone glow: An improved method for the assignment of weights for mesh deformation. In AMDO, Springer, F. J. P. Lpez and R. B. Fisher, Eds., vol. 5098 of Lecture Notes in Computer Science, 63--71. Google ScholarDigital Library
- Weber, O., Sorkine, O., Lipman, Y., and Gotsman, C. 2007. Context-aware skeletal shape deformation. In Computer Graphics Forum, vol. 26, Wiley Online Library, 265--274.Google Scholar
- Zhang, L., Snavely, N., Curless, B., and Seitz, S. M. 2004. Spacetime faces: High resolution capture for modeling and animation. ACM Trans. Graph. 23, 3 (Aug.), 548--558. Google ScholarDigital Library
- Zhang, W., Zheng, J., and Thalmann, N. M. 2015. Real-Time Subspace Integration for Example-Based Elastic Material. Computer Graphics Forum. Google ScholarDigital Library
Index Terms
- Fast and reliable example-based mesh IK for stylized deformations
Recommendations
Physically-based deformations: copy and paste
In contrast with purely geometric approaches, physically-based deformation techniques usually afford greater realism in the animation of soft objects and characters, due to the consideration of the inherent physical properties of the materials. In this ...
Fast automatic skinning transformations
Skinning transformations are a popular way to articulate shapes and characters. However, traditional animation interfaces require all of the skinning transformations to be specified explicitly, typically using a control structure (a rig). We propose a ...
Mesh pose-editing using examples
CASA 2007An easy-to-use mesh pose-editing system is presented. We take advantage of both skeleton-based and example-based approaches in order to provide an intuitive way for artists to edit mesh poses. Our system automatically extracts the skeletons of the ...
Comments