Arno Schödl
Irfan A. Essa
ABSTRACT
We introduce a new optimization algorithm for video sprites to animate realistic-looking characters. Video sprites are animations created by rearranging recorded video frames of a moving object. Our new technique to find good frame arrangements is based on repeated partial replacements of the sequence. It allows the user to specify animations using a flexible cost function. We also show a fast technique to compute video sprite transitions and a simple algorithm to correct for perspective effects of the input footage. We use our techniques to create character animations of animals, which are difficult both to train in the real world and to animate as 3D models.
- ARIKAN, O., AND FORSYTH, D. A. 2002. Interactive motion generation from examples. In Proceedings of SIGGRAPH 2002, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series. Google Scholar
Digital Library
- BARJOSEPH, Z. 1999. Statistical learning of multi-dimensional textures. Master's thesis, The Hebrew University of Jerusalem.Google Scholar
- BONET, J. S. D. 1997. Multiresolution sampling procedure for analysis and synthesis of texture images. Proceedings of SIGGRAPH 97 (August), 361-368. ISBN 0-89791-896-7. Held in Los Angeles, California. Google ScholarDigital Library
- BRADKSI, G., AND PISAREVSKY, V. 2000. Intel's computer vision library: Applications in calibration, stereo, segmentation, tracking, gesture, face, and object recognition. In In Proceedings of IEEE Computer Vision and Pattern Recognition Conference 2000, vol. II, II:796-797. Demonstration Paper.Google Scholar
- BREGLER, C., AND MALIK, J. 1998. Tracking people with twists and exponential maps. In Proceedings of Computer Vision and Pattern Recognition 1998, 8-15. Google ScholarDigital Library
- BREGLER, C., COVELL, M., AND SLANEY, M. 1997. Video rewrite: Driving visual speech with audio. Proceedings of SIGGRAPH 97 (August), 353-360. ISBN 0-89791-896-7. Held in Los Angeles, California. Google ScholarDigital Library
- BUEHLER, C., BOSSE, M., MCMILLAN, L., GORTLER, S. J., AND COHEN, M. F. 2001. Unstructured lumigraph rendering. In Proceedings of SIGGRAPH 2001, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, 425-432. ISBN 1-58113-292-1. Google ScholarDigital Library
- CHEN, S. E. 1995. Quicktime VR-an image-based approach to virtual environment navigation. Proceedings of SIGGRAPH 95 (August), 29-38. ISBN 0-201-84776-0. Held in Los Angeles, California. Google ScholarDigital Library
- COHEN, M. F. 1992. Interactive spacetime control for animation. Computer Graphics (Proceedings of SIGGRAPH 92) 26, 2 (July), 293-302. ISBN 0-201-51585-7. Held in Chicago, Illinois. Google ScholarDigital Library
- COSATTO, E., AND GRAF, H. P. 1998. Sample-based synthesis of photo-realistic talking heads. Computer Animation '98 (June). Held in Philadelphia, Pennsylvania, USA. Google ScholarDigital Library
- DANA, P. 1992. Issues and techniques for keyframing transformations. In Graphics Gems III. Academic Press, Boston, 121-123. ISBN 0-12-409673-5. Google ScholarDigital Library
- DEBEVEC, P. E., TAYLOR, C. J., AND MALIK, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. Proceedings of SIGGRAPH 96 (August), 11-20. ISBN 0-201-94800-1. Held in New Orleans, Louisiana. Google ScholarDigital Library
- ESSA, I., BASU, S., DARRELL, T., AND PENTLAND, A. 1996. Modeling, tracking and interactive animation of faces and heads using input from video. In Proceedings of Computer Animation Conference 1996, IEEE Computer Society Press, 68-79. Google ScholarDigital Library
- FITZGIBBON, A. W. 2001. Stochastic rigidity: Image registration for nowhere-static scenes. In Proceeding of IEEE International Conference on Computer Vision 2001, I: 662-669.Google ScholarCross Ref
- GLEICHER, M. 1998. Retargeting motion to new characters. Proceedings of SIGGRAPH 98 (July), 33-42. ISBN 0-89791-999-8. Held in Orlando, Florida. Google ScholarDigital Library
- GORTLER, S. J., GRZESZCZUK, R., SZELISKI, R., AND COHEN, M. F. 1996. The lumigraph. Proceedings of SIGGRAPH 96 (August), 43-54. ISBN 0-201-94800-1. Held in New Orleans, Louisiana. Google ScholarDigital Library
- HEEGER, D. J., AND BERGEN, J. R. 1995. Pyramid-based texture analysis/synthesis. Proceedings of SIGGRAPH 95 (August), 229-238. ISBN 0-201-84776-0. Held in Los Angeles, California. Google ScholarDigital Library
- HODGINS, J. K., WOOTEN, W. L., BROGAN, D. C., AND O'BRIEN, J. F. 1995. Animating human athletics. Proceedings of SIGGRAPH 95 (August), 71-78. ISBN 0-201-84776-0. Held in Los Angeles, California. Google ScholarDigital Library
- HODGINS, J. K. 1998. Animating human motion. Scientific American 278, 3 (Mar.), 64-69 (Intl. ed. 46-51).Google ScholarCross Ref
- KAELBLING, L. P., LITTMAN, M. L., AND MOORE, A. P. 1996. Reinforcement learning: A survey. Journal of Artificial Intelligence Research 4, 237-285. Google ScholarDigital Library
- KOVAR, L., GLEICHER, M., AND PIGHIN, F. 2002. Motion graphs. In Proceedings of SIGGRAPH 2002, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series. Google ScholarDigital Library
- LASSETER, J. 1987. Principles of traditional animation applied to 3d computer animation. Computer Graphics (Proceedings of SIGGRAPH 87) 21, 4 (July), 35-44. Held in Anaheim, California. Google ScholarDigital Library
- LASZLO, J. F., VAN DE PANNE, M., AND FIUME, E. 1996. Limit cycle control and its application to the animation of balancing and walking. Proceedings of SIGGRAPH 96 (August), 155-162. ISBN 0-201-94800-1. Held in New Orleans, Louisiana. Google ScholarDigital Library
- LEE, J., CHAI, J., REITSMA, P. S. A., HODGINS, J., AND POLLARD, N. 2002. Interactive control of avatars animated with human motion data. In Proceedings of SIGGRAPH 2002, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series. Google ScholarDigital Library
- LEVOY, M., AND HANRAHAN, P. 1996. Light field rendering. Proceedings of SIGGRAPH 96 (August), 31-42. ISBN 0-201-94800-1. Held in New Orleans, Louisiana. Google ScholarDigital Library
- MCMILLAN, L.,AND BISHOP, G. 1995. Plenoptic modeling: An image-based rendering system. Proceedings of SIGGRAPH 95 (August), 39-46. ISBN 0-201-84776-0. Held in Los Angeles, California. Google ScholarDigital Library
- NGO, J. T., AND MARKS, J. 1993. Spacetime constraints revisited. Proceedings of SIGGRAPH 93 (August), 343-350. ISBN 0-201-58889-7. Held in Anaheim, California. Google ScholarDigital Library
- POPOVIC, Z., AND WITKIN, A. 1999. Physically based motion transformation. Proceedings of SIGGRAPH 99 (August), 11-20. ISBN 0-20148-560-5. Held in Los Angeles, California. Google ScholarDigital Library
- ROSE, C., COHEN, M. F., AND BODENHEIMER, B. 1998. Verbs and adverbs: Multidimensional motion interpolation. IEEE Computer Graphics & Applications 18, 5 (September-October), 32-40. ISSN 0272-1716. Google ScholarDigital Library
- SCHÖDL, A., AND ESSA, I. A. 2001. Machine learning for video-based rendering. In Advances in Neural Information Processing Systems, MIT Press, USA, T. K. Leen, T. G. Dietterich, and V. Tresp, Eds., vol. 13, 1002-1008.Google Scholar
- SCHÖDL, A., SZELISKI, R., SALESIN, D. H., AND ESSA, I. A. 2000. Video textures. Proceedings of SIGGRAPH 2000 (July), 489-498. ISBN 1-58113-208-5. Google ScholarDigital Library
- SEITZ, S. M., AND DYER, C. R. 1996. View morphing: Synthesizing 3d metamorphoses using image transforms. Proceedings of SIGGRAPH 96 (August), 21-30. ISBN0-201-94800-1. Held in New Orleans, Louisiana. Google ScholarDigital Library
- SOATTO, S., DORETTO, G., AND WU, Y. N. 2001. Dynamic textures. In Proceeding of IEEE International Conference on Computer Vision, II: 439-446.Google ScholarCross Ref
- SZELISKI, R., AND SHUM, H.-Y. 1997. Creating full view panoramic mosaics and environment maps. Proceedings of SIGGRAPH 97 (August), 251-258. ISBN 0-89791-896-7. Held in Los Angeles, California. Google ScholarDigital Library
- SZUMMER, M., AND PICARD, R. W. 1996. Temporal texture modeling. In Proceeding of IEEE International Conference on Image Processing, vol. 3, 823-826.Google ScholarCross Ref
- TERZOPOULOS, D., AND WATERS, K. 1993. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Transactions on Pattern Analysis and Machine Intelligence 15, 6, 56-579. Google ScholarDigital Library
- WEI, L.-Y., AND LEVOY, M. 2000. Fast texture synthesis using tree-structured vector quantization. Proceedings of SIGGRAPH 2000 (July), 479-488. ISBN 1-58113-208-5. Google ScholarDigital Library
- WILLIAMS, L. 1990. Performance-driven facial animation. Computer Graphics (Proceedings of SIGGRAPH 90) 24, 4 (August), 235-242. ISBN 0-201-50933-4. Held in Dallas, Texas. Google ScholarDigital Library
- WITKIN, A., AND KASS, M. 1988. Spacetime constraints. Computer Graphics (Proceedings of SIGGRAPH 88) 22, 4 (August), 159-168. Held in Atlanta, Georgia. Google ScholarDigital Library
- ZHANG, Z. 1998. A flexibe new technique for camera calibration. Tech. Rep. 98-71, Microsoft Research. www.research.microsoft.com/~zhang/Calib/.Google Scholar
Index Terms
- Controlled animation of video sprites
Recommendations
Layered acting for character animation
We introduce an acting-based animation system for creating and editing character animation at interactive speeds. Our system requires minimal training, typically under an hour, and is well suited for rapidly prototyping and creating expressive motion. A ...
Layered acting for character animation
SIGGRAPH '03: ACM SIGGRAPH 2003 PapersWe introduce an acting-based animation system for creating and editing character animation at interactive speeds. Our system requires minimal training, typically under an hour, and is well suited for rapidly prototyping and creating expressive motion. A ...
Music-driven character animation
Music-driven character animation extracts musical features from a song and uses them to create an animation. This article presents a system that builds a new animation directly from musical attributes, rather than simply synchronizing it to the music ...
Comments