Jackie Assa
Abstract
During the last decade, motion capture data has emerged and gained a leading role in animations, games and 3D environments. Many of these applications require the creation of expressive overview video clips capturing the human motion, however sufficient attention has not been given to this problem. In this paper, we present a technique that generates an overview video based on the analysis of motion capture data. Our method is targeted for applications of 3D character based animations, automating, for example, the action summary and gameplay overview in simulations and computer games. We base our method on quantum annealing optimization with an objective function that respects the analysis of the character motion and the camera movement constraints. It automatically generates a smooth camera control path, splitting it to several shots if required. To evaluate our method, we introduce a novel camera placement metric which is evaluated against previous work and conduct a user study comparing our results with the various systems.
Supplemental Material
- Apolloni, B., Carvalho, C., and de Falco, D. 1989. Quantum stochastic optimization. Stochastic Processes and their Applications 33, 2 (Dec), 233--244.Google Scholar
- Arijon, D. 1976. Grammar of the film language. Silman-James Press.Google Scholar
- Assa, J., Caspi, Y., and Cohen-Or, D. 2005. Action synopsis: Pose selection and illustration. In SIGGRAPH 2005 Conference Proceedings, ACM, vol. 24, 667--676. Google Scholar
- Bares, W. H., and Lester, J. C. 1999. Intelligent multi-shot 3d visualization interfaces. Knowl.-Based Syst. 12, 8, 403--412.Google ScholarDigital Library
- Bares, W. H., Thainimit, S., and McDermott, S. 2000. A model for constraint-based camera planning. In Smart Graphics, Papers from the 2000 AAAI Spring Symposium, AAAI Press, vol. 4, 84--91.Google Scholar
- Barr, A. H., Currin, B., Gabriel, S., and Hughes, J. F. 1992. Smooth interpolation of orientations with angular velocity constraints using quaternions. In SIGGRAPH 1992 Conference Proceedings, ACM, vol. 26, 313--320. Google Scholar
- Benhamou, F., Goualard, F., Langueéou, E., and Christie, M. 2004. Interval constraint solving for camera control and motion planning. ACM Transactions on Computational Logic 5, 4, 732--767. Google ScholarDigital Library
- Blanz, V., Tarr, M. J., and Bülthoff, H. H. 1999. What object attributes determine canonical views. Perception 28, 5, 575--600.Google ScholarCross Ref
- Christianson, D. B., Anderson, S. E., wei He, L., Salesin, D. H., Weld, D. S., and Cohen, M. F. 1996. Declarative camera control for automatic cinematography. In AAAI/IAAI, Vol. 1, 148--155. Google ScholarDigital Library
- Christie, M., and Olivier, P. 2006. Camera control in computer graphics. In Eurographics 2006 Star Report, 89--113.Google Scholar
- Christie, M., Machap, R., Normand, J.-M., Olivier, P., and Pickering, J. 2005. Virtual camera planning: A survey. In Smart Graphics, 40--52. Google Scholar
- DeMenthon, D., Kobla, V., and Doermann, D. 1998. Video summarization by curve simplification. In MULTIMEDIA '98: Proceedings of the 6th ACM international conference on Multimedia, ACM, 211--218. Google Scholar
- Drucker, S. M., and Zeltzer, D. 1994. Intelligent camera control in a virtual environment. In Proceedings of Graphics Interface '94, 190--199.Google Scholar
- Gleicher, M., and Witkin, A. 1992. Through-the-lens camera control. In SIGGRAPH 1992 conference proceedings, ACM, New York, NY, USA, 331--340. Google Scholar
- Gómez, F., Hurtado, F., Sellares, J. A., and Toussaint, G. T. 2001. Nice perspective projections. Journal of Visual Communication and Image Representation 12, 4, 387--400.Google ScholarDigital Library
- Gooch, B., Reinhard, E., Moulding, C., and Shirley, P. 2001. Artistic composition for image creation. In Proceedings of the 12th Eurographics Workshop on Rendering Techniques, Springer-Verlag, London, UK, 83--88. Google ScholarDigital Library
- Halper, N., and Olivier, P. 2000. Camplan: A camera planning agent. In AAAI 2000 Spring Symposium on Smart Graphics, AAAI Press, 92--100.Google Scholar
- Halper, N., Helbing, R., and Strothotte, T. 2001. A camera engine for computer games: Managing the trade-off between constraint satisfaction and frame coherence. In EG 2001 Proceedings, Blackwell Publishing, vol. 20(3), 174--183.Google ScholarCross Ref
- He, L.-W., Cohen, M. F., and Salesin, D. H. 1996. The virtual cinematographer: a paradigm for automatic real-time camera control and directing. In SIGGRAPH 1996 Conference Proceedings, ACM, 217--224. Google Scholar
- Jardillier, F., and Languénou, E. 1998. Screen-space constraints for camera movements: the virtual cameraman. Computer Graphics Forum 17, 3, 175--186. ISSN 1067--7055.Google ScholarCross Ref
- Kamada, T., and Kawai, S. 1988. A simple method for computing general position in displaying three-dimensional objects. Computer Vision, Graphics, and Image Processing 41, 1, 43--56. Google ScholarDigital Library
- Katz, S. D. 1991. Film Directing Shot by Shot: Visualizing from Concept to Screen. Michael Wiese Productions.Google Scholar
- Kwon, J.-Y., and Lee, I.-K. 2008. Detemination of camera parameters for character motions using motion area. The Visual Computer 24, 475--483. Google ScholarDigital Library
- Laptev, I., and Lindeberg, T. 2003. Space-time interest points. In ICCV '03: Proceedings of the Ninth IEEE International Conference on Computer Vision, IEEE Computer Society, Washington, DC, USA, 432. Google ScholarDigital Library
- Lee, J., Chai, J., Reitsma, P. S. A., Hodgins, J. K., and Pollard, N. S. 2002. Interactive control of avatars animated with human motion data. In SIGGRAPH 2002 Conference Proceedings, ACM, vol. 21, 491--500. Google Scholar
- Lee, C. H., Varshney, A., and Jacobs, D. W. 2005. Mesh saliency. In SIGGRAPH 2005 Conference Proceedings, ACM, vol. 24, 659--666. Google Scholar
- Lin, T.-C., Shih, Z.-C., and Tsai, Y.-T. 2004. Cinematic camera control in 3d computer games. In WSCG, 289--296.Google Scholar
- Mascelli, J. V. 1965. The Five C's of Cinematography: Motion Picture Filming Techniques. Cine/Graphic Publications.Google Scholar
- McCabe, H., and Kneafsey, J. 2006. A virtual cinematography system for first person shooter games. In Proceedings of International Digital Games Conference, 25--35.Google Scholar
- Page, D. L., Koschan, A., Sukumar, S. R., Roui-Abidi, B., and Abidi, M. A. 2003. Shape analysis algorithm based on information theory. In ICIP (1), 229--232.Google Scholar
- Palmer, S., Rosch, E., and Chase, P. 1981. Canonical perspective and the perception of objects. Attention and Performance IX, 135--151.Google Scholar
- Park, M. J., and Shin, S. Y. 2004. Example-based motion cloning. Computer Animation Virtual Worlds 15, 3--4, 245--257. Google ScholarCross Ref
- Pickering, J. H. 2002. Intelligent Camera Planning for Computer Graphics. PhD thesis, University of York.Google Scholar
- Polonsky, O., Patanè, G., Biasotti, S., Gotsman, C., and Spagnuolo, M. 2005. What's in an image: Towards the computation of the "best" view of an object. The Visual Computer 21, 8--10, 840--847.Google ScholarCross Ref
- Shoemake, K. 1985. Animating rotation with quaternion curves. In SIGGRAPH 1985 Conference Proceedings, ACM, 245--254. Google Scholar
- Sokolov, D., and Plemenos, D. 2008. Virtual world explorations by using topological and semantic knowledge. Vis. Comput. 24, 3, 173--185. Google ScholarDigital Library
- Vázquez, P.-P., Feixas, M., Sbert, M., and Heidrich, W. 2003. Automatic view selection using viewpoint entropy and its application to image-based modelling. Computer Graphics Forum 22, 4, 689--700.Google ScholarCross Ref
Index Terms
- Motion overview of human actions
Recommendations
Motion overview of human actions
SIGGRAPH Asia '08: ACM SIGGRAPH Asia 2008 papersDuring the last decade, motion capture data has emerged and gained a leading role in animations, games and 3D environments. Many of these applications require the creation of expressive overview video clips capturing the human motion, however sufficient ...
Optimized Motion Capture System for Full Body Human Motion Capturing Case Study of Educational Institution and Small Animation Production
DMDCM '11: Proceedings of the 2011 Workshop on Digital Media and Digital Content ManagementMotion capture system or MOCAP is a set of devices used for capturing moving objects. In addition to had used in the scientific community, Medical, Engineering, MOCAP is currently being used extensively in film and animation industry to create realistic ...
Digital animation: repercussions of new media on traditional animation concepts
Edutainment'10: Proceedings of the Entertainment for education, and 5th international conference on E-learning and gamesThe introduction of digital techniques in film production has revolutionized an entire technical universe and suggests new aesthetics where the image is overlapping the traditional story that is told. A new culture is based upon an emerging phenomenon ...
Comments