Rachel Heck
Skip Abstract Section
Abstract
Well-produced videos provide a convenient and effective way to archive lectures. In this article, we offer a new way to create lecture videos that retains many of the advantages of well-composed recordings, without the cost and intrusion of a video production crew. We present an automated system called Virtual Videography that employs the art of videography to mimic videographer-produced videos, while unobtrusively recording lectures. The system uses the data recorded by unattended video cameras and microphones to produce a new edited video as an offline postprocess. By producing videos offline, our system can use future information when planning shot sequences and synthesizing new shots. Using simple syntactic cues gathered from the original video and a novel shot planning algorithm, the system makes cinematic decisions without any semantic understanding of the lecture.
- Abowd, G. 1999. Classroom 2000: An experiment with the instrumentation of a living educational environment. IBM Syst. J. 38, 4, 508--530. Google Scholar
Digital Library
- Bares, W. and Lester, J. 1999. Intelligent multi-shot visualization interfaces for dynamic 3D worlds. In Proceedings of the 1999 International Conference on Intelligent User Interfaces. 119--126. Google ScholarDigital Library
- Bianchi, M. 1998. Autoauditorium: A fully automatic, multi-camera system to televise auditorium presentations. Presented at the Joint DARPA/NIST Smart Spaces Technology Workshop.Google Scholar
- Bianchi, M. 2004. Automatic video production of lectures using an intelligent and aware environment. In MUM: Proceedings of the 3rd International Conference on Mobile and Ubiquitous Multimedia. ACM Press, New York. 117--123. Google ScholarDigital Library
- Bordwell, D. 1998. On the History of Film Style. Harvard University Press, Cambridge, MA.Google Scholar
- Burns, B., Marks, R., Beymer, D., Weber, J., Gleicher, M., and Rosenchein, S. 1998. Person tracking research at autodesk. In 3rd Bay Area Vision Meeting: Visual Analysis of People---Invited Talk.Google Scholar
- Burns, K. 2001. Jazz: A Film by Ken Burns. PBS.Google Scholar
- Canopus 2002. Canopus Imaginate. http://www.canopus-corp.comGoogle Scholar
- Cantine, J., Howard, S., and Lewis, B. 1995. Shot By Shot: A Practical Guide to Filmmaking. Pittsburgh Filmmakers.Google Scholar
- Chen, M. 2001. Design of a virtual auditorium. In Proceedings of the ACM Multimedia Conference. ACM Press, New York. Google ScholarDigital Library
- Christianson, D. B., Anderson, S. E., He, L.-W., Weld, D. S., Cohen, M. F., and Salesin, D. H. 1996. Declarative camera control for automatic cinematography. In Proceedings of the AAAI Conference. 148--155. Google ScholarDigital Library
- Clark, R. 1983. Reconsidering research on learning from media. Rev. Educ. Res. 53, 4, 445--459.Google ScholarCross Ref
- Clark, R. 1991. When researchers swin upstream: Reflections on an unpopular argument about learning from media. Educ. Technol., 34--40. Google ScholarDigital Library
- Cutler, R. et al. 2002. Distributed meetings: A meeting capture and broadcasting system. In Proceedings of the ACM Multimedia Conference. ACM Press, New York. Google ScholarDigital Library
- Drucker, S. and Zeltzer, D. 1995. Camdroid: A system for implementing intelligent camera control. In Proceedings of the Symposium on Interactive 3D Graphics, 139--144. Google ScholarDigital Library
- Girgensohn, A., Bly, S., Boreczky, J., and Wilcox, L. 2001. Home video editing made easy--Balancing automation and user control. In Proceedings of the Human-Computer Interaction INTERACT Conference. 464--471.Google Scholar
- Girgensohn, A., Boreczky, J., Chiu, P., Doherty, J., Foote, J., Golovchinsky, G., Uchihashi, S., and Wilcox, L. 2000. A semi-automatic approach to home video editing. In Proceedings of the UIST Conference. 81--89. Google ScholarDigital Library
- Gleicher, M. and Masanz, J. 2000. Towards virtual videography (poster session). In Proceedings of the ACM Multimedia Conference. ACM Press, New York. Google ScholarDigital Library
- Gleicher, M. and Witkin, A. 1992. Through-the-Lens camera control. Comput. Graph. 26, 2 (Jul.), 331--340. Google ScholarDigital Library
- Gleicher, M. L., Heck, R. M., and Wallick, M. N. 2002. A framework for virtual videography. In Proceedings of the 2nd International Symposium on Smart Graphics. ACM Press, New York. 9--16. Google ScholarDigital Library
- He, L., Cohen, M., and Salesin, D. August 1996. The virtual cinematographer: A paradigm for automatic real-time camera control and directing. In Proceedings of the SIGGRAPH Conference. 217--224. Google ScholarDigital Library
- He, L., Liu, Z., and Zhang, Z. 2002. Why take notes? Use the whiteboard capture system. Tech. Rep. MSR-TR-2002-89, Microsoft Research. September.Google Scholar
- He, L., Sanocki, E., Gupta, A., and Grudin, J. 1999. Auto-Summarization of audio-video presentations. In Proceedings of the ACM Multimedia Conference. ACM Press, New York. Google ScholarDigital Library
- James, D. and Hunter, J. 2000. A streamlined system for building online presentation archives using smil. In Proceedings of the Australasian Conference on Computing Education. ACM Press, New York. 145--152. Google ScholarDigital Library
- Jones, M. J. and Rehg, J. M. 1998. Statistical color models with application to skin detection. Tech. Rep. CRL 98/11, Cambridge Research Laboratory.Google Scholar
- Karp, P. and Feiner, S. 1993. Automated presentation planning of animation using task decomposition with heuristic reasoning. In Proceedings of the Graphics Interface Conference. 118--127.Google Scholar
- Katz, S. 1991. Film Directing Shot by Shot: Visualizing from Concept to Screen. Michael Wiese Productions.Google Scholar
- Lee, D.-S., Erol, B., Graham, J., Hull, J. J., and Murata, N. 2002. Portable meeting recorder. In Proceedings of the ACM Multimedia Conference. ACM Press, New York. Google ScholarDigital Library
- Li, Y., Zhang, T., and Tretter, D. 2001. An overview of video abstraction techniques. Tech. Rep. HPL-2001-191, Imaging Systems Laboratory, HP Laboratories, Palo Alto, California. July.Google Scholar
- Liu, T. and Kender, J. R. 2003. Spatial-Temporal semantic grouping of instructional video content. In Proceedings of the 2nd International Conference on Image and Video Retrieval. Google ScholarDigital Library
- Machnicki, E. and Rowe, L. 2002. Virtual director: Automating a webcase. In Proceedings of the SPIE Conference on Multimedia Computing and Networking.Google Scholar
- Machrone, B. 2003. Every photo tells a story. http://www.pcmag.com/article2/0,4149,1404041,00.asp.Google Scholar
- Mukhopadhyay, S. and Smith, B. 1999. Passive capture and structuring of lectures. In Proceedings of the ACM Multimedia Conference. Google ScholarDigital Library
- Onishi, M., Izumi, M., and Fukunaga, K. 2000. Blackboard segmentation using video image of lecture and its applications. In Proceedings of the International Conference on Pattern Recognition. 615--618. Google ScholarDigital Library
- Onishi, M., Kagebayashi, T., and Fukunaga, K. 2001. Production of video images by computer controlled camera and its application to TV conference system. In Proceedings of the CVPR01 Conference. 131--137.Google Scholar
- Pinhanez, C. S. and Bobick, A. F. 1997. Intelligent studios: Using computer vision to control TV cameras. Appli. Artifi. Intell. 11, 4, 285--306.Google Scholar
- Rowe, L., Harley, D., Pletcher, P., and Lawrence, S. 2003. Bibs: A lecture webcasting system. Tech. Rep. 1005, Center for Studies in Higher Education, UC Berkeley. http://ideas.repec.org/p/cdl/cshedu/1005.html.Google Scholar
- Rui, Y., He, L., Gupta, A., and Liu, Q. 2001. Building an intelligent camera management system. In Proceedings of the ACM Multimedia Conference. Google ScholarDigital Library
- Russell, D. M. 2000. A design pattern-based video summarization technique: Moving from low-level signals to high-level structure. In Proceedings of the 33rd Hawaii International Conference on System Sciences. Google ScholarDigital Library
- Saund, E. 1999. Image mosaicing and a diagrammatic user interface for an office whiteboard scanner. http://www.parc. xerox.com/spl/members/saund/zombieboard-public.html.Google Scholar
- Saund, E., Fleet, D., Larner, D., and Mahoney, J. 2003. Perceptually-Supported image editing of text and graphics. In Proceedings of the UIST Conference. 183--192. Google ScholarDigital Library
- Stagetools. 2002. Moving Pictures. http://www.stagetools.com/Google Scholar
- Steinmetz, A. and Kienzle, M. 2001. The e-seminar lecture recording and districution system. In Proceedings of the SPIE Conference on Multimedia Computing and Networking. vol. 4312.Google Scholar
- Syeda-Mahmood, T. and Srinivasan, S. 2000. Detecting topical events in digital video. In Proceedings of the ACM Multimedia Conference. ACM Press, New York. Google ScholarDigital Library
- Teodosio, L. and Bender, W. 1993. Salient video stills: Content and context preserved. In Proceedings of the ACM Multimedia Conference. ACM Press, New York. Google ScholarDigital Library
- Virtual Ink. 2004. Mimio. http://www.mimio.com/index.shtml.Google Scholar
- Wallick, M., Rui, Y., and He, L. 2004. A portable solution for automatic lecture room camera management. In Proceedings of the IEEE International Conference on Multimedia and Expo.Google Scholar
- Wallick, M. N., Heck, R. M., and Gleicher, M. L. 2005. Chalkboard and marker regions. In Proceedings of the Mirage---Computer Vision/Computer Graphics Collaboration Techniques and Applications Conference.Google Scholar
- Wang, F., Ngo, C., and Pong, T. 2004. Gesture tracking and recognition for lecture video editing. In Proceedings of the ICPR Conference. 934--937. Google ScholarCross Ref
- Web page. 2005. The great media debate. http://hagar.up.ac.za/rbo/construct/media.html.Google Scholar
Index Terms
- Virtual videography
Recommendations
Write-a-video: computational video montage from themed text
We present Write-A-Video, a tool for the creation of video montage using mostly text-editing. Given an input themed text and a related video repository either from online websites or personal albums, the tool allows novice users to generate a video ...
Towards virtual videography (poster session)
MULTIMEDIA '00: Proceedings of the eighth ACM international conference on MultimediaVideographers have developed an art of conveying events in video. Through choices made in cinematography, editing, and post-processing, effective video presentations can be created from events recorded with little or no intrusion. In this paper, we ...
A framework for virtual videography
SMARTGRAPH '02: Proceedings of the 2nd international symposium on Smart graphicsThere are a significant number of events that happen on a regular basis that would be worth preserving on video but for which it is impractical to use traditional video production methods. In this paper, we describe one possible way to inexpensively and ...
Comments