M. Cecelia Buchanan
Polle T. Zellweger
Skip Abstract Section
Abstract
A traditional static document has a spatial layout that specifies where objects in the document appear. Because multimedia documents incorporate time, they also require a temporal layout, or schedule, that specifies when events in the document occur. This article argues that multimedia document systems should provide mechanisms for automatically producing temporal layouts for documents. The major advantage of this approach is that it makes it easier for authors to create and modify multimedia documents.This article revisits our 1993 framework for understanding automatic temporal formatters and explores the basic issues surrounding them. It also describes the Firefly multimedia document system, which was developed in 1992 to test the potential of automatic temporal formatting. Using our original framework, the paper reviews a representative sample of recent automatic document formatters. This analysis validates the basic framework and demonstrates the progress of the field in the intervening decade. A discussion of potential extensions to the framework is included.
- Allen, J. 1983. Maintaining knowledge about temporal intervals. Commun. ACM 26, 11, 832--843. Google Scholar
Digital Library
- Bailey, B., Konstan, J. A., Cooley, R., and Dejong, M. 1998. NSYNC---A toolkit for building interactive multimedia presentations. In Proceedings of the 6th ACM International Conference on Multimedia (Bristol, U.K., Sept.). ACM, New York, 257--266. Google Scholar
- Blakowski, G. 1992. High level services for distributed multimedia applications based on application and environment descriptions. In Proccedings of the ACSC15: 15th Australian Computer Science Conference (Hobart, Australia, Jan.). (Also appears in Australian Comput. Sci. Commun. 14, 1, 93--109.Google Scholar
- Blakowski, G., Hubel, J., and Langrehr, U. 1992. Tool support for the synchronization and presentation of distributed multimedia. Computer Commun. 15, 10, 611--618. Google ScholarDigital Library
- Blakowski, G. and Steinmetz, R. 1996. A media synchronization survey: Reference model, specification and case study. IEEE J. Sel. Areas Commun. 14, 1, 5--35. Google ScholarDigital Library
- Boll, S. and Klas, W. 2001. ZYX---A multimedia document model for reuse and adaptation of multimedia content. IEEE Trans. Knowl. Data Eng. 13, 3, 361--382. Google ScholarDigital Library
- Boll, S., Klas, W., and Wandel, J. 1999. A cross-media adaptation strategy for multimedia presentations. In Proceedings of the 7th ACM International Conference on Multimedia (Part I) (Orlando, Fla.). ACM, New York, 37--46. Google Scholar
- Buchanan, M. C. and Zellweger, P. 1992. Specifying temporal behavior in hypermedia documents. In Proceedings of the ACM Conference on Hypertext (Milan, Italy, Dec.). ACM, New York, 262--271. Google Scholar
- Buchanan, M. C. and Zellweger, P. 1993a. Automatically generating consistent schedules for multimedia documents. Multimed. Syst. J. 1, 2, 55--67.Google ScholarDigital Library
- Buchanan, M. C. and Zellweger, P. 1993b. Automatic temporal layout mechanisms. In Proceedings of the 1st International Conference on Multimedia (Anaheim, Calif., Sept.). ACM, New York, 341--350. Google Scholar
- Bulterman, D. C. A. 1998. User-centered abstractions for adaptive hypermedia presentations. In Proceedings of the 6th ACM International Conference on Multimedia (Bristol, U.K., Sept.). ACM, New York, 247--256. Google Scholar
- Bulterman, D. C. A. and Hardman, L. 2005. Structured multimedia authoring. ACM Trans. Multimed. Comput. Commun. Appl. 1, 1 (Feb.), 89--109. Google ScholarDigital Library
- Bulterman, D. C. A., Hardman, L., Jansen, J., Mullender, K. S., and Rutledge, L. 1998. GRiNS: A GRaphical INterface for creating and playing SMIL documents. Comput. Netw. ISDN Syst. 30, 1--7, 519--529. (Also appears in Proc. of the 7th Intl. WWW Conf., Australia, April 1998, 519--529.) Google Scholar
- Bulterman, D. C. A., Van Rossum, G., and Van Liere, R. 1991. A structure for transportable, dynamic multimedia documents. In Proceedings of the 1991 Summer USENIX Conference (Nashville, Tenn., June). 137--155.Google Scholar
- Candan, K. S., Prabhakaran, B., and Subrahmanian, V. S. 1997. CHIMP: A framework for supporting distributed multimedia document authoring and presentation. In Proceedings of the 4th ACM International Conference on Multimedia (Boston, Mass., Feb.). ACM, New York, 329--340. Google Scholar
- Candan, K. S., Prabhakaran, B., and Subrahmanian, V. S. 1998. Collaborative multimedia documents: Authoring and presentation. Intl. J. Intel. Syst. 13, 12, 1059--1111.Google ScholarCross Ref
- Courtiat, J.-P. and De Oliveira, R. C. 1997. Proving temporal consistency in a new multimedia model. In Proceedings of the 4th ACM International Conference on Multimedia (Boston, Mass., Feb.). ACM, New York, 141--152. Google Scholar
- Dechter, R., Meiri, I., and Pearl, J. 1991. Temporal constraint networks. Artif. Intel. 49, 61--95. Google ScholarDigital Library
- Drapeau, G. and Greenfield, H. 1991. MAEstro---A distributed multimedia authoring environment. In Proceedings of the 1991 Summer USENIX Conference (Nashville, Tenn., June). 315--328.Google Scholar
- Fiume, E., Tsichritzis, D., and Dami, L. 1987. A temporal scripting language for object-oriented animation. In Proceedings of the Eurographics 1987. North-Holland, Elsevier Science Publishers, Amsterdam, The Netherlands.Google Scholar
- Hamakawa, R. and Rekimoto, J. 1993. Object composition and playback models for handling multimedia data. In Proceedings of the 1st International Conference on Multimedia (Anaheim, Calif., Sept.). ACM, New York, 273--281. Google Scholar
- Hamakawa, R. and Rekimoto, J. 1994. Object composition and playback models for handling multimedia data. Multimed. Syst. 2, 1, 26--35. Google ScholarDigital Library
- Hillier, F. and Lieberman, G. 1974. Operations Research. Holden-Day, San Francisco, Calif.Google Scholar
- Jourdan, M., Layaïda, N., Roisin, C., Sabry-Ismaïl, L., and Tardif, L. 1998. Madeus, an authoring environment for interactive multimedia documents. In Proceedings of the 6th ACM International Conference on Multimedia (Bristol, U.K., Sept.). ACM, New York, 267--272. Google Scholar
- Jourdan, M., Layaïda, N., and Sabry-Ismaïl, L. 1997. Time representation and management in Madeus: An authoring environment for multimedia documents. In Proceedings of the International Conference on Multimedia Computing and Networking, SPIE Proc. 3020 (San Jose, Calif., Feb.). M. Freeman, R. Jardetzki and H. M. Vin, Eds., 68--79. Google Scholar
- Kim, M. Y. and Song, J. 1995. Multimedia documents with elastic time. In Proceedings of the 3rd ACM International Conference on Multimedia (San Francisco, Calif., Jan.). ACM, New York, 143--154. Google Scholar
- Kim, W., Kenchammana-Hosekote, D., Lim, E. P., and Srivastava, J. 1992. Synchronization relation tree: A model for temporal synchronization in multimedia presentations. Tech. Rep. 9242. University of Minnesota, Computer Science Department.Google Scholar
- Knuth, D. and Plass, M. 1981. Breaking paragraphs into lines. Softw. Prac. Exper. 11, 11, 1119--1184.Google ScholarCross Ref
- Koegel, J., Keskin, C., and Rutledge, J. 1992. Toolkits for multimedia interface design. In Proceedings of the of Xhibition 1992 (San Jose, Calif., June). 275--285.Google Scholar
- Layaïda, N. and Sabry-Ismaïl, L. 1996. Maintaining temporal consistency of multimedia documents using constraint networks. In Proceedings of the International Conference on Multimedia Computing and Networking, SPIE Proc. 2667 (San Jose, Calif., Jan.). M. Freeman, P. Jardetzky, H. M. Vin, Eds., 124--135.Google Scholar
- Layaïda, N., Sabry-Ismaïl, L., and Roisin, C. 2002. Dealing with uncertain durations in synchronized multimedia documents. Multimed. Tools Appl. 18, 3, 213--231. Google ScholarCross Ref
- Little, T. L. D. C. and Ghafoor., A. 1990. Synchronization and storage models for multimedia objects. IEEE J. Sel. Areas Commun. 8, 3, 413--427.Google ScholarDigital Library
- Macromind. 1989. MacroMind Director: Overview manual. MacroMind, Inc.Google Scholar
- Mirbel, I., Pernici, B., Sellis, T., Tserkezoglou, S., and Vazirgiannis, M. 2000. Checking the temporal integrity of interactive multimedia documents. The VLDB J. 9, 2, 111--130. Google ScholarDigital Library
- Ogawa, R., Harada, H., and Kameko, A. 1990. Scenario-based hypermedia: A model and a system. In Hypertext: Concepts, systems and applications, A. Rizk, N. Streitz and J. Andre, Eds., Cambridge Univ. Press, New York, 38--51. Google Scholar
- Perez-Luque, M. J. and Little, T. D. C. 1996. A temporal reference framework for multimedia synchronization. IEEE J. Sel. Areas Commun. 14, 1, 36--51. Google ScholarDigital Library
- Poole, L. 1991. QuickTime in motion. MACWORLD 8, 9, 154--159.Google Scholar
- Real Networks. 2004. RealPlayer. http://www.real.com/player/.Google Scholar
- Rodrigues, R. F. and Soares, L. F. G. 2003. Inter and intra media-object QoS provisioning in adaptive formatters. In Proceedings of the 2003 ACM Symposium on Document Engineering (Grenoble, France, Nov.). ACM, New York, 78--87. Google Scholar
- Roisin, C., Kober, V., Quint, V., Genevès, P., and Navarro, P. 2003. Editing SMIL with timelines. In Proceedings of the Synchronised Multimedia Integration Language European Conference (Paris, France, Jan.).Google Scholar
- Sampaio, P. N. M., Lohr, C., and Courtiat, J.-P. 2001. An integrated environment for the presentation of consistent SMIL 2.0 documents. In Proceedings of the 2001 ACM Symposium on Document Engineering (Atlanta, Ga, Nov.). ACM, New York, 115--124. Google Scholar
- Santos, C. A. S., Soares, L. F. G., Souza, G. L., and Courtiat, J.-P. 1998. Design methodology and formal validation of hypermedia documents. In Proceedings of the 6th ACM International Conference on Multimedia (Bristol, U.K., Sept.). ACM, New York, 39--48. Google Scholar
- Schnepf, J., Konstan, J. A., and Du, D. H. C. 1996a. Doing FLIPS: Flexible interactive presentation synchronization. IEEE J. Sel. Areas Commun. 14, 1, 114--125. Google ScholarDigital Library
- Schnepf, J. A., Lee, Y.-J., Du, D. H. C., Lai, L., and Kang, L.-W. 1996b. Building a framework for FLexible Interactive Presentations. In Proceedings of the Pacific Workshop on Distributed Multimedia Systems (Hong Kong, June).Google Scholar
- Soares, L. F. G., Rodrigues, R. F., and Saade, D. C. M. 2000. Modeling, authoring and formatting hypermedia documents in the HyperProp system. Multimed. Syst. 8, 2, 118--134. Google ScholarDigital Library
- Song, J., Kim, M. Y., Ramalingam, G., Miller, R., and Yi, B.-K. 1996. Interactive authoring of multimedia documents. In Proceedings of the IEEE Symposium on Visual Languages (Sept.). IEEE Computer Society Press, Los Alamitos, Calif., 276--283. Google Scholar
- Song, J., Ramalingam, G., Miller, R., and Yi, B.-K. 1999. Interactive authoring of multimedia documents in a constraint-based authoring system. Multimed. Syst. 7, 5, 424--437. Google ScholarDigital Library
- Steinmetz, R. 1990. Synchronization properties in multimedia systems. IEEE J. Sel. Areas Commun. 8, 3, 401--412.Google ScholarDigital Library
- Stotts, D. and Furuta, R. 1990. Temporal hyperprogramming. J. Vis. Lang. Comput. 1, 3, 237--253.Google ScholarDigital Library
- Swinehart, D., Zellweger, P., Beach, R., and Hagmann, R. 1986. A structural view of the Cedar programming environment. ACM Trans. Program. Lang. Syst. 8, 4, 419--490. Google ScholarDigital Library
- Van Rossum G., Jansen J., Mullender K. S., and Bulterman D. C. A. 1993. CMIFed: A presentation environment for portable hypermedia documents. In Proceedings of the 1st International Conference on Multimedia (Anaheim, Calif., Sept.). ACM, New York, 183--188. Google Scholar
- Vazirgiannis, M. and Boll, S. 1997. Events in interactive multimedia applications: Modeling and implementation design. In Proceedings of IEEE International Conference on Multimedia Computing and Systems 1997 (June). IEEE Computer Society Press, Los Alamitos, Calif., 244--251. Google Scholar
- Wahl, T. and Rothermel, K. 1994. Representing time in multimedia systems. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems 1994 (Boston Mass., May). IEEE Computer Society Press, Los Alamitos, Calif., 538--543.Google Scholar
- Wahl, T., Wirag, S., and Rothermel, K. 1995. Tiempo: Temporal modeling and authoring of interactive multimedia. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems (Washington, D.C.). IEEE Computer Society Press, Los Alamitos, Calif., 274--277. Google Scholar
- W3C. 2001. Synchronized Multimedia Integration Language (SMIL 2.0), World Wide Web Consortium Recommendation 7 Aug. 2001, http://www.w3.org/TR/smil20.Google Scholar
Index Terms
- Automatic temporal layout mechanisms revisited
Recommendations
Automatic temporal layout mechanisms
MULTIMEDIA '93: Proceedings of the first ACM international conference on MultimediaInteractive Authoring of Multimedia Documents
VL '96: Proceedings of the 1996 IEEE Symposium on Visual LanguagesAuthoring multimedia documents involves coordinating various types of media items in time and space. To be effective, authoring requires integration tools that are highly interactive. In addition, the notion of ``time'' must be made explicit and ...
MING-I: a distributed interactive multimedia document development mechanism
The next generation of interactive multimedia documents can contain both static media, e.g., text, graph, image, and continuous media, e.g., audio and video, and can provide user interactions in distributed environments. However, the temporal ...
Comments