Sujal Subhash Wattamwar
Hiranmay Ghosh
ABSTRACT
Complex media events are often characterized by spatio-temporal relations between its constituent media objects. A multimedia query language should support specification of such relations for semantic retrieval. We propose a method for formally defining 3D spatio-temporal relations between elementary media objects in this paper. To support soft decision making for multimedia data interpretation and to provide graded ranking, we define these relations using a set of fuzzy membership functions. It is possible to define fuzzy 3D extensions of Allen's relations as well as arbitrary new relations using our method. This method can be incorporated with upcoming multimedia query languages, such as MP7QF.
- Allen J F., "Maintaining Knowledge about Temporal Intervals", Comm. ACM 26(11), 1983. Google Scholar
Digital Library
- Arbab F., "Set models and Boolean operations for solids and assemblies", Computer Graphics and Applications, IEEE, Volume 10, Issue 6, Page(s):76--86, 1990. Google ScholarDigital Library
- Doller M., Renner K., Kosch H., Wolf I., Gruhne M., "Introduction of an MPEG-7 Query Language", 2nd International Conference on Digital Information Management, ICDIM, Pages 92--97, 2007.Google Scholar
- Ghosh H., Chaudhury S, Kashyap K. and Maiti B., "Ontology Specification and Integration for Multimedia Applications. In Ontologies: A Handbook of Principles, Concepts and Applications in Information Systems", Springer, 2007.Google Scholar
- Harit G., Chaudhury S., Ghosh H., "Using Multimedia Ontology for generating Conceptual Annotations and Hyperlinks in Video Collections", IEEE international conference on Web Intelligence, Pages 211--217, 2006. Google ScholarDigital Library
- Kandasamy W B V., "Smarandache Fuzzy Algebra", American Research Press, Rehoboth, 2003.Google Scholar
- Karthik T, Chaudhury S and Ghosh H., "Specifying Spatio-Temporal Relations in Multimedia Ontologies". International Conference of Pattern Recognition and Machine Intelligence (PReMI), Kolkata, Dec 2005. Google ScholarDigital Library
- Liu P., Chakraborty A., and Hsu L H., "A Logic Approach for MPEG-7 XML Document Queries", in Proceedings of the Extreme Markup Languages, Montreal, Canada, 2001. Google ScholarDigital Library
- Papadias D., "Approximate spatio temporal retrieval", ACM Transactions on Information Systems, vol. 19, pp. 53--96, January 2001. Google ScholarDigital Library
- Salembier P., Smith J R, "MPEG-7 Multimedia Description Schemes", IEEE Transactions on Circuits and Systems for Video Technology, vol 11, no. 6, June 2001. Google ScholarDigital Library
Index Terms
- Spatio-temporal query for multimedia databases
Recommendations
Probabilistic spatio-temporal inference for motion event understanding
In Video data, moving object has temporal flow and spatial features, which can be expressed in spatio-temporal relation. The goal in this paper is the understanding of object movement of spatio-temporal relation through mapping between vocabulary and ...
A data model and a query language for multimedia documents databases
A multimedia application involves information that may be in a form of video, images, audio, text and graphics, need to be stored, retrieved and manipulated in large databases. In this paper, we propose an object-oriented database schema that supports ...
Heterogeneous spatio-temporal relation learning network for facial action unit detection
Highlights- The attention-based feature decoupling module is proposed to obtain AU-specific spatio-temporal feature vectors.
AbstractProperties such as temporal relation and action relation of facial Action Units (AUs) make AU detection different from general multi-label classification tasks. Therefore, how to capture the spatial and temporal co-occurrence of AUs ...
Comments