Skip to main content
Erschienen in: Multimedia Systems 3/2012

01.06.2012 | Regular Paper

Spatio-temporal querying recurrent multimedia databases using a semantic sequence state graph

verfasst von: M. M. Naik, M. Sigdel, R. S. Aygun

Erschienen in: Multimedia Systems | Ausgabe 3/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present an indexing method for spatiotemporal data: semantic sequence state graph (S3G). S3G maintains objects with their locations as states and events as transitions. The spatial information is maintained in states while the semantic events result in temporal ordering between the states. If the objects visit the same locations repeatedly, we call such databases as recurrent databases. Our querying interface supports queries based on spatio-temporal logic that includes operators such as ‘next’ and ‘eventually’. The interactive querying interface enables the user to build the query interactively and see the intermediate results of the query.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Allen, J.F.: Maintaining knowledge about temporal intervals. In: Communications of the ACM. 26/11/1983. ACM Press (1983) Allen, J.F.: Maintaining knowledge about temporal intervals. In: Communications of the ACM. 26/11/1983. ACM Press (1983)
2.
Zurück zum Zitat Assfalg, J., Bertini, M., Colombo, C., Del Bimbo, A.: Semantic annotation of sports videos. IEEE Multimed. 9(2), 52–60 (2002)CrossRef Assfalg, J., Bertini, M., Colombo, C., Del Bimbo, A.: Semantic annotation of sports videos. IEEE Multimed. 9(2), 52–60 (2002)CrossRef
3.
Zurück zum Zitat Athitsos, V., Papapetrou, P., Potamias, M., Kollios, G., Gunopulos, D.: Approximate embedding-based subsequence matching of time series. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data. Vancouver, Canada, June 09–12, 2008, SIGMOD ’08 (2008) Athitsos, V., Papapetrou, P., Potamias, M., Kollios, G., Gunopulos, D.: Approximate embedding-based subsequence matching of time series. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data. Vancouver, Canada, June 09–12, 2008, SIGMOD ’08 (2008)
4.
Zurück zum Zitat Aygun, R.S., Yazici, A.: Modeling and management of fuzzy information in multimedia database application. Multimed. Tools Appl. 24(1), 29–56 (2004)CrossRef Aygun, R.S., Yazici, A.: Modeling and management of fuzzy information in multimedia database application. Multimed. Tools Appl. 24(1), 29–56 (2004)CrossRef
5.
Zurück zum Zitat Berchtold, S., Keim, D.A., Kriegel, H.-P.: The X-tree: An Index Structure for High-Dimensional Data, Readings in Multimedia Computing and Networking, pp. 451–462. Morgan Kaufmann, San Francisco (2002) Berchtold, S., Keim, D.A., Kriegel, H.-P.: The X-tree: An Index Structure for High-Dimensional Data, Readings in Multimedia Computing and Networking, pp. 451–462. Morgan Kaufmann, San Francisco (2002)
6.
Zurück zum Zitat Bozanis, P., Foteinos, P.: WeR-trees. Data Knowl. Eng. 63(2), 397–413 (2007)CrossRef Bozanis, P., Foteinos, P.: WeR-trees. Data Knowl. Eng. 63(2), 397–413 (2007)CrossRef
7.
Zurück zum Zitat Böhm, C., Berchtold, S., Keim, D.A.: Searching in high-dimensional spaces: index structures for improving the performance of multimedia databases. ACM Comput. Surv. 33(3), 322–373 (2001)CrossRef Böhm, C., Berchtold, S., Keim, D.A.: Searching in high-dimensional spaces: index structures for improving the performance of multimedia databases. ACM Comput. Surv. 33(3), 322–373 (2001)CrossRef
8.
Zurück zum Zitat Chen, S., Ooi, B., Tan, K., Nascimento, M.A. (2008) ST2B-tree: a self-tunable spatio-temporal b+-tree index for moving objects. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data. Vancouver, Canada, June 09–12, 2008, SIGMOD ’08 Chen, S., Ooi, B., Tan, K., Nascimento, M.A. (2008) ST2B-tree: a self-tunable spatio-temporal b+-tree index for moving objects. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data. Vancouver, Canada, June 09–12, 2008, SIGMOD ’08
9.
Zurück zum Zitat Del Bimbo, A., Vicario, E., Zingoni, D.: Symbolic description and visual querying of image sequences using spatio-temporal logic. IEEE Trans. Knowl. Data Eng. 7(4), 609–622 (1995)CrossRef Del Bimbo, A., Vicario, E., Zingoni, D.: Symbolic description and visual querying of image sequences using spatio-temporal logic. IEEE Trans. Knowl. Data Eng. 7(4), 609–622 (1995)CrossRef
11.
Zurück zum Zitat Hadjieleftheriou, M., Kollios, G., Bakalov, P., Tsotras, V.J.: Complex spatio-temporal pattern queries. In: Proceedings of the 31st International Conference on Very Large Data Bases (VLDB ’05). VLDB Endowment, pp. 877–888 (2005) Hadjieleftheriou, M., Kollios, G., Bakalov, P., Tsotras, V.J.: Complex spatio-temporal pattern queries. In: Proceedings of the 31st International Conference on Very Large Data Bases (VLDB ’05). VLDB Endowment, pp. 877–888 (2005)
12.
Zurück zum Zitat Hongeng, S., Nevatia, R., Bremond, F.: Video-based event recognition: activity representation and probabilistic recognition methods. Comput. Vis. Image Underst. 96(2), 129–162 (2004)CrossRef Hongeng, S., Nevatia, R., Bremond, F.: Video-based event recognition: activity representation and probabilistic recognition methods. Comput. Vis. Image Underst. 96(2), 129–162 (2004)CrossRef
14.
Zurück zum Zitat Jain, V., Aygun, R.S.: SMART: A grammar-based semantic video modeling and representation. In: IEEE SouthEast Con 2008 Jain, V., Aygun, R.S.: SMART: A grammar-based semantic video modeling and representation. In: IEEE SouthEast Con 2008
15.
Zurück zum Zitat Jain, V., Aygün, R.S.: Spatio-temporal querying of video content using SQL for quantizable video databases. J. Multimed. 4(4), 215–227 (2009) Jain, V., Aygün, R.S.: Spatio-temporal querying of video content using SQL for quantizable video databases. J. Multimed. 4(4), 215–227 (2009)
16.
Zurück zum Zitat Jensen, C.S., Lin, D., Ooi, B.C.: Query and update efficient B+-tree based indexing of moving objects. In: VLDB. pp. 768–779 (2004) Jensen, C.S., Lin, D., Ooi, B.C.: Query and update efficient B+-tree based indexing of moving objects. In: VLDB. pp. 768–779 (2004)
17.
Zurück zum Zitat Jensen, C.S., Snodgrass, R.T.: Temporal data management. IEEE Trans. Knowl. Data Eng. 11(1), 36–44 (1999)CrossRef Jensen, C.S., Snodgrass, R.T.: Temporal data management. IEEE Trans. Knowl. Data Eng. 11(1), 36–44 (1999)CrossRef
18.
Zurück zum Zitat Kim, C., Vasudev, B.: Spatiotemporal sequence matching for efficient video copy detection. IEEE Trans. Circuits Syst. Video Technol. 15(1), 127–132 (2005)CrossRef Kim, C., Vasudev, B.: Spatiotemporal sequence matching for efficient video copy detection. IEEE Trans. Circuits Syst. Video Technol. 15(1), 127–132 (2005)CrossRef
19.
Zurück zum Zitat Koprulu, M., Cicekli, N.K., Yazici, A.: Spatio-temporal querying in video databases. Inf. Sci. Inf. Comput. Sci. 160(1–4), 131–152 (2004) Koprulu, M., Cicekli, N.K., Yazici, A.: Spatio-temporal querying in video databases. Inf. Sci. Inf. Comput. Sci. 160(1–4), 131–152 (2004)
20.
Zurück zum Zitat Lagogiannis, G., Lorentzos, N., Sioutas, S., Theodoridis, E.: A time efficient indexing scheme for complex spatiotemporal retrieval. SIGMOD Rec. 38(3), 11–16 (2010)CrossRef Lagogiannis, G., Lorentzos, N., Sioutas, S., Theodoridis, E.: A time efficient indexing scheme for complex spatiotemporal retrieval. SIGMOD Rec. 38(3), 11–16 (2010)CrossRef
21.
Zurück zum Zitat Lay, J.A., Guan, L.: Semantic retrieval of multimedia by concept languages: treating semantic concepts like words. Signal Process. Mag. IEEE 23(2), 115–123 (2006)CrossRef Lay, J.A., Guan, L.: Semantic retrieval of multimedia by concept languages: treating semantic concepts like words. Signal Process. Mag. IEEE 23(2), 115–123 (2006)CrossRef
22.
Zurück zum Zitat Lee, M., Yoon, H., Kim, Y.J., Lee, Y.: SMILE tree: a stream data multi-query indexing technique with level-dimension nodes and extended-range nodes. In: Proceedings of the 2nd International Conference on Ubiquitous Information Management and Communication. Suwon, Korea, January 31–February 01, 2008, ICUIMC ‘08 Lee, M., Yoon, H., Kim, Y.J., Lee, Y.: SMILE tree: a stream data multi-query indexing technique with level-dimension nodes and extended-range nodes. In: Proceedings of the 2nd International Conference on Ubiquitous Information Management and Communication. Suwon, Korea, January 31–February 01, 2008, ICUIMC ‘08
23.
Zurück zum Zitat Lejsek, H., Ásmundsson, F.H., Jónsson, B.Þ., Amsaleg, L.: NV-Tree: an efficient disk-based index for approximate search in very large high-dimensional collections. IEEE Trans. Pattern Anal. Mach. Intell. 31(5), 869–883 (2009)CrossRef Lejsek, H., Ásmundsson, F.H., Jónsson, B.Þ., Amsaleg, L.: NV-Tree: an efficient disk-based index for approximate search in very large high-dimensional collections. IEEE Trans. Pattern Anal. Mach. Intell. 31(5), 869–883 (2009)CrossRef
24.
Zurück zum Zitat Li, J.Z., Ozsu, M.T., Szafron, D.: Modeling of moving objects in a video database. In: International Conference on Multimedia Computing and Systems, pp. 336 (1997) Li, J.Z., Ozsu, M.T., Szafron, D.: Modeling of moving objects in a video database. In: International Conference on Multimedia Computing and Systems, pp. 336 (1997)
25.
Zurück zum Zitat Lin, D., Jensen, C.S., Ooi, B.C., Šaltenis, S.: Efficient indexing of the historical, present, and future positions of moving objects. In: Proceedings of the 6th International Conference on Mobile Data Management, Ayia Napa, Cyprus, May 09–13, 2005, MDM ‘05. ACM, New York, NY, pp. 59–66 (2005) Lin, D., Jensen, C.S., Ooi, B.C., Šaltenis, S.: Efficient indexing of the historical, present, and future positions of moving objects. In: Proceedings of the 6th International Conference on Mobile Data Management, Ayia Napa, Cyprus, May 09–13, 2005, MDM ‘05. ACM, New York, NY, pp. 59–66 (2005)
26.
Zurück zum Zitat Min, J.S., Kim, D.H., Ryu, K.H.: A spatiotemporal data and indexing, electrical and electronic technology, 2001. TENCON. In: Proceedings of IEEE Region 10th International Conference on, vol. 1, pp. 110–113 (2001) Min, J.S., Kim, D.H., Ryu, K.H.: A spatiotemporal data and indexing, electrical and electronic technology, 2001. TENCON. In: Proceedings of IEEE Region 10th International Conference on, vol. 1, pp. 110–113 (2001)
27.
Zurück zum Zitat Naik, M., Jain, V., Aygun, R.S.: S3G: A semantic sequence state graph for indexing spatio-temporal data—a tennis video database application. In: ICSC, 2008 IEEE International Conference on Semantic Computing, pp. 66–73 (2008) Naik, M., Jain, V., Aygun, R.S.: S3G: A semantic sequence state graph for indexing spatio-temporal data—a tennis video database application. In: ICSC, 2008 IEEE International Conference on Semantic Computing, pp. 66–73 (2008)
28.
Zurück zum Zitat Park, D.-J., Heu, S., Kim, H.-J.: The RS-tree: an efficient data structure for distance browsing queries. Inf. Process. Lett. 80(4), 195–203 (2001)MathSciNetMATHCrossRef Park, D.-J., Heu, S., Kim, H.-J.: The RS-tree: an efficient data structure for distance browsing queries. Inf. Process. Lett. 80(4), 195–203 (2001)MathSciNetMATHCrossRef
29.
Zurück zum Zitat Patel, J.M., Chen, Y., Chakka, V.P.: STRIPES: an efficient index for predicted trajectories. In: Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, Paris, France, June 13–18, 2004. SIGMOD ’04. ACM, New York, NY, pp. 635–646 (2004) Patel, J.M., Chen, Y., Chakka, V.P.: STRIPES: an efficient index for predicted trajectories. In: Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, Paris, France, June 13–18, 2004. SIGMOD ’04. ACM, New York, NY, pp. 635–646 (2004)
30.
Zurück zum Zitat Pissinou, N., Radev, I., Makki, K., Campbell, W.J.: Spatio-temporal composition of video objects: representation and querying in video database systems. IEEE Trans. Knowl. Data Eng. 13(16), 1033–1040 (2001)CrossRef Pissinou, N., Radev, I., Makki, K., Campbell, W.J.: Spatio-temporal composition of video objects: representation and querying in video database systems. IEEE Trans. Knowl. Data Eng. 13(16), 1033–1040 (2001)CrossRef
31.
Zurück zum Zitat Ren, W., Singh, S., Singh, M., Zhu, Y.S.: State-of-the-art on spatio-temporal information-based video retrieval. Pattern Recognit. 42(2), 267–282 (2009)MATHCrossRef Ren, W., Singh, S., Singh, M., Zhu, Y.S.: State-of-the-art on spatio-temporal information-based video retrieval. Pattern Recognit. 42(2), 267–282 (2009)MATHCrossRef
32.
Zurück zum Zitat Šaltenis, S., Jensen, C.S., Leutenegger, S.T., Lopez, M.A.: Indexing the positions of continuously moving objects. SIGMOD Rec. 29(2), 331–342 (2000)CrossRef Šaltenis, S., Jensen, C.S., Leutenegger, S.T., Lopez, M.A.: Indexing the positions of continuously moving objects. SIGMOD Rec. 29(2), 331–342 (2000)CrossRef
33.
Zurück zum Zitat Saltenis, S., Jensen, C.S.: Indexing of moving objects for location-based services. ICDE 2002, 463–472 (2002) Saltenis, S., Jensen, C.S.: Indexing of moving objects for location-based services. ICDE 2002, 463–472 (2002)
34.
Zurück zum Zitat Salzberg, B., Tsotras, V.J.: Comparison of access methods for time-evolving data. ACM Comput. Surv. 31(2), 158–221 (1999)CrossRef Salzberg, B., Tsotras, V.J.: Comparison of access methods for time-evolving data. ACM Comput. Surv. 31(2), 158–221 (1999)CrossRef
35.
Zurück zum Zitat Tao, Y., Papadias, D., Sun, J.: The TPR*-tree: an optimized spatio-temporal access method for predictive queries. In: Proceedings of the 29th International Conference on Very Large Data Bases (VLDB), Berlin, Germany, 2003, pp. 790–801 (2003) Tao, Y., Papadias, D., Sun, J.: The TPR*-tree: an optimized spatio-temporal access method for predictive queries. In: Proceedings of the 29th International Conference on Very Large Data Bases (VLDB), Berlin, Germany, 2003, pp. 790–801 (2003)
36.
Zurück zum Zitat Valle, E., Cord, M., Philipp-Foliguet, S.: High-dimensional descriptor indexing for large multimedia databases. In: Proceeding of the 17th ACM Conference on Information and Knowledge Management. CIKM '08. ACM (2008) Valle, E., Cord, M., Philipp-Foliguet, S.: High-dimensional descriptor indexing for large multimedia databases. In: Proceeding of the 17th ACM Conference on Information and Knowledge Management. CIKM '08. ACM (2008)
37.
Zurück zum Zitat Vardi, M.Y. Branching vs. linear time: final showdown. In: Proceedings of the 7th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS’01), 2031 (2001), pp. 1–22 Vardi, M.Y. Branching vs. linear time: final showdown. In: Proceedings of the 7th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS’01), 2031 (2001), pp. 1–22
38.
Zurück zum Zitat Wattamwar, S.S., Ghosh, H.: Spatio-temporal query for multimedia databases. In: Proceeding of the 2nd ACM Workshop on Multimedia Semantics. Vancouver, British Columbia, Canada, October 31–31, 2008, MS ’08. pp. 48–55, ACM, New York, NY Wattamwar, S.S., Ghosh, H.: Spatio-temporal query for multimedia databases. In: Proceeding of the 2nd ACM Workshop on Multimedia Semantics. Vancouver, British Columbia, Canada, October 31–31, 2008, MS ’08. pp. 48–55, ACM, New York, NY
39.
Zurück zum Zitat Ye, H., Luo, H., Song, K., Xiang, H., Chen, J.: Indexing moving objects based on 2n index tree. In: Proceedings of the 6th Conference on 6th WSEAS International Conference on Artificial intelligence, Knowledge Engineering and Data Bases, vol. 6, Corfu Island, Greece, February 16–19, 2007 Ye, H., Luo, H., Song, K., Xiang, H., Chen, J.: Indexing moving objects based on 2n index tree. In: Proceedings of the 6th Conference on 6th WSEAS International Conference on Artificial intelligence, Knowledge Engineering and Data Bases, vol. 6, Corfu Island, Greece, February 16–19, 2007
40.
Zurück zum Zitat Yiu, M.L., Tao, Y., Mamoulis, N.: The Bdual-tree: indexing moving objects by space filling curves in the dual space. VLDB J. 17(3), 379–400 (2008)CrossRef Yiu, M.L., Tao, Y., Mamoulis, N.: The Bdual-tree: indexing moving objects by space filling curves in the dual space. VLDB J. 17(3), 379–400 (2008)CrossRef
Metadaten
Titel
Spatio-temporal querying recurrent multimedia databases using a semantic sequence state graph
verfasst von
M. M. Naik
M. Sigdel
R. S. Aygun
Publikationsdatum
01.06.2012
Verlag
Springer-Verlag
Erschienen in
Multimedia Systems / Ausgabe 3/2012
Print ISSN: 0942-4962
Elektronische ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-011-0255-8

Weitere Artikel der Ausgabe 3/2012

Multimedia Systems 3/2012 Zur Ausgabe