Skip to main content
Top
Published in:
Cover of the book

2016 | OriginalPaper | Chapter

A Novel Approach to Multimedia Ontology Engineering for Automated Reasoning over Audiovisual LOD Datasets

Author : Leslie F. Sikos

Published in: Intelligent Information and Database Systems

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multimedia reasoning, which is suitable for, among others, multimedia content analysis and high-level video scene interpretation, relies on the formal and comprehensive conceptualization of the represented knowledge domain. However, most multimedia ontologies are not exhaustive in terms of role definitions, and do not incorporate complex role inclusions and role interdependencies. In fact, most multimedia ontologies do not have a role box at all, and implement only a basic subset of the available logical constructors. Consequently, their application in multimedia reasoning is limited. To address the above issues, VidOnt, the very first multimedia ontology with \( {{\mathcal{S}\mathcal{R}\mathcal{O}\mathcal{I}\mathcal{Q}}^{{({\mathcal{D}})}}} \) expressivity and a DL-safe ruleset has been introduced for next-generation multimedia reasoning. In contrast to the common practice, the formal grounding has been set in one of the most expressive description logics, and the ontology validated with industry-leading reasoners, namely HermiT and FaCT++. This paper also presents best practices for developing multimedia ontologies, based on my ontology engineering approach.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
In the \( {{\mathcal{S}\mathcal{R}\mathcal{O}\mathcal{I}\mathcal{Q}}} \) description logic. Many less expressive DLs do not provide inverse roles, and no other ontology supports the universal role, which has been introduced in \( {{\mathcal{S}\mathcal{R}\mathcal{O}\mathcal{I}\mathcal{Q}}} \).
 
2
Semantic Web Rule Language.
 
Literature
1.
go back to reference Meghini, C., Sebastiani, F., Straccia, U.: Reasoning about the Form and Content of Multimedia Objects. In: AAAI 1997 Spring Symposium on Intelligent Integration and Use of Text, Image, Video and Audio, pp. 89–94. AAAI Press, Menlo Park (1997) Meghini, C., Sebastiani, F., Straccia, U.: Reasoning about the Form and Content of Multimedia Objects. In: AAAI 1997 Spring Symposium on Intelligent Integration and Use of Text, Image, Video and Audio, pp. 89–94. AAAI Press, Menlo Park (1997)
2.
go back to reference Simou, N., Athanasiadis, T., Tzouvaras, V., Kollias, S.: Multimedia reasoning with f–SHIN. In: Second International Workshop on Semantic Media Adaptation and Personalization, IEEE (2007). doi:10.1109/SMAP.2007.40 Simou, N., Athanasiadis, T., Tzouvaras, V., Kollias, S.: Multimedia reasoning with f–SHIN. In: Second International Workshop on Semantic Media Adaptation and Personalization, IEEE (2007). doi:10.​1109/​SMAP.​2007.​40
3.
go back to reference Simou, N., Saathoff, C., Dasiopoulou, S., Spyrou, E., Voisine, N., Tzouvaras, V., Kompatsiaris, I., Avrithis, Y., Staab, S.: An ontology infrastructure for multimedia reasoning. In: Atzori, L., Giusto, D.D., Leonardi, R., Pereira, F. (eds.) VLBV 2005. LNCS, vol. 3893, pp. 51–60. Springer, Heidelberg (2006)CrossRef Simou, N., Saathoff, C., Dasiopoulou, S., Spyrou, E., Voisine, N., Tzouvaras, V., Kompatsiaris, I., Avrithis, Y., Staab, S.: An ontology infrastructure for multimedia reasoning. In: Atzori, L., Giusto, D.D., Leonardi, R., Pereira, F. (eds.) VLBV 2005. LNCS, vol. 3893, pp. 51–60. Springer, Heidelberg (2006)CrossRef
5.
go back to reference Gómez-Romero, J., Patricio, M.A., García, J., Molina, J.M.: Ontology-based context representation and reasoning for object tracking and scene interpretation in video. Expert Syst. Appl. 38, 7494–7510 (2011). doi:10.1016/j.eswa.2010.12.118 CrossRef Gómez-Romero, J., Patricio, M.A., García, J., Molina, J.M.: Ontology-based context representation and reasoning for object tracking and scene interpretation in video. Expert Syst. Appl. 38, 7494–7510 (2011). doi:10.​1016/​j.​eswa.​2010.​12.​118 CrossRef
6.
go back to reference Möller, R., Neumann, B.: Ontology-based reasoning techniques for multimedia interpretation and retrieval. In: Semantic Multimedia and Ontologies. Springer, London (2008). doi:10.1007/978-1-84800-076-6_3 Möller, R., Neumann, B.: Ontology-based reasoning techniques for multimedia interpretation and retrieval. In: Semantic Multimedia and Ontologies. Springer, London (2008). doi:10.​1007/​978-1-84800-076-6_​3
7.
go back to reference Elleuch, N., Zarka, M., Ammar, A.B., Alimi, A.M.: A fuzzy ontology-based framework for reasoning in visual video content analysis and indexing. In: 11th International Workshop on Multimedia Data Mining (MDMKDD 2011), San Diego (2011). doi:10.1145/2237827.2237828 Elleuch, N., Zarka, M., Ammar, A.B., Alimi, A.M.: A fuzzy ontology-based framework for reasoning in visual video content analysis and indexing. In: 11th International Workshop on Multimedia Data Mining (MDMKDD 2011), San Diego (2011). doi:10.​1145/​2237827.​2237828
8.
go back to reference Jaimes, A., Tseng, B.L., Smith, J.R.: Modal keywords, ontologies, and reasoning for video understanding. In: Bakker, E.M., Lew, M.S., Huang, T.S., Sebe, N., Zhou, X.S. (eds.) Image and Video Retrieval. LNCS, vol. 2728, pp. 248–259. Springer, Heidelberg (2003). doi:10.1007/3-540-45113-7_25 CrossRef Jaimes, A., Tseng, B.L., Smith, J.R.: Modal keywords, ontologies, and reasoning for video understanding. In: Bakker, E.M., Lew, M.S., Huang, T.S., Sebe, N., Zhou, X.S. (eds.) Image and Video Retrieval. LNCS, vol. 2728, pp. 248–259. Springer, Heidelberg (2003). doi:10.​1007/​3-540-45113-7_​25 CrossRef
9.
go back to reference Dasiopoulou, S., Heinecke, J., Saathoff, C., Strintzis, M.G.: Multimedia reasoning with natural language support. In: IEEE Sixth International Conference on Semantic Computing, pp. 413–420. IEEE (2007). doi:10.1109/ICSC.2007.28 Dasiopoulou, S., Heinecke, J., Saathoff, C., Strintzis, M.G.: Multimedia reasoning with natural language support. In: IEEE Sixth International Conference on Semantic Computing, pp. 413–420. IEEE (2007). doi:10.​1109/​ICSC.​2007.​28
10.
go back to reference D’Odorico, T., Bennett, B.: Automated reasoning on vague concepts using formal ontologies, with an application to event detection on video data. In: 11th International Symposium on Logical Formalizations of Commonsense Reasoning (COMMONSENSE 2013), Ayia Napa (2013) D’Odorico, T., Bennett, B.: Automated reasoning on vague concepts using formal ontologies, with an application to event detection on video data. In: 11th International Symposium on Logical Formalizations of Commonsense Reasoning (COMMONSENSE 2013), Ayia Napa (2013)
11.
go back to reference Ballan, L., Bertini, M., Del Bimbo, A., Serra, G.: Semantic annotation of soccer videos by visual instance clustering and spatial/temporal reasoning in ontologies. Multimedia Tools Appl. 48, 313–337 (2010). doi:10.1007/s11042-009-0342-4 CrossRef Ballan, L., Bertini, M., Del Bimbo, A., Serra, G.: Semantic annotation of soccer videos by visual instance clustering and spatial/temporal reasoning in ontologies. Multimedia Tools Appl. 48, 313–337 (2010). doi:10.​1007/​s11042-009-0342-4 CrossRef
12.
go back to reference Sikos, L.F., Powers, D.M.W.: Knowledge-driven video information retrieval with LOD: from semi-structured to structured video metadata. In: Eighth Workshop on Exploiting Semantic Annotations in Information Retrieval (ESAIR 2015), Melbourne (2015). doi:10.1145/2810133.2810141 Sikos, L.F., Powers, D.M.W.: Knowledge-driven video information retrieval with LOD: from semi-structured to structured video metadata. In: Eighth Workshop on Exploiting Semantic Annotations in Information Retrieval (ESAIR 2015), Melbourne (2015). doi:10.​1145/​2810133.​2810141
16.
go back to reference Hitzler, P., Krötzsch, M., Rudolph, S.: Foundations of Semantic Web Technologies. CRC Press, Boca Raton (2009) Hitzler, P., Krötzsch, M., Rudolph, S.: Foundations of Semantic Web Technologies. CRC Press, Boca Raton (2009)
17.
go back to reference Simou, N., Tzouvaras, V., Avrithis, Y., Stamou, G., Kollias, S.: A visual descriptor ontology for multimedia reasoning. In: 6th International Workshop on Image Analysis for Multimedia Interactive Services, Montreux (2005) Simou, N., Tzouvaras, V., Avrithis, Y., Stamou, G., Kollias, S.: A visual descriptor ontology for multimedia reasoning. In: 6th International Workshop on Image Analysis for Multimedia Interactive Services, Montreux (2005)
Metadata
Title
A Novel Approach to Multimedia Ontology Engineering for Automated Reasoning over Audiovisual LOD Datasets
Author
Leslie F. Sikos
Copyright Year
2016
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-662-49381-6_1

Premium Partner