Skip to main content
Top

2019 | OriginalPaper | Chapter

Integration of Exploration and Search: A Case Study of the M\(^3\) Model

Authors : Snorri Gíslason, Björn Þór Jónsson, Laurent Amsaleg

Published in: MultiMedia Modeling

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Effective support for multimedia analytics applications requires exploration and search to be integrated seamlessly into a single interaction model. Media metadata can be seen as defining a multidimensional media space, casting multimedia analytics tasks as exploration, manipulation and augmentation of that space. We present an initial case study of integrating exploration and search within this multidimensional media space. We extend the M\(^3\) model, initially proposed as a pure exploration tool, and show that it can be elegantly extended to allow searching within an exploration context and exploring within a search context. We then evaluate the suitability of relational database management systems, as representatives of today’s data management technologies, for implementing the extended M\(^3\) model. Based on our results, we finally propose some research directions for scalability of multimedia analytics.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Arigon, A.M., Miquel, M., Tchounikine, A.: Multimedia data warehouses: a multiversion model and a medical application. Multi. Tools Apps. 35(1), 91–108 (2007)CrossRef Arigon, A.M., Miquel, M., Tchounikine, A.: Multimedia data warehouses: a multiversion model and a medical application. Multi. Tools Apps. 35(1), 91–108 (2007)CrossRef
2.
go back to reference Babenko, A., Lempitsky, V.S.: The inverted multi-index. IEEE Trans. Pattern Anal. Mach. Intell. 37(6), 1247–1260 (2015)CrossRef Babenko, A., Lempitsky, V.S.: The inverted multi-index. IEEE Trans. Pattern Anal. Mach. Intell. 37(6), 1247–1260 (2015)CrossRef
3.
go back to reference Bartolini, I., Ciaccia, P.: Integrating semantic and visual facets for browsing digital photo collections. In: Proceedings of SEBD (2009) Bartolini, I., Ciaccia, P.: Integrating semantic and visual facets for browsing digital photo collections. In: Proceedings of SEBD (2009)
4.
go back to reference Diao, M., Mukherjea, S., Rajput, N., Srivastava, K.: Faceted search and browsing of audio content on spoken web. In: Proceedings of CIKM (2010) Diao, M., Mukherjea, S., Rajput, N., Srivastava, K.: Faceted search and browsing of audio content on spoken web. In: Proceedings of CIKM (2010)
5.
go back to reference Guðmundsson, G.Þ., Amsaleg, L., Jónsson, B.Þ., Franklin, M.J.: Towards engineering a web-scale multimedia service: a case study using Spark. In: Proceedings of MMSys, Taipei, Taiwan (2017) Guðmundsson, G.Þ., Amsaleg, L., Jónsson, B.Þ., Franklin, M.J.: Towards engineering a web-scale multimedia service: a case study using Spark. In: Proceedings of MMSys, Taipei, Taiwan (2017)
6.
go back to reference Jégou, H., Tavenard, R., Douze, M., Amsaleg, L.: Searching in one billion vectors: re-rank with source coding. In: Proceedings of ICASSP, Prague, Czech Republic (2011) Jégou, H., Tavenard, R., Douze, M., Amsaleg, L.: Searching in one billion vectors: re-rank with source coding. In: Proceedings of ICASSP, Prague, Czech Republic (2011)
7.
go back to reference Jin, X., Han, J., Cao, L., Luo, J., Ding, B., Lin, C.X.: Visual cube and on-line analytical processing of images. In: Proceedings of CIKM (2010) Jin, X., Han, J., Cao, L., Luo, J., Ding, B., Lin, C.X.: Visual cube and on-line analytical processing of images. In: Proceedings of CIKM (2010)
9.
go back to reference Jónsson, B.Þ., Tómasson, G., Sigurþórsson, H., Eiríksdóttir, Á., Amsaleg, L., Lárusdóttir, M.K.: A multi-dimensional data model for personal photo browsing. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015. LNCS, vol. 8936, pp. 345–356. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-14442-9_41CrossRef Jónsson, B.Þ., Tómasson, G., Sigurþórsson, H., Eiríksdóttir, Á., Amsaleg, L., Lárusdóttir, M.K.: A multi-dimensional data model for personal photo browsing. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015. LNCS, vol. 8936, pp. 345–356. Springer, Cham (2015). https://​doi.​org/​10.​1007/​978-3-319-14442-9_​41CrossRef
10.
go back to reference Shneiderman, B., Bederson, B.B., Drucker, S.M.: Find that photo! interface strategies to annotate, browse, and share. Commun. ACM 49(4), 69–71 (2006)CrossRef Shneiderman, B., Bederson, B.B., Drucker, S.M.: Find that photo! interface strategies to annotate, browse, and share. Commun. ACM 49(4), 69–71 (2006)CrossRef
11.
go back to reference Worring, M., Koelma, D.C.: Insight in image collections by multimedia pivot tables. In: Proceedings of ACM ICMR, Shanghai, China (2015) Worring, M., Koelma, D.C.: Insight in image collections by multimedia pivot tables. In: Proceedings of ACM ICMR, Shanghai, China (2015)
12.
go back to reference Yee, K.P., Swearingen, K., Li, K., Hearst, M.: Faceted metadata for image search and browsing. In: Proceedings of CHI (2003) Yee, K.P., Swearingen, K., Li, K., Hearst, M.: Faceted metadata for image search and browsing. In: Proceedings of CHI (2003)
13.
go back to reference Zahálka, J., Rudinac, S., Jónsson, B.Þ., Koelma, D.C., Worring, M., : Blackthorn: large-scale interactive multimodal learning. IEEE Trans. Multi. 20(3), 687–698 (2018)CrossRef Zahálka, J., Rudinac, S., Jónsson, B.Þ., Koelma, D.C., Worring, M., : Blackthorn: large-scale interactive multimodal learning. IEEE Trans. Multi. 20(3), 687–698 (2018)CrossRef
14.
go back to reference Zahálka, J., Worring, M.: Towards interactive, intelligent, and integrated multimedia analytics. In: Proceedings of IEEE VAST, Paris, France (2014) Zahálka, J., Worring, M.: Towards interactive, intelligent, and integrated multimedia analytics. In: Proceedings of IEEE VAST, Paris, France (2014)
15.
go back to reference Zaïane, O.R., Han, J., Li, Z.N., Hou, J.: Mining multimedia data. In: Proceedings of CASCON (1998) Zaïane, O.R., Han, J., Li, Z.N., Hou, J.: Mining multimedia data. In: Proceedings of CASCON (1998)
Metadata
Title
Integration of Exploration and Search: A Case Study of the M Model
Authors
Snorri Gíslason
Björn Þór Jónsson
Laurent Amsaleg
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-05710-7_13