Skip to main content

2017 | OriginalPaper | Buchkapitel

Random Walks Analysis on Graph Modelled Multimodal Collections

verfasst von : Serwah Sabetghadam, Mihai Lupu, Andreas Rauber

Erschienen in: Semantic Keyword-Based Search on Structured Data Sources

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nowadays, there is a proliferation of information objects from different modalities—Text, Image, Audio, Video. Different types of relations between information objects (e.g. similarity or semantic) has motivated graph-based search in multimodal Information Retrieval. In this paper, we formulate a Random Walks problem along our model for multimodal IR, that is robust over different distributions of modalities. We investigate query-dependent and query-independent Random Walks on our model. The results show that the query-dependent Random Walks provides higher precision value than query-independent Random Walks. We additionally investigate the contribution of the graph structure (quantified by the number and weights of incoming and outgoing links) to the final ranking in both types of Random Walks. We observed that query-dependent Random Walks is less dependent on the graph structure. The experiments are applied on a multimodal collection with about 400,000 documents and images.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Berber, T., Vahid, A.H., Ozturkmenoglu, O., Hamed, R.G., Alpkocak, A.: Demir at imageclefwiki 2011: evaluating different weighting schemes in information retrieval. In: CLEF (2011) Berber, T., Vahid, A.H., Ozturkmenoglu, O., Hamed, R.G., Alpkocak, A.: Demir at imageclefwiki 2011: evaluating different weighting schemes in information retrieval. In: CLEF (2011)
2.
Zurück zum Zitat Chib, S., Greenberg, E.: Understanding the metropolis-hastings algorithm. Am. Stat. 49(4), 327–335 (1995) Chib, S., Greenberg, E.: Understanding the metropolis-hastings algorithm. Am. Stat. 49(4), 327–335 (1995)
3.
Zurück zum Zitat Delbru, R., Toupikov, N., Catasta, M., Tummarello, G.: A node indexing scheme for web entity retrieval. In: Aroyo, L., Antoniou, G., Hyvönen, E., Teije, A., Stuckenschmidt, H., Cabral, L., Tudorache, T. (eds.) ESWC 2010. LNCS, vol. 6089, pp. 240–256. Springer, Heidelberg (2010). doi:10.1007/978-3-642-13489-0_17 CrossRef Delbru, R., Toupikov, N., Catasta, M., Tummarello, G.: A node indexing scheme for web entity retrieval. In: Aroyo, L., Antoniou, G., Hyvönen, E., Teije, A., Stuckenschmidt, H., Cabral, L., Tudorache, T. (eds.) ESWC 2010. LNCS, vol. 6089, pp. 240–256. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-13489-0_​17 CrossRef
4.
Zurück zum Zitat Duan, L., Li, W., Tsang, I.W., Xu, D.: Improving web image search by bag-based reranking. IEEE Trans. Image Process. 20(11), 3280–3290 (2011)MathSciNetCrossRef Duan, L., Li, W., Tsang, I.W., Xu, D.: Improving web image search by bag-based reranking. IEEE Trans. Image Process. 20(11), 3280–3290 (2011)MathSciNetCrossRef
5.
Zurück zum Zitat Elbassuoni, S., Blanco, R.: Keyword search over RDF graphs. In: CIKM (2011) Elbassuoni, S., Blanco, R.: Keyword search over RDF graphs. In: CIKM (2011)
6.
Zurück zum Zitat Fergus, R., Fei-Fei, L., Perona, P., Zisserman, A.: Learning object categories from google’s image search. In: Proceedings of International Conference on Computer Vision (2005) Fergus, R., Fei-Fei, L., Perona, P., Zisserman, A.: Learning object categories from google’s image search. In: Proceedings of International Conference on Computer Vision (2005)
7.
Zurück zum Zitat Hsu, W.H., Kennedy, L.S., Chang, S.-F.: Video search reranking through random walk over document-level context graph. In: MULTIMEDIA (2007) Hsu, W.H., Kennedy, L.S., Chang, S.-F.: Video search reranking through random walk over document-level context graph. In: MULTIMEDIA (2007)
8.
Zurück zum Zitat Jing, Y., Baluja, S.: Visualrank: applying pagerank to large-scale image search. IEEE Trans. Pattern Anal. Mach. Intell. 30(11), 1877–1890 (2008)CrossRef Jing, Y., Baluja, S.: Visualrank: applying pagerank to large-scale image search. IEEE Trans. Pattern Anal. Mach. Intell. 30(11), 1877–1890 (2008)CrossRef
9.
Zurück zum Zitat Kasneci, G., Suchanek, F., Ifrim, G., Ramanath, M., Weikum, G.: Naga: searching and ranking knowledge. In: ICDE (2008) Kasneci, G., Suchanek, F., Ifrim, G., Ramanath, M., Weikum, G.: Naga: searching and ranking knowledge. In: ICDE (2008)
10.
Zurück zum Zitat Liu, Y., Mei, T.: Optimizing visual search reranking via pairwise learning. IEEE Trans. Multimedia 13(2), 280–291 (2011)CrossRef Liu, Y., Mei, T.: Optimizing visual search reranking via pairwise learning. IEEE Trans. Multimedia 13(2), 280–291 (2011)CrossRef
11.
Zurück zum Zitat Martinet, J., Satoh, S.: An information theoretic approach for automatic document annotation from intermodal analysis. In: Workshop on Multimodal Information Retrieval (2007) Martinet, J., Satoh, S.: An information theoretic approach for automatic document annotation from intermodal analysis. In: Workshop on Multimodal Information Retrieval (2007)
12.
Zurück zum Zitat Donald, K.M., Smeaton, A.F.: A comparison of score, rank and probability-based fusion methods for video shot retrieval. In: Leow, W.-K., Lew, M.S., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 61–70. Springer, Heidelberg (2005). doi:10.1007/11526346_10 CrossRef Donald, K.M., Smeaton, A.F.: A comparison of score, rank and probability-based fusion methods for video shot retrieval. In: Leow, W.-K., Lew, M.S., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 61–70. Springer, Heidelberg (2005). doi:10.​1007/​11526346_​10 CrossRef
13.
Zurück zum Zitat Mei, T., Rui, Y., Li, S., Tian, Q.: Multimedia search reranking: a literature survey. ACM Comput. Surv. (CSUR) 46(3), 38 (2014)CrossRef Mei, T., Rui, Y., Li, S., Tian, Q.: Multimedia search reranking: a literature survey. ACM Comput. Surv. (CSUR) 46(3), 38 (2014)CrossRef
14.
Zurück zum Zitat Minack, E., Paiu, R., Costache, S., Demartini, G., Gaugaz, J., Ioannou, E., Chirita, P.-A., Nejdl, W.: Leveraging personal metadata for desktop search: the beagle++ system. J. Web Semant. Sci. Serv. Agents WWW 8(1), 37–54 (2010)CrossRef Minack, E., Paiu, R., Costache, S., Demartini, G., Gaugaz, J., Ioannou, E., Chirita, P.-A., Nejdl, W.: Leveraging personal metadata for desktop search: the beagle++ system. J. Web Semant. Sci. Serv. Agents WWW 8(1), 37–54 (2010)CrossRef
15.
Zurück zum Zitat Minkov, E., Cohen, W.W., Ng, A.Y.: Contextual search and name disambiguation in email using graphs. In: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 27–34 (2006) Minkov, E., Cohen, W.W., Ng, A.Y.: Contextual search and name disambiguation in email using graphs. In: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 27–34 (2006)
16.
Zurück zum Zitat Rocha, C., Schwabe, D., Aragao, M.P.: A hybrid approach for searching in the semantic web. In: WWW (2004) Rocha, C., Schwabe, D., Aragao, M.P.: A hybrid approach for searching in the semantic web. In: WWW (2004)
17.
Zurück zum Zitat Sabetghadam, S., Lupu, M., Rauber, A.: Astera - a generic model for multimodal information retrieval. In: Proceedings of Integrating IR Technologies for Professional Search Workshop (2013) Sabetghadam, S., Lupu, M., Rauber, A.: Astera - a generic model for multimodal information retrieval. In: Proceedings of Integrating IR Technologies for Professional Search Workshop (2013)
18.
Zurück zum Zitat Sabetghadam, S., Lupu, M., Rauber, A.: A combined approach of structured and non-structured IR in multimodal domain. In: ICMR (2014) Sabetghadam, S., Lupu, M., Rauber, A.: A combined approach of structured and non-structured IR in multimodal domain. In: ICMR (2014)
19.
Zurück zum Zitat Sabetghadam, S., Bierig, R., Rauber, A.: A hybrid approach for multi-faceted IR in multimodal domain. In: Kanoulas, E., Lupu, M., Clough, P., Sanderson, M., Hall, M., Hanbury, A., Toms, E. (eds.) CLEF 2014. LNCS, vol. 8685, pp. 86–97. Springer, Heidelberg (2014). doi:10.1007/978-3-319-11382-1_9 CrossRef Sabetghadam, S., Bierig, R., Rauber, A.: A hybrid approach for multi-faceted IR in multimodal domain. In: Kanoulas, E., Lupu, M., Clough, P., Sanderson, M., Hall, M., Hanbury, A., Toms, E. (eds.) CLEF 2014. LNCS, vol. 8685, pp. 86–97. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-11382-1_​9 CrossRef
20.
Zurück zum Zitat Sabetghadam, S., Lupu, M., Rauber, A.: Leveraging metropolis-hastings algorithm on graph-based model for multimodal IR. In: GSB 2015: First International Workshop on Graph Search and Beyond (2015) Sabetghadam, S., Lupu, M., Rauber, A.: Leveraging metropolis-hastings algorithm on graph-based model for multimodal IR. In: GSB 2015: First International Workshop on Graph Search and Beyond (2015)
21.
Zurück zum Zitat Tiddi, I., dAquin, M., Motta, E.: Walking linked data: a graph traversal approach to explain clusters. In: Proceedings of the Fifth International Workshop on Consuming Linked Data, COLD (2014) Tiddi, I., dAquin, M., Motta, E.: Walking linked data: a graph traversal approach to explain clusters. In: Proceedings of the Fifth International Workshop on Consuming Linked Data, COLD (2014)
22.
Zurück zum Zitat Tonon, A., Demartini, G., Cudré-Mauroux, P.: Combining inverted indices and structured search for ad-hoc object retrieval. In: SIGIR (2012) Tonon, A., Demartini, G., Cudré-Mauroux, P.: Combining inverted indices and structured search for ad-hoc object retrieval. In: SIGIR (2012)
23.
Zurück zum Zitat Walsh, B.: Markov Chain Monte Carlo and Gibbs sampling (2004) Walsh, B.: Markov Chain Monte Carlo and Gibbs sampling (2004)
24.
Zurück zum Zitat Wang, M., Li, H., Tao, D., Lu, K., Wu, X.: Multimodal graph-based reranking for web image search. IEEE Trans. Image Process. 21(11), 4649–4661 (2012)MathSciNetCrossRef Wang, M., Li, H., Tao, D., Lu, K., Wu, X.: Multimodal graph-based reranking for web image search. IEEE Trans. Image Process. 21(11), 4649–4661 (2012)MathSciNetCrossRef
25.
Zurück zum Zitat Yao, T., Mei, T., Ngo, C.-W.: Co-reranking by mutual reinforcement for image search. In: CIVR (2010) Yao, T., Mei, T., Ngo, C.-W.: Co-reranking by mutual reinforcement for image search. In: CIVR (2010)
Metadaten
Titel
Random Walks Analysis on Graph Modelled Multimodal Collections
verfasst von
Serwah Sabetghadam
Mihai Lupu
Andreas Rauber
Copyright-Jahr
2017
Verlag
Springer International Publishing
DOI
https://doi.org/10.1007/978-3-319-53640-8_7

Neuer Inhalt