Skip to main content

2011 | OriginalPaper | Buchkapitel

11. Interactive Image Retrieval

verfasst von : Dr. Alejandro Héctor Toselli, Dr. Enrique Vidal, Prof. Francisco Casacuberta

Erschienen in: Multimodal Interactive Pattern Recognition and Applications

Verlag: Springer London

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter presents search methods for image retrieval which are boosted using the user’s supervision by means of the human–computer interaction methodology. Two contributions are presented which cover different aspects of this problem.
The first one deals with classical relevance feedback, content-based image retrieval, but with a formulation directly derived from the IPR paradigm adopted throughout this book. This formulation helps putting forward the improving role of “consistency” among the retrieved images. The second contribution considers the use of a complementary text-based “modality” to express the user relevance feedback information, which leads to improved retrieval results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Since H′ can be the result of several interaction steps, the total number of supervised images, m, can be greater than the number of images retrieved in each interaction step, n.
 
2
We recall that only the notation Pr () stands for true probabilities; here we abuse the notation by letting P() denote arbitrary functions used as models.
 
Literatur
1.
Zurück zum Zitat Deselaers, T., Keysers, D., & Ney, H. (2008). Features for image retrieval: an experimental comparison. Information Retrieval, 11(2), 77–107. CrossRef Deselaers, T., Keysers, D., & Ney, H. (2008). Features for image retrieval: an experimental comparison. Information Retrieval, 11(2), 77–107. CrossRef
2.
Zurück zum Zitat Duda, R., & Hart, P. (1973). Pattern recognition and scene analysis. New York: Wiley. Duda, R., & Hart, P. (1973). Pattern recognition and scene analysis. New York: Wiley.
3.
Zurück zum Zitat Escalante, H. J., Hérnadez, C. A., Sucar, L. E., & Montes, M. (2008). Late fusion of heterogeneous methods for multimedia image retrieval. In MIR’08: Proceeding of the 1st ACM international conference on multimedia information retrieval (pp. 172–179), New York, NY, USA. New York: ACM. CrossRef Escalante, H. J., Hérnadez, C. A., Sucar, L. E., & Montes, M. (2008). Late fusion of heterogeneous methods for multimedia image retrieval. In MIR’08: Proceeding of the 1st ACM international conference on multimedia information retrieval (pp. 172–179), New York, NY, USA. New York: ACM. CrossRef
4.
Zurück zum Zitat Faloutsos, C., Barber, R., Flickner, M., Hafner, J., Niblack, W., Petkovic, D., & Equitz, W. (1994). Efficient and effective querying by image content. Journal of Intelligent Information Systems, 3(3/4), 231–262. CrossRef Faloutsos, C., Barber, R., Flickner, M., Hafner, J., Niblack, W., Petkovic, D., & Equitz, W. (1994). Efficient and effective querying by image content. Journal of Intelligent Information Systems, 3(3/4), 231–262. CrossRef
5.
Zurück zum Zitat Giacinto, G., & Rolli, F. (2004). Instance-based relevance feedback for image retrieval. In Neural information processing systems (NIPS), Vancouver, Canada. Giacinto, G., & Rolli, F. (2004). Instance-based relevance feedback for image retrieval. In Neural information processing systems (NIPS), Vancouver, Canada.
6.
Zurück zum Zitat Jin, H., Tao, W., & Sun, A. (2008). Vast: Automatically combining keywords and visual features for web image retrieval. International Conference on Advanced Communication Technology, 3, 2188–2193. Jin, H., Tao, W., & Sun, A. (2008). Vast: Automatically combining keywords and visual features for web image retrieval. International Conference on Advanced Communication Technology, 3, 2188–2193.
7.
Zurück zum Zitat Lacoste, C., Chevallet, J. q. P., Lim, J. q. H., Le, D. T. H., Xiong, W., Racoceanu, D., Teodorescu, R., & Vuillemenot, N. (2006). Inter-media concept-based medical image indexing and retrieval with umls at ipal. In CLEF (pp. 694–701). Lacoste, C., Chevallet, J. q. P., Lim, J. q. H., Le, D. T. H., Xiong, W., Racoceanu, D., Teodorescu, R., & Vuillemenot, N. (2006). Inter-media concept-based medical image indexing and retrieval with umls at ipal. In CLEF (pp. 694–701).
8.
Zurück zum Zitat Moënne-Loccoz, N., Bruno, E., & Marchand-Maillet, S. (2005). Interactive retrieval of video sequences from local feature dynamics. In Proceedings of the 3rd international workshop on adaptive multimedia retrieval, AMR’05, Glasgow, UK. Moënne-Loccoz, N., Bruno, E., & Marchand-Maillet, S. (2005). Interactive retrieval of video sequences from local feature dynamics. In Proceedings of the 3rd international workshop on adaptive multimedia retrieval, AMR’05, Glasgow, UK.
9.
Zurück zum Zitat Müller, H., Müller, W., Marchand-Maillet, S., & Squire, D. M. (2000). Strategies for positive and negative relevance feedback in image retrieval. In A. Sanfeliu, J. J. Villanueva, M. Vanrell, R. Alquezar, J. q. O. Eklundh & Y. Aloimonos (Eds.), Computer vision and image analysis: Vol. 1. Proceedings of the international conference on pattern recognition (ICPR’2000) (pp. 1043–1046), Barcelona, Spain. Müller, H., Müller, W., Marchand-Maillet, S., & Squire, D. M. (2000). Strategies for positive and negative relevance feedback in image retrieval. In A. Sanfeliu, J. J. Villanueva, M. Vanrell, R. Alquezar, J. q. O. Eklundh & Y. Aloimonos (Eds.), Computer vision and image analysis: Vol. 1. Proceedings of the international conference on pattern recognition (ICPR’2000) (pp. 1043–1046), Barcelona, Spain.
10.
Zurück zum Zitat Paredes, R., Deselaers, T., & Vidal, E. (2008). A probabilistic model for user relevance feedback on image retrieval. In Proceedings of the 5th international workshop on machine learning for multimodal interaction, MLMI’08 (pp. 260–271). Berlin: Springer. CrossRef Paredes, R., Deselaers, T., & Vidal, E. (2008). A probabilistic model for user relevance feedback on image retrieval. In Proceedings of the 5th international workshop on machine learning for multimodal interaction, MLMI’08 (pp. 260–271). Berlin: Springer. CrossRef
11.
Zurück zum Zitat Rocchio, J. J. (1971). Relevance feedback in information retrieval. In G. Salton (Ed.), The SMART retrieval system: experiments in automatic document processing (pp. 313–323). New York: Prentice-Hall. Rocchio, J. J. (1971). Relevance feedback in information retrieval. In G. Salton (Ed.), The SMART retrieval system: experiments in automatic document processing (pp. 313–323). New York: Prentice-Hall.
12.
Zurück zum Zitat Rooij, O. d., Snoek, C. G. M., & Worring, M. (2007). Query on demand video browsing. In ACM int. conf. on multimedia (pp. 811–814), Augsburg, Germany. Rooij, O. d., Snoek, C. G. M., & Worring, M. (2007). Query on demand video browsing. In ACM int. conf. on multimedia (pp. 811–814), Augsburg, Germany.
13.
Zurück zum Zitat Setia, L., Ick, J., & Burkhardt, H. (2005). Svm-based relevance feedback in image retrieval using invariant feature histograms. In IAPR workshop on machine vision applications (MVA), Tsukuba Science City, Japan. Setia, L., Ick, J., & Burkhardt, H. (2005). Svm-based relevance feedback in image retrieval using invariant feature histograms. In IAPR workshop on machine vision applications (MVA), Tsukuba Science City, Japan.
14.
Zurück zum Zitat Smeulders, A. W. M., Worring, M., Santini, S., Gupta, A., & Jain, R. (2000). Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12), 1349–1380. CrossRef Smeulders, A. W. M., Worring, M., Santini, S., Gupta, A., & Jain, R. (2000). Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12), 1349–1380. CrossRef
15.
Zurück zum Zitat Smith, J. R., & Chang, S. q. F. (1996). Tools and techniques for color image retrieval. In SPIE storage and retrieval for image and video databases (Vol. 2670, pp. 426–437). Smith, J. R., & Chang, S. q. F. (1996). Tools and techniques for color image retrieval. In SPIE storage and retrieval for image and video databases (Vol. 2670, pp. 426–437).
16.
Zurück zum Zitat Swain, M. J., & Ballard, D. H. (1991). Color indexing. International Journal of Computer Vision, 7(1), 11–32. CrossRef Swain, M. J., & Ballard, D. H. (1991). Color indexing. International Journal of Computer Vision, 7(1), 11–32. CrossRef
17.
Zurück zum Zitat Tamura, H., Mori, S., & Yamawaki, T. (1978). Textural features corresponding to visual perception. IEEE Transactions on Systems, Man, and Cybernetics, 8(6), 460–472. CrossRef Tamura, H., Mori, S., & Yamawaki, T. (1978). Textural features corresponding to visual perception. IEEE Transactions on Systems, Man, and Cybernetics, 8(6), 460–472. CrossRef
18.
Zurück zum Zitat Vasconcelos, N., & Lippman, A. (1998). Bayesian modeling of video editing and structure: Semantic features for video summarization and browsing. In ICIP (pp. 153–157), Chicago, IL, USA. Vasconcelos, N., & Lippman, A. (1998). Bayesian modeling of video editing and structure: Semantic features for video summarization and browsing. In ICIP (pp. 153–157), Chicago, IL, USA.
19.
Zurück zum Zitat Vidal, E., Rodríguez, L., Casacuberta, F., & García-Varea, I. (2007). Interactive pattern recognition. In LNCS: Vol. 4892. Proceedings of the 4th joint workshop on multimodal interaction and related machine learning algorithms (pp. 60–71), Brno, Czech Republic. CrossRef Vidal, E., Rodríguez, L., Casacuberta, F., & García-Varea, I. (2007). Interactive pattern recognition. In LNCS: Vol. 4892. Proceedings of the 4th joint workshop on multimodal interaction and related machine learning algorithms (pp. 60–71), Brno, Czech Republic. CrossRef
20.
Zurück zum Zitat Zhou, X. S., & Huang, T. S. (2003). Relevance feedback in image retrieval: A comprehensive review. Multimedia Systems, 8, 536–544. CrossRef Zhou, X. S., & Huang, T. S. (2003). Relevance feedback in image retrieval: A comprehensive review. Multimedia Systems, 8, 536–544. CrossRef
Metadaten
Titel
Interactive Image Retrieval
verfasst von
Dr. Alejandro Héctor Toselli
Dr. Enrique Vidal
Prof. Francisco Casacuberta
Copyright-Jahr
2011
Verlag
Springer London
DOI
https://doi.org/10.1007/978-0-85729-479-1_11

Neuer Inhalt