Skip to main content
Erschienen in: International Journal of Multimedia Information Retrieval 3/2016

01.09.2016 | Regular Paper

Image recommendation based on keyword relevance using absorbing Markov chain and image features

verfasst von: D. Sejal, V. Rashmi, K. R. Venugopal, S. S. Iyengar, L. M. Patnaik

Erschienen in: International Journal of Multimedia Information Retrieval | Ausgabe 3/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Image recommendation is an important feature of search engine, as tremendous amount of images are available online. It is necessary to retrieve relevant images to meet the user’s requirement. In this paper, we present an algorithm image recommendation with absorbing Markov chain (IRAbMC) to retrieve relevant images for a user’s input query. Images are ranked by calculating keyword relevance probability between annotated keywords from log and keywords of user input query. Keyword relevance is computed using absorbing Markov chain. Images are reranked using image visual features. Experimental results show that the IRAbMC algorithm outperforms Markovian semantic indexing (MSI) method with improved relevance score of retrieved ranked images.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Akbas E, Vural FTY (2007) Automatic image annotation by ensemble of visual descriptors. In: CVPR’07: the proceedings of IEEE conference on computer vision and pattern recognition, pp 1–8 Akbas E, Vural FTY (2007) Automatic image annotation by ensemble of visual descriptors. In: CVPR’07: the proceedings of IEEE conference on computer vision and pattern recognition, pp 1–8
2.
Zurück zum Zitat Bartolini I, Ciaccia P (2010) Multi-dimensional keyword-based image annotation and search. In: The Proceedings of the 2nd international workshop on keyword search on structured data, pp 5–10 Bartolini I, Ciaccia P (2010) Multi-dimensional keyword-based image annotation and search. In: The Proceedings of the 2nd international workshop on keyword search on structured data, pp 5–10
3.
Zurück zum Zitat Wang C, Jing F, Zhang L, Zhang H-J (2007) Content-based image annotation refinement. In: CVPR’07: the proceedings of IEEE conference on computer vision and pattern recognition, pp 1–8 Wang C, Jing F, Zhang L, Zhang H-J (2007) Content-based image annotation refinement. In: CVPR’07: the proceedings of IEEE conference on computer vision and pattern recognition, pp 1–8
4.
Zurück zum Zitat Li J, Wang JZ (2008) Real-time computerized annotation of pictures. IEEE Trans Pattern Anal Mach Intell 30(6):985–1002CrossRef Li J, Wang JZ (2008) Real-time computerized annotation of pictures. IEEE Trans Pattern Anal Mach Intell 30(6):985–1002CrossRef
5.
Zurück zum Zitat Makadia A, Pavlovic V, Kumar S (2008) A new baseline for image annotation. Comput Vis ECCV 2008:316–329 Makadia A, Pavlovic V, Kumar S (2008) A new baseline for image annotation. Comput Vis ECCV 2008:316–329
6.
Zurück zum Zitat Verma Y, Jawahar CV (2012) Image annotation using metric learning in semantic neighbourhoods. Comput Vis ECCV 2012:836–849 Verma Y, Jawahar CV (2012) Image annotation using metric learning in semantic neighbourhoods. Comput Vis ECCV 2012:836–849
7.
Zurück zum Zitat Wang C, Blei D, Li F-F (2009) Simultaneous image classification and annotation. In: CVPR 2009: the proceedings of IEEE conference on computer vision and pattern recognition, pp 1903–1910 Wang C, Blei D, Li F-F (2009) Simultaneous image classification and annotation. In: CVPR 2009: the proceedings of IEEE conference on computer vision and pattern recognition, pp 1903–1910
8.
Zurück zum Zitat Guillaumin M, Mensink T, Verbeek J, Schmid C (2009) Tagprop: discriminative metric learning in nearest neighbor models for image auto-annotation. In: The proceedings of IEEE \(12^{th}\) international conference on computer vision, pp 309–316 Guillaumin M, Mensink T, Verbeek J, Schmid C (2009) Tagprop: discriminative metric learning in nearest neighbor models for image auto-annotation. In: The proceedings of IEEE \(12^{th}\) international conference on computer vision, pp 309–316
9.
Zurück zum Zitat Stevenson K, Leung C (2005) Comparative evaluation of web image search engines for multimedia applications. In: ICME 2005: the proceedings of IEEE international conference on multimedia and expo, pp 4–14 Stevenson K, Leung C (2005) Comparative evaluation of web image search engines for multimedia applications. In: ICME 2005: the proceedings of IEEE international conference on multimedia and expo, pp 4–14
10.
Zurück zum Zitat Smyth B (2007) A community-based approach to personalizing web search. IEEE J Comput 40(8):42–50CrossRef Smyth B (2007) A community-based approach to personalizing web search. IEEE J Comput 40(8):42–50CrossRef
11.
Zurück zum Zitat He X, Cai D, Han J (2008) Learning a maximum margin subspace for image retrieval. IEEE Trans Knowl Data Eng 20(2):189–201CrossRef He X, Cai D, Han J (2008) Learning a maximum margin subspace for image retrieval. IEEE Trans Knowl Data Eng 20(2):189–201CrossRef
12.
Zurück zum Zitat Gao Y, Peng J, Luo H, Keim DA, Fan J (2009) An interactive approach for filtering out junk images from keyword-based google search results. IEEE Trans Circuits Syst Video Technol 19(12):1851–1865CrossRef Gao Y, Peng J, Luo H, Keim DA, Fan J (2009) An interactive approach for filtering out junk images from keyword-based google search results. IEEE Trans Circuits Syst Video Technol 19(12):1851–1865CrossRef
13.
Zurück zum Zitat Liu D, Hua KA, Vu K, Yu N (2009) Fast query point movement techniques for large CBIR systems. IEEE Trans Knowl Data Eng 21(5):729–743CrossRef Liu D, Hua KA, Vu K, Yu N (2009) Fast query point movement techniques for large CBIR systems. IEEE Trans Knowl Data Eng 21(5):729–743CrossRef
14.
Zurück zum Zitat Rahman MdM, Antani SK, Thoma GR (2011) A learning-based similarity fusion and filtering approach for biomedical image retrieval using SVM classification and relevance feedback. IEEE Trans Inf Technol Biomed 15(4):640–646CrossRef Rahman MdM, Antani SK, Thoma GR (2011) A learning-based similarity fusion and filtering approach for biomedical image retrieval using SVM classification and relevance feedback. IEEE Trans Inf Technol Biomed 15(4):640–646CrossRef
15.
Zurück zum Zitat Cheng E, Jing F, Zhang L (2009) A unified relevance feedback framework for web image retrieval. IEEE Trans Image Process 18(6):1350–1357MathSciNetCrossRef Cheng E, Jing F, Zhang L (2009) A unified relevance feedback framework for web image retrieval. IEEE Trans Image Process 18(6):1350–1357MathSciNetCrossRef
16.
Zurück zum Zitat Kekre HB, Thepade SD, Mukherjee P, Wadhwa S, Kakaiya M, Singh S (2010) Image retrieval with shape features extracted using gradient operators and slope magnitude technique with BTC. Int J Comput Appl 6(8):28–33 Kekre HB, Thepade SD, Mukherjee P, Wadhwa S, Kakaiya M, Singh S (2010) Image retrieval with shape features extracted using gradient operators and slope magnitude technique with BTC. Int J Comput Appl 6(8):28–33
17.
Zurück zum Zitat Guo J-M, Prasetyo H (2015) Content based image retrieval using features extracted from halftoning-based block truncation coding. IEEE Trans Image Process 24(3):1010–1024MathSciNetCrossRef Guo J-M, Prasetyo H (2015) Content based image retrieval using features extracted from halftoning-based block truncation coding. IEEE Trans Image Process 24(3):1010–1024MathSciNetCrossRef
18.
Zurück zum Zitat Hofmann T (2001) Unsupervised learning by probabilistic latent semantic analysis. J Mach Learn 42(2):177–196CrossRefMATH Hofmann T (2001) Unsupervised learning by probabilistic latent semantic analysis. J Mach Learn 42(2):177–196CrossRefMATH
19.
Zurück zum Zitat Li Z, Tang Z, Zhao W, Li Z (2012) Combining generative/discriminative learning for automatic image annotation and retrieval. Int J Intell Sci 2(3):55–62CrossRef Li Z, Tang Z, Zhao W, Li Z (2012) Combining generative/discriminative learning for automatic image annotation and retrieval. Int J Intell Sci 2(3):55–62CrossRef
20.
Zurück zum Zitat Fan J, Gao Y, Luo H (2008) Integrating concept ontology and multitask learning to achieve more effective classifier training for multilevel image annotation. IEEE Trans Image Process 17(3):407–426MathSciNetCrossRef Fan J, Gao Y, Luo H (2008) Integrating concept ontology and multitask learning to achieve more effective classifier training for multilevel image annotation. IEEE Trans Image Process 17(3):407–426MathSciNetCrossRef
21.
Zurück zum Zitat Vompras J, Scholz T, Conrad S (2008) Extracting contextual information from multiuser systems for improving annotation-based retrieval of image data. In: The proceedings of the 1st ACM international conference on multimedia information retrieval, pp 149–155 Vompras J, Scholz T, Conrad S (2008) Extracting contextual information from multiuser systems for improving annotation-based retrieval of image data. In: The proceedings of the 1st ACM international conference on multimedia information retrieval, pp 149–155
22.
Zurück zum Zitat OSullivan D, Wilson DC, Bertolotto M (2011) Task-based annotation and retrieval for image information management. Multimed Tools Appl 54(2):473–497CrossRef OSullivan D, Wilson DC, Bertolotto M (2011) Task-based annotation and retrieval for image information management. Multimed Tools Appl 54(2):473–497CrossRef
23.
Zurück zum Zitat Deniz Kılınç, Adil Alpkocak (2011) An expansion and reranking approach for annotation-based image retrieval from web. J Expert Syst Appl 38(10):13121–13127CrossRef Deniz Kılınç, Adil Alpkocak (2011) An expansion and reranking approach for annotation-based image retrieval from web. J Expert Syst Appl 38(10):13121–13127CrossRef
24.
Zurück zum Zitat Wang X-J, Zhang L, Ma W-Y (2012) Duplicate search based image annotation using web scale data. IEEE J Electr Eng 100(9):2705–2721MathSciNet Wang X-J, Zhang L, Ma W-Y (2012) Duplicate search based image annotation using web scale data. IEEE J Electr Eng 100(9):2705–2721MathSciNet
25.
Zurück zum Zitat Riad A, Elminir H, Abd-Elghany S (2012) Web image retrieval search engine based on semantically shared annotation. Int J Comput Sci Issues 9(3):223–228 Riad A, Elminir H, Abd-Elghany S (2012) Web image retrieval search engine based on semantically shared annotation. Int J Comput Sci Issues 9(3):223–228
26.
Zurück zum Zitat Krishna AN, Prasad BG (2012) Automated image annotation for semantic indexing and retrieval of medical images. Int J Comput Appl 55(3):26–33 Krishna AN, Prasad BG (2012) Automated image annotation for semantic indexing and retrieval of medical images. Int J Comput Appl 55(3):26–33
27.
Zurück zum Zitat Ayadi MG, Bouslimi R, Akaichi J (2013) A new CBIR approach for the annotation of medical images. Int J Comput Appl 73(6):34–45 Ayadi MG, Bouslimi R, Akaichi J (2013) A new CBIR approach for the annotation of medical images. Int J Comput Appl 73(6):34–45
28.
Zurück zum Zitat Zhang D, Islam MdM, Lu G (2013) Structural image retrieval using automatic image annotation and region based inverted file. J Visual Commun Image Represent 24(7):1087–1098CrossRef Zhang D, Islam MdM, Lu G (2013) Structural image retrieval using automatic image annotation and region based inverted file. J Visual Commun Image Represent 24(7):1087–1098CrossRef
29.
Zurück zum Zitat Sang J, Changsheng X, Dongyuan L (2012) Learn to personalized image search from the photo sharing websites. IEEE Trans Multimed 14(4):963–974CrossRef Sang J, Changsheng X, Dongyuan L (2012) Learn to personalized image search from the photo sharing websites. IEEE Trans Multimed 14(4):963–974CrossRef
30.
Zurück zum Zitat Li L-J, Fei-Fei L (2010) Optimol: automatic online picture collection via incremental model learning. Int J Comput Vis 88(2):147–168CrossRef Li L-J, Fei-Fei L (2010) Optimol: automatic online picture collection via incremental model learning. Int J Comput Vis 88(2):147–168CrossRef
31.
Zurück zum Zitat Pham T-T, Maillot NE, Lim J-H, Chevallet J-P (2007) Latent semantic fusion model for image retrieval and annotation. In: The proceedings of the sixteenth ACM conference on information and knowledge management, pp 439–444 Pham T-T, Maillot NE, Lim J-H, Chevallet J-P (2007) Latent semantic fusion model for image retrieval and annotation. In: The proceedings of the sixteenth ACM conference on information and knowledge management, pp 439–444
32.
Zurück zum Zitat Song H, Li X, Wang P (2009) Multimodal image retrieval based on annotation keywords and visual content. In: CASE 2009: the proceedings of IEEE international conference on control, automation and systems engineering, pp 295–298 Song H, Li X, Wang P (2009) Multimodal image retrieval based on annotation keywords and visual content. In: CASE 2009: the proceedings of IEEE international conference on control, automation and systems engineering, pp 295–298
33.
Zurück zum Zitat Winston WL, Goldberg JB (2004) Operations research: applications and algorithms, vol 3. Duxbury press Belmont, CA, p 1440 Winston WL, Goldberg JB (2004) Operations research: applications and algorithms, vol 3. Duxbury press Belmont, CA, p 1440
34.
Zurück zum Zitat Raftopoulos KA, Ntalianis KS, Sourlas DD, Kollias SD (2013) Mining user queries with Markov chains: application to online image retrieval. IEEE Trans Knowl Data Eng 25(2):433–447CrossRef Raftopoulos KA, Ntalianis KS, Sourlas DD, Kollias SD (2013) Mining user queries with Markov chains: application to online image retrieval. IEEE Trans Knowl Data Eng 25(2):433–447CrossRef
36.
Zurück zum Zitat Berry MW, Dumais ST, O’Brien GW (1995) Using linear algebra for intelligent information retrieval. SIAM Rev 37(4):573–595MathSciNetCrossRefMATH Berry MW, Dumais ST, O’Brien GW (1995) Using linear algebra for intelligent information retrieval. SIAM Rev 37(4):573–595MathSciNetCrossRefMATH
37.
Zurück zum Zitat Salehian H, Zamani F, Jamzad M (2012) Fast content based color image retrieval system based on texture analysis of edge map. J Adv Mater Res 341:168–172 Salehian H, Zamani F, Jamzad M (2012) Fast content based color image retrieval system based on texture analysis of edge map. J Adv Mater Res 341:168–172
38.
Zurück zum Zitat Lux M (2011) Content based image retrieval with LIRe. In: The proceedings of the \(19^{th}\) ACM international conference on multimedia, pp 735–738 Lux M (2011) Content based image retrieval with LIRe. In: The proceedings of the \(19^{th}\) ACM international conference on multimedia, pp 735–738
39.
Zurück zum Zitat Huiskes MJ, Lew MS (2008) The MIR flickr retrieval evaluation. In: MIR ’08: proceedings of the 2008 ACM international conference on multimedia information retrieval Huiskes MJ, Lew MS (2008) The MIR flickr retrieval evaluation. In: MIR ’08: proceedings of the 2008 ACM international conference on multimedia information retrieval
Metadaten
Titel
Image recommendation based on keyword relevance using absorbing Markov chain and image features
verfasst von
D. Sejal
V. Rashmi
K. R. Venugopal
S. S. Iyengar
L. M. Patnaik
Publikationsdatum
01.09.2016
Verlag
Springer London
Erschienen in
International Journal of Multimedia Information Retrieval / Ausgabe 3/2016
Print ISSN: 2192-6611
Elektronische ISSN: 2192-662X
DOI
https://doi.org/10.1007/s13735-016-0104-9

Weitere Artikel der Ausgabe 3/2016

International Journal of Multimedia Information Retrieval 3/2016 Zur Ausgabe