Top

International Journal of Machine Learning and Cybernetics

Published in:

08-04-2017 | Original Article

A learning automata framework based on relevance feedback for content-based image retrieval

Authors: Mohsen Fathian, Fardin Akhlaghian Tab, Karim Moradi, Soudeh Saien

Published in: International Journal of Machine Learning and Cybernetics | Issue 9/2018

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The need for efficient image browsing and searching motivates the use of Content-Based Image Retrieval (CBIR) systems. However, they suffer from a big gap between high-level image semantics and low-level features. So, a learning process to reduce the gap seems quite useful. This paper presents a novel Learning Automata (LA)-based approach to improve the CBIR systems. Distributed Learning Automata (DLA) is used in this work to learn the relevant images from textual query feedbacks of the users. Subsequently, the retrieved images are ranked according to the learning outcome and similarity measure. In this study, the similarity between images is evaluated based on two color descriptors: the global color histogram and local color auto-correlogram. A thorough observation and comparison of these color descriptors performances are performed with different color spaces and also with various similarity measures. Experimental results on two publicly available databases demonstrate that the performance of the proposed CBIR system after each round is improved and the system could retrieve images compatible with the users’ perception.

previous article Uncertain maximal frequent subgraph mining algorithm based on adjacency matrix and weight

next article A learning framework for information block search based on probabilistic graphical models and Fisher Kernel

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

ATZelectronics worldwide

ATZlectronics worldwide is up-to-speed on new trends and developments in automotive electronics on a scientific level with a high depth of information.

Order your 30-days-trial for free and without any commitment.

inform now

ATZelektronik

Die Fachzeitschrift ATZelektronik bietet für Entwickler und Entscheider in der Automobil- und Zulieferindustrie qualitativ hochwertige und fundierte Informationen aus dem gesamten Spektrum der Pkw- und Nutzfahrzeug-Elektronik.

Lassen Sie sich jetzt unverbindlich 2 kostenlose Ausgabe zusenden.

inform now

Kundu M, Chowdhury M, Banerjee M (2012) Interactive image retrieval using M-band wavelet, earth mover’s distance and fuzzy relevance feedback. Int J Mach Learn Cyber 3(4):285–296. doi:10.1007/s13042-011-0062-8 CrossRef

Fakheri M, Sedghi T, Shayesteh MG, Amirani MC (2013) Framework for image retrieval using machine learning and statistical similarity matching techniques. Image Process IET 7(1):1–11. doi:10.1049/iet-ipr.2012.0104 CrossRef

Li W, Duan L, Xu D, Tsang IW (2011) Text-based image retrieval using progressive multi-instance learning. In: IEEE International Conference on Computer Vision (ICCV), pp 2049–2055. doi:10.1109/ICCV.2011.6126478

Kato T (1992) Database architecture for content-based image retrieval. In: Image storage and retrieval systems, San Jose, pp 112–123. doi:10.1117/12.58497

Wu Y, Tian Q, Huang TS (2000) Discriminant-EM algorithm with application to image retrieval. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition (CVPR) 1:222–227. doi:10.1109/CVPR.2000.855823

Laaksonen J, Koskela M, Laakso S, Oja E (2000) PicSOM—content-based image retrieval with self-organizing maps. Pattern Recognit Lett 21(13–14):1199–1207. doi:10.1016/S0167-8655(00)00082-9 CrossRefMATH

Ng WY, Lv Y, Zeng Z, Yeung D, Chan PK (2015) Sequential conditional entropy maximization semi-supervised hashing for semantic image retrieval. Int J Mach Learn Cyber. doi:10.1007/s13042-015-0350-9

En C, Jing F, Lei Z (2009) A unified relevance feedback framework for web image retrieval. IEEE Trans Image Process 18(6):1350–1357. doi:10.1109/TIP.2009.2017128 MathSciNetCrossRefMATH

Yi Y, Feiping N, Dong X, Jiebo L, Yueting Z, Pan Y (2012) A multimedia retrieval framework based on semi-supervised ranking and relevance feedback. IEEE Trans Pattern Anal Mach Intell 34(4):723–742. doi:10.1109/TPAMI.2011.170 CrossRef

10.

Lin K, Yang H, Hsiao J, Chen C (2015) Deep learning of binary hash codes for fast image retrieval. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2015, pp. 27–35. doi:10.1109/CVPRW.2015.7301269

11.

Alippi C, Polycarpou M, Panayiotou C, Ellinas G (2009) Relevance feedback for content-based image retrieval using support vector machines and feature selection. Lecture notes in computer science. Springer, Berlin, pp 942–951. doi:10.1007/978-3-642-04274-4_97

12.

Zhang L, Lin F, Zhang B (2001) Support vector machine learning for image retrieval. Proc Int Conf Image Process 2:721–724. doi:10.1109/ICIP.2001.958595

13.

Kundu MK, Chowdhury M, Rota Bulò S (2015) A graph-based relevance feedback mechanism in content-based image retrieval. Knowl Based Syst 73:254–264. doi:10.1016/j.knosys.2014.10.009 CrossRef

14.

Feng L, Wu J, Liu S, Zhang H (2015) Global correlation descriptor: a novel image representation for image retrieval. J Vis Commun Image R 33:104–114. doi:10.1016/j.jvcir.2015.09.002 CrossRef

15.

Khemchandani R, Pal A (2016) Tree based multi-category Laplacian TWSVM for content based image retrieval. Int J Mach Learn Cyber. doi:10.1007/s13042-016-0493-3

16.

Li Jing, Allinson NM (2013) Relevance feedback in content-based image retrieval: a survey. Handb Neural Inf Process 49:433–469. doi:10.1007/978-3-642-36657-4_13 CrossRef

17.

Mollakhalili Meybodi M, Meybodi M (2014) Extended distributed learning automata. Appl Intell 41 (3):923–940. doi:10.1007/s10489-014-0577-2 CrossRef

18.

Thathachar M, Sastry PS (2002) Varieties of learning automata: an overview. IEEE Trans Syst Man Cybern B Cybern 32(6):711–722. doi:10.1109/TSMCB.2002.1049606 CrossRef

19.

Yarahmadi T, Torkestani JA, Zandevakili F (2012) A new method based on distributed learning automata for page ranking in web. Int J Phys Sci 7(13):2066–2075. doi:10.5897/IJPS11.1708

20.

Khomami MMD, Rezvanian A, Meybodi MR (2016) Distributed learning automata-based algorithm for community detection in complex networks. Int J Mod Phys B. doi:10.1142/S0217979216500429 MathSciNet

21.

Guldogan E, Gabbouj M (2008) Feature selection for content-based image retrieval. SIViP 2(3):241–250. doi:10.1007/s11760-007-0049-9 CrossRefMATH

22.

Sun J, Zhang X, Cui J, Zhou L (2006) Image retrieval based on color distribution entropy. Pattern Recognit Lett. 27(10):1122–1126. doi:10.1016/j.patrec.2005.12.014 CrossRef

23.

Fathian M, Akhlaghian Tab F (2011) A novel content-based image retrieval approach using fuzzy combination of color and texture. In: Deng H, Miao D, Lei J, Wang F (eds) Artificial intelligence and computational intelligence, vol 7004. Lecture notes in computer science. Springer, Berlin, pp 12–23. doi:10.1007/978-3-642-23896-3_2 CrossRef

24.

Rahimi M, Ebrahimi Moghaddam M (2015) A content-based image retrieval system based on Color Ton Distribution descriptors. SIViP 9(3):691–704. doi:10.1007/s11760-013-0506-6 CrossRef

25.

Lu T-C, Chang C-C (2007) Color image retrieval technique based on color features and image bitmap. Inf Process Manag. 43(2):461–472. doi:10.1016/j.ipm.2006.07.014 MathSciNetCrossRef

26.

Manjunath BS, Ohm JR, Vasudevan VV, Yamada A (2001) Color and texture descriptors. IEEE Trans Circuits Syst Video Technol 11(6):703–715. doi:10.1109/76.927424 CrossRef

27.

Aptoula E, Lefevre S (2009) Morphological description of color images for content-based image retrieval. IEEE Trans Image Process 18(11):2505–2517. doi:10.1109/TIP.2009.2027363 MathSciNetCrossRefMATH

28.

Plataniotis KN, Venetsanopoulos AN (2000) Color image processing and applications. Springer, New York. doi:10.1007/978-3-662-04186-4 CrossRef

29.

Ogle VE, Stonebraker M (1995) Chabot: retrieval from a relational database of images. Computer 28(9):40–48. doi:10.1109/2.410150 CrossRef

30.

Swain M, Ballard D (1991) Color indexing. Int J Comput Vis 7(1):11–32. doi:10.1007/BF00130487 CrossRef

31.

Suhasini PS, Sri Rama Krishna K., Murali Krishna, I.V. (2016) Content based image retrieval based on different global and local color histogram methods: a survey. J Inst Eng India Ser B. doi:10.1007/s40031-016-0223-y

32.

Jing H, Kumar SR, Mitra M, Wei-Jing Z, Zabih R (1997) Image indexing using color correlograms. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp 762–768. doi:10.1109/CVPR.1997.609412

33.

Huang J, Kumar SR, Mitra M, Zhu W, Zabih R (1999) Spatial color indexing and applications. Int J Comput Vis 35(3):245–268. doi:10.1023/a:1008108327226 CrossRef

34.

Thathachar MAL, Harita BR (1987) Learning automata with changing number of actions. IEEE Trans Syst Man Cybern Syst 17(6):1095–1100. doi:10.1109/TSMC.1987.6499323 CrossRef

35.

Beigy H, Meybodi MR (2006) Utilizing distributed learning automata to solve stochastic shortest path problems. Int J Uncertain Fuzz 14(05):591–615. doi:10.1142/S0218488506004217 MathSciNetCrossRefMATH

36.

Deza M, Deza E (2009) Encyclopedia of distances. Springer, Berlin, pp 1–583. doi:10.1007/978-3-64200234-2_1 CrossRefMATH

37.

Emran SM, Ye N (2002) Robustness of Chi-square and Canberra distance metrics for computer intrusion detection. Qual Reliab Eng Int. 18(1):19–28. doi:10.1002/qre.441 CrossRef

38.

Fathian M, Akhlaghian Tab F (2011) Content-based image retrieval using color features of partitioned images. In: International Conference on Graphic and Image Processing, pp 82850Q–82850Q-8. doi:10.1117/12.913302

39.

Wang JZ, Li J, Wiederhold G (2001) SIMPLIcity: semantics sensitive integrated matching for picture libraries. IEEE Trans Pattern Anal Mach Intell 23:947–963CrossRef

40.

Li F-F, Fergus R, Perona P (2006) One-shot learning of object categories. IEEE Trans Pattern Anal Mach Intell 28(4):594–611. doi:10.1109/TPAMI.2006.79 CrossRef

41.

Moghaddam HA, Khajoie TT, Rouhi AH, Tarzjan MS (2005) Wavelet correlogram: a new approach for image indexing and retrieval. Pattern Recogn 38(12):2506–2518. doi:10.1016/j.patcog.2005.05.010 CrossRef

42.

Junwei H, Ngan KN, Mingjing L, Hong-Jiang Z (2005) A memory learning framework for effective image retrieval. IEEE Trans Image Process 14(4):511–524. doi:10.1109/TIP.2004.841205 CrossRef

43.

Yong R, Huang TS, Ortega M, Mehrotra S (1998) Relevance feedback: a power tool for interactive content-based image retrieval. IEEE Trans Circuits Syst Video Technol 8(5):644–655. doi:10.1109/76.718510 CrossRef

Title: A learning automata framework based on relevance feedback for content-based image retrieval
Authors: Mohsen Fathian
Fardin Akhlaghian Tab
Karim Moradi
Soudeh Saien
Publication date: 08-04-2017
Publisher: Springer Berlin Heidelberg
Published in: International Journal of Machine Learning and Cybernetics / Issue 9/2018
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI: https://doi.org/10.1007/s13042-017-0656-x

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

ATZelectronics worldwide

ATZelektronik

Other articles of this Issue 9/2018

Uncertain maximal frequent subgraph mining algorithm based on adjacency matrix and weight

DFTDT: distributed functional tangent decision tree for aqua status prediction in wireless sensor networks

OKRELM: online kernelized and regularized extreme learning machine for wearable-based activity recognition

Hesitant fuzzy linguistic multi-criteria decision making based on possibility theory

Neural network observer-based leader-following consensus of heterogenous nonlinear uncertain systems

A new fuzzy twin support vector machine for pattern classification