Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Evolutionary Intelligence
Published in: Evolutionary Intelligence 4/2021

11-04-2020 | Research Paper

RetrieveNet: a novel deep network for medical image retrieval

Authors: Chesti Altaff Hussain, Dhulipalla Venkata Rao, S. Aruna Mastani

Published in: Evolutionary Intelligence | Issue 4/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Content-Based Image Retrieval is an accurate characterization of visual information used for medical and natural image classification, retrieval, face recognition, etc. In recent years, deep networks achieved state-of-the-art accuracy in various vision tasks. In this paper, we propose an end-to-end approach for medical image retrieval. The proposed approach comprises a novel deep network for classification of input query image followed by the retrieval module to retrieve the images belongs to the query image class. The proposed network comprises of multi-scale filter bank for robust feature extraction. We make use of skip connections to share the initially learned features across the network. The performance of the proposed network for medical image retrieval is validated in terms of precision and recall on three publicly available medical image databases. We validated the proposed approach for two different image modalities, namely CT scans and MRI scans. Performance evaluation depicts that proposed RetrieveNet outperforms other existing methods for medical image retrieval.
previous article Optimal feature selection-based diabetic retinopathy detection using improved rider optimization algorithm enabled with deep learning
next article Automated mammogram breast cancer detection using the optimized combination of convolutional and recurrent neural network

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
Literature
1.
André B, Vercauteren T, Buchner AM, Wallace MB, Ayache N (2012) Learning semantic and visual similarity for endomicroscopy video retrieval. IEEE Trans Med Imaging 31(6):1276–1288CrossRef
2.
Chaudhary S, Murala S (2019) Deep network for human action recognition using weber motion. Neurocomputing 367:207–216CrossRef
3.
Depeursinge A, Vargas A, Platon A, Geissbuhler A, Poletti PA, Müller H (2012) Building a reference multimedia database for interstitial lung diseases. Comput Med Imaging Graph 36(3):227–238CrossRef
4.
Dudhane A, Murala S (2018) \(\text{C}^{\hat{\,}}\) 2msnet: a novel approach for single image haze removal. In: 2018 IEEE winter conference on applications of computer vision (WACV). IEEE, pp 1397–1404
5.
Dudhane A, Murala S (2019) Ryf-net: deep fusion network for single image haze removal. IEEE Trans Image Process 29:628–640MathSciNetCrossRef
6.
Dudhane AA, Talbar SN (2018) Multi-scale directional mask pattern for medical image classification and retrieval. In: Proceedings of 2nd international conference on computer vision & image processing. Springer, pp 345–357
7.
Galshetwar G, Waghmare L, Gonde A, Murala S (2019) Local energy oriented pattern for image indexing and retrieval. J Vis Commun Image Represent 64:102615CrossRef
8.
Galshetwar G, Waghmare LM, Gonde AB, Murala S (2018) Multi-dimensional multi-directional mask maximum edge pattern for bio-medical image retrieval. Int J Multimed Inf Retr 7(4):231–239CrossRef
9.
Galshetwar GM, Patil PW, Gonde AB, Waghmare LM, Maheshwari R (2018) Local directional gradient based feature learning for image retrieval. In: 2018 IEEE 13th international conference on industrial and information systems (ICIIS). IEEE, pp 113–118
10.
11.
Gonde AB, Patil PW, Galshetwar GM, Waghmare LM (2017) Volumetric local directional triplet patterns for biomedical image retrieval. In: 2017 4th international conference on image information processing (ICIIP). IEEE, pp 1–6
12.
Guo Z, Zhang L, Zhang D (2010) A completed modeling of local binary pattern operator for texture classification. IEEE Trans Image Process 19(6):1657–1663MathSciNetCrossRef
13.
Guo Z, Zhang L, Zhang D (2010) Rotation invariant texture classification using LBP variance (LBPV) with global matching. Pattern Recognit 43(3):706–719CrossRef
14.
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
15.
Heikkilä M, Pietikäinen M, Schmid C (2009) Description of interest regions with local binary patterns. Pattern Recognit 42(3):425–436CrossRef
16.
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708
17.
Huang J, Kumar SR, Mitra M (1997) Combining supervised learning with color correlograms for content-based image retrieval. In: Proceedings of the 5th ACM international conference on multimedia. ACM, pp 325–334
18.
Iandola FN, Han S, Moskewicz MW, Ashraf K, Dally WJ, Keutzer K (2016) Squeezenet: alexnet-level accuracy with 50x fewer parameters and< 0.5 mb model size. arXiv preprint arXiv:​1602.​07360
19.
Jhanwar N, Chaudhuri S, Seetharaman G, Zavidovique B (2004) Content based image retrieval using motif cooccurrence matrix. Image Vis Comput 22(14):1211–1220CrossRef
20.
Kokare M, Biswas P, Chatterji B (2006) Rotation-invariant texture image retrieval using rotated complex wavelet filters. IEEE Trans Syst Man Cybern B (Cybern) 36(6):1273–1282CrossRef
21.
Kokare M, Biswas PK, Chatterji BN (2005) Texture image retrieval using new rotated complex wavelet filters. IEEE Trans Syst Man Cybern B (Cybern) 35(6):1168–1178CrossRef
22.
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105
23.
LeCun Y, Bottou L, Bengio Y, Haffner P et al (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef
24.
Lin CH, Chen RT, Chan YK (2009) A smart content-based image retrieval system based on color and texture feature. Image Vis Comput 27(6):658–665CrossRef
25.
Marcus DS, Fotenos AF, Csernansky JG, Morris JC, Buckner RL (2010) Open access series of imaging studies: longitudinal mri data in nondemented and demented older adults. J Cogn Neurosci 22(12):2677–2684CrossRef
26.
Murala S, Maheshwari R, Balasubramanian R (2012) Directional binary wavelet patterns for biomedical image indexing and retrieval. J Med Syst 36(5):2865–2879CrossRef
27.
Murala S, Maheshwari R, Balasubramanian R (2012) Directional local extrema patterns: a new descriptor for content based image retrieval. Int J Multimed Inf Retr 1(3):191–203CrossRef
28.
Murala S, Maheshwari R, Balasubramanian R (2012) Local tetra patterns: a new feature descriptor for content-based image retrieval. IEEE Trans Image Process 21(5):2874–2886MathSciNetCrossRef
29.
Murala S, Wu QJ (2013) Local mesh patterns versus local binary patterns: biomedical image indexing and retrieval. IEEE J Biomed Health Inf 18(3):929–938CrossRef
30.
Murala S, Wu QJ (2013) Local ternary co-occurrence patterns: a new feature descriptor for mri and ct image retrieval. Neurocomputing 119:399–412CrossRef
31.
Murala S, Wu QJ (2015) Spherical symmetric 3D local ternary patterns for natural, texture and biomedical image indexing and retrieval. Neurocomputing 149:1502–1514CrossRef
32.
Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recognit 29(1):51–59CrossRef
33.
Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987CrossRef
34.
Patil P, Murala S, Dhall A, Chaudhary S (2018) Msednet: multi-scale deep saliency learning for moving object detection. In: 2018 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, pp 1670–1675
35.
Patil PW, Murala S (2018) Msfgnet: a novel compact end-to-end deep network for moving object detection. IEEE Trans Intell Transp Syst
36.
Pawar MM, Talbar SN, Dudhane A (2018) Local binary patterns descriptor based on sparse curvelet coefficients for false-positive reduction in mammograms. J Healthc Eng 2018
37.
38.
Randive SN, Rahulkar AD, Senapati RK (2018) LVP extraction and triplet-based segmentation for diabetic retinopathy recognition. Evolut Intell 11(1–2):117–129CrossRef
39.
Reeves AP, Xie Y, Liu S (2017) Large-scale image region documentation for fully automated image biomarker algorithm development and evaluation. J Med Imaging 4(2):024505CrossRef
40.
Rui,Y, She AC, Huang TS (1996) Modified fourier descriptors for shape representation-a practical approach. In: Proceedings of 1st international workshop on image databases and multi media search. Citeseer, pp 22–23
41.
Scott G, Shyu CR (2007) Knowledge-driven multidimensional indexing structure for biomedical media database retrieval. IEEE Trans Inf Technol Biomed 11(3):320–331CrossRef
42.
Shukla AK, Kanungo S (2019) Automated face retrieval using bag-of-features and sigmoidal grey wolf optimization. In: Evolutionary intelligence, pp 1–12
43.
Sorensen L, Shaker SB, De Bruijne M (2010) Quantitative analysis of pulmonary emphysema using local binary patterns. IEEE Trans Med Imaging 29(2):559–569CrossRef
44.
Stricker MA, Orengo M (1995) Similarity of color images. In: Storage and retrieval for image and video databases III, vol 2420. International Society for Optics and Photonics, pp 381–393
45.
Subrahmanyam M, Maheshwari R, Balasubramanian R (2012) Expert system design using wavelet and color vocabulary trees for image retrieval. Expert Syst Appl 39(5):5104–5114CrossRef
46.
Subrahmanyam M, Maheshwari R, Balasubramanian R (2012) Local maximum edge binary patterns: a new descriptor for image retrieval and object tracking. Signal Process 92(6):1467–1479CrossRef
47.
Subrahmanyam M, Wu QJ, Maheshwari R, Balasubramanian R (2013) Modified color motif co-occurrence matrix for image indexing and retrieval. Comput Electr Eng 39(3):762–774CrossRef
48.
49.
Swain MJ, Ballard DH (1992) Indexing via color histograms. In: Active perception and robot vision. Springer, Berlin, pp 261–273
50.
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9
51.
Takala V, Ahonen T, Pietikäinen M (2005) Block-based methods for image retrieval using local binary patterns. In: Scandinavian conference on image analysis. Springer, pp 882–891
52.
Tan X, Triggs B (2010) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 19(6):1635–1650MathSciNetCrossRef
53.
Verma M, Raman B (2018) Local neighborhood difference pattern: a new feature descriptor for natural and texture image retrieval. Multimed Tools Appl 77(10):11843–11866CrossRef
54.
Vipparthi SK, Nagar S (2014) Expert image retrieval system using directional local Motif XOR patterns. Expert Syst Appl 41(17):8016–8026CrossRef
55.
Vipparthi SK, Nagar S (2015) Directional local ternary patterns for multimedia image indexing and retrieval. Int J Signal Imaging Syst Eng 8(3):137–145CrossRef
56.
Xu X, Lee DJ, Antani S, Long LR (2008) A spine x-ray image retrieval system using partial shape matching. IEEE Trans Inf Technol Biomed 12(1):100–108CrossRef
57.
Yao CH, Chen SY (2003) Retrieval of translated, rotated and scaled color textures. Pattern Recognit 36(4):913–929CrossRef
58.
Zhang B, Gao Y, Zhao S, Liu J (2010) Local derivative pattern versus local binary pattern: face recognition with high-order local pattern descriptor. IEEE Trans Image Process 19(2):533–544MathSciNetCrossRef
59.
Zheng L, Wetzel AW, Gilbertson J, Becich MJ (2003) Design and analysis of a content-based pathology image retrieval system. IEEE Trans Inf Technol Biomed 7(4):249–255CrossRef
Metadata
Title
RetrieveNet: a novel deep network for medical image retrieval
Authors
Chesti Altaff Hussain
Dhulipalla Venkata Rao
S. Aruna Mastani
Publication date
11-04-2020
Publisher
Springer Berlin Heidelberg
Published in
Evolutionary Intelligence / Issue 4/2021
Print ISSN: 1864-5909
Electronic ISSN: 1864-5917
DOI
https://doi.org/10.1007/s12065-020-00401-z

Other articles of this Issue 4/2021

Evolutionary Intelligence 4/2021 Go to the issue

Research Paper

Neighborhood centroid opposite-based learning Harris Hawks optimization for training neural networks

Research Paper

The hub location’s method for solving optimal control problems

Research Paper

Hybrid approach based on cuckoo optimization algorithm and genetic algorithm for task scheduling

Research Paper

Hybrid particle swarm optimization with particle elimination for the high school timetabling problem

Research Paper

Investigating the use of an ensemble of evolutionary algorithms for letter identification in tremulous medieval handwriting

Research Paper

Dimensionality reduction of hyperspectral image using signal entropy and spatial information in genetic algorithm with discrete wavelet transformation

Premium Partner

    Image Credits