Skip to main content
Top
Published in: Medical & Biological Engineering & Computing 5/2020

02-03-2020 | Original Article

A multi-level similarity measure for the retrieval of the common CT imaging signs of lung diseases

Authors: Ling Ma, Xiabi Liu, Baowei Fei

Published in: Medical & Biological Engineering & Computing | Issue 5/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The common CT imaging signs of lung diseases (CISLs) which frequently appear in lung CT images are widely used in the diagnosis of lung diseases. Computer-aided diagnosis (CAD) based on the CISLs can improve radiologists’ performance in the diagnosis of lung diseases. Since similarity measure is important for CAD, we propose a multi-level method to measure the similarity between the CISLs. The CISLs are characterized in the low-level visual scale, mid-level attribute scale, and high-level semantic scale, for a rich representation. The similarity at multiple levels is calculated and combined in a weighted sum form as the final similarity. The proposed multi-level similarity method is capable of computing the level-specific similarity and optimal cross-level complementary similarity. The effectiveness of the proposed similarity measure method is evaluated on a dataset of 511 lung CT images from clinical patients for CISLs retrieval. It can achieve about 80% precision and take only 3.6 ms for the retrieval process. The extensive comparative evaluations on the same datasets are conducted to validate the advantages on retrieval performance of our multi-level similarity measure over the single-level measure and the two-level similarity methods. The proposed method can have wide applications in radiology and decision support.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Torre LA, Bray F, Siegel RL et al (2015) Global cancer statistics, 2012. CA Cancer J Clin 65(2):87–108CrossRefPubMed Torre LA, Bray F, Siegel RL et al (2015) Global cancer statistics, 2012. CA Cancer J Clin 65(2):87–108CrossRefPubMed
2.
3.
go back to reference Van Ginneken B, Romeny BTH, Viergever MA (2001) Computer-aided diagnosis in chest radiography: a survey. IEEE Trans Med Imaging 20:1228–1241PubMedCrossRef Van Ginneken B, Romeny BTH, Viergever MA (2001) Computer-aided diagnosis in chest radiography: a survey. IEEE Trans Med Imaging 20:1228–1241PubMedCrossRef
4.
go back to reference Doi K (2007) Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput Med Imaging Graph 31:198–211PubMedPubMedCentralCrossRef Doi K (2007) Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput Med Imaging Graph 31:198–211PubMedPubMedCentralCrossRef
5.
go back to reference Owais M, Arsalan M, Choi J et al (2019) Effective diagnosis and treatment through content-based medical image retrieval (CBMIR) by using artificial intelligence. J Clin Med 8(4):462PubMedCentralCrossRef Owais M, Arsalan M, Choi J et al (2019) Effective diagnosis and treatment through content-based medical image retrieval (CBMIR) by using artificial intelligence. J Clin Med 8(4):462PubMedCentralCrossRef
6.
go back to reference Li Z, Zhang X, Müller H, Zhang S (2018) Large-scale retrieval for medical image analytics: a comprehensive review. Med Image Anal 43:66–84PubMedCrossRef Li Z, Zhang X, Müller H, Zhang S (2018) Large-scale retrieval for medical image analytics: a comprehensive review. Med Image Anal 43:66–84PubMedCrossRef
7.
go back to reference Mehre SA, Dhara AK, Garg M et al (2019) Content-based image retrieval system for pulmonary nodules using optimal feature sets and class membership-based retrieval. J Digit Imaging 32(3):362–385PubMedCrossRef Mehre SA, Dhara AK, Garg M et al (2019) Content-based image retrieval system for pulmonary nodules using optimal feature sets and class membership-based retrieval. J Digit Imaging 32(3):362–385PubMedCrossRef
8.
go back to reference Shyu CR, Brodley CE, Kak AC et al (1999) ASSERT: a physician-in-the-loop content-based retrieval system for HRCT image databases. Comput Vis Image Underst 75:111–132CrossRef Shyu CR, Brodley CE, Kak AC et al (1999) ASSERT: a physician-in-the-loop content-based retrieval system for HRCT image databases. Comput Vis Image Underst 75:111–132CrossRef
9.
go back to reference Cheng W, Zhu X, Chen X et al (2019) Manhattan distance based adaptive 3D transform-domain collaborative filtering for laser speckle imaging of blood flow. IEEE Trans Med Imaging 38(7):1726–1735PubMedCrossRef Cheng W, Zhu X, Chen X et al (2019) Manhattan distance based adaptive 3D transform-domain collaborative filtering for laser speckle imaging of blood flow. IEEE Trans Med Imaging 38(7):1726–1735PubMedCrossRef
10.
go back to reference Cai S, Georgakilas GK, Johnson JL et al (2018) A cosine similarity-based method to infer variability of chromatin accessibility at the single-cell level. Front Genet 9:319PubMedPubMedCentralCrossRef Cai S, Georgakilas GK, Johnson JL et al (2018) A cosine similarity-based method to infer variability of chromatin accessibility at the single-cell level. Front Genet 9:319PubMedPubMedCentralCrossRef
11.
go back to reference Endo M, Aramaki T, Asakura K et al (2012) Content-based image-retrieval system in chest computed tomography for a solitary pulmonary nodule: method and preliminary experiments. Int J Comput Assist Radiol Surg 7(2):331–338PubMedCrossRef Endo M, Aramaki T, Asakura K et al (2012) Content-based image-retrieval system in chest computed tomography for a solitary pulmonary nodule: method and preliminary experiments. Int J Comput Assist Radiol Surg 7(2):331–338PubMedCrossRef
12.
go back to reference Dy JG, Brodley CE, Kak A et al (2003) Unsupervised feature selection applied to content-based retrieval of lung images. IEEE Trans Pattern Anal Mach Intell 25(3):373–378CrossRef Dy JG, Brodley CE, Kak A et al (2003) Unsupervised feature selection applied to content-based retrieval of lung images. IEEE Trans Pattern Anal Mach Intell 25(3):373–378CrossRef
13.
go back to reference Ashraf R, Ahmed M, Jabbar S et al (2018) Content based image retrieval by using color descriptor and discrete wavelet transform. J Med Syst 42(3):44PubMedCrossRef Ashraf R, Ahmed M, Jabbar S et al (2018) Content based image retrieval by using color descriptor and discrete wavelet transform. J Med Syst 42(3):44PubMedCrossRef
14.
go back to reference El-Naqa I, Yang Y, Galatsanos NP et al (2004) A similarity learning approach to content-based image retrieval: application to digital mammography. IEEE Trans Med Imaging 23(10):1233–1244PubMedCrossRef El-Naqa I, Yang Y, Galatsanos NP et al (2004) A similarity learning approach to content-based image retrieval: application to digital mammography. IEEE Trans Med Imaging 23(10):1233–1244PubMedCrossRef
15.
go back to reference Cho H, Hadjiiski L, Sahiner B, Chan HP, Helvie M, Paramagul C, Nees AV (2011) Similarity evaluation in a content-based image retrieval (CBIR) CADx system for characterization of breast masses on ultrasound images. Med Phys 38(4):1820–1831PubMedPubMedCentralCrossRef Cho H, Hadjiiski L, Sahiner B, Chan HP, Helvie M, Paramagul C, Nees AV (2011) Similarity evaluation in a content-based image retrieval (CBIR) CADx system for characterization of breast masses on ultrasound images. Med Phys 38(4):1820–1831PubMedPubMedCentralCrossRef
16.
go back to reference Rahman MM, Antani SK, Thoma GR (2011) A learning-based similarity fusion and filtering approach for biomedical image retrieval using SVM classification and relevance feedback. IEEE Trans Inf Technol Biomed 15(4):640–646PubMedCrossRef Rahman MM, Antani SK, Thoma GR (2011) A learning-based similarity fusion and filtering approach for biomedical image retrieval using SVM classification and relevance feedback. IEEE Trans Inf Technol Biomed 15(4):640–646PubMedCrossRef
17.
go back to reference Caicedo JC, González FA, Romero E (2011) Content-based histopathology image retrieval using a kernel based semantic annotation framework. J Biomed Inform 44(4):519–528PubMedCrossRef Caicedo JC, González FA, Romero E (2011) Content-based histopathology image retrieval using a kernel based semantic annotation framework. J Biomed Inform 44(4):519–528PubMedCrossRef
18.
go back to reference De Oliveira JEE, Machado AMC, Chavez GC et al (2010) MammoSys: a content-based image retrieval system using breast density patterns. Comput Methods Prog Biomed 99(3):289–297CrossRef De Oliveira JEE, Machado AMC, Chavez GC et al (2010) MammoSys: a content-based image retrieval system using breast density patterns. Comput Methods Prog Biomed 99(3):289–297CrossRef
19.
go back to reference Rahman MM, Desai BC, Bhattacharya P (2008) Medical image retrieval with probabilistic multi-class support vector machine classifiers and adaptive similarity fusion. Comput Med Imaging Graph 32(2):95–108PubMedCrossRef Rahman MM, Desai BC, Bhattacharya P (2008) Medical image retrieval with probabilistic multi-class support vector machine classifiers and adaptive similarity fusion. Comput Med Imaging Graph 32(2):95–108PubMedCrossRef
20.
go back to reference Wei CH, Li Y, Huang PJ (2010) Mammogram retrieval through machine learning within BI-RADS standards. J Biomed Inform 44(4):607–614CrossRef Wei CH, Li Y, Huang PJ (2010) Mammogram retrieval through machine learning within BI-RADS standards. J Biomed Inform 44(4):607–614CrossRef
21.
go back to reference Mueen A, Zainuddin R, Baba MS (2010) MIARS: a medical image retrieval system. J Med Syst 34(5):859–864PubMedCrossRef Mueen A, Zainuddin R, Baba MS (2010) MIARS: a medical image retrieval system. J Med Syst 34(5):859–864PubMedCrossRef
22.
go back to reference Tarjoman M, Fatemizadeh E, Badie K (2013) An implementation of a CBIR system based on SVM learning scheme. J Med Eng Technol 37(1):43–47PubMedCrossRef Tarjoman M, Fatemizadeh E, Badie K (2013) An implementation of a CBIR system based on SVM learning scheme. J Med Eng Technol 37(1):43–47PubMedCrossRef
23.
go back to reference Quddus A, Basir O (2012) Semantic image retrieval in magnetic resonance brain volumes. IEEE Trans Inf Technol Biomed 16(3):348–355PubMedCrossRef Quddus A, Basir O (2012) Semantic image retrieval in magnetic resonance brain volumes. IEEE Trans Inf Technol Biomed 16(3):348–355PubMedCrossRef
24.
go back to reference Wei L, Yang Y, Nishikawa RM (2009) Microcalcification classification assisted by content-based image retrieval for breast cancer diagnosis. Pattern Recogn 42(6):1126–1132CrossRef Wei L, Yang Y, Nishikawa RM (2009) Microcalcification classification assisted by content-based image retrieval for breast cancer diagnosis. Pattern Recogn 42(6):1126–1132CrossRef
25.
go back to reference Yuan K, Tian Z, Zou J et al (2011) Brain CT image database building for computer-aided diagnosis using content-based image retrieval. Inf Process Manag 47(2):176–185CrossRef Yuan K, Tian Z, Zou J et al (2011) Brain CT image database building for computer-aided diagnosis using content-based image retrieval. Inf Process Manag 47(2):176–185CrossRef
26.
go back to reference Yang W, Lu Z, Yu M, Huang M, Feng Q, Chen W (2012) Content-based retrieval of focal liver lesions using bag-of-visual-words representations of single-and multiphase contrast-enhanced CT images. J Digit Imaging 25(6):708–719PubMedPubMedCentralCrossRef Yang W, Lu Z, Yu M, Huang M, Feng Q, Chen W (2012) Content-based retrieval of focal liver lesions using bag-of-visual-words representations of single-and multiphase contrast-enhanced CT images. J Digit Imaging 25(6):708–719PubMedPubMedCentralCrossRef
27.
go back to reference Ko BC, Lee JH, Nam JY (2012) Automatic medical image annotation and keyword-based image retrieval using relevance feedback. J Digit Imaging 25(4):454–465PubMedCrossRef Ko BC, Lee JH, Nam JY (2012) Automatic medical image annotation and keyword-based image retrieval using relevance feedback. J Digit Imaging 25(4):454–465PubMedCrossRef
28.
go back to reference Zhang F, Song Y, Cai W et al (2016) Pairwise latent semantic association for similarity computation in medical imaging. IEEE Trans Biomed Eng 63(5):1058–1069PubMedCrossRef Zhang F, Song Y, Cai W et al (2016) Pairwise latent semantic association for similarity computation in medical imaging. IEEE Trans Biomed Eng 63(5):1058–1069PubMedCrossRef
29.
go back to reference Cauvin JM, Le Guillou C, Solaiman B et al (2003) Computer-assisted diagnosis system in digestive endoscopy. IEEE Trans Inf Technol Biomed 7(4):256–262PubMedCrossRef Cauvin JM, Le Guillou C, Solaiman B et al (2003) Computer-assisted diagnosis system in digestive endoscopy. IEEE Trans Inf Technol Biomed 7(4):256–262PubMedCrossRef
30.
go back to reference Rahman MM, Bhattacharya P, Desai BC (2007) A framework for medical image retrieval using machine learning and statistical similarity matching techniques with relevance feedback. IEEE Trans Inf Technol Biomed 11(1):58–69PubMedCrossRef Rahman MM, Bhattacharya P, Desai BC (2007) A framework for medical image retrieval using machine learning and statistical similarity matching techniques with relevance feedback. IEEE Trans Inf Technol Biomed 11(1):58–69PubMedCrossRef
31.
go back to reference Qayyum A, Anwar SM, Awais M, Majid M (2017) Medical image retrieval using deep convolutional neural network. Neurocomputing 266:8–20CrossRef Qayyum A, Anwar SM, Awais M, Majid M (2017) Medical image retrieval using deep convolutional neural network. Neurocomputing 266:8–20CrossRef
32.
go back to reference Gao Z, Wu S, Liu Z et al (2019) Learning the implicit strain reconstruction in ultrasound elastography using privileged information. Med Image Anal 58:101534PubMedCrossRef Gao Z, Wu S, Liu Z et al (2019) Learning the implicit strain reconstruction in ultrasound elastography using privileged information. Med Image Anal 58:101534PubMedCrossRef
33.
go back to reference Kurtz C, Beaulieu CF, Napel S, Rubin DL (2014) A hierarchical knowledge-based approach for retrieving similar medical images described with semantic annotations. J Biomed Inform 49:227–244PubMedCrossRef Kurtz C, Beaulieu CF, Napel S, Rubin DL (2014) A hierarchical knowledge-based approach for retrieving similar medical images described with semantic annotations. J Biomed Inform 49:227–244PubMedCrossRef
34.
go back to reference Burdescu DD, Mihai CG, Stanescu L et al (2013) Automatic image annotation and semantic based image retrieval for medical domain. Neurocomputing 109:33–48CrossRef Burdescu DD, Mihai CG, Stanescu L et al (2013) Automatic image annotation and semantic based image retrieval for medical domain. Neurocomputing 109:33–48CrossRef
35.
go back to reference Yao J, Zhang ZM, Antani S et al (2008) Automatic medical image annotation and retrieval. Neurocomputing 71(10–12):2012–2022CrossRef Yao J, Zhang ZM, Antani S et al (2008) Automatic medical image annotation and retrieval. Neurocomputing 71(10–12):2012–2022CrossRef
36.
go back to reference Napel SA, Beaulieu CF, Rodriguez C et al (2010) Automated retrieval of CT images of liver lesions on the basis of image similarity: method and preliminary results. Radiology 256(1):243–252PubMedPubMedCentralCrossRef Napel SA, Beaulieu CF, Rodriguez C et al (2010) Automated retrieval of CT images of liver lesions on the basis of image similarity: method and preliminary results. Radiology 256(1):243–252PubMedPubMedCentralCrossRef
37.
go back to reference Yang L, Jin R, Mummert L et al (2010) A boosting framework for visuality-preserving distance metric learning and its application to medical image retrieval. IEEE Trans Pattern Anal Mach Intell 32(1):30–44PubMedCrossRef Yang L, Jin R, Mummert L et al (2010) A boosting framework for visuality-preserving distance metric learning and its application to medical image retrieval. IEEE Trans Pattern Anal Mach Intell 32(1):30–44PubMedCrossRef
38.
go back to reference Cao Y, Steffey S, He J et al (2014) Medical image retrieval: a multimodal approach. Cancer Informatics 13:CIN-S14053CrossRef Cao Y, Steffey S, He J et al (2014) Medical image retrieval: a multimodal approach. Cancer Informatics 13:CIN-S14053CrossRef
39.
go back to reference Ma L, Liu X, Gao Y et al (2017) A new method of content based medical image retrieval and its applications to CT imaging sign retrieval. J Biomed Inform 66:148–158PubMedCrossRef Ma L, Liu X, Gao Y et al (2017) A new method of content based medical image retrieval and its applications to CT imaging sign retrieval. J Biomed Inform 66:148–158PubMedCrossRef
40.
go back to reference Han G, Liu X, Zhang H et al (2019) Hybrid resampling and multi-feature fusion for automatic recognition of cavity imaging sign in lung CT. Futur Gener Comput Syst 99:558–570CrossRef Han G, Liu X, Zhang H et al (2019) Hybrid resampling and multi-feature fusion for automatic recognition of cavity imaging sign in lung CT. Futur Gener Comput Syst 99:558–570CrossRef
41.
go back to reference Shi Z, Yang Y, Hospedales TM (2016) Weakly-supervised image annotation and segmentation with objects and attributes. IEEE Trans Pattern Anal Mach Intell 39(12):2525–2538PubMedCrossRef Shi Z, Yang Y, Hospedales TM (2016) Weakly-supervised image annotation and segmentation with objects and attributes. IEEE Trans Pattern Anal Mach Intell 39(12):2525–2538PubMedCrossRef
42.
go back to reference Penatti OA, Werneck RDO, de Almeida WR et al (2015) Mid-level image representations for real-time heart view plane classification of echocardiograms. Comput Biol Med 66:66–81PubMedCrossRef Penatti OA, Werneck RDO, de Almeida WR et al (2015) Mid-level image representations for real-time heart view plane classification of echocardiograms. Comput Biol Med 66:66–81PubMedCrossRef
44.
go back to reference Han G, Liu X, Han F et al (2015) The LISS—a public database of common imaging signs of lung diseases for computer-aided detection and diagnosis research and medical education. IEEE Trans Biomed Eng 62(2):648–656PubMedCrossRef Han G, Liu X, Han F et al (2015) The LISS—a public database of common imaging signs of lung diseases for computer-aided detection and diagnosis research and medical education. IEEE Trans Biomed Eng 62(2):648–656PubMedCrossRef
45.
go back to reference Ma L, Liu X, Fei B (2016) Learning with distribution of optimized features for recognizing common CT imaging signs of lung diseases. Phys Med Biol 62(2):612–632PubMedPubMedCentralCrossRef Ma L, Liu X, Fei B (2016) Learning with distribution of optimized features for recognizing common CT imaging signs of lung diseases. Phys Med Biol 62(2):612–632PubMedPubMedCentralCrossRef
46.
go back to reference Liu X, Ma L, Song L et al (2015) Recognizing common CT imaging signs of lung diseases through a new feature selection method based on Fisher criterion and genetic optimization. IEEE J Biomed Health Inform 19(2):635–647PubMedCrossRef Liu X, Ma L, Song L et al (2015) Recognizing common CT imaging signs of lung diseases through a new feature selection method based on Fisher criterion and genetic optimization. IEEE J Biomed Health Inform 19(2):635–647PubMedCrossRef
47.
go back to reference Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak J, van Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88CrossRefPubMed Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak J, van Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88CrossRefPubMed
48.
49.
go back to reference Dattorro J (2005) Convex optimization and Euclidean distance geometry. Meboo Publishing (v2007.09.17) Dattorro J (2005) Convex optimization and Euclidean distance geometry. Meboo Publishing (v2007.09.17)
Metadata
Title
A multi-level similarity measure for the retrieval of the common CT imaging signs of lung diseases
Authors
Ling Ma
Xiabi Liu
Baowei Fei
Publication date
02-03-2020
Publisher
Springer Berlin Heidelberg
Published in
Medical & Biological Engineering & Computing / Issue 5/2020
Print ISSN: 0140-0118
Electronic ISSN: 1741-0444
DOI
https://doi.org/10.1007/s11517-020-02146-4

Other articles of this Issue 5/2020

Medical & Biological Engineering & Computing 5/2020 Go to the issue

Premium Partner