Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 5/2019

14.03.2019 | Original Article

A novel image-based retrieval system for characterization of maxillofacial lesions in cone beam CT images

verfasst von: Fatemeh Abdolali, Reza Aghaeizadeh Zoroofi, Yoshito Otake, Yoshinobu Sato

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 5/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

The objective of medical content-based image retrieval (CBIR) is to assist clinicians in decision making by retrieving the most similar cases to a given query image from a large database. Herein, a new method for content-based image retrieval of cone beam CT (CBCT) scans is presented.

Methods

The introduced framework consists of two main phases: training database construction and querying. The goal of the training phase is database construction, which consists of three main steps. First, automatic segmentation of lesions using 3D symmetry analysis is performed. Embedding the prior shape knowledge of the 3D symmetry characteristics of the healthy human head structure increases the accuracy of automatic segmentation. Then, spatial pyramid matching is used for feature extraction, and the relative importance of each feature is learned using classifiers.

Results

The method was applied to a dataset of 1145 volumetric CBCT images with four classes of maxillofacial lesions. A symmetry-based analysis model for automatic lesion segmentation was evaluated using similarity measures. Mean Dice coefficients of 0.89, 0.85, 0.92, and 0.87 were achieved for maxillary sinus perforation, radiolucent lesion, unerupted tooth, and root fracture classes, respectively. Moreover, the execution time of automatic segmentation was reduced to 3 min per case. The performance of the proposed search engine was evaluated using mean average precision and normalized discounted cumulative gain. A mean average retrieval accuracy and normalized discounted cumulative gain of 0.90 and 0.92, respectively, were achieved.

Conclusion

Quantitative results show that the proposed approach is more effective than previous methods in the literature, and it can facilitate the introduction of CBIR in clinical CBCT applications.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Müller H, Michoux N, Bandon D, Geissbuhler A (2004) A review of content-based image retrieval systems in medical applications—clinical benefits and future directions. Int J Med Inf 73:1–23CrossRef Müller H, Michoux N, Bandon D, Geissbuhler A (2004) A review of content-based image retrieval systems in medical applications—clinical benefits and future directions. Int J Med Inf 73:1–23CrossRef
2.
Zurück zum Zitat Tyagi V (2017) Content-based image retrieval techniques: a review. In: Content-based image retrieval. Springer, pp 29–48 Tyagi V (2017) Content-based image retrieval techniques: a review. In: Content-based image retrieval. Springer, pp 29–48
3.
Zurück zum Zitat Datta R, Joshi D, Li J, Wang JZ (2008) Image retrieval: ideas, influences, and trends of the new age. ACM Comput Surv Csur 40:5 Datta R, Joshi D, Li J, Wang JZ (2008) Image retrieval: ideas, influences, and trends of the new age. ACM Comput Surv Csur 40:5
4.
Zurück zum Zitat Müller H, de Herrera AGS, Kalpathy-Cramer J, Demner-Fushman D, Antani SK, Eggel I (2012) Overview of the ImageCLEF 2012 medical image retrieval and classification tasks. In: CLEF online work. Noteslabsworkshop, pp 1–16 Müller H, de Herrera AGS, Kalpathy-Cramer J, Demner-Fushman D, Antani SK, Eggel I (2012) Overview of the ImageCLEF 2012 medical image retrieval and classification tasks. In: CLEF online work. Noteslabsworkshop, pp 1–16
5.
Zurück zum Zitat Müller H, Rosset A, Garcia A, Vallee JP, Geissbuhler A (2005) Benefits of content-based visual data access in radiology. Radiographics 25(3):849–858CrossRefPubMed Müller H, Rosset A, Garcia A, Vallee JP, Geissbuhler A (2005) Benefits of content-based visual data access in radiology. Radiographics 25(3):849–858CrossRefPubMed
6.
Zurück zum Zitat Korn P, Sidiropoulos N, Faloutsos C, Siegel E, Protopapas Z (1998) Fast and effective retrieval of medical tumor shapes. IEEE Trans Knowl Data Eng 10:889–904CrossRef Korn P, Sidiropoulos N, Faloutsos C, Siegel E, Protopapas Z (1998) Fast and effective retrieval of medical tumor shapes. IEEE Trans Knowl Data Eng 10:889–904CrossRef
7.
Zurück zum Zitat Long LR, Antani S, Lee D-J, Krainak DM, Thoma GR (2003) Biomedical information from a national collection of spine x-rays: film to content-based retrieval. In: Medical imaging 2003 PACS integrated medical information systems design evaluation. International Society for Optics and Photonics, pp 70–85 Long LR, Antani S, Lee D-J, Krainak DM, Thoma GR (2003) Biomedical information from a national collection of spine x-rays: film to content-based retrieval. In: Medical imaging 2003 PACS integrated medical information systems design evaluation. International Society for Optics and Photonics, pp 70–85
8.
Zurück zum Zitat Gundreddy RR, Tan M, Qiu Y, Cheng S, Liu H, Zheng B (2015) Assessment of performance and reproducibility of applying a content-based image retrieval scheme for classification of breast lesions. Med Phys 42:4241–4249CrossRefPubMedPubMedCentral Gundreddy RR, Tan M, Qiu Y, Cheng S, Liu H, Zheng B (2015) Assessment of performance and reproducibility of applying a content-based image retrieval scheme for classification of breast lesions. Med Phys 42:4241–4249CrossRefPubMedPubMedCentral
9.
Zurück zum Zitat Ramos J, Kockelkorn TT, Ramos I, Ramos R, Grutters J, Viergever MA, van Ginneken B, Campilho A (2016) Content-based image retrieval by metric learning from radiology reports: application to interstitial lung diseases. IEEE J Biomed Health Inform 20:281–292CrossRefPubMed Ramos J, Kockelkorn TT, Ramos I, Ramos R, Grutters J, Viergever MA, van Ginneken B, Campilho A (2016) Content-based image retrieval by metric learning from radiology reports: application to interstitial lung diseases. IEEE J Biomed Health Inform 20:281–292CrossRefPubMed
10.
Zurück zum Zitat Kurtz C, Depeursinge A, Napel S, Beaulieu CF, Rubin DL (2014) On combining image-based and ontological semantic dissimilarities for medical image retrieval applications. Med Image Anal 18:1082–1100CrossRefPubMedPubMedCentral Kurtz C, Depeursinge A, Napel S, Beaulieu CF, Rubin DL (2014) On combining image-based and ontological semantic dissimilarities for medical image retrieval applications. Med Image Anal 18:1082–1100CrossRefPubMedPubMedCentral
11.
Zurück zum Zitat Tzelepi M, Tefas A (2018) Deep convolutional learning for content based image retrieval. Neurocomputing 275:2467–2478CrossRef Tzelepi M, Tefas A (2018) Deep convolutional learning for content based image retrieval. Neurocomputing 275:2467–2478CrossRef
12.
Zurück zum Zitat Langs G, Hanbury A, Menze B, Müller H (2012) VISCERAL: towards large data in medical imaging-challenges and directions. In: MICCAI international workshop on medical content-based retrieval for clinical decision support, pp 92–98 Langs G, Hanbury A, Menze B, Müller H (2012) VISCERAL: towards large data in medical imaging-challenges and directions. In: MICCAI international workshop on medical content-based retrieval for clinical decision support, pp 92–98
13.
Zurück zum Zitat Carson C, Belongie S, Greenspan H, Malik J (2002) Blobworld: image segmentation using expectation-maximization and its application to image querying. IEEE Trans Pattern Anal Mach Intell 24(8):1026–1038CrossRef Carson C, Belongie S, Greenspan H, Malik J (2002) Blobworld: image segmentation using expectation-maximization and its application to image querying. IEEE Trans Pattern Anal Mach Intell 24(8):1026–1038CrossRef
14.
Zurück zum Zitat Bordes F, Berthier T, Di Jorio L, Vincent P, Bengio Y (2018) Iteratively unveiling new regions of interest in Deep Learning models. In: International conference on medical imaging with deep learning. Retrieved from https://openreview.net/pdf?id=rJz89iiiM. Accessed 13 Mar 2019 Bordes F, Berthier T, Di Jorio L, Vincent P, Bengio Y (2018) Iteratively unveiling new regions of interest in Deep Learning models. In: International conference on medical imaging with deep learning. Retrieved from https://​openreview.​net/​pdf?​id=​rJz89iiiM. Accessed 13 Mar 2019
15.
Zurück zum Zitat Penatti OA, Valle E, da Torres RS (2012) Comparative study of global color and texture descriptors for web image retrieval. J Vis Commun Image Represent 23:359–380CrossRef Penatti OA, Valle E, da Torres RS (2012) Comparative study of global color and texture descriptors for web image retrieval. J Vis Commun Image Represent 23:359–380CrossRef
16.
Zurück zum Zitat Abdolali F, Zoroofi RA, Otake Y, Sato Y (2016) Automatic segmentation of maxillofacial cysts in cone beam CT images. Comput Biol Med 72:108–119CrossRefPubMed Abdolali F, Zoroofi RA, Otake Y, Sato Y (2016) Automatic segmentation of maxillofacial cysts in cone beam CT images. Comput Biol Med 72:108–119CrossRefPubMed
17.
Zurück zum Zitat Loy G, Eklundh J-O (2006) Detecting symmetry and symmetric constellations of features. In: European conference on computer vision. Springer, pp 508–521 Loy G, Eklundh J-O (2006) Detecting symmetry and symmetric constellations of features. In: European conference on computer vision. Springer, pp 508–521
18.
Zurück zum Zitat Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110CrossRef Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110CrossRef
19.
Zurück zum Zitat Cheung W, Hamarneh G (2009) n-SIFT: n-dimensional scale invariant feature transform. IEEE Trans Image Process 18:2012–2021CrossRefPubMed Cheung W, Hamarneh G (2009) n-SIFT: n-dimensional scale invariant feature transform. IEEE Trans Image Process 18:2012–2021CrossRefPubMed
20.
Zurück zum Zitat Ni D, Chui YP, Qu Y, Yang X, Qin J, Wong T-T, Ho SS, Heng PA (2009) Reconstruction of volumetric ultrasound panorama based on improved 3D SIFT. Comput Med Imaging Graph 33:559–566CrossRefPubMed Ni D, Chui YP, Qu Y, Yang X, Qin J, Wong T-T, Ho SS, Heng PA (2009) Reconstruction of volumetric ultrasound panorama based on improved 3D SIFT. Comput Med Imaging Graph 33:559–566CrossRefPubMed
21.
Zurück zum Zitat Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24:603–619CrossRef Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24:603–619CrossRef
22.
Zurück zum Zitat Cui Y, Feng J (2013) Real-time B-spline free-form deformation via GPU acceleration. Comput Gr 37:1–11CrossRef Cui Y, Feng J (2013) Real-time B-spline free-form deformation via GPU acceleration. Comput Gr 37:1–11CrossRef
23.
Zurück zum Zitat Yang J, Yu K, Gong Y, Huang T (2009) Linear spatial pyramid matching using sparse coding for image classification. In: IEEE conference on computer vision pattern recognition, CVPR 2009. IEEE, pp 1794–1801 Yang J, Yu K, Gong Y, Huang T (2009) Linear spatial pyramid matching using sparse coding for image classification. In: IEEE conference on computer vision pattern recognition, CVPR 2009. IEEE, pp 1794–1801
24.
Zurück zum Zitat Csurka G, Dance C, Fan L, Willamowski J, Bray C (2004) Visual categorization with bags of keypoints. In: Workshop on statistical learning in computer vision, ECCV, Prague. pp 1–2 Csurka G, Dance C, Fan L, Willamowski J, Bray C (2004) Visual categorization with bags of keypoints. In: Workshop on statistical learning in computer vision, ECCV, Prague. pp 1–2
26.
Zurück zum Zitat Fei-Fei L, Fergus R, Perona P (2007) Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. Comput Vis Image Underst 106:59–70CrossRef Fei-Fei L, Fergus R, Perona P (2007) Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. Comput Vis Image Underst 106:59–70CrossRef
27.
Zurück zum Zitat Atkinson KE (2008) An introduction to numerical analysis. Wiley, Hoboken Atkinson KE (2008) An introduction to numerical analysis. Wiley, Hoboken
28.
Zurück zum Zitat Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26:297–302CrossRef Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26:297–302CrossRef
29.
Zurück zum Zitat Cignoni P, Rocchini C, Scopigno R (1998) Metro: measuring error on simplified surfaces. In: Computer graphics forum. Wiley, pp 167–174 Cignoni P, Rocchini C, Scopigno R (1998) Metro: measuring error on simplified surfaces. In: Computer graphics forum. Wiley, pp 167–174
30.
Zurück zum Zitat Clemmensen L, Hastie T, Witten D, Ersbøll B (2011) Sparse discriminant analysis. Technometrics 53:406–413CrossRef Clemmensen L, Hastie T, Witten D, Ersbøll B (2011) Sparse discriminant analysis. Technometrics 53:406–413CrossRef
31.
Zurück zum Zitat Schütze H, Manning CD, Raghavan P (2008) Introduction to information retrieval. Cambridge University Press, Cambridge Schütze H, Manning CD, Raghavan P (2008) Introduction to information retrieval. Cambridge University Press, Cambridge
32.
Zurück zum Zitat Järvelin K, Kekäläinen J (2002) Cumulated gain-based evaluation of IR techniques. ACM Trans Inf Syst TOIS 20:422–446CrossRef Järvelin K, Kekäläinen J (2002) Cumulated gain-based evaluation of IR techniques. ACM Trans Inf Syst TOIS 20:422–446CrossRef
33.
Zurück zum Zitat Stoetzer M, Nickel F, Rana M, Lemound J, Wenzel D, von See C, Gellrich N-C (2013) Advances in assessing the volume of odontogenic cysts and tumors in the mandible: a retrospective clinical trial. Head Face Med 9:14CrossRefPubMedPubMedCentral Stoetzer M, Nickel F, Rana M, Lemound J, Wenzel D, von See C, Gellrich N-C (2013) Advances in assessing the volume of odontogenic cysts and tumors in the mandible: a retrospective clinical trial. Head Face Med 9:14CrossRefPubMedPubMedCentral
34.
Zurück zum Zitat Abdolali F, Zoroofi RA, Abdolali M (2015) Content based image retrieval for maxillofacial lesions. In: 9th Iranian conference on machine vision and image processing (MVIP). IEEE, pp 5–8 Abdolali F, Zoroofi RA, Abdolali M (2015) Content based image retrieval for maxillofacial lesions. In: 9th Iranian conference on machine vision and image processing (MVIP). IEEE, pp 5–8
35.
Zurück zum Zitat Deserno TM, Molander B, Guld MO, Thies C, Grondahl HG (2007) Content-based access to oral and maxillofacial radiographs. Dentomaxillofacial Radiol 36:328–335CrossRef Deserno TM, Molander B, Guld MO, Thies C, Grondahl HG (2007) Content-based access to oral and maxillofacial radiographs. Dentomaxillofacial Radiol 36:328–335CrossRef
Metadaten
Titel
A novel image-based retrieval system for characterization of maxillofacial lesions in cone beam CT images
verfasst von
Fatemeh Abdolali
Reza Aghaeizadeh Zoroofi
Yoshito Otake
Yoshinobu Sato
Publikationsdatum
14.03.2019
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 5/2019
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-019-01946-w

Weitere Artikel der Ausgabe 5/2019

International Journal of Computer Assisted Radiology and Surgery 5/2019 Zur Ausgabe