Skip to main content
Erschienen in: Soft Computing 13/2023

18.05.2023 | Focus

CT and MRI multi-modal medical image fusion using weight-optimized anisotropic diffusion filtering

verfasst von: G. Tirumala Vasu, P. Palanisamy

Erschienen in: Soft Computing | Ausgabe 13/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The purpose of multi-modal medical image fusion is to improve the accuracy of clinical diagnosis; the fused image is produced by retaining the essential characteristics and precise details of the source images. In this paper, we proposed a weight-optimised anisotropic diffusion filtering (WOADF) method to merge computed tomography (CT) image and magnetic resonance (MRI) image. Diffusion of the intensities at the boundaries and detecting significantly meaningful edges in a medical image are two manifestations of an edge-preserving filter. WOADF is an effective method for realising these specifications within a scale space that consists of multiple dimensions. First, the CT and MRI images are decomposed into base layer and detail layer then weight map layers are created through image smoothing with an edge-preserving approach. And these weights are optimised by using the proposed WOADF. Lastly, by using the fusion rule, the optimized weight map layers and the fusion decision map are used to make a fused image. Compared to state-of-the-art standards, the proposed WOADF method outperforms them experimentally in terms of detail retention and visual effect.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Benjamin JR, Jayasree T (2019) An efficient MRI-PET medical image fusion using non-subsampled shearlet transform. In: IEEE International Conference on Intelligent Techniques in Control, Optimization and Signal Processing Benjamin JR, Jayasree T (2019) An efficient MRI-PET medical image fusion using non-subsampled shearlet transform. In: IEEE International Conference on Intelligent Techniques in Control, Optimization and Signal Processing
Zurück zum Zitat Chen CI (2017) Fusion of PET and MR brain images based on IHS and Log-Gabor transforms. IEEE Sens J 17(21):6995–7010CrossRef Chen CI (2017) Fusion of PET and MR brain images based on IHS and Log-Gabor transforms. IEEE Sens J 17(21):6995–7010CrossRef
Zurück zum Zitat Crombé A, Gauquelin L, Nougaret S, Chicart M, Pulido M, Floquet A, Guyon F, Croce S, Kind M, Cazeau A-L (2021) Diffusion-weighted MRI and PET/CT reproducibility in epithelial ovarian cancers during neoadjuvant chemotherapy. Diagn Intervent Imag 102(10):629–639CrossRef Crombé A, Gauquelin L, Nougaret S, Chicart M, Pulido M, Floquet A, Guyon F, Croce S, Kind M, Cazeau A-L (2021) Diffusion-weighted MRI and PET/CT reproducibility in epithelial ovarian cancers during neoadjuvant chemotherapy. Diagn Intervent Imag 102(10):629–639CrossRef
Zurück zum Zitat Dargan S, Kumar M, Ayyagari MR, Kumar G (2020) A Survey of deep learning and its applications: a new paradigm to machine learning. Arch Comput Methods Eng 27:1071–1092MathSciNetCrossRef Dargan S, Kumar M, Ayyagari MR, Kumar G (2020) A Survey of deep learning and its applications: a new paradigm to machine learning. Arch Comput Methods Eng 27:1071–1092MathSciNetCrossRef
Zurück zum Zitat Guo Y, Liu Y, OerlemansLao AS, Wu S, Lew MS (2016) Deep learning for visual understanding: a review. Neurocomputing 187:27–48CrossRef Guo Y, Liu Y, OerlemansLao AS, Wu S, Lew MS (2016) Deep learning for visual understanding: a review. Neurocomputing 187:27–48CrossRef
Zurück zum Zitat Haddadpour M, Daneshvar S, Seyedarabi H (2017) PET and MRI image fusion based on combination of 2-D Hilbert transform and IHS method. Biomed J 40(4):219–225CrossRef Haddadpour M, Daneshvar S, Seyedarabi H (2017) PET and MRI image fusion based on combination of 2-D Hilbert transform and IHS method. Biomed J 40(4):219–225CrossRef
Zurück zum Zitat He C, Liu Q, Li H, Wang H (2010) Multimodal medical image fusion based on IHS and PCA. Procedia Eng 7:280–285CrossRef He C, Liu Q, Li H, Wang H (2010) Multimodal medical image fusion based on IHS and PCA. Procedia Eng 7:280–285CrossRef
Zurück zum Zitat Hermessi H, Mourali O, Zagrouba E (2018) Convolutional neural network-based multimodal image fusion via similarity learning in the shearlet domain. Neural Comput Appl 30:2029–2045CrossRef Hermessi H, Mourali O, Zagrouba E (2018) Convolutional neural network-based multimodal image fusion via similarity learning in the shearlet domain. Neural Comput Appl 30:2029–2045CrossRef
Zurück zum Zitat Hill P, Achim A, Al-Mualla ME, Bull D (2016) Contrast sensitivity of the wavelet, dual tree complex wavelet, curvelet, and steerable pyramid transforms. IEEE Trans Image Process 25(6):2739–2751MathSciNetCrossRefMATH Hill P, Achim A, Al-Mualla ME, Bull D (2016) Contrast sensitivity of the wavelet, dual tree complex wavelet, curvelet, and steerable pyramid transforms. IEEE Trans Image Process 25(6):2739–2751MathSciNetCrossRefMATH
Zurück zum Zitat Kang J, Lu W, Zhang W (2020) Fusion of brain PET and MRI images using tissue-aware conditional generative adversarial network with joint loss. IEEE Access 8:6368–6378CrossRef Kang J, Lu W, Zhang W (2020) Fusion of brain PET and MRI images using tissue-aware conditional generative adversarial network with joint loss. IEEE Access 8:6368–6378CrossRef
Zurück zum Zitat Khemila H, Chibani BR (2016) Bayesian fusion: application in medical imaging. In: 2016 17th International Conference on Sciences and Techniques of Automatic Control and Computer Engineering Khemila H, Chibani BR (2016) Bayesian fusion: application in medical imaging. In: 2016 17th International Conference on Sciences and Techniques of Automatic Control and Computer Engineering
Zurück zum Zitat Li Shutao, Kang Xudong (2012) Fast multi-exposure image fusion with median filter and recursive filter. IEEE Trans Consum Electron 58(2):626–632CrossRef Li Shutao, Kang Xudong (2012) Fast multi-exposure image fusion with median filter and recursive filter. IEEE Trans Consum Electron 58(2):626–632CrossRef
Zurück zum Zitat Li S, Kang X, Hu J (2013) Image fusion with guided filtering. IEEE Trans Image Process 22(7):2864–2875CrossRef Li S, Kang X, Hu J (2013) Image fusion with guided filtering. IEEE Trans Image Process 22(7):2864–2875CrossRef
Zurück zum Zitat Li Shutao, Kang Xudong, Jianwen Hu (2013) Image fusion with guided filtering. IEEE Trans Image Process 22(7):2864–2875CrossRef Li Shutao, Kang Xudong, Jianwen Hu (2013) Image fusion with guided filtering. IEEE Trans Image Process 22(7):2864–2875CrossRef
Zurück zum Zitat Li X, Guo X, Han P, Wang X, Li H, Luo T (2020) Laplacian redecomposition for multimodal medical image fusion. IEEE Trans Instrum Meas 69(9):6880–6890CrossRef Li X, Guo X, Han P, Wang X, Li H, Luo T (2020) Laplacian redecomposition for multimodal medical image fusion. IEEE Trans Instrum Meas 69(9):6880–6890CrossRef
Zurück zum Zitat Liu Y, Liu S, Wang Z (2014) Medical image fusion by combining nonsubsampled contourlet transform and sparse representation. In: Chinese Conference on Pattern Recognition Liu Y, Liu S, Wang Z (2014) Medical image fusion by combining nonsubsampled contourlet transform and sparse representation. In: Chinese Conference on Pattern Recognition
Zurück zum Zitat Liu Y, Yang J, Sun J (2010) PET/CT medical image fusion algorithm based on multi-wavelet transform. In: 2nd International Conference on Advanced Computer Control Liu Y, Yang J, Sun J (2010) PET/CT medical image fusion algorithm based on multi-wavelet transform. In: 2nd International Conference on Advanced Computer Control
Zurück zum Zitat Liu Y, Yang J, Sun J (2010) PET/CT medical image fusion algorithm based on multiwavelet transform. In: 2010 2nd International Conference on Advanced Computer Control Liu Y, Yang J, Sun J (2010) PET/CT medical image fusion algorithm based on multiwavelet transform. In: 2010 2nd International Conference on Advanced Computer Control
Zurück zum Zitat Liu Y, Liu S, Wang Z (2015) A general framework for image fusion based on multi-scale transform and sparse representation. Inf Fusion 24:147–164CrossRef Liu Y, Liu S, Wang Z (2015) A general framework for image fusion based on multi-scale transform and sparse representation. Inf Fusion 24:147–164CrossRef
Zurück zum Zitat Mi S, Zhang L, Peng H, Wang J (2021) Medical image fusion based on DTNP systems and Laplacian pyramid. J Membr Comput 3:284–295MathSciNetCrossRef Mi S, Zhang L, Peng H, Wang J (2021) Medical image fusion based on DTNP systems and Laplacian pyramid. J Membr Comput 3:284–295MathSciNetCrossRef
Zurück zum Zitat Muthiah MA, Logashamugam E, Reddy BKV (2019) Fusion of MRI and PET images using deep learning neural networks. In: 2nd International Conference on Power and Embedded Drive Control (ICPEDC) Muthiah MA, Logashamugam E, Reddy BKV (2019) Fusion of MRI and PET images using deep learning neural networks. In: 2nd International Conference on Power and Embedded Drive Control (ICPEDC)
Zurück zum Zitat Nischitha, Padmavathi NB (2017) Fusion of multimodal abdominal cancerous images and classification using support vector machine. In: 2017 International Conference on Intelligent Sustainable Systems (ICISS) Nischitha, Padmavathi NB (2017) Fusion of multimodal abdominal cancerous images and classification using support vector machine. In: 2017 International Conference on Intelligent Sustainable Systems (ICISS)
Zurück zum Zitat Peijun T, Xu J, Wang R (2019) Visualization of the comprehensive birefringent information in polarization-sensitive optical coherence tomography. In: Optical Coherence Tomography and Coherence Domain Optical Methods in Biomedicine Peijun T, Xu J, Wang R (2019) Visualization of the comprehensive birefringent information in polarization-sensitive optical coherence tomography. In: Optical Coherence Tomography and Coherence Domain Optical Methods in Biomedicine
Zurück zum Zitat Perona P, Malik J (1990) Scale-space and edge detection using anisotropic diffusion. IEEE Trans Pattern Anal Mach Intell 12(7):629–639CrossRef Perona P, Malik J (1990) Scale-space and edge detection using anisotropic diffusion. IEEE Trans Pattern Anal Mach Intell 12(7):629–639CrossRef
Zurück zum Zitat Prakash O, Park CM, Khare A, Jeon M, Gwak J (2019) Multiscale fusion of multi modal medical images using lifting scheme based biorthogonal wavelet transform. Optik 182:995–1014CrossRef Prakash O, Park CM, Khare A, Jeon M, Gwak J (2019) Multiscale fusion of multi modal medical images using lifting scheme based biorthogonal wavelet transform. Optik 182:995–1014CrossRef
Zurück zum Zitat Qu G, Zhang D, Yan P (2002) Information measure for performance of image fusion. Electron Lett 38(7):1CrossRef Qu G, Zhang D, Yan P (2002) Information measure for performance of image fusion. Electron Lett 38(7):1CrossRef
Zurück zum Zitat Sahiner B, Pezeshk A, Hadjiiski LM, Wang X, Drukker K, Cha KH, Summers RM, Giger ML (2019) Deep learning in medical imaging and radiation therapy. Med Phys 46(1):e1–e36CrossRef Sahiner B, Pezeshk A, Hadjiiski LM, Wang X, Drukker K, Cha KH, Summers RM, Giger ML (2019) Deep learning in medical imaging and radiation therapy. Med Phys 46(1):e1–e36CrossRef
Zurück zum Zitat Shabanzade F, Ghassemian H (2017) Combination of wavelet and contourlet transforms for PET and MRI image fusion. In: 2017 Artificial Intelligence and Signal Processing Conference (AISP) Shabanzade F, Ghassemian H (2017) Combination of wavelet and contourlet transforms for PET and MRI image fusion. In: 2017 Artificial Intelligence and Signal Processing Conference (AISP)
Zurück zum Zitat Shen Dinggang, Guorong Wu, Suk Heung-Il (2017) Deep learning in medical image analysis. Annu Rev Biomed Eng 19(1):221–248CrossRef Shen Dinggang, Guorong Wu, Suk Heung-Il (2017) Deep learning in medical image analysis. Annu Rev Biomed Eng 19(1):221–248CrossRef
Zurück zum Zitat Singh S, Anand RS (2018) Ripplet domain fusion approach for CT and MR medical image information. Biomed Signal Process Control 46:281–292CrossRef Singh S, Anand RS (2018) Ripplet domain fusion approach for CT and MR medical image information. Biomed Signal Process Control 46:281–292CrossRef
Zurück zum Zitat Singh R, Khare A (2014) Redundant discrete wavelet transform based medical image fusion. Advances in intelligent systems and computing. Springer, pp 505–515 Singh R, Khare A (2014) Redundant discrete wavelet transform based medical image fusion. Advances in intelligent systems and computing. Springer, pp 505–515
Zurück zum Zitat Singh Rajiv, Khare Ashish (2014) Fusion of multimodal medical images using Daubechies complex wavelet transform—a multiresolution approach. Inf Fusion 19:49–60CrossRef Singh Rajiv, Khare Ashish (2014) Fusion of multimodal medical images using Daubechies complex wavelet transform—a multiresolution approach. Inf Fusion 19:49–60CrossRef
Zurück zum Zitat Tabarsaii S, Aghagolzade A, Ezoji M (2019) Sparse representation-based multi-focus image fusion in a hybrid of DWT and NSCT. In: 2019 4th International Conference on Pattern Recognition and Image Analysis Tabarsaii S, Aghagolzade A, Ezoji M (2019) Sparse representation-based multi-focus image fusion in a hybrid of DWT and NSCT. In: 2019 4th International Conference on Pattern Recognition and Image Analysis
Zurück zum Zitat Talbar SN, Chavan SS, Pawar A (2018) Non-subsampled complex wavelet transform based medical image fusion. In: Proceedings of the Future Technologies Conference (FTC) 2018 Talbar SN, Chavan SS, Pawar A (2018) Non-subsampled complex wavelet transform based medical image fusion. In: Proceedings of the Future Technologies Conference (FTC) 2018
Zurück zum Zitat Wang P, Liu B (2008) A novel image fusion metric based on multi-scale analysis. In: IEEE International Conference. Signal Processing Wang P, Liu B (2008) A novel image fusion metric based on multi-scale analysis. In: IEEE International Conference. Signal Processing
Zurück zum Zitat Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error measurement to structural similarity. IEEE Trans Image Process 13(1):31–44 Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error measurement to structural similarity. IEEE Trans Image Process 13(1):31–44
Zurück zum Zitat Wang Q, Shen Y, Jin J (2008) Performance evaluation of image fusion techniques. Image Fusion Algorithms Appl 19:469–492CrossRef Wang Q, Shen Y, Jin J (2008) Performance evaluation of image fusion techniques. Image Fusion Algorithms Appl 19:469–492CrossRef
Zurück zum Zitat Xydeas CS, Petrovic V (2000) Objective image fusion performance measure. Electron Lett 36(4):308–309CrossRef Xydeas CS, Petrovic V (2000) Objective image fusion performance measure. Electron Lett 36(4):308–309CrossRef
Zurück zum Zitat Xydeas CS, Petrović V (2000) Objective image fusion performance measure. Electron Lett 36(4):308–309CrossRef Xydeas CS, Petrović V (2000) Objective image fusion performance measure. Electron Lett 36(4):308–309CrossRef
Zurück zum Zitat Yang L, Guo BL, Ni W (2008) Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform. Neurocomputing 72(1–3):203–211CrossRef Yang L, Guo BL, Ni W (2008) Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform. Neurocomputing 72(1–3):203–211CrossRef
Zurück zum Zitat Yang Y, Tong S, Huang S, Lin P (2015) Multifocus image fusion based on NSCT and focused area detection. IEEE Sens J 15(5):2824–2838 Yang Y, Tong S, Huang S, Lin P (2015) Multifocus image fusion based on NSCT and focused area detection. IEEE Sens J 15(5):2824–2838
Zurück zum Zitat Yang Y, Que Y, Huang S, Lin P (2016) Multimodal sensor medical image fusion based on type-2 fuzzy logic in NSCT domain. IEEE Sens J 16(10):3735–3745CrossRef Yang Y, Que Y, Huang S, Lin P (2016) Multimodal sensor medical image fusion based on type-2 fuzzy logic in NSCT domain. IEEE Sens J 16(10):3735–3745CrossRef
Metadaten
Titel
CT and MRI multi-modal medical image fusion using weight-optimized anisotropic diffusion filtering
verfasst von
G. Tirumala Vasu
P. Palanisamy
Publikationsdatum
18.05.2023
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 13/2023
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-023-08419-y

Weitere Artikel der Ausgabe 13/2023

Soft Computing 13/2023 Zur Ausgabe

Premium Partner