Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 2/2018

18.12.2017 | Original Article

Improved medical image fusion based on cascaded PCA and shift invariant wavelet transforms

verfasst von: J. Reena Benjamin, T. Jayasree

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 2/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

In the medical field, radiologists need more informative and high-quality medical images to diagnose diseases. Image fusion plays a vital role in the field of biomedical image analysis. It aims to integrate the complementary information from multimodal images, producing a new composite image which is expected to be more informative for visual perception than any of the individual input images. The main objective of this paper is to improve the information, to preserve the edges and to enhance the quality of the fused image using cascaded principal component analysis (PCA) and shift invariant wavelet transforms.

Methods

A novel image fusion technique based on cascaded PCA and shift invariant wavelet transforms is proposed in this paper. PCA in spatial domain extracts relevant information from the large dataset based on eigenvalue decomposition, and the wavelet transform operating in the complex domain with shift invariant properties brings out more directional and phase details of the image. The significance of maximum fusion rule applied in dual-tree complex wavelet transform domain enhances the average information and morphological details.

Results

The input images of the human brain of two different modalities (MRI and CT) are collected from whole brain atlas data distributed by Harvard University. Both MRI and CT images are fused using cascaded PCA and shift invariant wavelet transform method. The proposed method is evaluated based on three main key factors, namely structure preservation, edge preservation, contrast preservation. The experimental results and comparison with other existing fusion methods show the superior performance of the proposed image fusion framework in terms of visual and quantitative evaluations.

Conclusion

In this paper, a complex wavelet-based image fusion has been discussed. The experimental results demonstrate that the proposed method enhances the directional features as well as fine edge details. Also, it reduces the redundant details, artifacts, distortions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Pappachan A, Dasarathy BV (2014) Medical image fusion: a survey of the state of the art. Inf Fusion 19:4–19CrossRef Pappachan A, Dasarathy BV (2014) Medical image fusion: a survey of the state of the art. Inf Fusion 19:4–19CrossRef
2.
Zurück zum Zitat Liu Y, Liu S, Wang Z (2015) Multi-focus image fusion with dense SIFT. Inf Fusion 23:139–155CrossRef Liu Y, Liu S, Wang Z (2015) Multi-focus image fusion with dense SIFT. Inf Fusion 23:139–155CrossRef
3.
Zurück zum Zitat Wang Z, Ziou D, Armenakis C, Li D, Li Q (2005) A comparative analysis of image fusion methods. IEEE Trans Geosci Remote Sens 43(6):1391–1402CrossRef Wang Z, Ziou D, Armenakis C, Li D, Li Q (2005) A comparative analysis of image fusion methods. IEEE Trans Geosci Remote Sens 43(6):1391–1402CrossRef
4.
Zurück zum Zitat Bhateja V, Patel H, Krishna A, Lay-Ekuakille A (2015) Multimodal medical image sensor fusion framework using cascade of wavelet and contourlet transform domains. IEEE Sens J 15(12):6783–6790CrossRef Bhateja V, Patel H, Krishna A, Lay-Ekuakille A (2015) Multimodal medical image sensor fusion framework using cascade of wavelet and contourlet transform domains. IEEE Sens J 15(12):6783–6790CrossRef
5.
Zurück zum Zitat He C, Liu Q, Li H, Wang H (2010) Multimodal medical image fusion based on HIS and PCA. Procedia Eng 7:280–285CrossRef He C, Liu Q, Li H, Wang H (2010) Multimodal medical image fusion based on HIS and PCA. Procedia Eng 7:280–285CrossRef
6.
Zurück zum Zitat Bedi SS, Khandelwal R (2013) Contrast enhancement for PCA fusion of medical images. J Glob Res Comput Sci 4:25–29 Bedi SS, Khandelwal R (2013) Contrast enhancement for PCA fusion of medical images. J Glob Res Comput Sci 4:25–29
7.
Zurück zum Zitat Li S, Kang X, Fang L, Hu T, Yin H (2017) Pixel level image fusion: a survey of the state of the art. Inf Fusion 33:100–112 Li S, Kang X, Fang L, Hu T, Yin H (2017) Pixel level image fusion: a survey of the state of the art. Inf Fusion 33:100–112
8.
Zurück zum Zitat Nandi D, Ashour AS, Samanta S, Chakraborty S, Salem MAM, Dey N (2015) Principal component analysis in medical image processing: a study. Int J Image Min 1(1):65–83CrossRef Nandi D, Ashour AS, Samanta S, Chakraborty S, Salem MAM, Dey N (2015) Principal component analysis in medical image processing: a study. Int J Image Min 1(1):65–83CrossRef
9.
Zurück zum Zitat Wan T, Zhu C, Qin Z (2013) Multifocus image fusion based on robust principal component analysis. Pattern Recognit Lett 34:1001–1008CrossRef Wan T, Zhu C, Qin Z (2013) Multifocus image fusion based on robust principal component analysis. Pattern Recognit Lett 34:1001–1008CrossRef
10.
Zurück zum Zitat Suraj AA, Francis M, Kavya T, Nirmal TM (2014) Discrete wavelet transform based image fusion and denoising in FPGA. J Electr Syst Inf Technol 1:72–81 Suraj AA, Francis M, Kavya T, Nirmal TM (2014) Discrete wavelet transform based image fusion and denoising in FPGA. J Electr Syst Inf Technol 1:72–81
11.
Zurück zum Zitat Singh R, Khare A (2014) Fusion of multimodal medical images using Daubechies complex wavelet transform–a multiresolution approach. Inf Fusion 19:49–60CrossRef Singh R, Khare A (2014) Fusion of multimodal medical images using Daubechies complex wavelet transform–a multiresolution approach. Inf Fusion 19:49–60CrossRef
12.
Zurück zum Zitat Wei H, Viallon M, Delattre BMA, Moulin K, Yang F, Croisille P, Zhu Y (2015) Free breathing diffusion tensor imaging and tractography of the human heart in healthy volunteers using wavelet based image fusion. IEEE Trans Med Imaging 34(1):306–316CrossRefPubMed Wei H, Viallon M, Delattre BMA, Moulin K, Yang F, Croisille P, Zhu Y (2015) Free breathing diffusion tensor imaging and tractography of the human heart in healthy volunteers using wavelet based image fusion. IEEE Trans Med Imaging 34(1):306–316CrossRefPubMed
13.
Zurück zum Zitat Prakash O, Srivastava R, Khare A (2013) Biorthogonal wavelet transform based image fusion using absolute maximum fusion rule. In: Proceedings of 2013, IEEE international conference on information and communication technologies, pp 758–763 Prakash O, Srivastava R, Khare A (2013) Biorthogonal wavelet transform based image fusion using absolute maximum fusion rule. In: Proceedings of 2013, IEEE international conference on information and communication technologies, pp 758–763
14.
Zurück zum Zitat Tu TM, Huang PS, Hung CL, Hung CP, Chang A (2004) A fast intensity hue saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Geosci Remote Sens Lett 1(4):309–312 Tu TM, Huang PS, Hung CL, Hung CP, Chang A (2004) A fast intensity hue saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Geosci Remote Sens Lett 1(4):309–312
15.
Zurück zum Zitat Ellmauthaler A, Pagliari CL, da Silva EAB (2013) Multiscale image fusion using the undecimated wavelet transform with spectral factorization and nonorthogonal filter banks. IEEE Trans Image Process 22(3):1005–1017CrossRefPubMed Ellmauthaler A, Pagliari CL, da Silva EAB (2013) Multiscale image fusion using the undecimated wavelet transform with spectral factorization and nonorthogonal filter banks. IEEE Trans Image Process 22(3):1005–1017CrossRefPubMed
16.
Zurück zum Zitat Nandeesh MD, Meenakshi M (2015) A novel technique of medical image fusion using stationary wavelet transform and principal component analysis. In: 2015 international conference on smart sensors and systems (IC-SSS), pp 1–5 Nandeesh MD, Meenakshi M (2015) A novel technique of medical image fusion using stationary wavelet transform and principal component analysis. In: 2015 international conference on smart sensors and systems (IC-SSS), pp 1–5
17.
Zurück zum Zitat Harpreet K, Rachna R (2015) A combined approach using DWT & PCA on image fusion. Int J Adv Res Comput Commun Eng 4(9):294–296 Harpreet K, Rachna R (2015) A combined approach using DWT & PCA on image fusion. Int J Adv Res Comput Commun Eng 4(9):294–296
18.
Zurück zum Zitat Vijayarajan R, Muttan S (2015) Discrete wavelet transform based principal averaging fusion for medical images. Int J Electron Commun 69:896–902 Vijayarajan R, Muttan S (2015) Discrete wavelet transform based principal averaging fusion for medical images. Int J Electron Commun 69:896–902
19.
Zurück zum Zitat Pawar MM, Kulkarni NP (2014) Image resolution using multiwavelet transforms with interpolation technique. J Electr Electron Eng 9:9–13 Pawar MM, Kulkarni NP (2014) Image resolution using multiwavelet transforms with interpolation technique. J Electr Electron Eng 9:9–13
20.
Zurück zum Zitat Khare A, Tiwary US, Pedrycz W, Jeon M (2010) Multilevel adaptive thresholding and shrinkage technique for denoising using Daubechies complex wavelet transform. Imaging Sci J 58:340–358CrossRef Khare A, Tiwary US, Pedrycz W, Jeon M (2010) Multilevel adaptive thresholding and shrinkage technique for denoising using Daubechies complex wavelet transform. Imaging Sci J 58:340–358CrossRef
21.
Zurück zum Zitat Liu Y, Liu S, Wang Z (2015) A general framework for image fusion based on multi-scale transform and sparse representation. Inf Fusion 24:147–164CrossRef Liu Y, Liu S, Wang Z (2015) A general framework for image fusion based on multi-scale transform and sparse representation. Inf Fusion 24:147–164CrossRef
22.
Zurück zum Zitat Singh RR, Mishra R (2015) Benefits of dual tree complex wavelet transform over discrete wavelet transform for image fusion. Int J Innov Res Sci Technol 1(11):259–263 Singh RR, Mishra R (2015) Benefits of dual tree complex wavelet transform over discrete wavelet transform for image fusion. Int J Innov Res Sci Technol 1(11):259–263
23.
Zurück zum Zitat Chauhan RPS, Dwivedi R, Bhaga R (2013) Comparative analysis of discrete wavelet transform and complex wavelet transform for image fusion and denoising. Int J Eng Sci Invent 2(3):18–27 Chauhan RPS, Dwivedi R, Bhaga R (2013) Comparative analysis of discrete wavelet transform and complex wavelet transform for image fusion and denoising. Int J Eng Sci Invent 2(3):18–27
24.
Zurück zum Zitat Chatterjee P, Ghoshal S, Biswas B, Chakrabarti A, Dey KN (2015) Medical image fusion using Daubechies complex wavelet and near set. In: Transactions on computational science XXV, Volume 9030 of the series lecture notes in computer science, pp 90–111 Chatterjee P, Ghoshal S, Biswas B, Chakrabarti A, Dey KN (2015) Medical image fusion using Daubechies complex wavelet and near set. In: Transactions on computational science XXV, Volume 9030 of the series lecture notes in computer science, pp 90–111
25.
Zurück zum Zitat Lu C, Chelikani S, Jaffray DA, Milosevic MF, Staib LH, Duncan JS (2012) Simultaneous non rigid registration, segmentation and tumor detection in MRI guided cervical cancer radiation therapy. IEEE Trans Med Imaging 31(6):1213–1227CrossRefPubMedPubMedCentral Lu C, Chelikani S, Jaffray DA, Milosevic MF, Staib LH, Duncan JS (2012) Simultaneous non rigid registration, segmentation and tumor detection in MRI guided cervical cancer radiation therapy. IEEE Trans Med Imaging 31(6):1213–1227CrossRefPubMedPubMedCentral
26.
Zurück zum Zitat Alam F, Rahman SU, Ullah S, Gulati K (October 2017) Medical image registration in image guided surgery: issues, challenges and research opportunities. Biocybern Biomed Eng 38:71–89 Alam F, Rahman SU, Ullah S, Gulati K (October 2017) Medical image registration in image guided surgery: issues, challenges and research opportunities. Biocybern Biomed Eng 38:71–89
27.
Zurück zum Zitat Zhang Y, Shi F, Wu G, Wang L, Yap PT, Shen D (2016) Consistent spatial–temporal longitudinal atlas construction for developing infant brains. IEEE Trans Med Imaging 35(12):2568–2577CrossRefPubMed Zhang Y, Shi F, Wu G, Wang L, Yap PT, Shen D (2016) Consistent spatial–temporal longitudinal atlas construction for developing infant brains. IEEE Trans Med Imaging 35(12):2568–2577CrossRefPubMed
28.
Zurück zum Zitat Zhang Y, Shi F, Yap P-T, Shen D (2016) Detail-preserving construction of neonatal brain atlases in space-frequency domain. Hum Brain Mapp 37(6):2133–2150CrossRefPubMed Zhang Y, Shi F, Yap P-T, Shen D (2016) Detail-preserving construction of neonatal brain atlases in space-frequency domain. Hum Brain Mapp 37(6):2133–2150CrossRefPubMed
29.
Zurück zum Zitat Solanki CK, Patel NM (2011) Pixel based and wavelet based image fusion methods with their comparative study. In: National conference on recent trends in engineering & technology, pp 13–14 Solanki CK, Patel NM (2011) Pixel based and wavelet based image fusion methods with their comparative study. In: National conference on recent trends in engineering & technology, pp 13–14
30.
Zurück zum Zitat Xydeas CS (2000) Petrovic: objective image fusion performance measure. Electron Lett 36:308–309 Xydeas CS (2000) Petrovic: objective image fusion performance measure. Electron Lett 36:308–309
31.
Zurück zum Zitat Bhavana V, Krishnappa HK (2015) Multi-modality medical image fusion using discrete wavelet transform. Procedia Comput Sci 70:625–631CrossRef Bhavana V, Krishnappa HK (2015) Multi-modality medical image fusion using discrete wavelet transform. Procedia Comput Sci 70:625–631CrossRef
32.
Zurück zum Zitat Udhaya Suriya TS, Rangarajan P (2017) Brain tumor detection using discrete wavelet transform based medical image fusion. Biomed Res 2017:684–688 Udhaya Suriya TS, Rangarajan P (2017) Brain tumor detection using discrete wavelet transform based medical image fusion. Biomed Res 2017:684–688
33.
Zurück zum Zitat Sultana T, Dulal Hossain MD, Karam Newaz MD (2016) Analysis on SWT based image fusion techniques using intuitionistic fuzzy set operations. Int J Technol Enhanc Emerg Eng Res 4:16–19 Sultana T, Dulal Hossain MD, Karam Newaz MD (2016) Analysis on SWT based image fusion techniques using intuitionistic fuzzy set operations. Int J Technol Enhanc Emerg Eng Res 4:16–19
34.
Zurück zum Zitat Saravanan V, Babu G, Siva Kumar R, Monie EC (2016) Medical image fusion by PCA method and implementation on FPGA. Int J Emerg Trends Sci Technol 3(05):800–806. ISSN: 2348–9480 Saravanan V, Babu G, Siva Kumar R, Monie EC (2016) Medical image fusion by PCA method and implementation on FPGA. Int J Emerg Trends Sci Technol 3(05):800–806. ISSN: 2348–9480
35.
Zurück zum Zitat Kuswaha L , Thakare VV (2017) A critical review on image fusion. Int J Innov Res Comput Commun Eng 5(5) Kuswaha L , Thakare VV (2017) A critical review on image fusion. Int J Innov Res Comput Commun Eng 5(5)
36.
Zurück zum Zitat Kaur D (2016) Image fusion using a hybrid technique (\(\text{ PCA }+\text{ SWT }\)). Int J Eng Comput Sci 5(02):15661–15667CrossRef Kaur D (2016) Image fusion using a hybrid technique (\(\text{ PCA }+\text{ SWT }\)). Int J Eng Comput Sci 5(02):15661–15667CrossRef
37.
Zurück zum Zitat Hill P, Al-Mualla ME, Bull D (2017) Perceptual image fusion using wavelets. IEEE Trans Image Process 26(3):1076–1088CrossRefPubMed Hill P, Al-Mualla ME, Bull D (2017) Perceptual image fusion using wavelets. IEEE Trans Image Process 26(3):1076–1088CrossRefPubMed
38.
Zurück zum Zitat Bhandaril PK, Venkasteshappa, Raj CP (2016) An efficient method of image fusion using SWT and DTCWT. Int J Electron Commun Eng 9:29–37 Bhandaril PK, Venkasteshappa, Raj CP (2016) An efficient method of image fusion using SWT and DTCWT. Int J Electron Commun Eng 9:29–37
Metadaten
Titel
Improved medical image fusion based on cascaded PCA and shift invariant wavelet transforms
verfasst von
J. Reena Benjamin
T. Jayasree
Publikationsdatum
18.12.2017
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 2/2018
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-017-1692-4

Weitere Artikel der Ausgabe 2/2018

International Journal of Computer Assisted Radiology and Surgery 2/2018 Zur Ausgabe