Skip to main content
Erschienen in: Neural Computing and Applications 6/2012

01.09.2012 | Original Article

GA-based multiresolution fusion of segmented brain images using PD-, T1- and T2-weighted MR modalities

verfasst von: Mahua Bhattacharya, Arpita Das, M. Chandana

Erschienen in: Neural Computing and Applications | Ausgabe 6/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Medical image fusion has been used to derive the useful complimentary information from multimodality imaging. The proposed methodology introduces fusion approach for robust and automatic extraction of information from segmented images of different modalities. This fusion strategy is implemented in multiresolution domain using wavelet transform- and genetic algorithm-based search technique to extract maximum complementary information. The analysis of input images at multiple resolutions is able to extract more fine details and improves the quality of the composite fused image. The proposed approaches are also independent of any manual marking or knowledge of fiducial points and start the fusion procedure automatically. The performance of fusion scheme implemented on segmented brain images has been evaluated computing mutual information as similarity measuring matrix. Prior to fusion process, images are being segmented using different segmentation techniques like fuzzy C-mean and Markov random field models. Experimental results show that Gibbs- and ICM-based segmentation approaches related to Markov random field perform over the fuzzy C-mean and which are being used prior to GA-based fusion process for MR T1, MR T2 and MR PD images of section of human brain.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Barra V, Boire J-Y (2001) A general framework for the fusion of anatomical and functional medical images. NeuroImage 13(3):410–424CrossRef Barra V, Boire J-Y (2001) A general framework for the fusion of anatomical and functional medical images. NeuroImage 13(3):410–424CrossRef
2.
Zurück zum Zitat Wang Z, Ziou D, Armenakis C, Li D, Li Q (2005) A comparative analysis of image fusion methods. IEEE Trans Geosci Remote Sensing 43(6):1391–1402CrossRef Wang Z, Ziou D, Armenakis C, Li D, Li Q (2005) A comparative analysis of image fusion methods. IEEE Trans Geosci Remote Sensing 43(6):1391–1402CrossRef
3.
Zurück zum Zitat Garg S, Kiran KU, Mohan R, Tiwary US (2005) Multilevel medical image fusion using segmented image by level set evolution with region competition. In: Proceedings of 27th IEEE engineering in medicine and biology conference (EMBC-05), Shanghai, China, September 1–4, 2005 Garg S, Kiran KU, Mohan R, Tiwary US (2005) Multilevel medical image fusion using segmented image by level set evolution with region competition. In: Proceedings of 27th IEEE engineering in medicine and biology conference (EMBC-05), Shanghai, China, September 1–4, 2005
4.
Zurück zum Zitat Guihong Q, Dali Z, Pingfan Y (2001) Medical image fusion by wavelet transform modulus maxima. Opt Exp 9:184–190CrossRef Guihong Q, Dali Z, Pingfan Y (2001) Medical image fusion by wavelet transform modulus maxima. Opt Exp 9:184–190CrossRef
5.
Zurück zum Zitat Dutta Majumder D, Bhattacharya M (1998) Soft computing methods for uncertainty management in multimodal image registration and fusion problems. In: International conference of information sciences JCIS-98, North Carolina, Duke University, USA, October 1998 Dutta Majumder D, Bhattacharya M (1998) Soft computing methods for uncertainty management in multimodal image registration and fusion problems. In: International conference of information sciences JCIS-98, North Carolina, Duke University, USA, October 1998
6.
Zurück zum Zitat Dutta Majumder D, Bhattacharya M (2000) Cybernetic approach to medical technology: application to cancer screening and other diagnostics, millennium volume of kybernetes. Int J Syst Cybernet 29(7/8):871–895 (MCB publications, Emerald, UK) Dutta Majumder D, Bhattacharya M (2000) Cybernetic approach to medical technology: application to cancer screening and other diagnostics, millennium volume of kybernetes. Int J Syst Cybernet 29(7/8):871–895 (MCB publications, Emerald, UK)
7.
Zurück zum Zitat Bloch I (1996) Information combination operators for data fusion: a comparative review with classification. IEEE Trans Syst Man Cybernet Part A Syst Humans 26(1):52–67 Bloch I (1996) Information combination operators for data fusion: a comparative review with classification. IEEE Trans Syst Man Cybernet Part A Syst Humans 26(1):52–67
8.
Zurück zum Zitat Chanussot J, Mauris G, Lambert P (1999) Fuzzy fusion techniques for linear features detection in multitemporal SAR images. IEEE Trans Geosci Remote Sensing 37(3):1292–1305 Chanussot J, Mauris G, Lambert P (1999) Fuzzy fusion techniques for linear features detection in multitemporal SAR images. IEEE Trans Geosci Remote Sensing 37(3):1292–1305
9.
Zurück zum Zitat Zhu Y-M, Cochoff SM (2006) An object-oriented framework for medical image registration, fusion, and visualization. Comput Methods Programs Biomed 82(3):258–267CrossRef Zhu Y-M, Cochoff SM (2006) An object-oriented framework for medical image registration, fusion, and visualization. Comput Methods Programs Biomed 82(3):258–267CrossRef
10.
Zurück zum Zitat Petrovic VS, Xydeas CS (2004) Gradient-based multiresolution image fusion. IEEE Trans Image Process 13(2):228–237CrossRef Petrovic VS, Xydeas CS (2004) Gradient-based multiresolution image fusion. IEEE Trans Image Process 13(2):228–237CrossRef
11.
Zurück zum Zitat Redondo R, Sroubek F, Fischer S, Cristobal G (2009) Multifocus image fusion using the log-Gabor transform and a Multisize Windows technique. Inform Fusion 10(2):163–171CrossRef Redondo R, Sroubek F, Fischer S, Cristobal G (2009) Multifocus image fusion using the log-Gabor transform and a Multisize Windows technique. Inform Fusion 10(2):163–171CrossRef
12.
Zurück zum Zitat Li S, Yang B (2008) Multifocus image fusion using region segmentation and spatial frequency. Image Vis Comput 26(7):971–979CrossRef Li S, Yang B (2008) Multifocus image fusion using region segmentation and spatial frequency. Image Vis Comput 26(7):971–979CrossRef
13.
Zurück zum Zitat Dutta Majumder D, Bhattacharya M (1998) Multimodal data fusion for alzheimer’s patients using dempster-shafer theory of evidence. In: 3rd Asian fuzzy systems symposium 1998, Korea, Proceedings, pp 713–719 Dutta Majumder D, Bhattacharya M (1998) Multimodal data fusion for alzheimer’s patients using dempster-shafer theory of evidence. In: 3rd Asian fuzzy systems symposium 1998, Korea, Proceedings, pp 713–719
14.
Zurück zum Zitat Leahy R, Yan X (1991) Incorporation of anatomical MR data for improved functional imaging with PET. In: Colchester ACF, Hawkes DJ (eds) information processing in medical imaging. Springer, New York, pp 105–120 Leahy R, Yan X (1991) Incorporation of anatomical MR data for improved functional imaging with PET. In: Colchester ACF, Hawkes DJ (eds) information processing in medical imaging. Springer, New York, pp 105–120
15.
Zurück zum Zitat Hurn MA, Mardia KV (1996) Bayesian fused classification of medical images. IEEE Trans Med Imaging 15:850–858CrossRef Hurn MA, Mardia KV (1996) Bayesian fused classification of medical images. IEEE Trans Med Imaging 15:850–858CrossRef
16.
Zurück zum Zitat Garvey TD, Lowrance JD, Fischler MA (1981) An inference technique for integrating knowledge from disparate sources. In: Proceedings of 7th international conference on artificial intelligence. Vancouver, BC, Canada, pp 319–325 Garvey TD, Lowrance JD, Fischler MA (1981) An inference technique for integrating knowledge from disparate sources. In: Proceedings of 7th international conference on artificial intelligence. Vancouver, BC, Canada, pp 319–325
17.
Zurück zum Zitat Le H`egarat-Mascle S, Bloch I, Vidal-Madjar D (1997) Application of Dempster-Shafer evidence theory to unsupervised classification in multisource remote sensing. IEEE Trans Geosci Remote Sensing 35:1018–1031 Le H`egarat-Mascle S, Bloch I, Vidal-Madjar D (1997) Application of Dempster-Shafer evidence theory to unsupervised classification in multisource remote sensing. IEEE Trans Geosci Remote Sensing 35:1018–1031
18.
Zurück zum Zitat Bruzzone L, Fern’andez Prieto D, Serpico SB (1999) A neural-statistical approach to multitemporal and multisource remote-sensing image classification. IEEE Trans Geosci Remote Sensing 37(3):1350–1359 Bruzzone L, Fern’andez Prieto D, Serpico SB (1999) A neural-statistical approach to multitemporal and multisource remote-sensing image classification. IEEE Trans Geosci Remote Sensing 37(3):1350–1359
19.
Zurück zum Zitat Li M, Cai W, Tan Z (2006) A region-based multi-sensor image fusion scheme using pulse-coupled neural network. Pattern Recogn Lett 27(16):1948–1956CrossRef Li M, Cai W, Tan Z (2006) A region-based multi-sensor image fusion scheme using pulse-coupled neural network. Pattern Recogn Lett 27(16):1948–1956CrossRef
20.
Zurück zum Zitat Pradhan PS, King RL, Younan NH, Holcomb DW (2006) Estimation of the number of decomposition levels for a wavelet-based multiresolution multisensor image fusion. IEEE Trans Geosci Remote Sensing 44(12):3674–3686CrossRef Pradhan PS, King RL, Younan NH, Holcomb DW (2006) Estimation of the number of decomposition levels for a wavelet-based multiresolution multisensor image fusion. IEEE Trans Geosci Remote Sensing 44(12):3674–3686CrossRef
21.
Zurück zum Zitat Acerbi-Junior FW, Clevers JGPW, Schaepman ME (2006) The assessment of multi-sensor image fusion using wavelet transforms for mapping the Brazilian Savanna. Int J Appl Earth Observ Geoinform 8(4):278–288CrossRef Acerbi-Junior FW, Clevers JGPW, Schaepman ME (2006) The assessment of multi-sensor image fusion using wavelet transforms for mapping the Brazilian Savanna. Int J Appl Earth Observ Geoinform 8(4):278–288CrossRef
22.
Zurück zum Zitat Pajares G, Cruz JMDL (2004) A wavelet-based image fusion tutorial. Pattern Recogn 37(9):1855–1872CrossRef Pajares G, Cruz JMDL (2004) A wavelet-based image fusion tutorial. Pattern Recogn 37(9):1855–1872CrossRef
23.
Zurück zum Zitat Ray LA, Adhami RR (2006) Dual tree discrete wavelet transform with application to image fusion. In: Southeastern symposium on system theory, pp 430–433 Ray LA, Adhami RR (2006) Dual tree discrete wavelet transform with application to image fusion. In: Southeastern symposium on system theory, pp 430–433
24.
Zurück zum Zitat Qu G, Zhang D, Yan P (2001) Medical image fusion by wavelet transform modulus maxima. Opt Exp 9(4):184–190 Qu G, Zhang D, Yan P (2001) Medical image fusion by wavelet transform modulus maxima. Opt Exp 9(4):184–190
25.
Zurück zum Zitat Zheng YF, Essock EA, Hansen BC, Haun AM (2007) A new metric based on extended spatial frequency and its application to DWT based fusion algorithms. Inform Fusion 8(2):177–192CrossRef Zheng YF, Essock EA, Hansen BC, Haun AM (2007) A new metric based on extended spatial frequency and its application to DWT based fusion algorithms. Inform Fusion 8(2):177–192CrossRef
26.
Zurück zum Zitat Mitianoudis N, Stathaki T (2007) Pixel-based and region-based image fusion schemes using ICA bases. Inform Fusion 8(2):131–142CrossRef Mitianoudis N, Stathaki T (2007) Pixel-based and region-based image fusion schemes using ICA bases. Inform Fusion 8(2):131–142CrossRef
27.
Zurück zum Zitat Piella G (2003) A general framework for multiresolution image fusion: from pixels to regions. Inform Fusion 4(4):259–280CrossRef Piella G (2003) A general framework for multiresolution image fusion: from pixels to regions. Inform Fusion 4(4):259–280CrossRef
28.
Zurück zum Zitat Pham DL, Xu C, Prince JL (2000) Current methods in medical image segmentation. Ann Rev Biomed Eng 2:315–338CrossRef Pham DL, Xu C, Prince JL (2000) Current methods in medical image segmentation. Ann Rev Biomed Eng 2:315–338CrossRef
29.
Zurück zum Zitat Banerjee S, Mukherjee DP, Dutta Majumder D (1999) Fuzzy c-means approach to tissue classification in multimodal medical imaging. Inform Sci 115:261–279 Banerjee S, Mukherjee DP, Dutta Majumder D (1999) Fuzzy c-means approach to tissue classification in multimodal medical imaging. Inform Sci 115:261–279
30.
Zurück zum Zitat Fenster A, Chiu B (2005) Evaluation of segmentation algorithms for medical imaging. In: Proceedings of the 2005 IEEE engineering in medicine and biology 27th annual conference Shanghai, China, September 1–4, p 244 Fenster A, Chiu B (2005) Evaluation of segmentation algorithms for medical imaging. In: Proceedings of the 2005 IEEE engineering in medicine and biology 27th annual conference Shanghai, China, September 1–4, p 244
31.
Zurück zum Zitat Zhang YJ (1996) A survey on evaluation methods for image segmentation. Pattern Recogn 29:1335–1346 Zhang YJ (1996) A survey on evaluation methods for image segmentation. Pattern Recogn 29:1335–1346
32.
Zurück zum Zitat Weszka JS, Rosenfeld A (1978) Threshold evaluation techniques. IEEE Trans Syst Man Cybernet SMC-8:622–629 Weszka JS, Rosenfeld A (1978) Threshold evaluation techniques. IEEE Trans Syst Man Cybernet SMC-8:622–629
33.
Zurück zum Zitat Levine MD, Nazif A (1985) Dynamic measurement of computer generated image segmentations. IEEE Trans Pattern Anal Mach Intell PAMI-7(2):155–164 Levine MD, Nazif A (1985) Dynamic measurement of computer generated image segmentations. IEEE Trans Pattern Anal Mach Intell PAMI-7(2):155–164
34.
Zurück zum Zitat Sahoo PK, Soltani S, Wong AKC, Chen YC (1988) A survey of thresholding techniques. CVGIP 41:233–260 Sahoo PK, Soltani S, Wong AKC, Chen YC (1988) A survey of thresholding techniques. CVGIP 41:233–260
35.
Zurück zum Zitat Cardenes R, Warfield S, Macías E, Ruiz-Alzola J (2003) High performance supervised and unsupervised MRI brain segmentation. In: Proceedings of the neuroimaging workshop, Eurocast, pp 57–60 Cardenes R, Warfield S, Macías E, Ruiz-Alzola J (2003) High performance supervised and unsupervised MRI brain segmentation. In: Proceedings of the neuroimaging workshop, Eurocast, pp 57–60
36.
Zurück zum Zitat Cardenes R, Warfield S, Macías E, Santana J, Ruiz-Alzola J (2003) An efficient algorithm for multiple esclerosis lesion segmentation from brain MRI. Computer aided system theory-EUROCAST 2809, pp 542–551 Cardenes R, Warfield S, Macías E, Santana J, Ruiz-Alzola J (2003) An efficient algorithm for multiple esclerosis lesion segmentation from brain MRI. Computer aided system theory-EUROCAST 2809, pp 542–551
37.
Zurück zum Zitat Bland M (1995) An introduction to medical statistics. Oxford University Press, Oxford, pp 542–551 Bland M (1995) An introduction to medical statistics. Oxford University Press, Oxford, pp 542–551
38.
Zurück zum Zitat Zar JH (1984) Biostatistical analysis, 2nd edn. Prentice Hall Inc., Englewood Cliffs Zar JH (1984) Biostatistical analysis, 2nd edn. Prentice Hall Inc., Englewood Cliffs
39.
Zurück zum Zitat Chalana V, Kim Y (1997) A methodology for evaluation of boundary detection algorithms on medical images. IEEE Trans Med Imaging 16(5):642–652 Chalana V, Kim Y (1997) A methodology for evaluation of boundary detection algorithms on medical images. IEEE Trans Med Imaging 16(5):642–652
40.
Zurück zum Zitat Metz CE (1986) ROC methodology in radiologic imaging. Invest Radiol 21:720–733 Metz CE (1986) ROC methodology in radiologic imaging. Invest Radiol 21:720–733
41.
Zurück zum Zitat Dunn JC (1974) A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. J Cybern 3(3):32–57MathSciNet Dunn JC (1974) A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. J Cybern 3(3):32–57MathSciNet
42.
Zurück zum Zitat Bezdek JC, Keller JM, Krishnapuram R, Pal NR (1999) Fuzzy models and algorithms for pattern recognition and image processing, 3rd edn. Springer, New York, pp 368–369 Bezdek JC, Keller JM, Krishnapuram R, Pal NR (1999) Fuzzy models and algorithms for pattern recognition and image processing, 3rd edn. Springer, New York, pp 368–369
43.
Zurück zum Zitat Zhang Y, Brady M, Smith S (2001) Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans Med Imaging 1:45–57 Zhang Y, Brady M, Smith S (2001) Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans Med Imaging 1:45–57
44.
Zurück zum Zitat Besag J (1986) On the statistical analysis of dirty images. R Stat Soc B 48:259–302 Besag J (1986) On the statistical analysis of dirty images. R Stat Soc B 48:259–302
45.
Zurück zum Zitat Geman S, Geman D (1984) Stochastic relaxation, Gibbs distribution, and the Bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell 6:721–741MATHCrossRef Geman S, Geman D (1984) Stochastic relaxation, Gibbs distribution, and the Bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell 6:721–741MATHCrossRef
46.
Zurück zum Zitat Wu J, Feng G (2009) Intrusion detection based on simulated annealing and fuzzy c-means clustering. In: International conference on multimedia information networking and security, pp 382–385 Wu J, Feng G (2009) Intrusion detection based on simulated annealing and fuzzy c-means clustering. In: International conference on multimedia information networking and security, pp 382–385
47.
Zurück zum Zitat Burt PJ (1984) The pyramid as structure for efficient computation. In: Rosenfeld A (ed) Multiresolution image processing and analysis, vol. 5. Springer, Berlin, pp 6–35 Burt PJ (1984) The pyramid as structure for efficient computation. In: Rosenfeld A (ed) Multiresolution image processing and analysis, vol. 5. Springer, Berlin, pp 6–35
48.
Zurück zum Zitat Toet A (1992) Multiscale contrast enhancement with application to image fusion. Opt Eng 31(5):1026–1031 Toet A (1992) Multiscale contrast enhancement with application to image fusion. Opt Eng 31(5):1026–1031
49.
Zurück zum Zitat Uner MK, Ramac LC, Varshney PK (1997) Concealed weapon detection: an image fusion approach. In: Proceedings of SPIE, vol 2942, pp 123–132 Uner MK, Ramac LC, Varshney PK (1997) Concealed weapon detection: an image fusion approach. In: Proceedings of SPIE, vol 2942, pp 123–132
50.
Zurück zum Zitat Wilson TA, Rogers SK, Myers LR (1995) Perceptual-based hyperspectral image fusion using multiresolution analysis. Opt Eng 34(11):3154–3164 Wilson TA, Rogers SK, Myers LR (1995) Perceptual-based hyperspectral image fusion using multiresolution analysis. Opt Eng 34(11):3154–3164
51.
Zurück zum Zitat Das A, Bhattacharya M (2011) Affine based registration of CT and MR modality images of human brain using multiresolution approaches: comparative study on genetic algorithm and particle swarm optimization. Neural Comput Appl 20(2):223–237 (Springer, London) Das A, Bhattacharya M (2011) Affine based registration of CT and MR modality images of human brain using multiresolution approaches: comparative study on genetic algorithm and particle swarm optimization. Neural Comput Appl 20(2):223–237 (Springer, London)
52.
Zurück zum Zitat Butz T, Thiran J-P (2001) Affine registration with feature space mutual information. In: Niessen WJ, Viergever MA (eds) Medical image computing and computer-assisted intervention, vol 2208 of lecture notes in computer science. Springer, Berlin, pp 549–556 Butz T, Thiran J-P (2001) Affine registration with feature space mutual information. In: Niessen WJ, Viergever MA (eds) Medical image computing and computer-assisted intervention, vol 2208 of lecture notes in computer science. Springer, Berlin, pp 549–556
53.
Zurück zum Zitat Bhattacharya M, Dutta Majumder D (2000) Registration of CT and MR images of Alzheimer’s patient: a shape theoretic approach. Pattern Recog Lett 21(6–7):531–548 Bhattacharya M, Dutta Majumder D (2000) Registration of CT and MR images of Alzheimer’s patient: a shape theoretic approach. Pattern Recog Lett 21(6–7):531–548
54.
Zurück zum Zitat Hill DLG et al (1993) Registration of MR and CT images for skull base surgery using point like anatomical features. Brit J Radiol 64:1030–1035 Hill DLG et al (1993) Registration of MR and CT images for skull base surgery using point like anatomical features. Brit J Radiol 64:1030–1035
Metadaten
Titel
GA-based multiresolution fusion of segmented brain images using PD-, T1- and T2-weighted MR modalities
verfasst von
Mahua Bhattacharya
Arpita Das
M. Chandana
Publikationsdatum
01.09.2012
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 6/2012
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-011-0730-3

Weitere Artikel der Ausgabe 6/2012

Neural Computing and Applications 6/2012 Zur Ausgabe