Skip to main content
Erschienen in: Soft Computing 19/2018

29.06.2017 | Methodologies and Application

Multi-focus image fusion method using S-PCNN optimized by particle swarm optimization

verfasst von: Xin Jin, Dongming Zhou, Shaowen Yao, Rencan Nie, Qian Jiang, Kangjian He, Quan Wang

Erschienen in: Soft Computing | Ausgabe 19/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposed a novel image fusion method based on simplified pulse-coupled neural network (S-PCNN), particle swarm optimization (PSO) and block image processing method. In general, the parameters of S-PCNN are set manually, which is complex and time-consuming and usually causes inconsistence. In this paper, the parameters of S-PCNN are set by PSO algorithm to overcome these shortcomings and improve fusion performance. Firstly, source images are divided into several equidimension sub-blocks, and then, spatial frequency is calculated as the characteristic factor of the sub-block to get the whole source image’s characterization factor matrix (CFM), and by this way the operand can be effectively reduced. Secondly, S-PCNN is used for the analysis of the CFM to get its oscillation frequency graph (OFG). Thirdly, the fused CFM will be got according to the OFG. Finally, the fused image will be reconstructed according to the fused CFM and block rule. In this process, the parameters of S-PCNN are set by PSO algorithm to get the best fusion effect. By CFM and block method, the operand of the proposed method will be effectively reduced. The experiments indicate that the multi-focus image fusion algorithm is more efficient than other traditional image fusion algorithms, and it proves that the automatically parameters setting method is effective as well.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Barbieri R, Barbieri N, de Lima KF (2015a) Some applications of the PSO for optimization of acoustic filters. Appl Acoust 89(1298):62–70CrossRef Barbieri R, Barbieri N, de Lima KF (2015a) Some applications of the PSO for optimization of acoustic filters. Appl Acoust 89(1298):62–70CrossRef
Zurück zum Zitat Barbieri R, Barbieri N, de Lima KF (2015b) Some applications of the PSO for optimization of acoustic filters. Appl Acoust 89(1298):62–70CrossRef Barbieri R, Barbieri N, de Lima KF (2015b) Some applications of the PSO for optimization of acoustic filters. Appl Acoust 89(1298):62–70CrossRef
Zurück zum Zitat Chai Y, Li H, Li Z (2011) Multifocus image fusion scheme using focused region detection and multiresolution. Opt Commun 284(19):4376–4389CrossRef Chai Y, Li H, Li Z (2011) Multifocus image fusion scheme using focused region detection and multiresolution. Opt Commun 284(19):4376–4389CrossRef
Zurück zum Zitat Deng XY, De MAY (2012) PCNN model automatic parameters determination and its modified model. Acta Electron Sin 5(5):955–964 Deng XY, De MAY (2012) PCNN model automatic parameters determination and its modified model. Acta Electron Sin 5(5):955–964
Zurück zum Zitat Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: International symposium on MICRO machine and human science 1995, pp 39–43 Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: International symposium on MICRO machine and human science 1995, pp 39–43
Zurück zum Zitat Ekblad U, Kinser JM, Atmer J et al (2004) The intersecting cortical model in image processing. Nucl Instrum Methods Phys Res 525(1):392–396CrossRef Ekblad U, Kinser JM, Atmer J et al (2004) The intersecting cortical model in image processing. Nucl Instrum Methods Phys Res 525(1):392–396CrossRef
Zurück zum Zitat Eskandari M, Toygar O (2015) Selection of optimized features and weights on face-iris fusion using distance images. Comput Vis Image Understand 137(C):63–75CrossRef Eskandari M, Toygar O (2015) Selection of optimized features and weights on face-iris fusion using distance images. Comput Vis Image Understand 137(C):63–75CrossRef
Zurück zum Zitat Gu X, Fang Y, Wang Y (2013) Attention selection using global topological properties based on pulse coupled neural network. Comput Vis Image Understand 117(10):1400–1411CrossRef Gu X, Fang Y, Wang Y (2013) Attention selection using global topological properties based on pulse coupled neural network. Comput Vis Image Understand 117(10):1400–1411CrossRef
Zurück zum Zitat Guo JM, Prasetyo H, Su HS (2013a) Image indexing using the color and bit pattern feature fusion. J Vis Commun Image Represent 24:1360–1379CrossRef Guo JM, Prasetyo H, Su HS (2013a) Image indexing using the color and bit pattern feature fusion. J Vis Commun Image Represent 24:1360–1379CrossRef
Zurück zum Zitat Guo JM, Prasetyo H, Su HS (2013b) Image indexing using the color and bit pattern feature fusion. J Vis Commun Image Represent 24:1360–1379CrossRef Guo JM, Prasetyo H, Su HS (2013b) Image indexing using the color and bit pattern feature fusion. J Vis Commun Image Represent 24:1360–1379CrossRef
Zurück zum Zitat He K, Zhou D, Zhang X, Nie R et al (2017) Infrared and visible image fusion based on target extraction in the nonsubsampled contourlet transform domain. J Appl Remote Sens 11(1):015011CrossRef He K, Zhou D, Zhang X, Nie R et al (2017) Infrared and visible image fusion based on target extraction in the nonsubsampled contourlet transform domain. J Appl Remote Sens 11(1):015011CrossRef
Zurück zum Zitat Jin H et al (2015) Fusion of remote sensing images based on pyramid decomposition with Baldwinian Clonal Selection Optimization. Infrared Phys Technol 73:204–211CrossRef Jin H et al (2015) Fusion of remote sensing images based on pyramid decomposition with Baldwinian Clonal Selection Optimization. Infrared Phys Technol 73:204–211CrossRef
Zurück zum Zitat Jin X, Nie R, Zhou D et al (2016b) A novel DNA sequence similarity calculation based on simplified pulse-coupled neural network and Huffman coding. Phys A Stat Mech Appl 461:325–338MathSciNetCrossRef Jin X, Nie R, Zhou D et al (2016b) A novel DNA sequence similarity calculation based on simplified pulse-coupled neural network and Huffman coding. Phys A Stat Mech Appl 461:325–338MathSciNetCrossRef
Zurück zum Zitat Jin X, Zhou D, Yao S et al (2016c) Remote sensing image fusion method in CIELab color space using nonsubsampled shearlet transform and pulse coupled neural networks. J Appl Remote Sens 10(2):025023CrossRef Jin X, Zhou D, Yao S et al (2016c) Remote sensing image fusion method in CIELab color space using nonsubsampled shearlet transform and pulse coupled neural networks. J Appl Remote Sens 10(2):025023CrossRef
Zurück zum Zitat Johnson JL, Padgett ML (1999) PCNN models and applications. IEEE Trans Neural Netw 10(3):480–498CrossRef Johnson JL, Padgett ML (1999) PCNN models and applications. IEEE Trans Neural Netw 10(3):480–498CrossRef
Zurück zum Zitat Johnson JL, Ritter D (1993) Observation of periodic waves in a pulse-coupled neural network. Opt Lett 18(15):1253–1255CrossRef Johnson JL, Ritter D (1993) Observation of periodic waves in a pulse-coupled neural network. Opt Lett 18(15):1253–1255CrossRef
Zurück zum Zitat Kavitha S, Thyagharajan KK (2016) Efficient DWT-based fusion techniques using genetic algorithm for optimal parameter estimation. Soft Comput 2016:1–10. doi:10.1007/s00500-015-2009-6 Kavitha S, Thyagharajan KK (2016) Efficient DWT-based fusion techniques using genetic algorithm for optimal parameter estimation. Soft Comput 2016:1–10. doi:10.​1007/​s00500-015-2009-6
Zurück zum Zitat Li H, Chai Y, Li Z (2013) Multi-focus image fusion based on nonsubsampled contourlet transform and focused regions detection. Optik Int J Light Electron Opt 124(1):40–51CrossRef Li H, Chai Y, Li Z (2013) Multi-focus image fusion based on nonsubsampled contourlet transform and focused regions detection. Optik Int J Light Electron Opt 124(1):40–51CrossRef
Zurück zum Zitat Li J, Zou B, Ding L et al (2013) Image segmentation with S-PCNN model and immune algorithm. J Comput 8(9):2429–2436 Li J, Zou B, Ding L et al (2013) Image segmentation with S-PCNN model and immune algorithm. J Comput 8(9):2429–2436
Zurück zum Zitat Luo XQ, Zhang ZC, Wu XJ (2014) Adaptive multistrategy image fusion method. J Electron Imaging 23(5):053011CrossRef Luo XQ, Zhang ZC, Wu XJ (2014) Adaptive multistrategy image fusion method. J Electron Imaging 23(5):053011CrossRef
Zurück zum Zitat Maurya L, Mahapatra PK, Kumar A (2017) A social spider optimized image fusion approach for contrast enhancement and brightness preservation. Appl Soft Comput 52:575–592CrossRef Maurya L, Mahapatra PK, Kumar A (2017) A social spider optimized image fusion approach for contrast enhancement and brightness preservation. Appl Soft Comput 52:575–592CrossRef
Zurück zum Zitat Ozcan E, Mohan CK (2000) Particle swarm optimization: surfing the waves. In: Proceedings of the international conference on the practice and theory of automated timetabling 2000, pp 6–9 Ozcan E, Mohan CK (2000) Particle swarm optimization: surfing the waves. In: Proceedings of the international conference on the practice and theory of automated timetabling 2000, pp 6–9
Zurück zum Zitat Palsson F et al (2015) Model-based fusion of multi-and hyperspectral images using PCA and wavelets. IEEE Trans Geosci Remote Sens 53(5):2652–2663CrossRef Palsson F et al (2015) Model-based fusion of multi-and hyperspectral images using PCA and wavelets. IEEE Trans Geosci Remote Sens 53(5):2652–2663CrossRef
Zurück zum Zitat Peng J (2013) Image fusion with nonsubsampled contourlet transform and sparse representation. J Electron Imaging 22(4):6931–6946MathSciNet Peng J (2013) Image fusion with nonsubsampled contourlet transform and sparse representation. J Electron Imaging 22(4):6931–6946MathSciNet
Zurück zum Zitat Peng G, Wang Z, Liu S, Zhuang S (2015) Image fusion by combining multiwavelet with nonsubsampled direction filter bank. Soft Comput 2015:1–13. doi:10.1007/s00500-015-1893-0 Peng G, Wang Z, Liu S, Zhuang S (2015) Image fusion by combining multiwavelet with nonsubsampled direction filter bank. Soft Comput 2015:1–13. doi:10.​1007/​s00500-015-1893-0
Zurück zum Zitat Raghavendra R, Dorizzi B, Rao A et al (2011) Particle swarm optimization based fusion of near infrared and visible images for improved face verification. Pattern Recognit 44(2):401–411CrossRef Raghavendra R, Dorizzi B, Rao A et al (2011) Particle swarm optimization based fusion of near infrared and visible images for improved face verification. Pattern Recognit 44(2):401–411CrossRef
Zurück zum Zitat Saeedi J, Faez K (2012) Infrared and visible image fusion using fuzzy logic and population-based optimization. Appl Soft Comput 12:1041–1054CrossRef Saeedi J, Faez K (2012) Infrared and visible image fusion using fuzzy logic and population-based optimization. Appl Soft Comput 12:1041–1054CrossRef
Zurück zum Zitat Saha A, Bhatnagar G, Wu QMJ (2013) Mutual spectral residual approach for multifocus image fusion. Digit Signal Process 23(4):1121–1135MathSciNetCrossRef Saha A, Bhatnagar G, Wu QMJ (2013) Mutual spectral residual approach for multifocus image fusion. Digit Signal Process 23(4):1121–1135MathSciNetCrossRef
Zurück zum Zitat Shi Y, Eberhart R (1998) “A modified particle swarm”. In: Proceeding of 1998 IEEE international conference on evolutionary computation IEEE, Piscataway, NJ, USA, pp 69–73 Shi Y, Eberhart R (1998) “A modified particle swarm”. In: Proceeding of 1998 IEEE international conference on evolutionary computation IEEE, Piscataway, NJ, USA, pp 69–73
Zurück zum Zitat Shi Y, Eberhart RC (1998) Parameter selection in particle swarm optimization. In: International conference on evolutionary programming Vii Springer-Verlag 1998, pp 591–600 Shi Y, Eberhart RC (1998) Parameter selection in particle swarm optimization. In: International conference on evolutionary programming Vii Springer-Verlag 1998, pp 591–600
Zurück zum Zitat Shi M, Jiang S, Wang H et al (2009) A Simplified pulse-coupled neural network for adaptive segmentation of fabric defects. Mach Vis Appl 20(22):131–138CrossRef Shi M, Jiang S, Wang H et al (2009) A Simplified pulse-coupled neural network for adaptive segmentation of fabric defects. Mach Vis Appl 20(22):131–138CrossRef
Zurück zum Zitat Subashini MM, Sahoo SK (2014) Pulse coupled neural networks and its applications. Expert Syst Appl 41(8):3965–3974CrossRef Subashini MM, Sahoo SK (2014) Pulse coupled neural networks and its applications. Expert Syst Appl 41(8):3965–3974CrossRef
Zurück zum Zitat Szekely AG, Lindblad T (1999) Parameter adaptation in a simplified pulse-coupled neural network. In: The workshop on virtual intelligence/dynamic neural networks: neural networks fuzzy systems. International society for optics and photonics 1999, pp 278–285 Szekely AG, Lindblad T (1999) Parameter adaptation in a simplified pulse-coupled neural network. In: The workshop on virtual intelligence/dynamic neural networks: neural networks fuzzy systems. International society for optics and photonics 1999, pp 278–285
Zurück zum Zitat Tian T, Sun S, Li N (2016) Multi-sensor information fusion estimators for stochastic uncertain systems with correlated noises. Inf Fus 27:126–137CrossRef Tian T, Sun S, Li N (2016) Multi-sensor information fusion estimators for stochastic uncertain systems with correlated noises. Inf Fus 27:126–137CrossRef
Zurück zum Zitat Wang G, Xu X, Jiang X, Nie R (2015) A modified model of pulse coupled neural networks with adaptive parameters and its application on image fusion. ICIC Express Lett 6(9):2523–2530 Wang G, Xu X, Jiang X, Nie R (2015) A modified model of pulse coupled neural networks with adaptive parameters and its application on image fusion. ICIC Express Lett 6(9):2523–2530
Zurück zum Zitat Wang Q, Zhou D, Nie R et al (2016) Medical image fusion using pulse coupled neural network and multi-objective particle swarm optimization. In: Eighth international conference on digital image processing. 2016, p 100334K Wang Q, Zhou D, Nie R et al (2016) Medical image fusion using pulse coupled neural network and multi-objective particle swarm optimization. In: Eighth international conference on digital image processing. 2016, p 100334K
Zurück zum Zitat Xu X, Shan D, Wang G et al (2016) Multimodal medical image fusion using PCNN optimized by the QPSO algorithm. Appl Soft Comput 46:588–595CrossRef Xu X, Shan D, Wang G et al (2016) Multimodal medical image fusion using PCNN optimized by the QPSO algorithm. Appl Soft Comput 46:588–595CrossRef
Zurück zum Zitat Yang H, Jin X, Zhou D (2015) Block medical image fusion based on adaptive PCNN. In: IEEE international conference on software engineering and service science. IEEE 2015, pp. 330–333 Yang H, Jin X, Zhou D (2015) Block medical image fusion based on adaptive PCNN. In: IEEE international conference on software engineering and service science. IEEE 2015, pp. 330–333
Zurück zum Zitat Yi LI, Wu XJ (2014) A novel image fusion method using self-adaptive dual-channel pulse coupled neural networks based on PSO evolutionary learning. Acta Electron Sin 42(2):217–222 Yi LI, Wu XJ (2014) A novel image fusion method using self-adaptive dual-channel pulse coupled neural networks based on PSO evolutionary learning. Acta Electron Sin 42(2):217–222
Zurück zum Zitat Yu B et al (2015) Hybrid dual-tree complex wavelet transform and support vector machine for digital multi-focus image fusion. Neurocomputing 182:1–9CrossRef Yu B et al (2015) Hybrid dual-tree complex wavelet transform and support vector machine for digital multi-focus image fusion. Neurocomputing 182:1–9CrossRef
Zurück zum Zitat Zhang B et al (2016) Multi-focus image fusion algorithm based on focused region extraction. Neurocomputing 174:733–748CrossRef Zhang B et al (2016) Multi-focus image fusion algorithm based on focused region extraction. Neurocomputing 174:733–748CrossRef
Zurück zum Zitat Zhang Y, Ge L (2009) Efficient fusion scheme for multi-focus images by using blurring measure. Digit Signal Process 19(2):186–193CrossRef Zhang Y, Ge L (2009) Efficient fusion scheme for multi-focus images by using blurring measure. Digit Signal Process 19(2):186–193CrossRef
Zurück zum Zitat Zheng J, Liu Y, Ren J et al (2016) Fusion of block and keypoints based approaches for effective copy-move image forgery detection. Multidimens Syst Signal Process 27(4):989–1005MathSciNetCrossRef Zheng J, Liu Y, Ren J et al (2016) Fusion of block and keypoints based approaches for effective copy-move image forgery detection. Multidimens Syst Signal Process 27(4):989–1005MathSciNetCrossRef
Zurück zum Zitat Zhou D, Nie R, Zhao D (2009) Analysis of autowave characteristics for competitive pulse coupled neural network and its application. Neurocomputing 72(10–12):2331–2336CrossRef Zhou D, Nie R, Zhao D (2009) Analysis of autowave characteristics for competitive pulse coupled neural network and its application. Neurocomputing 72(10–12):2331–2336CrossRef
Metadaten
Titel
Multi-focus image fusion method using S-PCNN optimized by particle swarm optimization
verfasst von
Xin Jin
Dongming Zhou
Shaowen Yao
Rencan Nie
Qian Jiang
Kangjian He
Quan Wang
Publikationsdatum
29.06.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 19/2018
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-017-2694-4

Weitere Artikel der Ausgabe 19/2018

Soft Computing 19/2018 Zur Ausgabe