Skip to main content
Top

2017 | OriginalPaper | Chapter

A Novel Layer Based Image Fusion Approach via Transfer Learning and Coupled Dictionary

Authors : Kai Hu, Bin Sun, Qiao Deng, Qi Yang

Published in: Computer Vision

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

A novel layer based image fusion method is proposed in this paper. It exploits and utilizes the implicated patterns among source images with two parts: (i) proposed a more precise model roots in transfer learning and coupled dictionary for layering source images; (ii) designed appropriate fusion scheme which bases on multi-scale transformation for recombining layers into final fused image efficiently. Rigorous experimental comparison in subjective and objective demonstrates that proposed image fusion method achieves better result in visual perception and computer process.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Zhang, Z., Blum, R.S.: A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application. In: Proceedings of the IEEE, vol. 87, p. 1315 (1999) Zhang, Z., Blum, R.S.: A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application. In: Proceedings of the IEEE, vol. 87, p. 1315 (1999)
2.
go back to reference Lewis, J.J., O’Callaghan, R.J., Nikolov, S.G., Bull, D.R., Canagarajah, N.: Pixel- and region-based image fusion with complex wavelets. Inf. Fusion 8, 119 (2007)CrossRef Lewis, J.J., O’Callaghan, R.J., Nikolov, S.G., Bull, D.R., Canagarajah, N.: Pixel- and region-based image fusion with complex wavelets. Inf. Fusion 8, 119 (2007)CrossRef
3.
go back to reference Nencini, F., Garzelli, A., Baronti, S., Alparone, L.: Remote sensing image fusion using the curvelet transform. Inf. Fusion 8, 143 (2007)CrossRef Nencini, F., Garzelli, A., Baronti, S., Alparone, L.: Remote sensing image fusion using the curvelet transform. Inf. Fusion 8, 143 (2007)CrossRef
4.
go back to reference Li, T., Wang, Y.: Biological image fusion using a NSCT based variable-weight method. Inf. Fusion 12, 85 (2011)CrossRef Li, T., Wang, Y.: Biological image fusion using a NSCT based variable-weight method. Inf. Fusion 12, 85 (2011)CrossRef
5.
go back to reference Yang, B., Li, S.: Multifocus image fusion and restoration with sparse representation. IEEE Trans. Instrum. Meas. 59, 884 (2010)CrossRef Yang, B., Li, S.: Multifocus image fusion and restoration with sparse representation. IEEE Trans. Instrum. Meas. 59, 884 (2010)CrossRef
6.
go back to reference Kim, M., Han, D.K., Ko, H.: Joint patch clustering-based dictionary learning for multimodal image fusion. Inf. Fusion 27, 198 (2016)CrossRef Kim, M., Han, D.K., Ko, H.: Joint patch clustering-based dictionary learning for multimodal image fusion. Inf. Fusion 27, 198 (2016)CrossRef
7.
go back to reference Liu, Y., Liu, S., Wang, Z.: A general framework for image fusion based on multi-scale transform and sparse representation. Inf. Fusion 24, 147 (2015)CrossRef Liu, Y., Liu, S., Wang, Z.: A general framework for image fusion based on multi-scale transform and sparse representation. Inf. Fusion 24, 147 (2015)CrossRef
8.
go back to reference Li, S., Kang, X., Fang, L., Hu, J., Yin, H.: Pixel-level image fusion: a survey of the state of the art. Inf. Fusion 33, 100 (2017)CrossRef Li, S., Kang, X., Fang, L., Hu, J., Yin, H.: Pixel-level image fusion: a survey of the state of the art. Inf. Fusion 33, 100 (2017)CrossRef
10.
go back to reference Chen, C., Li, Y., Liu, W., Huang, J.: SIRF: simultaneous satellite image registration and fusion in a unified framework. IEEE Trans. Image Process. 24, 4213 (2015)MathSciNetCrossRef Chen, C., Li, Y., Liu, W., Huang, J.: SIRF: simultaneous satellite image registration and fusion in a unified framework. IEEE Trans. Image Process. 24, 4213 (2015)MathSciNetCrossRef
11.
go back to reference Ma, J., Chen, C., Li, C., Huang, J.: Infrared and visible image fusion via gradient transfer and total variation minimization. Inf. Fusion 31, 100 (2016)CrossRef Ma, J., Chen, C., Li, C., Huang, J.: Infrared and visible image fusion via gradient transfer and total variation minimization. Inf. Fusion 31, 100 (2016)CrossRef
12.
go back to reference Zhang, Q., Levine, M.D.: Robust multi-focus image fusion using multi-task sparse representation and spatial context. IEEE Trans. Image Process. 25, 2045 (2016)MathSciNetCrossRef Zhang, Q., Levine, M.D.: Robust multi-focus image fusion using multi-task sparse representation and spatial context. IEEE Trans. Image Process. 25, 2045 (2016)MathSciNetCrossRef
13.
go back to reference Yu, N., Qiu, T., Bi, F., Wang, A.: Image features extraction and fusion based on joint sparse representation. IEEE J. Sel. Top. Signal Process. 5, 1074 (2011)CrossRef Yu, N., Qiu, T., Bi, F., Wang, A.: Image features extraction and fusion based on joint sparse representation. IEEE J. Sel. Top. Signal Process. 5, 1074 (2011)CrossRef
14.
15.
go back to reference Panagakis, Y., Nicolaou, M.A., Zafeiriou, S., Pantic, M.: Robust correlated and individual component analysis. IEEE Trans. Pattern Anal. Mach. Intell. 38, 1665 (2016)CrossRef Panagakis, Y., Nicolaou, M.A., Zafeiriou, S., Pantic, M.: Robust correlated and individual component analysis. IEEE Trans. Pattern Anal. Mach. Intell. 38, 1665 (2016)CrossRef
16.
go back to reference Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22, 1345 (2010)CrossRef Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22, 1345 (2010)CrossRef
17.
go back to reference Ando, R.K., Zhang, T.: A framework for learning predictive structures from multiple tasks and unlabeled data. J. Mach. Learn. Res. 6, 1817 (2005)MathSciNetMATH Ando, R.K., Zhang, T.: A framework for learning predictive structures from multiple tasks and unlabeled data. J. Mach. Learn. Res. 6, 1817 (2005)MathSciNetMATH
18.
go back to reference Dai, W., Yang, Q., Xue, G., Yu, Y.: Self-taught clustering. In: ICML 2008, 8 p. Helsinki, USA (2008) Dai, W., Yang, Q., Xue, G., Yu, Y.: Self-taught clustering. In: ICML 2008, 8 p. Helsinki, USA (2008)
19.
go back to reference Huang, D., Wang, Y.F.: Coupled dictionary and feature space learning with applications to cross-domain image synthesis and recognition. In: IEEE International Conference on Computer Vision, 2496 p. (2013) Huang, D., Wang, Y.F.: Coupled dictionary and feature space learning with applications to cross-domain image synthesis and recognition. In: IEEE International Conference on Computer Vision, 2496 p. (2013)
20.
go back to reference Gao, R., Vorobyov, S.A., Zhao, H.: Multi-focus image fusion via coupled dictionary training. In: International Conference on Acoustics Speech and Signal Processing, 1666 p. (2016) Gao, R., Vorobyov, S.A., Zhao, H.: Multi-focus image fusion via coupled dictionary training. In: International Conference on Acoustics Speech and Signal Processing, 1666 p. (2016)
21.
go back to reference Liu, Z., Blasch, E., Xue, Z., Zhao, J., Laganiere, R., Wu, W.: Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision: a comparative study. IEEE Trans. Pattern Anal. Mach. Intell. 34, 94 (2012)CrossRef Liu, Z., Blasch, E., Xue, Z., Zhao, J., Laganiere, R., Wu, W.: Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision: a comparative study. IEEE Trans. Pattern Anal. Mach. Intell. 34, 94 (2012)CrossRef
22.
go back to reference Han, Y., Cai, Y., Cao, Y., Xu, X.: A new image fusion performance metric based on visual information fidelity. Inf. Fusion 14, 127 (2013)CrossRef Han, Y., Cai, Y., Cao, Y., Xu, X.: A new image fusion performance metric based on visual information fidelity. Inf. Fusion 14, 127 (2013)CrossRef
23.
go back to reference Zheng, Y., Essock, E.A., Hansen, B.C., Haun, A.M.: A new metric based on extended spatial frequency and its application to DWT based fusion algorithms. Inf. Fusion 8, 177 (2007)CrossRef Zheng, Y., Essock, E.A., Hansen, B.C., Haun, A.M.: A new metric based on extended spatial frequency and its application to DWT based fusion algorithms. Inf. Fusion 8, 177 (2007)CrossRef
Metadata
Title
A Novel Layer Based Image Fusion Approach via Transfer Learning and Coupled Dictionary
Authors
Kai Hu
Bin Sun
Qiao Deng
Qi Yang
Copyright Year
2017
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-7302-1_17

Premium Partner