Skip to main content
Top
Published in: Arabian Journal for Science and Engineering 2/2022

28-07-2021 | Research Article-Computer Engineering and Computer Science

Multi-focus Image Fusion Using Hybrid De-focused Region Segmentation Approach

Authors: Benish Amin, Abdul Ghafoor, M. Mohsin Riaz

Published in: Arabian Journal for Science and Engineering | Issue 2/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multi-focus image fusion aims to obtain necessary details from multiple source images, having varied level of focus depths, in order to generate an all-in-focus fused image that ideally contains all the information from source images. This paper presented an image matting-based fusion approach to combine focus information of multiple source images based on correlation between nearby pixels. First the focused pixels of source images are identified by perceiving the sharpness of the images by utilizing multiple sharpness metrics. Trimap is generated from focused maps to obtain prior information and image matting is applied to accurately segment the focused and de-focused regions of the source images. In the end, the focused regions from multiple source images are integrated to obtain a well formed and consistent fused image. Experiments and comparison with various existing fusion techniques verify the significance of proposed technique.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kaur, G.; Kaur, P.: Survey on multi-focus image fusion techniques. In: International Conference on Electrical, Electronics, and Optimization Techniques, pp. 1420–1424 (2016) Kaur, G.; Kaur, P.: Survey on multi-focus image fusion techniques. In: International Conference on Electrical, Electronics, and Optimization Techniques, pp. 1420–1424 (2016)
2.
go back to reference Dulhare, U.; Khaled, A. M.; Ali, M. H.: A review on diversified mechanisms for multi focus image fusion. In: International Conference on Communication and Information Processing, pp. 1–6 (2019) Dulhare, U.; Khaled, A. M.; Ali, M. H.: A review on diversified mechanisms for multi focus image fusion. In: International Conference on Communication and Information Processing, pp. 1–6 (2019)
3.
go back to reference Kou, L., Zhang, L., Zhang, K., Sun, J., Han, Q., Jin, Z.: A multi-focus image fusion method via region mosaicking on Laplacian pyramids. PLoS ONE 13(5), e0191085 (2018)CrossRef Kou, L., Zhang, L., Zhang, K., Sun, J., Han, Q., Jin, Z.: A multi-focus image fusion method via region mosaicking on Laplacian pyramids. PLoS ONE 13(5), e0191085 (2018)CrossRef
4.
go back to reference Vijayarajan, R., Muttan, S.: Discrete wavelet transform based principal component averaging fusion for medical images. AEU Int. J. Electron. Commun. 69(6), 896–902 (2015)CrossRef Vijayarajan, R., Muttan, S.: Discrete wavelet transform based principal component averaging fusion for medical images. AEU Int. J. Electron. Commun. 69(6), 896–902 (2015)CrossRef
5.
go back to reference Kalaivani, K., Asnath, Y.: Pixel level fusion of multi temporal landsat images using discrete wavelet transform for detecting changes. J. Adv. Res. Dynamical Control Syst. 9(5), 125–130 (2017) Kalaivani, K., Asnath, Y.: Pixel level fusion of multi temporal landsat images using discrete wavelet transform for detecting changes. J. Adv. Res. Dynamical Control Syst. 9(5), 125–130 (2017)
6.
go back to reference Liu, Y., Liu, S., Wang, Z.: Multi-focus image fusion with dense SIFT. Inf. Fusion 23, 139–155 (2015)CrossRef Liu, Y., Liu, S., Wang, Z.: Multi-focus image fusion with dense SIFT. Inf. Fusion 23, 139–155 (2015)CrossRef
7.
go back to reference Wang, J., Peng, J., Feng, X., He, G., Wu, J., Yan, K.: Image fusion with nonsubsampled contourlet transform and sparse representation. J. Electron. Imag. 22(4), 043019 (2013)CrossRef Wang, J., Peng, J., Feng, X., He, G., Wu, J., Yan, K.: Image fusion with nonsubsampled contourlet transform and sparse representation. J. Electron. Imag. 22(4), 043019 (2013)CrossRef
8.
go back to reference Yang, G., Li, M., Chen, L., Yu, J.: The nonsubsampled contourlet transform based statistical medical image fusion using generalized gaussian density. Comput. Math. Methods Med. 2015, 262819 (2015)MathSciNetMATH Yang, G., Li, M., Chen, L., Yu, J.: The nonsubsampled contourlet transform based statistical medical image fusion using generalized gaussian density. Comput. Math. Methods Med. 2015, 262819 (2015)MathSciNetMATH
9.
go back to reference Li, H., Li, L., Zhang, J.: Multi-focus image fusion based on sparse feature matrix decomposition and morphological filtering. Optics Commun. 342, 1–11 (2015)CrossRef Li, H., Li, L., Zhang, J.: Multi-focus image fusion based on sparse feature matrix decomposition and morphological filtering. Optics Commun. 342, 1–11 (2015)CrossRef
10.
go back to reference Liu, X., Zhou, Y., Wang, J.: Image fusion based on shearlet transform and regional features. AEU Int. J. Electron. Commun. 68(6), 471–477 (2014)CrossRef Liu, X., Zhou, Y., Wang, J.: Image fusion based on shearlet transform and regional features. AEU Int. J. Electron. Commun. 68(6), 471–477 (2014)CrossRef
11.
go back to reference Naji, M. A.; Aghagolzadeh, A.: Multi-focus image fusion in DCT domain based on correlation coefficient. In: International Conference on Knowledge-Based Engineering and Innovation, pp. 632–639 (2015) Naji, M. A.; Aghagolzadeh, A.: Multi-focus image fusion in DCT domain based on correlation coefficient. In: International Conference on Knowledge-Based Engineering and Innovation, pp. 632–639 (2015)
12.
go back to reference Song, Y., Wu, W., Liu, Z., Yang, X., Liu, K., Lu, W.: An adaptive pansharpening method by using weighted least squares filter. IEEE Geosci. Remote Sens. Lett. 13(1), 18–22 (2016)CrossRef Song, Y., Wu, W., Liu, Z., Yang, X., Liu, K., Lu, W.: An adaptive pansharpening method by using weighted least squares filter. IEEE Geosci. Remote Sens. Lett. 13(1), 18–22 (2016)CrossRef
13.
go back to reference Jian, L., Yang, X., Zhou, Z., Zhou, K., Liu, K.: Multi-scale image fusion through rolling guidance filter. Future Generat. Comput. Syst. 83(C), 310–325 (2018)CrossRef Jian, L., Yang, X., Zhou, Z., Zhou, K., Liu, K.: Multi-scale image fusion through rolling guidance filter. Future Generat. Comput. Syst. 83(C), 310–325 (2018)CrossRef
14.
go back to reference Duana, J., Chen, L., Chen, C.L.P.: Multifocus image fusion using superpixel segmentation and superpixel-based mean filtering. Appl. Opt. 55(36), 10352–10362 (2016)CrossRef Duana, J., Chen, L., Chen, C.L.P.: Multifocus image fusion using superpixel segmentation and superpixel-based mean filtering. Appl. Opt. 55(36), 10352–10362 (2016)CrossRef
15.
go back to reference Duana, J., Chen, L., Chen, C.L.P.: Multifocus image fusion with enhanced linear spectral clustering and fast depth map estimation. Neurocomputing 318, 43–54 (2018)CrossRef Duana, J., Chen, L., Chen, C.L.P.: Multifocus image fusion with enhanced linear spectral clustering and fast depth map estimation. Neurocomputing 318, 43–54 (2018)CrossRef
16.
go back to reference Paul, S., Sevcenco, I.S., Agathoklis, P.: Multi-exposure and multi-focus image fusion in gradient domain. J. Circuits Syst. Comput. 25(10), 1650123 (2016)CrossRef Paul, S., Sevcenco, I.S., Agathoklis, P.: Multi-exposure and multi-focus image fusion in gradient domain. J. Circuits Syst. Comput. 25(10), 1650123 (2016)CrossRef
17.
go back to reference Li, S., Kang, X., Hu, J., Yang, B.: Image matting for fusion of multi-focus images in dynamic scenes. Inf. Fusion 14(2), 147–162 (2013)CrossRef Li, S., Kang, X., Hu, J., Yang, B.: Image matting for fusion of multi-focus images in dynamic scenes. Inf. Fusion 14(2), 147–162 (2013)CrossRef
18.
go back to reference Bai, X., Zhang, Y., Zhou, F., Xue, B.: Quadtree-based multi-focus image fusion using a weighted focus-measure. Inf. Fusion 22, 105–118 (2015)CrossRef Bai, X., Zhang, Y., Zhou, F., Xue, B.: Quadtree-based multi-focus image fusion using a weighted focus-measure. Inf. Fusion 22, 105–118 (2015)CrossRef
19.
go back to reference Li, H.; Wu, X.-J.: Multi-focus image fusion using dictionary learning and low-rank representation. In:International Conference on Image and Graphics, pp. 675–686 (2017) Li, H.; Wu, X.-J.: Multi-focus image fusion using dictionary learning and low-rank representation. In:International Conference on Image and Graphics, pp. 675–686 (2017)
20.
go back to reference Li, Q., Yang, X., Wu, W., Liu, K., Jeon, G.: Multi-focus image fusion method for vision sensor systems via dictionary learning with guided filter. Sensors 18(7), 2143 (2018)CrossRef Li, Q., Yang, X., Wu, W., Liu, K., Jeon, G.: Multi-focus image fusion method for vision sensor systems via dictionary learning with guided filter. Sensors 18(7), 2143 (2018)CrossRef
21.
go back to reference Amin, B., Riaz, M.M., Ghafoor, A.: A hybrid defocused region segmentation approach using image matting. Multidimensional Syst. Signal Process. 30, 561–569 (2019)CrossRef Amin, B., Riaz, M.M., Ghafoor, A.: A hybrid defocused region segmentation approach using image matting. Multidimensional Syst. Signal Process. 30, 561–569 (2019)CrossRef
22.
go back to reference Vu, C.T., Phan, T.D., Chandler, D.M.: S3: A spectral and spatial measure of local perceived sharpness in natural images. IET Image Process. 21(3), 934–945 (2012)CrossRef Vu, C.T., Phan, T.D., Chandler, D.M.: S3: A spectral and spatial measure of local perceived sharpness in natural images. IET Image Process. 21(3), 934–945 (2012)CrossRef
23.
24.
go back to reference Levin, A., Lischinski, D., Weiss, Y.: A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 228–242 (2008)CrossRef Levin, A., Lischinski, D., Weiss, Y.: A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 228–242 (2008)CrossRef
25.
26.
go back to reference Xydeas, C.S., Petrovi, V.: Objective image fusion performance measure. Electron. Lett. 36(4), 308–309 (2000)CrossRef Xydeas, C.S., Petrovi, V.: Objective image fusion performance measure. Electron. Lett. 36(4), 308–309 (2000)CrossRef
27.
go back to reference Chen, Y., Blum, R.S.: A new automated quality assessment algorithm for image fusion. Image Vision Comput. 27(10), 1421–1432 (2009)CrossRef Chen, Y., Blum, R.S.: A new automated quality assessment algorithm for image fusion. Image Vision Comput. 27(10), 1421–1432 (2009)CrossRef
28.
go back to reference Haghighat, M.; Razian, M. A.: Fast-fmi: non-reference image fusion metric. In: IEEE International Conference on Application of Information and Communication Technologies, pp. 1–3 (2014) Haghighat, M.; Razian, M. A.: Fast-fmi: non-reference image fusion metric. In: IEEE International Conference on Application of Information and Communication Technologies, pp. 1–3 (2014)
29.
go back to reference Wang, Z., Bovik, A.C.: A universal image quality index. IEEE Signal Process. Lett. 9(3), 81–84 (2002)CrossRef Wang, Z., Bovik, A.C.: A universal image quality index. IEEE Signal Process. Lett. 9(3), 81–84 (2002)CrossRef
30.
go back to reference Yang, C., Zhang, J., Wang, X., Liu, X.: A novel similarity based quality metric for image fusion. Inf. Fusion 9(2), 156–160 (2008)CrossRef Yang, C., Zhang, J., Wang, X., Liu, X.: A novel similarity based quality metric for image fusion. Inf. Fusion 9(2), 156–160 (2008)CrossRef
Metadata
Title
Multi-focus Image Fusion Using Hybrid De-focused Region Segmentation Approach
Authors
Benish Amin
Abdul Ghafoor
M. Mohsin Riaz
Publication date
28-07-2021
Publisher
Springer Berlin Heidelberg
Published in
Arabian Journal for Science and Engineering / Issue 2/2022
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-021-05795-1

Other articles of this Issue 2/2022

Arabian Journal for Science and Engineering 2/2022 Go to the issue

Research Article-Computer Engineering and Computer Science

Distance Estimation from a Monocular Camera Using Face and Body Features

Research Article-Computer Engineering and Computer Science

Resource Provisioning Through Machine Learning in Cloud Services

Premium Partners