Top

Journal of Computer and Systems Sciences International

Published in:

01-05-2019 | PATTERN RECOGNITION AND IMAGE PROCESSING

Fusion of Images of Different Spectra Based on Generative Adversarial Networks

Authors: Yu. V. Vizil’ter, O. V. Vygolov, D. V. Komarov, M. A. Lebedev

Published in: Journal of Computer and Systems Sciences International | Issue 3/2019

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

A method for fusing images of different spectra by using generative adversarial networks is proposed. An original architecture of a FusionNet neural network is developed based on pix2pix. It enables the synthesis of a complex (integrated) image that comprises the most informative fragments of different-spectra images, thus being more informative than any of these individual images. A technique for generating training and test sets, as well as the process of data augmentation, is described. The operation of the proposed image fusion method is demonstrated on some real-world infrared and visible images.

previous article Neural Network Training System for Marker Encoding

next article Non-Orthogonal Sampling as the Basis for Video Data Compression and Reconstruction

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

D. Kingma and J. Ba, “Adam: a method for stochastic optimization,” in Proceedings of the International Conference on Learning Representations ICLR'2015, San Diego, CA, 2015; arXiv:1412.6980v9.

P. Isola, Jun-Yan Zhu, T. Zhou, and A. A. Efros, “Image-to-image translation with conditional adversarial networks,” in Proceedings of the International Conference on Computer Vision and Pattern Recognition (CVPR’2017), Honolulu, Hawaii, USA, 2017; arXiv:1611.07004.

O. Ronneberger, P. Fischer, and Th. Brox, “U-net: convolutional networks for biomedical image segmentation,” in Proceedings of the International Conference on Computer Vision and Pattern Recognition (CVPR’2015), Boston, Massachusetts, USA, 2015; arXiv:1505.04597.

Jiayi Ma, Yong Ma, and Chang Li, “Infrared and visible image fusion methods and applications: a survey,” Inform. Fusion 45, 153–178 (2019). https://doi.org/10.1016/j.inffus.2018.02.004 CrossRef

V. V. Insarov, S. V. Tikhonova, and I. I. Mikhailov, “Problems of building vision systems using integration of information channels of various spectral ranges,” Nov. Tekhnol., Pril. Zh. Inform. Tekhnol., No. 3 (2014).

B. K. S. Kumar, “Image fusion based on pixel significance using cross bilateral filter,” Signal, Image Video Process. 9, 1193–1204 (2015).CrossRef

Q. Zhang, Y. Fu, H. Li, and Z. Jian, “Dictionary learning method for joint sparse representation-based image fusion,” Opt. Eng. 52 (5), 057006 (2013). https://doi.org/10.1117/1.OE.52.5.057006

C. H. Liu, Y. Qi, and W. R. Ding, “Infrared and visible image fusion method based on saliency detection in sparse domain,” Infrared Phys. Technol. 83, 94–102 (2017).CrossRef

J. Ma, Z. Zhou, B. Wang, and H. Zong, “Infrared and visible image fusion based on visual saliency map and weighted least square optimization,” Infrared Phys. Technol. 82, 8–17 (2017).CrossRef

10.

Y. Liu, X. Chen, R. K. Ward, and Z. J. Wang, “Image fusion with convolutional sparse representation,” IEEE Signal Proces. Lett. 23, 1882–1886 (2016).

11.

H. Li, X. J. Wu, and J. Kittler, “Infrared and visible image fusion using a deep learning framework,” in Proceedings of the International Conference on Pattern Recognition (ICPR, 2018), Beijing, China, 2018; arXiv:1804.06992.

12.

A. B. Petro, C. Sbert, and J. M. Morel, “Multiscale retinex,” Image Proces. On Line, 71–88 (2014). https://doi.org/10.5201/ipol.2014.107

Title: Fusion of Images of Different Spectra Based on Generative Adversarial Networks
Authors: Yu. V. Vizil’ter
O. V. Vygolov
D. V. Komarov
M. A. Lebedev
Publication date: 01-05-2019
Publisher: Pleiades Publishing
Published in: Journal of Computer and Systems Sciences International / Issue 3/2019
Print ISSN: 1064-2307
Electronic ISSN: 1555-6530
DOI: https://doi.org/10.1134/S1064230719030201

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 3/2019

Algorithms of Stabilization of a Spacecraft with Flexible Elements

Low-Altitude Aircraft Routing

The Analysis of the Loss of the Traction Effect during an Intensive Start of a Vehicle

Mathematical Modeling of the Operation of Pension Funds in Order to Assess Their Sustainability

Calculation of Program Controls Not Generating Singular States of a Gyro System. II

Energy-Efficient Scheduling in Distributed Real-Time Computing Systems

Premium Partner