Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Cognitive Computation
Published in: Cognitive Computation 4/2021

17-05-2021

SE-DCGAN: a New Method of Semantic Image Restoration

Authors: Fangyan Zhang, Xin Wang, Tongfeng Sun, Xinzheng Xu

Published in: Cognitive Computation | Issue 4/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Image restoration is a technique that utilizes the edge of a corrupted area. The information content of the damaged information area is inferred based on the remaining information of these images, and then the damaged area is filled to achieve image restoration. To solve the problem of image occlusion in practical applications, a squeeze-excitation network-deep convolution generative adversarial network (SE-DCGAN) was proposed. First, many new sharp images are generated using SE-DCGAN. Then, in the generated image, the most similar image is found based on the context semantics of the original image and the encoding of the unfilled portion to fill the original image. SE-DCGAN introduces maxout activation with powerful fitting capabilities to improve image generation efficiency and avoid image generation redundancy. Experiments based on three datasets of CelebA, Street View House Number and anime avatars, showed that our method successfully predicted a large number of missing regions. This method improves the recognition rate of occluded images, produces high-quality perceptual results, and is flexible enough to handle a variety of masks or obstructions.
previous article Improving Neural Machine Translation Model with Deep Encoding Information
next article A Novel Robust Soft-Computed Range-Free Localization Algorithm Against Malicious Anchor Nodes

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
Literature
1.
Bertalmio M, Sapiro G, Caselles V.  Image inpainting. Conference on Computer Graphics and Interactive Techniques. ACM Press /Addison-Wesley Publishing Company; 2002. p. 417–424.
2.
ElSayed A, Mahmood A, Sobh T.  Effect of super resolution on high dimensional features for unsupervised face recognition in the wild, 2017 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), Washington, DC; 2017. p. 1–5.
3.
Dhamija J, Choudhury T, Kumar P, Rathore YS.  An advancement towards efficient face recognition using live video feed: for the future, 3rd International Conference on Computational Intelligence and Networks (CINE). 2017. p. 53–56.
4.
Khadatkar A, Khedgaonkar R, Patnaik KS. Occlusion invariant face recognition system, 2016 World Conference on Futuristic Trends in Research and Innovation for Social Welfare (Startup Conclave), Coimbatore; 2016. p. 1–4.
5.
Li XX, Hao PY, He L, Feng YJ. Image gradient orientations embedded structural error coding for face recognition with occlusion[J]. J Ambient Intell Humaniz Comput. 2019;3(14):1–19.
6.
7.
Li C, Zhang F. Underwater image restoration based on improved background light estimation and automatic white balance, 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI). 2018. p. 1–5.
8.
Huang J-B, Kang SB, Ahuja N, Kopf J. Image completion using planar structure guidance. ACM Trans Graph. 2014;33(4):129.
9.
Nicole D, Enrico V, Federica M, Stefano T. Occlusion detection and restoration techniques for 3D face recognition: a literature review. Mach Vis Appl. 2018;29(3):789–813.
10.
Bertalmio M, Vese L, Sapiro G, Osher S. Simultaneous structure and texture image inpainting (TIP). 2003;12(8):882–9.
11.
Zoran D, Weiss  Y. From learning models of natural image patches to whole image restoration. (ICCV). 2011. p. 479–486.
12.
Krishnaveni B, Sridhar S. Approximation algorithm based on greedy approach for face recognition with partial occlusion. Multimed Tools Appl. 2019;78(19):27511–31.CrossRef
13.
Ren JS, Xu L, Yan Q, Sun W. Shepard convolutional neural networks. Curran Associates (NIPS). 2015. p. 901–909.
14.
Iizuka S, Simo-Serra E, Ishikawa H. Globally and locally consistent image completion[J]. ACM Trans Graph. 2017;36(4):1–14.CrossRef
15.
Rezagholiradeh M, Haidar  MA, Reg-Gan. Semi-supervised learning based on generative adversarial networks for regression, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2018. p. 2806–2810.
16.
17.
Zhao S, Li J, Huo Q. Removing ring artifacts in Cbct images via generative adversarial network, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2018. p. 1055–1059.
18.
19.
Liu X, Xie C, Kuang H , Ma, X. Face aging simulation with deep convolutional generative adversarial networks, 10th International Conference on Measuring Technology and Mechatronics Automation (ICMTMA). IEEE Computer Society. 2018.
20.
Yeh R, Chen Chen, Lim T Y, et al.  Semantic image inpainting with perceptual and contextual losses [C] Proc of IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017. p. 6882–6890.
21.
Yijun L, Sifei L, Jimei Y, et al Generative face completion Proc of IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017. p. 5892–5900.
22.
Lahasan B, Lutfi SL, San-Segundo, . A survey on techniques to handle face recognition challenges: occlusion, single sample per subject and expression. Artif Intell Rev. 2019;52(2):949–79.CrossRef
23.
Sherin A, Abbott F,  Felsberg AL, Per-Erik M. Facial emotion recognition with varying poses and/or partial occlusion Using multi-stage progressive transfer learning (SCIA). 2019. p. 101–112.
24.
Pathak D, Krahenb P, Donahue J,Darrell T, Efros A. Context encoders: feature learning by inpainting. 2016. p. 121–135.
25.
Hu J, Shen L ,Albanie S. Squeeze-and-excitation networks. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2014. p. 1–1.
26.
Goodfellow I J, Pouget-Abadie J, Mirza M, et al. Generative adversarial networks. Advances in Neural Information Processing Systems: p. 2672–2680.
27.
Shen W, Wang  W. Node identification in wireless network based on convolutional neural network, 14th International Conference on Computational Intelligence and Security(CIS), 2018. p. 238–241.
28.
Yip B, Towner R, Kling T. Image pre-processing using OpenCV library on MORPH-II face database. Comput Sci. 2018. p. 1–6.
Metadata
Title
SE-DCGAN: a New Method of Semantic Image Restoration
Authors
Fangyan Zhang
Xin Wang
Tongfeng Sun
Xinzheng Xu
Publication date
17-05-2021
Publisher
Springer US
Published in
Cognitive Computation / Issue 4/2021
Print ISSN: 1866-9956
Electronic ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-021-09877-y

Other articles of this Issue 4/2021

Cognitive Computation 4/2021 Go to the issue

OriginalPaper

Probabilistic Dual-Hesitant Pythagorean Fuzzy Sets and Their Application in Multi-attribute Group Decision-Making

OriginalPaper

Multi-Scale Mahalanobis Kernel-Based Support Vector Machine for Classification of High-Resolution Remote Sensing Images

OriginalPaper

Predicting Seminal Quality via Imbalanced Learning with Evolutionary Safe-Level Synthetic Minority Over-Sampling Technique

OriginalPaper

Multi-attribute Cognitive Decision Making via Convex Combination of Weighted Vector Similarity Measures for Single-Valued Neutrosophic Sets

BriefCommunication

One-shot Cluster-Based Approach for the Detection of COVID–19 from Chest X–ray Images

OriginalPaper

A Novel Robust Soft-Computed Range-Free Localization Algorithm Against Malicious Anchor Nodes

Premium Partner

    Image Credits