Skip to main content

2020 | OriginalPaper | Buchkapitel

Image-to-Image Local Feature Translation Using Double Adversarial Networks Based on CycleGAN

verfasst von : Chen Wu, Lei Li, Zhenzhen Yang, Peihong Yan, Jiali Jiao

Erschienen in: Communications, Signal Processing, and Systems

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Image-to-image translation is a hot field in the machine learning with the emergency of the generative adversarial networks. Most of the latest models easily lead to changes in the overall image and overfitting when they are used to local feature translation. To address these limitations, this article adds a suppressor and proposes a double adversarial CycleGAN. The suppressor is added to suppress the change of images, and the suppressor and generator form a new adversarial relationship. We hope it will achieve Nash equilibrium that is the change of image focus on the local feature. Finally, a contrast experiment was conducted. In the case of image local feature transfer, the change of image is focused on the local features and the overfitting phenomenon can be well resolved.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Liu M-Y, Breuel T, Kautz J. Unsupervised image-to-image translation networks. CoRR, abs/1703.00848, 2017. Liu M-Y, Breuel T, Kautz J. Unsupervised image-to-image translation networks. CoRR, abs/1703.00848, 2017.
2.
Zurück zum Zitat Hertzmann A, Jacobs CE, Oliver N, Curless B, Salesin DH. Image analogies. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques, SIGGRAPH ’01. ACM: New York, NY, USA, 2001. p. 327–40. Hertzmann A, Jacobs CE, Oliver N, Curless B, Salesin DH. Image analogies. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques, SIGGRAPH ’01. ACM: New York, NY, USA, 2001. p. 327–40.
3.
Zurück zum Zitat Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y. Generative adversarial nets. In: Ghahramani Z, Welling M, Cortes C, Lawrence ND, Weinberger KQ, editors. Advances in neural information processing systems 27. New York: Curran Associates, Inc.; 2014. p. 2672–80. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y. Generative adversarial nets. In: Ghahramani Z, Welling M, Cortes C, Lawrence ND, Weinberger KQ, editors. Advances in neural information processing systems 27. New York: Curran Associates, Inc.; 2014. p. 2672–80.
4.
Zurück zum Zitat Perarnau G, van de Weijer J, Raducanu B, Álvarez JM. Invertible conditional gans for image editing. CoRR, abs/1611.06355, 2016. Perarnau G, van de Weijer J, Raducanu B, Álvarez JM. Invertible conditional gans for image editing. CoRR, abs/1611.06355, 2016.
5.
Zurück zum Zitat Zhu J-Y, Krähenbühl P, Shechtman E, Efros AA. Generative visual manipulation on the natural image manifold. In: Proceedings of European conference on computer vision (ECCV), 2016.CrossRef Zhu J-Y, Krähenbühl P, Shechtman E, Efros AA. Generative visual manipulation on the natural image manifold. In: Proceedings of European conference on computer vision (ECCV), 2016.CrossRef
6.
Zurück zum Zitat Xia Y, He D, Qin T, Wang L, Yu N, Liu T-Y, Ma W-Y. Dual learning for machine translation. CoRR, abs/1611.00179, 2016. Xia Y, He D, Qin T, Wang L, Yu N, Liu T-Y, Ma W-Y. Dual learning for machine translation. CoRR, abs/1611.00179, 2016.
7.
Zurück zum Zitat Shen W, Liu R. Learning residual images for face attribute manipulation. CoRR, abs/1612.05363, 2016. Shen W, Liu R. Learning residual images for face attribute manipulation. CoRR, abs/1612.05363, 2016.
8.
Zurück zum Zitat Kim T, Cha M, Kim H, Lee JK, Kim J. Learning to discover cross-domain relations with generative adversarial networks. CoRR, abs/1703.05192, 2017. Kim T, Cha M, Kim H, Lee JK, Kim J. Learning to discover cross-domain relations with generative adversarial networks. CoRR, abs/1703.05192, 2017.
9.
Zurück zum Zitat Yi Z, Zhang H, Tan P, Gong M. Dualgan: Unsupervised dual learning for image-to-image translation. CoRR, abs/1704.02510, 2017. Yi Z, Zhang H, Tan P, Gong M. Dualgan: Unsupervised dual learning for image-to-image translation. CoRR, abs/1704.02510, 2017.
10.
Zurück zum Zitat Zhu J-Y, Park T, Isola P, Efros AA. Unpaired image-to-image translation using cycle-consistent adversarial networks. CoRR, abs/1703.10593, 2017. Zhu J-Y, Park T, Isola P, Efros AA. Unpaired image-to-image translation using cycle-consistent adversarial networks. CoRR, abs/1703.10593, 2017.
11.
Zurück zum Zitat Isola P, Zhu J-Y, Zhou T, Efros AA. Image-to-image translation with conditional adversarial networks. CoRR, abs/1611.07004, 2016. Isola P, Zhu J-Y, Zhou T, Efros AA. Image-to-image translation with conditional adversarial networks. CoRR, abs/1611.07004, 2016.
12.
Zurück zum Zitat Choi Y, Choi M-J, Kim M, Ha J-W, Kim S, Choo J. Stargan: Unified generative adversarial networks for multi-domain image-to-image translation. CoRR, abs/1711.09020, 2017. Choi Y, Choi M-J, Kim M, Ha J-W, Kim S, Choo J. Stargan: Unified generative adversarial networks for multi-domain image-to-image translation. CoRR, abs/1711.09020, 2017.
13.
Zurück zum Zitat Zhou S, Xiao T, Yang Y, Feng D, He Q, He W. Genegan: Learning object transfiguration and attribute subspace from unpaired data. CoRR, abs/1705.04932, 2017. Zhou S, Xiao T, Yang Y, Feng D, He Q, He W. Genegan: Learning object transfiguration and attribute subspace from unpaired data. CoRR, abs/1705.04932, 2017.
14.
Zurück zum Zitat Taigman Y, Polyak A, Wolf L. Unsupervised cross-domain image generation. CoRR, abs/1611.02200, 2016. Taigman Y, Polyak A, Wolf L. Unsupervised cross-domain image generation. CoRR, abs/1611.02200, 2016.
15.
Zurück zum Zitat Radford A, Metz L, Chintala S. Unsupervised representation learning with deep convolutional generative adversarial networks. CoRR, abs/1511.06434, 2015. Radford A, Metz L, Chintala S. Unsupervised representation learning with deep convolutional generative adversarial networks. CoRR, abs/1511.06434, 2015.
16.
Zurück zum Zitat Qi G-J. Loss-sensitive generative adversarial networks on lipschitz densities. CoRR, abs/1701.06264, 2017. Qi G-J. Loss-sensitive generative adversarial networks on lipschitz densities. CoRR, abs/1701.06264, 2017.
17.
Zurück zum Zitat Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville AC. Improved training of wasserstein gans. CoRR, abs/1704.00028, 2017. Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville AC. Improved training of wasserstein gans. CoRR, abs/1704.00028, 2017.
18.
Zurück zum Zitat Heusel M, Ramsauer H, Unterthiner T, Nessler B, Klambauer G, Hochreiter S. Gans trained by a two time-scale update rule converge to a nash equilibrium. CoRR, abs/1706.08500, 2017. Heusel M, Ramsauer H, Unterthiner T, Nessler B, Klambauer G, Hochreiter S. Gans trained by a two time-scale update rule converge to a nash equilibrium. CoRR, abs/1706.08500, 2017.
Metadaten
Titel
Image-to-Image Local Feature Translation Using Double Adversarial Networks Based on CycleGAN
verfasst von
Chen Wu
Lei Li
Zhenzhen Yang
Peihong Yan
Jiali Jiao
Copyright-Jahr
2020
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-6504-1_109