Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 4/2020

17-12-2019 | Original Article

An adversarial non-volume preserving flow model with Boltzmann priors

Authors: Jian Zhang, Shifei Ding, Weikuan Jia

Published in: International Journal of Machine Learning and Cybernetics | Issue 4/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Flow-based generative models (flow models) are conceptually attractive due to tractability of the exact log-likelihood and the exact latent-variable inference. In order to generate sharper images and extend the Gaussian prior of Flow models to other discrete forms, we propose an adversarial non-volume preserving flow model with Boltzmann priors (ANVP) for modeling complex high-dimensional densities. In order to generate sharper images, an ANVP model introduces an adversarial regularizer into the loss function to penalize the condition that it places a high probability in regions where the training data distribution has a low density. Moreover, we show that the Gaussian prior can be extended to other forms such as the Boltzmann prior in the proposed ANVP model, and we use multi-scale transformations and Boltzmann priors to model the data distribution. The experiments show that proposed model is effective in image generation task.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Dinh L, Krueger D, Bengio Y (2015) NICE: Non-linear independent components estimation. In: International conference on learning representations Dinh L, Krueger D, Bengio Y (2015) NICE: Non-linear independent components estimation. In: International conference on learning representations
2.
go back to reference Kingma D, Welling M (2013) Auto-encoding variational bayes. In: International conference on learning representations Kingma D, Welling M (2013) Auto-encoding variational bayes. In: International conference on learning representations
3.
go back to reference Goodfellow I, Pouget-Abadie J, Mirza M et al (2014) Generative adversarial nets. In: International conference on neural information processing systems Goodfellow I, Pouget-Abadie J, Mirza M et al (2014) Generative adversarial nets. In: International conference on neural information processing systems
4.
go back to reference Gulrajani I, Ahmed F, Arjovsky M et al (2017) Improved training of wasserstein GANs. In: International conference on neural information processing systems Gulrajani I, Ahmed F, Arjovsky M et al (2017) Improved training of wasserstein GANs. In: International conference on neural information processing systems
5.
go back to reference Metz L, Poole B, Pfau D et al (2017) Unrolled generative adversarial networks. In: International conference on learning representations Metz L, Poole B, Pfau D et al (2017) Unrolled generative adversarial networks. In: International conference on learning representations
6.
go back to reference Nair V, Hinton G (2010) Rectified linear units improve restricted boltzmann machines. In: International conference on machine learning Nair V, Hinton G (2010) Rectified linear units improve restricted boltzmann machines. In: International conference on machine learning
7.
go back to reference Dinh L, Sohl-Dickstein J, Bengio S (2017) Density estimation using Real NVP. In: International conference on learning representations Dinh L, Sohl-Dickstein J, Bengio S (2017) Density estimation using Real NVP. In: International conference on learning representations
8.
go back to reference Kingma D, Dhariwal P (2018) Glow: generative flow with invertible 1 × 1 convolutions. In: International conference on neural information processing systems Kingma D, Dhariwal P (2018) Glow: generative flow with invertible 1 × 1 convolutions. In: International conference on neural information processing systems
9.
go back to reference Zhang N (2019) Point-wise gated restricted Boltzmann machines using clean data. Int J Collab Intell 2(1):75–82 Zhang N (2019) Point-wise gated restricted Boltzmann machines using clean data. Int J Collab Intell 2(1):75–82
10.
go back to reference Grégoire M, Klaus-Robert M, Marco C (2016) Wasserstein training of restricted Boltzmann machines. In: International conference on neural information processing systems Grégoire M, Klaus-Robert M, Marco C (2016) Wasserstein training of restricted Boltzmann machines. In: International conference on neural information processing systems
11.
go back to reference Fisher C, Smith A, Walsh J (2018) Boltzmann encoded adversarial machines. arXiv 1804.086822018 Fisher C, Smith A, Walsh J (2018) Boltzmann encoded adversarial machines. arXiv 1804.086822018
12.
go back to reference Zhang N, Ding S, Zhang J et al (2017) An overview on restricted Boltzmann machines. Neurocomputing 275:1186–1199CrossRef Zhang N, Ding S, Zhang J et al (2017) An overview on restricted Boltzmann machines. Neurocomputing 275:1186–1199CrossRef
13.
go back to reference Hinton G (2012) A practical guide to training restricted Boltzmann machines, neural networks: tricks of the trade. Springer, Berlin Heidelberg, pp 599–619CrossRef Hinton G (2012) A practical guide to training restricted Boltzmann machines, neural networks: tricks of the trade. Springer, Berlin Heidelberg, pp 599–619CrossRef
14.
go back to reference Mescheder L, Nowozin S, Geiger A (2017) Adversarial variational bayes: unifying variational autoencoders and generative adversarial networks. In: International conference on neural information processing systems Mescheder L, Nowozin S, Geiger A (2017) Adversarial variational bayes: unifying variational autoencoders and generative adversarial networks. In: International conference on neural information processing systems
15.
go back to reference Du M, Ding S, Xu X et al (2018) Density peaks clustering using geodesic distances. Int J Mach Learn Cybernet 9(8):1335–1349CrossRef Du M, Ding S, Xu X et al (2018) Density peaks clustering using geodesic distances. Int J Mach Learn Cybernet 9(8):1335–1349CrossRef
16.
go back to reference Li M (2019) NNGDPC: a kNNG-based density peaks clustering. Int J Collab Intell 2(1):1–15 Li M (2019) NNGDPC: a kNNG-based density peaks clustering. Int J Collab Intell 2(1):1–15
17.
go back to reference He K, Zhang X, Ren S et al (2016) Deep Residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition He K, Zhang X, Ren S et al (2016) Deep Residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition
Metadata
Title
An adversarial non-volume preserving flow model with Boltzmann priors
Authors
Jian Zhang
Shifei Ding
Weikuan Jia
Publication date
17-12-2019
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 4/2020
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-019-01048-8

Other articles of this Issue 4/2020

International Journal of Machine Learning and Cybernetics 4/2020 Go to the issue