Skip to main content

2018 | OriginalPaper | Buchkapitel

Augmented Self-paced Learning with Generative Adversarial Networks

verfasst von : Xiao-Yu Zhang, Shupeng Wang, Yanfei Lv, Peng Li, Haiping Wang

Erschienen in: Computational Science – ICCS 2018

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Learning with very limited training data is a challenging but typical scenario in machine learning applications. In order to achieve a robust learning model, on one hand, the instructive labeled instances should be fully leveraged; on the other hand, extra data source need to be further explored. This paper aims to develop an effective learning framework for robust modeling, by naturally combining two promising advanced techniques, i.e. generative adversarial networks and self-paced learning. To be specific, we present a novel augmented self-paced learning with generative adversarial networks (ASPL-GANs), which consists of three component modules, i.e. a generator G, a discriminator D, and a self-paced learner S. Via competition between G and D, realistic synthetic instances with specific class labels are generated. Receiving both real and synthetic instances as training data, classifier S simulates the learning process of humans in a self-paced fashion and gradually proceeds from easy to complex instances in training. The three components are maintained in a unified framework and optimized jointly via alternating iteration. Experimental results validate the effectiveness of the proposed algorithm in classification tasks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bishop, C.: Pattern Recognition and Machine Learning (Information Science and Statistics), 1st edn. Springer, New York (2007). 2006. corr. 2nd printing edn. Bishop, C.: Pattern Recognition and Machine Learning (Information Science and Statistics), 1st edn. Springer, New York (2007). 2006. corr. 2nd printing edn.
2.
Zurück zum Zitat Zhang, X.Y., Wang, S., Yun, X.: Bidirectional active learning: a two-way exploration into unlabeled and labeled data set. IEEE Trans. Neural Netw. Learn. Syst. 26(12), 3034–3044 (2015)MathSciNetCrossRef Zhang, X.Y., Wang, S., Yun, X.: Bidirectional active learning: a two-way exploration into unlabeled and labeled data set. IEEE Trans. Neural Netw. Learn. Syst. 26(12), 3034–3044 (2015)MathSciNetCrossRef
3.
Zurück zum Zitat Zhang, X.Y.: Simultaneous optimization for robust correlation estimation in partially observed social network. Neurocomputing. 12(205), 455–462 (2016)CrossRef Zhang, X.Y.: Simultaneous optimization for robust correlation estimation in partially observed social network. Neurocomputing. 12(205), 455–462 (2016)CrossRef
4.
Zurück zum Zitat Zhang, X.Y., Wang, S., Zhu, X., Yun, X., Wu, G., Wang, Y.: Update vs. upgrade: modeling with indeterminate multi-class active learning. Neurocomputing 25(162), 163–170 (2015)CrossRef Zhang, X.Y., Wang, S., Zhu, X., Yun, X., Wu, G., Wang, Y.: Update vs. upgrade: modeling with indeterminate multi-class active learning. Neurocomputing 25(162), 163–170 (2015)CrossRef
5.
Zurück zum Zitat Zhang, X., Xu, C., Cheng, J., Lu, H., Ma, S.: Effective annotation and search for video blogs with integration of context and content analysis. IEEE Trans. Multimedia 11(2), 272–285 (2009)CrossRef Zhang, X., Xu, C., Cheng, J., Lu, H., Ma, S.: Effective annotation and search for video blogs with integration of context and content analysis. IEEE Trans. Multimedia 11(2), 272–285 (2009)CrossRef
6.
Zurück zum Zitat Liu, Y., Zhang, X., Zhu, X., Guan, Q., Zhao, X.: Listnet-based object proposals ranking. Neurocomputing 6(267), 182–194 (2017)CrossRef Liu, Y., Zhang, X., Zhu, X., Guan, Q., Zhao, X.: Listnet-based object proposals ranking. Neurocomputing 6(267), 182–194 (2017)CrossRef
7.
Zurück zum Zitat Zhang, X.: Interactive patent classification based on multi-classifier fusion and active learning. Neurocomputing 15(127), 200–205 (2014)CrossRef Zhang, X.: Interactive patent classification based on multi-classifier fusion and active learning. Neurocomputing 15(127), 200–205 (2014)CrossRef
8.
Zurück zum Zitat LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)CrossRef LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)CrossRef
9.
Zurück zum Zitat Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. PAMI 35(8), 1798–1828 (2013)CrossRef Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. PAMI 35(8), 1798–1828 (2013)CrossRef
10.
Zurück zum Zitat Xu, G., Wu, H.Z., Shi, Y.Q.: Structural design of convolution neural networks for steganalysis. IEEE Signal Process. Lett. 23(5), 708–712 (2016)CrossRef Xu, G., Wu, H.Z., Shi, Y.Q.: Structural design of convolution neural networks for steganalysis. IEEE Signal Process. Lett. 23(5), 708–712 (2016)CrossRef
11.
Zurück zum Zitat Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014) Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)
12.
Zurück zum Zitat Meng, D., Zhao, Q., Jiang, L.: What objective does self-paced learning indeed optimize? arXiv preprint arXiv:1511.06049. Accessed 19 Nov 2015 Meng, D., Zhao, Q., Jiang, L.: What objective does self-paced learning indeed optimize? arXiv preprint arXiv:​1511.​06049. Accessed 19 Nov 2015
13.
Zurück zum Zitat Kumar, M.P., Packer, B., Koller, D.: Self-paced learning for latent variable models. In: Advances in Neural Information Processing Systems, pp. 1189–1197 (2010) Kumar, M.P., Packer, B., Koller, D.: Self-paced learning for latent variable models. In: Advances in Neural Information Processing Systems, pp. 1189–1197 (2010)
Metadaten
Titel
Augmented Self-paced Learning with Generative Adversarial Networks
verfasst von
Xiao-Yu Zhang
Shupeng Wang
Yanfei Lv
Peng Li
Haiping Wang
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-93713-7_39

Premium Partner