Skip to main content

2018 | OriginalPaper | Buchkapitel

Multi-view Restricted Boltzmann Machines with Posterior Consistency

verfasst von : Ding Shifei, Zhang Nan, Zhang Jian

Erschienen in: Intelligent Information Processing IX

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Restricted Boltzmann machines (RBMs) have been proven to be powerful tools in many specific applications, such as representational learning and document modelling. However, the extensions of RBMs are rarely used in the field of multi-view learning. In this paper, we present a new multi-view RBM model, named as the RBM with posterior consistency, for multi-view classification. The RBM with posterior consistency computes multiple representations by regularizing the marginal likelihood function with the consistency among representations from different views. Contrasting with existing multi-view classification methods, such as multi-view Gaussian pro-cess with posterior consistency (MvGP) and consensus and complementarity based maximum entropy discrimination (MED-2C), the RBM with posterior consistency have achieved satisfactory results on two-class and multi-class classification datasets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRef Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRef
2.
Zurück zum Zitat Zhang, N., Ding, S., Zhang, J., Xue, Y.: An overview on restricted Boltzmann machines. Neurocomputing 275, 1186–1199 (2018)CrossRef Zhang, N., Ding, S., Zhang, J., Xue, Y.: An overview on restricted Boltzmann machines. Neurocomputing 275, 1186–1199 (2018)CrossRef
3.
Zurück zum Zitat Courville, A., Desjardins, G., Bergstra, J., Bengio, Y.: The spike-and-slab RBM and extensions to discrete and sparse data distributions. IEEE Trans. Pattern Anal. Mach. Intell. 36(9), 1874–1887 (2014)CrossRef Courville, A., Desjardins, G., Bergstra, J., Bengio, Y.: The spike-and-slab RBM and extensions to discrete and sparse data distributions. IEEE Trans. Pattern Anal. Mach. Intell. 36(9), 1874–1887 (2014)CrossRef
4.
Zurück zum Zitat Mittelman, R., Kuipers, B., Savarese, S., Lee, H.: Structured recurrent temporal restricted Boltzmann machines. In: Proceedings of International Conference on Machine Learning, ICML 2014, Beijing, China, pp. 1647–1655, 21–26 June 2014 Mittelman, R., Kuipers, B., Savarese, S., Lee, H.: Structured recurrent temporal restricted Boltzmann machines. In: Proceedings of International Conference on Machine Learning, ICML 2014, Beijing, China, pp. 1647–1655, 21–26 June 2014
5.
Zurück zum Zitat Zhang, N., Ding, S., Zhang, J., Xue, Y.: Research on point-wise gated deep networks. Appl. Soft Comput. 52, 1210–1221 (2017)CrossRef Zhang, N., Ding, S., Zhang, J., Xue, Y.: Research on point-wise gated deep networks. Appl. Soft Comput. 52, 1210–1221 (2017)CrossRef
6.
Zurück zum Zitat Nguyen, T.D., Tran, T., Phung, D., Venkatesh, S.: Graph-induced restricted Boltzmann machines for document modelling. Inf. Sci. 328, 60–75 (2016)CrossRef Nguyen, T.D., Tran, T., Phung, D., Venkatesh, S.: Graph-induced restricted Boltzmann machines for document modelling. Inf. Sci. 328, 60–75 (2016)CrossRef
7.
Zurück zum Zitat Amer, M.R., Shields, T., Siddiquie, B., Tamrakar, A., Divakaran, A., Chai, S.: Deep multimodal fusion: a hybrid approach. Int. J. Comput. Vis. 126(2–4), 440–456 (2018)MathSciNetCrossRef Amer, M.R., Shields, T., Siddiquie, B., Tamrakar, A., Divakaran, A., Chai, S.: Deep multimodal fusion: a hybrid approach. Int. J. Comput. Vis. 126(2–4), 440–456 (2018)MathSciNetCrossRef
8.
Zurück zum Zitat Salakhutdinov, R.R., Hinton, G.E.: Deep Boltzmann machines. In: Proceedings of International Conference on Artificial Intelligence and Statistics, AISTATS 2009, Clearwater Beach, pp. 448–455, 16–18 April 2009 Salakhutdinov, R.R., Hinton, G.E.: Deep Boltzmann machines. In: Proceedings of International Conference on Artificial Intelligence and Statistics, AISTATS 2009, Clearwater Beach, pp. 448–455, 16–18 April 2009
9.
Zurück zum Zitat Zhao, J., Xie, X., Xu, X., Sun, S.: Multi-view learning overview: recent progress and new challenges. Inf. Fusion 38, 43–54 (2017)CrossRef Zhao, J., Xie, X., Xu, X., Sun, S.: Multi-view learning overview: recent progress and new challenges. Inf. Fusion 38, 43–54 (2017)CrossRef
11.
Zurück zum Zitat Chao, G., Sun, S.: Consensus and complementarity based maximum entropy discrimination for multi-view classification. Inf. Sci. 367, 296–310 (2016)CrossRef Chao, G., Sun, S.: Consensus and complementarity based maximum entropy discrimination for multi-view classification. Inf. Sci. 367, 296–310 (2016)CrossRef
12.
Zurück zum Zitat Ravanbakhsh, S., Póczos, B., Schneider, J., Schuurmans, D., Greiner, R.: Stochastic neural net-works with monotonic activation functions. In: Proceedings of International Conference on Artificial Intelligence and Statistics, AISTATS 2016, Cadiz, pp. 809–818, 9–11 May 2016 Ravanbakhsh, S., Póczos, B., Schneider, J., Schuurmans, D., Greiner, R.: Stochastic neural net-works with monotonic activation functions. In: Proceedings of International Conference on Artificial Intelligence and Statistics, AISTATS 2016, Cadiz, pp. 809–818, 9–11 May 2016
13.
Zurück zum Zitat Hinton, G.E.: Training products of experts by minimizing contrastive divergence. Neural Comput. 14(8), 1711–1800 (2002)CrossRef Hinton, G.E.: Training products of experts by minimizing contrastive divergence. Neural Comput. 14(8), 1711–1800 (2002)CrossRef
14.
Zurück zum Zitat Ding, S., Zhang, X., An, Y., Xue, Y.: Weighted linear loss multiple birth support vector machine based on information granulation for multi-class classification. Pattern Recogn. 67, 32–46 (2017)CrossRef Ding, S., Zhang, X., An, Y., Xue, Y.: Weighted linear loss multiple birth support vector machine based on information granulation for multi-class classification. Pattern Recogn. 67, 32–46 (2017)CrossRef
Metadaten
Titel
Multi-view Restricted Boltzmann Machines with Posterior Consistency
verfasst von
Ding Shifei
Zhang Nan
Zhang Jian
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-00828-4_4