Skip to main content
Top

2018 | OriginalPaper | Chapter

Clustering Model Based on RBM Encoding in Big Data

Authors : Lina Yuan, Xinfeng Xiao, FuFang Li, Ningning Deng

Published in: Cloud Computing and Security

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, a clustering model based on deep learning RBM encoding is proposed for the further data mining of the massive, complex and high-dimensional data. This model includes two major parts: pre-training and fine-tuning & optimization. In the pre-training part, proper parameters are adopted for RBM encoding to reduce the high-dimensional and large-scaled data, and then pre-clustering is done with k-means and other algorithms. The fine-tuning & optimization part is developed from the deep structure of pre-training to form a deep fine-tuning, and network is initialized with the parameters generated from the pre-training, and then the initial clustering center generated from pre-training process is further clustered and optimized. At the same time, encoding features are optimized and the final clustering center and membership matrix are obtained. In order to validate this model, some data are selected from the UCI dataset for clustering comparison. It is indicated in the data analysis that this clustering model based on RBM encoding has little impact on the clustering effect, but the execution is more efficient.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Jinjia, W., et al.: The study of deep learning under big data. High Technol. Lett. 27(1), 27–37 (2017). (in Chinese) Jinjia, W., et al.: The study of deep learning under big data. High Technol. Lett. 27(1), 27–37 (2017). (in Chinese)
2.
go back to reference Weng, S.: The construction of the cognitive modeling for deep learning based on the micro-MOOC learning system. Mod. Educ. Technol. 27(6), 87–93 (2017). (in Chinese) Weng, S.: The construction of the cognitive modeling for deep learning based on the micro-MOOC learning system. Mod. Educ. Technol. 27(6), 87–93 (2017). (in Chinese)
3.
go back to reference Cai, H.: Research of clustering algorithms in big data analysis. Hehui University Of Science Technology, An Hui, pp. 1–33 (2016). (in Chinese) Cai, H.: Research of clustering algorithms in big data analysis. Hehui University Of Science Technology, An Hui, pp. 1–33 (2016). (in Chinese)
4.
go back to reference Qi, Y.: Research of key technologies of clustering based on deep learning. Southwest Jiaotong University, Si Chuan, pp. 1–58 (2016). (in Chinese) Qi, Y.: Research of key technologies of clustering based on deep learning. Southwest Jiaotong University, Si Chuan, pp. 1–58 (2016). (in Chinese)
5.
go back to reference Li, F., Xie, D., Qi, D., Xie, G., Chen, W., Peng, L.: Research on effective and intelligent resource management in internet computing. Appl. Math. Inf. Sci. 8(2), 625–631 (2014)CrossRef Li, F., Xie, D., Qi, D., Xie, G., Chen, W., Peng, L.: Research on effective and intelligent resource management in internet computing. Appl. Math. Inf. Sci. 8(2), 625–631 (2014)CrossRef
6.
go back to reference Ma, S.: ETc. Deep learning with big data: state of art and development. CAAI Trans. Intell. Syst. 11(6), 728–740 (2016). (in Chinese) Ma, S.: ETc. Deep learning with big data: state of art and development. CAAI Trans. Intell. Syst. 11(6), 728–740 (2016). (in Chinese)
7.
go back to reference Zhang, J.: ETc. Review of deep learning. Appl. Res. Comput. 35(7), 27–37 (2018). (in Chinese) Zhang, J.: ETc. Review of deep learning. Appl. Res. Comput. 35(7), 27–37 (2018). (in Chinese)
8.
go back to reference Keguang, Y.: Research on incremental clustering method for large dataset. Mod. Electron. Tech. 40(9), 176–182 (2017). (in Chinese) Keguang, Y.: Research on incremental clustering method for large dataset. Mod. Electron. Tech. 40(9), 176–182 (2017). (in Chinese)
Metadata
Title
Clustering Model Based on RBM Encoding in Big Data
Authors
Lina Yuan
Xinfeng Xiao
FuFang Li
Ningning Deng
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-00006-6_35

Premium Partner