Skip to main content

2020 | OriginalPaper | Buchkapitel

Design and Implementation of Sensory Data Collection and Storage Based on Hadoop Platform

verfasst von : Zhen Bai, Shaohua Cui, Chenglin Zhao

Erschienen in: Communications, Signal Processing, and Systems

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

At present, modern manufacturing and management concepts such as digitization, networking, and intelligence are widely used in the industry. Industry automation and information have been unprecedentedly improved, and therefore the entire life of industrial production link involves massive amounts of data, and the status monitoring data of industrial machine have large, multiple source, heterogeneous, and complex data characteristics. What is more, the traditional processing methods and tools could not meet the requirements for massive data, and may miss the best time to repair machine. So, to resolve the challenges that the industrial sensory big data faces, this paper proposes the sensory data collection and storage based on Hadoop platform.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Liu, F.C., Shen, F.: Building a research data science platform from industrial machines. In: IEEE Conference (2015) Liu, F.C., Shen, F.: Building a research data science platform from industrial machines. In: IEEE Conference (2015)
2.
Zurück zum Zitat Manwal, M., Gupta, A.: Big Data and Hadoop A Technological Survey, Emerging Trends in Computing and Communication Technologies (ICETCCT), February (2018) Manwal, M., Gupta, A.: Big Data and Hadoop A Technological Survey, Emerging Trends in Computing and Communication Technologies (ICETCCT), February (2018)
3.
Zurück zum Zitat Lyu, Y., Fan, X., Liu, K.: An optimized strategy for small files storing and accessing in HDFS. In: IEEE International Conference on Computational Science and Engineering (CSE), vol. 1, pp. 611–614 (2017) Lyu, Y., Fan, X., Liu, K.: An optimized strategy for small files storing and accessing in HDFS. In: IEEE International Conference on Computational Science and Engineering (CSE), vol. 1, pp. 611–614 (2017)
4.
Zurück zum Zitat Sarnovsky, M., Bajus, D.: Building environment analysis based on clustering methods from sensory data on top of the Hadoop platform. In: IEEE Conference (2017) Sarnovsky, M., Bajus, D.: Building environment analysis based on clustering methods from sensory data on top of the Hadoop platform. In: IEEE Conference (2017)
5.
Zurück zum Zitat Xie, J.: Construction for the city taxi trajectory data analysis system by Hadoop platform. In: IEEE Conference (2017) Xie, J.: Construction for the city taxi trajectory data analysis system by Hadoop platform. In: IEEE Conference (2017)
6.
Zurück zum Zitat Zhonghua, M.: Seismic data attribute extraction based on Hadoop platform. In: IEEE Conference (2017) Zhonghua, M.: Seismic data attribute extraction based on Hadoop platform. In: IEEE Conference (2017)
7.
Zurück zum Zitat Longley, P.A., Goodchild, M.F., Maguire, D.J., Rhind, D.W.: Geographic Information Systems and Science. Wiley, New York (2001) Longley, P.A., Goodchild, M.F., Maguire, D.J., Rhind, D.W.: Geographic Information Systems and Science. Wiley, New York (2001)
8.
Zurück zum Zitat Mazumdar, S., Dhar, S.: Hadoop as big data operating system—the emerging approach for managing challenges of enterprise big data platform. In: IEEE Conference (2015) Mazumdar, S., Dhar, S.: Hadoop as big data operating system—the emerging approach for managing challenges of enterprise big data platform. In: IEEE Conference (2015)
9.
Zurück zum Zitat Ding, X., Tian, B.: A scheme of structured data compression and query on Hadoop platform. In: IEEE Conference (2015) Ding, X., Tian, B.: A scheme of structured data compression and query on Hadoop platform. In: IEEE Conference (2015)
10.
Zurück zum Zitat Yan, H., Song, G.: Based on the Hadoop cloud computing experiment platform. J. Shenyang Norm. Univ. (Natural Sciences) 1, 85–89 (2013) Yan, H., Song, G.: Based on the Hadoop cloud computing experiment platform. J. Shenyang Norm. Univ. (Natural Sciences) 1, 85–89 (2013)
Metadaten
Titel
Design and Implementation of Sensory Data Collection and Storage Based on Hadoop Platform
verfasst von
Zhen Bai
Shaohua Cui
Chenglin Zhao
Copyright-Jahr
2020
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-6508-9_106