Skip to main content
Top

2016 | OriginalPaper | Chapter

Application and Implementation of Private Cloud in Agriculture Sensory Data Platform

Authors : Shuwen Jiang, Tian’en Chen, Jing Dong

Published in: Computer and Computing Technologies in Agriculture IX

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the explosive development of the Internet of things technology in recent years, the Internet of things technology is also used more and more widely in modern agricultural production. For mass sensor data was produced by the Internet of things in agricultural production, While big data bring many benefits and unprecedented challenges to users. The Internet of things in agriculture production produces some complexity problem which are mass sensor data’s Scale, sensor data’s heterogeneity and mass sensor data’s operation, distribution of sensor, high concurrency of data is written etc. In the presence of these problems, this paper put forward a kind solution of agricultural private cloud sensor data Platform, which is named “Sensor PrivateClouds Platform” (SPCP). The Private cloud platform including following modules, All of these are distributed sensor data caching module based on cluster of memercached and Nginx load (SensorCache); heterogeneous data adapter of sensor module (SensorAdpter), distributed computing storage module based on hadoop’ HDFS (SensorStorage), efficient query module of sensor data warehouse based on the Hive (SensorStore), management module of sensor metadata (SensorManager), parallel sensor data analysis module (SensorNum) based on the map-reduce of the hadoop, cloud service of sensor data module (SensorPublish) based on webservice. The experimental results show that SPCP have had the abilities which are mass sensor data storage, cleaning of heterogeneous sensor data, real-time query and processing of mass sensor data. These abilities provides a feasible solution for the heterogeneous data storage and mass sensor data’s query in the Internet of things of agriculture production.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Zhao, Z.-F., Wei, W.-F., Qiang, M.A.: A real-time processing system for massive sensing data. Microelectron. Comput. 29(9), 10–14 (2012) Zhao, Z.-F., Wei, W.-F., Qiang, M.A.: A real-time processing system for massive sensing data. Microelectron. Comput. 29(9), 10–14 (2012)
2.
go back to reference Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. In: Proceedings of the SOSP, pp. 20–43 (2003) Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. In: Proceedings of the SOSP, pp. 20–43 (2003)
3.
go back to reference Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large cluster. In: Proceedings of the OSDI 2004, pp. 137–150 (2004) Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large cluster. In: Proceedings of the OSDI 2004, pp. 137–150 (2004)
5.
go back to reference Pike, R., Dorward, S., Griesemer, R., Quinlan, S.: Interpreting the data: parallel analysis with sawzall. Sci. Program. J. 13(4), 227–298 (2005) Pike, R., Dorward, S., Griesemer, R., Quinlan, S.: Interpreting the data: parallel analysis with sawzall. Sci. Program. J. 13(4), 227–298 (2005)
6.
go back to reference Thusoo, A., Sarma, J.S., Jain, N., Shao, Z., et al.: Hive-a petabyte scale data warehouse using Hadoop data engineering. In: Proceedings of the ICDE, pp. 996–1005 (2010) Thusoo, A., Sarma, J.S., Jain, N., Shao, Z., et al.: Hive-a petabyte scale data warehouse using Hadoop data engineering. In: Proceedings of the ICDE, pp. 996–1005 (2010)
7.
go back to reference Olston, C., Reed, B., Sirvastava, U., Kumar, R., Tomkins, A.: Pig Latin: a not-so-foreign language for data processing. In: Proceedings of the SIGMOD, pp. 1099–1110 (2008) Olston, C., Reed, B., Sirvastava, U., Kumar, R., Tomkins, A.: Pig Latin: a not-so-foreign language for data processing. In: Proceedings of the SIGMOD, pp. 1099–1110 (2008)
8.
go back to reference Chen, T., Xiao, N., Liu, F., Fu, C.S.: Clustering-based and consistent hashing-aware data placement algorithm. J. Softw. 21(12), 3175–3185 (2010)CrossRef Chen, T., Xiao, N., Liu, F., Fu, C.S.: Clustering-based and consistent hashing-aware data placement algorithm. J. Softw. 21(12), 3175–3185 (2010)CrossRef
9.
go back to reference Patten, S.: The S3 Sookbook: Get Cooking with Amazon’s Simple Storage Service. Sopobo (2009) Patten, S.: The S3 Sookbook: Get Cooking with Amazon’s Simple Storage Service. Sopobo (2009)
10.
go back to reference Murty, J.: Programming Amazon Web Service: S3, EC2, SQS, FPS, and SimpleDB. O’Reilly, Sebastopol (2008) Murty, J.: Programming Amazon Web Service: S3, EC2, SQS, FPS, and SimpleDB. O’Reilly, Sebastopol (2008)
Metadata
Title
Application and Implementation of Private Cloud in Agriculture Sensory Data Platform
Authors
Shuwen Jiang
Tian’en Chen
Jing Dong
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-48354-2_6

Premium Partner