Skip to main content
Top
Published in: Wireless Personal Communications 1/2018

09-02-2018

Development and Application of Big Data Platform for “Bohai granary”

Authors: Pingzeng Liu, Xiujuan Wang, Fujiang Wen, Yuqi Liu, Zhanquan Sun, Chao Zhang, Maoling Yan, Linqiang Fan

Published in: Wireless Personal Communications | Issue 1/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In order to effectively solve series of problems which affect grain production in implementation of the “Bohai granary” project, such as the wide varieties of factors (including soil fertility, soil salinity, pH, underground water level, water salinity, crop varieties and management etc.), the huge spatial and temporal variability, the difficulty of real-time information collection, the complexity of analysis and processing etc., a “Bohai granary” big data platform is developed. With the invention of “Shennong IOAT” series of sensing equipment, the acquisition of multi-site real-time synchronization field information is achieved. And by combining a variety of data collection methods, the collection of factors comprehensively affecting the grain production has been realized. Based on the Hadoop big data platform, it becomes a reality to store, analyze and apply the collected data efficiently. Through the big data platform, the precise management of grain production, the automatic warning of soil moisture content, the disaster and typical insect damage in crop growth, and the automatic control of typical link production are all achieved.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Li, G., & Cheng, X. (2012). Research status and scientific thinking of big data. Bulletin of Chinese Academy of Sciences, 27(6), 647–657. Li, G., & Cheng, X. (2012). Research status and scientific thinking of big data. Bulletin of Chinese Academy of Sciences, 27(6), 647–657.
2.
go back to reference Zikopoulos, P., & Eaton, C. (2012). Understanding big data: Analytics for enterprise class Hadoop and streaming data. New York: McGraw-Hill Osborne Media. Zikopoulos, P., & Eaton, C. (2012). Understanding big data: Analytics for enterprise class Hadoop and streaming data. New York: McGraw-Hill Osborne Media.
4.
go back to reference Zhang, Y. (2013). Research on big data management with architecture of fusion of database and MapReduce. e-Science Technology & Application, 4(1), 19–29. Zhang, Y. (2013). Research on big data management with architecture of fusion of database and MapReduce. e-Science Technology & Application, 4(1), 19–29.
5.
go back to reference Tao, X. J., Xiao-Feng, H. U., & Liu, Y. (2013). Overview of big data research. Journal of System Simulation, 25(260S1), 142–146. Tao, X. J., Xiao-Feng, H. U., & Liu, Y. (2013). Overview of big data research. Journal of System Simulation, 25(260S1), 142–146.
6.
go back to reference Jin, X., Wang, Y., & Cheng, X. (2013). Research system and status of big data. Information & Communications Technologies, 6, 35–43. Jin, X., Wang, Y., & Cheng, X. (2013). Research system and status of big data. Information & Communications Technologies, 6, 35–43.
7.
go back to reference Sun, Z. F., Du, K. M., Zheng, F. X., et al. (2013). Perspectives of research and application of big data on smart agriculture. Journal of Agricultural Science & Technology, 15(6), 63–71. Sun, Z. F., Du, K. M., Zheng, F. X., et al. (2013). Perspectives of research and application of big data on smart agriculture. Journal of Agricultural Science & Technology, 15(6), 63–71.
8.
go back to reference Shi-Wei, X. U., Wang, D. J., & Zhe-Min, L. I. (2015). Application research on big data promote agricultural modernization. Scientia Agricultura Sinica, 48(17), 3429–3438. Shi-Wei, X. U., Wang, D. J., & Zhe-Min, L. I. (2015). Application research on big data promote agricultural modernization. Scientia Agricultura Sinica, 48(17), 3429–3438.
9.
go back to reference Yu, Y., & Song, M. (2013). Big data. ZTE Technology Journal, 1, 57–60. Yu, Y., & Song, M. (2013). Big data. ZTE Technology Journal, 1, 57–60.
10.
go back to reference Weng, W. H., & Lin, W. T. (2014). Development trends and strategy planning in big data industry. Contemporary Management Research, 10, 203–214.CrossRef Weng, W. H., & Lin, W. T. (2014). Development trends and strategy planning in big data industry. Contemporary Management Research, 10, 203–214.CrossRef
11.
go back to reference Gong, X. Y., Bo-Hu, L. I., Chai, X. D., et al. (2014). Survey on big data platform technology. Journal of System Simulation, 26(3), 489–496. Gong, X. Y., Bo-Hu, L. I., Chai, X. D., et al. (2014). Survey on big data platform technology. Journal of System Simulation, 26(3), 489–496.
12.
go back to reference Wang, H. Y. (2011). An application of Hadoop platform in cloud computing. Computer Engineering & Software, 32(4), 36–38. Wang, H. Y. (2011). An application of Hadoop platform in cloud computing. Computer Engineering & Software, 32(4), 36–38.
13.
go back to reference Yan, X. F., & Zhang, D. X. (2013). Big data research. Computer Technology & Development, 23(4), 168–172.MathSciNet Yan, X. F., & Zhang, D. X. (2013). Big data research. Computer Technology & Development, 23(4), 168–172.MathSciNet
14.
go back to reference Liu, Z. H., & Zhang, Q. L. (2014). Research overview of big data technology. Journal of Zhejiang University, 48(6), 957–972.MATH Liu, Z. H., & Zhang, Q. L. (2014). Research overview of big data technology. Journal of Zhejiang University, 48(6), 957–972.MATH
15.
go back to reference Zhang, F. J. (2014). Overview on big data technology. Communications Technology, 47(11), 1240–1248. Zhang, F. J. (2014). Overview on big data technology. Communications Technology, 47(11), 1240–1248.
16.
go back to reference Xuelong, L. I., & Gong, H. G. (2015). A survey on big data systems. Scientia Sinica Informationis, 45(1), 1–44. Xuelong, L. I., & Gong, H. G. (2015). A survey on big data systems. Scientia Sinica Informationis, 45(1), 1–44.
17.
go back to reference Shepler, S., Callaghan, B., Robinson, D., et al. (2003). Network File System (NFS) version 4 Protocol. AMC Transactions on Computer Systems, 6(5), 3–4. Shepler, S., Callaghan, B., Robinson, D., et al. (2003). Network File System (NFS) version 4 Protocol. AMC Transactions on Computer Systems, 6(5), 3–4.
18.
go back to reference Ghemawat, S., Gobioff, H., & Leung, S. T. (2003). The Google file system. In Nineteenth ACM symposium on operating systems principles (pp. 29–43). ACM. Ghemawat, S., Gobioff, H., & Leung, S. T. (2003). The Google file system. In Nineteenth ACM symposium on operating systems principles (pp. 29–43). ACM.
20.
go back to reference Beaver, D., Kumar, S., Li, H. C., et al. (2010). Finding a needle in Haystack: Facebook’s photo storage. In: Usenix conference on operating systems design and implementation (pp. 47–60). USENIX Association. Beaver, D., Kumar, S., Li, H. C., et al. (2010). Finding a needle in Haystack: Facebook’s photo storage. In: Usenix conference on operating systems design and implementation (pp. 47–60). USENIX Association.
22.
go back to reference Decandia, G., Hastorun, D., Jampani, M., et al. (2007). Dynamo: Amazon’s highly available key-value store. In ACM sigops symposium on operating systems principles (pp. 205–220). ACM. Decandia, G., Hastorun, D., Jampani, M., et al. (2007). Dynamo: Amazon’s highly available key-value store. In ACM sigops symposium on operating systems principles (pp. 205–220). ACM.
23.
go back to reference Chang, F., Dean, J., Ghemawat, S., et al. (2010). Tushar Chandra, Andrew Fikes, and Robert E. Gruber. Bigtable: A distributed storage system for structured data. In Proceedings of USENIX Symposium on Operating System. Chang, F., Dean, J., Ghemawat, S., et al. (2010). Tushar Chandra, Andrew Fikes, and Robert E. Gruber. Bigtable: A distributed storage system for structured data. In Proceedings of USENIX Symposium on Operating System.
24.
go back to reference Malewicz, G., Austern, M. H., Bik, A. J. C., et al. (2010). Pregel: A system for large-scale graph processing. In ACM SIGMOD international conference on management of data (pp. 135–146). ACM. Malewicz, G., Austern, M. H., Bik, A. J. C., et al. (2010). Pregel: A system for large-scale graph processing. In ACM SIGMOD international conference on management of data (pp. 135–146). ACM.
25.
go back to reference Melnik, S., Gubarev, A., Long, J. J., et al. (2011). Dremel: Interactive analysis of web-scale datasets. Communications of the ACM, 3(12), 114–123.CrossRef Melnik, S., Gubarev, A., Long, J. J., et al. (2011). Dremel: Interactive analysis of web-scale datasets. Communications of the ACM, 3(12), 114–123.CrossRef
26.
go back to reference Labrinidis, A., & Jagadish, H. V. (2012). Challenges and opportunities with big data. VLDB Endowment. Labrinidis, A., & Jagadish, H. V. (2012). Challenges and opportunities with big data. VLDB Endowment.
27.
go back to reference Crockford, D. (2006). The application/json media type for javascript object notation (json). Journal of Biological Regulators & Homeostatic Agents, 13(4), 250–251. Crockford, D. (2006). The application/json media type for javascript object notation (json). Journal of Biological Regulators & Homeostatic Agents, 13(4), 250–251.
28.
go back to reference Dean, J., & Ghemawat, S. (2008). MapReduce: Simplified data processing on large clusters. ACM, 51, 107.CrossRef Dean, J., & Ghemawat, S. (2008). MapReduce: Simplified data processing on large clusters. ACM, 51, 107.CrossRef
29.
go back to reference Isard, M., Budiu, M., Yu, Y., et al. (2007). Dryad:distributed data-parallel programs from sequential building blocks. ACM SIGOPS Operating Systems Review, 41(3), 59–72.CrossRef Isard, M., Budiu, M., Yu, Y., et al. (2007). Dryad:distributed data-parallel programs from sequential building blocks. ACM SIGOPS Operating Systems Review, 41(3), 59–72.CrossRef
30.
go back to reference Low, Y., Bickson, D., Gonzalez, J., et al. (2012). Distributed GraphLab: A framework for machine learning and data mining in the cloud. Proceedings of the Vldb Endowment, 5(8), 716–727.CrossRef Low, Y., Bickson, D., Gonzalez, J., et al. (2012). Distributed GraphLab: A framework for machine learning and data mining in the cloud. Proceedings of the Vldb Endowment, 5(8), 716–727.CrossRef
31.
go back to reference Neumeyer, L., Robbins, B., Nair, A., et al. (2010). S4: Distributed stream computing platform. In IEEE International Conference on Data Mining Workshops (pp. 170–177). IEEE Computer Society. Neumeyer, L., Robbins, B., Nair, A., et al. (2010). S4: Distributed stream computing platform. In IEEE International Conference on Data Mining Workshops (pp. 170–177). IEEE Computer Society.
32.
go back to reference Zwaenepoel, W., Zwaenepoel, W., & Zwaenepoel, W. (2013). X-Stream: Edge-centric graph processing using streaming partitions. In Twenty-Fourth ACM symposium on operating systems principles (pp. 472–488). ACM. Zwaenepoel, W., Zwaenepoel, W., & Zwaenepoel, W. (2013). X-Stream: Edge-centric graph processing using streaming partitions. In Twenty-Fourth ACM symposium on operating systems principles (pp. 472–488). ACM.
34.
go back to reference Doctorow, C. (2008). Big data: Welcome to the petacentre. Nature, 455(7209), 16.CrossRef Doctorow, C. (2008). Big data: Welcome to the petacentre. Nature, 455(7209), 16.CrossRef
35.
go back to reference Keim, D., Andrienko, G., Fekete, J. D., Görg, C., Kohlhammer, J., & Melançon, G. (2008). Visual analytics: Definition, process, and challenges. Information Visualization: Human-Centered Issues and Perspectives, 4950, 154–175.CrossRef Keim, D., Andrienko, G., Fekete, J. D., Görg, C., Kohlhammer, J., & Melançon, G. (2008). Visual analytics: Definition, process, and challenges. Information Visualization: Human-Centered Issues and Perspectives, 4950, 154–175.CrossRef
36.
go back to reference Min, C., & Jaenicke, H. (2010). An information-theoretic framework for visualization. IEEE Transactions on Visualization and Computer Graphics, 16(6), 1206–1215.CrossRef Min, C., & Jaenicke, H. (2010). An information-theoretic framework for visualization. IEEE Transactions on Visualization and Computer Graphics, 16(6), 1206–1215.CrossRef
37.
go back to reference Dervin, B. (1998). Sense-making theory and practice: An overview of user interests in knowledge seeking and use. Journal of Knowledge Management, 2(2), 36–46.CrossRef Dervin, B. (1998). Sense-making theory and practice: An overview of user interests in knowledge seeking and use. Journal of Knowledge Management, 2(2), 36–46.CrossRef
38.
go back to reference Dervin, B. (1999). On studying information seeking methodologically: The implications of connecting metatheory to method. Information Processing & Management, 35(6), 727–750.CrossRef Dervin, B. (1999). On studying information seeking methodologically: The implications of connecting metatheory to method. Information Processing & Management, 35(6), 727–750.CrossRef
39.
go back to reference Piaget, J. (2008). Intellectual evolution from adolescence to adulthood. Human Development, 51(1), 40–47.CrossRef Piaget, J. (2008). Intellectual evolution from adolescence to adulthood. Human Development, 51(1), 40–47.CrossRef
40.
go back to reference Chandramohan, V., & Christensen, K. (2002). A first look at wired sensor networks for video surveillance systems. In IEEE conference on local computer Networks, Proceedings. LCN 2002 (pp. 728–729). IEEE. Chandramohan, V., & Christensen, K. (2002). A first look at wired sensor networks for video surveillance systems. In IEEE conference on local computer Networks, Proceedings. LCN 2002 (pp. 728–729). IEEE.
41.
go back to reference Post, F. H., Nielson, G. M., & Bonneau, G. P. (2003). Data visualization. New York: Springer.CrossRef Post, F. H., Nielson, G. M., & Bonneau, G. P. (2003). Data visualization. New York: Springer.CrossRef
42.
go back to reference Vinh, N. Q., Yu, Q., Huang, M. L., et al. (2013). TabuVis: A tool for visual analytics multidimensional datasets. Science China, 56(5), 1–12. Vinh, N. Q., Yu, Q., Huang, M. L., et al. (2013). TabuVis: A tool for visual analytics multidimensional datasets. Science China, 56(5), 1–12.
Metadata
Title
Development and Application of Big Data Platform for “Bohai granary”
Authors
Pingzeng Liu
Xiujuan Wang
Fujiang Wen
Yuqi Liu
Zhanquan Sun
Chao Zhang
Maoling Yan
Linqiang Fan
Publication date
09-02-2018
Publisher
Springer US
Published in
Wireless Personal Communications / Issue 1/2018
Print ISSN: 0929-6212
Electronic ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-018-5441-y

Other articles of this Issue 1/2018

Wireless Personal Communications 1/2018 Go to the issue