Skip to main content
Top
Published in: Environmental Earth Sciences 14/2019

01-07-2019 | Original Article

Cloud computing-based high accuracy surface modeling method for China’s Poyang Lake basin DEM generation

Authors: Changqing Yan, Jimin Liu, Chuanfa Chen, Tianxiang Yue

Published in: Environmental Earth Sciences | Issue 14/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The increasing availability of big spatial data demands large-scale surface modeling methods. To find a solution for large-scale surface modeling problem, based on previously developed high accuracy surface modeling (HASM) method, an extended high accuracy surface modeling method utilizing cloud computing is developed. The developed method was run on a Hadoop-based cloud computing environment comprising four computers and applied for China’s Poyang Lake basin digital elevation model construction. The experiments results indicate that the cloud computing-based method outperforms the general sequential method based on single computer significantly and attains three times speedups. Furthermore, the improved schedule algorithm for cloud computing-based HASM has further accelerated the computing speed.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Akdogan A, Demiryurek U, Banaei-Kashani F, Shahabi C (2010) Voronoi-based geospatial query processing with mapreduce. In: 2010 IEEE second international conference on cloud computing technology and science (CloudCom). IEEE, Indianapolis, IN, pp 9–16CrossRef Akdogan A, Demiryurek U, Banaei-Kashani F, Shahabi C (2010) Voronoi-based geospatial query processing with mapreduce. In: 2010 IEEE second international conference on cloud computing technology and science (CloudCom). IEEE, Indianapolis, IN, pp 9–16CrossRef
go back to reference Almeer MH (2012) Hadoop Mapreduce for remote sensing image analysis. Int J Emerg Technol Adv Eng 2(4):443–451 Almeer MH (2012) Hadoop Mapreduce for remote sensing image analysis. Int J Emerg Technol Adv Eng 2(4):443–451
go back to reference Armbrust M, Fox A, Griffith R, Joseph AD, Katz RH, Konwinski A, Lee G, Patterson DA, Rabkin A, Stoica I (2009) Above the clouds: a Berkeley view of cloud computing. UC Berkeley Technical Report Armbrust M, Fox A, Griffith R, Joseph AD, Katz RH, Konwinski A, Lee G, Patterson DA, Rabkin A, Stoica I (2009) Above the clouds: a Berkeley view of cloud computing. UC Berkeley Technical Report
go back to reference Borthakur D (2007) The Hadoop distributed file system: architecture and design. Hadoop Project Website Borthakur D (2007) The Hadoop distributed file system: architecture and design. Hadoop Project Website
go back to reference Eldawy A, Mokbel MF (2015) The era of big spatial data: a survey. Inf Media Technol 10(2):305–316 Eldawy A, Mokbel MF (2015) The era of big spatial data: a survey. Inf Media Technol 10(2):305–316
go back to reference Fisher PF, Tate NJ (2006) Causes and consequences of error in digital elevation models. Prog Phys Geogr 30(4):467–489CrossRef Fisher PF, Tate NJ (2006) Causes and consequences of error in digital elevation models. Prog Phys Geogr 30(4):467–489CrossRef
go back to reference Gunarathne T, Wu TL, Choi JY, Bae SH, Qiu J (2011) Cloud computing paradigms for pleasingly parallel biomedical applications. Concurr Comput Pract Exp 23(17):2338–2354CrossRef Gunarathne T, Wu TL, Choi JY, Bae SH, Qiu J (2011) Cloud computing paradigms for pleasingly parallel biomedical applications. Concurr Comput Pract Exp 23(17):2338–2354CrossRef
go back to reference Hegeman JW, Sardeshmukh VB, Sugumaran R, Armstrong MP (2014) Distributed LiDAR data processing in a high-memory cloud-computing environment. Ann GIS 20(4):255–264CrossRef Hegeman JW, Sardeshmukh VB, Sugumaran R, Armstrong MP (2014) Distributed LiDAR data processing in a high-memory cloud-computing environment. Ann GIS 20(4):255–264CrossRef
go back to reference Jian X, Xiao X, Chengfang H, Zhizhong Z, Zhaohui W, Dengzhong Z (2015) A Hadoop-based algorithm of generating DEM grid from point cloud data. Int Arch Photogramm Remote Sens Spat Inf Sci 40(7):1209CrossRef Jian X, Xiao X, Chengfang H, Zhizhong Z, Zhaohui W, Dengzhong Z (2015) A Hadoop-based algorithm of generating DEM grid from point cloud data. Int Arch Photogramm Remote Sens Spat Inf Sci 40(7):1209CrossRef
go back to reference Mell P, Grance T (2011) The NIST definition of cloud computing (draft). NIST Spec Publ 800(145):7 Mell P, Grance T (2011) The NIST definition of cloud computing (draft). NIST Spec Publ 800(145):7
go back to reference Stein LD (2010) The case for cloud computing in genome informatics. Genome Biol 11(5):207CrossRef Stein LD (2010) The case for cloud computing in genome informatics. Genome Biol 11(5):207CrossRef
go back to reference Sugumaran R, Burnett J, Armstrong MP (2014) Using a cloud computing environment to process large 3D spatial datasets. In: Karimi HA (ed) Big data: techniques and technologies in geoinformatics. Taylor & Francis Group, p 55 Sugumaran R, Burnett J, Armstrong MP (2014) Using a cloud computing environment to process large 3D spatial datasets. In: Karimi HA (ed) Big data: techniques and technologies in geoinformatics. Taylor & Francis Group, p 55
go back to reference Vecchiola C, Pandey S, Buyya R (2009) High-performance cloud computing: a view of scientific applications. In: 2009 10th international symposium on pervasive systems, algorithms, and networks (ISPAN). IEEE, Kaohsiung, pp 4–16CrossRef Vecchiola C, Pandey S, Buyya R (2009) High-performance cloud computing: a view of scientific applications. In: 2009 10th international symposium on pervasive systems, algorithms, and networks (ISPAN). IEEE, Kaohsiung, pp 4–16CrossRef
go back to reference Xu Z, Guan J, Zhou J (2015) A distributed inverse distance weighted interpolation algorithm based on the cloud computing platform of Hadoop and its implementation. In: 12th International conference on fuzzy systems and knowledge discovery (FSKD’15). IEEE, Zhangjiajie, pp 2460–2464 Xu Z, Guan J, Zhou J (2015) A distributed inverse distance weighted interpolation algorithm based on the cloud computing platform of Hadoop and its implementation. In: 12th International conference on fuzzy systems and knowledge discovery (FSKD’15). IEEE, Zhangjiajie, pp 2460–2464
go back to reference Yan C, Yue T, Liu J, Zhao C, Li H, Chen C (2015) A comparison of methods for solving high accuracy surface modeling in DEM construction. J Algorithms Comput Technol 9(4):377–388CrossRef Yan C, Yue T, Liu J, Zhao C, Li H, Chen C (2015) A comparison of methods for solving high accuracy surface modeling in DEM construction. J Algorithms Comput Technol 9(4):377–388CrossRef
go back to reference Yang C, Goodchild M, Huang Q, Nebert D, Raskin R, Xu Y, Bambacus M, Fay D (2011) Spatial cloud computing: how can the geospatial sciences use and help shape cloud computing? Int J Digit Earth 4(4):305–329CrossRef Yang C, Goodchild M, Huang Q, Nebert D, Raskin R, Xu Y, Bambacus M, Fay D (2011) Spatial cloud computing: how can the geospatial sciences use and help shape cloud computing? Int J Digit Earth 4(4):305–329CrossRef
go back to reference Yue TX (2011) Surface modeling: high accuracy and high speed methods. CRC Press, New YorkCrossRef Yue TX (2011) Surface modeling: high accuracy and high speed methods. CRC Press, New YorkCrossRef
go back to reference Zhang Q, Cheng L, Boutaba R (2010) Cloud computing: state-of-the-art and research challenges. J Internet Serv Appl 1(1):7–18CrossRef Zhang Q, Cheng L, Boutaba R (2010) Cloud computing: state-of-the-art and research challenges. J Internet Serv Appl 1(1):7–18CrossRef
go back to reference Zhao W, Ma H, He Q (2009) Parallel K-means clustering based on mapreduce. In: Jaatun MG, Zhao G, Rong C (eds) Cloud computing, vol 5931. Springer, Berlin, Heidelberg, pp 674–679CrossRef Zhao W, Ma H, He Q (2009) Parallel K-means clustering based on mapreduce. In: Jaatun MG, Zhao G, Rong C (eds) Cloud computing, vol 5931. Springer, Berlin, Heidelberg, pp 674–679CrossRef
Metadata
Title
Cloud computing-based high accuracy surface modeling method for China’s Poyang Lake basin DEM generation
Authors
Changqing Yan
Jimin Liu
Chuanfa Chen
Tianxiang Yue
Publication date
01-07-2019
Publisher
Springer Berlin Heidelberg
Published in
Environmental Earth Sciences / Issue 14/2019
Print ISSN: 1866-6280
Electronic ISSN: 1866-6299
DOI
https://doi.org/10.1007/s12665-019-8387-9

Other articles of this Issue 14/2019

Environmental Earth Sciences 14/2019 Go to the issue