Skip to main content
Erschienen in: Environmental Earth Sciences 14/2019

01.07.2019 | Original Article

Cloud computing-based high accuracy surface modeling method for China’s Poyang Lake basin DEM generation

verfasst von: Changqing Yan, Jimin Liu, Chuanfa Chen, Tianxiang Yue

Erschienen in: Environmental Earth Sciences | Ausgabe 14/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The increasing availability of big spatial data demands large-scale surface modeling methods. To find a solution for large-scale surface modeling problem, based on previously developed high accuracy surface modeling (HASM) method, an extended high accuracy surface modeling method utilizing cloud computing is developed. The developed method was run on a Hadoop-based cloud computing environment comprising four computers and applied for China’s Poyang Lake basin digital elevation model construction. The experiments results indicate that the cloud computing-based method outperforms the general sequential method based on single computer significantly and attains three times speedups. Furthermore, the improved schedule algorithm for cloud computing-based HASM has further accelerated the computing speed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Akdogan A, Demiryurek U, Banaei-Kashani F, Shahabi C (2010) Voronoi-based geospatial query processing with mapreduce. In: 2010 IEEE second international conference on cloud computing technology and science (CloudCom). IEEE, Indianapolis, IN, pp 9–16CrossRef Akdogan A, Demiryurek U, Banaei-Kashani F, Shahabi C (2010) Voronoi-based geospatial query processing with mapreduce. In: 2010 IEEE second international conference on cloud computing technology and science (CloudCom). IEEE, Indianapolis, IN, pp 9–16CrossRef
Zurück zum Zitat Almeer MH (2012) Hadoop Mapreduce for remote sensing image analysis. Int J Emerg Technol Adv Eng 2(4):443–451 Almeer MH (2012) Hadoop Mapreduce for remote sensing image analysis. Int J Emerg Technol Adv Eng 2(4):443–451
Zurück zum Zitat Armbrust M, Fox A, Griffith R, Joseph AD, Katz RH, Konwinski A, Lee G, Patterson DA, Rabkin A, Stoica I (2009) Above the clouds: a Berkeley view of cloud computing. UC Berkeley Technical Report Armbrust M, Fox A, Griffith R, Joseph AD, Katz RH, Konwinski A, Lee G, Patterson DA, Rabkin A, Stoica I (2009) Above the clouds: a Berkeley view of cloud computing. UC Berkeley Technical Report
Zurück zum Zitat Borthakur D (2007) The Hadoop distributed file system: architecture and design. Hadoop Project Website Borthakur D (2007) The Hadoop distributed file system: architecture and design. Hadoop Project Website
Zurück zum Zitat Eldawy A, Mokbel MF (2015) The era of big spatial data: a survey. Inf Media Technol 10(2):305–316 Eldawy A, Mokbel MF (2015) The era of big spatial data: a survey. Inf Media Technol 10(2):305–316
Zurück zum Zitat Fisher PF, Tate NJ (2006) Causes and consequences of error in digital elevation models. Prog Phys Geogr 30(4):467–489CrossRef Fisher PF, Tate NJ (2006) Causes and consequences of error in digital elevation models. Prog Phys Geogr 30(4):467–489CrossRef
Zurück zum Zitat Gunarathne T, Wu TL, Choi JY, Bae SH, Qiu J (2011) Cloud computing paradigms for pleasingly parallel biomedical applications. Concurr Comput Pract Exp 23(17):2338–2354CrossRef Gunarathne T, Wu TL, Choi JY, Bae SH, Qiu J (2011) Cloud computing paradigms for pleasingly parallel biomedical applications. Concurr Comput Pract Exp 23(17):2338–2354CrossRef
Zurück zum Zitat Hegeman JW, Sardeshmukh VB, Sugumaran R, Armstrong MP (2014) Distributed LiDAR data processing in a high-memory cloud-computing environment. Ann GIS 20(4):255–264CrossRef Hegeman JW, Sardeshmukh VB, Sugumaran R, Armstrong MP (2014) Distributed LiDAR data processing in a high-memory cloud-computing environment. Ann GIS 20(4):255–264CrossRef
Zurück zum Zitat Jian X, Xiao X, Chengfang H, Zhizhong Z, Zhaohui W, Dengzhong Z (2015) A Hadoop-based algorithm of generating DEM grid from point cloud data. Int Arch Photogramm Remote Sens Spat Inf Sci 40(7):1209CrossRef Jian X, Xiao X, Chengfang H, Zhizhong Z, Zhaohui W, Dengzhong Z (2015) A Hadoop-based algorithm of generating DEM grid from point cloud data. Int Arch Photogramm Remote Sens Spat Inf Sci 40(7):1209CrossRef
Zurück zum Zitat Mell P, Grance T (2011) The NIST definition of cloud computing (draft). NIST Spec Publ 800(145):7 Mell P, Grance T (2011) The NIST definition of cloud computing (draft). NIST Spec Publ 800(145):7
Zurück zum Zitat Stein LD (2010) The case for cloud computing in genome informatics. Genome Biol 11(5):207CrossRef Stein LD (2010) The case for cloud computing in genome informatics. Genome Biol 11(5):207CrossRef
Zurück zum Zitat Sugumaran R, Burnett J, Armstrong MP (2014) Using a cloud computing environment to process large 3D spatial datasets. In: Karimi HA (ed) Big data: techniques and technologies in geoinformatics. Taylor & Francis Group, p 55 Sugumaran R, Burnett J, Armstrong MP (2014) Using a cloud computing environment to process large 3D spatial datasets. In: Karimi HA (ed) Big data: techniques and technologies in geoinformatics. Taylor & Francis Group, p 55
Zurück zum Zitat Vecchiola C, Pandey S, Buyya R (2009) High-performance cloud computing: a view of scientific applications. In: 2009 10th international symposium on pervasive systems, algorithms, and networks (ISPAN). IEEE, Kaohsiung, pp 4–16CrossRef Vecchiola C, Pandey S, Buyya R (2009) High-performance cloud computing: a view of scientific applications. In: 2009 10th international symposium on pervasive systems, algorithms, and networks (ISPAN). IEEE, Kaohsiung, pp 4–16CrossRef
Zurück zum Zitat Xu Z, Guan J, Zhou J (2015) A distributed inverse distance weighted interpolation algorithm based on the cloud computing platform of Hadoop and its implementation. In: 12th International conference on fuzzy systems and knowledge discovery (FSKD’15). IEEE, Zhangjiajie, pp 2460–2464 Xu Z, Guan J, Zhou J (2015) A distributed inverse distance weighted interpolation algorithm based on the cloud computing platform of Hadoop and its implementation. In: 12th International conference on fuzzy systems and knowledge discovery (FSKD’15). IEEE, Zhangjiajie, pp 2460–2464
Zurück zum Zitat Yan C, Yue T, Liu J, Zhao C, Li H, Chen C (2015) A comparison of methods for solving high accuracy surface modeling in DEM construction. J Algorithms Comput Technol 9(4):377–388CrossRef Yan C, Yue T, Liu J, Zhao C, Li H, Chen C (2015) A comparison of methods for solving high accuracy surface modeling in DEM construction. J Algorithms Comput Technol 9(4):377–388CrossRef
Zurück zum Zitat Yang C, Goodchild M, Huang Q, Nebert D, Raskin R, Xu Y, Bambacus M, Fay D (2011) Spatial cloud computing: how can the geospatial sciences use and help shape cloud computing? Int J Digit Earth 4(4):305–329CrossRef Yang C, Goodchild M, Huang Q, Nebert D, Raskin R, Xu Y, Bambacus M, Fay D (2011) Spatial cloud computing: how can the geospatial sciences use and help shape cloud computing? Int J Digit Earth 4(4):305–329CrossRef
Zurück zum Zitat Yue TX (2011) Surface modeling: high accuracy and high speed methods. CRC Press, New YorkCrossRef Yue TX (2011) Surface modeling: high accuracy and high speed methods. CRC Press, New YorkCrossRef
Zurück zum Zitat Zhang Q, Cheng L, Boutaba R (2010) Cloud computing: state-of-the-art and research challenges. J Internet Serv Appl 1(1):7–18CrossRef Zhang Q, Cheng L, Boutaba R (2010) Cloud computing: state-of-the-art and research challenges. J Internet Serv Appl 1(1):7–18CrossRef
Zurück zum Zitat Zhao W, Ma H, He Q (2009) Parallel K-means clustering based on mapreduce. In: Jaatun MG, Zhao G, Rong C (eds) Cloud computing, vol 5931. Springer, Berlin, Heidelberg, pp 674–679CrossRef Zhao W, Ma H, He Q (2009) Parallel K-means clustering based on mapreduce. In: Jaatun MG, Zhao G, Rong C (eds) Cloud computing, vol 5931. Springer, Berlin, Heidelberg, pp 674–679CrossRef
Metadaten
Titel
Cloud computing-based high accuracy surface modeling method for China’s Poyang Lake basin DEM generation
verfasst von
Changqing Yan
Jimin Liu
Chuanfa Chen
Tianxiang Yue
Publikationsdatum
01.07.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Environmental Earth Sciences / Ausgabe 14/2019
Print ISSN: 1866-6280
Elektronische ISSN: 1866-6299
DOI
https://doi.org/10.1007/s12665-019-8387-9

Weitere Artikel der Ausgabe 14/2019

Environmental Earth Sciences 14/2019 Zur Ausgabe