Skip to main content
Top

2020 | OriginalPaper | Chapter

Computational Infrastructure of SoilGrids 2.0

Authors : Luís M. de Sousa, Laura Poggio, Gwen Dawes, Bas Kempen, Rik van den Bosch

Published in: Environmental Software Systems. Data Science in Action

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

SoilGrids maps soil properties for the entire globe at medium spatial resolution (250 m cell side) using state-of-the-art machine learning methods. The expanding pool of input data and the increasing computational demands of predictive models required a prediction framework that could deal with large data. This article describes the mechanisms set in place for a geo-spatially parallelised prediction system for soil properties. The features provided by GRASS GIS – mapset and region – are used to limit predictions to a specific geographic area, enabling parallelisation. The Slurm job scheduler is used to deploy predictions in a high-performance computing cluster. The framework presented can be seamlessly applied to most other geo-spatial process requiring parallelisation. This framework can also be employed with a different job scheduler, GRASS GIS being the main requirement and engine.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
5.
go back to reference Goode, J.P.: The homolosine projection: a new device for portraying the earth’s surface entire. Ann. Assoc. Am. Geogr. 15(3), 119–125 (1925)CrossRef Goode, J.P.: The homolosine projection: a new device for portraying the earth’s surface entire. Ann. Assoc. Am. Geogr. 15(3), 119–125 (1925)CrossRef
8.
9.
go back to reference Minasny, B., McBratney, A.: Digital soil mapping: a brief history and some lessons. Geoderma 264(Part B), 301–311 (2016). Soil mapping, classification, and modelling: history and future directionsCrossRef Minasny, B., McBratney, A.: Digital soil mapping: a brief history and some lessons. Geoderma 264(Part B), 301–311 (2016). Soil mapping, classification, and modelling: history and future directionsCrossRef
10.
go back to reference Momjian, B.: PostgreSQL: Introduction and Concepts. Addison-Wesley, New York (2001) Momjian, B.: PostgreSQL: Introduction and Concepts. Addison-Wesley, New York (2001)
11.
go back to reference Neteler, M., Mitasova, H.: Open Source GIS: A GRASS GIS Approach, vol. 689. Springer, Berlin (2013) Neteler, M., Mitasova, H.: Open Source GIS: A GRASS GIS Approach, vol. 689. Springer, Berlin (2013)
14.
go back to reference Reuther, A., et al.: Scheduler technologies in support of high performance data analysis. In: 2016 IEEE High Performance Extreme Computing Conference (HPEC), pp. 1–6. IEEE (2016) Reuther, A., et al.: Scheduler technologies in support of high performance data analysis. In: 2016 IEEE High Performance Extreme Computing Conference (HPEC), pp. 1–6. IEEE (2016)
15.
go back to reference Schwan, P., et al.: Lustre: building a file system for 1000-node clusters. In: Proceedings of the 2003 Linux Symposium, vol. 2003, pp. 380–386 (2003) Schwan, P., et al.: Lustre: building a file system for 1000-node clusters. In: Proceedings of the 2003 Linux Symposium, vol. 2003, pp. 380–386 (2003)
16.
go back to reference Snyder, J.P.: Flattening the Earth: Two Thousand Years of Map Projections. University of Chicago Press, Chicago (1997) Snyder, J.P.: Flattening the Earth: Two Thousand Years of Map Projections. University of Chicago Press, Chicago (1997)
17.
go back to reference de Sousa, L.M., Poggio, L., Kempen, B.: Comparison of FOSS4G supported equal-area projections using discrete distortion indicatrices. ISPRS Int. J. Geo-Inf. 8(8), 351 (2019)CrossRef de Sousa, L.M., Poggio, L., Kempen, B.: Comparison of FOSS4G supported equal-area projections using discrete distortion indicatrices. ISPRS Int. J. Geo-Inf. 8(8), 351 (2019)CrossRef
Metadata
Title
Computational Infrastructure of SoilGrids 2.0
Authors
Luís M. de Sousa
Laura Poggio
Gwen Dawes
Bas Kempen
Rik van den Bosch
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-39815-6_3

Premium Partner