Skip to main content
Erschienen in: Hydrogeology Journal 6/2020

15.06.2020 | Paper

An agile and parsimonious approach to data management in groundwater science using open-source resources

Erschienen in: Hydrogeology Journal | Ausgabe 6/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

National governments and international organizations such as the European Commission, are promoting the increased use of information and communication technologies to assist scientists in the “mining” of knowledge. A typical workflow for a hydrogeologist consists of investigating and reporting hydrogeological processes in a study area, from data collection to model-based analysis. While hydrogeologists may feel insufficiently skilled to undertake the self-automatizing and digitizing process, the digitalization of the aforementioned workflow can be easily obtained by means of agile and parsimonious methodologies based on free and open-source software, and by using existing standards. This route is demonstrated for the digitalization of a vadose-zone monitoring system, where a large number of raw data related to water infiltration through the vadose zone are collected. The main aspects of the proposed methodology are a structured database (DB) where field data are stored, and a Python script to manage and process the available data. The structured DB was designed to store data recorded by field sensors and to generate inputs to run a transfer-function-based model to simulate percolation to the water table. Field data and model outputs were also exploited to automatically generate summary reports, like plots and table statistics. The proposed methodology can be generalized to other hydrogeological processes and case studies, as it is based on commonly available standards, basic knowledge of data-storage and data-management, and elementary programming skills to connect the different components of its suite.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Allen RG, Pereira LS, Raes D, Smith M (1998) Crop evapotranspiration - guidelines for computing crop water requirements. FAO Irrigation and Drainage Paper 56. FAO, Rome Allen RG, Pereira LS, Raes D, Smith M (1998) Crop evapotranspiration - guidelines for computing crop water requirements. FAO Irrigation and Drainage Paper 56. FAO, Rome
Zurück zum Zitat Androniceanu A (2019) The social sustainability of smart cities: urban technological innovation, big data management, and the cognitive internet of things. Geopolit Hist Int Relat 11(2):110–115 Androniceanu A (2019) The social sustainability of smart cities: urban technological innovation, big data management, and the cognitive internet of things. Geopolit Hist Int Relat 11(2):110–115
Zurück zum Zitat Babovic V (2005) Data mining in hydrology. Hydrol Proc Int J 19(7):1511–1515CrossRef Babovic V (2005) Data mining in hydrology. Hydrol Proc Int J 19(7):1511–1515CrossRef
Zurück zum Zitat Biffl S, Lüder A, Rinker F, Waltersdorfer L, Winkler D (2019) Engineering data logistics for agile automation systems engineering. In: Biffl S, Eckhart M, Lüder A, Weippl E (eds) Security and quality in cyber-physical systems engineering. Springer, Cham, Switzerland, pp 187–225CrossRef Biffl S, Lüder A, Rinker F, Waltersdorfer L, Winkler D (2019) Engineering data logistics for agile automation systems engineering. In: Biffl S, Eckhart M, Lüder A, Weippl E (eds) Security and quality in cyber-physical systems engineering. Springer, Cham, Switzerland, pp 187–225CrossRef
Zurück zum Zitat Brimicombe A (2003) GIS, environmental modelling and engineering. Taylor and Francis, LondonCrossRef Brimicombe A (2003) GIS, environmental modelling and engineering. Taylor and Francis, LondonCrossRef
Zurück zum Zitat Chen Q, Wu W, Blanckaert K, Ma J, Huang G (2012) Optimization of water quality monitoring network in a large river by combining measurements: a numerical model and matter-element analyses. J Environ Manag 110:116–124CrossRef Chen Q, Wu W, Blanckaert K, Ma J, Huang G (2012) Optimization of water quality monitoring network in a large river by combining measurements: a numerical model and matter-element analyses. J Environ Manag 110:116–124CrossRef
Zurück zum Zitat Di Prima S (2015) Automated single ring infiltrometer with a low-cost microcontroller circuit. Comput Electron Agric 118:390–395CrossRef Di Prima S (2015) Automated single ring infiltrometer with a low-cost microcontroller circuit. Comput Electron Agric 118:390–395CrossRef
Zurück zum Zitat Essawy BT, Goodall JL, Xu H, Rajasekar A, Myers JD, Kugler TA, Mirza MB, Whitton MC, Moore RW (2016) Server-side workflow execution using data grid technology for reproducible analyses of data-intensive hydrologic systems. Earth Space Sci 3(4):163–175CrossRef Essawy BT, Goodall JL, Xu H, Rajasekar A, Myers JD, Kugler TA, Mirza MB, Whitton MC, Moore RW (2016) Server-side workflow execution using data grid technology for reproducible analyses of data-intensive hydrologic systems. Earth Space Sci 3(4):163–175CrossRef
Zurück zum Zitat Fatehnia M, Paran S, Kish S, Tawfiq K (2016) Automating double ring infiltrometer with an Arduino microcontroller. Geoderma 262:133–139CrossRef Fatehnia M, Paran S, Kish S, Tawfiq K (2016) Automating double ring infiltrometer with an Arduino microcontroller. Geoderma 262:133–139CrossRef
Zurück zum Zitat Fletcher T, Deletic A (2007) Data requirements for integrated urban water management: urban water series-UNESCO-IHP. CRC, Boca Raton, FL Fletcher T, Deletic A (2007) Data requirements for integrated urban water management: urban water series-UNESCO-IHP. CRC, Boca Raton, FL
Zurück zum Zitat Foglia L, Mehl SW, Hill MC, Perona P, Burlando P (2007) Testing alternative ground water models using cross-validation and other methods. Groundwater 45(5):627–641CrossRef Foglia L, Mehl SW, Hill MC, Perona P, Burlando P (2007) Testing alternative ground water models using cross-validation and other methods. Groundwater 45(5):627–641CrossRef
Zurück zum Zitat Gao Y, Zhou W (2008) Advances and challenges of GIS and DBMS applications in karst. Environ Geol 54:901–904 Gao Y, Zhou W (2008) Advances and challenges of GIS and DBMS applications in karst. Environ Geol 54:901–904
Zurück zum Zitat Gogu R, Carabin G, Hallet V, Peters V, Dassargues A (2001) GIS-based hydrogeological databases and groundwater modelling. Hydrogeol J 9(6):555–569CrossRef Gogu R, Carabin G, Hallet V, Peters V, Dassargues A (2001) GIS-based hydrogeological databases and groundwater modelling. Hydrogeol J 9(6):555–569CrossRef
Zurück zum Zitat Goodchild M (1992) Integrating GIS and spatial data analysis: problems and possibilities. Int J Geogr Inf Syst 6(5):407–423CrossRef Goodchild M (1992) Integrating GIS and spatial data analysis: problems and possibilities. Int J Geogr Inf Syst 6(5):407–423CrossRef
Zurück zum Zitat Guillaume JH, Hunt RJ, Comunian A, Blakers RS, Fu B (2016) Methods for exploring uncertainty in groundwater management predictions. In: Integrated groundwater management. Springer, Cham, Switzerland, pp 711–737 Guillaume JH, Hunt RJ, Comunian A, Blakers RS, Fu B (2016) Methods for exploring uncertainty in groundwater management predictions. In: Integrated groundwater management. Springer, Cham, Switzerland, pp 711–737
Zurück zum Zitat Guru SM, Kearney M, Fitch P, Peters C (2009) Challenges in using scientific workflow tools in the hydrology domain. 18th World IMACS/MODSIM Congress, Cairns, Australia 13–17 July 2009 Guru SM, Kearney M, Fitch P, Peters C (2009) Challenges in using scientific workflow tools in the hydrology domain. 18th World IMACS/MODSIM Congress, Cairns, Australia 13–17 July 2009
Zurück zum Zitat Horsburgh JS, Tarboton DG, Maidment DR, Zaslavsky I (2008) A relational model for environmental and water resources data. Water Resour Res 44(5) Horsburgh JS, Tarboton DG, Maidment DR, Zaslavsky I (2008) A relational model for environmental and water resources data. Water Resour Res 44(5)
Zurück zum Zitat Horsburgh JS, Morsy MM, Castronova AM, Goodall JL, Gan T, Yi H, Stealey MJ, Tarboton DG (2016) Hydroshare: sharing diverse environmental data types and models as social objects with application to the hydrology domain. JAWRA J Am Water Resour Assoc 52(4):873–889CrossRef Horsburgh JS, Morsy MM, Castronova AM, Goodall JL, Gan T, Yi H, Stealey MJ, Tarboton DG (2016) Hydroshare: sharing diverse environmental data types and models as social objects with application to the hydrology domain. JAWRA J Am Water Resour Assoc 52(4):873–889CrossRef
Zurück zum Zitat Hunter JD (2007) Matplotlib: a 2D graphics environment. Comput Sci Eng 9(3):90–95CrossRef Hunter JD (2007) Matplotlib: a 2D graphics environment. Comput Sci Eng 9(3):90–95CrossRef
Zurück zum Zitat Hutton C, Wagener T, Freer J, Han D, Duffy C, Arheimer B (2016) Most computational hydrology is not reproducible, so is it really science? Water Resour Res 52(10):7548–7555CrossRef Hutton C, Wagener T, Freer J, Han D, Duffy C, Arheimer B (2016) Most computational hydrology is not reproducible, so is it really science? Water Resour Res 52(10):7548–7555CrossRef
Zurück zum Zitat INBO (International Network of Basin Organizations) (2018) The handbook on water information system: administration, processing and exploitation of water-related data. International Network of Basin Organizations, Paris INBO (International Network of Basin Organizations) (2018) The handbook on water information system: administration, processing and exploitation of water-related data. International Network of Basin Organizations, Paris
Zurück zum Zitat Linde N, Ginsbourger D, Irving J, Nobile F, Doucet A (2017) On uncertainty quantification in hydrogeology and hydrogeophysics. Adv Water Resour 110:166–181CrossRef Linde N, Ginsbourger D, Irving J, Nobile F, Doucet A (2017) On uncertainty quantification in hydrogeology and hydrogeophysics. Adv Water Resour 110:166–181CrossRef
Zurück zum Zitat Liu H, van Oosterom P, Hu C, Wang W (2016) Managing large multidimensional array hydrologic datasets: a case study comparing NetCDF and SciDB. Proced Eng 154:207–214CrossRef Liu H, van Oosterom P, Hu C, Wang W (2016) Managing large multidimensional array hydrologic datasets: a case study comparing NetCDF and SciDB. Proced Eng 154:207–214CrossRef
Zurück zum Zitat Mackay JD, Jackson CR, Wang L (2014a) A lumped conceptual model to simulate groundwater level time–series. Environ Model Softw 61:229–245CrossRef Mackay JD, Jackson CR, Wang L (2014a) A lumped conceptual model to simulate groundwater level time–series. Environ Model Softw 61:229–245CrossRef
Zurück zum Zitat Mackay JD, Jackson CR, Wang L (2014b) AquiMod user manual (v1. 0). British Geological Survey, Keyworth, UK Mackay JD, Jackson CR, Wang L (2014b) AquiMod user manual (v1. 0). British Geological Survey, Keyworth, UK
Zurück zum Zitat Nyerges T (1991) GIS for environmental modellers: an overview. In: First International Conference/Workshop on Integrating GIS and Environmental Modeling. NCGIA, Boulder, CO Nyerges T (1991) GIS for environmental modellers: an overview. In: First International Conference/Workshop on Integrating GIS and Environmental Modeling. NCGIA, Boulder, CO
Zurück zum Zitat Ogilvy RD, Meldrum PI, Kuras O, Wilkinson PB, Chambers JE, Sen M, Pulido-Bosch A, Gisbert J, Jorreto S, Frances I, Tsourlos P (2009) Automated monitoring of coastal aquifers with electrical resistivity tomography. Near Surface Geophys 7(5–6):367–376CrossRef Ogilvy RD, Meldrum PI, Kuras O, Wilkinson PB, Chambers JE, Sen M, Pulido-Bosch A, Gisbert J, Jorreto S, Frances I, Tsourlos P (2009) Automated monitoring of coastal aquifers with electrical resistivity tomography. Near Surface Geophys 7(5–6):367–376CrossRef
Zurück zum Zitat Patterson L, Doyle M, King K, Monsma D (2017) Internet of water: sharing and integrating water data for sustainability. The Aspen Institute, Washington, DC Patterson L, Doyle M, King K, Monsma D (2017) Internet of water: sharing and integrating water data for sustainability. The Aspen Institute, Washington, DC
Zurück zum Zitat Popielarczyk D, Templin T (2014) Application of integrated GNSS/hydroacoustic measurements and GIS geodatabase models for bottom analysis of Lake Hancza: the deepest inland reservoir in Poland. Pure Appl Geophys 171(6):997–1011CrossRef Popielarczyk D, Templin T (2014) Application of integrated GNSS/hydroacoustic measurements and GIS geodatabase models for bottom analysis of Lake Hancza: the deepest inland reservoir in Poland. Pure Appl Geophys 171(6):997–1011CrossRef
Zurück zum Zitat Refsgaard JC, Højberg AL, Møller I, Hansen M, Søndergaard V (2010) Groundwater modeling in integrated water resources management: visions for 2020. Groundwater 48(5):633–648CrossRef Refsgaard JC, Højberg AL, Møller I, Hansen M, Søndergaard V (2010) Groundwater modeling in integrated water resources management: visions for 2020. Groundwater 48(5):633–648CrossRef
Zurück zum Zitat Richards LA (1931) Capillary conduction of liquids through porous mediums. Physics 1(5):318–333CrossRef Richards LA (1931) Capillary conduction of liquids through porous mediums. Physics 1(5):318–333CrossRef
Zurück zum Zitat Singh A (2014) Groundwater resources management through the applications of simulation modeling: a review. Sci Total Environ 499:414–423CrossRef Singh A (2014) Groundwater resources management through the applications of simulation modeling: a review. Sci Total Environ 499:414–423CrossRef
Zurück zum Zitat Thornthwaite CW (1948) An approach toward a rational classification of climate. Geogr Rev 38(1):55–94CrossRef Thornthwaite CW (1948) An approach toward a rational classification of climate. Geogr Rev 38(1):55–94CrossRef
Zurück zum Zitat Tipping RG (2002) The development of a karst feature database for southeastern Minnesota. J Cave Karst Stud 51 Tipping RG (2002) The development of a karst feature database for southeastern Minnesota. J Cave Karst Stud 51
Zurück zum Zitat van Rossum G, de Boer J (1991) Interactively testing remote servers using the Python programming language. CWI Q 4(4):283–303 van Rossum G, de Boer J (1991) Interactively testing remote servers using the Python programming language. CWI Q 4(4):283–303
Zurück zum Zitat Vivoni ER, Camilli R, Rodriguez MA, Sheehan DD, Entekhabi D (2002) Development of mobile computing applications for hydraulics and water quality field measurements. WIT Trans Ecol Environ 52. Ninth International Conference on Hydraulic Information Management HYDROSOFT IX, Montreal, May 2002 Vivoni ER, Camilli R, Rodriguez MA, Sheehan DD, Entekhabi D (2002) Development of mobile computing applications for hydraulics and water quality field measurements. WIT Trans Ecol Environ 52. Ninth International Conference on Hydraulic Information Management HYDROSOFT IX, Montreal, May 2002
Zurück zum Zitat Walker G, Taylor P, Cox S, Sheahan P (2009) Water data transfer format (WDTF): guiding principles, technical challenges and the future. In: Proc. 18th world IMACS Congress and MODSIM09 Int. Congress on Modelling and Simulation, Cairns, Australia, July 2009, pp 4381–4387 Walker G, Taylor P, Cox S, Sheahan P (2009) Water data transfer format (WDTF): guiding principles, technical challenges and the future. In: Proc. 18th world IMACS Congress and MODSIM09 Int. Congress on Modelling and Simulation, Cairns, Australia, July 2009, pp 4381–4387
Zurück zum Zitat WMO (World Meteorological Organization) (2005) Hydrological information systems for integrated water resources management: WHYCOS guidelines for development, implementation and governance. WMO/TD no. 1282, World Meteorological Organization, Geneva WMO (World Meteorological Organization) (2005) Hydrological information systems for integrated water resources management: WHYCOS guidelines for development, implementation and governance. WMO/TD no. 1282, World Meteorological Organization, Geneva
Zurück zum Zitat Wu Q, Xu H, Zhou W (2008) Development of a 3D GIS and its application to karst areas. Environ Geol 54(5):1037–1045CrossRef Wu Q, Xu H, Zhou W (2008) Development of a 3D GIS and its application to karst areas. Environ Geol 54(5):1037–1045CrossRef
Zurück zum Zitat Young S, Peschel J, Penny G, Thompson S, Srinivasan V (2017) Robot-assisted measurement for hydrologic understanding in data sparse regions. Water 9(7):494CrossRef Young S, Peschel J, Penny G, Thompson S, Srinivasan V (2017) Robot-assisted measurement for hydrologic understanding in data sparse regions. Water 9(7):494CrossRef
Metadaten
Titel
An agile and parsimonious approach to data management in groundwater science using open-source resources
Publikationsdatum
15.06.2020
Erschienen in
Hydrogeology Journal / Ausgabe 6/2020
Print ISSN: 1431-2174
Elektronische ISSN: 1435-0157
DOI
https://doi.org/10.1007/s10040-020-02176-0

Weitere Artikel der Ausgabe 6/2020

Hydrogeology Journal 6/2020 Zur Ausgabe