Skip to main content
Top
Published in: Engineering with Computers 1/2020

02-01-2019 | Original Article

Heterogeneous parallel computing accelerated generalized likelihood uncertainty estimation (GLUE) method for fast hydrological model uncertainty analysis purpose

Authors: Guangyuan Kan, Xiaoyan He, Liuqian Ding, Jiren Li, Yang Hong, Ke Liang

Published in: Engineering with Computers | Issue 1/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The generalized likelihood uncertainty estimation (GLUE) is a famous and widely used sensitivity and uncertainty analysis method. It provides a new way to solve the “equifinality” problem encountered in the hydrological model parameter estimation. In this research, we focused on the computational efficiency issue of the GLUE method. Inspired by the emerging heterogeneous parallel computing technology, we parallelized the GLUE in algorithmic level and then implemented the parallel GLUE algorithm on a multi-core CPU and many-core GPU hybrid heterogeneous hardware system. The parallel GLUE was implemented using OpenMP and CUDA software ecosystems for multi-core CPU and many-core GPU systems, respectively. Application of the parallel GLUE for the Xinanjiang hydrological model parameter sensitivity analysis proved its much better computational efficiency than the traditional serial computing technology, and the correctness was also verified. The heterogeneous parallel computing accelerated GLUE method has very good application prospects for theoretical analysis and real-world applications.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Barca E, Porcu E, Bruno D, Passarella G (2017) An automated decision support system for aided assessment of variogram models. Environ Model Softw 87:72–83CrossRef Barca E, Porcu E, Bruno D, Passarella G (2017) An automated decision support system for aided assessment of variogram models. Environ Model Softw 87:72–83CrossRef
2.
go back to reference Beven K, Binley A (1992) The future of distributed models: model calibration and predictive uncertainty. Hydrol Process 6:297–298 Beven K, Binley A (1992) The future of distributed models: model calibration and predictive uncertainty. Hydrol Process 6:297–298
3.
go back to reference Beven K (1993) Prophecy, reality and uncertainty in distributed hydrological modeling. Adv Water Resour 16:41–51CrossRef Beven K (1993) Prophecy, reality and uncertainty in distributed hydrological modeling. Adv Water Resour 16:41–51CrossRef
4.
go back to reference Beven K (2006) A manifesto for the equifinality thesis. J Hydrol 320(1–2):18–36CrossRef Beven K (2006) A manifesto for the equifinality thesis. J Hydrol 320(1–2):18–36CrossRef
5.
go back to reference Cameron D, Beven K, Tawn J, Blazkova S, Naden P (1999) Flood frequency estimation by continuous simulation for a gauged upland catchment (with uncertainty). J Hydrol 219:169–187CrossRef Cameron D, Beven K, Tawn J, Blazkova S, Naden P (1999) Flood frequency estimation by continuous simulation for a gauged upland catchment (with uncertainty). J Hydrol 219:169–187CrossRef
6.
go back to reference Cameron D, Beven K, Tawn J (2001) Modelling extreme rainfalls using a modified random pulse Bartlett–Lewis stochastic rainfall model (with uncertainty). Adv Water Resour 24:203–211CrossRef Cameron D, Beven K, Tawn J (2001) Modelling extreme rainfalls using a modified random pulse Bartlett–Lewis stochastic rainfall model (with uncertainty). Adv Water Resour 24:203–211CrossRef
7.
go back to reference Campbell E, Fox D et al (1999) A Bayesian approach to parameter estimation and pooling in nonlinear flood event models. Water Resour Res 35(1):211–230CrossRef Campbell E, Fox D et al (1999) A Bayesian approach to parameter estimation and pooling in nonlinear flood event models. Water Resour Res 35(1):211–230CrossRef
8.
go back to reference Chen S, Kang E et al (2003) Review of the hydrological model researches. J Desert Res 23(3):221–229 (in Chinese) Chen S, Kang E et al (2003) Review of the hydrological model researches. J Desert Res 23(3):221–229 (in Chinese)
9.
go back to reference Chen S, Kan G, Li J, Ke H, Liang K (2018) Investigation of China urban air condition using big data, information theory and machine learning, 2018. Polish J Environ Stud 27(2):565–578CrossRef Chen S, Kan G, Li J, Ke H, Liang K (2018) Investigation of China urban air condition using big data, information theory and machine learning, 2018. Polish J Environ Stud 27(2):565–578CrossRef
10.
go back to reference Chen Z, Hartmann A, Goldscheider N (2017) A new approach to evaluate spatiotemporal dynamics of controlling parameters in distributed environmental models. Environ Model Softw 87:1–16CrossRef Chen Z, Hartmann A, Goldscheider N (2017) A new approach to evaluate spatiotemporal dynamics of controlling parameters in distributed environmental models. Environ Model Softw 87:1–16CrossRef
11.
go back to reference Dong J, Zheng C, Kan G, Wen J, Zhao M, Yu J (2015) Applying the ensemble artificial neural network-based hybrid data-driven model to daily total load forecasting. Neural Comput Appl 26(3):603–611CrossRef Dong J, Zheng C, Kan G, Wen J, Zhao M, Yu J (2015) Applying the ensemble artificial neural network-based hybrid data-driven model to daily total load forecasting. Neural Comput Appl 26(3):603–611CrossRef
12.
go back to reference Fan YR, Huang GH, Baetz BW, Li YP, Huang K, Li Z, Chen X, Xiong LH (2017) Parameter uncertainty and temporal dynamics of sensitivity for hydrologic models: A hybrid sequential data assimilation and probabilistic collocation method. Environ Model Softw 86:30–49CrossRef Fan YR, Huang GH, Baetz BW, Li YP, Huang K, Li Z, Chen X, Xiong LH (2017) Parameter uncertainty and temporal dynamics of sensitivity for hydrologic models: A hybrid sequential data assimilation and probabilistic collocation method. Environ Model Softw 86:30–49CrossRef
13.
go back to reference Franks S, Gineste P, Beven K, Merot P (1998) On constraining the predictions of a distributed model: the incorporation of fuzzy estimates of saturated areas into the calibration process. Water Resour Res 34(4):787–797CrossRef Franks S, Gineste P, Beven K, Merot P (1998) On constraining the predictions of a distributed model: the incorporation of fuzzy estimates of saturated areas into the calibration process. Water Resour Res 34(4):787–797CrossRef
14.
go back to reference Costa D, Burlando P, Liong SY (2017) Coupling spatially distributed river and groundwater transport models to investigate contaminant dynamics at river corridor scales. Environ Model Softw 86:91–110CrossRef Costa D, Burlando P, Liong SY (2017) Coupling spatially distributed river and groundwater transport models to investigate contaminant dynamics at river corridor scales. Environ Model Softw 86:91–110CrossRef
15.
go back to reference Groeneveld J, Muller B, Buchmann CM, Dressler G, Guo C, Hase N, Hoffmann F, John F, Klassert C, Lauf T, Liebelt V, Nolzen H, Pannicke N, Schulze J, Weise H, Schwarz N (2017) Theoretical foundations of human decision-making in agent-based land use models—a review. Environ Model Softw 87:39–48CrossRef Groeneveld J, Muller B, Buchmann CM, Dressler G, Guo C, Hase N, Hoffmann F, John F, Klassert C, Lauf T, Liebelt V, Nolzen H, Pannicke N, Schulze J, Weise H, Schwarz N (2017) Theoretical foundations of human decision-making in agent-based land use models—a review. Environ Model Softw 87:39–48CrossRef
16.
go back to reference Hornberger GM, Spear RC (1981) An approach to the preliminary analysis of environmental systems. J Environ Manag 12:7–18 Hornberger GM, Spear RC (1981) An approach to the preliminary analysis of environmental systems. J Environ Manag 12:7–18
17.
go back to reference Kan G, Yao C, Li Q, Li Z, Yu Z, Liu Z, Ding L, He X, Liang K (2015) Improving event-based rainfall-runoff simulation using an ensemble artificial neural network based hybrid data-driven model. Stoch Environ Res Risk Assess 29:1345–1370CrossRef Kan G, Yao C, Li Q, Li Z, Yu Z, Liu Z, Ding L, He X, Liang K (2015) Improving event-based rainfall-runoff simulation using an ensemble artificial neural network based hybrid data-driven model. Stoch Environ Res Risk Assess 29:1345–1370CrossRef
24.
go back to reference Kan G, He X, Ding L, Li J, Liang K, Hong Y (2017) Study on applicability of conceptual hydrological models for flood forecasting in humid, semi-humid semi-arid and arid basins in China. Water 9(10):719CrossRef Kan G, He X, Ding L, Li J, Liang K, Hong Y (2017) Study on applicability of conceptual hydrological models for flood forecasting in humid, semi-humid semi-arid and arid basins in China. Water 9(10):719CrossRef
25.
go back to reference Kan G, Tang G, Yang Y, Hong Y, Li J, Ding L, He X, Liang K, He L, Li Z, Hu Y, Cui Y (2017) An improved coupled routing and excess storage (CREST) distributed hydrological model and its verification in Ganjiang river basin, China. Water 9(11):904CrossRef Kan G, Tang G, Yang Y, Hong Y, Li J, Ding L, He X, Liang K, He L, Li Z, Hu Y, Cui Y (2017) An improved coupled routing and excess storage (CREST) distributed hydrological model and its verification in Ganjiang river basin, China. Water 9(11):904CrossRef
26.
go back to reference Kan G, He X, Ding L, Li J, Liang K, Hong Y (2017) A heterogeneous computing accelerated SCE-UA global optimization method using OpenMP, CUDA and OpenACC. Water Sci Technol 76(7):1640–1651CrossRef Kan G, He X, Ding L, Li J, Liang K, Hong Y (2017) A heterogeneous computing accelerated SCE-UA global optimization method using OpenMP, CUDA and OpenACC. Water Sci Technol 76(7):1640–1651CrossRef
27.
go back to reference Kan G, He X, Ding L, Li J, Hong Y, Ren M, Lei T, Liang K, Zuo D, Huang P (2017) Daily streamflow simulation based on improved machine learning method. Tecnologia y Ciencias del Agua 8(2):51–60CrossRef Kan G, He X, Ding L, Li J, Hong Y, Ren M, Lei T, Liang K, Zuo D, Huang P (2017) Daily streamflow simulation based on improved machine learning method. Tecnologia y Ciencias del Agua 8(2):51–60CrossRef
28.
go back to reference Kan G, He X, Ding L, Li J, Hong Y, Zuo D, Ren M, Lei T, Liang K (2018) Fast hydrological model calibration based on the heterogeneous parallel computing accelerated shuffled complex evolution method. Eng Optim 50(1):106–449MathSciNetCrossRef Kan G, He X, Ding L, Li J, Hong Y, Zuo D, Ren M, Lei T, Liang K (2018) Fast hydrological model calibration based on the heterogeneous parallel computing accelerated shuffled complex evolution method. Eng Optim 50(1):106–449MathSciNetCrossRef
30.
go back to reference Li K, Kan G, Ding L, Dong Q, Liu K, Liang L (2018) A novel flood forecasting method based on initial state variable correction. Water 10(1):12CrossRef Li K, Kan G, Ding L, Dong Q, Liu K, Liang L (2018) A novel flood forecasting method based on initial state variable correction. Water 10(1):12CrossRef
31.
go back to reference Li Z, Kan G, Yao C, Liu Z, Li Q, Yu S (2014) An improved neural network model and its application in hydrological simulation. J Hydrol Eng 19(10):04014019CrossRef Li Z, Kan G, Yao C, Liu Z, Li Q, Yu S (2014) An improved neural network model and its application in hydrological simulation. J Hydrol Eng 19(10):04014019CrossRef
32.
go back to reference Liu W, Chen Y, Wu C (2016) OpenCL heterogeneous parallel computing: from principle to practice. China Machine Press, Beijing (in Chinese) Liu W, Chen Y, Wu C (2016) OpenCL heterogeneous parallel computing: from principle to practice. China Machine Press, Beijing (in Chinese)
33.
go back to reference Locatelli T, Tarantola S, Gardiner B, Patenaude G (2017) Variance-based sensitivity analysis of a wind risk model—model behavior and lessons for forest modelling. Environ Model Softw 87:84–109CrossRef Locatelli T, Tarantola S, Gardiner B, Patenaude G (2017) Variance-based sensitivity analysis of a wind risk model—model behavior and lessons for forest modelling. Environ Model Softw 87:84–109CrossRef
34.
go back to reference Mo X, Beven K (2004) Multi-objective parameter conditioning of a three-source wheat canopy model. Agric For Meteorol 122:39–63CrossRef Mo X, Beven K (2004) Multi-objective parameter conditioning of a three-source wheat canopy model. Agric For Meteorol 122:39–63CrossRef
35.
go back to reference Ratto M, Tarantola S, Saltelli A (2001) Sensitivity analysis in model calibration: GSA-GLUE approach. Comput Phys Commun 126:212–224CrossRef Ratto M, Tarantola S, Saltelli A (2001) Sensitivity analysis in model calibration: GSA-GLUE approach. Comput Phys Commun 126:212–224CrossRef
36.
go back to reference Susan K, Beven K (1999) Equifinality, sensitivity and predictive uncertainty in the estimation of critical loads. Sci Total Environ 236:191–214CrossRef Susan K, Beven K (1999) Equifinality, sensitivity and predictive uncertainty in the estimation of critical loads. Sci Total Environ 236:191–214CrossRef
37.
go back to reference Tan B (1996) Comparison and analysis of hydrological model parameter automatic optimization methods. J China Hydrol 5:8–14 (in Chinese) Tan B (1996) Comparison and analysis of hydrological model parameter automatic optimization methods. J China Hydrol 5:8–14 (in Chinese)
38.
go back to reference Uhlenbrook S, Sieber A (2005) On the value of experimental data to reduce the prediction uncertainty of a process-oriented catchment model. Environ Model Softw 20:19–32CrossRef Uhlenbrook S, Sieber A (2005) On the value of experimental data to reduce the prediction uncertainty of a process-oriented catchment model. Environ Model Softw 20:19–32CrossRef
39.
go back to reference Wu YP, Liu SG, Qiu LJ, Sun YZ (2017) SWAT-DayCent coupler: An integration tool for simultaneous hydro-biogeochemical modelling using SWAT and DayCent. Environ Model Softw 86:81–90CrossRef Wu YP, Liu SG, Qiu LJ, Sun YZ (2017) SWAT-DayCent coupler: An integration tool for simultaneous hydro-biogeochemical modelling using SWAT and DayCent. Environ Model Softw 86:81–90CrossRef
40.
go back to reference Zhao R (1983) Watershed hydrological model-Xinanjiang model and Northern Shaanxi model. Water Resources and Electric Power Press, Beijing Zhao R (1983) Watershed hydrological model-Xinanjiang model and Northern Shaanxi model. Water Resources and Electric Power Press, Beijing
41.
go back to reference Zhao R (1994) Anthology of hydrological forecasting. Water Resources and Electric Power Press, Beijing Zhao R (1994) Anthology of hydrological forecasting. Water Resources and Electric Power Press, Beijing
Metadata
Title
Heterogeneous parallel computing accelerated generalized likelihood uncertainty estimation (GLUE) method for fast hydrological model uncertainty analysis purpose
Authors
Guangyuan Kan
Xiaoyan He
Liuqian Ding
Jiren Li
Yang Hong
Ke Liang
Publication date
02-01-2019
Publisher
Springer London
Published in
Engineering with Computers / Issue 1/2020
Print ISSN: 0177-0667
Electronic ISSN: 1435-5663
DOI
https://doi.org/10.1007/s00366-018-0685-4

Other articles of this Issue 1/2020

Engineering with Computers 1/2020 Go to the issue