Skip to main content
Top
Published in: Water Resources Management 2/2022

17-01-2022

Using Optimized Deep Learning to Predict Daily Streamflow: A Comparison to Common Machine Learning Algorithms

Authors: Khabat Khosravi, Ali Golkarian, John P. Tiefenbacher

Published in: Water Resources Management | Issue 2/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

From a watershed management perspective, streamflow need to be predicted accurately using simple, reliable, and cost-effective tools. Present study demonstrates the first applications of a novel optimized deep-learning algorithm of a convolutional neural network (CNN) using BAT metaheuristic algorithm (i.e., CNN-BAT). Using the prediction powers of 4 well-known algorithms as benchmarks – multilayer perceptron (MLP-BAT), adaptive neuro-fuzzy inference system (ANFIS-BAT), support vector regression (SVR-BAT) and random forest (RF-BAT), the CNN-BAT model is tested for daily streamflow (Qt) prediction in the Korkorsar catchment in northern Iran. Fifteen years of daily rainfall (Rt) and streamflow data from 1997 to 2012 were collected and used for model development and evaluation. The dataset was divided into two groups for building and testing models. The correlation coefficient (r) between rainfall and streamflow with and without antecedent events (i.e., Rt-1, Rt-2, etc.) (as the input variables) and Qt (as the output variable) served as the basis for constructing different input scenarios. Several quantitative and visually-based evaluation metrics were used to validate and compare the model’s performance. The results indicate that Rt was the most effective input variable on Qt prediction and the integration of Rt, Rt-1, and Qt-1 was the optimal input combination. The evaluation metrics show that the CNN-BAT algorithm outperforms the other algorithms. The Friedman and Wilcoxon signed-rank test indicates that the prediction power of CNN-BAT algorithm is significantly/statistically different from the other developed algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Abdulelah Al-Sudani Z, Salih SQ, Sharafati A, Yaseen Z (2019) Development of multivariate adaptive regression spline integrated with differential evolution model for stream flow simulation. J of Hyd 573:1–12CrossRef Abdulelah Al-Sudani Z, Salih SQ, Sharafati A, Yaseen Z (2019) Development of multivariate adaptive regression spline integrated with differential evolution model for stream flow simulation. J of Hyd 573:1–12CrossRef
go back to reference Abudu S, Cui CL, King JP, Abudukadeer K (2010) Comparison of performance of statistical models in forecasting monthly streamflow of Kizil River. China Water Sci Eng 3(3):269–281 Abudu S, Cui CL, King JP, Abudukadeer K (2010) Comparison of performance of statistical models in forecasting monthly streamflow of Kizil River. China Water Sci Eng 3(3):269–281
go back to reference Adnan R, Yuan X, Kisi O, Adnan M, Mehmood A (2018) Stream Flow Forecasting of Poorly Gauged Mountainous Watershed by Least Square Support Vector Machine, Fuzzy Genetic Algorithm and M5 Model Tree Using Climatic Data from Nearby Station. Water Resour Manag 32:4469–4486. https://doi.org/10.1007/s11269-018-2033-2CrossRef Adnan R, Yuan X, Kisi O, Adnan M, Mehmood A (2018) Stream Flow Forecasting of Poorly Gauged Mountainous Watershed by Least Square Support Vector Machine, Fuzzy Genetic Algorithm and M5 Model Tree Using Climatic Data from Nearby Station. Water Resour Manag 32:4469–4486. https://​doi.​org/​10.​1007/​s11269-018-2033-2CrossRef
go back to reference Barzegar R, Alami MT, Adamowski J (2020) Short-term water quality variable prediction using a hybrid CNN-LSTM deep learning model. Stoch Environ Res Risk Assess 34:415–433CrossRef Barzegar R, Alami MT, Adamowski J (2020) Short-term water quality variable prediction using a hybrid CNN-LSTM deep learning model. Stoch Environ Res Risk Assess 34:415–433CrossRef
go back to reference Bui D, Khosravi K, Tiefenbacher J, Nguyen H, Kazakis N (2020) Improving prediction of water quality indices using novel hybrid machine-learning algorithms. Sci Total Environ 13761 Bui D, Khosravi K, Tiefenbacher J, Nguyen H, Kazakis N (2020) Improving prediction of water quality indices using novel hybrid machine-learning algorithms. Sci Total Environ 13761
go back to reference Charhat SB, Dandawat YH, Londh SN (2009) Genetic programming to forecast streamflow. advances in water resources and hydraulic engineering, proceedings of 16th IAHR-APD Congress and 3rd Symposium of IAHR-ISHS pp 29 Charhat SB, Dandawat YH, Londh SN (2009) Genetic programming to forecast streamflow. advances in water resources and hydraulic engineering, proceedings of 16th IAHR-APD Congress and 3rd Symposium of IAHR-ISHS pp 29
go back to reference Deo RC, Downs NJ, Adamowski JF, Parisi AV (2018) Adaptive neuro-fuzzy inference system integrated with solar zenith angle for forecasting sub-tropical Photosynthetically Active Radiation. Food Energy Secur 8(1). https://doi.org/10.1002/fes3.151 Deo RC, Downs NJ, Adamowski JF, Parisi AV (2018) Adaptive neuro-fuzzy inference system integrated with solar zenith angle for forecasting sub-tropical Photosynthetically Active Radiation. Food Energy Secur 8(1). https://​doi.​org/​10.​1002/​fes3.​151
go back to reference Fix E, Hodges Jr (1955) Significance Probabilities of the Wilcoxon Test. Ann Math Stat 301–312 Fix E, Hodges Jr (1955) Significance Probabilities of the Wilcoxon Test. Ann Math Stat 301–312
go back to reference Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32:675–701CrossRef Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32:675–701CrossRef
go back to reference Ghorbanzadeh O, Blaschke T, Gholamnia K, Meena SR, Tiede D, Aryal J (2019) Evaluation of different machine learning methods and deep-learning convolutional neural networks for landslide detection. Remote Sens 11(2):196CrossRef Ghorbanzadeh O, Blaschke T, Gholamnia K, Meena SR, Tiede D, Aryal J (2019) Evaluation of different machine learning methods and deep-learning convolutional neural networks for landslide detection. Remote Sens 11(2):196CrossRef
go back to reference Gupta HV, Sorooshian S, Yapo P (1999) Status of automatic calibration for hydrologic models: Comparison with multilevel expert calibration. J Hydrol Eng 4:135–143CrossRef Gupta HV, Sorooshian S, Yapo P (1999) Status of automatic calibration for hydrologic models: Comparison with multilevel expert calibration. J Hydrol Eng 4:135–143CrossRef
go back to reference Hoseinzade E, Haratizadeh S (2019) CNNpred: CNN-based stock market prediction using a diverse set of variables. Expert Syst Appl 129:273–285CrossRef Hoseinzade E, Haratizadeh S (2019) CNNpred: CNN-based stock market prediction using a diverse set of variables. Expert Syst Appl 129:273–285CrossRef
go back to reference Kargar K, Safari MJS, Khosravi K (2021) Weighted instances handler wrapper and rotation forest-based hybrid algorithms for sediment transport modeling. J Hydrol 598:126452 Kargar K, Safari MJS, Khosravi K (2021) Weighted instances handler wrapper and rotation forest-based hybrid algorithms for sediment transport modeling. J Hydrol 598:126452
go back to reference Khosravi K, Daggupati P, Alami MT, Awadh SM, Ghareb MI, Panahi M et al. (2019) Meteorological data mining and hybrid data-intelligence models for reference evaporation simulation: A case study in Iraq. Comput Electron Agric 167:105041 Khosravi K, Daggupati P, Alami MT, Awadh SM, Ghareb MI, Panahi M et al. (2019) Meteorological data mining and hybrid data-intelligence models for reference evaporation simulation: A case study in Iraq. Comput Electron Agric 167:105041
go back to reference Khosravi K, Panahi M, Golkarian A, Keestra S, Saco P, Bui D, Lee S (2020) Convolutional neural network approach for spatial prediction of flood hazard at national scale of Iran. J Hydrol 591:125552 Khosravi K, Panahi M, Golkarian A, Keestra S, Saco P, Bui D, Lee S (2020) Convolutional neural network approach for spatial prediction of flood hazard at national scale of Iran. J Hydrol 591:125552
go back to reference Kisi O (2004) River flow modeling using artificial neural networks. J Hydrol Eng 9(1):60–63CrossRef Kisi O (2004) River flow modeling using artificial neural networks. J Hydrol Eng 9(1):60–63CrossRef
go back to reference Kisi O (2007) Streamflow forecasting using different artificial neural network algorithms. J Hydrol Eng 12(5):532–539CrossRef Kisi O (2007) Streamflow forecasting using different artificial neural network algorithms. J Hydrol Eng 12(5):532–539CrossRef
go back to reference Kisi O, Parmar KS (2016) Application of least square support vector machine and multivariate adaptive regression spline models in long term prediction of river water pollution. J Hydro 534:104–112CrossRef Kisi O, Parmar KS (2016) Application of least square support vector machine and multivariate adaptive regression spline models in long term prediction of river water pollution. J Hydro 534:104–112CrossRef
go back to reference Kratzert F, Klotz D, Brenner C, Schulz K, Herrnegger M (2018) Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks. Hydrol Earth Syst Sci 22:6005–6022CrossRef Kratzert F, Klotz D, Brenner C, Schulz K, Herrnegger M (2018) Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks. Hydrol Earth Syst Sci 22:6005–6022CrossRef
go back to reference Legates DR, Mccabe GJ (1999) Evaluating the use of goodness-of-fit measures in hydrologic and hydroclimatic model validation. Water Resour Res 35:233–241 Legates DR, Mccabe GJ (1999) Evaluating the use of goodness-of-fit measures in hydrologic and hydroclimatic model validation. Water Resour Res 35:233–241
go back to reference Melo Honorato AG, Lima da Silva GB, Guimarães Santos CA (2018) Monthly streamflow forecasting using neuro-wavelet techniques and input analysis. Hydrol Sci J 63(15):2060–2075CrossRef Melo Honorato AG, Lima da Silva GB, Guimarães Santos CA (2018) Monthly streamflow forecasting using neuro-wavelet techniques and input analysis. Hydrol Sci J 63(15):2060–2075CrossRef
go back to reference Nourani V, Davanlou Tajbakhsh A, Molajou A, Gokcekus H (2019) Hybrid Wavelet-M5 Model tree for rainfall-runoff modeling. J Hydrol Eng 24(5):04019012CrossRef Nourani V, Davanlou Tajbakhsh A, Molajou A, Gokcekus H (2019) Hybrid Wavelet-M5 Model tree for rainfall-runoff modeling. J Hydrol Eng 24(5):04019012CrossRef
go back to reference Schmidhuber J (2015) Deep learning in neural networks: An overview. Neural Netw 61:85–117CrossRef Schmidhuber J (2015) Deep learning in neural networks: An overview. Neural Netw 61:85–117CrossRef
go back to reference Shi J, Guo J, Zhen S (2012) Evaluation of hybrid forecasting approaches for wind speed and power generation time series. Renew Sust Energ Rev 16:3471–3480CrossRef Shi J, Guo J, Zhen S (2012) Evaluation of hybrid forecasting approaches for wind speed and power generation time series. Renew Sust Energ Rev 16:3471–3480CrossRef
go back to reference Singh J, Knapp HV, Demissie M (2004) Hydrologic modeling of the Iroquois River watershed using HSPF and SWAT. ISWS CR 2004–08. Champaign, Ill: Illin Stat Water Surv Singh J, Knapp HV, Demissie M (2004) Hydrologic modeling of the Iroquois River watershed using HSPF and SWAT. ISWS CR 2004–08. Champaign, Ill: Illin Stat Water Surv
go back to reference Tongal H, Booij M (2018) Simulation and forecasting of streamflows using machine learning models coupled with base flow separation. J Hydrol 564:266–282CrossRef Tongal H, Booij M (2018) Simulation and forecasting of streamflows using machine learning models coupled with base flow separation. J Hydrol 564:266–282CrossRef
go back to reference Valipour M (2015) Long-term runoff study using SARIMA and ARIMA models in the United States. Meteorol Appl 22(3):592–598CrossRef Valipour M (2015) Long-term runoff study using SARIMA and ARIMA models in the United States. Meteorol Appl 22(3):592–598CrossRef
go back to reference Wang W (2006) Stochasticity. IOS Press, Amsterdam, Nonlinearity and Forecasting of Streamflow Processes Wang W (2006) Stochasticity. IOS Press, Amsterdam, Nonlinearity and Forecasting of Streamflow Processes
go back to reference Yaseen Z, El-Shafie A, Abdulmohsin Afan H, Hameed M, Wan Mohtar WH, Hussain A (2015) RBFNN versus FFNN for daily river flow forecasting at Johor River. Malaysia Neural Comput Appl 27:1533–1542CrossRef Yaseen Z, El-Shafie A, Abdulmohsin Afan H, Hameed M, Wan Mohtar WH, Hussain A (2015) RBFNN versus FFNN for daily river flow forecasting at Johor River. Malaysia Neural Comput Appl 27:1533–1542CrossRef
go back to reference Yaseen ZM, Naganna SR, Sa’adi Z, Samui P, Ghorbani MA, Salih S, Shahid S, (2019) Hourly River Flow Forecasting: Application of Emotional Neural Network Versus Multiple Machine Learning Paradigms. Water Resour Manag 34:1075–1091CrossRef Yaseen ZM, Naganna SR, Sa’adi Z, Samui P, Ghorbani MA, Salih S, Shahid S, (2019) Hourly River Flow Forecasting: Application of Emotional Neural Network Versus Multiple Machine Learning Paradigms. Water Resour Manag 34:1075–1091CrossRef
go back to reference Zaini N, Malek MA, Yusoff M, Che Osmi S, Maardi N, Norhisham S (2018) Bat algorithm and neural network for monthly streamflow prediction AIP Conference Proceedings 2030, 020260 (2018); green design and manufacture: advanced and emerging applications. Proceed 4th Int Conf Green Design Manufact. https://doi.org/10.1063/1.5066901 Zaini N, Malek MA, Yusoff M, Che Osmi S, Maardi N, Norhisham S (2018) Bat algorithm and neural network for monthly streamflow prediction AIP Conference Proceedings 2030, 020260 (2018); green design and manufacture: advanced and emerging applications. Proceed 4th Int Conf Green Design Manufact. https://​doi.​org/​10.​1063/​1.​5066901
go back to reference Zhang D, Peng X, Pan K, Liu Y (2019) A novel wind speed forecasting based on hybrid decomposition and online sequential outlier robust extreme learning machine. Energy Convers Manag 180:338–357 Zhang D, Peng X, Pan K, Liu Y (2019) A novel wind speed forecasting based on hybrid decomposition and online sequential outlier robust extreme learning machine. Energy Convers Manag 180:338–357
Metadata
Title
Using Optimized Deep Learning to Predict Daily Streamflow: A Comparison to Common Machine Learning Algorithms
Authors
Khabat Khosravi
Ali Golkarian
John P. Tiefenbacher
Publication date
17-01-2022
Publisher
Springer Netherlands
Published in
Water Resources Management / Issue 2/2022
Print ISSN: 0920-4741
Electronic ISSN: 1573-1650
DOI
https://doi.org/10.1007/s11269-021-03051-7

Other articles of this Issue 2/2022

Water Resources Management 2/2022 Go to the issue