Skip to main content
Erschienen in: Water Resources Management 8/2023

17.03.2023

Performance Improvement of LSTM-based Deep Learning Model for Streamflow Forecasting Using Kalman Filtering

verfasst von: Fatemeh Bakhshi Ostadkalayeh, Saba Moradi, Ali Asadi, Alireza Moghaddam Nia, Somayeh Taheri

Erschienen in: Water Resources Management | Ausgabe 8/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Prediction of streamflow as a crucial source of hydrological information plays a central role in various fields of water resources projects. While accurate daily streamflow forecasts are essential, predicting streamflow based on limited data is useful for minimizing computational time and supporting flood early warning systems. This study aims to improve Long Short-Term Memory (LSTM) performance by Kalman filter (KF) for streamflow forecasting. For this goal, the simulation has been specified according to the daily streamflow series for 60 years of Dez Dam, located in Iran. We compared the results of simulating the LSTM, LSTM-KF, LSTM-UKF, LSTM-KFS, and LSTM-UKFS models. In addition, the accuracy of the proposed method is evaluated with statistical analysis including Nash–Sutcliffe efficiency (NSE), root-mean-squared error (RMSE), average absolute relative error (AARE) and mean relative error (MAE). The results demonstrate that the LSTM-UKFS model is highly effective in flood forecasting, indicating the promising potential of a simple architecture deep-learning approach for predicting floods, even in the presence of dams in the study area.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Adnan RM, Liang Z, Heddam S, Zounemat-Kermani M, Kisi O, Li B (2020) Least square support vector machine and multivariate adaptive regression splines for streamflow prediction in mountainous basin using hydro-meteorological data as inputs. J Hydrol 586:124371CrossRef Adnan RM, Liang Z, Heddam S, Zounemat-Kermani M, Kisi O, Li B (2020) Least square support vector machine and multivariate adaptive regression splines for streamflow prediction in mountainous basin using hydro-meteorological data as inputs. J Hydrol 586:124371CrossRef
Zurück zum Zitat Adnan RM, Liang Z, Trajkovic S, Zounemat-Kermani M, Li B, Kisi O (2019) Daily streamflow prediction using optimally pruned extreme learning machine. J Hydrol 577:123981CrossRef Adnan RM, Liang Z, Trajkovic S, Zounemat-Kermani M, Li B, Kisi O (2019) Daily streamflow prediction using optimally pruned extreme learning machine. J Hydrol 577:123981CrossRef
Zurück zum Zitat Akbari Asanjan A, Yang T, Hsu K, Sorooshian S, Lin J, Peng Q (2018) Short-term precipitation forecast based on the PERSIANN system and LSTM recurrent neural networks. J Geophys Res Atmos 123(22):12–543CrossRef Akbari Asanjan A, Yang T, Hsu K, Sorooshian S, Lin J, Peng Q (2018) Short-term precipitation forecast based on the PERSIANN system and LSTM recurrent neural networks. J Geophys Res Atmos 123(22):12–543CrossRef
Zurück zum Zitat Alizadeh B, Bafti AG, Kamangir H, Zhang Y, Wright DB, Franz KJ (2021) A novel attention-based LSTM cell post-processor coupled with bayesian optimization for streamflow prediction. J Hydrol 601:126526CrossRef Alizadeh B, Bafti AG, Kamangir H, Zhang Y, Wright DB, Franz KJ (2021) A novel attention-based LSTM cell post-processor coupled with bayesian optimization for streamflow prediction. J Hydrol 601:126526CrossRef
Zurück zum Zitat Althelaya KA, El-Alfy ESM, Mohammed S (2018) Stock market forecast using multivariate analysis with bidirectional and stacked (LSTM, GRU). In 2018 21st Saudi Computer Society National Computer Conference (NCC) (pp. 1–7). IEEE Althelaya KA, El-Alfy ESM, Mohammed S (2018) Stock market forecast using multivariate analysis with bidirectional and stacked (LSTM, GRU). In 2018 21st Saudi Computer Society National Computer Conference (NCC) (pp. 1–7). IEEE
Zurück zum Zitat Alvisi S, Franchini M (2010) Fuzzy Neural Networks for water level and discharge forecasting. In EGU General Assembly Conference Abstracts (p. 2441) Alvisi S, Franchini M (2010) Fuzzy Neural Networks for water level and discharge forecasting. In EGU General Assembly Conference Abstracts (p. 2441)
Zurück zum Zitat Bui DT, Khosravi K, Tiefenbacher J, Nguyen H, Kazakis N (2020) Improving prediction of water quality indices using novel hybrid machine-learning algorithms. Sci Total Environ 721:137612CrossRef Bui DT, Khosravi K, Tiefenbacher J, Nguyen H, Kazakis N (2020) Improving prediction of water quality indices using novel hybrid machine-learning algorithms. Sci Total Environ 721:137612CrossRef
Zurück zum Zitat Cabrera JS, Lee HS (2019) Flood-prone area assessment using GIS-based multi-criteria analysis: a case study in Davao Oriental, Philippines. Water 11(11):2203CrossRef Cabrera JS, Lee HS (2019) Flood-prone area assessment using GIS-based multi-criteria analysis: a case study in Davao Oriental, Philippines. Water 11(11):2203CrossRef
Zurück zum Zitat Cheng M, Fang F, Kinouchi T, Navon IM, Pain CC (2020) Long lead-time daily and monthly streamflow forecasting using machine learning methods. J Hydrol 590:125376CrossRef Cheng M, Fang F, Kinouchi T, Navon IM, Pain CC (2020) Long lead-time daily and monthly streamflow forecasting using machine learning methods. J Hydrol 590:125376CrossRef
Zurück zum Zitat Damavandi HG, Shah R, Stampoulis D, Wei Y, Boscovic D, Sabo J (2019) Accurate prediction of streamflow using long short-term memory network: a case study in the Brazos River Basin in Texas. Int J Environ Sci Dev 10(10):294–300CrossRef Damavandi HG, Shah R, Stampoulis D, Wei Y, Boscovic D, Sabo J (2019) Accurate prediction of streamflow using long short-term memory network: a case study in the Brazos River Basin in Texas. Int J Environ Sci Dev 10(10):294–300CrossRef
Zurück zum Zitat Dong L, Fang D, Wang X, Wei W, Damaševičius R, Scherer R, Woźniak M (2020) Prediction of streamflow based on dynamic sliding window LSTM. Water 12(11):3032CrossRef Dong L, Fang D, Wang X, Wei W, Damaševičius R, Scherer R, Woźniak M (2020) Prediction of streamflow based on dynamic sliding window LSTM. Water 12(11):3032CrossRef
Zurück zum Zitat Elijah OC, Philomena KI, Joseph TN, Charles ON, Paschal, EO (2020) Artificial intelligence in agriculture Elijah OC, Philomena KI, Joseph TN, Charles ON, Paschal, EO (2020) Artificial intelligence in agriculture
Zurück zum Zitat Fang W, Huang S, Ren K, Huang Q, Huang G, Cheng G, Li K (2019) Examining the applicability of different sampling techniques in the development of decomposition-based streamflow forecasting models. J Hydrol 568:534–550CrossRef Fang W, Huang S, Ren K, Huang Q, Huang G, Cheng G, Li K (2019) Examining the applicability of different sampling techniques in the development of decomposition-based streamflow forecasting models. J Hydrol 568:534–550CrossRef
Zurück zum Zitat Fang Z, Wang Y, Peng L, Hong H (2021) Predicting flood susceptibility using LSTM neural networks. J Hydrol 594:125734CrossRef Fang Z, Wang Y, Peng L, Hong H (2021) Predicting flood susceptibility using LSTM neural networks. J Hydrol 594:125734CrossRef
Zurück zum Zitat Guo Y, Tang W, Hou G, Pan F, Wang Y, Wang W (2021) Research on precipitation forecast based on LSTM–CP combined model. Sustainability 13(21):11596CrossRef Guo Y, Tang W, Hou G, Pan F, Wang Y, Wang W (2021) Research on precipitation forecast based on LSTM–CP combined model. Sustainability 13(21):11596CrossRef
Zurück zum Zitat Hu C, Wu Q, Li H, Jian S, Li N, Lou Z (2018) Deep learning with a long short-term memory networks approach for rainfall-runoff simulation. Water 10(11):1543CrossRef Hu C, Wu Q, Li H, Jian S, Li N, Lou Z (2018) Deep learning with a long short-term memory networks approach for rainfall-runoff simulation. Water 10(11):1543CrossRef
Zurück zum Zitat Khazaee Poul A, Shourian M, Ebrahimi H (2019) A comparative study of MLR, KNN, ANN and ANFIS models with wavelet transform in monthly stream flow prediction. Water Resour Manag 33:2907–2923CrossRef Khazaee Poul A, Shourian M, Ebrahimi H (2019) A comparative study of MLR, KNN, ANN and ANFIS models with wavelet transform in monthly stream flow prediction. Water Resour Manag 33:2907–2923CrossRef
Zurück zum Zitat Kim J, Lee K (2021) Unscented Kalman filter-aided long short-term memory approach for wind nowcasting. Aerospace 8(9):236CrossRef Kim J, Lee K (2021) Unscented Kalman filter-aided long short-term memory approach for wind nowcasting. Aerospace 8(9):236CrossRef
Zurück zum Zitat Kratzert F, Klotz D, Brenner C, Schulz K, Herrnegger M (2018) Rainfall–runoff modelling using long short-term memory (LSTM) networks. Hydrol Earth Syst Sci 22(11):6005–6022CrossRef Kratzert F, Klotz D, Brenner C, Schulz K, Herrnegger M (2018) Rainfall–runoff modelling using long short-term memory (LSTM) networks. Hydrol Earth Syst Sci 22(11):6005–6022CrossRef
Zurück zum Zitat Liu M, Huang Y, Li Z, Tong B, Liu Z, Sun M, Zhang H (2020) The applicability of LSTM-KNN model for real-time flood forecasting in different climate zones in China. Water 12(2), 440 Liu M, Huang Y, Li Z, Tong B, Liu Z, Sun M, Zhang H (2020) The applicability of LSTM-KNN model for real-time flood forecasting in different climate zones in China. Water 12(2), 440
Zurück zum Zitat Mehr AD, Gandomi AH (2021) MSGP-LASSO: An improved multi-stage genetic programming model for streamflow prediction. Inf Sci 561:181–195CrossRef Mehr AD, Gandomi AH (2021) MSGP-LASSO: An improved multi-stage genetic programming model for streamflow prediction. Inf Sci 561:181–195CrossRef
Zurück zum Zitat Ni L, Wang D, Singh VP, Wu J, Wang Y, Tao Y, Zhang J (2020) Streamflow and rainfall forecasting by two long short-term memory-based models. J Hydrol 583:124296CrossRef Ni L, Wang D, Singh VP, Wu J, Wang Y, Tao Y, Zhang J (2020) Streamflow and rainfall forecasting by two long short-term memory-based models. J Hydrol 583:124296CrossRef
Zurück zum Zitat Nor NI, Harun S, Kassim AH (2007) Radial basis function modeling of hourly streamflow hydrograph. J Hydrol Eng 12(1):113–123CrossRef Nor NI, Harun S, Kassim AH (2007) Radial basis function modeling of hourly streamflow hydrograph. J Hydrol Eng 12(1):113–123CrossRef
Zurück zum Zitat Poncela P, Ruiz E, Miranda K (2021) Factor extraction using Kalman filter and smoothing: This is not just another survey. Int J Forecast 37(4):1399–1425CrossRef Poncela P, Ruiz E, Miranda K (2021) Factor extraction using Kalman filter and smoothing: This is not just another survey. Int J Forecast 37(4):1399–1425CrossRef
Zurück zum Zitat Rahimzad M, Moghaddam Nia A, Zolfonoon H, Soltani J, Danandeh Mehr A, Kwon HH (2021) Performance comparison of an lstm-based deep learning model versus conventional machine learning algorithms for streamflow forecasting. Water Resour Manag 35(12):4167–4187CrossRef Rahimzad M, Moghaddam Nia A, Zolfonoon H, Soltani J, Danandeh Mehr A, Kwon HH (2021) Performance comparison of an lstm-based deep learning model versus conventional machine learning algorithms for streamflow forecasting. Water Resour Manag 35(12):4167–4187CrossRef
Zurück zum Zitat Ralaivola L, d'Alché-Buc F (2005) Time series filtering, smoothing and learning using the kernel Kalman filter. In Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005. (Vol. 3, pp. 1449–1454). IEEE Ralaivola L, d'Alché-Buc F (2005) Time series filtering, smoothing and learning using the kernel Kalman filter. In Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005. (Vol. 3, pp. 1449–1454). IEEE
Zurück zum Zitat Roy B, Singh MP, Singh A (2019) A novel approach for rainfall-runoff modelling using a biogeography-based optimization technique. Int J River Basin Manag (19):1–14 Roy B, Singh MP, Singh A (2019) A novel approach for rainfall-runoff modelling using a biogeography-based optimization technique. Int J River Basin Manag (19):1–14
Zurück zum Zitat Sepahvand A, Singh B, Ghobadi M, Sihag P (2021) Estimation of infiltration rate using data-driven models. Arab J Geosci 14(1):1–11CrossRef Sepahvand A, Singh B, Ghobadi M, Sihag P (2021) Estimation of infiltration rate using data-driven models. Arab J Geosci 14(1):1–11CrossRef
Zurück zum Zitat Sharma P, Machiwal D (2021) Streamflow forecasting: overview of advances in data-driven techniques. Adv Streamflow Forecast 1–50 Sharma P, Machiwal D (2021) Streamflow forecasting: overview of advances in data-driven techniques. Adv Streamflow Forecast 1–50
Zurück zum Zitat Shi Z (2021) Incorporating Transformer and LSTM to Kalman Filter with EM algorithm for state estimation. arXiv preprint arXiv:2105.00250 Shi Z (2021) Incorporating Transformer and LSTM to Kalman Filter with EM algorithm for state estimation. arXiv preprint arXiv:​2105.​00250
Zurück zum Zitat Singh B (2020) Prediction of the sodium absorption ratio using data-driven models: a case study in Iran. Geol Ecol Landsc 4(1):1–10CrossRef Singh B (2020) Prediction of the sodium absorption ratio using data-driven models: a case study in Iran. Geol Ecol Landsc 4(1):1–10CrossRef
Zurück zum Zitat Song T, Ding W, Wu J, Liu H, Zhou H, Chu J (2019) Flash flood forecasting based on long short-term memory networks. Water 12(1):109CrossRef Song T, Ding W, Wu J, Liu H, Zhou H, Chu J (2019) Flash flood forecasting based on long short-term memory networks. Water 12(1):109CrossRef
Zurück zum Zitat Sun L, Seidou O, Nistor I, Liu K (2016) Review of the Kalman-type hydrological data assimilation. Hydrol Sci J 61(13):2348–2366CrossRef Sun L, Seidou O, Nistor I, Liu K (2016) Review of the Kalman-type hydrological data assimilation. Hydrol Sci J 61(13):2348–2366CrossRef
Zurück zum Zitat Wegayehu EB, Muluneh FB (2022) Short-term daily univariate streamflow forecasting using deep learning models. Adv Meteorol Wegayehu EB, Muluneh FB (2022) Short-term daily univariate streamflow forecasting using deep learning models. Adv Meteorol
Zurück zum Zitat Widiasari IR, Nugoho LE, Efendi R (2018) Context-based hydrology time series data for a flood prediction model using LSTM. In 2018 5th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE) (pp. 385–390). IEEE Widiasari IR, Nugoho LE, Efendi R (2018) Context-based hydrology time series data for a flood prediction model using LSTM. In 2018 5th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE) (pp. 385–390). IEEE
Zurück zum Zitat Wu J, Fang Q, Xu Y, Su J, Ma F (2017) October. Kalman filter based time series prediction of cake factory daily sale. In 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI) (pp. 1–7). IEEE Wu J, Fang Q, Xu Y, Su J, Ma F (2017) October. Kalman filter based time series prediction of cake factory daily sale. In 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI) (pp. 1–7). IEEE
Zurück zum Zitat Wu Y, Ding Y, Zhu Y, Feng J, Wang S (2020) Complexity to forecast flood: Problem definition and spatiotemporal attention LSTM solution. Complexity Wu Y, Ding Y, Zhu Y, Feng J, Wang S (2020) Complexity to forecast flood: Problem definition and spatiotemporal attention LSTM solution. Complexity
Zurück zum Zitat Xiang Z, Yan J, Demir I (2020) A rainfall-runoff model with LSTM-based sequence-to-sequence learning. Water Resour Res 56(e2019WR025326):1 Xiang Z, Yan J, Demir I (2020) A rainfall-runoff model with LSTM-based sequence-to-sequence learning. Water Resour Res 56(e2019WR025326):1
Zurück zum Zitat Yamak PT, Yujian L, Gadosey PK (2019) A comparison between arima, lstm, and gru for time series forecasting. In Proceedings of the 2019 2nd International Conference on Algorithms, Computing and Artificial Intelligence (pp. 49–55) Yamak PT, Yujian L, Gadosey PK (2019) A comparison between arima, lstm, and gru for time series forecasting. In Proceedings of the 2019 2nd International Conference on Algorithms, Computing and Artificial Intelligence (pp. 49–55)
Zurück zum Zitat Yaseen ZM, Ebtehaj I, Bonakdari H, Deo RC, Mehr AD, Mohtar WHMW, Singh VP (2017) Novel approach for streamflow forecasting using a hybrid ANFIS-FFA model. J Hydrol 554:263–276CrossRef Yaseen ZM, Ebtehaj I, Bonakdari H, Deo RC, Mehr AD, Mohtar WHMW, Singh VP (2017) Novel approach for streamflow forecasting using a hybrid ANFIS-FFA model. J Hydrol 554:263–276CrossRef
Zurück zum Zitat Yaseen ZM, Jaafar O, Deo RC, Kisi O, Adamowski J, Quilty J, El-Shafie A (2016) Stream-flow forecasting using extreme learning machines: a case study in a semi-arid region in Iraq. J Hydrol 542:603–614CrossRef Yaseen ZM, Jaafar O, Deo RC, Kisi O, Adamowski J, Quilty J, El-Shafie A (2016) Stream-flow forecasting using extreme learning machines: a case study in a semi-arid region in Iraq. J Hydrol 542:603–614CrossRef
Zurück zum Zitat Yaseen ZM, Allawi MF, Yousif AA, Jaafar O, Hamzah FM, El-Shafie A (2018a) Non-tuned machine learning approach for hydrological time series forecasting. Neural Comput Appl 30(5):1479–1491CrossRef Yaseen ZM, Allawi MF, Yousif AA, Jaafar O, Hamzah FM, El-Shafie A (2018a) Non-tuned machine learning approach for hydrological time series forecasting. Neural Comput Appl 30(5):1479–1491CrossRef
Zurück zum Zitat Yaseen ZM, El-Shafie A, Jaafar O, Afan HA, Sayl KN (2015) Artificial intelligence based models for stream-flow forecasting: 2000–2015. J Hydrol 530:829–844CrossRef Yaseen ZM, El-Shafie A, Jaafar O, Afan HA, Sayl KN (2015) Artificial intelligence based models for stream-flow forecasting: 2000–2015. J Hydrol 530:829–844CrossRef
Zurück zum Zitat Yaseen ZM, Fu M, Wang C, Mohtar WHMW, Deo RC, El-Shafie A (2018) Application of the hybrid artificial neural network coupled with rolling mechanism and grey model algorithms for streamflow forecasting over multiple time horizons. Water Resour Manag 32(5):1883–1899CrossRef Yaseen ZM, Fu M, Wang C, Mohtar WHMW, Deo RC, El-Shafie A (2018) Application of the hybrid artificial neural network coupled with rolling mechanism and grey model algorithms for streamflow forecasting over multiple time horizons. Water Resour Manag 32(5):1883–1899CrossRef
Zurück zum Zitat Zhang D, Lin J, Peng Q, Wang D, Yang T, Sorooshian S, Liu X, Zhuang J (2018a) Modeling and simulating of reservoir operation using the artificial neural network, support vector regression, deep learning algorithm. J Hydrol 565:720–736CrossRef Zhang D, Lin J, Peng Q, Wang D, Yang T, Sorooshian S, Liu X, Zhuang J (2018a) Modeling and simulating of reservoir operation using the artificial neural network, support vector regression, deep learning algorithm. J Hydrol 565:720–736CrossRef
Zurück zum Zitat Zhang D, Lindholm G, Ratnaweera H (2018b) Use long short-term memory to enhance Internet of Things for combined sewer overflow monitoring. J Hydrol 556:409–418CrossRef Zhang D, Lindholm G, Ratnaweera H (2018b) Use long short-term memory to enhance Internet of Things for combined sewer overflow monitoring. J Hydrol 556:409–418CrossRef
Zurück zum Zitat Zhang J, Zhu Y, Zhang X, Ye M, Yang J (2018c) Developing a Long Short-Term Memory (LSTM) based model for predicting water table depth in agricultural areas. J Hydrol 561:918–929CrossRef Zhang J, Zhu Y, Zhang X, Ye M, Yang J (2018c) Developing a Long Short-Term Memory (LSTM) based model for predicting water table depth in agricultural areas. J Hydrol 561:918–929CrossRef
Metadaten
Titel
Performance Improvement of LSTM-based Deep Learning Model for Streamflow Forecasting Using Kalman Filtering
verfasst von
Fatemeh Bakhshi Ostadkalayeh
Saba Moradi
Ali Asadi
Alireza Moghaddam Nia
Somayeh Taheri
Publikationsdatum
17.03.2023
Verlag
Springer Netherlands
Erschienen in
Water Resources Management / Ausgabe 8/2023
Print ISSN: 0920-4741
Elektronische ISSN: 1573-1650
DOI
https://doi.org/10.1007/s11269-023-03492-2

Weitere Artikel der Ausgabe 8/2023

Water Resources Management 8/2023 Zur Ausgabe