Skip to main content
Erschienen in: Soft Computing 11/2020

15.07.2019 | Focus

Using big data computing framework and parallelized PSO algorithm to construct the reservoir dispatching rule optimization

verfasst von: Wenjuan Zhang, Yingping Huang

Erschienen in: Soft Computing | Ausgabe 11/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The paper aims to study how to realize the rational allocation and efficient utilization of water resources among reservoirs and coordinate the balanced optimization of benefit among dispatching objectives under the premise of ensuring flood control safety. A multi-objective optimal dispatching system for reservoirs in Jinsha River basin based on the Spark big data computing framework and parallelized particle swarm optimization (PSO) is proposed. The characteristics of multiple objectives of water resources optimal dispatching system in Jinsha River basin are analyzed. The multiple objectives have been transformed into single objectives, and the solving model of the problem is obtained. Secondly, the parallel algorithm programming model, the PSO algorithm and its parallel strategy for solving optimization problems, and the parallel method of PSO based on Spark big data computing framework are studied. The results show that the research work provides a scientific theoretical basis and a feasible optimization method for the management and dispatch of cascade hydropower stations. Therefore, this study plays a decisive role in promoting the efficient operation of water resources optimal dispatching system and has good reference value for the development and application of big data parallel programming based on Spark platform.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Ahmadianfar I, Adib A, Taghian M (2017) Optimization of multi-reservoir operation with a new hedging rule: application of fuzzy set theory and NSGA-II. Appl Water Sci 7(6):3075–3086CrossRef Ahmadianfar I, Adib A, Taghian M (2017) Optimization of multi-reservoir operation with a new hedging rule: application of fuzzy set theory and NSGA-II. Appl Water Sci 7(6):3075–3086CrossRef
Zurück zum Zitat Bashiriatrabi H, Qaderi K, Rheinheimer DE et al (2015) Application of harmony search algorithm to reservoir operation optimization. Water Resour Manag 29(15):1–20 Bashiriatrabi H, Qaderi K, Rheinheimer DE et al (2015) Application of harmony search algorithm to reservoir operation optimization. Water Resour Manag 29(15):1–20
Zurück zum Zitat Cañón J, González J, Valdés J (2015) Reservoir operation and water allocation to mitigate drought effects in crops: a multilevel optimization using the drought frequency index. J Water Resour Plan Manag 135(6):458–465CrossRef Cañón J, González J, Valdés J (2015) Reservoir operation and water allocation to mitigate drought effects in crops: a multilevel optimization using the drought frequency index. J Water Resour Plan Manag 135(6):458–465CrossRef
Zurück zum Zitat Cheng R, Jin Y (2015) A social learning particle swarm optimization algorithm for scalable optimization. Inf Sci 291(6):43–60MathSciNetMATHCrossRef Cheng R, Jin Y (2015) A social learning particle swarm optimization algorithm for scalable optimization. Inf Sci 291(6):43–60MathSciNetMATHCrossRef
Zurück zum Zitat Cui D (2017) Application of whale optimization algorithm in reservoir optimal operation. Adv Sci Technol Water Resour 37(3):72–76 Cui D (2017) Application of whale optimization algorithm in reservoir optimal operation. Adv Sci Technol Water Resour 37(3):72–76
Zurück zum Zitat Du WB, Gao Y, Liu C et al (2015) Adequate is better: particle swarm optimization with limited-information. Appl Math Comput 268:832–838MathSciNetMATH Du WB, Gao Y, Liu C et al (2015) Adequate is better: particle swarm optimization with limited-information. Appl Math Comput 268:832–838MathSciNetMATH
Zurück zum Zitat Eberhart R, Kennedy J (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, vol 4, pp 1942–1948 Eberhart R, Kennedy J (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, vol 4, pp 1942–1948
Zurück zum Zitat Eberhart RC, Shi Y (1998) Comparison between genetic algorithms and particle swarm optimization. In: International conference on evolutionary programming. Springer, Berlin, pp 611–616 Eberhart RC, Shi Y (1998) Comparison between genetic algorithms and particle swarm optimization. In: International conference on evolutionary programming. Springer, Berlin, pp 611–616
Zurück zum Zitat Esmin AAA, Coelho RA, Matwin S (2015) A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data. Artif Intell Rev 44(1):23–45CrossRef Esmin AAA, Coelho RA, Matwin S (2015) A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data. Artif Intell Rev 44(1):23–45CrossRef
Zurück zum Zitat Feng B, Dai M, Tao Z et al (2017) Effect of reservoir group joint operation on flood control in the middle and lower reaches of Yangtze River. J Water Resour Res 06(3):278–284CrossRef Feng B, Dai M, Tao Z et al (2017) Effect of reservoir group joint operation on flood control in the middle and lower reaches of Yangtze River. J Water Resour Res 06(3):278–284CrossRef
Zurück zum Zitat Ginting BM, Harlan D, Taufik A et al (2017) Optimization of reservoir operation using linear program, case study of Riam Jerawi Reservoir, Indonesia. Int J River Basin Manag 15(2):187–198CrossRef Ginting BM, Harlan D, Taufik A et al (2017) Optimization of reservoir operation using linear program, case study of Riam Jerawi Reservoir, Indonesia. Int J River Basin Manag 15(2):187–198CrossRef
Zurück zum Zitat Gu W, Shao D, Tan X et al (2017) Simulation and optimization of multi-reservoir operation in inter-basin water transfer system. Water Resour Manag 31(11):3401–3412CrossRef Gu W, Shao D, Tan X et al (2017) Simulation and optimization of multi-reservoir operation in inter-basin water transfer system. Water Resour Manag 31(11):3401–3412CrossRef
Zurück zum Zitat He Q, Wang L (2015) A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization. Appl Math Comput 186(2):1407–1422MathSciNetMATH He Q, Wang L (2015) A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization. Appl Math Comput 186(2):1407–1422MathSciNetMATH
Zurück zum Zitat Jiang C, Zhang F, Li T (2018) Synchronization and antisynchronization of N-coupled fractional-order complex chaotic systems with ring connection. Math Methods Appl Sci 41(7):2625–2638MathSciNetMATHCrossRef Jiang C, Zhang F, Li T (2018) Synchronization and antisynchronization of N-coupled fractional-order complex chaotic systems with ring connection. Math Methods Appl Sci 41(7):2625–2638MathSciNetMATHCrossRef
Zurück zum Zitat Li HY (2017) Existence of nontrivial solutions for superlinear three-point boundary value problems. Acta Math Appl Sin Engl Ser 33(4):1043–1052MathSciNetMATHCrossRef Li HY (2017) Existence of nontrivial solutions for superlinear three-point boundary value problems. Acta Math Appl Sin Engl Ser 33(4):1043–1052MathSciNetMATHCrossRef
Zurück zum Zitat Li Y, Zhan ZH, Lin S et al (2015) Competitive and cooperative particle swarm optimization with an information sharing mechanism for global optimization problems. Inf Sci 293(3):370–382CrossRef Li Y, Zhan ZH, Lin S et al (2015) Competitive and cooperative particle swarm optimization with an information sharing mechanism for global optimization problems. Inf Sci 293(3):370–382CrossRef
Zurück zum Zitat Li Y, Sun Y, Meng F (2017) New criteria for exponential stability of switched time-varying systems with delays and nonlinear disturbances. Nonlinear Anal Hybrid Syst 26:284–291MathSciNetMATHCrossRef Li Y, Sun Y, Meng F (2017) New criteria for exponential stability of switched time-varying systems with delays and nonlinear disturbances. Nonlinear Anal Hybrid Syst 26:284–291MathSciNetMATHCrossRef
Zurück zum Zitat Li D, Chen F, An Y (2018) Existence and multiplicity of nontrivial solutions for nonlinear fractional differential systems with p-Laplacian via critical point theory. Math Methods Appl Sci 41(8):3197–3212MathSciNetMATHCrossRef Li D, Chen F, An Y (2018) Existence and multiplicity of nontrivial solutions for nonlinear fractional differential systems with p-Laplacian via critical point theory. Math Methods Appl Sci 41(8):3197–3212MathSciNetMATHCrossRef
Zurück zum Zitat Liang K, Dai M, Shen H, Wang J, Wang Z, Chen B (2018) L2 − L∞ synchronization for singularly perturbed complex networks with semi-Markov jump topology. Appl Math Comput 321:450–462MathSciNetMATH Liang K, Dai M, Shen H, Wang J, Wang Z, Chen B (2018) L2 − L∞ synchronization for singularly perturbed complex networks with semi-Markov jump topology. Appl Math Comput 321:450–462MathSciNetMATH
Zurück zum Zitat Liu F (2017) On the Triebel-Lizorkin space boundedness of Marcinkiewicz integrals along compound surfaces. Math Inequal Appl 20(2):515–535MathSciNetMATH Liu F (2017) On the Triebel-Lizorkin space boundedness of Marcinkiewicz integrals along compound surfaces. Math Inequal Appl 20(2):515–535MathSciNetMATH
Zurück zum Zitat Liu F (2018a) A note of Littlewood-Paley functions on Triebel-Lizorkin spaces. Bull Korean Math Soc 55(2):659–672MathSciNetMATH Liu F (2018a) A note of Littlewood-Paley functions on Triebel-Lizorkin spaces. Bull Korean Math Soc 55(2):659–672MathSciNetMATH
Zurück zum Zitat Liu H, Wang N, Xie J et al (2015) Application of improved ant colony algorithm to optimal dispatching of reservoir group water supply. J Hydroelectr Eng 34(2):31–36 Liu H, Wang N, Xie J et al (2015) Application of improved ant colony algorithm to optimal dispatching of reservoir group water supply. J Hydroelectr Eng 34(2):31–36
Zurück zum Zitat Momeni E, Armaghani DJ, Hajihassani M et al (2015) Prediction of uniaxial compressive strength of rock samples using hybrid particle swarm optimization-based artificial neural networks. Measurement 60(1):50–63CrossRef Momeni E, Armaghani DJ, Hajihassani M et al (2015) Prediction of uniaxial compressive strength of rock samples using hybrid particle swarm optimization-based artificial neural networks. Measurement 60(1):50–63CrossRef
Zurück zum Zitat Ouyang S, Zhou J, Li C et al (2015) Optimal design for flood limit water level of cascade reservoirs. Water Resour Manag 29(2):445–457CrossRef Ouyang S, Zhou J, Li C et al (2015) Optimal design for flood limit water level of cascade reservoirs. Water Resour Manag 29(2):445–457CrossRef
Zurück zum Zitat Pan L, Housh M, Liu P et al (2015) Robust stochastic optimization for reservoir operation. Water Resour Res 51(1):409–429CrossRef Pan L, Housh M, Liu P et al (2015) Robust stochastic optimization for reservoir operation. Water Resour Res 51(1):409–429CrossRef
Zurück zum Zitat Saberchenari K, Abghari H, Tabari H (2016) Application of PSO algorithm in short-term optimization of reservoir operation. Environ Monit Assess 188(12):667CrossRef Saberchenari K, Abghari H, Tabari H (2016) Application of PSO algorithm in short-term optimization of reservoir operation. Environ Monit Assess 188(12):667CrossRef
Zurück zum Zitat Spiliotis M, Mediero L, Garrote L (2016) Optimization of hedging rules for reservoir operation during droughts based on particle swarm optimization. Water Resour Manag 30(15):1–20CrossRef Spiliotis M, Mediero L, Garrote L (2016) Optimization of hedging rules for reservoir operation during droughts based on particle swarm optimization. Water Resour Manag 30(15):1–20CrossRef
Zurück zum Zitat Sun J, Wu X, Palade V et al (2015a) Random drift particle swarm optimization algorithm: convergence analysis and parameter selection. Mach Learn 101(1–3):345–376MathSciNetMATHCrossRef Sun J, Wu X, Palade V et al (2015a) Random drift particle swarm optimization algorithm: convergence analysis and parameter selection. Mach Learn 101(1–3):345–376MathSciNetMATHCrossRef
Zurück zum Zitat Sun W, Yang B, Yanbin XU et al (2015b) Study on optimal water supply operation model of pluriennial regulation reservoir groups with external water resource. J Hydroelectr Eng 34(6):21–27 Sun W, Yang B, Yanbin XU et al (2015b) Study on optimal water supply operation model of pluriennial regulation reservoir groups with external water resource. J Hydroelectr Eng 34(6):21–27
Zurück zum Zitat Taormina R, Chau KW (2015) Data-driven input variable selection for rainfall–runoff modeling using binary-coded particle swarm optimization and extreme learning machines. J Hydrol 529:1617–1632CrossRef Taormina R, Chau KW (2015) Data-driven input variable selection for rainfall–runoff modeling using binary-coded particle swarm optimization and extreme learning machines. J Hydrol 529:1617–1632CrossRef
Zurück zum Zitat Tayebiyan A, Ali TAM, Ghazali AH et al (2016) Optimization of exclusive release policies for hydropower reservoir operation by using genetic algorithm. Water Resour Manag 30(3):1203–1216CrossRef Tayebiyan A, Ali TAM, Ghazali AH et al (2016) Optimization of exclusive release policies for hydropower reservoir operation by using genetic algorithm. Water Resour Manag 30(3):1203–1216CrossRef
Zurück zum Zitat Tian Z, Tian M, Gu C, Hao X (2017) An accelerated Jacobi-gradient based iterative algorithm for solving Sylvester matrix equations. Filomat 31(8):2381–2390MathSciNetCrossRef Tian Z, Tian M, Gu C, Hao X (2017) An accelerated Jacobi-gradient based iterative algorithm for solving Sylvester matrix equations. Filomat 31(8):2381–2390MathSciNetCrossRef
Zurück zum Zitat Wan W, Guo X, Lei X et al (2018) A novel optimization method for multi-reservoir operation policy derivation in complex inter-basin water transfer system. Water Resour Manag 32:1–21CrossRef Wan W, Guo X, Lei X et al (2018) A novel optimization method for multi-reservoir operation policy derivation in complex inter-basin water transfer system. Water Resour Manag 32:1–21CrossRef
Zurück zum Zitat Wang Y, Pan Z, Li Y, Zhang W (2017) H∞ control for nonlinear stochastic Markov systems with time-delay and multiplicative noise. J Syst Sci Complex 30(6):1–23MathSciNetCrossRef Wang Y, Pan Z, Li Y, Zhang W (2017) H∞ control for nonlinear stochastic Markov systems with time-delay and multiplicative noise. J Syst Sci Complex 30(6):1–23MathSciNetCrossRef
Zurück zum Zitat Yong Z, Gong D, Ying H et al (2015) Feature selection algorithm based on bare bones particle swarm optimization. Neurocomputing 148(1):150–157 Yong Z, Gong D, Ying H et al (2015) Feature selection algorithm based on bare bones particle swarm optimization. Neurocomputing 148(1):150–157
Zurück zum Zitat Yu Y, Wang P, Wang C et al (2018) Optimal reservoir operation using multi-objective evolutionary algorithms for potential estuarine eutrophication control. J Environ Manag 223:758–770CrossRef Yu Y, Wang P, Wang C et al (2018) Optimal reservoir operation using multi-objective evolutionary algorithms for potential estuarine eutrophication control. J Environ Manag 223:758–770CrossRef
Metadaten
Titel
Using big data computing framework and parallelized PSO algorithm to construct the reservoir dispatching rule optimization
verfasst von
Wenjuan Zhang
Yingping Huang
Publikationsdatum
15.07.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 11/2020
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-019-04188-9

Weitere Artikel der Ausgabe 11/2020

Soft Computing 11/2020 Zur Ausgabe