Skip to main content
Top

2014 | OriginalPaper | Chapter

10. Advances in Water Resources Systems Engineering: Applications of Machine Learning

Author : John W. Labadie, Ph.D, P.E.

Published in: Modern Water Resources Engineering

Publisher: Humana Press

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

There has long existed a dichotomy in the field of water resources systems engineering between simulation and optimization modeling, with each approach having its own advantages and disadvantages. Simulation models provide a means of accurately representing the complex physiochemical, socioeconomic, and legal-administrative behavior of complex water resources systems, but lack the capability of systematically determining optimal water planning and management decisions. Optimization models, on the other hand, excel at automatic determination of optima, while often sacrificing the accurate representation of the underlying water system behavior. Various means of effectively establishing a synergy between simulation and optimization models that accentuates their advantages while minimizing their shortcomings have evolved from the field of artificial intelligence within the province of computer science. Artificial intelligence was defined by John McCarthy in 1955 as “the science and engineering of making intelligent decisions.” Machine learning, as a branch of artificial intelligence, focuses on the development of specific algorithms that allow computerized agents to learn optimal behaviors through interaction with a real or simulated environment. Although there are many aspects of machine learning, the focus here is on agent-based modeling tools for learning optimal decisions and management rule structures for water resources systems under conflicting goals and complex stochastic environments. A wide variety of machine learning tools such as reinforcement learning, artificial neural networks, fuzzy rule-based systems, and evolutionary algorithms are applied herein to complex decision problems in integrated management of multipurpose river-reservoir systems, real-time control of combined sewer systems for pollution reduction, and integrated design and operation of stormwater control systems for sustaining and remediating coastal aquatic ecosystems damaged by intensified urbanization and development.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Labadie JW, Brazil LE, Corbu I, Johnson LE (eds) (1989) Computerized decision support systems for water managers. American Society of Civil Engineers, Reston, VA Labadie JW, Brazil LE, Corbu I, Johnson LE (eds) (1989) Computerized decision support systems for water managers. American Society of Civil Engineers, Reston, VA
2.
go back to reference Keys AM, Palmer RN (1995) An assessment of shared vision model effectiveness in water resources planning, Proceedings of the 22nd annual water resources planning and management conference. American Society of Civil Engineers, Washington, DC, pp 532–535 Keys AM, Palmer RN (1995) An assessment of shared vision model effectiveness in water resources planning, Proceedings of the 22nd annual water resources planning and management conference. American Society of Civil Engineers, Washington, DC, pp 532–535
3.
go back to reference Labadie JW (2004) Optimal operation of multi-reservoir systems: state-of-the-art review. J Water Resour Plann Manage 130(2):93–111CrossRef Labadie JW (2004) Optimal operation of multi-reservoir systems: state-of-the-art review. J Water Resour Plann Manage 130(2):93–111CrossRef
4.
go back to reference Hashimoto T, Stedinger JR, Loucks DP (1982) Reliability, resiliency, and vulnerability criteria for water resource system performance evaluation. Water Resour Res 18(3):489–498CrossRef Hashimoto T, Stedinger JR, Loucks DP (1982) Reliability, resiliency, and vulnerability criteria for water resource system performance evaluation. Water Resour Res 18(3):489–498CrossRef
5.
go back to reference Ao S-I, Rieger B, Amouzegar MA (eds) (2010) Machine learning and systems engineering, vol 68, Series: Lecture Notes in Electrical Engineering. Springer, Netherlands Ao S-I, Rieger B, Amouzegar MA (eds) (2010) Machine learning and systems engineering, vol 68, Series: Lecture Notes in Electrical Engineering. Springer, Netherlands
6.
go back to reference Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, Cambridge, MA Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, Cambridge, MA
7.
go back to reference World Commission on Dams (WCD) (2000) Dams and development: a new framework for decision-making, report of the world commission on dams. Earthscan Publications Ltd., London World Commission on Dams (WCD) (2000) Dams and development: a new framework for decision-making, report of the world commission on dams. Earthscan Publications Ltd., London
8.
go back to reference Wang D, Adams BJ (1986) Optimization of real-time reservoir operations with Markov decision processes. Water Resour Res 22(3):345–352CrossRef Wang D, Adams BJ (1986) Optimization of real-time reservoir operations with Markov decision processes. Water Resour Res 22(3):345–352CrossRef
9.
go back to reference Braga BPF, Yeh WG, Becker L, Barros MTL (1991) Stochastic optimization of multiple reservoir system operation. J Water Resour Plann Manage 117(4):471–481CrossRef Braga BPF, Yeh WG, Becker L, Barros MTL (1991) Stochastic optimization of multiple reservoir system operation. J Water Resour Plann Manage 117(4):471–481CrossRef
10.
go back to reference Tejada-Guibert JA, Johnson SA, Stedinger JR (1995) The value of hydrologic information in stochastic dynamic programming models of a multireservoir system. Water Resour Res 3(10):2571–2579CrossRef Tejada-Guibert JA, Johnson SA, Stedinger JR (1995) The value of hydrologic information in stochastic dynamic programming models of a multireservoir system. Water Resour Res 3(10):2571–2579CrossRef
11.
go back to reference Lee, J-H, Labadie JW (2007) Stochastic optimization of multi-reservoir systems via reinforcement learning. Water Resour Res 43, No. W11408 Lee, J-H, Labadie JW (2007) Stochastic optimization of multi-reservoir systems via reinforcement learning. Water Resour Res 43, No. W11408
12.
go back to reference Kelman J, Stedinger JR, Cooper LA, Hsu E, Yuan S-Q (1990) Sampling stochastic dynamic programming applied to reservoir operation. Water Resour Res 26(3):447–454CrossRef Kelman J, Stedinger JR, Cooper LA, Hsu E, Yuan S-Q (1990) Sampling stochastic dynamic programming applied to reservoir operation. Water Resour Res 26(3):447–454CrossRef
13.
go back to reference Kaelbling LP, Littman ML, Moore AW (1996) Reinforcement learning: a survey. J Artifi Intell Res 4:237–285 Kaelbling LP, Littman ML, Moore AW (1996) Reinforcement learning: a survey. J Artifi Intell Res 4:237–285
14.
go back to reference Dreyfus SE, Law AM (1977) The art and theory of dynamic programming. Academic, New York, USA Dreyfus SE, Law AM (1977) The art and theory of dynamic programming. Academic, New York, USA
15.
go back to reference Ross SM (1983) Introduction to stochastic dynamic programming. Academic Press, Inc., San Diego, CA Ross SM (1983) Introduction to stochastic dynamic programming. Academic Press, Inc., San Diego, CA
16.
go back to reference Watkins C, Dayan P (1992) Technical note: Q-Learning. Mach Learn 8:279–292 Watkins C, Dayan P (1992) Technical note: Q-Learning. Mach Learn 8:279–292
17.
go back to reference Foufoula-Georgiou E (1991) Convex interpolation for gradient dynamic-programming. Water Resour Res 27(1):31–36CrossRef Foufoula-Georgiou E (1991) Convex interpolation for gradient dynamic-programming. Water Resour Res 27(1):31–36CrossRef
18.
go back to reference Johnson SA, Stedinger JR, Shoemaker CA, Li Y, Tejada-Guibert JA (1993) Numerical-solution of continuous-state dynamic programs using linear and spline interpolation. Oper Res 41(3):484–500CrossRef Johnson SA, Stedinger JR, Shoemaker CA, Li Y, Tejada-Guibert JA (1993) Numerical-solution of continuous-state dynamic programs using linear and spline interpolation. Oper Res 41(3):484–500CrossRef
19.
go back to reference K-water (2003) Geum river basin operational guidelines for MODSIM, technical report. Korea Water Resources Corporation, Daejeon K-water (2003) Geum river basin operational guidelines for MODSIM, technical report. Korea Water Resources Corporation, Daejeon
20.
go back to reference AMSA (1994) Approaches to combined sewer overflow program development. Association of Metropolitan Sewerage Agencies, Washington, DC AMSA (1994) Approaches to combined sewer overflow program development. Association of Metropolitan Sewerage Agencies, Washington, DC
21.
go back to reference U.S. EPA (1999) Combined sewer overflow management fact sheet. EPA/832/R-99-005, U.S. Environmental Protection Agency, Washington, DC U.S. EPA (1999) Combined sewer overflow management fact sheet. EPA/832/R-99-005, U.S. Environmental Protection Agency, Washington, DC
22.
go back to reference McCarron J (2010) Chicago Sun Times. August 6 McCarron J (2010) Chicago Sun Times. August 6
24.
go back to reference Loucks ED, Locke EF, Heinz SR, Vitasovic ZC (2004) A real-time control strategy for operating the Milwaukee Metropolitan Sewerage District (MMSD) conveyance and storage system. Proceedings of the 2004 World Water and Environmental Resources Congress: Critical Transitions in Water and Environmental Resources Management, Environmental and Water Resources Institute and American Society of Civil Engineers, Reston, Virginia, USA Loucks ED, Locke EF, Heinz SR, Vitasovic ZC (2004) A real-time control strategy for operating the Milwaukee Metropolitan Sewerage District (MMSD) conveyance and storage system. Proceedings of the 2004 World Water and Environmental Resources Congress: Critical Transitions in Water and Environmental Resources Management, Environmental and Water Resources Institute and American Society of Civil Engineers, Reston, Virginia, USA
25.
go back to reference Pleau M, Colas H, Lavallée P, Pelletier G, Bonin R (2005) Global optimal real-time control of the Quebec urban drainage system. Environ Model Software 20:401–413CrossRef Pleau M, Colas H, Lavallée P, Pelletier G, Bonin R (2005) Global optimal real-time control of the Quebec urban drainage system. Environ Model Software 20:401–413CrossRef
26.
go back to reference Vazquez J, François M, Gilbert D (2003) Real-time management of a sewage system: verification of the optimality and applicability of graphical linear programming compared to mixed linear programming. J Water Sci 16(4):425–442, article in French Vazquez J, François M, Gilbert D (2003) Real-time management of a sewage system: verification of the optimality and applicability of graphical linear programming compared to mixed linear programming. J Water Sci 16(4):425–442, article in French
27.
go back to reference Weyand M (2002) Real-time control in combined sewer systems in Germany–some case studies. Urban Water 4:347–354CrossRef Weyand M (2002) Real-time control in combined sewer systems in Germany–some case studies. Urban Water 4:347–354CrossRef
28.
go back to reference Schutze M, Campisano A, Colas H, Schilling W, Vanrolleghem PA (2004) Real-time control of urban wastewater systems–Where do we stand today? J Hydrol 299(3):335–348 Schutze M, Campisano A, Colas H, Schilling W, Vanrolleghem PA (2004) Real-time control of urban wastewater systems–Where do we stand today? J Hydrol 299(3):335–348
29.
go back to reference Labadie JW (1993) Optimal use of in-line storage for real-time urban stormwater control. In: Cao C, Yen BC, Benedini M (eds) Urban storm drainage. Water Resources Publications, Inc, Highlands Ranch, CO Labadie JW (1993) Optimal use of in-line storage for real-time urban stormwater control. In: Cao C, Yen BC, Benedini M (eds) Urban storm drainage. Water Resources Publications, Inc, Highlands Ranch, CO
30.
go back to reference Darsono S, Labadie JW (2007) Neural optimal control algorithm for real-time regulation of in-line storage in combined sewer systems. Environ Model Software 22:1349–1361CrossRef Darsono S, Labadie JW (2007) Neural optimal control algorithm for real-time regulation of in-line storage in combined sewer systems. Environ Model Software 22:1349–1361CrossRef
31.
go back to reference Kayhanian M, Stenstrom MK (2005) First flush pollutant mass loading: Treatment strategies. Trans ResRecord (Hydrology, Hydraulics, and Water Quality), No. 1904, 133–143 Kayhanian M, Stenstrom MK (2005) First flush pollutant mass loading: Treatment strategies. Trans ResRecord (Hydrology, Hydraulics, and Water Quality), No. 1904, 133–143
32.
go back to reference Huber WC, Dickinson RE (1992) Stormwater management model. Version 4: User’s Manual, EPA/600/3-88-001a, U.S. Environmental Protection Agency, Athens, Georgia, USA. October Huber WC, Dickinson RE (1992) Stormwater management model. Version 4: User’s Manual, EPA/600/3-88-001a, U.S. Environmental Protection Agency, Athens, Georgia, USA. October
33.
go back to reference Griva I, Nash SG, Sofer A (2010) Linear and nonlinear optimization. SIAM, Pennsylvania, PA Griva I, Nash SG, Sofer A (2010) Linear and nonlinear optimization. SIAM, Pennsylvania, PA
34.
go back to reference Chen Y-H, Chai S-Y (1991) UNSTDY: combined sewer model user’s manual. Chen Engineering Technology, Inc, Ft. Collins, CO Chen Y-H, Chai S-Y (1991) UNSTDY: combined sewer model user’s manual. Chen Engineering Technology, Inc, Ft. Collins, CO
35.
go back to reference Unver OL, Mays LW (1990) Model for real-time optimal flood control operation of a reservoir system. Water Res Manage 4:21–46CrossRef Unver OL, Mays LW (1990) Model for real-time optimal flood control operation of a reservoir system. Water Res Manage 4:21–46CrossRef
36.
go back to reference Parisini T, Zoppoli R (1994) Neural networks for feedback feed-forward nonlinear control systems. IEEE Trans Neural Netw 5(3):436–449CrossRef Parisini T, Zoppoli R (1994) Neural networks for feedback feed-forward nonlinear control systems. IEEE Trans Neural Netw 5(3):436–449CrossRef
37.
go back to reference Haykin S (1994) Neural networks: a comprehensive foundation. IEEE Press, New York Haykin S (1994) Neural networks: a comprehensive foundation. IEEE Press, New York
38.
go back to reference Freeman J (1994) Simulating neural networks with mathematica. Addison Wesley Publishing Company, Inc, Reading, MA Freeman J (1994) Simulating neural networks with mathematica. Addison Wesley Publishing Company, Inc, Reading, MA
39.
go back to reference Hassoum M (1995) Fundamentals of artificial neural networks. MIT Press, Cambridge, MA Hassoum M (1995) Fundamentals of artificial neural networks. MIT Press, Cambridge, MA
40.
go back to reference County K (2004) 2003–2004 Annual combined sewer overflow report. King County Department of Natural Resources and Parks, Wastewater Treatment Division, Seattle County K (2004) 2003–2004 Annual combined sewer overflow report. King County Department of Natural Resources and Parks, Wastewater Treatment Division, Seattle
41.
go back to reference Masters T (1996) Practical neural network recipes in C++. Elsevier Science and Technology Books, Burlington, MA Masters T (1996) Practical neural network recipes in C++. Elsevier Science and Technology Books, Burlington, MA
42.
go back to reference Wilson C, Scotto L, Scarpa J, Volety A, Laramore S, Haunert D (2005) Survey of water quality, oyster reproduction and oyster health status in the St. Lucie Estuary. J Shellfish Res 24:157–165 Wilson C, Scotto L, Scarpa J, Volety A, Laramore S, Haunert D (2005) Survey of water quality, oyster reproduction and oyster health status in the St. Lucie Estuary. J Shellfish Res 24:157–165
43.
go back to reference USCOE and SFWMD (2004) Central and southern Florida project: Indian river lagoon—south: final integrated project implementation report and environmental impact statement. U.S. Army Corps of Engineers and South Florida Water Management District, Jacksonville, FL USCOE and SFWMD (2004) Central and southern Florida project: Indian river lagoon—south: final integrated project implementation report and environmental impact statement. U.S. Army Corps of Engineers and South Florida Water Management District, Jacksonville, FL
44.
go back to reference Haunert D, Konyha K (2001) Establishing St. Lucie Estuary Watershed Inflow Targets to enhance Mesohaline Biota, Appendix E., Indian River Lagoon—South Feasibility Study, South Florida Water Management District, West Palm Beach, FL Haunert D, Konyha K (2001) Establishing St. Lucie Estuary Watershed Inflow Targets to enhance Mesohaline Biota, Appendix E., Indian River Lagoon—South Feasibility Study, South Florida Water Management District, West Palm Beach, FL
45.
go back to reference Wan Y, Labadie J, Konya K, Conboy T (2006) Optimization of frequency distribution of freshwater inflows for coastal ecosystem restoration. J Water Resour Plann Manage 132(5):320–329CrossRef Wan Y, Labadie J, Konya K, Conboy T (2006) Optimization of frequency distribution of freshwater inflows for coastal ecosystem restoration. J Water Resour Plann Manage 132(5):320–329CrossRef
46.
go back to reference Bárdossy A, Duckstein L (1995) Fuzzy rule-based modeling with applications to geophysical, biological, and engineering systems. CRC Press, Boca Raton, FL Bárdossy A, Duckstein L (1995) Fuzzy rule-based modeling with applications to geophysical, biological, and engineering systems. CRC Press, Boca Raton, FL
47.
go back to reference Zimmermann H (2001) Fuzzy Set theory and its applications. Kluwer, Boston, MACrossRef Zimmermann H (2001) Fuzzy Set theory and its applications. Kluwer, Boston, MACrossRef
48.
go back to reference Holland J (1975) Adaptation in natural and artificial system. The University of Michigan Press, Ann Arbor, MI Holland J (1975) Adaptation in natural and artificial system. The University of Michigan Press, Ann Arbor, MI
49.
go back to reference Goldberg D (1989) Genetic algorithms in search, optimization and machine learning. Addison-Wesley Publishing Company Inc, Reading, MA Goldberg D (1989) Genetic algorithms in search, optimization and machine learning. Addison-Wesley Publishing Company Inc, Reading, MA
50.
go back to reference Michalewicz Z (1996) Genetic algorithms + data structures = evolution programs. Springer, Berlin Michalewicz Z (1996) Genetic algorithms + data structures = evolution programs. Springer, Berlin
51.
go back to reference Sareni B, Krähenbühl L (1998) Fitness sharing and niching methods revisited. IEEE Trans Evolut Comput 2(3):97–106CrossRef Sareni B, Krähenbühl L (1998) Fitness sharing and niching methods revisited. IEEE Trans Evolut Comput 2(3):97–106CrossRef
52.
go back to reference Bicknell B, Imhoff J, Kittle J, Jobes T, Donigan A (2001) Hydrologic simulation program-FORTRAN, version 12, user’s manual, national exposure research laboratory, office of research and development. U.S. Environmental Protection Agency, Athens, GA Bicknell B, Imhoff J, Kittle J, Jobes T, Donigan A (2001) Hydrologic simulation program-FORTRAN, version 12, user’s manual, national exposure research laboratory, office of research and development. U.S. Environmental Protection Agency, Athens, GA
53.
go back to reference Aqua Terra Consultants (1996) Modifications to HSPF for high water table and Wetlands conditions in South Florida. Report submitted to South Florida Water Management District, West Palm Beach, Florida Aqua Terra Consultants (1996) Modifications to HSPF for high water table and Wetlands conditions in South Florida. Report submitted to South Florida Water Management District, West Palm Beach, Florida
54.
go back to reference Smajstrla AG (1990) Agricultural field scale irrigation requirements simulation (AFSIRS) model, version 5.5. Technical manual. University of Florida, Gainesville, FL Smajstrla AG (1990) Agricultural field scale irrigation requirements simulation (AFSIRS) model, version 5.5. Technical manual. University of Florida, Gainesville, FL
55.
go back to reference Hu G (1999) Two-dimensional hydrodynamic model of St. Lucie estuary. Proceedings of the ASCE-CSCE national conference on environmental engineering. American Society of Civil Engineers, Reston, VA Hu G (1999) Two-dimensional hydrodynamic model of St. Lucie estuary. Proceedings of the ASCE-CSCE national conference on environmental engineering. American Society of Civil Engineers, Reston, VA
Metadata
Title
Advances in Water Resources Systems Engineering: Applications of Machine Learning
Author
John W. Labadie, Ph.D, P.E.
Copyright Year
2014
Publisher
Humana Press
DOI
https://doi.org/10.1007/978-1-62703-595-8_10