Skip to main content

2014 | OriginalPaper | Buchkapitel

2. The Dynamic Programming Approach

verfasst von : Alexander B. Kurzhanski, Pravin Varaiya

Erschienen in: Dynamics and Control of Trajectory Tubes

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter describes general schemes of the Dynamic Programming approach. It introduces the notion of value function and its role in these schemes. They are dealt with under either classical conditions or directional differentiability of related functions, leaving more complicated cases to later chapters. Here the emphasis is on indicating solutions to forward and backward reachability problems for “linear-convex” systems and the design of closed-loop control strategies for optimal target and time-optimal feedback problems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The general nondifferentiable case for the value function is discussed later in Sect. 5.​1.
 
2
Problems of reachability under unknown but bounded disturbances are beyond the scope of this book, along the approaches of which they are treated in papers [133, 176, 183].
 
3
With additional information on \(\mathcal{P}(t)\) (see Remark 1.​5.​3), in degenerate cases the control u (t) may be written down in more detail.
 
4
This example is animated in the toolbox [132].
 
5
A closed set \(\mathcal{Q}\) is said to be reachable in finite time if the intersection \(\mathcal{Q}\cap \mathbf{X}_{+}(t,x)\not =\varnothing \) for some τ > t. Here X +(t, x) is the total (forward) reachability set from position {t, x}. 
 
Literatur
16.
Zurück zum Zitat Bardi, M., Capuzzo Dolcetta, I.: Optimal Control and Viscosity Solutions of Hamilton–Jacobi–Bellman Equations. SCFA. Birkhäuser, Boston (1997)CrossRefMATH Bardi, M., Capuzzo Dolcetta, I.: Optimal Control and Viscosity Solutions of Hamilton–Jacobi–Bellman Equations. SCFA. Birkhäuser, Boston (1997)CrossRefMATH
22.
Zurück zum Zitat Bellman, R.: Introduction to the Mathematical Theory of Controlled Processes, vol. 1/2. Academic, New York (1967/1971) Bellman, R.: Introduction to the Mathematical Theory of Controlled Processes, vol. 1/2. Academic, New York (1967/1971)
24.
Zurück zum Zitat Bertsekas, D.P.: Dynamic Programming and Optimal Control, vol. 1/2. Athena Scientific, Belmont (1996/2012) Bertsekas, D.P.: Dynamic Programming and Optimal Control, vol. 1/2. Athena Scientific, Belmont (1996/2012)
26.
Zurück zum Zitat Blagodatskih, V.I, Filippov, A.F.: Differential inclusions and optimal control. Proc. Steklov Math. Inst. 169, 194–252 (1985) Blagodatskih, V.I, Filippov, A.F.: Differential inclusions and optimal control. Proc. Steklov Math. Inst. 169, 194–252 (1985)
29.
Zurück zum Zitat Bliss, G.A.: Calculus of Variations. Mathematical Association of America, Chicago (1944) Bliss, G.A.: Calculus of Variations. Mathematical Association of America, Chicago (1944)
33.
Zurück zum Zitat Bolza, O.: Lectures on Calculus of Variations. Hafer Pub. Co, New York (1946). Dover reprint Bolza, O.: Lectures on Calculus of Variations. Hafer Pub. Co, New York (1946). Dover reprint
50.
Zurück zum Zitat Crandall, M.G., Lions, P.-L.: Viscosity solutions of Hamilton–Jacobi equations. Trans. Am. Math. Soc. 277(1), 1–41 (1983)MathSciNetCrossRefMATH Crandall, M.G., Lions, P.-L.: Viscosity solutions of Hamilton–Jacobi equations. Trans. Am. Math. Soc. 277(1), 1–41 (1983)MathSciNetCrossRefMATH
61.
Zurück zum Zitat Demyanov, V.F., Malozemov, V.N.: Introduction to Minimax. Wiley, New York (1974) Demyanov, V.F., Malozemov, V.N.: Introduction to Minimax. Wiley, New York (1974)
72.
Zurück zum Zitat Fan, K.: Existence theorems and extreme solutions for inequalities concerning convex functions or linear transformations. Mathematische Zeitschrift 68(1), 205–216 (1957)MathSciNetCrossRefMATH Fan, K.: Existence theorems and extreme solutions for inequalities concerning convex functions or linear transformations. Mathematische Zeitschrift 68(1), 205–216 (1957)MathSciNetCrossRefMATH
75.
Zurück zum Zitat Filippov, A.F.: On certain questions in the theory of optimal control. SIAM J. Control. 1, 76–84 (1962)MATH Filippov, A.F.: On certain questions in the theory of optimal control. SIAM J. Control. 1, 76–84 (1962)MATH
87.
Zurück zum Zitat Gelfand, I.M., Shilov, G.E.: Generalized Functions. Dover, New York (1991) Gelfand, I.M., Shilov, G.E.: Generalized Functions. Dover, New York (1991)
121.
Zurück zum Zitat Krasovski, N.N.: Rendezvous Game Problems. National Technical Information Service, Springfield (1971) Krasovski, N.N.: Rendezvous Game Problems. National Technical Information Service, Springfield (1971)
133.
Zurück zum Zitat Kurzhanskiy, A.A., Varaiya, P.: Ellipsoidal techniques for reachability analysis of discrete-time linear systems. IEEE Trans. Automat. Control 52(1), 26–38 (2007)MathSciNetCrossRef Kurzhanskiy, A.A., Varaiya, P.: Ellipsoidal techniques for reachability analysis of discrete-time linear systems. IEEE Trans. Automat. Control 52(1), 26–38 (2007)MathSciNetCrossRef
158.
Zurück zum Zitat Kurzhanski, A.B., Filippova, T.F.: On the theory of trajectory tubes: a mathematical formalism for uncertain dynamics, viability and control. In: Advances in Nonlinear Dynamics and Control. Progress in Systems and Control Theory, vol. 17, pp. 122–188. Birkhäuser, Boston (1993) Kurzhanski, A.B., Filippova, T.F.: On the theory of trajectory tubes: a mathematical formalism for uncertain dynamics, viability and control. In: Advances in Nonlinear Dynamics and Control. Progress in Systems and Control Theory, vol. 17, pp. 122–188. Birkhäuser, Boston (1993)
174.
Zurück zum Zitat Kurzhanski, A.B., Vályi, I.: Ellipsoidal Calculus for Estimation and Control. SCFA. Birkhäuser, Boston (1997)CrossRefMATH Kurzhanski, A.B., Vályi, I.: Ellipsoidal Calculus for Estimation and Control. SCFA. Birkhäuser, Boston (1997)CrossRefMATH
176.
Zurück zum Zitat Kurzhanski, A.B., Varaiya, P.: On the reachability problem under persistent disturbances. Dokl. Math. 61(3), 3809–3814 (2000)MathSciNet Kurzhanski, A.B., Varaiya, P.: On the reachability problem under persistent disturbances. Dokl. Math. 61(3), 3809–3814 (2000)MathSciNet
183.
224.
237.
Zurück zum Zitat Rockafellar, R.T.: Convex Analysis, 2nd edn. Princeton University Press, Princeton (1999) Rockafellar, R.T.: Convex Analysis, 2nd edn. Princeton University Press, Princeton (1999)
238.
Zurück zum Zitat Rockafellar, R.T., Wets, R.J.: Variational Analysis. Springer, Berlin (2005) Rockafellar, R.T., Wets, R.J.: Variational Analysis. Springer, Berlin (2005)
247.
Zurück zum Zitat Subbotin, A.I.: Generalized Solutions of First-Order PDE’s. The Dynamic Optimization Perspective. SCFA. Birkhäuser, Boston (1995)CrossRef Subbotin, A.I.: Generalized Solutions of First-Order PDE’s. The Dynamic Optimization Perspective. SCFA. Birkhäuser, Boston (1995)CrossRef
269.
Zurück zum Zitat Whittaker, E.T.: Analytical Dynamics. Dover, New York (1944)MATH Whittaker, E.T.: Analytical Dynamics. Dover, New York (1944)MATH
Metadaten
Titel
The Dynamic Programming Approach
verfasst von
Alexander B. Kurzhanski
Pravin Varaiya
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-10277-1_2