Skip to main content
SpringerLink
Log in

Comparison principle for equations of the Hamilton-Jacobi type in control theory

  • Published:
Proceedings of the Steklov Institute of Mathematics Aims and scope Submit manuscript

Abstract

This paper deals with the comparison principle for the first-order ODEs of the Hamilton-Jacobi-Bellman and Hamilton-Jacobi-Bellman-Isaacs type which describe solutions to the problems of reachability and control synthesis under complete as well as under limited information on the system disturbances. Since the exact solutions require fairly complicated calculation, this paper presents the upper and lower bounds to these solutions, which in some cases may suffice for solving such problems as the investigation of safety zones in motion planning, verification of control strategies or of conditions for the nonintersection of reachability tubes, etc. For systems with original linear structure it is indicated that present among the suggested estimates are those of ellipsoidal type, which ensure tight approximations of the convex reachability sets as well as of the solvability sets for the problem of control synthesis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze, and E. F. Mishchenko, Mathematical Theory of Optimal Processes (Fizmatgiz, Moscow, 1961; Interscience, New York, 1962).

    Google Scholar 

  2. R. Bellman and R. Kalaba, Dynamic Programming and Modern Control Theory (London Math. Society Monographs, London, 1965).

    Google Scholar 

  3. N. N. Krasovskii and A. I. Subbotin, Game-Theoretical Control Problems (Springer-Verlag, Berlin, 1988).

    Google Scholar 

  4. Yu. S. Osipov and A. V. Kryazhimskii, Inverse Problem of Ordinary Differential Equations: Dynamic Solutions (Gordon and Breach, 1995).

  5. D. P. Bertsekas, Dynamic Programming and Optimal Control (Athena Scientific, Belmont, Mass., 1995), Vols. I, II.

    Google Scholar 

  6. A. B. Kurzhanski and P. Varaiya, J. Optim. Theory Appl., 108(2), 227 (2001).

    Article  MathSciNet  Google Scholar 

  7. R. Isaacs, Differential Games (Wiley, New York, 1965; Mir, Moscow, 1967).

    Google Scholar 

  8. T. Basar and P. Bernhard, H ∞-Optimal Control and Related Minimax Design Problems, 2nd ed. (Birkhäuser, Boston, 1995).

    Google Scholar 

  9. T. Basar and J. Olsder, Dynamic Noncooperative Game Theory (Academic Press, New York, 1982).

    Google Scholar 

  10. G. Leitmann, in Dynamic Systems and Microphysics, Ed. by A. Blaquière and G. Leitmann (Academic Press, New York, 1982), pp. 119–141.

    Google Scholar 

  11. N. N. Krasovskii, Game Problems on the Encounter of Motions (Nauka, Moscow, 1970) [in Russian].

    Google Scholar 

  12. E. B. Lee and L. Marcus, Foundations of Optimal Control Theory (Wiley, New York, 1967).

    Google Scholar 

  13. A. B. Kurzhanski, Control and Observation under Conditions of Uncertainty (Nauka, Moscow, 1977) [in Russian].

    Google Scholar 

  14. Yu. S. Osipov, Dokl. Akad. Nauk SSSR 223(6), 1314 (1975).

    MATH  MathSciNet  Google Scholar 

  15. A. B. Kurzhanski and P. Varaiya, SIAM J. Control Optim. 41(1), 181 (2002).

    Article  MATH  MathSciNet  Google Scholar 

  16. S. Osher and R. Fedkiw, Level Set Methods and Dynamic Implicit Surfaces (Springer, 2003), Ser. AMS, Vol. 153.

  17. J. A. Sethian, Level Set Methods and Fast Marching Methods, 2nd. ed. (Cambridge Univ. Press, 1999).

  18. L. Bensoussan and J-L. Lions, Contrôle Impulsionnel et Inequations Quasivariationnelles (Bordas, Paris, 1962).

    Google Scholar 

  19. F. H. Clarke, Yu. S. Ledyaev, R. J. Stern, and P. R. Wolenski, Nonsmooth Analysis and Control Theory (Springer-Verlag, 1998), Ser. GTM, Vol. 178.

  20. V. I. Gurman, The Extension Principle in Problems of Control (Fizmatlit, Moscow, 1997).

    Google Scholar 

  21. V. S. Patsko, S. G. Pyatko, and A. A. Fedotov, J. Comp. Syst. Sci. Intern. 42(3), 320 (2003).

    MathSciNet  Google Scholar 

  22. Kh. G. Guseinov, A. N. Moiseev, and V. N. Ushakov, Prikl. Mat. Mekh., No. 2, 179 (1998).

  23. M. G. Crandall, L. C. Evans, and P-L. Lions, Trans. Amer. Math. Soc. 282(2), 487 (1984).

    Article  MATH  MathSciNet  Google Scholar 

  24. W. H. Fleming and H. M. Soner, Controlled Markov Processes and Viscosity Solutions (Springer-Verlag, New York, 1993).

    Google Scholar 

  25. M. Bardi and I. Capuzzo-Dolcetta, Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations (Birkhäuser, Boston, 1997), Ser. SCFA.

    Google Scholar 

  26. A. I. Subbotin, Generalized Solutions of First-order PDE’s. The Dynamical Optimization Perspective (Birkhäuser, Boston, 1995), Ser. SCFA.

    Google Scholar 

  27. A. F. Filippov, Differential Equations with Discontinuous Righthand Sides (Dordrecht, 1988).

  28. A. B. Kurzhanski and I. Vályi, Ellipsoidal Calculus for Estimation and Control (Birkhäuser, Boston, 1997), Ser. SCFA.

    Google Scholar 

  29. P. Varaiya and A. B. Kurzhanski, in Contemporary Mathematics and Its Applications (Akademiya Nauk Gruzii, Institut Kibernetiki, Tbilisi, 2005), Vol. 23, pp. 34–72.

    Google Scholar 

  30. A. B. Kurzhanski and P. Varaiya, Dynamics Contin., Discrete, Impuls. Systems. Ser. B (Appl. Algorithms), 9(3), 347 (2002).

    MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Computational Mathematics and Cybernetics, Moscow State University, Moscow, Vorob’evy Gory, 119992, Russia

    A. B. Kurzhanski

Authors
  1. A. B. Kurzhanski
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

Published in Russian in Trudy Instituta Matematiki i Mekhaniki UrO RAN, 2006, Vol. 12, No. 1.

The article was translated by the author.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kurzhanski, A.B. Comparison principle for equations of the Hamilton-Jacobi type in control theory. Proc. Steklov Inst. Math. 253 (Suppl 1), S185–S195 (2006). https://doi.org/10.1134/S0081543806050130

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0081543806050130

Keywords

Search

Navigation