Skip to main content
SpringerLink
Log in

A numerical approach to the infinite horizon problem of deterministic control theory

  • Published:
Applied Mathematics and Optimization Submit manuscript

Abstract

We are concerned with the Hamilton-Jacobi equation related to the infinite horizon problem of deterministic control theory. Approximate solutions are constructed by means of a discretization in time as well as in the state variable and we prove that their rate of convergence to the viscosity solution is of order 1, provided a semiconcavity assumption is satisfied. A computational algorithm, originally due to R. Gonzales and E. Rofman, is adapted and reformulated for the problem at hand in order to obtain an error estimate for the numerical approximate solutions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Aubin JP, Cellina A (1984) Differential Inclusions. Springer-Verlag, Berlin, Heidelberg, New York

    Google Scholar 

  2. Capuzzo Dolcetta I (1983) On a discrete approximation of the Hamilton-Jacobi equation of dynamic programming. Appl Math Optim 10:367–377

    Google Scholar 

  3. Capuzzo Dolcetta I, Ishii H (1984) Approximate solutions of the Bellman equation of deterministic control theory. Appl Math Optim 11:161–181

    Google Scholar 

  4. Crandall MG, Lions PL (1983) Viscosity solutions of Hamilton-Jacobi equations. Trans Amer Math Soc 277:1–42

    Google Scholar 

  5. Crandall MG, Lions PL (1984) Two approximations of solutions of Hamilton-Jacobi equations. Math Comp 43:1–19

    Google Scholar 

  6. Crandall MG, Evans LC, Lions PL (1984) Some properties of viscosity solutions of Hamilton-Jacobi equations. Trans Amer Math Soc 282:487–502

    Google Scholar 

  7. Falcone M (1985) Numerical solution of deterministic continuous control problems. Proceedings of the International Symposium on Numerical Analysis, Madrid, September 1985

  8. Falcone M (1986) (forthcoming)

  9. Fleming WH, Rishel RW (1975) Deterministic and Stochastic Optimal Control. Springer-Verlag, Berlin, Heidelberg, New York

    Google Scholar 

  10. Glowinski R, Lions JL, Trémolières R (1976) Analyse Numerique des Inéquations Variationnelles, vols 1 and 2. Dunod, Paris

    Google Scholar 

  11. Gonzales R, Rofman E (1985) On deterministic control problems: an approximation procedure for the optimal cost, I and II. SIAM J Control Optim 23:242–285

    Google Scholar 

  12. Lions PL (1982) Generalized Solutions of Hamilton-Jacobi Equations. Pitman, London

    Google Scholar 

  13. Lions PL, Mercier B (1980) Approximation numerique des equations de Hamilton-Jacobi-Bellman. RAIRO Anal Numér 14:369–393

    Google Scholar 

  14. Quadrat JP (1975) Analyse Numerique de l'Equation de Bellman Stochastique. Rapport INRIA no 140

  15. Rofman E (1985) Approximation of Hamilton-Jacobi-Bellman equation in deterministic control theory. An application to energy production systems. In: Capuzzo Dolcetta I, Fleming WH, Zolezzi T (eds) Recent Mathematical Methods in Dynamic Programming. Lecture Notes in Mathematics 1119. Springer-Verlag, Berlin, Heidelberg, New York

    Google Scholar 

  16. Souganidis PE (1985) Approximation schemes for viscosity solutions of Hamilton-Jacobi equations. J. Differential Equations 59:1–43

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dipartimento di Matematica, Università di Roma, P. A. Moro, 2, 00185, Roma, Italy

    M. Falcone

Authors
  1. M. Falcone
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

Communicated by W. Fleming

This work has been partially supported by CNR-GNAFA.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Falcone, M. A numerical approach to the infinite horizon problem of deterministic control theory. Appl Math Optim 15, 1–13 (1987). https://doi.org/10.1007/BF01442644

Download citation

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01442644

Keywords

Search

Navigation