Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Cover of the book

2016 | OriginalPaper | Chapter

1. Introduction and Organization of the Book

Authors : Karl Hinderer, Ulrich Rieder, Michael Stieglitz

Published in: Dynamic Optimization

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this treatise we deal with optimization problems whose objective functions show a sequential structure and hence are amenable to sequential methods. The corresponding field mostly goes by the name Discrete-time Dynamic Programming. Other names are Discrete-time Stochastic Control and Multi-stage Optimization. In order to avoid possible confusion with programming in computer science we speak of Dynamic Optimization.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
next chapter The Stationary Deterministic Model and the Basic Solution Procedure
Literature
Altman, E. (1999). Constrained Markov decision processes (Stochastic Modeling). Boca Raton: Chapman & Hall/CRC.MATH
Bäuerle, N., & Rieder, U. (2011). Markov decision processes with applications to finance (Universitext). Heidelberg: Springer.CrossRefMATH
Bellman, R. (1957). Dynamic programming. Princeton: Princeton University Press.MATH
Bertsekas, D. P. (1975). Convergence of discretization procedures in dynamic programming. IEEE Transactions Automatic Control, AC-20, 415–419.MathSciNetCrossRefMATH
Bertsekas, D. P. (2001). Dynamic programming and optimal control (Vol. II, 2nd ed.). Belmont: Athena Scientific.MATH
Bertsekas, D. P. (2005). Dynamic programming and optimal control (Vol. I, 3rd ed.). Belmont: Athena Scientific.MATH
Bertsekas, D. P., & Shreve, S. E. (1979). Existence of optimal stationary policies in deterministic optimal control. Journal of Mathematical Analysis and Applications, 69, 607–620.MathSciNetCrossRefMATH
Chang, H. S., Fu, M. C., Hu, J., & Marcus, S. I. (2007). Simulation-based algorithms for Markov decision processes. London: Springer.CrossRefMATH
Dvoretzky, A., Kiefer, J., & Wolfowitz, J. (1952b). The inventory problem. II. Case of unknown distributions of demand. Econometrica, 20, 450–466.MathSciNetCrossRefMATH
Dynkin, E. B., & Yushkevich, A. A. (1979). Controlled Markov processes. Berlin: Springer.CrossRefMATH
Filar, J., & Vrieze, K. (1997). Competitive Markov decision processes. New York: Springer.MATH
Hernández-Lerma, O., & Lasserre, J. B. (1996). Discrete-time Markov control processes. New York: Springer.CrossRefMATH
Hernández-Lerma, O., & Lasserre, J. B. (1999). Further topics on discrete-time Markov control processes. New York: Springer.CrossRefMATH
Hinderer, K. (1970). Foundations of non-stationary dynamic programming with discrete time parameter (Lecture Notes in Operations Research and Mathematical Systems, Vol. 33). Berlin: Springer.CrossRefMATH
Hinderer, K., & Stieglitz, M. (1996). Increasing and Lipschitz continuous minimizers in one-dimensional linear-convex systems without constraints: The continuous and the discrete case. Mathematical Methods of Operations Research, 44, 189–204.MathSciNetCrossRefMATH
Howard, R. A. (1960). Dynamic programming and Markov processes. Cambridge: Technology Press of Massachusetts Institute of Technology.MATH
Maitra, A. P., & Sudderth, W. D. (1996). Discrete gambling and stochastic games. New York: Springer.CrossRefMATH
Puterman, M. L. (1994). Markov decision processes: Discrete stochastic dynamic programming. New York: Wiley.CrossRefMATH
Sennott, L. I. (1999). Stochastic dynamic programming and the control of queueing systems. New York: Wiley.MATH
Metadata
Title
Introduction and Organization of the Book
Authors
Karl Hinderer
Ulrich Rieder
Michael Stieglitz
Copyright Year
2016
Book
Dynamic Optimization

Print ISBN: 978-3-319-48813-4

Electronic ISBN: 978-3-319-48814-1

Copyright Year: 2016

DOI
https://doi.org/10.1007/978-3-319-48814-1_1