Skip to main content
Top
Published in: Journal of Computer and Systems Sciences International 2/2023

30-09-2023 | CONTROL IN STOCHASTIC SYSTEMS AND UNDER UNCERTAINTY

Operational Absolutely Optimal Dynamic Control of the Stochastic Differential Plant’s State by Its Output

Author: E. A. Rudenko

Published in: Journal of Computer and Systems Sciences International | Issue 2/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The problem of synthesizing the average-optimal control law for a dynamic plant subject to random disturbances, if its state variables are measured partially or with random errors, is considered. Using the method of a posteriori sufficient coordinates (SCs), the complexity of constructing the well-known interval-optimal Mortensen controller is described and a much simpler algorithm for finding its operational-optimal analog is obtained. The new controller does not require the solution of the corresponding Bellman equation in inverse time, since it is optimal in the sense of a time-varying criterion. This makes it possible to disregard information about the future behavior of the object and reduces the procedure for finding the dependence of a control on sufficient coordinates to direct-time integration of the Fokker–Planck–Kolmogorov equation and to solving a problem of parametric nonlinear programming. The application of the obtained algorithm is demonstrated by the example of a linear-quadratic-Gaussian problem, as a result of which a new operational version of the well-known separation theorem is formulated. It represents a stochastic control device as a combination of a linear Kalman–Bucy filter and a linear operational-optimal positional controller. The latter differs from the traditional interval-optimal controller by the well-known gain and does not require the solution of the corresponding matrix Riccati equation in inverse time.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference R. L. Stratonovich, “Toward the theory of optimal control. Sufficient coordinates,” Automation and Remote Control 23 (7), 910–917 (1962). R. L. Stratonovich, “Toward the theory of optimal control. Sufficient coordinates,” Automation and Remote Control 23 (7), 910–917 (1962).
2.
go back to reference R. E. Mortensen, “Stochastic optimal control with noisy observations,” Int. J. Control 4 (5), 455–466 (1966).MathSciNetCrossRef R. E. Mortensen, “Stochastic optimal control with noisy observations,” Int. J. Control 4 (5), 455–466 (1966).MathSciNetCrossRef
3.
go back to reference M. H. A. Davis and P. P. Varaiya, “Dynamic programming conditions for partially observable stochastic systems,” SIAM J. Control 11 (2), 226–262 (1973).MathSciNetCrossRef M. H. A. Davis and P. P. Varaiya, “Dynamic programming conditions for partially observable stochastic systems,” SIAM J. Control 11 (2), 226–262 (1973).MathSciNetCrossRef
4.
go back to reference Yu. I. Paraev, Introduction to Statistical Dynamics of Control and Filtering Processes (Sov. radio, Moscow, 1976) [in Russian]. Yu. I. Paraev, Introduction to Statistical Dynamics of Control and Filtering Processes (Sov. radio, Moscow, 1976) [in Russian].
5.
go back to reference V. E. Benes and I. Karatzas, “On the relation of Zakai’s and Mortensen’s equations,” SIAM J. Control Optim. 21 (3), 472–489 (1983).MathSciNetCrossRef V. E. Benes and I. Karatzas, “On the relation of Zakai’s and Mortensen’s equations,” SIAM J. Control Optim. 21 (3), 472–489 (1983).MathSciNetCrossRef
6.
go back to reference A. Bensoussan, Stochastic Control of Partially Observable Systems (Cambridge Univ. Press, Cambridge, 1992).CrossRef A. Bensoussan, Stochastic Control of Partially Observable Systems (Cambridge Univ. Press, Cambridge, 1992).CrossRef
7.
go back to reference E. A. Rudenko, “Operational-optimal finite-dimensional dynamic controller of the stochastic differential plant’s state according to its output: I. General nonlinear case,” J. Comput. Syst. Sci. Int. 61 (5), 724–740 (2022).MathSciNetCrossRef E. A. Rudenko, “Operational-optimal finite-dimensional dynamic controller of the stochastic differential plant’s state according to its output: I. General nonlinear case,” J. Comput. Syst. Sci. Int. 61 (5), 724–740 (2022).MathSciNetCrossRef
8.
9.
go back to reference V. S. Verba, V. I. Merkulov, and E. A. Rudenko, “Linear-cubic locally optimal control of linear systems and its application for aircraft guidance,” J. Comput. Syst. Sci. Int. 59 (5), 768–780 (2020).CrossRef V. S. Verba, V. I. Merkulov, and E. A. Rudenko, “Linear-cubic locally optimal control of linear systems and its application for aircraft guidance,” J. Comput. Syst. Sci. Int. 59 (5), 768–780 (2020).CrossRef
10.
go back to reference V. S. Pugachev and I. N. Sinitsyn, Stochastic Differential Systems: Analysis and Filtering (Nauka, Moscow, 1985) [in Russian]. V. S. Pugachev and I. N. Sinitsyn, Stochastic Differential Systems: Analysis and Filtering (Nauka, Moscow, 1985) [in Russian].
11.
go back to reference I. N. Sinitsyn, Kalman and Pugachev Filters (Logos, Moscow, 2007) [in Russian]. I. N. Sinitsyn, Kalman and Pugachev Filters (Logos, Moscow, 2007) [in Russian].
12.
go back to reference A. V. Panteleev, E. A. Rudenko, and A. S. Bortakovskii, Nonlinear Control Systems: Description, Analysis, and Synthesis (Vuzovskaya kniga, Moscow, 2008) [in Russian]. A. V. Panteleev, E. A. Rudenko, and A. S. Bortakovskii, Nonlinear Control Systems: Description, Analysis, and Synthesis (Vuzovskaya kniga, Moscow, 2008) [in Russian].
13.
go back to reference E. A. Rudenko, “Optimal structure of continuous nonlinear reduced-order Pugachev filter,” J. Comput. Syst. Sci. Int. 52 (6), 866–902 (2013).MathSciNetCrossRef E. A. Rudenko, “Optimal structure of continuous nonlinear reduced-order Pugachev filter,” J. Comput. Syst. Sci. Int. 52 (6), 866–902 (2013).MathSciNetCrossRef
14.
go back to reference A. N. Shiryaev, Probability (Nauka, Moscow, 1980) [in Russian]. A. N. Shiryaev, Probability (Nauka, Moscow, 1980) [in Russian].
15.
go back to reference K. Brammer and G. Siffling, Kalman-Bucy-Filter, Deterministische Beobachtung und Stochastische Filterung (R. Oldenbourg, München, 1975; Nauka, Moscow, 1982). K. Brammer and G. Siffling, Kalman-Bucy-Filter, Deterministische Beobachtung und Stochastische Filterung (R. Oldenbourg, München, 1975; Nauka, Moscow, 1982).
Metadata
Title
Operational Absolutely Optimal Dynamic Control of the Stochastic Differential Plant’s State by Its Output
Author
E. A. Rudenko
Publication date
30-09-2023
Publisher
Pleiades Publishing
Published in
Journal of Computer and Systems Sciences International / Issue 2/2023
Print ISSN: 1064-2307
Electronic ISSN: 1555-6530
DOI
https://doi.org/10.1134/S1064230723020168

Other articles of this Issue 2/2023

Journal of Computer and Systems Sciences International 2/2023 Go to the issue

Premium Partner