Skip to main content
Log in

Hybrid Solution Method for Dynamic Programming Equations for MDOF Stochastic Systems

  • Published:
Dynamics and Control

Abstract

An optimal control problem is considered for a multi-degree-of-freedom (MDOF) system, excited by a white-noise random force. The problem is to minimize the expected response energy by a given time instantT by applying a vector control force with given bounds on magnitudes of its components. This problem is governed by the Hamilton-Jacobi-Bellman, or HJB, partial differential equation. This equation has been studied previously [1] for the case of a single-degree-of-freedom system by developing a “hybrid” solution. Specifically, an exact analitycal solution has been obtained within a certain outer domain of the phase plane, which provides necessary boundary conditions for numerical solution within a bounded in velocity inner domain, thereby alleviating problem of numerical analysis for an unbounded domain. This hybrid approach is extended here to MDOF systems using common transformation to modal coordinates. The multidimensional HJB equation is solved explicitly for the corresponding outer domain, thereby reducing the problem to a set of numerical solutions within bounded inner domains. Thus, the problem of bounded optimal control is solved completely as long as the necessary modal control forces can be implemented in the actuators. If, however, the control forces can be applied to the original generalized coordinates only, the resulting optimal control law may become unfeasible. The reason is the nonlinearity in maximization operation for modal control forces, which may lead to violation of some constraints after inverse transformation to original coordinates. A semioptimal control law is illustrated for this case, based on projecting boundary points of the domain of the admissible transformed control forces onto boundaries of the domain of the original control forces. Case of a single control force is considered also, and similar solution to the HJB equation is derived.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bratus', A., Dimentberg, M. and Iourtchenko, D, “Optimal bounded response control for a second-order system under a white-noise excitation,” Journal of Vibration and Control, to appear.

  2. Boyd, S. and Barrat, C., Linear Controller Design: Limits of Performance, Prentice Hall, 1991.

  3. Bensoussan, A., Perturbation Methods in Optimal Control, John Wiley, 1988.

  4. Fleming, W. and Rishel, R., Deterministic and Stochastic Optimal Control, Springer-Verlag, 1975.

  5. Friedman, A., Stochastic Differential Equations and Applications, Academic Press, 1975.

  6. Strang, G., Linear Algebra and its Applications, Academic Press, 1976.

  7. Bryson, A. and Ho, Y-C., Applied Optimal Control, Optimization, Estimation and Control, John Wiley, 1975.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bratus, A., Dimentberg, M., Iourtchenko, D. et al. Hybrid Solution Method for Dynamic Programming Equations for MDOF Stochastic Systems. Dynamics and Control 10, 107–116 (2000). https://doi.org/10.1023/A:1008304230605

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008304230605

Navigation