Skip to main content

2019 | OriginalPaper | Buchkapitel

Probing and Duality in Stochastic Model Predictive Control

verfasst von : Martin A. Sehr, Robert R. Bitmead

Erschienen in: Handbook of Model Predictive Control

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In a general nonlinear setting, stochastic optimal control involves the propagation of the conditional probability density of the state given the input signal and output measurements. This density is known as the information state in control circles and as the belief state in artificial intelligence and robotics squares. The choice of control signal affects the information state so that state observability becomes control-dependent. Thus, the feedback control law needs to include aspects of probing in addition to, or more accurately in competition with, its function in regulation. This is called duality of the control. In the linear case, this connection is not problematic since the control signal simply translates or recenters the conditional density without other effect. But for nonlinear systems, this complication renders all but the simplest optimal control problems computationally intractable.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Here γ is the target signal-to-noise ratio for a given bit-error rate [21].
 
Literatur
1.
Zurück zum Zitat Allison, B., Ciarniello, J., Tessier, P., Dumont, G.: Dual adaptive control of chip refiner motor load. Automatica 31(8), 1169–1184 (1995)MathSciNetCrossRef Allison, B., Ciarniello, J., Tessier, P., Dumont, G.: Dual adaptive control of chip refiner motor load. Automatica 31(8), 1169–1184 (1995)MathSciNetCrossRef
2.
Zurück zum Zitat Anderson, B., Johnson, Jr., C.: Exponential convergence of adaptive identification and control algorithms. Automatica 18(1), 1–13 (1982)MathSciNetCrossRef Anderson, B., Johnson, Jr., C.: Exponential convergence of adaptive identification and control algorithms. Automatica 18(1), 1–13 (1982)MathSciNetCrossRef
3.
Zurück zum Zitat Bitmead, R., Gevers, M.: Riccati difference and differential equations: convergence, monotonicity and stability. In: Bittanti, S., Laub, A., Willems, J. (eds.) The Riccati Equation, Communications and Control Engineering, pp. 263–291. Springer, New York (1991)CrossRef Bitmead, R., Gevers, M.: Riccati difference and differential equations: convergence, monotonicity and stability. In: Bittanti, S., Laub, A., Willems, J. (eds.) The Riccati Equation, Communications and Control Engineering, pp. 263–291. Springer, New York (1991)CrossRef
4.
Zurück zum Zitat Bitmead, R., Gevers, M., Wertz, V.: Adaptive Optimal Control: The Thinking Man’s GPC. Series in Systems and Control Engineering. Prentice Hall, Englewood Cliffs (1990) Bitmead, R., Gevers, M., Wertz, V.: Adaptive Optimal Control: The Thinking Man’s GPC. Series in Systems and Control Engineering. Prentice Hall, Englewood Cliffs (1990)
5.
Zurück zum Zitat Blackmore, L., Ono, M., Bektassov, A., Williams, B.C.: A probabilistic particle-control approximation of chance-constrained stochastic predictive control. IEEE Trans. Robot. 26(3), 502–517 (2010)CrossRef Blackmore, L., Ono, M., Bektassov, A., Williams, B.C.: A probabilistic particle-control approximation of chance-constrained stochastic predictive control. IEEE Trans. Robot. 26(3), 502–517 (2010)CrossRef
6.
Zurück zum Zitat Cover, T., Thomas, J.: Elements of Information Theory. Wiley, New York (2006)MATH Cover, T., Thomas, J.: Elements of Information Theory. Wiley, New York (2006)MATH
7.
Zurück zum Zitat Doucet, A., de Freitas, J., Gordon, N.: Sequential Monte Carlo Methods in Practice. Springer, New York (2001)CrossRef Doucet, A., de Freitas, J., Gordon, N.: Sequential Monte Carlo Methods in Practice. Springer, New York (2001)CrossRef
8.
Zurück zum Zitat Filatov, N., Unbehauen, H.: Adaptive Dual Control. Springer, New York (2004)CrossRef Filatov, N., Unbehauen, H.: Adaptive Dual Control. Springer, New York (2004)CrossRef
9.
Zurück zum Zitat Filatov, N.M., Unbehauen, H.: Survey of adaptive dual control methods. IEE Proc. Control Theory Appl. 147, 118–128 (2000)CrossRef Filatov, N.M., Unbehauen, H.: Survey of adaptive dual control methods. IEE Proc. Control Theory Appl. 147, 118–128 (2000)CrossRef
10.
Zurück zum Zitat Genceli, H., Nikolaou, M.: New approach to constrained predictive control with simultaneous model identification. AIChE J. 42(10), 2857–2868 (1996)MathSciNetCrossRef Genceli, H., Nikolaou, M.: New approach to constrained predictive control with simultaneous model identification. AIChE J. 42(10), 2857–2868 (1996)MathSciNetCrossRef
11.
Zurück zum Zitat Goodwin, G., Payne, R.: Dynamic System Identification: Experiment Design and Data Analysis. Academic, New York (1977)MATH Goodwin, G., Payne, R.: Dynamic System Identification: Experiment Design and Data Analysis. Academic, New York (1977)MATH
12.
Zurück zum Zitat Goodwin, C.G., Sin, K.S.: Adaptive Filtering Prediction and Control. Prentice-Hall, Englewood Cliffs (1984)MATH Goodwin, C.G., Sin, K.S.: Adaptive Filtering Prediction and Control. Prentice-Hall, Englewood Cliffs (1984)MATH
13.
Zurück zum Zitat Goodwin, G.C., Kong, H., Mirzaeva, G., Seron, M.M.: Robust model predictive control: reflections and opportunities. J. Control Decis. 1(2), 115–148 (2014)CrossRef Goodwin, G.C., Kong, H., Mirzaeva, G., Seron, M.M.: Robust model predictive control: reflections and opportunities. J. Control Decis. 1(2), 115–148 (2014)CrossRef
14.
Zurück zum Zitat Green, M., Moore, J.: Persistence of excitation in linear systems. Syst. Control Lett. 7, 351–360 (1986)CrossRef Green, M., Moore, J.: Persistence of excitation in linear systems. Syst. Control Lett. 7, 351–360 (1986)CrossRef
15.
Zurück zum Zitat Ha, M.H., Bitmead, R.: Optimal dual adaptive agile mobile wireless power control. Automatica 74, 84–89 (2016)MathSciNetCrossRef Ha, M.H., Bitmead, R.: Optimal dual adaptive agile mobile wireless power control. Automatica 74, 84–89 (2016)MathSciNetCrossRef
16.
Zurück zum Zitat Hayashi, F.: Econometrics. Princeton University Press, Princeton, NJ (2000)MATH Hayashi, F.: Econometrics. Princeton University Press, Princeton, NJ (2000)MATH
17.
Zurück zum Zitat Ismail, A., Dumont, G.: Dual adaptive control of paper coating. IEEE Trans. Control Syst. Technol. 11(3), 289–309 (2003)CrossRef Ismail, A., Dumont, G.: Dual adaptive control of paper coating. IEEE Trans. Control Syst. Technol. 11(3), 289–309 (2003)CrossRef
18.
Zurück zum Zitat Keerthi, S., Gilbert, E.: Optimal, infinite horizon feedback laws for a general class of constrained discrete time systems: stability and moving horizon approximations. J. Optim. Theory Appl. 57, 265–293 (1988)MathSciNetCrossRef Keerthi, S., Gilbert, E.: Optimal, infinite horizon feedback laws for a general class of constrained discrete time systems: stability and moving horizon approximations. J. Optim. Theory Appl. 57, 265–293 (1988)MathSciNetCrossRef
19.
Zurück zum Zitat Kouvaritakis, B., Cannon, M.: Model Predictive Control. Springer, Cham (2016)CrossRef Kouvaritakis, B., Cannon, M.: Model Predictive Control. Springer, Cham (2016)CrossRef
20.
Zurück zum Zitat Kumar, P.R., Varaiya, P.: Stochastic Systems: Estimation, Identification, and Adaptive Control. Prentice-Hall, Englewood Cliffs (1986)MATH Kumar, P.R., Varaiya, P.: Stochastic Systems: Estimation, Identification, and Adaptive Control. Prentice-Hall, Englewood Cliffs (1986)MATH
21.
Zurück zum Zitat Lee, E.A., Messerschmitt, D.G.: Digital Communication, 2nd edn. Kluwer Academic, Boston (1990) Lee, E.A., Messerschmitt, D.G.: Digital Communication, 2nd edn. Kluwer Academic, Boston (1990)
22.
Zurück zum Zitat Li, Y., Leith, D., Shorten, R.: Experimental evaluation of TCP protocols for high-speed networks. IEEE-ACM Trans. Netw. 15, 1109–1122 (2007)CrossRef Li, Y., Leith, D., Shorten, R.: Experimental evaluation of TCP protocols for high-speed networks. IEEE-ACM Trans. Netw. 15, 1109–1122 (2007)CrossRef
23.
Zurück zum Zitat Liu, A., Bitmead, R.: Stochastic observability in network state estimation and control. Automatica 47, 65–78 (2011)MathSciNetCrossRef Liu, A., Bitmead, R.: Stochastic observability in network state estimation and control. Automatica 47, 65–78 (2011)MathSciNetCrossRef
24.
Zurück zum Zitat Marafioti, G., Bitmead, R., Hovd, M.: Persistently exciting model predictive control. Int. J. Adapt. Control Signal Process. 28, 536–552 (2014)MathSciNetCrossRef Marafioti, G., Bitmead, R., Hovd, M.: Persistently exciting model predictive control. Int. J. Adapt. Control Signal Process. 28, 536–552 (2014)MathSciNetCrossRef
25.
Zurück zum Zitat Mayne, D.Q.: Model predictive control: recent developments and future promise. Automatica 50(12), 2967–2986 (2014)MathSciNetCrossRef Mayne, D.Q.: Model predictive control: recent developments and future promise. Automatica 50(12), 2967–2986 (2014)MathSciNetCrossRef
26.
Zurück zum Zitat Mayne, D.Q., Raković, S.V., Findeisen, R., Allgöwer, F.: Robust output feedback model predictive control of constrained linear systems: time varying case. Automatica 45(9), 2082–2087 (2009)MathSciNetCrossRef Mayne, D.Q., Raković, S.V., Findeisen, R., Allgöwer, F.: Robust output feedback model predictive control of constrained linear systems: time varying case. Automatica 45(9), 2082–2087 (2009)MathSciNetCrossRef
27.
Zurück zum Zitat Mesbah, A.: Stochastic model predictive control: an overview and perspectives for future research. IEEE Control System 36(6), 30–44 (2016)MathSciNetCrossRef Mesbah, A.: Stochastic model predictive control: an overview and perspectives for future research. IEEE Control System 36(6), 30–44 (2016)MathSciNetCrossRef
28.
Zurück zum Zitat Schwarm, A.T., Nikolaou, M.: Chance-constrained model predictive control. AIChE J. 45(8), 1743–1752 (1999)CrossRef Schwarm, A.T., Nikolaou, M.: Chance-constrained model predictive control. AIChE J. 45(8), 1743–1752 (1999)CrossRef
29.
30.
Zurück zum Zitat Sehr, M.A., Bitmead, R.R.: Sumptus cohiberi: the cost of constraints in MPC with state estimates. In: American Control Conference, pp. 901–906, Boston (2016) Sehr, M.A., Bitmead, R.R.: Sumptus cohiberi: the cost of constraints in MPC with state estimates. In: American Control Conference, pp. 901–906, Boston (2016)
31.
Zurück zum Zitat Sehr, M.A., Bitmead, R.R.: Particle model predictive control: tractable stochastic nonlinear output-feedback MPC. In: Proceedings of IFAC World Congress, Toulouse (2017) Sehr, M.A., Bitmead, R.R.: Particle model predictive control: tractable stochastic nonlinear output-feedback MPC. In: Proceedings of IFAC World Congress, Toulouse (2017)
32.
Zurück zum Zitat Sehr, M.A., Bitmead, R.R.: Tractable dual optimal stochastic model predictive control: an example in healthcare. In: Proceedings 1st IEEE Conference on Control Technology and Applications, Kohala Coast (2017) Sehr, M.A., Bitmead, R.R.: Tractable dual optimal stochastic model predictive control: an example in healthcare. In: Proceedings 1st IEEE Conference on Control Technology and Applications, Kohala Coast (2017)
33.
Zurück zum Zitat Sehr, M.A., Bitmead, R.R.: Performance of model predictive control of POMDPs. In: Proceedings of 17th European Control Conference, Limassol Cyprus (2018) Sehr, M.A., Bitmead, R.R.: Performance of model predictive control of POMDPs. In: Proceedings of 17th European Control Conference, Limassol Cyprus (2018)
34.
Zurück zum Zitat Simon, D.: Optimal State Estimation: Kalman, H∞, and Nonlinear Approaches. Wiley, Hoboken (2006)CrossRef Simon, D.: Optimal State Estimation: Kalman, H, and Nonlinear Approaches. Wiley, Hoboken (2006)CrossRef
35.
Zurück zum Zitat Steele, R.: Mobile Radio Communications. IEEE Press, Piscataway (1992) Steele, R.: Mobile Radio Communications. IEEE Press, Piscataway (1992)
36.
Zurück zum Zitat Sui, D., Feng, L., Hovd, M.: Robust output feedback model predictive control for linear systems via moving horizon estimation. In: American Control Conference, pp. 453–458, Seattle (2008) Sui, D., Feng, L., Hovd, M.: Robust output feedback model predictive control for linear systems via moving horizon estimation. In: American Control Conference, pp. 453–458, Seattle (2008)
37.
Zurück zum Zitat Sunberg, Z., Chakravorty, S., Erwin, R.S.: Information space receding horizon control. IEEE Trans. Cybern. 43(6), 2255–2260 (2013)CrossRef Sunberg, Z., Chakravorty, S., Erwin, R.S.: Information space receding horizon control. IEEE Trans. Cybern. 43(6), 2255–2260 (2013)CrossRef
38.
Zurück zum Zitat Willems, J., Rapisarda, P., Markovsky, I., De Moor, B.: A note on persistency of excitation. Syst. Control Lett. 54(4), 325–329 (2005)MathSciNetCrossRef Willems, J., Rapisarda, P., Markovsky, I., De Moor, B.: A note on persistency of excitation. Syst. Control Lett. 54(4), 325–329 (2005)MathSciNetCrossRef
39.
Zurück zum Zitat Yan, J., Bitmead, R.R.: Incorporating state estimation into model predictive control and its application to network traffic control. Automatica 41(4), 595–604 (2005)MathSciNetCrossRef Yan, J., Bitmead, R.R.: Incorporating state estimation into model predictive control and its application to network traffic control. Automatica 41(4), 595–604 (2005)MathSciNetCrossRef
Metadaten
Titel
Probing and Duality in Stochastic Model Predictive Control
verfasst von
Martin A. Sehr
Robert R. Bitmead
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-319-77489-3_6

Neuer Inhalt