Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Cover of the book

2013 | OriginalPaper | Chapter

1. Introduction

Authors : Oswaldo L.V. Costa, Marcelo D. Fragoso, Marcos G. Todorov

Published in: Continuous-Time Markov Jump Linear Systems

Publisher: Springer Berlin Heidelberg

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recent advances in technology have led to dynamical systems with increasing complexity, which in turn demand for more and more efficient and reliable control systems. It has been widely recognized that the requirements of specific behaviors and stringent performances call for the inclusion of possible failure prevention in a modern control design. Therefore, either due to security reasons or efficiency necessity, a system failure is a critical issue that has to be considered in the design of a controller in modern technology. In view of this, dynamical systems that are subject to abrupt changes have been a theme of increasing investigation in recent years, and a variety of different approaches to analyze this class of systems has emerged over the last decades. A particularly interesting class of models within this framework is the so-called Markov jump linear systems (MJLS), which is the subject matter of this book. The goal of this first chapter is to highlight, in a rather informal way, some of the main characteristics of MJLS, through some illustrative examples of possible applications of this class of systems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
next chapter A Few Tools and Notations
Literature
1.
F. Abdollahi, K. Khorasani, A decentralized \(\mathcal{{H}}_{\infty}\) routing control strategy for mobile networked multi-agents, in Proceedings of the 2009 American Control Conference, St. Louis, USA, June 2009, pp. 1555–1560
2.
F. Abdollahi, K. Khorasani, A decentralized Markovian jump \(\mathcal{{H}}_{\infty}\) control routing strategy for mobile multi-agent networked systems. IEEE Transactions on Control Systems Technology 19, 269–283 (2011)
4.
H. Abou-Kandil, G. Freiling, V. Ionescu, G. Jank, Matrix Riccati Equations in Control and Systems Theory (Systems and Control: Foundations and Applications) (Birkhäuser, Basel, 2003)
5.
H. Abou-Kandil, G. Freiling, G. Jank, Solution and asymptotic behaviour of coupled Riccati equations in jump linear systems. IEEE Transactions on Automatic Control 39, 1631–1636 (1994) MathSciNetMATH
6.
H. Abou-Kandil, G. Freiling, G. Jank, On the solution of discrete-time Markovian jump linear quadratic control problems. Automatica 31, 765–768 (1995) MathSciNetMATH
8.
R. Akella, P.R. Kumar, Optimal control of production rate in a failure prone manufacturing system. IEEE Transactions on Automatic Control 31, 116–126 (1986) MathSciNetMATH
9.
S. Allam, F. Dufour, P. Bertrand, Discrete-time estimation of a Markov chain with marked point process observations. Application to Markovian jump filtering. IEEE Transactions on Automatic Control 46, 903–908 (2001) MathSciNetMATH
11.
P. Apkarian, R.J. Adams, Advanced gain-scheduling techniques for uncertain systems. IEEE Transactions on Control Systems Technology 6, 21–32 (1998)
12.
H. Arai, S. Tachi, Position control of a manipulator with passive joints using dynamic coupling. IEEE Transactions on Robotics and Automation 7, 528–534 (1991)
14.
M. Athans, Command and control (C2) theory: A challenge to control science. IEEE Transactions on Automatic Control 32, 286–293 (1987)
15.
R.E. Azouzi, M. Abbad, E. Altman, Perturbation of multivariable linear quadratic systems with jump parameters. IEEE Transactions on Automatic Control 46, 1666–1671 (2001) MATH
17.
J. Baczynski, M.D. Fragoso, Maximal versus strong solution of algebraic Riccati equations arising in infinite Markov jump linear systems. Systems & Control Letters 57, 246–254 (2008) MathSciNetMATH
18.
J. Baczynski, M.D. Fragoso, E.P. Lopes, On a discrete time linear jump stochastic dynamic game. International Journal of Systems Science 32, 979–988 (2001) MathSciNetMATH
20.
Y. Bar-Shalom, Tracking methods in a multitarget environment. IEEE Transactions on Automatic Control 23, 618–626 (1978) MATH
21.
Y. Bar-Shalom, K. Birmiwal, Variable dimension for maneuvering target tracking. IEEE Transactions on Automatic Control 18, 621–628 (1982)
22.
Y. Bar-Shalom, X.R. Li, Estimation and Tracking. Principles, Techniques, and Software. (Artech House, Norwood, 1993)
24.
K. Benjelloun, E.K. Boukas, Mean square stochastic stability of linear time-delay systems with Markovian jump parameters. IEEE Transactions on Automatic Control 43, 1456–1460 (1998) MathSciNetMATH
26.
F. Bernard, F. Dufour, P. Bertrand, On the JLQ problem with uncertainty. IEEE Transactions on Automatic Control 42, 869–872 (1997) MathSciNetMATH
28.
T. Bielecki, P.R. Kumar, Necessary and sufficient conditions for a zero inventory policy to be optimal in an unreliable manufacturing system, in Proceedings of the 25th IEEE Conference on Decision and Control, Athens, 1986, pp. 248–250
32.
W.P. Blair, D.D. Sworder, Continuous-time regulation of a class of econometric models. IEEE Transactions on Systems, Man and Cybernetics SMC-5, 341–346 (1975) MathSciNet
33.
W.P. Blair, D.D. Sworder, Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria. International Journal of Control 21, 833–844 (1975) MathSciNetMATH
35.
H.A.P. Blom, An efficient filter for abruptly changing systems, in Proceedings of the 23rd IEEE Conference on Decision and Control, Las Vegas, NV, 1984, pp. 656–658
36.
H.A.P. Blom, Continuous-discrete filtering for the systems with Markovian switching coefficients and simultaneous jump, in Proceedings of the 21st Asilomar Conference on Signals, Systems and Computers, Pacific Grove, 1987, pp. 244–248
37.
H.A.P. Blom, Y. Bar-Shalom, The interacting multiple model algorithm for systems with Markovian jumping parameters. IEEE Transactions on Automatic Control 33, 780–783 (1988) MATH
38.
S. Bohacek, E. Jonckheere, Nonlinear tracking over compact sets with linear dynamically varying H ∞ control. SIAM Journal on Control and Optimization 40, 1042–1071 (2001) MathSciNetMATH
39.
S. Bohacek, E.A. Jonckheere, Relationships between linear dynamically varying systems and jump linear systems. Mathematics of Control. Signals and Systems 16, 207–224 (2003) MathSciNetMATH
40.
E.K. Boukas, Stochastic Switching Systems: Analysis and Design (Birkhäuser, Basel, 2006)
41.
E.K. Boukas, Control of Singular Systems with Random Abrupt Changes (Springer, Berlin, 2008) MATH
42.
E.K. Boukas, K. Benjelloun, On stabilization of uncertain linear systems with jump parameters. International Journal of Control 72, 842–850 (2001) MathSciNet
43.
E.K. Boukas, A. Benzaouia, Stability of discrete-time linear systems with Markovian jumping parameters and constrained control. IEEE Transactions on Automatic Control 47, 516–521 (2002) MathSciNet
44.
E.K. Boukas, Z.K. Liu, Jump linear quadratic regulator with controlled jump rates. IEEE Transactions on Automatic Control 46, 301–305 (2001) MathSciNetMATH
45.
E.K. Boukas, Z.K. Liu, Robust H ∞-control of discrete-time Markovian jump linear systems with mode-dependent time-delays. IEEE Transactions on Automatic Control 46, 1918–1924 (2001) MathSciNetMATH
46.
E.K. Boukas, Z.K. Liu, G.X. Liu, Delay-dependent robust stability and H ∞-control of jump linear systems with time-delay. International Journal of Control 74, 329–340 (2001) MathSciNetMATH
47.
E.K. Boukas, P. Shi, H ∞-control for discrete-time linear systems with Markovian jump parameters, in Proceedings of the 36th IEEE Conference on Decision and Control, 1997, pp. 4143–4148
48.
E.K. Boukas, H. Yang, Stability of discrete-time linear systems with Markovian jumping parameters. Mathematics of Control. Signals and Systems 8, 390–402 (1995) MathSciNetMATH
52.
D.O. Cajueiro, Stochastic optimal control of jumping Markov parameter processes with applications to finance, PhD Thesis, Instituto Tecnológico de Aeronáutica—ITA, Brazil (2002)
55.
Y.Y. Cao, J. Lam, Robust H ∞ control of uncertain Markovian jump systems with time-delay. IEEE Transactions on Automatic Control 45, 77–83 (2000) MathSciNetMATH
57.
H. Chan, Ü. Özgüner, Optimal control of systems over a communication network with queues via a jump system approach, in Proceedings of the 4th IEEE Conference on Control Applications, Albany, NY, 1995, pp. 1148–1153
59.
H.J. Chizeck, Y. Ji, Optimal quadratic control of jump linear systems with Gaussian noise in discrete-time, in Proceedings of the 27th Conference on Decision and Control, 1988, pp. 1989–1992
60.
H.J. Chizeck, A.S. Willsky, D. Castañon, Discrete-time Markovian jump linear quadratic optimal control. International Journal of Control 43, 197–216 (1986)
61.
E.F. Costa, J.B.R. do Val, On the detectability and observability of discrete-time Markov jump linear systems. Systems & Control Letters 44, 135–145 (2001) MathSciNetMATH
63.
E.F. Costa, J.B.R. do Val, Weak detectability and the linear-quadratic control problem of discrete-time Markov jump linear systems. International Journal of Control 75, 1282–1292 (2002) MathSciNetMATH
65.
O.L.V. Costa, Linear minimum mean square error estimation for discrete-time Markovian jump linear systems. IEEE Transactions on Automatic Control 39, 1685–1689 (1994) MATH
66.
O.L.V. Costa, Discrete-time coupled Riccati equations for systems with Markov switching parameters. Journal of Mathematical Analysis and Applications 194, 197–216 (1995) MathSciNetMATH
67.
O.L.V. Costa, Mean square stabilizing solutions for discrete-time coupled algebraic Riccati equations. IEEE Transactions on Automatic Control 41, 593–598 (1996) MATH
69.
O.L.V. Costa, E.O. Assumpção, E.K. Boukas, R.P. Marques, Constrained quadratic state feedback control of discrete-time Markovian jump linear systems. Automatica 35, 617–626 (1999) MATH
70.
O.L.V. Costa, J.C.C. Aya, Monte-Carlo TD(λ)-methods for the optimal control of discrete-time Markovian jump linear systems. Automatica 38, 217–225 (2002) MathSciNetMATH
71.
O.L.V. Costa, E.K. Boukas, Necessary and sufficient conditions for robust stability and stabilizability of continuous-time linear systems with Markovian jumps. Journal of Optimization Theory and Applications 99, 359–379 (1998) MathSciNetMATH
73.
O.L.V. Costa, J.B.R. do Val, Full information H ∞-control for discrete-time infinite Markov jump parameter systems. Journal of Mathematical Analysis and Applications 202, 578–603 (1996) MathSciNetMATH
74.
O.L.V. Costa, J.B.R. do Val, Jump LQ-optimal control for discrete-time Markovian systems with l 2 stochastic inputs. Stochastic Analysis and Applications 16, 843–858 (1998) MathSciNetMATH
75.
O.L.V. Costa, J.B.R. do Val, J.C. Geromel, A convex programming approach to H 2-control of discrete-time Markovian jump linear systems. International Journal of Control 66, 557–579 (1997) MathSciNetMATH
77.
O.L.V. Costa, M.D. Fragoso, Stability results for discrete-time linear systems with Markovian jumping parameters. Journal of Mathematical Analysis and Applications 179, 154–178 (1993) MathSciNetMATH
78.
O.L.V. Costa, M.D. Fragoso, Discrete-time LQ-optimal control problems for infinite Markov jump parameter systems. IEEE Transactions on Automatic Control 40, 2076–2088 (1995) MathSciNetMATH
79.
O.L.V. Costa, M.D. Fragoso, Comments on stochastic stability of jump linear systems. IEEE Transactions on Automatic Control 49, 1414–1416 (2004) MathSciNet
80.
O.L.V. Costa, M.D. Fragoso, A separation principle for the H 2-control of continuous-time infinite Markov jump linear systems with partial observations. Journal of Mathematical Analysis and Applications 331, 97–120 (2007) MathSciNetMATH
81.
O.L.V. Costa, M.D. Fragoso, R.P. Marques, Discrete-Time Markov Jump Linear Systems (Springer, Berlin, 2004)
82.
O.L.V. Costa, M.D. Fragoso, M.G. Todorov, On the filtering problem for continuous-time Markov jump linear systems with no observation of the Markov chain. European Journal of Control 17, 339–354 (2011) MathSciNetMATH
83.
O.L.V. Costa, S. Guerra, Robust linear filtering for discrete-time hybrid Markov linear systems. International Journal of Control 75, 712–727 (2002) MathSciNetMATH
84.
O.L.V. Costa, S. Guerra, Stationary filter for linear minimum mean square error estimator of discrete-time Markovian jump systems. IEEE Transactions on Automatic Control 47, 1351–1356 (2002) MathSciNet
85.
O.L.V. Costa, R.P. Marques, Mixed H 2/H ∞-control of discrete-time Markovian jump linear systems. IEEE Transactions on Automatic Control 43, 95–100 (1998) MathSciNetMATH
87.
O.L.V. Costa, R.P. Marques, Robust H 2-control for discrete-time Markovian jump linear systems. International Journal of Control 73, 11–21 (2000) MathSciNetMATH
89.
O.L.V. Costa, E.F. Tuesta, Finite horizon quadratic optimal control and a separation principle for Markovian jump linear systems. IEEE Transactions on Automatic Control 48, 1836–1842 (2003) MathSciNet
90.
O.L.V. Costa, E.F. Tuesta, H 2-control and the separation principle for discrete-time Markovian jump linear systems. Mathematics of Control. Signals and Systems 16, 320–350 (2004) MathSciNetMATH
92.
J.J. Craig, Introduction to Robotics: Mechanics and Control (Addison-Wesley, Reading, 1986)
93.
A. Czornik, On Control Problems for Jump Linear Systems (Wydawnictwo Politechniki Śla̧skiej, Gliwice, 2003)
94.
A. Czornik, A. Swierniak, On the discrete JLQ and JLQG problems. Nonlinear Analysis 47, 423–434 (2001) MathSciNetMATH
101.
D.P. de Farias, J.C. Geromel, J.B.R. do Val, O.L.V. Costa, Output feedback control of Markov jump linear systems in continuous-time. IEEE Transactions on Automatic Control 45, 944–949 (2000) MATH
104.
C.E. de Souza, M.D. Fragoso, H ∞-control for linear systems with Markovian jumping parameters. Control, Theory and Advanced Technology 9, 457–466 (1993) MathSciNet
108.
J.B.R. do Val, T. Başar, Receding horizon control of jump linear systems and a macroeconomic policy problem. Journal of Economic Dynamics & Control 23, 1099–1131 (1999) MathSciNetMATH
111.
J.B.R. do Val, J.C. Geromel, A.P.C. Gonçalves, The H 2-control for jump linear systems: Cluster observations of the Markov state. Automatica 38, 343–349 (2002) MATH
114.
U. Doraszelski, K.L. Judd, Avoiding the curse of dimensionality in dynamic stochastic games. Quantitative Economics 3(1), 53–93 (2012) MathSciNet
118.
V. Dragan, T. Morozan, Stability and robust stabilization to linear stochastic systems described by differential equations with Markovian jumping and multiplicative white noise. Stochastic Analysis and Applications 20, 33–92 (2002) MathSciNetMATH
119.
V. Dragan, T. Morozan, The linear quadratic optimization for a class of linear stochastic systems with multiplicative white noise and Markovian jumping. IEEE Transactions on Automatic Control 49, 665–675 (2004) MathSciNet
120.
V. Dragan, T. Morozan, Stochastic H 2 optimal control for a class of linear systems with periodic coefficients. European Journal of Control 11, 619–631 (2005) MathSciNet
121.
V. Dragan, T. Morozan, A.M. Stoica, Mathematical Methods in Robust Control of Linear Stochastic Systems (Mathematical Concepts and Methods in Science and Engineering) (Springer, New York, 2010)
122.
V. Dragan, P. Shi, E.K. Boukas, Control of singularly perturbed systems with Markovian jump parameters: an H ∞ approach. Automatica 35, 1369–1378 (1999) MathSciNetMATH
124.
F. Dufour, P. Bertrand, An image based filter for discrete-time Markovian jump linear systems. Automatica 32, 241–247 (1996) MathSciNetMATH
125.
F. Dufour, R.J. Elliott, Adaptive control of linear systems with Markov perturbations. IEEE Transactions on Automatic Control 43, 351–372 (1998) MathSciNetMATH
126.
F. Dufour, R.J. Elliott, Filtering with discrete state observations. Applied Mathematics & Optimization 40, 259–272 (1999) MathSciNetMATH
127.
F. Dufour, D. Kannan, Discrete time nonlinear filtering with marked point process observations. Stochastic Analysis and Applications 17, 99–115 (1999) MathSciNetMATH
129.
E.O. Elliott, Estimates of error rates for codes on burst-error channels. Bell System Technical Journal 42, 1977–1997 (1963)
130.
R.J. Elliott, L. Aggoun, J.B. Moore, Hidden Markov Models: Estimation and Control (Springer, New York, 1995) MATH
132.
R.J. Elliott, F. Dufour, F. Sworder, Exact hybrid filters in discrete-time. IEEE Transactions on Automatic Control 41, 1807–1810 (1996) MathSciNetMATH
133.
J.S. Evans, R.J. Evans, Image-enhanced multiple model tracking. Automatica 35, 1769–1786 (1999) MATH
134.
M.H.C. Everdij, H.A.P. Blom, Embedding adaptive JLQG into LQ martingale control with a completely observable stochastic control matrix. IEEE Transactions on Automatic Control 41, 424–430 (1996) MathSciNetMATH
137.
X. Feng, K.A. Loparo, Y. Ji, H.J. Chizeck, Stochastic stability properties of jump linear systems. IEEE Transactions on Automatic Control 37, 38–53 (1992) MathSciNetMATH
141.
A.K. Fletcher, S. Rangan, V.K. Goyal, Estimation from lossy sensor data: Jump linear modeling and Kalman filtering, in Proc. Third Int. Symp. on Information Processing in Sensor Networks (IPSN), New York, NY, 2000, pp. 251–258
142.
J.J. Florentin, Optimal control of continuous-time Markov stochastic systems. Journal of Electronics and Control 10, 473–488 (1961) MathSciNet
143.
M.D. Fragoso, On a partially observable LQG problem for systems with Markovian jumping parameters. Systems & Control Letters 10, 349–356 (1988) MathSciNetMATH
144.
M.D. Fragoso, On a discrete-time jump LQG problem. International Journal of System Sciences 20, 2539–2545 (1989) MathSciNetMATH
145.
M.D. Fragoso, A small random perturbation analysis of a partially observable LQG problem with jumping parameter. IMA Journal of Mathematical Control and Information 7, 293–305 (1990) MathSciNetMATH
146.
M.D. Fragoso, J. Baczynski, Optimal control for continuous-time linear quadratic problems with infinite Markov jump parameters. SIAM Journal on Control and Optimization 40, 270–297 (2001) MathSciNetMATH
147.
M.D. Fragoso, J. Baczynski, Lyapunov coupled equations for continuous-time infinite Markov jump linear systems. Journal of Mathematical Analysis and Applications 274, 319–335 (2002) MathSciNetMATH
148.
M.D. Fragoso, J. Baczynski, Stochastic versus mean square stability in continuous-time linear infinite Markov jump parameters. Stochastic Analysis and Applications 20, 347–356 (2002) MathSciNetMATH
149.
M.D. Fragoso, J. Baczynski, On an infinite dimensional perturbed Riccati differential equation arising in stochastic control. Linear Algebra and Its Applications 406, 165–176 (2005) MathSciNetMATH
150.
M.D. Fragoso, O.L.V. Costa, A unified approach for mean square stability of continuous-time linear systems with Markovian jumping parameters and additive disturbances, in Proceedings of the 39th Conference on Decision and Control, Sydney, Australia, 2000, pp. 2361–2366
151.
M.D. Fragoso, O.L.V. Costa, Mean square stabilizability of continuous-time linear systems with partial information on the Markovian jumping parameters. Stochastic Analysis and Applications 22, 99–111 (2004) MathSciNetMATH
152.
M.D. Fragoso, O.L.V. Costa, A unified approach for stochastic and mean square stability of continuous-time linear systems with Markovian jumping parameters and additive disturbance. SIAM Journal on Control and Optimization 44, 1165–1191 (2005) MathSciNetMATH
153.
M.D. Fragoso, O.L.V. Costa, A separation principle for the continuous-time LQ-problem with Markovian jump parameters. IEEE Transactions on Automatic Control 55, 2692–2707 (2010) MathSciNet
155.
M.D. Fragoso, O.L.V. Costa, J. Baczynski, N. Rocha, Optimal linear mean square filter for continuous-time jump linear systems. IEEE Transactions on Automatic Control 50, 1364–1369 (2005) MathSciNet
156.
M.D. Fragoso, O.L.V. Costa, C.E. de Souza, A new approach to linearly perturbed Riccati equations arising in stochastic control. Applied Mathematics & Optimization 37, 99–126 (1998) MathSciNetMATH
158.
M.D. Fragoso, J.B.R. do Val, D.L. Pinto Jr., Jump linear H ∞-control: the discrete-time case. Control, Theory and Advanced Technology 10, 1459–1474 (1995) MathSciNet
159.
M.D. Fragoso, E.M. Hemerly, Optimal control for a class of noisy linear systems with Markovian jumping parameters and quadratic cost. International Journal of Systems Science 22, 2553–3561 (1991) MathSciNetMATH
160.
M.D. Fragoso, N. Rocha, Stationary filter for continuous-time Markovian jump linear systems. SIAM Journal on Control and Optimization 44, 801–815 (2005) MathSciNetMATH
164.
Z. Gajic, R. Losada, Monotonicity of algebraic Lyapunov iterations for optimal control of jump parameter linear systems. Systems & Control Letters 41, 175–181 (2000) MathSciNetMATH
165.
J. Gao, B. Huang, Z. Wang, LMI-based robust H ∞ control of uncertain linear jump systems with time-delay. Automatica 37, 1141–1146 (2001) MATH
167.
J.C. Geromel, A.P.C. Gonçalves, A.R. Fioravanti, Dynamic output feedback control of discrete-time Markov jump linear systems through linear matrix inequalities. SIAM Journal on Control and Optimization 48, 573–593 (2009) MathSciNetMATH
170.
L.E. Ghaoui, M.A. Rami, Robust state-feedback stabilization of jump linear systems via LMIs. International Journal of Robust and Nonlinear Control 6, 1015–1022 (1996) MathSciNetMATH
171.
M.K. Ghosh, A. Arapostathis, S.I. Marcus, A note on an LQG regulator with Markovian switching and pathwise average cost. IEEE Transactions on Automatic Control 40, 1919–1921 (1995) MathSciNetMATH
172.
E. Gilbert, Capacity of a burst-noise channel. Bell System Technical Journal 39, 1253–1265 (1960) MathSciNet
173.
A.P.C. Gonçalves, A.R. Fioravanti, J.C. Geromel, Markov jump linear systems and filtering through network transmitted measurements. Signal Processing 90, 2842–2850 (2010) MATH
174.
W.S. Gray, O. González, Modelling electromagnetic disturbances in closed-loop computer controlled flight systems, in Proceedings of the 1998 American Control Conference, Philadelphia, PA, 1998, pp. 359–364
175.
W.S. Gray, O.R. González, M. Doǧan, Stability analysis of digital linear flight controllers subject to electromagnetic disturbances. IEEE Transactions on Aerospace and Electronic Systems 36, 1204–1218 (2000)
176.
B.E. Griffiths, K.A. Loparo, Optimal control of jump linear quadratic Gaussian systems. International Journal of Control 42, 791–819 (1985) MathSciNetMATH
184.
T.-J. Ho, B.-S. Chen, Novel extended Viterbi-based multiple-model algorithms for state estimation of discrete-time systems with Markov jump parameters. IEEE Transactions on Signal Processing 54, 393–404 (2006)
186.
S. Hu, W.-Y. Yan, Stability robustness of networked control systems with respect to packet loss. Automatica 43, 1243–1248 (2007) MathSciNetMATH
187.
Y. Ji, H.J. Chizeck, Controllability, observability and discrete-time Markovian jump linear quadratic control. International Journal of Control 48, 481–498 (1988) MathSciNetMATH
188.
Y. Ji, H.J. Chizeck, Optimal quadratic control of jump linear systems with separately controlled transition probabilities. International Journal of Control 49, 481–491 (1989) MathSciNetMATH
189.
Y. Ji, H.J. Chizeck, Controllability, observability and continuous-time Markovian jump linear quadratic control. IEEE Transactions on Automatic Control 35, 777–788 (1990) MathSciNetMATH
190.
Y. Ji, H.J. Chizeck, Jump linear quadratic Gaussian control: steady state solution and testable conditions. Control, Theory and Advanced Technology 6, 289–319 (1990) MathSciNet
191.
Y. Ji, H.J. Chizeck, X. Feng, K.A. Loparo, Stability and control of discrete-time jump linear systems. Control, Theory and Advanced Technology 7, 247–270 (1991) MathSciNet
196.
I.I. Kats, N.N. Krasovskii, On the stability of systems with random parameters. Applied Mathematics and Mechanics 24, 1225–1246 (1960) MATH
197.
P.A. Kawka, A.G. Alleyne, Robust wireless servo control using a discrete-time uncertain Markovian jump linear model. IEEE Transactions on Control Systems Technology 17, 733–742 (2009)
198.
T. Kazangey, D.D. Sworder, Effective federal policies for regulating residential housing, in Proceedings of the Summer Computer Simulation Conference, 1971, pp. 1120–1128
200.
N.N. Krasovskii, E.A. Lidskii, Analytical design of controllers in systems with random attributes I. Automation and Remote Control 22, 1021–1025 (1961) MathSciNet
201.
N.N. Krasovskii, E.A. Lidskii, Analytical design of controllers in systems with random attributes II. Automation and Remote Control 22, 1141–1146 (1961) MathSciNet
202.
N.N. Krasovskii, E.A. Lidskii, Analytical design of controllers in systems with random attributes III. Automation and Remote Control 22, 1289–1294 (1961) MathSciNet
206.
L. Li, V.A. Ugrinovskii, R. Orsi, Decentralized robust control of uncertain Markov jump parameter systems via output feedback. Automatica 43, 1932–1944 (2007) MathSciNetMATH
208.
C. Lin, Z. Wang, F. Yang, Observer-based networked control for continuous-time systems with random sensor delays. Automatica 45, 578–584 (2009) MathSciNetMATH
209.
M. Liu, D.W.C. Ho, Y. Niu, Stabilization of Markovian jump linear systems over networks with random communication delay. Automatica 45, 416–421 (2009) MathSciNetMATH
210.
K.A. Loparo, Stochastic stability of coupled linear systems: A survey of methods and results. Stochastic Analysis and Applications 2, 193–228 (1984) MathSciNetMATH
211.
K.A. Loparo, F. Abdel-Malek, A probabilistic mechanism to dynamic power system security. IEEE Transactions on Circuits and Systems 37, 787–798 (1990)
212.
K.A. Loparo, G.L. Blankenship, A probabilistic mechanism for small disturbance instabilities in electric power systems. IEEE Transactions on Circuits and Systems 32, 177–184 (1985)
213.
K.A. Loparo, M.R. Buchner, K. Vasudeva, Leak detection in an experimental heat exchanger process: a multiple model approach. IEEE Transactions on Automatic Control 36, 167–177 (1991)
217.
M.S. Mahmoud, P. Shi, Robust Kalman filtering for continuous time-lag systems with Markovian jump parameters. IEEE Transactions on Circuits and Systems 50, 98–105 (2003) MathSciNet
218.
M.S. Mahmoud, P. Shi, Robust stability, stabilization and H ∞ control of time-delay systems with Markovian jump parameters. International Journal of Robust and Nonlinear Control 13, 755–784 (2003) MathSciNetMATH
219.
R. Malhamé, A jump-driven Markovian electric load model. Advances in Applied Probability 22, 564–586 (1990) MathSciNetMATH
220.
R. Malhamé, C.Y. Chong, Electric load model synthesis by diffusion approximation of a high-order hybrid-state stochastic system. IEEE Transactions on Automatic Control 30, 854–860 (1985) MATH
221.
M. Mariton, Almost sure and moments stability of jump linear systems. Systems & Control Letters 30, 1145–1147 (1985) MathSciNetMATH
222.
M. Mariton, On controllability of linear systems with stochastic jump parameters. IEEE Transactions on Automatic Control 31, 680–683 (1986) MathSciNetMATH
223.
M. Mariton, Jump Linear Systems in Automatic Control (Dekker, New York, 1990)
224.
M. Mariton, P. Bertrand, Output feedback for a class of linear systems with jump parameters. IEEE Transactions on Automatic Control 30, 898–900 (1985) MathSciNetMATH
225.
M. Mariton, P. Bertrand, Reliable flight control systems: Components placement and feedback synthesis, in Proceedings of the 10th IFAC World Congress, Munich, 1987, pp. 150–154
226.
N. Meskin, K. Khorasani, Fault detection and isolation of discrete-time Markovian jump linear systems with application to a network of multi-agent systems having imperfect communication channels. Automatica 45, 2032–2040 (2009) MathSciNetMATH
228.
R. Morales-Menéndez, N. de Freitas, D. Poole, Estimation and control of industrial processes with particle filters, in Proceedings of the 2003 American Control Conference, Denver, 2003, pp. 579–584
229.
T. Morozan, Optimal stationary control for dynamic systems with Markov perturbations. Stochastic Analysis and Applications 1, 299–325 (1983) MathSciNetMATH
230.
T. Morozan, Stabilization of some stochastic discrete-time control systems. Stochastic Analysis and Applications 1, 89–116 (1983) MathSciNetMATH
231.
T. Morozan, Stability and control for linear systems with jump Markov perturbations. Stochastic Analysis and Applications 13, 91–110 (1995) MathSciNetMATH
232.
A.S. Morse, Control Using Logic-based Switching (Springer, London, 1997) MATH
240.
B. Park, W.H. Kwon, Robust one-step receding horizon control of discrete-time Markovian jump uncertain systems. Automatica 38, 1229–1235 (2002) MathSciNetMATH
241.
S. Patilkulkarni, H. Herencia-Zapana, W.S. Gray, O.R. González, On the stability of jump-linear systems driven by finite-state machines with Markovian inputs, in Proceedings of the 2004 American Control Conference, 2004, pp. 2534–2539
243.
N.J. Ploplys, P.A. Kawka, A.G. Alleyne, Closed-loop control over wireless networks. IEEE Control Systems Magazine 24, 58–71 (2004)
244.
S. Primak, V. Kontorovich, V. Lyandres, Stochastic Methods and Their Applications to Communications (Wiley, Chichester, 2005)
245.
M. Ait Rami, L. El Ghaoui, Robust stabilization of jump linear systems using linear matrix inequalities, in IFAC Symposium on Robust Control Design, Rio de Janeiro, 1994, pp. 148–151
246.
M. Ait Rami, L. El Ghaoui, LMI optimization for nonstandard Riccati equations arising in stochastic control. IEEE Transactions on Automatic Control 41, 1666–1671 (1996) MathSciNetMATH
248.
V.G. Robinson, D.D. Sworder, A computational algorithm for design of regulators for linear jump parameter systems. IEEE Transactions on Automatic Control 18, 355–360 (1974) MathSciNet
249.
S. Roy, A. Saberi, Static decentralized control of a single-integrator network with Markovian sensing topology. Automatica 41, 1867–1877 (2005) MathSciNetMATH
252.
P.A. Samuelson, Interactions between the multiplier analysis and the principle of acceleration. Review of Economics and Statistics 21, 75–85 (1939)
253.
T. Sathyan, T. Kirubarajan, Markov-jump-system-based secure chaotic communication. IEEE Transactions on Circuits and Systems. I, Fundamental Theory and Applications 53, 1597–1609 (2006) MathSciNet
254.
P. Seiler, R. Sengupta, An H ∞ approach to networked control. IEEE Transactions on Automatic Control 50, 356–364 (2005) MathSciNet
256.
P. Shi, E.K. Boukas, H ∞ control for Markovian jumping linear systems with parametric uncertainty. Journal of Optimization Theory and Applications 95, 75–99 (1997) MathSciNetMATH
257.
P. Shi, E.K. Boukas, R.K. Agarwal, Control of Markovian jump discrete-time systems with norm bounded uncertainty and unknown delay. IEEE Transactions on Automatic Control 44, 2139–2144 (1999) MathSciNetMATH
258.
P. Shi, E.K. Boukas, R.K. Agarwal, Robust control for Markovian jumping discrete-time systems. International Journal of Systems Science 30, 787–797 (1999) MATH
261.
A.A.G. Siqueira, M.H. Terra, Nonlinear and Markovian \(\mathcal{H}_{\infty}\) controls of underactuated manipulators. IEEE Transactions on Control Systems Technology 12, 635–648 (2004)
262.
A.A.G. Siqueira, M.H. Terra, A fault-tolerant manipulator robot based on \(\mathcal{H}_{2}\), \(\mathcal{H}_{\infty}\), and mixed \(\mathcal{H}_{2}/\mathcal {H}_{\infty}\) Markovian controls. IEEE/ASME Transactions on Mechatronics 14, 257–263 (2009)
263.
A.A.G. Siqueira, M.H. Terra, C. Buosi, Fault-tolerant robot manipulators based on output-feedback \(\mathcal{{H}}_{\infty}\) controllers. Robotics and Autonomous Systems 55, 785–794 (2007)
266.
A. Stoica, I. Yaesh, Jump-Markovian based control of wing deployment for an uncrewed air vehicle. Journal of Guidance, Control, and Dynamics 25, 407–411 (2002)
268.
L.E.O. Svensson, N. Williams, Optimal monetary policy under uncertainty: A Markov jump-linear-quadratic approach. Federal Reserve of St. Louis Review 90, 275–293 (2008)
269.
D.D. Sworder, On the stochastic maximum principle. Journal of Mathematical Analysis and Applications 24, 627–640 (1968) MathSciNetMATH
270.
D.D. Sworder, Feedback control of a class of linear systems with jump parameters. IEEE Transactions on Automatic Control 14, 9–14 (1969) MathSciNet
271.
D.D. Sworder, J.E. Boyd, Estimation Problems in Hybrid Systems (Cambridge University Press, London, 1999)
273.
D.D. Sworder, V.G. Robinson, Bayes’ controllers with memory for a linear systems with jump parameters. IEEE Transactions on Automatic Control 17, 118–121 (1972)
274.
D.D. Sworder, V.G. Robinson, Feedback regulators for jump parameter systems with state and control dependent transition rates. IEEE Transactions on Automatic Control 19, 47–49 (1973) MathSciNet
275.
D.D. Sworder, R.O. Rogers, An LQG solution to a control problem with solar thermal receiver. IEEE Transactions on Automatic Control 28, 971–978 (1983)
278.
M.G. Todorov, M.D. Fragoso, Infinite Markov jump-bounded real lemma. Systems & Control Letters 57, 64–70 (2008) MathSciNetMATH
279.
M.G. Todorov, M.D. Fragoso, Output feedback H ∞ control of continuous-time infinite Markovian jump linear systems via LMI methods. SIAM Journal on Control and Optimization 47, 950–974 (2008) MathSciNetMATH
282.
M.G. Todorov, M.D. Fragoso, On the stability radii of continuous-time infinite Markov jump linear systems. Mathematics of Control. Signals and Systems 22, 23–38 (2010) MathSciNetMATH
284.
M.G. Todorov, M.D. Fragoso, On the robust stability, stabilization, and stability radii of continuous-time infinite Markov jump linear systems. SIAM Journal on Control and Optimization 49, 1171–1196 (2011) MathSciNetMATH
286.
P.N.V. Tu, Dynamical Systems: An Introduction with Applications in Economics and Biology, 2nd edn. (Springer, Berlin, 1994) MATH
287.
J.K. Tugnait, Adaptive estimation and identification for discrete systems with Markov jump parameters. IEEE Transactions on Automatic Control 27, 1054–1064 (1982) MathSciNetMATH
288.
J.K. Tugnait, Detection and estimation for abruptly changing systems. Automatica 18, 607–615 (1982) MATH
290.
V.A. Ugrinovskii, Randomized algorithms for robust stability and guaranteed cost control of stochastic jump parameter systems with uncertain switching policies. Journal of Optimization Theory and Applications 124, 227–245 (2005) MathSciNetMATH
291.
V.A. Ugrinovskii, H.R. Pota, Decentralized control of power systems via robust control of uncertain Markov jump parameter systems. International Journal of Control 78, 662–677 (2005) MathSciNetMATH
297.
Z. Wang, H. Qiao, K.J. Burnham, On stabilization of bilinear uncertain time-delay stochastic systems with Markovian jumping parameters. IEEE Transactions on Automatic Control 47, 640–646 (2002) MathSciNet
299.
F.H. Westerhoff, Samuelson’s multiplier–accelerator model revisited. Applied Economics Letters 13, 89–92 (2006)
303.
W.M. Wonham, Random differential equations in control theory, in Probabilistic Methods in Applied Mathematics, vol. 2, ed. by A.T. Bharucha-Reid (Academic Press, San Diego, 1970), pp. 131–212
305.
J. Xiong, J. Lam, Robust H 2 control of Markovian jump systems with uncertain switching probabilities. International Journal of Systems Science 40, 255–265 (2009) MathSciNetMATH
306.
J. Xiong, J. Lam, H. Gao, D.W.C. Ho, On robust stabilization of Markovian jump systems with uncertain switching probabilities. Automatica 41, 897–903 (2005) MathSciNetMATH
307.
C. Yang, P. Bertrand, M. Mariton, Adaptive control in the presence of Markovian parameter jumps. International Journal of Control 52, 473–484 (1990) MATH
309.
G. Yin, Q. Zhang, Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach (Springer, New York, 1998) MATH
316.
L. Zhang, E.K. Boukas, Stability and stabilization of Markovian jump linear systems with partly unknown transition probabilities. Automatica 45, 463–468 (2005) MathSciNet
317.
L. Zhang, E.K. Boukas, H ∞ control for discrete-time Markovian jump linear systems with partly unknown transition probabilities. International Journal of Robust and Nonlinear Control 19, 868–883 (2009) MathSciNetMATH
318.
L. Zhang, E.K. Boukas, J. Lam, Analysis and synthesis of Markov jump linear systems with time-varying delays and partially known transition probabilities. IEEE Transactions on Automatic Control 53, 2458–2464 (2009) MathSciNetMATH
319.
L. Zhang, E.K. Boukas, P. Shi, H ∞ model reduction for discrete-time Markov jump linear systems with partially known transition probabilities. International Journal of Control 82, 343–351 (2009) MathSciNetMATH
321.
Q. Zhang, Optimal filtering of discrete-time hybrid systems. Journal of Optimization Theory and Applications 100, 123–144 (1999) MathSciNetMATH
322.
Q. Zhang, Hybrid filtering for linear systems with non-Gaussian disturbances. IEEE Transactions on Automatic Control 45, 50–61 (2000) MATH
323.
Q. Zhang, S.A. Kassam, Finite-state Markov model for Rayleigh fading channels. IEEE Transactions on Communications 47, 1688–1692 (1999)
Metadata
Title
Introduction
Authors
Oswaldo L.V. Costa
Marcelo D. Fragoso
Marcos G. Todorov
Copyright Year
2013
Publisher
Springer Berlin Heidelberg
Book
Continuous-Time Markov Jump Linear Systems

Print ISBN: 978-3-642-34099-4

Electronic ISBN: 978-3-642-34100-7

Copyright Year: 2013

DOI
https://doi.org/10.1007/978-3-642-34100-7_1