Skip to main content
Top

2013 | OriginalPaper | Chapter

3. Optimal Tracking Control for Discrete-Time Systems

Authors : Huaguang Zhang, Derong Liu, Yanhong Luo, Ding Wang

Published in: Adaptive Dynamic Programming for Control

Publisher: Springer London

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The aim of this chapter is to present some direct methods for solving the closed-loop optimal tracking control problem for discrete-time systems. Considering the fact that the performance index functions of optimal tracking control problems are quite different from those of optimal state feedback control problems, a new type of performance index function is defined. The methods are mainly based on the iterative HDP and GDHP algorithms. We first study the optimal tracking control problem of affine nonlinear systems, and after that we study the optimal tracking control problem of nonaffine nonlinear systems. It is noticed that most real-world systems need to be effectively controlled within a finite time horizon. Hence, based on the above results, we will further study the finite-horizon optimal tracking control problem, using the ADP approach in the last part of this chapter.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aganovic Z, Gajic Z (1994) The successive approximation procedure for finite-time optimal control of bilinear systems. IEEE Trans Autom Control 39:1932–1935 MathSciNetMATHCrossRef Aganovic Z, Gajic Z (1994) The successive approximation procedure for finite-time optimal control of bilinear systems. IEEE Trans Autom Control 39:1932–1935 MathSciNetMATHCrossRef
2.
go back to reference Cimen T, Banks SP (2004) Nonlinear optimal tracking control with application to super-tankers for autopilot design. Automatica 40:1845–1863 MathSciNetMATHCrossRef Cimen T, Banks SP (2004) Nonlinear optimal tracking control with application to super-tankers for autopilot design. Automatica 40:1845–1863 MathSciNetMATHCrossRef
3.
go back to reference Cui LL, Zhang HG, Chen B, Zhang QL (2010) Asymptotic tracking control scheme for mechanical systems with external disturbances and friction. Neurocomputing 73:1293–1302 CrossRef Cui LL, Zhang HG, Chen B, Zhang QL (2010) Asymptotic tracking control scheme for mechanical systems with external disturbances and friction. Neurocomputing 73:1293–1302 CrossRef
4.
go back to reference Devasiad S, Chen D, Paden B (1996) Nonlinear inversion-based output tracking. IEEE Trans Autom Control 41:930–942 CrossRef Devasiad S, Chen D, Paden B (1996) Nonlinear inversion-based output tracking. IEEE Trans Autom Control 41:930–942 CrossRef
5.
go back to reference Dierks T, Jagannathan S (2009) Optimal tracking control of affine nonlinear discrete-time systems with unknown internal dynamics. In: Proceedings of joint 48th IEEE conference on decision and control and 28th Chinese control conference, Shanghai, China, pp 6750–6755 Dierks T, Jagannathan S (2009) Optimal tracking control of affine nonlinear discrete-time systems with unknown internal dynamics. In: Proceedings of joint 48th IEEE conference on decision and control and 28th Chinese control conference, Shanghai, China, pp 6750–6755
6.
go back to reference Enns R, Si J (2003) Helicopter trimming and tracking control using direct neural dynamic programming. IEEE Trans Neural Netw 14:929–939 CrossRef Enns R, Si J (2003) Helicopter trimming and tracking control using direct neural dynamic programming. IEEE Trans Neural Netw 14:929–939 CrossRef
7.
go back to reference Gao D, Tang G, Zhang B (2006) Approximate optimal tracking control for a class of nonlinear systems with disturbances. In: Proceedings of 6th world congress on intelligent control and automation, Dalian, China, pp 521–525 Gao D, Tang G, Zhang B (2006) Approximate optimal tracking control for a class of nonlinear systems with disturbances. In: Proceedings of 6th world congress on intelligent control and automation, Dalian, China, pp 521–525
10.
go back to reference Lewis FL, Syrmos VL (1995) Optimal control. Wiley, New York Lewis FL, Syrmos VL (1995) Optimal control. Wiley, New York
11.
go back to reference Mclain TW, Bailry CA, Beard RW (1999) Synthesis and experimental testing of a nonlinear optimal tracking controller. In: Proceedings of the American control conference, San Diego, CA, USA, pp 2847–2851 Mclain TW, Bailry CA, Beard RW (1999) Synthesis and experimental testing of a nonlinear optimal tracking controller. In: Proceedings of the American control conference, San Diego, CA, USA, pp 2847–2851
12.
go back to reference Park YM, Choi MS, Lee KY (1996) An optimal tracking neuro-controller for nonlinear dynamic systems. IEEE Trans Neural Netw 7:1009–1110 CrossRef Park YM, Choi MS, Lee KY (1996) An optimal tracking neuro-controller for nonlinear dynamic systems. IEEE Trans Neural Netw 7:1009–1110 CrossRef
14.
go back to reference Si J, Wang YT (2001) On-line learning control by association and reinforcement. IEEE Trans Neural Netw 12:264–276 CrossRef Si J, Wang YT (2001) On-line learning control by association and reinforcement. IEEE Trans Neural Netw 12:264–276 CrossRef
15.
16.
go back to reference Yang Q, Jagannathan S (2007) Online reinforcement learning neural network controller design for nanomanipulation. In: Proceedings of the IEEE symposium on approximate dynamic programming and reinforcement learning, Honolulu, HI, pp 225–232 CrossRef Yang Q, Jagannathan S (2007) Online reinforcement learning neural network controller design for nanomanipulation. In: Proceedings of the IEEE symposium on approximate dynamic programming and reinforcement learning, Honolulu, HI, pp 225–232 CrossRef
17.
go back to reference Wang FY, Jin N, Liu D, Wei Q (2011) Adaptive dynamic programming for finite-horizon optimal control of discrete-time nonlinear systems with ε-error bound. IEEE Trans Neural Netw 22:24–36 CrossRef Wang FY, Jin N, Liu D, Wei Q (2011) Adaptive dynamic programming for finite-horizon optimal control of discrete-time nonlinear systems with ε-error bound. IEEE Trans Neural Netw 22:24–36 CrossRef
18.
go back to reference Wang D, Liu D, Wei Q (2012) Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approach. Neurocomputing 78:14–22 CrossRef Wang D, Liu D, Wei Q (2012) Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approach. Neurocomputing 78:14–22 CrossRef
19.
go back to reference Zhang HG, Yang J, Su CY (2007) T-S fuzzy-model-based robust H-infinity design for networked control systems with uncertainties. IEEE Trans Ind Inform 3:289–301 CrossRef Zhang HG, Yang J, Su CY (2007) T-S fuzzy-model-based robust H-infinity design for networked control systems with uncertainties. IEEE Trans Ind Inform 3:289–301 CrossRef
20.
go back to reference Zhang HG, Wei QL, Luo YH (2008) A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm. IEEE Trans Syst Man Cybern, Part B, Cybern 38:937–942 CrossRef Zhang HG, Wei QL, Luo YH (2008) A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm. IEEE Trans Syst Man Cybern, Part B, Cybern 38:937–942 CrossRef
21.
go back to reference Zhang HG, Wang ZS, Liu DR (2009) Global asymptotic stability and robust stability of a class of Cohen–Grossberg neural networks with mixed delays. IEEE Trans Circuits Syst I, Regul Pap 56:616–629 MathSciNetCrossRef Zhang HG, Wang ZS, Liu DR (2009) Global asymptotic stability and robust stability of a class of Cohen–Grossberg neural networks with mixed delays. IEEE Trans Circuits Syst I, Regul Pap 56:616–629 MathSciNetCrossRef
22.
go back to reference Zheng CD, Zhang HG (2007) Generalized multivariate rectangular matrix Pade-type approximants. IEEE Trans Circuits Syst I, Regul Pap 54:2099–2105 MathSciNetCrossRef Zheng CD, Zhang HG (2007) Generalized multivariate rectangular matrix Pade-type approximants. IEEE Trans Circuits Syst I, Regul Pap 54:2099–2105 MathSciNetCrossRef
23.
go back to reference Zheng CD, Zhang HG, Tian H (2007) Generalized homogeneous multivariate matrix Pade-type approximants and Pade approximants. IEEE Trans Autom Control 52:2160–2165 MathSciNetCrossRef Zheng CD, Zhang HG, Tian H (2007) Generalized homogeneous multivariate matrix Pade-type approximants and Pade approximants. IEEE Trans Autom Control 52:2160–2165 MathSciNetCrossRef
24.
go back to reference Zheng CD, Zhang HG, Wang ZS (2009) Delay-dependent globally exponential stability criteria for static neural networks: an LMI approach. IEEE Trans Neural Netw 56:605–609 Zheng CD, Zhang HG, Wang ZS (2009) Delay-dependent globally exponential stability criteria for static neural networks: an LMI approach. IEEE Trans Neural Netw 56:605–609
Metadata
Title
Optimal Tracking Control for Discrete-Time Systems
Authors
Huaguang Zhang
Derong Liu
Yanhong Luo
Ding Wang
Copyright Year
2013
Publisher
Springer London
DOI
https://doi.org/10.1007/978-1-4471-4757-2_3