Skip to main content
Erschienen in: Neural Processing Letters 2/2017

12.07.2016

A NN-Based Hybrid Intelligent Algorithm for a Discrete Nonlinear Uncertain Optimal Control Problem

verfasst von: Chunxiao Ding, Yun Sun, Yuanguo Zhu

Erschienen in: Neural Processing Letters | Ausgabe 2/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A discrete-time nonlinear optimal control system with uncertain perturbation is studied in this paper. A value-iteration-based hybrid intelligent algorithm (HIA), incorporating heuristic dynamic programming algorithm and uncertain simulation, is presented. And some characters of the HIA are provided. Two neural networks are used in the algorithm: a critic network is aimed at approximating the objective function, as well as an active network is used to obtain an uncertain optimal control law. As an application, a schistosomiasis compartment SI model is solved to illustrate the feasibility and effectiveness of the HIA.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Al-Tamimi A, Lewis FL, Abu-Khalaf M (2008) Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. IEEE Trans Syst Man Cybern B 38(4):943–949CrossRef Al-Tamimi A, Lewis FL, Abu-Khalaf M (2008) Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. IEEE Trans Syst Man Cybern B 38(4):943–949CrossRef
2.
Zurück zum Zitat Berkovitz LD (1976) Optimal control theory. Springer, New YorkMATH Berkovitz LD (1976) Optimal control theory. Springer, New YorkMATH
3.
Zurück zum Zitat Bradtke SJ, Ydstie BE, Barto AG (1994) Adaptive linear quadratic control using policy iteration. Am Control Conf IEEE 3:3475–3479 Bradtke SJ, Ydstie BE, Barto AG (1994) Adaptive linear quadratic control using policy iteration. Am Control Conf IEEE 3:3475–3479
4.
Zurück zum Zitat Chen X, Ralescu DA (2011) A note on truth value in uncertain logic. Expert Syst Appl 38(12):15582–15586CrossRef Chen X, Ralescu DA (2011) A note on truth value in uncertain logic. Expert Syst Appl 38(12):15582–15586CrossRef
6.
Zurück zum Zitat Deng L, Zhu Y (2012) An uncertain optimal control model with n jumps and application. Comput Sci Inf Syst 9(4):1453–1468CrossRef Deng L, Zhu Y (2012) An uncertain optimal control model with n jumps and application. Comput Sci Inf Syst 9(4):1453–1468CrossRef
7.
Zurück zum Zitat Deng L, Zhu Y (2012) Uncertain optimal control with jump. ICIC Express Lett B 3(2):419–424 Deng L, Zhu Y (2012) Uncertain optimal control with jump. ICIC Express Lett B 3(2):419–424
8.
9.
Zurück zum Zitat Ding C, Zhu Y (2015) Two empirical uncertain models for project scheduling problem. J Oper Res Soc 66(9):1471–1480 Ding C, Zhu Y (2015) Two empirical uncertain models for project scheduling problem. J Oper Res Soc 66(9):1471–1480
10.
Zurück zum Zitat Ding C, Qiu Z, Zhu H (2015) Multi-host transmission dynamics of schistosomiasis and its optimal control. Math Biosci Eng 12(5):983–1006MathSciNetCrossRefMATH Ding C, Qiu Z, Zhu H (2015) Multi-host transmission dynamics of schistosomiasis and its optimal control. Math Biosci Eng 12(5):983–1006MathSciNetCrossRefMATH
11.
Zurück zum Zitat Ding S, Wang Z, Huang Z, Zhang H (2016) Novel switching jumps dependent exponential synchronization criteria for memristor-based neural networks. Neural Process Lett. doi:10.1007/s11063-016-9504-3 Ding S, Wang Z, Huang Z, Zhang H (2016) Novel switching jumps dependent exponential synchronization criteria for memristor-based neural networks. Neural Process Lett. doi:10.​1007/​s11063-016-9504-3
12.
Zurück zum Zitat Dreyfus G (2005) Neural networks: methodology and applications. Springer, BerlinMATH Dreyfus G (2005) Neural networks: methodology and applications. Springer, BerlinMATH
13.
Zurück zum Zitat Finlayson BA (2013) The method of weighted residuals and variational principles. Society for Industrial and Applied Mathematics, New YorkCrossRefMATH Finlayson BA (2013) The method of weighted residuals and variational principles. Society for Industrial and Applied Mathematics, New YorkCrossRefMATH
14.
Zurück zum Zitat Fleming WH, Rishel RW (1975) Deterministic and stochastic optimal control. Springer, New YorkCrossRefMATH Fleming WH, Rishel RW (1975) Deterministic and stochastic optimal control. Springer, New YorkCrossRefMATH
16.
17.
Zurück zum Zitat Gao Y, Wen M, Ding S (2013) (s, S) policy for uncertain single-period inventory problem. Int J Uncertain Fuzziness Knowl Based Syst 21(6):945–953MathSciNetCrossRefMATH Gao Y, Wen M, Ding S (2013) (s, S) policy for uncertain single-period inventory problem. Int J Uncertain Fuzziness Knowl Based Syst 21(6):945–953MathSciNetCrossRefMATH
18.
Zurück zum Zitat Ge X, Zhu Y (2013) A necessary condition of optimality for uncertain optimal control problem. Fuzzy Optim Decis Mak 12(1):41–51MathSciNetCrossRef Ge X, Zhu Y (2013) A necessary condition of optimality for uncertain optimal control problem. Fuzzy Optim Decis Mak 12(1):41–51MathSciNetCrossRef
19.
Zurück zum Zitat Lasalle JP (1969) Functional analysis and time optimal control. Academic, New YorkMATH Lasalle JP (1969) Functional analysis and time optimal control. Academic, New YorkMATH
20.
Zurück zum Zitat Liu B (2007) Uncertainty theory, 2nd edn. Springer, BerlinMATH Liu B (2007) Uncertainty theory, 2nd edn. Springer, BerlinMATH
21.
Zurück zum Zitat Liu B (2008) Fuzzy process, hybrid process and uncertain process. J Uncertain Syst 2(1):3–16 Liu B (2008) Fuzzy process, hybrid process and uncertain process. J Uncertain Syst 2(1):3–16
22.
Zurück zum Zitat Liu B (2009) Some research problems in uncertainty theory. J Uncertain Syst 3(1):3–10 Liu B (2009) Some research problems in uncertainty theory. J Uncertain Syst 3(1):3–10
23.
Zurück zum Zitat Liu B (2010) Uncertainty theory: a branch of mathematics for modeling human uncertainty. Springer, BerlinCrossRef Liu B (2010) Uncertainty theory: a branch of mathematics for modeling human uncertainty. Springer, BerlinCrossRef
24.
Zurück zum Zitat Liu Y, Ha M (2010) Expected value of function of uncertain variables. J Uncertain Syst 4(3):181–186 Liu Y, Ha M (2010) Expected value of function of uncertain variables. J Uncertain Syst 4(3):181–186
25.
Zurück zum Zitat Kang Y, Zhu Y (2012) Bang–bang optimal control for multi-stage uncertain systems. Inf Int Interdiscip J 15(8):3229–3238MathSciNetMATH Kang Y, Zhu Y (2012) Bang–bang optimal control for multi-stage uncertain systems. Inf Int Interdiscip J 15(8):3229–3238MathSciNetMATH
26.
Zurück zum Zitat Kiumarsi B, Lewis FL, Levine DS (2015) Optimal control of nonlinear discrete time-varying systems using a new neural network approximation structure. Neurocomputing 156:157–165CrossRef Kiumarsi B, Lewis FL, Levine DS (2015) Optimal control of nonlinear discrete time-varying systems using a new neural network approximation structure. Neurocomputing 156:157–165CrossRef
27.
Zurück zum Zitat Kwakernaak H, Sivan R (1972) Linear optimal control systems. Wiley-Interscience, New YorkMATH Kwakernaak H, Sivan R (1972) Linear optimal control systems. Wiley-Interscience, New YorkMATH
28.
Zurück zum Zitat Meditch JS, Tacker EC (1972) Stochastic optimal linear estimation and control. IEEE Trans Syst Man Cybern 2(3):444CrossRef Meditch JS, Tacker EC (1972) Stochastic optimal linear estimation and control. IEEE Trans Syst Man Cybern 2(3):444CrossRef
29.
Zurück zum Zitat Peng Z, Iwamura K (2010) A sufficient and necessary condition of uncertainty distribution. J Interdiscip Math 13(3):277–285MathSciNetCrossRefMATH Peng Z, Iwamura K (2010) A sufficient and necessary condition of uncertainty distribution. J Interdiscip Math 13(3):277–285MathSciNetCrossRefMATH
30.
Zurück zum Zitat Peng J, Yao K (2011) A new option pricing model for stocks in uncertainty markets. Int J Oper Res 8(2):18–26MathSciNet Peng J, Yao K (2011) A new option pricing model for stocks in uncertainty markets. Int J Oper Res 8(2):18–26MathSciNet
31.
Zurück zum Zitat Prokhorov DV, Wunsch DC (1997) Adaptive critic designs. IEEE Trans Neural Netw 8(5):997–1007CrossRef Prokhorov DV, Wunsch DC (1997) Adaptive critic designs. IEEE Trans Neural Netw 8(5):997–1007CrossRef
32.
Zurück zum Zitat Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117CrossRef Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117CrossRef
33.
Zurück zum Zitat Sheng L, Zhu Y (2013) Optimistic value model of uncertain optimal control. Int J Uncertain Fuzziness Knowl Based Syst 21(Suppl):75–87MathSciNetCrossRefMATH Sheng L, Zhu Y (2013) Optimistic value model of uncertain optimal control. Int J Uncertain Fuzziness Knowl Based Syst 21(Suppl):75–87MathSciNetCrossRefMATH
34.
Zurück zum Zitat Sheng L, Zhu Y, Hamalainen T (2013) An uncertain optimal control model with Hurwicz criterion. Appl Math Comput 224:412–421MathSciNetMATH Sheng L, Zhu Y, Hamalainen T (2013) An uncertain optimal control model with Hurwicz criterion. Appl Math Comput 224:412–421MathSciNetMATH
35.
Zurück zum Zitat Stengel RF (1986) Stochastic optimal control. Wiley, New YorkMATH Stengel RF (1986) Stochastic optimal control. Wiley, New YorkMATH
36.
Zurück zum Zitat Werbos P J (1990) A menu of designs for reinforcement learning over time. In: Neural networks for control. MIT Press, Cambridge, p 67–95 Werbos P J (1990) A menu of designs for reinforcement learning over time. In: Neural networks for control. MIT Press, Cambridge, p 67–95
37.
Zurück zum Zitat Xu X, Zhu Y (2012) Uncertain bang–bang control for continuous time model. Cybern Syst 43(6):515–527CrossRefMATH Xu X, Zhu Y (2012) Uncertain bang–bang control for continuous time model. Cybern Syst 43(6):515–527CrossRefMATH
38.
Zurück zum Zitat Yan H, Zhu Y (2015) Bang–bang control model for uncertain switched systems. Appl Math Model 39(10):2994–3002MathSciNetCrossRef Yan H, Zhu Y (2015) Bang–bang control model for uncertain switched systems. Appl Math Model 39(10):2994–3002MathSciNetCrossRef
39.
Zurück zum Zitat Yao K (2014) Sine entropy of uncertain set and its applications. Appl Soft Comput 22:432–442CrossRef Yao K (2014) Sine entropy of uncertain set and its applications. Appl Soft Comput 22:432–442CrossRef
40.
Zurück zum Zitat Yao K, Li X (2012) Uncertain alternating renewal process and its application. IEEE Trans Fuzzy Syst 20(6):1154–1160CrossRef Yao K, Li X (2012) Uncertain alternating renewal process and its application. IEEE Trans Fuzzy Syst 20(6):1154–1160CrossRef
41.
Zurück zum Zitat Zhang X, Chen X (2012) A new uncertain programming model for project scheduling problem. Inf Int Interdiscip J 15(10):3901–3910MathSciNetMATH Zhang X, Chen X (2012) A new uncertain programming model for project scheduling problem. Inf Int Interdiscip J 15(10):3901–3910MathSciNetMATH
42.
Zurück zum Zitat Zhu Y (2010) Uncertain optimal control with application to a portfolio selection model. Cybern Syst Int J 41(7):535–547CrossRefMATH Zhu Y (2010) Uncertain optimal control with application to a portfolio selection model. Cybern Syst Int J 41(7):535–547CrossRefMATH
43.
Zurück zum Zitat Zhu Y (2012) Functions of uncertain variables and uncertain programming. J Uncertain Syst 6(4):278–288 Zhu Y (2012) Functions of uncertain variables and uncertain programming. J Uncertain Syst 6(4):278–288
Metadaten
Titel
A NN-Based Hybrid Intelligent Algorithm for a Discrete Nonlinear Uncertain Optimal Control Problem
verfasst von
Chunxiao Ding
Yun Sun
Yuanguo Zhu
Publikationsdatum
12.07.2016
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2017
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-016-9536-8

Weitere Artikel der Ausgabe 2/2017

Neural Processing Letters 2/2017 Zur Ausgabe

Neuer Inhalt