Skip to main content
Erschienen in: Neural Computing and Applications 3-4/2014

01.03.2014 | Original Article

Recurrent neural network modeling combined with bilinear model structure

verfasst von: Wei-Der Chang

Erschienen in: Neural Computing and Applications | Ausgabe 3-4/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a neural network modeling scheme for nonlinear systems. The proposed architecture is a new combination of neural network and bilinear system model in which the terms of cross-products of input and output signals within the bilinear model are taken as the inputs into the neural network. Compared with the original bilinear system, this kind of network model possesses much more adjustable parameters to fulfill the system identification. Moreover, instead of the general back-propagation method an evolutionary computation called the differential evolution algorithm is presented to update the network parameters. This algorithm is with multiple direction searches toward the global optimal solution for given optimization problem. To show the feasibility of the proposed scheme, a nonlinear chemical process system of continuously stirred tank reactor is illustrated. Many simulations and examinations are considered to verify the robustness of the proposed neural network structure on the modeling performance, including different sets of initial conditions of the algorithm and model orders.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Khasei M, Bijari M (2011) A novel hybridization of artificial neural networks and ARIMA models for time series forecasting. Appl Soft Comput 11:2664–2675CrossRef Khasei M, Bijari M (2011) A novel hybridization of artificial neural networks and ARIMA models for time series forecasting. Appl Soft Comput 11:2664–2675CrossRef
2.
Zurück zum Zitat Luan X, Liu F, Shi P (2010) Robust finite-time H ∞ control for nonlinear jump systems via neural networks. Circuits Syst Signal Process 29:481–498CrossRefMATHMathSciNet Luan X, Liu F, Shi P (2010) Robust finite-time H control for nonlinear jump systems via neural networks. Circuits Syst Signal Process 29:481–498CrossRefMATHMathSciNet
3.
Zurück zum Zitat He H, Zhu Z, Makinen E (2009) A neural network model to minimize the connected dominating set for self-configuration of wireless sensor networks. IEEE Trans Neural Netw 20:973–982CrossRef He H, Zhu Z, Makinen E (2009) A neural network model to minimize the connected dominating set for self-configuration of wireless sensor networks. IEEE Trans Neural Netw 20:973–982CrossRef
4.
Zurück zum Zitat Song X, Gao H, Ding L, Liu D, Hao M (2012) The globally asymptotic stability analysis for a class of recurrent neural networks with delays. Neural Comput Appl. doi:10.1007/s00521-012-0888-3 Song X, Gao H, Ding L, Liu D, Hao M (2012) The globally asymptotic stability analysis for a class of recurrent neural networks with delays. Neural Comput Appl. doi:10.​1007/​s00521-012-0888-3
5.
Zurück zum Zitat Nourafza N, Setayeshi S, Khadem-Zadeh A (2012) A novel approach to accelerate the convergence speed of a stochastic multi-agent system using recurrent neural nets. Neural Comput Appl. doi:10.1007/s00521-011-0624-4 Nourafza N, Setayeshi S, Khadem-Zadeh A (2012) A novel approach to accelerate the convergence speed of a stochastic multi-agent system using recurrent neural nets. Neural Comput Appl. doi:10.​1007/​s00521-011-0624-4
6.
Zurück zum Zitat Ahn KK, Anh HPH (2010) Inverse double NARX fuzzy modeling for system identification. IEEE Trans Mechatron 15:136–148CrossRef Ahn KK, Anh HPH (2010) Inverse double NARX fuzzy modeling for system identification. IEEE Trans Mechatron 15:136–148CrossRef
7.
Zurück zum Zitat Huang CJ, Li THS, Chen CC (2009) Fuzzy feedback linearization control for MIMO nonlinear system and its application to full-vehicle suspension system. Circuits Syst Signal Process 28:959–991CrossRefMATH Huang CJ, Li THS, Chen CC (2009) Fuzzy feedback linearization control for MIMO nonlinear system and its application to full-vehicle suspension system. Circuits Syst Signal Process 28:959–991CrossRefMATH
8.
Zurück zum Zitat Jassar S, Liao Z, Zhao L (2011) A recurrent neuro-fuzzy system and its application in inferential sensing. Appl Soft Comput 11:2935–2945CrossRef Jassar S, Liao Z, Zhao L (2011) A recurrent neuro-fuzzy system and its application in inferential sensing. Appl Soft Comput 11:2935–2945CrossRef
9.
Zurück zum Zitat Razavi-Far R, Davilu H, Palade V, Lucas C (2009) Model-based fault detection and isolation of a steam generator using neuro-fuzzy networks. Neurocomputing 72:2939–2951CrossRef Razavi-Far R, Davilu H, Palade V, Lucas C (2009) Model-based fault detection and isolation of a steam generator using neuro-fuzzy networks. Neurocomputing 72:2939–2951CrossRef
10.
Zurück zum Zitat Balasubramaniam P, Chandran R (2011) Delay decomposition approach to stability analysis for uncertain fuzzy Hopfield neural networks with time-varying delay. Commun Nonlinear Sci Numer Simul 16:2098–2108CrossRefMATHMathSciNet Balasubramaniam P, Chandran R (2011) Delay decomposition approach to stability analysis for uncertain fuzzy Hopfield neural networks with time-varying delay. Commun Nonlinear Sci Numer Simul 16:2098–2108CrossRefMATHMathSciNet
11.
Zurück zum Zitat Guo NR, Li THS (2011) Construction of a neuro-fuzzy classification model based on feature-extraction approach. Expert Syst Appl 38:682–691CrossRef Guo NR, Li THS (2011) Construction of a neuro-fuzzy classification model based on feature-extraction approach. Expert Syst Appl 38:682–691CrossRef
12.
Zurück zum Zitat Abiyev RH, Kaynak O (2010) Type 2 fuzzy neural structure for identification and control of time-varying plants. IEEE Trans Ind Electron 57:4147–4159CrossRef Abiyev RH, Kaynak O (2010) Type 2 fuzzy neural structure for identification and control of time-varying plants. IEEE Trans Ind Electron 57:4147–4159CrossRef
13.
Zurück zum Zitat Nounou MN, Nounou HN (2007) Improving the prediction and parsimony of ARX models using multiscale estimation. Appl Soft Comput 7:711–721CrossRef Nounou MN, Nounou HN (2007) Improving the prediction and parsimony of ARX models using multiscale estimation. Appl Soft Comput 7:711–721CrossRef
14.
Zurück zum Zitat Rojas I, Valenzuela O, Rojas F, Herrera LJ, Pomares H, Marquez L, Pasadas M (2008) Soft-computing techniques and ARMA model for time series prediction. Neurocomputing 71:519–537CrossRef Rojas I, Valenzuela O, Rojas F, Herrera LJ, Pomares H, Marquez L, Pasadas M (2008) Soft-computing techniques and ARMA model for time series prediction. Neurocomputing 71:519–537CrossRef
15.
Zurück zum Zitat Tsai JSH, Wang CT, Kuang CC, Guo SM, Shieh LS, Chen CW (2010) A NARMAX model-based state-space self-tuning control for nonlinear stochastic hybrid systems. Appl Math Model 34:3030–3054CrossRefMATHMathSciNet Tsai JSH, Wang CT, Kuang CC, Guo SM, Shieh LS, Chen CW (2010) A NARMAX model-based state-space self-tuning control for nonlinear stochastic hybrid systems. Appl Math Model 34:3030–3054CrossRefMATHMathSciNet
16.
Zurück zum Zitat Campello RJGB, Favier G, do Amaral WC (2004) Optimal expansions of discrete-time Volterra models using Laguerre functions. Automatica 40:815–822CrossRefMATHMathSciNet Campello RJGB, Favier G, do Amaral WC (2004) Optimal expansions of discrete-time Volterra models using Laguerre functions. Automatica 40:815–822CrossRefMATHMathSciNet
17.
Zurück zum Zitat Zhang J, Zhao H (2010) A novel adaptive bilinear filter based on pipelined architecture. Digit Signal Process 20:23–38CrossRef Zhang J, Zhao H (2010) A novel adaptive bilinear filter based on pipelined architecture. Digit Signal Process 20:23–38CrossRef
18.
Zurück zum Zitat dos Santos PL, Ramos JA, Martins de Carvalho JL (2009) Identification of bilinear systems with white noise inputs: an iterative deterministic-stochastic subspace approach. IEEE Trans Control Syst Technol 17:1145–1153CrossRef dos Santos PL, Ramos JA, Martins de Carvalho JL (2009) Identification of bilinear systems with white noise inputs: an iterative deterministic-stochastic subspace approach. IEEE Trans Control Syst Technol 17:1145–1153CrossRef
19.
Zurück zum Zitat Subudhi B, Jena D (2011) A differential evolution based neural network approach to nonlinear system identification. Appl Soft Comput 11:861–871CrossRef Subudhi B, Jena D (2011) A differential evolution based neural network approach to nonlinear system identification. Appl Soft Comput 11:861–871CrossRef
20.
Zurück zum Zitat Narendra KS, Parthasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1:4–27CrossRef Narendra KS, Parthasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1:4–27CrossRef
21.
Zurück zum Zitat Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous. J Global Optim 11:341–359CrossRefMATHMathSciNet Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous. J Global Optim 11:341–359CrossRefMATHMathSciNet
22.
Zurück zum Zitat Hachicha NH, Jarboui B, Siarry P (2011) A fuzzy logic control using a differential evolution algorithm aimed at modeling the financial market dynamics. Inf Sci 181:79–91CrossRef Hachicha NH, Jarboui B, Siarry P (2011) A fuzzy logic control using a differential evolution algorithm aimed at modeling the financial market dynamics. Inf Sci 181:79–91CrossRef
23.
Zurück zum Zitat Bhattacharya A, Chattopadhyay PK (2011) Solving economic emission load dispatch problems using hybrid differential evolution. Appl Soft Comput 11:2526–2537CrossRef Bhattacharya A, Chattopadhyay PK (2011) Solving economic emission load dispatch problems using hybrid differential evolution. Appl Soft Comput 11:2526–2537CrossRef
24.
Zurück zum Zitat Babu BV, Angira R (2006) Modified differential evolution (MDE) for optimization of non-linear chemical processes. Comput Chem Eng 30:989–1002CrossRef Babu BV, Angira R (2006) Modified differential evolution (MDE) for optimization of non-linear chemical processes. Comput Chem Eng 30:989–1002CrossRef
25.
Zurück zum Zitat Maulik U, Saha I (2010) Automatic fuzzy clustering using modified differential evolution for image classification. IEEE Trans Geosci Remote Sens 48:3503–3510CrossRef Maulik U, Saha I (2010) Automatic fuzzy clustering using modified differential evolution for image classification. IEEE Trans Geosci Remote Sens 48:3503–3510CrossRef
26.
Zurück zum Zitat Karaboga N, Cetinkaya B (2006) Design of digital FIR filters using differential evolution algorithm. Circuits Syst Signal Process 25:649–660CrossRefMATHMathSciNet Karaboga N, Cetinkaya B (2006) Design of digital FIR filters using differential evolution algorithm. Circuits Syst Signal Process 25:649–660CrossRefMATHMathSciNet
27.
Zurück zum Zitat Chen CT, Peng ST (1999) Learning control of process systems with hard input constraints. J Process Control 9:151–160CrossRefMATH Chen CT, Peng ST (1999) Learning control of process systems with hard input constraints. J Process Control 9:151–160CrossRefMATH
Metadaten
Titel
Recurrent neural network modeling combined with bilinear model structure
verfasst von
Wei-Der Chang
Publikationsdatum
01.03.2014
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 3-4/2014
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-012-1295-5

Weitere Artikel der Ausgabe 3-4/2014

Neural Computing and Applications 3-4/2014 Zur Ausgabe

Premium Partner