Skip to main content
Erschienen in: Neural Processing Letters 3/2014

01.06.2014

From Different Zhang Functions to Various ZNN Models Accelerated to Finite-Time Convergence for Time-Varying Linear Matrix Equation

verfasst von: Lin Xiao, Yunong Zhang

Erschienen in: Neural Processing Letters | Ausgabe 3/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In addition to the parallel-distributed nature, recurrent neural networks can be implemented physically by designated hardware and thus have been found broad applications in many fields. In this paper, a special class of recurrent neural network named Zhang neural network (ZNN), together with its electronic realization, is investigated and exploited for online solution of time-varying linear matrix equations. By following the idea of Zhang function (i.e., error function), two ZNN models are proposed and studied, which allow us to choose plentiful activation functions (e.g., any monotonically-increasing odd activation function). It is theoretically proved that such two ZNN models globally and exponentially converge to the theoretical solution of time-varying linear matrix equations when using linear activation functions. Besides, the new activation function, named Li activation function, is exploited. It is theoretically proved that, when using Li activation function, such two ZNN models can be further accelerated to finite-time convergence to the time-varying theoretical solution. In addition, the upper bound of the convergence time is derived analytically via Lyapunov theory. Then, we conduct extensive simulations using such two ZNN models. The results substantiate the theoretical analysis and the efficacy of the proposed ZNN models for solving time-varying linear matrix equations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Prasanna GNS, Musicus BR (1996) Generalized multiprocessor scheduling and applications to matrix computations. IEEE Trans Parallel Distrib Syst 7(6):932–943CrossRef Prasanna GNS, Musicus BR (1996) Generalized multiprocessor scheduling and applications to matrix computations. IEEE Trans Parallel Distrib Syst 7(6):932–943CrossRef
2.
Zurück zum Zitat Kurzak J, Buttari A, Dongarra J (2008) Solving systems of linear equations on the cell processor using cholesky factorization. IEEE Trans Parallel Distrib Syst 19(9):1175–1185CrossRef Kurzak J, Buttari A, Dongarra J (2008) Solving systems of linear equations on the cell processor using cholesky factorization. IEEE Trans Parallel Distrib Syst 19(9):1175–1185CrossRef
3.
Zurück zum Zitat Ding F, Chen T (2005) Gradient based iterative algorithms for solving a class of matrix equations. IEEE Trans Autom Control 50(8):1216–1221CrossRefMathSciNet Ding F, Chen T (2005) Gradient based iterative algorithms for solving a class of matrix equations. IEEE Trans Autom Control 50(8):1216–1221CrossRefMathSciNet
4.
Zurück zum Zitat Huang GX, Yin F, Guo K (2008) An iterative method for the skew-symmetric solution and the optimal spproximate solution of the matrix equation \(AXB=C\). J Comput Appl Math 212:231–244CrossRefMATHMathSciNet Huang GX, Yin F, Guo K (2008) An iterative method for the skew-symmetric solution and the optimal spproximate solution of the matrix equation \(AXB=C\). J Comput Appl Math 212:231–244CrossRefMATHMathSciNet
5.
Zurück zum Zitat Wu AG, Lv L, Hou MZ (2011) Finite iterative algorithms for extended sylvester-conjugate matrix equations. J Comput Appl Math 54:2363–2384MATHMathSciNet Wu AG, Lv L, Hou MZ (2011) Finite iterative algorithms for extended sylvester-conjugate matrix equations. J Comput Appl Math 54:2363–2384MATHMathSciNet
6.
7.
Zurück zum Zitat Zhou B, Duan GR, Li ZY (2009) Gradient based iterative algorithm for solving coupled matrix equations. Syst Control Lett 58:327–333CrossRefMATHMathSciNet Zhou B, Duan GR, Li ZY (2009) Gradient based iterative algorithm for solving coupled matrix equations. Syst Control Lett 58:327–333CrossRefMATHMathSciNet
8.
Zurück zum Zitat Mathews JH, Fink KD (2004) Numerical methods using MATLAB. Prentice Hall, New Jersey Mathews JH, Fink KD (2004) Numerical methods using MATLAB. Prentice Hall, New Jersey
9.
Zurück zum Zitat Cheng SC, Tsai WH (2009) A neural network implementation of the moment- preserving technique and its application to thresholding. IEEE Trans Comput 42(4):501–507CrossRef Cheng SC, Tsai WH (2009) A neural network implementation of the moment- preserving technique and its application to thresholding. IEEE Trans Comput 42(4):501–507CrossRef
10.
Zurück zum Zitat Luque-Baena RM, Ortiz-de-Lazcano-Lobato JM, Lopez-Rubio E, Dominguez E, Palomo EJ (2013) A competitive neural network for multiple object tracking in video sequence analysis. Neural Process Lett 37(1):47–67CrossRef Luque-Baena RM, Ortiz-de-Lazcano-Lobato JM, Lopez-Rubio E, Dominguez E, Palomo EJ (2013) A competitive neural network for multiple object tracking in video sequence analysis. Neural Process Lett 37(1):47–67CrossRef
11.
Zurück zum Zitat Pande S, Morgan F, Cawley S, Bruintjes T, Smit G, McGinley B, Carrillo S, Harkin J, McDaid L (2012) Modular neural tile architecture for compact embedded hardware spiking neural network. Neural Process Lett. doi:10.1007/s11063-012-9274-5 Pande S, Morgan F, Cawley S, Bruintjes T, Smit G, McGinley B, Carrillo S, Harkin J, McDaid L (2012) Modular neural tile architecture for compact embedded hardware spiking neural network. Neural Process Lett. doi:10.​1007/​s11063-012-9274-5
12.
13.
Zurück zum Zitat Wang L, Liu W, Shi H (2009) Delay-constrained multicast routing using the noisy chaotic neural networks. IEEE Trans Comput 58(1):82–89CrossRefMathSciNet Wang L, Liu W, Shi H (2009) Delay-constrained multicast routing using the noisy chaotic neural networks. IEEE Trans Comput 58(1):82–89CrossRefMathSciNet
14.
Zurück zum Zitat Elhadef M, Nayak A (2012) Comparison-based system-level fault diagnosis: a neural network approach. IEEE Trans Parallel Distrib Syst 23(6):1047–1059CrossRef Elhadef M, Nayak A (2012) Comparison-based system-level fault diagnosis: a neural network approach. IEEE Trans Parallel Distrib Syst 23(6):1047–1059CrossRef
15.
Zurück zum Zitat Ge SS, Yang C, Lee TH (2008) Adaptive predictive control using neural network for a class of pure-feedback systems in discrete time. IEEE Trans Neural Netw 19(9):1599–1614CrossRef Ge SS, Yang C, Lee TH (2008) Adaptive predictive control using neural network for a class of pure-feedback systems in discrete time. IEEE Trans Neural Netw 19(9):1599–1614CrossRef
16.
Zurück zum Zitat Yang C, Ge SS, Xiang C, Chai T, Lee TH (2008) Output feedback nn control for two classes of discrete-time systems with unknown control directions in a unified approach. IEEE Trans Neural Netw 19(9):1873–1886CrossRef Yang C, Ge SS, Xiang C, Chai T, Lee TH (2008) Output feedback nn control for two classes of discrete-time systems with unknown control directions in a unified approach. IEEE Trans Neural Netw 19(9):1873–1886CrossRef
17.
Zurück zum Zitat Xia Y, Feng G, Wang J (2008) A novel recurrent neural network for solving nonlinear optimization problems with inequality constraints. IEEE Trans Neural Netw 19(8):1340–1353CrossRef Xia Y, Feng G, Wang J (2008) A novel recurrent neural network for solving nonlinear optimization problems with inequality constraints. IEEE Trans Neural Netw 19(8):1340–1353CrossRef
18.
Zurück zum Zitat Guo D, Yi C, Zhang Y (2011) Zhang neural network versus gradient-based neural network for time-varying linear matrix equation solving. Neurocomputing 74:3708–3712CrossRef Guo D, Yi C, Zhang Y (2011) Zhang neural network versus gradient-based neural network for time-varying linear matrix equation solving. Neurocomputing 74:3708–3712CrossRef
19.
Zurück zum Zitat Zhang Y, Jiang D, Wang J (2002) A recurrent neural network for solving sylvester equation with time-varying coefficients. IEEE Trans Neural Netw 13(5):1053–1063CrossRef Zhang Y, Jiang D, Wang J (2002) A recurrent neural network for solving sylvester equation with time-varying coefficients. IEEE Trans Neural Netw 13(5):1053–1063CrossRef
20.
Zurück zum Zitat Zhang Y, Ge SS (2005) Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans Neural Netw 16(6):1477–1490CrossRef Zhang Y, Ge SS (2005) Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans Neural Netw 16(6):1477–1490CrossRef
21.
Zurück zum Zitat Zhang Y, Ma W, Cai B (2009) From Zhang neural networks to newton iteration for matrix inversion. IEEE Trans Circuits Syst I 56(7):1405–1415CrossRefMathSciNet Zhang Y, Ma W, Cai B (2009) From Zhang neural networks to newton iteration for matrix inversion. IEEE Trans Circuits Syst I 56(7):1405–1415CrossRefMathSciNet
22.
Zurück zum Zitat Xiao L, Zhang Y (2011) Zhang neural network versus gradient neural network for solving time-varying linear inequalities. IEEE Trans Neural Netw 22(10):1676–1684CrossRefMathSciNet Xiao L, Zhang Y (2011) Zhang neural network versus gradient neural network for solving time-varying linear inequalities. IEEE Trans Neural Netw 22(10):1676–1684CrossRefMathSciNet
23.
Zurück zum Zitat Xiao L, Zhang Y (2012) Two new types of Zhang neural networks solving systems of time-varying nonlinear inequalities. IEEE Trans Circuits Syst I 59(10):2363–2373CrossRefMathSciNet Xiao L, Zhang Y (2012) Two new types of Zhang neural networks solving systems of time-varying nonlinear inequalities. IEEE Trans Circuits Syst I 59(10):2363–2373CrossRefMathSciNet
24.
Zurück zum Zitat Zhang Y, Li F, Yang Y, Li Z (2012) Different Zhang functions leading to different zhang-dynamics models illustrated via time-varying reciprocal solving. Appl Math Model 36:4502–4511CrossRefMATHMathSciNet Zhang Y, Li F, Yang Y, Li Z (2012) Different Zhang functions leading to different zhang-dynamics models illustrated via time-varying reciprocal solving. Appl Math Model 36:4502–4511CrossRefMATHMathSciNet
25.
26.
Zurück zum Zitat Li S, Chen S, Liu B (2013) Accelerating a recurrent neural network to finite-time convergence for solving time-varying sylvester equation by using a sign-bi-power activation function. Neural Process Lett 37:189–205CrossRef Li S, Chen S, Liu B (2013) Accelerating a recurrent neural network to finite-time convergence for solving time-varying sylvester equation by using a sign-bi-power activation function. Neural Process Lett 37:189–205CrossRef
27.
Zurück zum Zitat Li S, Liu B, Li Y (2013) Selective positive-negative feedback produces the winner-take-all competition in recurrent neural networks. IEEE Trans Neural Netw Learn Syst 24(2):301–309CrossRef Li S, Liu B, Li Y (2013) Selective positive-negative feedback produces the winner-take-all competition in recurrent neural networks. IEEE Trans Neural Netw Learn Syst 24(2):301–309CrossRef
28.
Zurück zum Zitat Li S, Li Y, Wang Z (2013) A class of finite-time dual neural networks for solving quadratic programming problems and its k-winners-take-all application. Neural Netw 39:27–39CrossRef Li S, Li Y, Wang Z (2013) A class of finite-time dual neural networks for solving quadratic programming problems and its k-winners-take-all application. Neural Netw 39:27–39CrossRef
29.
Zurück zum Zitat Khalil HK (2001) Nonlinear Systems, 3rd edn. Prentice Hall, Englewood Cliffs Khalil HK (2001) Nonlinear Systems, 3rd edn. Prentice Hall, Englewood Cliffs
Metadaten
Titel
From Different Zhang Functions to Various ZNN Models Accelerated to Finite-Time Convergence for Time-Varying Linear Matrix Equation
verfasst von
Lin Xiao
Yunong Zhang
Publikationsdatum
01.06.2014
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2014
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-013-9306-9

Weitere Artikel der Ausgabe 3/2014

Neural Processing Letters 3/2014 Zur Ausgabe