Skip to main content
Erschienen in: Neural Processing Letters 1/2018

09.09.2017

Gradient Neural Network with Nonlinear Activation for Computing Inner Inverses and the Drazin Inverse

verfasst von: Predrag S. Stanimirović, Marko D. Petković, Dimitrios Gerontitis

Erschienen in: Neural Processing Letters | Ausgabe 1/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Two gradient-based recurrent neural networks (GNNs) for solving two matrix equations are presented and investigated. These GNNs can be used for generating various inner inverses, including the Moore–Penrose, and in the computation of the Drazin inverse. Convergence properties of defined GNNs are considered. Certain conditions which impose convergence towards the pseudoinverse, and the Drazin inverse are exactly specified. The influence of nonlinear activation functions on the convergence performance of defined GNN models is investigated. Computer simulation experience further confirms the theoretical results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ben-Israel A, Greville TNE (2003) Generalized inverses: theory and applications, 2nd edn. Springer, New YorkMATH Ben-Israel A, Greville TNE (2003) Generalized inverses: theory and applications, 2nd edn. Springer, New YorkMATH
2.
Zurück zum Zitat Chen K (2013) Recurrent implicit dynamics for online matrix inversion. Appl Math Comput 219(20):10218–10224MathSciNetMATH Chen K (2013) Recurrent implicit dynamics for online matrix inversion. Appl Math Comput 219(20):10218–10224MathSciNetMATH
3.
Zurück zum Zitat Chen K, Yi C (2016) Robustness analysis of a hybrid of recursive neural dynamics for online matrix inversion. Appl Math Comput 273:969–975MathSciNet Chen K, Yi C (2016) Robustness analysis of a hybrid of recursive neural dynamics for online matrix inversion. Appl Math Comput 273:969–975MathSciNet
4.
Zurück zum Zitat Cichocki A, Kaczorek T, Stajniak A (1992) Computation of the Drazin inverse of a singular matrix making use of neural networks. Bull Pol Acad Sci Tech Sci 40:387–394MATH Cichocki A, Kaczorek T, Stajniak A (1992) Computation of the Drazin inverse of a singular matrix making use of neural networks. Bull Pol Acad Sci Tech Sci 40:387–394MATH
5.
Zurück zum Zitat Higham NJ (2002) Accuracy and stability of numerical algorithms, 2nd edn. SIAM, PhiladelphiaCrossRefMATH Higham NJ (2002) Accuracy and stability of numerical algorithms, 2nd edn. SIAM, PhiladelphiaCrossRefMATH
6.
Zurück zum Zitat Jang JS, Lee SY, Shin SY, Jang JS, Shin SY (1987) An optimization network for matrix inversion. In: Neural information processing systems, pp 397–401 Jang JS, Lee SY, Shin SY, Jang JS, Shin SY (1987) An optimization network for matrix inversion. In: Neural information processing systems, pp 397–401
7.
Zurück zum Zitat Li S, Chen S, Liu B (2013) Accelerating a recurrent neural network to finite-time convergence for solving time-varying Sylvester equation by using a sign-bi-power activation function. Neural Process Lett 37:189–205CrossRef Li S, Chen S, Liu B (2013) Accelerating a recurrent neural network to finite-time convergence for solving time-varying Sylvester equation by using a sign-bi-power activation function. Neural Process Lett 37:189–205CrossRef
8.
Zurück zum Zitat Li Z, Zhang Y (2010) Improved Zhang neural network model and its solution of time-varying generalized linear matrix equations. Expert Syst Appl 37:7213–7218CrossRef Li Z, Zhang Y (2010) Improved Zhang neural network model and its solution of time-varying generalized linear matrix equations. Expert Syst Appl 37:7213–7218CrossRef
9.
Zurück zum Zitat Liao B, Zhang Y (2014) Different complex ZFs leading to different complex ZNN models for time-varying complex generalized inverse matrices. IEEE Trans Neural Netw Learn Syst 25:1621–1631CrossRef Liao B, Zhang Y (2014) Different complex ZFs leading to different complex ZNN models for time-varying complex generalized inverse matrices. IEEE Trans Neural Netw Learn Syst 25:1621–1631CrossRef
10.
Zurück zum Zitat Luo FL, Bao Z (1992) Neural network approach to computing matrix inversion. Appl Math Comput 47:109–120MathSciNetMATH Luo FL, Bao Z (1992) Neural network approach to computing matrix inversion. Appl Math Comput 47:109–120MathSciNetMATH
12.
Zurück zum Zitat Sheng X, Wang T (2013) An iterative method to compute Moore–Penrose inverse based on gradient maximal convergence rate. Filomat 27(7):1269–1276MathSciNetCrossRefMATH Sheng X, Wang T (2013) An iterative method to compute Moore–Penrose inverse based on gradient maximal convergence rate. Filomat 27(7):1269–1276MathSciNetCrossRefMATH
13.
Zurück zum Zitat Stanimirović PS, Živković I, Wei Y (2015) Recurrent neural network approach based on the integral representation of the Drazin inverse. Neural Comput 27(10):2107–2131CrossRef Stanimirović PS, Živković I, Wei Y (2015) Recurrent neural network approach based on the integral representation of the Drazin inverse. Neural Comput 27(10):2107–2131CrossRef
14.
Zurück zum Zitat Stanimirović PS, Živković IS, Wei Y (2015) Recurrent neural network for computing the Drazin inverse. IEEE Trans Neural Netw Learn Syst 26:2830–2843MathSciNetCrossRef Stanimirović PS, Živković IS, Wei Y (2015) Recurrent neural network for computing the Drazin inverse. IEEE Trans Neural Netw Learn Syst 26:2830–2843MathSciNetCrossRef
15.
Zurück zum Zitat Soleymani F, Stanimirović PS (2013) A higher order iterative method for computing the Drazin inverse. Sci World J 2013, Article ID 708647. doi:10.1155/2013/708647 Soleymani F, Stanimirović PS (2013) A higher order iterative method for computing the Drazin inverse. Sci World J 2013, Article ID 708647. doi:10.​1155/​2013/​708647
16.
Zurück zum Zitat Wang G, Wei Y, Qiao S (2003) Generalized inverses: theory and computations. Science Press, New YorkMATH Wang G, Wei Y, Qiao S (2003) Generalized inverses: theory and computations. Science Press, New YorkMATH
17.
Zurück zum Zitat Wang J (1993) A recurrent neural network for real-time matrix inversion. Appl Math Comput 55:89–100MathSciNetMATH Wang J (1993) A recurrent neural network for real-time matrix inversion. Appl Math Comput 55:89–100MathSciNetMATH
19.
Zurück zum Zitat Wang J (1997) Recurrent neural networks for computing pseudoinverses of rank-defficient matrices. SIAM J Sci Comput 18:1479–1493MathSciNetCrossRefMATH Wang J (1997) Recurrent neural networks for computing pseudoinverses of rank-defficient matrices. SIAM J Sci Comput 18:1479–1493MathSciNetCrossRefMATH
20.
Zurück zum Zitat Wang X-Z, Wei Y, Stanimirović PS (2016) Complex neural network models for time-varying Drazin inverse. Neural Comput 28:2790–2824CrossRef Wang X-Z, Wei Y, Stanimirović PS (2016) Complex neural network models for time-varying Drazin inverse. Neural Comput 28:2790–2824CrossRef
21.
22.
23.
Zurück zum Zitat Zhang Y, Ge SS (2003) A general recurrent neural network model for time-varying matrix inversion. In: Proceedings of 42nd IEEE conference on decision and control, San Diego, vol 6, pp 6169–6174 Zhang Y, Ge SS (2003) A general recurrent neural network model for time-varying matrix inversion. In: Proceedings of 42nd IEEE conference on decision and control, San Diego, vol 6, pp 6169–6174
24.
Zurück zum Zitat Zhang Y, Yang Y, Tan N, Cai B (2011) Zhang neural network solving for time-varying full-rank matrix Moore–Penrose inverse. Computing 92:97–121MathSciNetCrossRefMATH Zhang Y, Yang Y, Tan N, Cai B (2011) Zhang neural network solving for time-varying full-rank matrix Moore–Penrose inverse. Computing 92:97–121MathSciNetCrossRefMATH
25.
Zurück zum Zitat Zhang Y, Shi Y, Chen K, Wang C (2009) Global exponential convergence and stability of gradient-based neural network for online matrix inversion. Appl Math Comput 215:1301–1306MathSciNetMATH Zhang Y, Shi Y, Chen K, Wang C (2009) Global exponential convergence and stability of gradient-based neural network for online matrix inversion. Appl Math Comput 215:1301–1306MathSciNetMATH
26.
Zurück zum Zitat Zhang Y (2005) Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans Neural Netw 16(6):1477–1490CrossRef Zhang Y (2005) Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans Neural Netw 16(6):1477–1490CrossRef
27.
Zurück zum Zitat Zhang Y, Ma W, Cai B (2009) From Zhang neural network to Newton iteration for matrix inversion. IEEE Trans Circuits Syst I 56(7):1405–1415MathSciNetCrossRef Zhang Y, Ma W, Cai B (2009) From Zhang neural network to Newton iteration for matrix inversion. IEEE Trans Circuits Syst I 56(7):1405–1415MathSciNetCrossRef
28.
Zurück zum Zitat Zhang Y, Qiu B, Jin L, Guo D (2015) Infinitely many Zhang functions resulting in various ZNN models for time-varying matrix inversion with link to Drazin inverse. Inf Process Lett 115:703–706MathSciNetCrossRefMATH Zhang Y, Qiu B, Jin L, Guo D (2015) Infinitely many Zhang functions resulting in various ZNN models for time-varying matrix inversion with link to Drazin inverse. Inf Process Lett 115:703–706MathSciNetCrossRefMATH
Metadaten
Titel
Gradient Neural Network with Nonlinear Activation for Computing Inner Inverses and the Drazin Inverse
verfasst von
Predrag S. Stanimirović
Marko D. Petković
Dimitrios Gerontitis
Publikationsdatum
09.09.2017
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 1/2018
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-017-9705-4

Weitere Artikel der Ausgabe 1/2018

Neural Processing Letters 1/2018 Zur Ausgabe

Neuer Inhalt