Skip to main content
Top
Published in: Neural Processing Letters 1/2018

09-09-2017

Gradient Neural Network with Nonlinear Activation for Computing Inner Inverses and the Drazin Inverse

Authors: Predrag S. Stanimirović, Marko D. Petković, Dimitrios Gerontitis

Published in: Neural Processing Letters | Issue 1/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Two gradient-based recurrent neural networks (GNNs) for solving two matrix equations are presented and investigated. These GNNs can be used for generating various inner inverses, including the Moore–Penrose, and in the computation of the Drazin inverse. Convergence properties of defined GNNs are considered. Certain conditions which impose convergence towards the pseudoinverse, and the Drazin inverse are exactly specified. The influence of nonlinear activation functions on the convergence performance of defined GNN models is investigated. Computer simulation experience further confirms the theoretical results.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ben-Israel A, Greville TNE (2003) Generalized inverses: theory and applications, 2nd edn. Springer, New YorkMATH Ben-Israel A, Greville TNE (2003) Generalized inverses: theory and applications, 2nd edn. Springer, New YorkMATH
2.
go back to reference Chen K (2013) Recurrent implicit dynamics for online matrix inversion. Appl Math Comput 219(20):10218–10224MathSciNetMATH Chen K (2013) Recurrent implicit dynamics for online matrix inversion. Appl Math Comput 219(20):10218–10224MathSciNetMATH
3.
go back to reference Chen K, Yi C (2016) Robustness analysis of a hybrid of recursive neural dynamics for online matrix inversion. Appl Math Comput 273:969–975MathSciNet Chen K, Yi C (2016) Robustness analysis of a hybrid of recursive neural dynamics for online matrix inversion. Appl Math Comput 273:969–975MathSciNet
4.
go back to reference Cichocki A, Kaczorek T, Stajniak A (1992) Computation of the Drazin inverse of a singular matrix making use of neural networks. Bull Pol Acad Sci Tech Sci 40:387–394MATH Cichocki A, Kaczorek T, Stajniak A (1992) Computation of the Drazin inverse of a singular matrix making use of neural networks. Bull Pol Acad Sci Tech Sci 40:387–394MATH
5.
go back to reference Higham NJ (2002) Accuracy and stability of numerical algorithms, 2nd edn. SIAM, PhiladelphiaCrossRefMATH Higham NJ (2002) Accuracy and stability of numerical algorithms, 2nd edn. SIAM, PhiladelphiaCrossRefMATH
6.
go back to reference Jang JS, Lee SY, Shin SY, Jang JS, Shin SY (1987) An optimization network for matrix inversion. In: Neural information processing systems, pp 397–401 Jang JS, Lee SY, Shin SY, Jang JS, Shin SY (1987) An optimization network for matrix inversion. In: Neural information processing systems, pp 397–401
7.
go back to reference Li S, Chen S, Liu B (2013) Accelerating a recurrent neural network to finite-time convergence for solving time-varying Sylvester equation by using a sign-bi-power activation function. Neural Process Lett 37:189–205CrossRef Li S, Chen S, Liu B (2013) Accelerating a recurrent neural network to finite-time convergence for solving time-varying Sylvester equation by using a sign-bi-power activation function. Neural Process Lett 37:189–205CrossRef
8.
go back to reference Li Z, Zhang Y (2010) Improved Zhang neural network model and its solution of time-varying generalized linear matrix equations. Expert Syst Appl 37:7213–7218CrossRef Li Z, Zhang Y (2010) Improved Zhang neural network model and its solution of time-varying generalized linear matrix equations. Expert Syst Appl 37:7213–7218CrossRef
9.
go back to reference Liao B, Zhang Y (2014) Different complex ZFs leading to different complex ZNN models for time-varying complex generalized inverse matrices. IEEE Trans Neural Netw Learn Syst 25:1621–1631CrossRef Liao B, Zhang Y (2014) Different complex ZFs leading to different complex ZNN models for time-varying complex generalized inverse matrices. IEEE Trans Neural Netw Learn Syst 25:1621–1631CrossRef
10.
go back to reference Luo FL, Bao Z (1992) Neural network approach to computing matrix inversion. Appl Math Comput 47:109–120MathSciNetMATH Luo FL, Bao Z (1992) Neural network approach to computing matrix inversion. Appl Math Comput 47:109–120MathSciNetMATH
12.
go back to reference Sheng X, Wang T (2013) An iterative method to compute Moore–Penrose inverse based on gradient maximal convergence rate. Filomat 27(7):1269–1276MathSciNetCrossRefMATH Sheng X, Wang T (2013) An iterative method to compute Moore–Penrose inverse based on gradient maximal convergence rate. Filomat 27(7):1269–1276MathSciNetCrossRefMATH
13.
go back to reference Stanimirović PS, Živković I, Wei Y (2015) Recurrent neural network approach based on the integral representation of the Drazin inverse. Neural Comput 27(10):2107–2131CrossRef Stanimirović PS, Živković I, Wei Y (2015) Recurrent neural network approach based on the integral representation of the Drazin inverse. Neural Comput 27(10):2107–2131CrossRef
14.
go back to reference Stanimirović PS, Živković IS, Wei Y (2015) Recurrent neural network for computing the Drazin inverse. IEEE Trans Neural Netw Learn Syst 26:2830–2843MathSciNetCrossRef Stanimirović PS, Živković IS, Wei Y (2015) Recurrent neural network for computing the Drazin inverse. IEEE Trans Neural Netw Learn Syst 26:2830–2843MathSciNetCrossRef
15.
go back to reference Soleymani F, Stanimirović PS (2013) A higher order iterative method for computing the Drazin inverse. Sci World J 2013, Article ID 708647. doi:10.1155/2013/708647 Soleymani F, Stanimirović PS (2013) A higher order iterative method for computing the Drazin inverse. Sci World J 2013, Article ID 708647. doi:10.​1155/​2013/​708647
16.
go back to reference Wang G, Wei Y, Qiao S (2003) Generalized inverses: theory and computations. Science Press, New YorkMATH Wang G, Wei Y, Qiao S (2003) Generalized inverses: theory and computations. Science Press, New YorkMATH
17.
go back to reference Wang J (1993) A recurrent neural network for real-time matrix inversion. Appl Math Comput 55:89–100MathSciNetMATH Wang J (1993) A recurrent neural network for real-time matrix inversion. Appl Math Comput 55:89–100MathSciNetMATH
19.
20.
go back to reference Wang X-Z, Wei Y, Stanimirović PS (2016) Complex neural network models for time-varying Drazin inverse. Neural Comput 28:2790–2824CrossRef Wang X-Z, Wei Y, Stanimirović PS (2016) Complex neural network models for time-varying Drazin inverse. Neural Comput 28:2790–2824CrossRef
21.
23.
go back to reference Zhang Y, Ge SS (2003) A general recurrent neural network model for time-varying matrix inversion. In: Proceedings of 42nd IEEE conference on decision and control, San Diego, vol 6, pp 6169–6174 Zhang Y, Ge SS (2003) A general recurrent neural network model for time-varying matrix inversion. In: Proceedings of 42nd IEEE conference on decision and control, San Diego, vol 6, pp 6169–6174
24.
go back to reference Zhang Y, Yang Y, Tan N, Cai B (2011) Zhang neural network solving for time-varying full-rank matrix Moore–Penrose inverse. Computing 92:97–121MathSciNetCrossRefMATH Zhang Y, Yang Y, Tan N, Cai B (2011) Zhang neural network solving for time-varying full-rank matrix Moore–Penrose inverse. Computing 92:97–121MathSciNetCrossRefMATH
25.
go back to reference Zhang Y, Shi Y, Chen K, Wang C (2009) Global exponential convergence and stability of gradient-based neural network for online matrix inversion. Appl Math Comput 215:1301–1306MathSciNetMATH Zhang Y, Shi Y, Chen K, Wang C (2009) Global exponential convergence and stability of gradient-based neural network for online matrix inversion. Appl Math Comput 215:1301–1306MathSciNetMATH
26.
go back to reference Zhang Y (2005) Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans Neural Netw 16(6):1477–1490CrossRef Zhang Y (2005) Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans Neural Netw 16(6):1477–1490CrossRef
27.
go back to reference Zhang Y, Ma W, Cai B (2009) From Zhang neural network to Newton iteration for matrix inversion. IEEE Trans Circuits Syst I 56(7):1405–1415MathSciNetCrossRef Zhang Y, Ma W, Cai B (2009) From Zhang neural network to Newton iteration for matrix inversion. IEEE Trans Circuits Syst I 56(7):1405–1415MathSciNetCrossRef
28.
go back to reference Zhang Y, Qiu B, Jin L, Guo D (2015) Infinitely many Zhang functions resulting in various ZNN models for time-varying matrix inversion with link to Drazin inverse. Inf Process Lett 115:703–706MathSciNetCrossRefMATH Zhang Y, Qiu B, Jin L, Guo D (2015) Infinitely many Zhang functions resulting in various ZNN models for time-varying matrix inversion with link to Drazin inverse. Inf Process Lett 115:703–706MathSciNetCrossRefMATH
Metadata
Title
Gradient Neural Network with Nonlinear Activation for Computing Inner Inverses and the Drazin Inverse
Authors
Predrag S. Stanimirović
Marko D. Petković
Dimitrios Gerontitis
Publication date
09-09-2017
Publisher
Springer US
Published in
Neural Processing Letters / Issue 1/2018
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-017-9705-4

Other articles of this Issue 1/2018

Neural Processing Letters 1/2018 Go to the issue