Skip to main content
Erschienen in: Neural Processing Letters 1/2019

28.03.2019

Improved GNN Models for Constant Matrix Inversion

verfasst von: Predrag S. Stanimirović, Marko D. Petković

Erschienen in: Neural Processing Letters | Ausgabe 1/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

It was shown that the multiplication of the left hand side of the classical Zhang neural network design rule by an appropriate positive definite matrix generates a new neural design with improved convergence rate. Our intention is to apply similar principle on the standard gradient neural network (GNN) model. To that goal, we discover that some of proposed models can be considered as the multiplication of the right hand side of the GNN model by a symmetric positive-semidefinite matrix. As a final result, we propose appropriate general pattern to define various improvements of the standard GNN design for online real-time matrix inversion in time invariant case. The leading idea in generating improved models is initiated after a combination of two GNN patterns. Improved GNN (IGNN) design shows global exponential convergence with an improved convergence rate with respect to the convergence rate of the original GNN pattern. The acceleration in the convergence rate is defined by the smallest eigenvalue of appropriate positive semidefinite matrices. IGNN models are not only generalizations of original GNN models but they comprise so far defined improvements of the standard GNN design.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Wang G, Wei Y, Qiao S (2018) Generalized inverses: theory and computations, developments in mathematics, vol 53. Springer, BeijingCrossRef Wang G, Wei Y, Qiao S (2018) Generalized inverses: theory and computations, developments in mathematics, vol 53. Springer, BeijingCrossRef
2.
Zurück zum Zitat Wei Y, Stanimirović P, Petković M (2018) Numerical and symbolic computations of generalized inverses. World Scientific Publishing Co. Pte. Ltd., HackensackCrossRefMATH Wei Y, Stanimirović P, Petković M (2018) Numerical and symbolic computations of generalized inverses. World Scientific Publishing Co. Pte. Ltd., HackensackCrossRefMATH
3.
Zurück zum Zitat Jang JS, Lee SY, Shin SY, Jang JS, Shin SY (1988) An optimization network for matrix inversion. In: Anderson DZ (ed) Neural information processing systems. American Institute of Physics, New York, pp 397–401 Jang JS, Lee SY, Shin SY, Jang JS, Shin SY (1988) An optimization network for matrix inversion. In: Anderson DZ (ed) Neural information processing systems. American Institute of Physics, New York, pp 397–401
4.
Zurück zum Zitat Luo FL, Bao Z (1992) Neural network approach to computing matrix inversion. Appl Math Comput 47:109–120MathSciNetMATH Luo FL, Bao Z (1992) Neural network approach to computing matrix inversion. Appl Math Comput 47:109–120MathSciNetMATH
5.
Zurück zum Zitat Wang J (1993) A recurrent neural network for real-time matrix inversion. Appl Math Comput 55:89–100MathSciNetMATH Wang J (1993) A recurrent neural network for real-time matrix inversion. Appl Math Comput 55:89–100MathSciNetMATH
7.
Zurück zum Zitat Wang J (1997) Recurrent neural networks for computing pseudoinverses of rank-deficient matrices. SIAM J Sci Comput 18:1479–1493MathSciNetCrossRefMATH Wang J (1997) Recurrent neural networks for computing pseudoinverses of rank-deficient matrices. SIAM J Sci Comput 18:1479–1493MathSciNetCrossRefMATH
8.
9.
Zurück zum Zitat Cichocki A, Kaczorek T, Stajniak A (1992) Computation of the Drazin inverse of a singular matrix making use of neural networks. Bull Pol Acad Sci Tech Sci 40:387–394MATH Cichocki A, Kaczorek T, Stajniak A (1992) Computation of the Drazin inverse of a singular matrix making use of neural networks. Bull Pol Acad Sci Tech Sci 40:387–394MATH
10.
Zurück zum Zitat Živković I, Stanimirović PS, Wei Y (2016) Recurrent neural network for computing outer inverse. Neural Comput 28(5):970–998MathSciNetCrossRefMATH Živković I, Stanimirović PS, Wei Y (2016) Recurrent neural network for computing outer inverse. Neural Comput 28(5):970–998MathSciNetCrossRefMATH
11.
Zurück zum Zitat Stanimirović PS, Živković IS, Wei Y (2015) Recurrent neural network for computing the Drazin inverse. IEEE Trans Neural Netw Learn Syst 26:2830–2843MathSciNetCrossRef Stanimirović PS, Živković IS, Wei Y (2015) Recurrent neural network for computing the Drazin inverse. IEEE Trans Neural Netw Learn Syst 26:2830–2843MathSciNetCrossRef
12.
Zurück zum Zitat Stanimirović PS, Živković I, Wei Y (2015) Recurrent neural network approach based on the integral representation of the Drazin inverse. Neural Comput 27(10):2107–2131MathSciNetCrossRefMATH Stanimirović PS, Živković I, Wei Y (2015) Recurrent neural network approach based on the integral representation of the Drazin inverse. Neural Comput 27(10):2107–2131MathSciNetCrossRefMATH
13.
Zurück zum Zitat Zhang Y, Yang Y, Tan N, Cai B (2011) Zhang neural network solving for time-varying full-rank matrix Moore–Penrose inverse. Computing 92:97–121MathSciNetCrossRefMATH Zhang Y, Yang Y, Tan N, Cai B (2011) Zhang neural network solving for time-varying full-rank matrix Moore–Penrose inverse. Computing 92:97–121MathSciNetCrossRefMATH
14.
Zurück zum Zitat Liao B, Zhang Y (2014) Different complex ZFs leading to different complex ZNN models for time-varying complex generalized inverse matrices. IEEE Trans Neural Netw Learn Syst 25:1621–1631CrossRef Liao B, Zhang Y (2014) Different complex ZFs leading to different complex ZNN models for time-varying complex generalized inverse matrices. IEEE Trans Neural Netw Learn Syst 25:1621–1631CrossRef
15.
Zurück zum Zitat Qiao S, Wang X-Z, Wei Y (2018) Two finite-time convergent Zhang neural network models for time-varying complex matrix Drazin inverse. Linear Algebra Appl. 542:101–117MathSciNetCrossRefMATH Qiao S, Wang X-Z, Wei Y (2018) Two finite-time convergent Zhang neural network models for time-varying complex matrix Drazin inverse. Linear Algebra Appl. 542:101–117MathSciNetCrossRefMATH
16.
17.
Zurück zum Zitat Zhang Y, Yi C (2011) Zhang neural networks and neural-dynamic method. Nova Science Publishers, New York Zhang Y, Yi C (2011) Zhang neural networks and neural-dynamic method. Nova Science Publishers, New York
18.
Zurück zum Zitat Stanimirović PS, Petković MD, Gerontitis D (2018) Gradient neural network with nonlinear activation for computing inner inverses and the Drazin inverse. Neural Process. Lett. 48:109–133CrossRef Stanimirović PS, Petković MD, Gerontitis D (2018) Gradient neural network with nonlinear activation for computing inner inverses and the Drazin inverse. Neural Process. Lett. 48:109–133CrossRef
19.
Zurück zum Zitat Zhang Y (2005) Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans Neural Netw 16(6):1477–1490CrossRef Zhang Y (2005) Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans Neural Netw 16(6):1477–1490CrossRef
20.
Zurück zum Zitat Chen K (2013) Recurrent implicit dynamics for online matrix inversion. Appl Math Comput 219(20):10218–10224MathSciNetMATH Chen K (2013) Recurrent implicit dynamics for online matrix inversion. Appl Math Comput 219(20):10218–10224MathSciNetMATH
21.
Zurück zum Zitat Chen K, Yi C (2016) Robustness analysis of a hybrid of recursive neural dynamics for online matrix inversion. Appl Math Comput 273:969–975MathSciNetMATH Chen K, Yi C (2016) Robustness analysis of a hybrid of recursive neural dynamics for online matrix inversion. Appl Math Comput 273:969–975MathSciNetMATH
22.
Zurück zum Zitat Živković I, Stanimirović PS (2017) Matlab simulation of the hybrid of recursive neural dynamics for online matrix inversion. Facta Univ (Niš) Ser Math Inform 32:799–809MathSciNet Živković I, Stanimirović PS (2017) Matlab simulation of the hybrid of recursive neural dynamics for online matrix inversion. Facta Univ (Niš) Ser Math Inform 32:799–809MathSciNet
23.
Zurück zum Zitat Wang X-Z, Stanimirović PS, Wei Y (2018) Complex ZFs for computing time-varying complex outer inverses. Neurocomputing 275:983–1001CrossRef Wang X-Z, Stanimirović PS, Wei Y (2018) Complex ZFs for computing time-varying complex outer inverses. Neurocomputing 275:983–1001CrossRef
24.
Zurück zum Zitat Liao B, Zhang Y (2014) From different ZFs to different ZNN models accelerated via Li activation functions to finite-time convergence for time-varying matrix pseudoinversion. Neurocomputing 133:512–522CrossRef Liao B, Zhang Y (2014) From different ZFs to different ZNN models accelerated via Li activation functions to finite-time convergence for time-varying matrix pseudoinversion. Neurocomputing 133:512–522CrossRef
25.
Zurück zum Zitat Xiao L, Liao B, Li S, Chen K (2018) Nonlinear recurrent neural networks for finite-time solution of general time-varying linear matrix equations. Neural Netw 98:102–113CrossRef Xiao L, Liao B, Li S, Chen K (2018) Nonlinear recurrent neural networks for finite-time solution of general time-varying linear matrix equations. Neural Netw 98:102–113CrossRef
26.
Zurück zum Zitat Xiao L (2015) A finite-time convergent neural dynamics for online solution of time-varying linear complex matrix equation. Neurocomputing 167:254–259CrossRef Xiao L (2015) A finite-time convergent neural dynamics for online solution of time-varying linear complex matrix equation. Neurocomputing 167:254–259CrossRef
28.
Zurück zum Zitat Xiao L (2016) A new design formula exploited for accelerating Zhang neural network and its application to time-varying matrix inversion. Theor Comput Sci 647:50–58MathSciNetCrossRefMATH Xiao L (2016) A new design formula exploited for accelerating Zhang neural network and its application to time-varying matrix inversion. Theor Comput Sci 647:50–58MathSciNetCrossRefMATH
29.
Zurück zum Zitat Xiao L (2017) A finite-time recurrent neural network for solving online time-varying Sylvester matrix equation based on a new evolution formula. Nonlinear Dyn 90:1581–1591MathSciNetCrossRefMATH Xiao L (2017) A finite-time recurrent neural network for solving online time-varying Sylvester matrix equation based on a new evolution formula. Nonlinear Dyn 90:1581–1591MathSciNetCrossRefMATH
30.
Zurück zum Zitat Xiao L (2017) Accelerating a recurrent neural network to finite-time convergence using a new design formula and its application to time-varying matrix square root. J Frankl Inst 354:5667–5677MathSciNetCrossRefMATH Xiao L (2017) Accelerating a recurrent neural network to finite-time convergence using a new design formula and its application to time-varying matrix square root. J Frankl Inst 354:5667–5677MathSciNetCrossRefMATH
31.
Zurück zum Zitat Xiao L, Liao B, Li S, Zhang Z, Ding L, Jin L (2018) Design and analysis of FTZNN applied to the real-time solution of a nonstationary Lyapunov equation and tracking control of a wheeled mobile manipulator. IEEE Trans Ind Inform 14(1):98–105CrossRef Xiao L, Liao B, Li S, Zhang Z, Ding L, Jin L (2018) Design and analysis of FTZNN applied to the real-time solution of a nonstationary Lyapunov equation and tracking control of a wheeled mobile manipulator. IEEE Trans Ind Inform 14(1):98–105CrossRef
33.
Zurück zum Zitat Li S, Chen S, Liu B (2013) Accelerating a recurrent neural network to finite-time convergence for solving time-varying Sylvester equation by using a sign-bi-power activation function. Neural Process Lett 37:189–205CrossRef Li S, Chen S, Liu B (2013) Accelerating a recurrent neural network to finite-time convergence for solving time-varying Sylvester equation by using a sign-bi-power activation function. Neural Process Lett 37:189–205CrossRef
34.
Zurück zum Zitat Li Z, Zhang Y (2010) Improved Zhang neural network model and its solution of time-varying generalized linear matrix equations. Expert Syst Appl 37:7213–7218CrossRef Li Z, Zhang Y (2010) Improved Zhang neural network model and its solution of time-varying generalized linear matrix equations. Expert Syst Appl 37:7213–7218CrossRef
35.
Zurück zum Zitat Wang X-Z, Ma H, Stanimirović PS (2017) Nonlinearly activated recurrent neural network for computing the Drazin inverse. Neural Process Lett 46:195–217CrossRef Wang X-Z, Ma H, Stanimirović PS (2017) Nonlinearly activated recurrent neural network for computing the Drazin inverse. Neural Process Lett 46:195–217CrossRef
36.
Zurück zum Zitat Zhang Y, Ge SS (2003) A general recurrent neural network model for time-varying matrix inversion. In: Proceedings of 42nd IEEE conference on decision and control, San Diego, vol 6, pp 6169–6174 Zhang Y, Ge SS (2003) A general recurrent neural network model for time-varying matrix inversion. In: Proceedings of 42nd IEEE conference on decision and control, San Diego, vol 6, pp 6169–6174
37.
Zurück zum Zitat Zhang Y, Shi Y, Chen K, Wang C (2009) Global exponential convergence and stability of gradient-based neural network for online matrix inversion. Appl Math Comput 215:1301–1306MathSciNetMATH Zhang Y, Shi Y, Chen K, Wang C (2009) Global exponential convergence and stability of gradient-based neural network for online matrix inversion. Appl Math Comput 215:1301–1306MathSciNetMATH
38.
Zurück zum Zitat Zhang Y, Ma W, Cai B (2009) From Zhang neural network to Newton iteration for matrix inversion. IEEE Trans Circuits Syst I 56(7):1405–1415MathSciNetCrossRef Zhang Y, Ma W, Cai B (2009) From Zhang neural network to Newton iteration for matrix inversion. IEEE Trans Circuits Syst I 56(7):1405–1415MathSciNetCrossRef
39.
Zurück zum Zitat Wang S-D, Kuo T-S, Hsu C-F (1986) Trace bounds on the solution of the algebraic matrix Riccati and Lyapunov equation. IEEE Trans Autom Control AC–31(7):654–656MathSciNetCrossRefMATH Wang S-D, Kuo T-S, Hsu C-F (1986) Trace bounds on the solution of the algebraic matrix Riccati and Lyapunov equation. IEEE Trans Autom Control AC–31(7):654–656MathSciNetCrossRefMATH
40.
Zurück zum Zitat Stanimirović PS, Katsikis VN, Li S (2018) Hybrid GNN–ZNN models for solving linear matrix equations. Neurocomputing 316:124–134CrossRef Stanimirović PS, Katsikis VN, Li S (2018) Hybrid GNN–ZNN models for solving linear matrix equations. Neurocomputing 316:124–134CrossRef
Metadaten
Titel
Improved GNN Models for Constant Matrix Inversion
verfasst von
Predrag S. Stanimirović
Marko D. Petković
Publikationsdatum
28.03.2019
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 1/2019
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-019-10025-9

Weitere Artikel der Ausgabe 1/2019

Neural Processing Letters 1/2019 Zur Ausgabe

Neuer Inhalt