Skip to main content
Erschienen in: Neural Processing Letters 3/2021

27.07.2019

Two Matrix-Type Projection Neural Networks for Matrix-Valued Optimization with Application to Image Restoration

verfasst von: Lingmei Huang, Youshen Xia, Liqing Huang, Songchuan Zhang

Erschienen in: Neural Processing Letters | Ausgabe 3/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In recent years, matrix-valued optimization algorithms have been studied to enhance the computational performance of vector-valued optimization algorithms. This paper presents two matrix-type projection neural networks, continuous-time and discrete-time ones, for solving matrix-valued optimization problems. The proposed continuous-time neural network may be viewed as a significant extension to the vector-type double projection neural network. More importantly, the proposed discrete-time projection neural network is suitable for parallel implementation in terms of matrix state spaces. Under pseudo-monotonicity and Lipschitz continuous conditions, the proposed two matrix-type projection neural networks are guaranteed to be globally convergent to the optimal solution. Finally, the proposed matrix-type projection neural network is effectively applied to image restoration. Computed examples show that the two proposed matrix-type projection neural networks are much superior to the vector-type projection neural networks in terms of computation speed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Kalouptsidis N (1997) Signal processing systems: theory and design Kalouptsidis N (1997) Signal processing systems: theory and design
2.
Zurück zum Zitat Mohammed JL, Hummel RA, Zucker SW (1983) A gradient projection algorithm for relaxation methods. IEEE Trans Pattern Anal Mach Intell 5:330–332CrossRef Mohammed JL, Hummel RA, Zucker SW (1983) A gradient projection algorithm for relaxation methods. IEEE Trans Pattern Anal Mach Intell 5:330–332CrossRef
3.
Zurück zum Zitat Grant M, Boyd S, Ye Y (2006) Disciplined convex programming. Springer, New YorkCrossRef Grant M, Boyd S, Ye Y (2006) Disciplined convex programming. Springer, New YorkCrossRef
4.
Zurück zum Zitat Vanderbei RJ, Shanno DF (1999) An interior-point algorithm for nonconvex nonlinear programming. Comput Optim Appl 13:231–252MathSciNetCrossRef Vanderbei RJ, Shanno DF (1999) An interior-point algorithm for nonconvex nonlinear programming. Comput Optim Appl 13:231–252MathSciNetCrossRef
5.
Zurück zum Zitat Zhang SC, Xia YS (2018) Solving nonlinear optimization problems of real functions in complex variables by complex-valued iterative methods. IEEE Trans Cybern 48:277–287CrossRef Zhang SC, Xia YS (2018) Solving nonlinear optimization problems of real functions in complex variables by complex-valued iterative methods. IEEE Trans Cybern 48:277–287CrossRef
6.
Zurück zum Zitat Xia YS (1996) A new neural network for solving linear programming problems and its application. IEEE Trans Neural Netw 7:525–529CrossRef Xia YS (1996) A new neural network for solving linear programming problems and its application. IEEE Trans Neural Netw 7:525–529CrossRef
7.
Zurück zum Zitat Xia YS, Wang J (2004) A recurrent neural network for nonlinear convex optimization subject to nonlinear inequality constraints. IEEE Trans Circuits Syst I Regul Pap 51:1385–1394MathSciNetCrossRef Xia YS, Wang J (2004) A recurrent neural network for nonlinear convex optimization subject to nonlinear inequality constraints. IEEE Trans Circuits Syst I Regul Pap 51:1385–1394MathSciNetCrossRef
8.
Zurück zum Zitat Xia YS (2009) A compact cooperative recurrent neural network for computing general constrained L1 norm estimators. IEEE Press, PiscatawayMATH Xia YS (2009) A compact cooperative recurrent neural network for computing general constrained L1 norm estimators. IEEE Press, PiscatawayMATH
9.
Zurück zum Zitat Xia YS, Wang J (1998) A general methodology for designing globally convergent optimization neural networks. IEEE Trans Neural Netw 9:1331–1343CrossRef Xia YS, Wang J (1998) A general methodology for designing globally convergent optimization neural networks. IEEE Trans Neural Netw 9:1331–1343CrossRef
10.
Zurück zum Zitat Liu QS, Wang J (2008) A one-layer recurrent neural network for non-smooth convex optimization subject to linear equality constraints. In: International conference on neural information processing, pp 1003–1010 Liu QS, Wang J (2008) A one-layer recurrent neural network for non-smooth convex optimization subject to linear equality constraints. In: International conference on neural information processing, pp 1003–1010
11.
12.
Zurück zum Zitat Rodriguez-Vazquez A, Dominguez-Castro R, Rueda A, Huertas JL (1990) Nonlinear switched capacitor neural networks for optimization problems. IEEE Trans Circuits Syst 37:384–398MathSciNetCrossRef Rodriguez-Vazquez A, Dominguez-Castro R, Rueda A, Huertas JL (1990) Nonlinear switched capacitor neural networks for optimization problems. IEEE Trans Circuits Syst 37:384–398MathSciNetCrossRef
13.
Zurück zum Zitat Zhang S, Constantinides AG (1992) Lagrange programming neural networks. IEEE Trans Circuits Syst II Analog Digit Signal Process 39:441–452CrossRef Zhang S, Constantinides AG (1992) Lagrange programming neural networks. IEEE Trans Circuits Syst II Analog Digit Signal Process 39:441–452CrossRef
14.
Zurück zum Zitat Xia YS, Leung H, Wang J (2002) A projection neural network and its application to constrained optimization problems. IEEE Trans Circuits Syst I Fundam Theory Appl 49:447–458MathSciNetCrossRef Xia YS, Leung H, Wang J (2002) A projection neural network and its application to constrained optimization problems. IEEE Trans Circuits Syst I Fundam Theory Appl 49:447–458MathSciNetCrossRef
15.
Zurück zum Zitat Xia YS, Feng G, Wang J (2008) A novel recurrent neural network for solving nonlinear optimization problems with inequality constraints. IEEE Trans Neural Netw 19:1340–1353CrossRef Xia YS, Feng G, Wang J (2008) A novel recurrent neural network for solving nonlinear optimization problems with inequality constraints. IEEE Trans Neural Netw 19:1340–1353CrossRef
16.
Zurück zum Zitat Xia YS (2004) An extended projection neural network for constrained optimization. Neural Comput 16:863–883CrossRef Xia YS (2004) An extended projection neural network for constrained optimization. Neural Comput 16:863–883CrossRef
17.
Zurück zum Zitat Xia YS, Wang J (2007) Solving variational inequality problems with linear constraints based on a novel recurrent neural network. In: International symposium on advances in neural networks-ISNN, DBLP Xia YS, Wang J (2007) Solving variational inequality problems with linear constraints based on a novel recurrent neural network. In: International symposium on advances in neural networks-ISNN, DBLP
18.
Zurück zum Zitat Xia YS, Wang J (2016) A bi-projection neural network for solving constrained quadratic optimization problems. IEEE Trans Neural Netw Learn Syst 27:214–224MathSciNetCrossRef Xia YS, Wang J (2016) A bi-projection neural network for solving constrained quadratic optimization problems. IEEE Trans Neural Netw Learn Syst 27:214–224MathSciNetCrossRef
19.
Zurück zum Zitat Xia YS (2009) New cooperative projection neural network for nonlinearly constrained variational inequality. Sci China 52:1766–1777MathSciNetMATH Xia YS (2009) New cooperative projection neural network for nonlinearly constrained variational inequality. Sci China 52:1766–1777MathSciNetMATH
20.
Zurück zum Zitat Cheng L, Hou ZG, Lin Y et al (2011) Recurrent neural network for non-smooth convex optimization problems with application to the identification of genetic regulatory networks. IEEE Trans Neural Netw 22:714–726CrossRef Cheng L, Hou ZG, Lin Y et al (2011) Recurrent neural network for non-smooth convex optimization problems with application to the identification of genetic regulatory networks. IEEE Trans Neural Netw 22:714–726CrossRef
21.
Zurück zum Zitat Eshaghnezhad M, Effati S, Mansoori A (2016) A neurodynamic model to solve nonlinear pseudo-monotone projection equation and its applications. IEEE Trans Cybern 47:3050–3062CrossRef Eshaghnezhad M, Effati S, Mansoori A (2016) A neurodynamic model to solve nonlinear pseudo-monotone projection equation and its applications. IEEE Trans Cybern 47:3050–3062CrossRef
22.
Zurück zum Zitat Xia YS, Chen T, Shan J (2014) A novel iterative method for computing generalized inverse. MIT Press, CambridgeCrossRef Xia YS, Chen T, Shan J (2014) A novel iterative method for computing generalized inverse. MIT Press, CambridgeCrossRef
23.
Zurück zum Zitat Xia YS, Deng ZP, Zheng WX (2013) Analysis and application of a novel fast algorithm for 2-D ARMA model parameter estimation. Automatica 49(10):3056–3064MathSciNetCrossRef Xia YS, Deng ZP, Zheng WX (2013) Analysis and application of a novel fast algorithm for 2-D ARMA model parameter estimation. Automatica 49(10):3056–3064MathSciNetCrossRef
24.
Zurück zum Zitat Xia YS, Wang J (2018) Robust regression estimation based on low-dimensional recurrent neural networks. IEEE Trans Neural Netw Learn Syst 29(12):5935–5946MathSciNetCrossRef Xia YS, Wang J (2018) Robust regression estimation based on low-dimensional recurrent neural networks. IEEE Trans Neural Netw Learn Syst 29(12):5935–5946MathSciNetCrossRef
25.
Zurück zum Zitat Li Z, Cheng H, Guo H (2017) General recurrent neural network for solving generalized linear matrix equation. Complexity 3:1–7MathSciNetMATH Li Z, Cheng H, Guo H (2017) General recurrent neural network for solving generalized linear matrix equation. Complexity 3:1–7MathSciNetMATH
26.
Zurück zum Zitat Bouhamidi A, Jbilou K, Raydan M (2011) Convex constrained optimization for large-scale generalized Sylvester equations. Kluwer Academic Publishers, DordrechtCrossRef Bouhamidi A, Jbilou K, Raydan M (2011) Convex constrained optimization for large-scale generalized Sylvester equations. Kluwer Academic Publishers, DordrechtCrossRef
27.
Zurück zum Zitat Shi QB, Xia YS (2014) Fast multi-channel image reconstruction using a novel two-dimensional algorithm. Multimed Tools Appl 71:2015–2028CrossRef Shi QB, Xia YS (2014) Fast multi-channel image reconstruction using a novel two-dimensional algorithm. Multimed Tools Appl 71:2015–2028CrossRef
28.
Zurück zum Zitat Li JF, Li W, Huang R (2016) An efficient method for solving a matrix least squares problem over a matrix inequality constraint. Kluwer Academic Publishers, DordrechtCrossRef Li JF, Li W, Huang R (2016) An efficient method for solving a matrix least squares problem over a matrix inequality constraint. Kluwer Academic Publishers, DordrechtCrossRef
29.
Zurück zum Zitat Bouhamidi A (2012) A kronecker approximation with a convex constrained optimization method for blind image restoration. Optim Lett 6:1251–1264MathSciNetCrossRef Bouhamidi A (2012) A kronecker approximation with a convex constrained optimization method for blind image restoration. Optim Lett 6:1251–1264MathSciNetCrossRef
30.
Zurück zum Zitat Bertsekas DP, Tsitsiklis JN (1989) Parallel and distributed computation: numerical methods. Prentice Hall, Upper Saddle RiverMATH Bertsekas DP, Tsitsiklis JN (1989) Parallel and distributed computation: numerical methods. Prentice Hall, Upper Saddle RiverMATH
31.
Zurück zum Zitat Kinderlehrer D, Stampcchia G (1980) An introduction to variational inequalities and their applications. Academic, New York Kinderlehrer D, Stampcchia G (1980) An introduction to variational inequalities and their applications. Academic, New York
32.
Zurück zum Zitat Xia YS, Leung H, Kamel MS (2016) A discrete-time learning algorithm for image restoration using a novel L2-norm noise constrained estimation. Neurocomputing 198:155–170CrossRef Xia YS, Leung H, Kamel MS (2016) A discrete-time learning algorithm for image restoration using a novel L2-norm noise constrained estimation. Neurocomputing 198:155–170CrossRef
Metadaten
Titel
Two Matrix-Type Projection Neural Networks for Matrix-Valued Optimization with Application to Image Restoration
verfasst von
Lingmei Huang
Youshen Xia
Liqing Huang
Songchuan Zhang
Publikationsdatum
27.07.2019
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2021
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-019-10086-w

Weitere Artikel der Ausgabe 3/2021

Neural Processing Letters 3/2021 Zur Ausgabe

Neuer Inhalt