Skip to main content
Erschienen in: Neural Processing Letters 5/2021

24.06.2021

Continuous-Time Varying Complex QR Decomposition via Zeroing Neural Dynamics

verfasst von: Vasilios N. Katsikis, Spyridon D. Mourtas, Predrag S. Stanimirović, Yunong Zhang

Erschienen in: Neural Processing Letters | Ausgabe 5/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

QR decomposition (QRD) is of fundamental importance for matrix factorization in both real and complex cases. In this paper, by using zeroing neural dynamics method, a continuous-time model is proposed for solving the time-varying problem of QRD in real-time. The proposed dynamics use time derivative information from a known real or complex matrix. Furthermore, its theoretical analysis is provided to substantiate the convergence and effectiveness of solving the time-varying QRD problem. In addition, numerical experiments in four different-dimensional time-varying matrices show that the proposed model is effective for solving the time-varying QRD problem both in the case of a real or a complex matrix as input.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Anaraki FP, Becker S (2019) Improved fixed-rank Nyström approximation via QR decomposition: practical and theoretical aspects. Neurocomputing 363:261–272CrossRef Anaraki FP, Becker S (2019) Improved fixed-rank Nyström approximation via QR decomposition: practical and theoretical aspects. Neurocomputing 363:261–272CrossRef
2.
Zurück zum Zitat Anderson M, Ballard G, Demmel J, Keutzer K (2011) Communication-avoiding QR decomposition for GPUs. In: Proceedings of IEEE international parallel distributed processing symposium, pp 48–58 Anderson M, Ballard G, Demmel J, Keutzer K (2011) Communication-avoiding QR decomposition for GPUs. In: Proceedings of IEEE international parallel distributed processing symposium, pp 48–58
3.
Zurück zum Zitat Baumann M, Helmke U (2003) Singular value decomposition of time-varying matrices. Future Gen Comput Syst 19:353–361CrossRef Baumann M, Helmke U (2003) Singular value decomposition of time-varying matrices. Future Gen Comput Syst 19:353–361CrossRef
5.
Zurück zum Zitat Chang RC, Lin C, Lin K, Huang C, Chen F (2010) Iterative QR decomposition architecture using the modified gram-schmidt algorithm for MIMO systems. IEEE Trans Circuits Syst I Regul Pap 57(5):1095–1102MathSciNetCrossRef Chang RC, Lin C, Lin K, Huang C, Chen F (2010) Iterative QR decomposition architecture using the modified gram-schmidt algorithm for MIMO systems. IEEE Trans Circuits Syst I Regul Pap 57(5):1095–1102MathSciNetCrossRef
6.
Zurück zum Zitat Charif F, Benchabane A, Bennia A (2018) A simplified architecture of the Zhang neural network for Toeplitz linear systems solving. Neural Process Lett 47:391–401 Charif F, Benchabane A, Bennia A (2018) A simplified architecture of the Zhang neural network for Toeplitz linear systems solving. Neural Process Lett 47:391–401
7.
Zurück zum Zitat Chen J, Zhang Y (2020) Online singular value decomposition of time-varying matrix via zeroing neural dynamics. Neurocomputing 383:314–323CrossRef Chen J, Zhang Y (2020) Online singular value decomposition of time-varying matrix via zeroing neural dynamics. Neurocomputing 383:314–323CrossRef
9.
Zurück zum Zitat Gatu C, Kontoghiorghes EJ (2003) Parallel algorithms for computing all possible subset regression models using the QR decomposition. Parallel Comput 29(4):505–521MathSciNetCrossRef Gatu C, Kontoghiorghes EJ (2003) Parallel algorithms for computing all possible subset regression models using the QR decomposition. Parallel Comput 29(4):505–521MathSciNetCrossRef
10.
Zurück zum Zitat Ghaderyan P, Abbasi A, Ebrahimi A (2018) Time-varying singular value decomposition analysis of electrodermal activity: a novel method of cognitive load estimation. Measurement 126:102–109CrossRef Ghaderyan P, Abbasi A, Ebrahimi A (2018) Time-varying singular value decomposition analysis of electrodermal activity: a novel method of cognitive load estimation. Measurement 126:102–109CrossRef
11.
Zurück zum Zitat Graham A (2018) Kronecker products and matrix calculus with applications. Dover Publications, MineolaMATH Graham A (2018) Kronecker products and matrix calculus with applications. Dover Publications, MineolaMATH
12.
Zurück zum Zitat Guo D, Nie Z, Yan L (2017) Novel discrete-time Zhang neural network for time-varying matrix inversion. IEEE Trans Syst Man Cybern Syst 47(8):2301–2310CrossRef Guo D, Nie Z, Yan L (2017) Novel discrete-time Zhang neural network for time-varying matrix inversion. IEEE Trans Syst Man Cybern Syst 47(8):2301–2310CrossRef
13.
Zurück zum Zitat Gupta AK (2014) Numerical methods using MATLAB. MATLAB solutions series. Springer Press, New YorkCrossRef Gupta AK (2014) Numerical methods using MATLAB. MATLAB solutions series. Springer Press, New YorkCrossRef
14.
Zurück zum Zitat Horn RA, Johnson CR (1991) Topics in matrix analysis. Cambridge University Press, New YorkCrossRef Horn RA, Johnson CR (1991) Topics in matrix analysis. Cambridge University Press, New YorkCrossRef
15.
Zurück zum Zitat Jin L, Zhang Y, Li S, Zhang Y (2016) Modified ZNN for time-varying quadratic programming with inherent tolerance to noises and its application to kinematic redundancy resolution of robot manipulators. IEEE Trans Ind Electron 63(11):6978–6988CrossRef Jin L, Zhang Y, Li S, Zhang Y (2016) Modified ZNN for time-varying quadratic programming with inherent tolerance to noises and its application to kinematic redundancy resolution of robot manipulators. IEEE Trans Ind Electron 63(11):6978–6988CrossRef
16.
Zurück zum Zitat Jin L, Zhang Y (2016) Continuous and discrete Zhang dynamics for real-time varying nonlinear optimization. Numer Algorithms 73:115–140MathSciNetCrossRef Jin L, Zhang Y (2016) Continuous and discrete Zhang dynamics for real-time varying nonlinear optimization. Numer Algorithms 73:115–140MathSciNetCrossRef
17.
Zurück zum Zitat Kerr A, Campbell D, Richards MA (2009) QR decomposition on GPUs. In: Kaeli DR, Leeser M (eds) Proceedings of 2nd workshop on general purpose processing on graphics processing units, GPGPU 2009, Washington, DC, USA, March 8, 2009, vol 383 of ACM international conference proceeding series. ACM, pp 71–78 Kerr A, Campbell D, Richards MA (2009) QR decomposition on GPUs. In: Kaeli DR, Leeser M (eds) Proceedings of 2nd workshop on general purpose processing on graphics processing units, GPGPU 2009, Washington, DC, USA, March 8, 2009, vol 383 of ACM international conference proceeding series. ACM, pp 71–78
18.
Zurück zum Zitat Kokkinos Y, Margaritis KG (2018) Managing the computational cost of model selection and cross-validation in extreme learning machines via Cholesky. SVD, QR and eigen decompositions. Neurocomputing 295:29–45CrossRef Kokkinos Y, Margaritis KG (2018) Managing the computational cost of model selection and cross-validation in extreme learning machines via Cholesky. SVD, QR and eigen decompositions. Neurocomputing 295:29–45CrossRef
19.
Zurück zum Zitat Liang Z, Shi P (2004) An efficient and effective method to solve kernel Fisher discriminant analysis. Neurocomputing 61:485–493CrossRef Liang Z, Shi P (2004) An efficient and effective method to solve kernel Fisher discriminant analysis. Neurocomputing 61:485–493CrossRef
20.
Zurück zum Zitat Liao B, Zhang Y (2014) Different complex ZFs leading to different complex ZNN models for time-varying complex generalized inverse matrices. IEEE Trans Neural Netw Learn Syst 25(9):1621–1631CrossRef Liao B, Zhang Y (2014) Different complex ZFs leading to different complex ZNN models for time-varying complex generalized inverse matrices. IEEE Trans Neural Netw Learn Syst 25(9):1621–1631CrossRef
21.
Zurück zum Zitat Liao B, Zhang Y (2014) From different ZFs to different ZNN models accelerated via Li activation functions to finite-time convergence for time-varying matrix pseudoinversion. Neurocomputing 133:512–522CrossRef Liao B, Zhang Y (2014) From different ZFs to different ZNN models accelerated via Li activation functions to finite-time convergence for time-varying matrix pseudoinversion. Neurocomputing 133:512–522CrossRef
22.
Zurück zum Zitat Liu C, Tang C, Yuan L, Xing Z, Zhang Y (2016) QR decomposition architecture using the iteration look-ahead modified gram-Schmidt algorithm. Dev Syst IET Circuits 10(5):402–409CrossRef Liu C, Tang C, Yuan L, Xing Z, Zhang Y (2016) QR decomposition architecture using the iteration look-ahead modified gram-Schmidt algorithm. Dev Syst IET Circuits 10(5):402–409CrossRef
23.
Zurück zum Zitat Luethi P, Studer C, Duetsch S, Zgraggen E, Kaeslin H, Felber N, Fichtner W (2008) Gram-Schmidt-based QR decomposition for MIMO detection: VLSI implementation and comparison. In: Proceedings of APCCAS 2008–2008 IEEE asia pacific conference on circuits and systems, pp 830–833 Luethi P, Studer C, Duetsch S, Zgraggen E, Kaeslin H, Felber N, Fichtner W (2008) Gram-Schmidt-based QR decomposition for MIMO detection: VLSI implementation and comparison. In: Proceedings of APCCAS 2008–2008 IEEE asia pacific conference on circuits and systems, pp 830–833
24.
Zurück zum Zitat Penrose R (1956) On a best approximate solutions to linear matrix equations. Proc Camb Philos Soc 52:17–19CrossRef Penrose R (1956) On a best approximate solutions to linear matrix equations. Proc Camb Philos Soc 52:17–19CrossRef
25.
Zurück zum Zitat Petković MD, Stanimirović PS, Katsikis VN (2018) Modified discrete iterations for computing the inverse and pseudoinverse of the time-varying matrix. Neurocomputing 289:155–165CrossRef Petković MD, Stanimirović PS, Katsikis VN (2018) Modified discrete iterations for computing the inverse and pseudoinverse of the time-varying matrix. Neurocomputing 289:155–165CrossRef
26.
Zurück zum Zitat Stanimirović PS, Katsikis VN, Li S (2018) Hybrid GNN-ZNN models for solving linear matrix equations. Neurocomputing 316:124–134CrossRef Stanimirović PS, Katsikis VN, Li S (2018) Hybrid GNN-ZNN models for solving linear matrix equations. Neurocomputing 316:124–134CrossRef
27.
Zurück zum Zitat Stanimirović PS, Katsikis VN, Li S (2019) Higher-order ZNN dynamics. Neural Process Lett 1–25 Stanimirović PS, Katsikis VN, Li S (2019) Higher-order ZNN dynamics. Neural Process Lett 1–25
28.
Zurück zum Zitat Stanimirovic PS, Pappas D, Katsikis VN, Stanimirović IP (2012) Full-rank representations of outer inverses based on the QR decomposition. Appl Math Comput 218(20):10321–10333MathSciNetMATH Stanimirovic PS, Pappas D, Katsikis VN, Stanimirović IP (2012) Full-rank representations of outer inverses based on the QR decomposition. Appl Math Comput 218(20):10321–10333MathSciNetMATH
29.
Zurück zum Zitat Stanimirović PS, Katsikis VN, Zhang Z, Li S, Chen J, Zhou M (2019) Varying-parameter Zhang neural network for approximating some expressions involving outer inverses. Optim Methods Softw 1–27 Stanimirović PS, Katsikis VN, Zhang Z, Li S, Chen J, Zhou M (2019) Varying-parameter Zhang neural network for approximating some expressions involving outer inverses. Optim Methods Softw 1–27
30.
Zurück zum Zitat Stanimirović PS, Katsikis VN, Li S (2019) Integration enhanced and noise tolerant ZNN for computing various expressions involving outer inverses. Neurocomputing 329:129–143CrossRef Stanimirović PS, Katsikis VN, Li S (2019) Integration enhanced and noise tolerant ZNN for computing various expressions involving outer inverses. Neurocomputing 329:129–143CrossRef
31.
Zurück zum Zitat Ullah I, Nisar H, Raza H, Qasim M, Inam O, Omer H (2018) QR-decomposition based SENSE reconstruction using parallel architecture. Comp Biol Med 95:1–12CrossRef Ullah I, Nisar H, Raza H, Qasim M, Inam O, Omer H (2018) QR-decomposition based SENSE reconstruction using parallel architecture. Comp Biol Med 95:1–12CrossRef
32.
Zurück zum Zitat Wang G, Wei Y, Qiao S (2018) Generalized inverses: theory and computations, developments in mathematics, vol 53. Springer, SingaporeCrossRef Wang G, Wei Y, Qiao S (2018) Generalized inverses: theory and computations, developments in mathematics, vol 53. Springer, SingaporeCrossRef
33.
Zurück zum Zitat Xiao L (2015) A finite-time convergent neural dynamics for online solution of time-varying linear complex matrix equation. Neurocomputing 167:254–259CrossRef Xiao L (2015) A finite-time convergent neural dynamics for online solution of time-varying linear complex matrix equation. Neurocomputing 167:254–259CrossRef
34.
Zurück zum Zitat Xiao L (2016) A nonlinearly-activated neurodynamic model and its finite-time solution to equality-constrained quadratic optimization with nonstationary coefficients. Appl Soft Comput 40:252–259CrossRef Xiao L (2016) A nonlinearly-activated neurodynamic model and its finite-time solution to equality-constrained quadratic optimization with nonstationary coefficients. Appl Soft Comput 40:252–259CrossRef
35.
Zurück zum Zitat Yang L, Ren G, Qiu Z (2010) Novel noise reduction algorithm for LS channel estimation in OFDM system with frequency selective channels. In: Proceedings of IEEE international conference on communication systems, pp 478–482 Yang L, Ren G, Qiu Z (2010) Novel noise reduction algorithm for LS channel estimation in OFDM system with frequency selective channels. In: Proceedings of IEEE international conference on communication systems, pp 478–482
36.
Zurück zum Zitat Ye Q, Ye N, Yin T (2015) Fast orthogonal linear discriminant analysis with application to image classification. Neurocomputing 158:216–224CrossRef Ye Q, Ye N, Yin T (2015) Fast orthogonal linear discriminant analysis with application to image classification. Neurocomputing 158:216–224CrossRef
37.
Zurück zum Zitat Yu J, Rui Y, Tao D (2014) Click prediction for web image reranking using multimodal sparse coding. IEEE Trans Image Process 23(5):2019–2032MathSciNetCrossRef Yu J, Rui Y, Tao D (2014) Click prediction for web image reranking using multimodal sparse coding. IEEE Trans Image Process 23(5):2019–2032MathSciNetCrossRef
38.
Zurück zum Zitat Yu J, Tan M, Zhang H, Tao D, Rui Y (2019) Hierarchical deep click feature prediction for fine-grained image recognition. IEEE Trans Pattern Anal Mach Intell 1–1 Yu J, Tan M, Zhang H, Tao D, Rui Y (2019) Hierarchical deep click feature prediction for fine-grained image recognition. IEEE Trans Pattern Anal Mach Intell 1–1
39.
Zurück zum Zitat Zhang Y, Yi C (2011) Zhang neural networks and neural-dynamic method. Nova Science Publishers Inc, New York Zhang Y, Yi C (2011) Zhang neural networks and neural-dynamic method. Nova Science Publishers Inc, New York
40.
Zurück zum Zitat Zhang Y, Jin L, Guo D, Yin Y, Chou Y (2015) Taylor-type 1-step-ahead numerical differentiation rule for first-order derivative approximation and ZNN discretization. J Comput Appl Math 273:29–40MathSciNetCrossRef Zhang Y, Jin L, Guo D, Yin Y, Chou Y (2015) Taylor-type 1-step-ahead numerical differentiation rule for first-order derivative approximation and ZNN discretization. J Comput Appl Math 273:29–40MathSciNetCrossRef
41.
Zurück zum Zitat Zhang Y, Huang H, Yang M, Ling Y, Li J (2020) New zeroing neural dynamics models for diagonalization of symmetric matrix stream. Numer Algorithms 85:849–866MathSciNetCrossRef Zhang Y, Huang H, Yang M, Ling Y, Li J (2020) New zeroing neural dynamics models for diagonalization of symmetric matrix stream. Numer Algorithms 85:849–866MathSciNetCrossRef
42.
Zurück zum Zitat Zhao C, Chen Y, Wei Z, Miao D, Gu X (2019) QRKISS: a two-stage metric learning via QR-decomposition and KISS for person re-identification. Neural Process Lett 49:899–922CrossRef Zhao C, Chen Y, Wei Z, Miao D, Gu X (2019) QRKISS: a two-stage metric learning via QR-decomposition and KISS for person re-identification. Neural Process Lett 49:899–922CrossRef
Metadaten
Titel
Continuous-Time Varying Complex QR Decomposition via Zeroing Neural Dynamics
verfasst von
Vasilios N. Katsikis
Spyridon D. Mourtas
Predrag S. Stanimirović
Yunong Zhang
Publikationsdatum
24.06.2021
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 5/2021
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-021-10566-y

Weitere Artikel der Ausgabe 5/2021

Neural Processing Letters 5/2021 Zur Ausgabe

Neuer Inhalt