Skip to main content
Top
Published in: Neural Computing and Applications 10/2021

14-09-2020 | Original Article

Prescribed-time convergent and noise-tolerant Z-type neural dynamics for calculating time-dependent quadratic programming

Authors: Bolin Liao, Yuyan Wang, Weibing Li, Chen Peng, Qiuhong Xiang

Published in: Neural Computing and Applications | Issue 10/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Neural-dynamics methods for solving quadratic programming (QP) have been studied for decades. The main feature of a neural-dynamics solver is that it can generate a continuous path from the initial point, and the final path will converge to the solution. In particular, the Z-type neural dynamics (ZND) that has emerged in recent years shows that it can completely converge to the ideal solution for the real-time-dependent QP in the ideal situation, i.e., without noise. It is worth noting that noise substantially influences the accuracy of neural-dynamics models in the process of solving the problems. Nevertheless, the existing neural-dynamics methods show limited capacity of noise tolerance, which may seriously affect their application in practical problems. By exploiting the Z-type design formula and two nonlinear activation functions, this work proposes a prescribed-time convergent and noise-tolerant ZND (PTCNTZND) model for calculating real-time-dependent QPs under noisy environments. Theoretical analyses of the PTCNTZND model show that it can be accelerated to prescribed-time convergence to the time-dependent optimal solution, and has natural anti-noise ability. The upper bound of the convergence time is also derived theoretically. Finally, the performance of the PTCNTZND model was verified by experiments, and the results substantiate the excellent robustness and convergence characteristics of the proposed PTCNTZND model for calculating real-time-dependent QPs, as compared with the existing ZND models.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Aubry A, De Maio A, Piezzo M, Farina A (2014) Radar waveform design in a spectrally crowded environment via nonconvex quadratic optimization. IEEE Trans Aerosp Electron Syst 50:1138–1152CrossRef Aubry A, De Maio A, Piezzo M, Farina A (2014) Radar waveform design in a spectrally crowded environment via nonconvex quadratic optimization. IEEE Trans Aerosp Electron Syst 50:1138–1152CrossRef
2.
go back to reference Mattingley J, Boyd S (2010) Real-time convex optimization in signal processing. IEEE Signal Process Mag 27:50–61CrossRef Mattingley J, Boyd S (2010) Real-time convex optimization in signal processing. IEEE Signal Process Mag 27:50–61CrossRef
3.
go back to reference Johansen TA, Fsosen TI, Berge SP (2004) Constrained nonlinear control allocation with singularity avoidance using sequential quadratic programming. IEEE Trans Control Syst Technol 12:211–216CrossRef Johansen TA, Fsosen TI, Berge SP (2004) Constrained nonlinear control allocation with singularity avoidance using sequential quadratic programming. IEEE Trans Control Syst Technol 12:211–216CrossRef
4.
go back to reference Miao P, Shen Y, Huang Y, Wang Y-W (2015) Solving time-varying quadratic programs based on finite-time Zhang neural networks and their application to robot tracking. Neural Comput Appl 26:693–703CrossRef Miao P, Shen Y, Huang Y, Wang Y-W (2015) Solving time-varying quadratic programs based on finite-time Zhang neural networks and their application to robot tracking. Neural Comput Appl 26:693–703CrossRef
5.
go back to reference Liao B, Zhang Y, Jin L (2016) Taylor \(O(h^{3})\) discretization of ZNN models for dynamic equality-constrained quadratic programming with application to manipulators. IEEE Trans Neural Netw Learn Syst 27:225–237MathSciNetCrossRef Liao B, Zhang Y, Jin L (2016) Taylor \(O(h^{3})\) discretization of ZNN models for dynamic equality-constrained quadratic programming with application to manipulators. IEEE Trans Neural Netw Learn Syst 27:225–237MathSciNetCrossRef
6.
go back to reference Boyd S, Vandenberghe L (2004) Convex optimization. Cambridge University Press, CambridgeCrossRef Boyd S, Vandenberghe L (2004) Convex optimization. Cambridge University Press, CambridgeCrossRef
7.
go back to reference Wu AI, Tam PKS (1999) A neural network methodology and strategy of quadratic optimisation. Neural Comput Appl 8:283–289CrossRef Wu AI, Tam PKS (1999) A neural network methodology and strategy of quadratic optimisation. Neural Comput Appl 8:283–289CrossRef
8.
go back to reference Guzmán C, Nemirovski A (2015) On lower complexity bounds for large-scale smooth convex optimization. J Complex 31:1–14MathSciNetCrossRef Guzmán C, Nemirovski A (2015) On lower complexity bounds for large-scale smooth convex optimization. J Complex 31:1–14MathSciNetCrossRef
9.
go back to reference Hopfield JJ, Tank DW (1985) Neural computation of decisions in optimization problems. Biol Cybern 52:141–152MATH Hopfield JJ, Tank DW (1985) Neural computation of decisions in optimization problems. Biol Cybern 52:141–152MATH
10.
go back to reference Guo D, Yi C, Zhang Y (2011) Zhang neural network versus gradient-based neural network for time-varying linear matrix equation solving. Neurocomputing 74:3708–3712CrossRef Guo D, Yi C, Zhang Y (2011) Zhang neural network versus gradient-based neural network for time-varying linear matrix equation solving. Neurocomputing 74:3708–3712CrossRef
11.
go back to reference Feng J, Qin S, Shi F, Zhao X (2018) A recurrent neural network with finite-time convergence for convex quadratic bilevel programming problems. Neural Comput Appl 30:3399–3408CrossRef Feng J, Qin S, Shi F, Zhao X (2018) A recurrent neural network with finite-time convergence for convex quadratic bilevel programming problems. Neural Comput Appl 30:3399–3408CrossRef
12.
go back to reference Ding L, Xiao L, Liao B, Jin J, Liu M (2016) Novel complex-valued neural network for dynamic complex-valued matrix inversion. J Adv Comput Intell Intell Informat 20:132–138CrossRef Ding L, Xiao L, Liao B, Jin J, Liu M (2016) Novel complex-valued neural network for dynamic complex-valued matrix inversion. J Adv Comput Intell Intell Informat 20:132–138CrossRef
13.
go back to reference Jin L, Zhang Y (2015) Discrete-time Zhang neural network for online time-varying nonlinear optimization with application to manipulator motion generation. IEEE Trans Neural Netw Learn Syst 26:1525–1531MathSciNetCrossRef Jin L, Zhang Y (2015) Discrete-time Zhang neural network for online time-varying nonlinear optimization with application to manipulator motion generation. IEEE Trans Neural Netw Learn Syst 26:1525–1531MathSciNetCrossRef
15.
go back to reference Forti M, Nistri P, Quincampoix M (2004) Generalized neural network for nonsmooth nonlinear programming problems. IEEE Trans Circuits Syst I-Regul Pap 51:1741–1754MathSciNetCrossRef Forti M, Nistri P, Quincampoix M (2004) Generalized neural network for nonsmooth nonlinear programming problems. IEEE Trans Circuits Syst I-Regul Pap 51:1741–1754MathSciNetCrossRef
16.
go back to reference Liu S, Wang J (2006) A simplified dual neural network for quadratic programming with its KWTA application. IEEE Trans Neural Netw 17:1500–1510CrossRef Liu S, Wang J (2006) A simplified dual neural network for quadratic programming with its KWTA application. IEEE Trans Neural Netw 17:1500–1510CrossRef
17.
go back to reference Tao Q, Cao J, Sun D (2001) A simple and high performance neurel network for quadratic programming problems. Appl Math Comput 124:251–260MathSciNetMATH Tao Q, Cao J, Sun D (2001) A simple and high performance neurel network for quadratic programming problems. Appl Math Comput 124:251–260MathSciNetMATH
18.
go back to reference Sun DI, Ashley B, Brewer B, Hughes A, Tinney WF (1984) Optimal power flow by newton approach. IEEE Trans Power App Syst 103:2864–2880CrossRef Sun DI, Ashley B, Brewer B, Hughes A, Tinney WF (1984) Optimal power flow by newton approach. IEEE Trans Power App Syst 103:2864–2880CrossRef
19.
go back to reference Zhang Y, Li W, Guo D, Ke Z (2013) Different Zhang functions leading to different ZNN models illustrated via time-varying matrix square roots finding. Expert Syst Appl 40:4393–4403CrossRef Zhang Y, Li W, Guo D, Ke Z (2013) Different Zhang functions leading to different ZNN models illustrated via time-varying matrix square roots finding. Expert Syst Appl 40:4393–4403CrossRef
20.
go back to reference Zhang Y, Li Z (2009) Zhang neural network for online solution of time-varying convex quadratic program subject to time-varying linear-equality constraints. Phys Lett A 373:1639–1643CrossRef Zhang Y, Li Z (2009) Zhang neural network for online solution of time-varying convex quadratic program subject to time-varying linear-equality constraints. Phys Lett A 373:1639–1643CrossRef
21.
go back to reference Guo D, Zhang Y (2015) ZNN for solving online time-varying linear matrix-vector inequality via equality conversion. Appl Math Comput 259:327–338MathSciNetMATH Guo D, Zhang Y (2015) ZNN for solving online time-varying linear matrix-vector inequality via equality conversion. Appl Math Comput 259:327–338MathSciNetMATH
22.
go back to reference Zhang Z, Lu Y, Zheng L, Li S, Yu Z, Li Y (2018) A new varying-parameter convergent-differential neural-network for solving time-varying convex QP problem constrained by linear-equality. IEEE Trans Autom Control 63:4110–4125MathSciNetCrossRef Zhang Z, Lu Y, Zheng L, Li S, Yu Z, Li Y (2018) A new varying-parameter convergent-differential neural-network for solving time-varying convex QP problem constrained by linear-equality. IEEE Trans Autom Control 63:4110–4125MathSciNetCrossRef
23.
go back to reference Li S, Li Y, Wang Z (2013) A class of finite-time dual neural networks for solving quadratic programming problems and its \(k\)-winners-take-all application. Neural Netw 39:27–39CrossRef Li S, Li Y, Wang Z (2013) A class of finite-time dual neural networks for solving quadratic programming problems and its \(k\)-winners-take-all application. Neural Netw 39:27–39CrossRef
24.
go back to reference Liao B, Zhang Y (2014) From different ZFs to different ZNN models accelerated via Li activation functions to finite-time convergence for time-varying matrix pseudoinversion. Neurocomputing 133:512–522CrossRef Liao B, Zhang Y (2014) From different ZFs to different ZNN models accelerated via Li activation functions to finite-time convergence for time-varying matrix pseudoinversion. Neurocomputing 133:512–522CrossRef
25.
go back to reference Xiao L, Liao B, Li S, Chen K (2018) Nonlinear recurrent neural networks for finite-time solution of general time-varying linear matrix equations. Neural Netw 98:102–113CrossRef Xiao L, Liao B, Li S, Chen K (2018) Nonlinear recurrent neural networks for finite-time solution of general time-varying linear matrix equations. Neural Netw 98:102–113CrossRef
26.
go back to reference Polyakov A (2012) Nonlinear feedback design for fixed-time stabilization of linear control systems. IEEE Trans Autom Control 57:2106–2110MathSciNetCrossRef Polyakov A (2012) Nonlinear feedback design for fixed-time stabilization of linear control systems. IEEE Trans Autom Control 57:2106–2110MathSciNetCrossRef
27.
go back to reference Khelil N, Otis MJD (2016) Finite-time stabilization of homogeneous non-Lipschitz systems. Mathematics 4:58CrossRef Khelil N, Otis MJD (2016) Finite-time stabilization of homogeneous non-Lipschitz systems. Mathematics 4:58CrossRef
28.
go back to reference Xiao L (2016) A nonlinearly activated neural dynamics and its finite-time solution to time-varying nonlinear equation. Neurocomputing 173:1983–1988CrossRef Xiao L (2016) A nonlinearly activated neural dynamics and its finite-time solution to time-varying nonlinear equation. Neurocomputing 173:1983–1988CrossRef
29.
go back to reference Xiao L (2019) A finite-time convergent zhang neural network and its application to real-time matrix square root finding. Neural Comput Appl 31:793–800CrossRef Xiao L (2019) A finite-time convergent zhang neural network and its application to real-time matrix square root finding. Neural Comput Appl 31:793–800CrossRef
30.
go back to reference Jin L, Zhang Y, Li S (2016) Integration-enhanced Zhang neural network for real-time-varying matrix inversion in the presence of various kinds of noises. IEEE Trans Neural Netw Learn Syst 27:2615–2627CrossRef Jin L, Zhang Y, Li S (2016) Integration-enhanced Zhang neural network for real-time-varying matrix inversion in the presence of various kinds of noises. IEEE Trans Neural Netw Learn Syst 27:2615–2627CrossRef
31.
go back to reference Xiang Q, Li W, Liao B, Huang Z (2018) Noise-resistant discrete-time neural dynamics for computing time-dependent Lyapunov equation. IEEE Access 6:45359–45371CrossRef Xiang Q, Li W, Liao B, Huang Z (2018) Noise-resistant discrete-time neural dynamics for computing time-dependent Lyapunov equation. IEEE Access 6:45359–45371CrossRef
Metadata
Title
Prescribed-time convergent and noise-tolerant Z-type neural dynamics for calculating time-dependent quadratic programming
Authors
Bolin Liao
Yuyan Wang
Weibing Li
Chen Peng
Qiuhong Xiang
Publication date
14-09-2020
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 10/2021
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05356-x

Other articles of this Issue 10/2021

Neural Computing and Applications 10/2021 Go to the issue

S.I. : Higher Level Artificial Neural Network Based Intelligent Systems

Comparison of two deep learning methods for ship target recognition with optical remotely sensed data

Premium Partner