Skip to main content
Erschienen in: Neural Computing and Applications 3-4/2014

01.09.2014 | Original Article

Regression-based weight generation algorithm in neural network for solution of initial and boundary value problems

verfasst von: S. Chakraverty, Susmita Mall

Erschienen in: Neural Computing and Applications | Ausgabe 3-4/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper introduces a new algorithm for solving ordinary differential equations (ODEs) with initial or boundary conditions. In our proposed method, the trial solution of differential equation has been used in the regression-based neural network (RBNN) model for single input and single output system. The artificial neural network (ANN) trial solution of ODE is written as sum of two terms, first one satisfies initial/boundary conditions and contains no adjustable parameters. The second part involves a RBNN model containing adjustable parameters. Network has been trained using the initial weights generated by the coefficients of regression fitting. We have used feed-forward neural network and error back propagation algorithm for minimizing error function. Proposed model has been tested for first, second and fourth-order ODEs. We also compare the results of proposed algorithm with the traditional ANN algorithm. The idea may very well be extended to other complicated differential equations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ricardo HJ (2009) A modern introduction to differential equations, 2nd edn. Elsevier, AmsterdamMATH Ricardo HJ (2009) A modern introduction to differential equations, 2nd edn. Elsevier, AmsterdamMATH
2.
Zurück zum Zitat Sneddon IN (2006) Elements of partial differential equations. Dover, New YorkMATH Sneddon IN (2006) Elements of partial differential equations. Dover, New YorkMATH
3.
Zurück zum Zitat Douglas J, Jones BF (1963) Predictor–corrector methods for nonlinear parabolic differential equations. J Ind Appl Math 11:195–204MATHMathSciNetCrossRef Douglas J, Jones BF (1963) Predictor–corrector methods for nonlinear parabolic differential equations. J Ind Appl Math 11:195–204MATHMathSciNetCrossRef
4.
Zurück zum Zitat Reddy JN (1993) An introduction to the finite element method. McGraw-Hill, New York Reddy JN (1993) An introduction to the finite element method. McGraw-Hill, New York
5.
Zurück zum Zitat Meade AJ Jr, Fernandez AA (1994) The numerical solution of linear ordinary differential equations by feed forward neural networks. Math Comput Model 19:1–25MATHMathSciNetCrossRef Meade AJ Jr, Fernandez AA (1994) The numerical solution of linear ordinary differential equations by feed forward neural networks. Math Comput Model 19:1–25MATHMathSciNetCrossRef
6.
Zurück zum Zitat Meade AJ Jr, Fernandez AA (1994) Solution of nonlinear ordinary differential equations by feed forward neural networks. Math Comput Model 20:19–44MATHMathSciNetCrossRef Meade AJ Jr, Fernandez AA (1994) Solution of nonlinear ordinary differential equations by feed forward neural networks. Math Comput Model 20:19–44MATHMathSciNetCrossRef
7.
Zurück zum Zitat Lagaris IE, Likas AC, Fotiadis DI (1998) Artificial neural networks for solving ordinary and partial differential equations. IEEE Trans Neural Netw 9:987–1000CrossRef Lagaris IE, Likas AC, Fotiadis DI (1998) Artificial neural networks for solving ordinary and partial differential equations. IEEE Trans Neural Netw 9:987–1000CrossRef
8.
Zurück zum Zitat Lagaris IE, Likas AC, Papageorgiou DG (2000) Neural network methods for boundary value problems with irregular boundaries. IEEE Trans Neural Netw 11:1041–1049CrossRef Lagaris IE, Likas AC, Papageorgiou DG (2000) Neural network methods for boundary value problems with irregular boundaries. IEEE Trans Neural Netw 11:1041–1049CrossRef
9.
Zurück zum Zitat Malek A, Beidokhti SR (2006) Numerical solution for high order deferential equations, using a hybrid neural network—optimization method. Appl Math Comput 183:260–271MATHMathSciNetCrossRef Malek A, Beidokhti SR (2006) Numerical solution for high order deferential equations, using a hybrid neural network—optimization method. Appl Math Comput 183:260–271MATHMathSciNetCrossRef
10.
Zurück zum Zitat Yazid HS, Pakdaman M, Modaghegh H (2011) Unsupervised kernel least mean square algorithm for solving ordinary differential equations. Neurocomputing 74:2062–2071CrossRef Yazid HS, Pakdaman M, Modaghegh H (2011) Unsupervised kernel least mean square algorithm for solving ordinary differential equations. Neurocomputing 74:2062–2071CrossRef
11.
Zurück zum Zitat Selvaraju N, Abdul Samant J (2010) Solution of matrix Riccati differential equation for nonlinear singular system using neural networks. Int J Comput Appl 29:48–54 Selvaraju N, Abdul Samant J (2010) Solution of matrix Riccati differential equation for nonlinear singular system using neural networks. Int J Comput Appl 29:48–54
12.
Zurück zum Zitat Shirvany Y, Hayati M, Moradian R (2009) Multilayer perceptron neural networks with novel unsupervised training method for numerical solution of the partial differential equations. Appl Soft Comput 9:20–29CrossRef Shirvany Y, Hayati M, Moradian R (2009) Multilayer perceptron neural networks with novel unsupervised training method for numerical solution of the partial differential equations. Appl Soft Comput 9:20–29CrossRef
13.
Zurück zum Zitat Aartt LP, Van der veer P (2001) Neural network method for solving partial differential equations. Neural Process Lett 14:261–271CrossRef Aartt LP, Van der veer P (2001) Neural network method for solving partial differential equations. Neural Process Lett 14:261–271CrossRef
14.
Zurück zum Zitat He S, Reif K, Unbehauen R (2000) Multilayer neural networks for solving a class of partial differential equations. Neural Netw 13:385–396CrossRef He S, Reif K, Unbehauen R (2000) Multilayer neural networks for solving a class of partial differential equations. Neural Netw 13:385–396CrossRef
15.
Zurück zum Zitat Hoda SA, Nagla HA (2011) Neural network methods for mixed boundary value problems. Int J Nonlinear Sci 11:312–316MathSciNet Hoda SA, Nagla HA (2011) Neural network methods for mixed boundary value problems. Int J Nonlinear Sci 11:312–316MathSciNet
16.
Zurück zum Zitat McFall KS, Mahan JR (2009) Artificial neural network for solution of boundary value problems with exact satisfaction of arbitrary boundary conditions. IEEE Trans Neural Netw 20:1221–1233CrossRef McFall KS, Mahan JR (2009) Artificial neural network for solution of boundary value problems with exact satisfaction of arbitrary boundary conditions. IEEE Trans Neural Netw 20:1221–1233CrossRef
17.
Zurück zum Zitat Manevitz L, Bitar A, Givoli D (2005) Neural network time series forecasting of finite-element mesh adaptation. Neurocomputing 63:447–463CrossRef Manevitz L, Bitar A, Givoli D (2005) Neural network time series forecasting of finite-element mesh adaptation. Neurocomputing 63:447–463CrossRef
18.
Zurück zum Zitat Leephakpreeda T (2002) Novel determination of differential-equation solutions: universal approximation method. J Comput Appl Math 146:443–457MATHMathSciNetCrossRef Leephakpreeda T (2002) Novel determination of differential-equation solutions: universal approximation method. J Comput Appl Math 146:443–457MATHMathSciNetCrossRef
19.
Zurück zum Zitat Mai-Duy N, Tran-Cong T (2001) Numerical solution of differential equations using multi quadric radial basis function networks. Neural Netw 14:185–199CrossRef Mai-Duy N, Tran-Cong T (2001) Numerical solution of differential equations using multi quadric radial basis function networks. Neural Netw 14:185–199CrossRef
20.
Zurück zum Zitat Jianyu L, Siwei L, Yingjian Q, Yaping H (2003) Numerical solution of elliptic partial differential equation using radial basis function neural networks. Neural Netw 16:729–734CrossRef Jianyu L, Siwei L, Yingjian Q, Yaping H (2003) Numerical solution of elliptic partial differential equation using radial basis function neural networks. Neural Netw 16:729–734CrossRef
21.
Zurück zum Zitat Jckiewiez Z, Rahaman M, Welfent BD (2008) Numerical solution of a fredholm integra-differential equation modelling θ-neural networks. Appl Math Comput 195:2523–5363 Jckiewiez Z, Rahaman M, Welfent BD (2008) Numerical solution of a fredholm integra-differential equation modelling θ-neural networks. Appl Math Comput 195:2523–5363
22.
Zurück zum Zitat Tsoulos IG, Lagaris IE (2006) Solving differential equations with genetic programming. Genet Program Evolvable Mach 7:33–54CrossRef Tsoulos IG, Lagaris IE (2006) Solving differential equations with genetic programming. Genet Program Evolvable Mach 7:33–54CrossRef
23.
Zurück zum Zitat Parisi DR, Mariani MC, Laborde MA (2003) Solving differential equations with unsupervised neural networks. Chem Eng Process 42:715–721CrossRef Parisi DR, Mariani MC, Laborde MA (2003) Solving differential equations with unsupervised neural networks. Chem Eng Process 42:715–721CrossRef
24.
Zurück zum Zitat Mall S, Chakraverty S (2013) Regression based neural network training for the solution of ordinary differential equations. Int J Math Model Numer Optim 4:136–149MATH Mall S, Chakraverty S (2013) Regression based neural network training for the solution of ordinary differential equations. Int J Math Model Numer Optim 4:136–149MATH
25.
Zurück zum Zitat Tsoulos IG, Gavrilis D, Glavas E (2009) Solving differential equations with constructed neural networks. Neurocomputing 72:2385–2391CrossRef Tsoulos IG, Gavrilis D, Glavas E (2009) Solving differential equations with constructed neural networks. Neurocomputing 72:2385–2391CrossRef
26.
Zurück zum Zitat Smaoui N, Al-Enezi S (2004) Modelling the dynamics of nonlinear partial differential equations using neural networks. J Comput Appl Math 170:27–58MATHMathSciNetCrossRef Smaoui N, Al-Enezi S (2004) Modelling the dynamics of nonlinear partial differential equations using neural networks. J Comput Appl Math 170:27–58MATHMathSciNetCrossRef
27.
Zurück zum Zitat Chakraverty S, Singh VP, Sharma RK (2006) Regression based weight generation algorithm in neural network for estimation of frequencies of vibrating plates. J Comput Methods Appl Mech Eng 195:4194–4202MATHCrossRef Chakraverty S, Singh VP, Sharma RK (2006) Regression based weight generation algorithm in neural network for estimation of frequencies of vibrating plates. J Comput Methods Appl Mech Eng 195:4194–4202MATHCrossRef
28.
Zurück zum Zitat Chakraverty S, Singh VP, Sharma RK, Sharma GK (2009) Modelling vibration frequencies of annular plates by regression based neural network. Appl Soft Comput 9:439–447CrossRef Chakraverty S, Singh VP, Sharma RK, Sharma GK (2009) Modelling vibration frequencies of annular plates by regression based neural network. Appl Soft Comput 9:439–447CrossRef
29.
Zurück zum Zitat Zurada JM (1994) Introduction to artificial neural network. West, Eagan Zurada JM (1994) Introduction to artificial neural network. West, Eagan
30.
Zurück zum Zitat Haykin S (1999) Neural networks a comprehensive foundation. Prentice Hall, Upper Saddle RiverMATH Haykin S (1999) Neural networks a comprehensive foundation. Prentice Hall, Upper Saddle RiverMATH
Metadaten
Titel
Regression-based weight generation algorithm in neural network for solution of initial and boundary value problems
verfasst von
S. Chakraverty
Susmita Mall
Publikationsdatum
01.09.2014
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 3-4/2014
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-013-1526-4

Weitere Artikel der Ausgabe 3-4/2014

Neural Computing and Applications 3-4/2014 Zur Ausgabe

Premium Partner