Skip to main content
Top
Published in: Neural Computing and Applications 3-4/2014

01-09-2014 | Original Article

Regression-based weight generation algorithm in neural network for solution of initial and boundary value problems

Authors: S. Chakraverty, Susmita Mall

Published in: Neural Computing and Applications | Issue 3-4/2014

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper introduces a new algorithm for solving ordinary differential equations (ODEs) with initial or boundary conditions. In our proposed method, the trial solution of differential equation has been used in the regression-based neural network (RBNN) model for single input and single output system. The artificial neural network (ANN) trial solution of ODE is written as sum of two terms, first one satisfies initial/boundary conditions and contains no adjustable parameters. The second part involves a RBNN model containing adjustable parameters. Network has been trained using the initial weights generated by the coefficients of regression fitting. We have used feed-forward neural network and error back propagation algorithm for minimizing error function. Proposed model has been tested for first, second and fourth-order ODEs. We also compare the results of proposed algorithm with the traditional ANN algorithm. The idea may very well be extended to other complicated differential equations.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ricardo HJ (2009) A modern introduction to differential equations, 2nd edn. Elsevier, AmsterdamMATH Ricardo HJ (2009) A modern introduction to differential equations, 2nd edn. Elsevier, AmsterdamMATH
2.
go back to reference Sneddon IN (2006) Elements of partial differential equations. Dover, New YorkMATH Sneddon IN (2006) Elements of partial differential equations. Dover, New YorkMATH
3.
go back to reference Douglas J, Jones BF (1963) Predictor–corrector methods for nonlinear parabolic differential equations. J Ind Appl Math 11:195–204MATHMathSciNetCrossRef Douglas J, Jones BF (1963) Predictor–corrector methods for nonlinear parabolic differential equations. J Ind Appl Math 11:195–204MATHMathSciNetCrossRef
4.
go back to reference Reddy JN (1993) An introduction to the finite element method. McGraw-Hill, New York Reddy JN (1993) An introduction to the finite element method. McGraw-Hill, New York
5.
go back to reference Meade AJ Jr, Fernandez AA (1994) The numerical solution of linear ordinary differential equations by feed forward neural networks. Math Comput Model 19:1–25MATHMathSciNetCrossRef Meade AJ Jr, Fernandez AA (1994) The numerical solution of linear ordinary differential equations by feed forward neural networks. Math Comput Model 19:1–25MATHMathSciNetCrossRef
6.
go back to reference Meade AJ Jr, Fernandez AA (1994) Solution of nonlinear ordinary differential equations by feed forward neural networks. Math Comput Model 20:19–44MATHMathSciNetCrossRef Meade AJ Jr, Fernandez AA (1994) Solution of nonlinear ordinary differential equations by feed forward neural networks. Math Comput Model 20:19–44MATHMathSciNetCrossRef
7.
go back to reference Lagaris IE, Likas AC, Fotiadis DI (1998) Artificial neural networks for solving ordinary and partial differential equations. IEEE Trans Neural Netw 9:987–1000CrossRef Lagaris IE, Likas AC, Fotiadis DI (1998) Artificial neural networks for solving ordinary and partial differential equations. IEEE Trans Neural Netw 9:987–1000CrossRef
8.
go back to reference Lagaris IE, Likas AC, Papageorgiou DG (2000) Neural network methods for boundary value problems with irregular boundaries. IEEE Trans Neural Netw 11:1041–1049CrossRef Lagaris IE, Likas AC, Papageorgiou DG (2000) Neural network methods for boundary value problems with irregular boundaries. IEEE Trans Neural Netw 11:1041–1049CrossRef
9.
go back to reference Malek A, Beidokhti SR (2006) Numerical solution for high order deferential equations, using a hybrid neural network—optimization method. Appl Math Comput 183:260–271MATHMathSciNetCrossRef Malek A, Beidokhti SR (2006) Numerical solution for high order deferential equations, using a hybrid neural network—optimization method. Appl Math Comput 183:260–271MATHMathSciNetCrossRef
10.
go back to reference Yazid HS, Pakdaman M, Modaghegh H (2011) Unsupervised kernel least mean square algorithm for solving ordinary differential equations. Neurocomputing 74:2062–2071CrossRef Yazid HS, Pakdaman M, Modaghegh H (2011) Unsupervised kernel least mean square algorithm for solving ordinary differential equations. Neurocomputing 74:2062–2071CrossRef
11.
go back to reference Selvaraju N, Abdul Samant J (2010) Solution of matrix Riccati differential equation for nonlinear singular system using neural networks. Int J Comput Appl 29:48–54 Selvaraju N, Abdul Samant J (2010) Solution of matrix Riccati differential equation for nonlinear singular system using neural networks. Int J Comput Appl 29:48–54
12.
go back to reference Shirvany Y, Hayati M, Moradian R (2009) Multilayer perceptron neural networks with novel unsupervised training method for numerical solution of the partial differential equations. Appl Soft Comput 9:20–29CrossRef Shirvany Y, Hayati M, Moradian R (2009) Multilayer perceptron neural networks with novel unsupervised training method for numerical solution of the partial differential equations. Appl Soft Comput 9:20–29CrossRef
13.
go back to reference Aartt LP, Van der veer P (2001) Neural network method for solving partial differential equations. Neural Process Lett 14:261–271CrossRef Aartt LP, Van der veer P (2001) Neural network method for solving partial differential equations. Neural Process Lett 14:261–271CrossRef
14.
go back to reference He S, Reif K, Unbehauen R (2000) Multilayer neural networks for solving a class of partial differential equations. Neural Netw 13:385–396CrossRef He S, Reif K, Unbehauen R (2000) Multilayer neural networks for solving a class of partial differential equations. Neural Netw 13:385–396CrossRef
15.
go back to reference Hoda SA, Nagla HA (2011) Neural network methods for mixed boundary value problems. Int J Nonlinear Sci 11:312–316MathSciNet Hoda SA, Nagla HA (2011) Neural network methods for mixed boundary value problems. Int J Nonlinear Sci 11:312–316MathSciNet
16.
go back to reference McFall KS, Mahan JR (2009) Artificial neural network for solution of boundary value problems with exact satisfaction of arbitrary boundary conditions. IEEE Trans Neural Netw 20:1221–1233CrossRef McFall KS, Mahan JR (2009) Artificial neural network for solution of boundary value problems with exact satisfaction of arbitrary boundary conditions. IEEE Trans Neural Netw 20:1221–1233CrossRef
17.
go back to reference Manevitz L, Bitar A, Givoli D (2005) Neural network time series forecasting of finite-element mesh adaptation. Neurocomputing 63:447–463CrossRef Manevitz L, Bitar A, Givoli D (2005) Neural network time series forecasting of finite-element mesh adaptation. Neurocomputing 63:447–463CrossRef
18.
go back to reference Leephakpreeda T (2002) Novel determination of differential-equation solutions: universal approximation method. J Comput Appl Math 146:443–457MATHMathSciNetCrossRef Leephakpreeda T (2002) Novel determination of differential-equation solutions: universal approximation method. J Comput Appl Math 146:443–457MATHMathSciNetCrossRef
19.
go back to reference Mai-Duy N, Tran-Cong T (2001) Numerical solution of differential equations using multi quadric radial basis function networks. Neural Netw 14:185–199CrossRef Mai-Duy N, Tran-Cong T (2001) Numerical solution of differential equations using multi quadric radial basis function networks. Neural Netw 14:185–199CrossRef
20.
go back to reference Jianyu L, Siwei L, Yingjian Q, Yaping H (2003) Numerical solution of elliptic partial differential equation using radial basis function neural networks. Neural Netw 16:729–734CrossRef Jianyu L, Siwei L, Yingjian Q, Yaping H (2003) Numerical solution of elliptic partial differential equation using radial basis function neural networks. Neural Netw 16:729–734CrossRef
21.
go back to reference Jckiewiez Z, Rahaman M, Welfent BD (2008) Numerical solution of a fredholm integra-differential equation modelling θ-neural networks. Appl Math Comput 195:2523–5363 Jckiewiez Z, Rahaman M, Welfent BD (2008) Numerical solution of a fredholm integra-differential equation modelling θ-neural networks. Appl Math Comput 195:2523–5363
22.
go back to reference Tsoulos IG, Lagaris IE (2006) Solving differential equations with genetic programming. Genet Program Evolvable Mach 7:33–54CrossRef Tsoulos IG, Lagaris IE (2006) Solving differential equations with genetic programming. Genet Program Evolvable Mach 7:33–54CrossRef
23.
go back to reference Parisi DR, Mariani MC, Laborde MA (2003) Solving differential equations with unsupervised neural networks. Chem Eng Process 42:715–721CrossRef Parisi DR, Mariani MC, Laborde MA (2003) Solving differential equations with unsupervised neural networks. Chem Eng Process 42:715–721CrossRef
24.
go back to reference Mall S, Chakraverty S (2013) Regression based neural network training for the solution of ordinary differential equations. Int J Math Model Numer Optim 4:136–149MATH Mall S, Chakraverty S (2013) Regression based neural network training for the solution of ordinary differential equations. Int J Math Model Numer Optim 4:136–149MATH
25.
go back to reference Tsoulos IG, Gavrilis D, Glavas E (2009) Solving differential equations with constructed neural networks. Neurocomputing 72:2385–2391CrossRef Tsoulos IG, Gavrilis D, Glavas E (2009) Solving differential equations with constructed neural networks. Neurocomputing 72:2385–2391CrossRef
26.
go back to reference Smaoui N, Al-Enezi S (2004) Modelling the dynamics of nonlinear partial differential equations using neural networks. J Comput Appl Math 170:27–58MATHMathSciNetCrossRef Smaoui N, Al-Enezi S (2004) Modelling the dynamics of nonlinear partial differential equations using neural networks. J Comput Appl Math 170:27–58MATHMathSciNetCrossRef
27.
go back to reference Chakraverty S, Singh VP, Sharma RK (2006) Regression based weight generation algorithm in neural network for estimation of frequencies of vibrating plates. J Comput Methods Appl Mech Eng 195:4194–4202MATHCrossRef Chakraverty S, Singh VP, Sharma RK (2006) Regression based weight generation algorithm in neural network for estimation of frequencies of vibrating plates. J Comput Methods Appl Mech Eng 195:4194–4202MATHCrossRef
28.
go back to reference Chakraverty S, Singh VP, Sharma RK, Sharma GK (2009) Modelling vibration frequencies of annular plates by regression based neural network. Appl Soft Comput 9:439–447CrossRef Chakraverty S, Singh VP, Sharma RK, Sharma GK (2009) Modelling vibration frequencies of annular plates by regression based neural network. Appl Soft Comput 9:439–447CrossRef
29.
go back to reference Zurada JM (1994) Introduction to artificial neural network. West, Eagan Zurada JM (1994) Introduction to artificial neural network. West, Eagan
30.
go back to reference Haykin S (1999) Neural networks a comprehensive foundation. Prentice Hall, Upper Saddle RiverMATH Haykin S (1999) Neural networks a comprehensive foundation. Prentice Hall, Upper Saddle RiverMATH
Metadata
Title
Regression-based weight generation algorithm in neural network for solution of initial and boundary value problems
Authors
S. Chakraverty
Susmita Mall
Publication date
01-09-2014
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 3-4/2014
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-013-1526-4

Other articles of this Issue 3-4/2014

Neural Computing and Applications 3-4/2014 Go to the issue

Premium Partner