Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Neural Computing and Applications
Published in: Neural Computing and Applications 6/2009

01-09-2009 | Original Article

Neural network training with optimal bounded ellipsoid algorithm

Authors: José de Jesús Rubio, Wen Yu, Andrés Ferreyra

Published in: Neural Computing and Applications | Issue 6/2009

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Compared to normal learning algorithms, for example backpropagation, the optimal bounded ellipsoid (OBE) algorithm has some better properties, such as faster convergence, since it has a similar structure as Kalman filter. OBE has some advantages over Kalman filter training, the noise is not required to be Guassian. In this paper OBE algorithm is applied in training the weights of the feedforward neural network for nonlinear system identification. Both hidden layers and output layers can be updated. From a dynamic system point of view, such training can be useful for all neural network applications requiring real-time updating of the weights. Two simulations give the effectiveness of the suggested algorithm.
previous article Face recognition using Gabor-based complete Kernel Fisher Discriminant analysis with fractional power polynomial models
next article An stable online clustering fuzzy neural network for nonlinear system identification

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now
Literature
1.
2.
Chowdhury FN (2003) A new approach to real-time training of dynamic neural networks. Int J Adapt Control Signal Process 31:509–521CrossRef
3.
Correa MV, Aguirre LA, Saldanha RR (2002) Using steady-state prior knowledge to constrain parameter estimates in nonlinear system identification. IEEE Trans Circuits Syst Part I 49(9):1376–1381CrossRef
4.
Dickerson JA, Kosko B (1996) Fuzzy function approximation with ellipsoidal rules. IEEE Trans Syst Man Cybern 26:542–560CrossRef
5.
6.
Gazor S, Shahtalebi K (2002) A new NLMS algorithm for slow noise magnitude variation. IEEE Signal Process Lett 9(11):348–351CrossRef
7.
El Ghaoui (2001) Robust filtering for discrete-time systems with bounded noise and parametric uncertainty. IEEE Trans Autom Control 46(7):1084–1089MATHCrossRef
8.
Gollamudi S, Nagaraj S, Kapoor S, Huang YF (1996) Set membership state estimation with optimal bounding ellipsoids. In: Proceedings of international symposium on information theory and its applications, Victoria, BC, Canada, pp 262–265
9.
Goodwin GC, Sang Sin K (1984) Adaptive filtering prediction and control. Prentice-Hall, Englewood Cliffis
10.
Haykin S (1994) Neural networks—a comprehensive foundation. Macmillan, New YorkMATH
11.
12.
Jin L, Nikiforunk PN, Gupta MM (1999) Adaptive model reference control of discrete-time nonlinear systems using neural networks. Control Theory Adv Technol Part 3 10(4):1373–1399
13.
Joachim D, Deller JR (2006) Multiweight optimization in optimal bounding ellipsoid algorithms. IEEE Trans Signal Process 54(2):679–690CrossRef
14.
Kapoor S, Gollamudi S, Nagaraj S, Huang YF (1996) Tracking of time-varing parameters using optimal bounding ellipsoid algorithms. In: Proceedings of 34th Allerton conference on communication, control and computing Monticello
15.
Kayuri NS, Vienkatasubramanian V (1993) Representing bounded fault classes using neural networks with ellipsoidal activation functions. Comput Chem Eng 17(2):139–163CrossRef
16.
Kosmatopoulos EB, Polycarpou MM, Christodoulou MA, Ioannou PA (1995) High-order neural network structures for identification of dynamical systems. IEEE Trans Neural Netw 6(2):422–431CrossRef
17.
Liguni Y, Sakai H, Higekatsu Tokumaru (1992) A real-time learning algorithm for a multilayered neural network based on the extended Kalman filter. IEEE Trans Signal Process 40(4):959–966CrossRef
18.
19.
Narendra KS, Parthasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1(1):4–27CrossRef
20.
Nazin SA, Polyak BT (2001) Limiting behavior of bounding ellipsoids for state estimation. In: Proceedings of the 5th IFAC symposium on nonlinear control systems, St Petersburg, Russia, vol 4–6, pp 585–589
21.
Parlos AG, Menon SK, Atiya AF (2001) An algorithm approach to adaptive state filtering using recurrent neural network. IEEE Trans Neural Netw 12(6):1411–1432CrossRef
22.
Puskorius GV, Feldkamp LA (1994) Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks. IEEE Trans Neural Netw 5(2):279–297CrossRef
23.
Ros L, Sabater A, Thomas F (2002) An ellipsoidal alculus based on propagation and fusion. IEEE Trans Syst Man Cybern 32(4):430-442CrossRef
24.
Rubio JJ, Yu W (2005) Dead-zone Kalman filter algorithm for recurrent neural networks. In: 44rd IEEE conference on decision and control, CDC’05, Seville, Spain, pp 2562–2567
25.
Ruck DW, Rogers SK, Kabrisky M, Maybeck PS, Oxley ME (1992) Comparative analysis of backpropagation and the extended Kalman filter for training multilayer perceptrons. IEEE Trans Pattern Anal Mach Intell 14(6):686–691CrossRef
26.
Safonov MG, Athans M (1978) Robustness and computational aspects of nonlinear stochastic estimators and regulators. IEEE Trans Autom Control 23(4):717–725MATHCrossRefMathSciNet
27.
Sastry PS, Santharam G, Unnikrishnan KP (1994) Memory neural networks for identification and control of dynamic systems. IEEE Trans Neural Netw 5:306–319CrossRef
28.
Schueppe FC (1973) Uncertain dynamic systems. Prentice-Hall, Englewood Cliffs
29.
Singhal S, Wu L (1989) Training multilayer perceptrons with the extended Kalman algorithm. Adv Neural Inf Process Syst I 133–140
30.
Weyer E, Campi MC (2000) Non-asymptotic confidence ellipsoids for the least squares estimate. In: 39rd IEEE conference on decision and control, Sydney, Australia, pp 2688–2693
31.
Wang LX (1997) A course in fuzzy systems and control. Prentice-Hall, Englewood Cliffs
32.
Yu W (2002) Nonlinear system identification using discrete-time recurrent neural networks with stable learning algorithms. Inf Sci 158(1):131–147
33.
Yu W, Ferreyra A (2005) On-line clustering for nonlinear system identification using fuzzy neural networks. In: IEEE international conference on fuzzy systems, pp 678–683
Metadata
Title
Neural network training with optimal bounded ellipsoid algorithm
Authors
José de Jesús Rubio
Wen Yu
Andrés Ferreyra
Publication date
01-09-2009
Publisher
Springer-Verlag
Published in
Neural Computing and Applications / Issue 6/2009
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-008-0203-5

Other articles of this Issue 6/2009

Neural Computing and Applications 6/2009 Go to the issue

Original Article

An stable online clustering fuzzy neural network for nonlinear system identification

Original Article

Robust neural network control system design for linear ultrasonic motor

Original Article

On the use of fuzzy synthetic evaluation and optimal classification for computing fire risk ranking of buildings

Original Article

A comparative analysis of principal component and independent component techniques for electrocardiograms

Original Article

Face recognition using Gabor-based complete Kernel Fisher Discriminant analysis with fractional power polynomial models

Original Article

Kernel optimization-based discriminant analysis for face recognition

Premium Partner

    Image Credits