Skip to main content
Erschienen in: Neural Processing Letters 2/2015

01.10.2015

A Modified Learning Algorithm for Interval Perceptrons with Interval Weights

verfasst von: Dakun Yang, Zhengxue Li, Yan Liu, Huisheng Zhang, Wei Wu

Erschienen in: Neural Processing Letters | Ausgabe 2/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In many applications, it is natural to use interval data to describe various kinds of uncertainties. This paper is concerned with a one-layer interval perceptron with the weights and the outputs being intervals and the inputs being real numbers. In the original learning method for this interval perceptron, an absolute value function is applied for newly learned radii of the interval weights, so as to force the radii to be positive. This approach seems unnatural somehow, and might cause oscillation in the learning procedure as indicated in our numerical experiments. In this paper, a modified learning method is proposed for this one-layer interval perceptron. We do not use the function of the absolute value, and instead, we replace, in the error function, the radius of each interval weight by a quadratic term. This simple trick does not cause any additional computational work for the learning procedure, but it brings about the following three advantages: First, the radii of the intervals of the weights are guaranteed to be positive during the learning procedure without the help of the absolute value function. Secondly, the oscillation mentioned above is eliminated and the convergence of the learning procedure is improved, as indicated by our numerical experiments. Finally, a by-product is that the convergence analysis of the learning procedure is now an easy job, while the analysis for the original learning method is at least difficult, if not impossible, due to the non-smoothness of the absolute value function involved.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Han M, Fan JC, Wang J (2011) A dynamic feedforward neural network based on Gaussian particle swarm optimization and its application for predictive control. IEEE Trans Neural Netw 22:1457–1468CrossRefMATH Han M, Fan JC, Wang J (2011) A dynamic feedforward neural network based on Gaussian particle swarm optimization and its application for predictive control. IEEE Trans Neural Netw 22:1457–1468CrossRefMATH
2.
Zurück zum Zitat Ren XM, Lv XH (2011) Identification of extended Hammerstein systems using dynamic self-optimizing neural networks. IEEE Trans Neural Netw 22:1169–1179CrossRef Ren XM, Lv XH (2011) Identification of extended Hammerstein systems using dynamic self-optimizing neural networks. IEEE Trans Neural Netw 22:1169–1179CrossRef
3.
Zurück zum Zitat Wade JJ, McDaid LJ, Santos JA, Sayers HM (2010) SWAT: a spiking neural network training algorithm for classification problems. IEEE Trans Neural Netw 21:1817–1830CrossRef Wade JJ, McDaid LJ, Santos JA, Sayers HM (2010) SWAT: a spiking neural network training algorithm for classification problems. IEEE Trans Neural Netw 21:1817–1830CrossRef
4.
Zurück zum Zitat Zhang NM (2011) Momentum algorithms in neural networks and the applications in numerical algebra, AIMSEC, pp 2192–2195 Zhang NM (2011) Momentum algorithms in neural networks and the applications in numerical algebra, AIMSEC, pp 2192–2195
5.
Zurück zum Zitat Heshmaty B, Kandel A (1985) Fuzzy linear regression and its applications to forecasting in uncertain environment. Fuzzy Sets Syst 15:159C191CrossRef Heshmaty B, Kandel A (1985) Fuzzy linear regression and its applications to forecasting in uncertain environment. Fuzzy Sets Syst 15:159C191CrossRef
6.
Zurück zum Zitat Kaneyoshi M, Tanaka H, Kamei M, Farata H (1990) New system identification technique using fuzzy regression analysis. In: International symposium on uncertainty modeling and analysis, College Park, MD, USA, pp 528C533 Kaneyoshi M, Tanaka H, Kamei M, Farata H (1990) New system identification technique using fuzzy regression analysis. In: International symposium on uncertainty modeling and analysis, College Park, MD, USA, pp 528C533
7.
Zurück zum Zitat Hashiyama T, Furuhash T, Uchikawa Y (1992) An interval fuzzy model using a fuzzy neural network. In: IEEE international conference neural networks, Baltimore, MD, USA, pp 745–750 Hashiyama T, Furuhash T, Uchikawa Y (1992) An interval fuzzy model using a fuzzy neural network. In: IEEE international conference neural networks, Baltimore, MD, USA, pp 745–750
8.
9.
Zurück zum Zitat Ishibuchi H, Tanaka H, Okada H (1993) An architecture of neural networks with interval weights and its application to fuzzy regression analysis. Fuzzy Sets Syst 57:27–39MathSciNetCrossRef Ishibuchi H, Tanaka H, Okada H (1993) An architecture of neural networks with interval weights and its application to fuzzy regression analysis. Fuzzy Sets Syst 57:27–39MathSciNetCrossRef
10.
Zurück zum Zitat Ishibuchi H, Nii M (2001) Fuzzy regression using asymmetric fuzzy coefficients and fuzzified neural networks. Fuzzy Sets Syst 119:273–290MathSciNetCrossRefMATH Ishibuchi H, Nii M (2001) Fuzzy regression using asymmetric fuzzy coefficients and fuzzified neural networks. Fuzzy Sets Syst 119:273–290MathSciNetCrossRefMATH
11.
Zurück zum Zitat Hernandez CA, Espf J, Nakayama K, Fernandez M (1993) Interval arithmetic backpropagation. In: Proceeding of 1993 international joint conference on neural network, pp 375–378, Hernandez CA, Espf J, Nakayama K, Fernandez M (1993) Interval arithmetic backpropagation. In: Proceeding of 1993 international joint conference on neural network, pp 375–378,
12.
Zurück zum Zitat Drago GP, Ridella S (1998) Pruning with interval arithmetic perceptron. Neurocomputing 18:229–246CrossRef Drago GP, Ridella S (1998) Pruning with interval arithmetic perceptron. Neurocomputing 18:229–246CrossRef
13.
Zurück zum Zitat Drago GP, Ridella S (1999) Possibility and necessity pattern classification using an interval arithmetic perceptron. Neural Comput Appl 8:40–52CrossRef Drago GP, Ridella S (1999) Possibility and necessity pattern classification using an interval arithmetic perceptron. Neural Comput Appl 8:40–52CrossRef
14.
Zurück zum Zitat Roque AMS, Mate C, Arroyo J, Sarabia A (2007) iMLP applying multi-layer perceptrons to interval-valued data. Neural Process Lett 25:157–169CrossRef Roque AMS, Mate C, Arroyo J, Sarabia A (2007) iMLP applying multi-layer perceptrons to interval-valued data. Neural Process Lett 25:157–169CrossRef
15.
Zurück zum Zitat Shao HM, Zheng GF (2011) Convergence analysis of a back-propagation algorithm with adaptive momentum. Neurocomputing 74:749–752CrossRef Shao HM, Zheng GF (2011) Convergence analysis of a back-propagation algorithm with adaptive momentum. Neurocomputing 74:749–752CrossRef
16.
Zurück zum Zitat Wang J, Yang J, Wu W (2011) Convergence of cyclic and almost-cyclic learning with momentum for feedforward neural networks. IEEE Trans Neural Netw 22:1297–1306CrossRef Wang J, Yang J, Wu W (2011) Convergence of cyclic and almost-cyclic learning with momentum for feedforward neural networks. IEEE Trans Neural Netw 22:1297–1306CrossRef
17.
Zurück zum Zitat Xu ZB, Zhang R, Jing WF (2009) When on-line BP training converges. IEEE Trans Neural Netw 20:1529–1539CrossRef Xu ZB, Zhang R, Jing WF (2009) When on-line BP training converges. IEEE Trans Neural Netw 20:1529–1539CrossRef
18.
Zurück zum Zitat Moore RE (1966) Interval analysis. Prentice-Hall, Englewood Cliffs, NJ Moore RE (1966) Interval analysis. Prentice-Hall, Englewood Cliffs, NJ
19.
Zurück zum Zitat Sunaga T (1958) Theory of an interval algebra and its applications to numerical analysis. RAAG Mem 2:29–46MATH Sunaga T (1958) Theory of an interval algebra and its applications to numerical analysis. RAAG Mem 2:29–46MATH
20.
Zurück zum Zitat Wu W, Wang J, Cheng MS, Li ZX (2011) Convergence analysis of online gradient method for BP neural networks. Neural Netw 24:91–98CrossRef Wu W, Wang J, Cheng MS, Li ZX (2011) Convergence analysis of online gradient method for BP neural networks. Neural Netw 24:91–98CrossRef
21.
Zurück zum Zitat Xu DP, Zhang HS, Liu LJ (2010) Convergence analysis of three classes of split-complex gradient algorithms for complex-valued recurrent neural networks. Neural Comput 22:2655–2677MathSciNetCrossRef Xu DP, Zhang HS, Liu LJ (2010) Convergence analysis of three classes of split-complex gradient algorithms for complex-valued recurrent neural networks. Neural Comput 22:2655–2677MathSciNetCrossRef
22.
Zurück zum Zitat Yao XF, Wang SD, Dong SQ (2004) Approximation of interval models by neural networks. In: Proceeding of 2004 IEEE international joint conference on neural networks, vol. 2. pp 1027–1032 Yao XF, Wang SD, Dong SQ (2004) Approximation of interval models by neural networks. In: Proceeding of 2004 IEEE international joint conference on neural networks, vol. 2. pp 1027–1032
Metadaten
Titel
A Modified Learning Algorithm for Interval Perceptrons with Interval Weights
verfasst von
Dakun Yang
Zhengxue Li
Yan Liu
Huisheng Zhang
Wei Wu
Publikationsdatum
01.10.2015
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2015
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-014-9362-9

Weitere Artikel der Ausgabe 2/2015

Neural Processing Letters 2/2015 Zur Ausgabe

Neuer Inhalt