Skip to main content
Erschienen in: Neural Computing and Applications 2/2009

01.02.2009 | Original Article

Identification using ANFIS with intelligent hybrid stable learning algorithm approaches

verfasst von: Mahdi Aliyari Shoorehdeli, Mohammad Teshnehlab, Ali Khaki Sedigh

Erschienen in: Neural Computing and Applications | Ausgabe 2/2009

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper suggests novel hybrid learning algorithm with stable learning laws for adaptive network based fuzzy inference system (ANFIS) as a system identifier and studies the stability of this algorithm. The new hybrid learning algorithm is based on particle swarm optimization (PSO) for training the antecedent part and gradient descent (GD) for training the conclusion part. Lyapunov stability theory is used to study the stability of the proposed algorithm. This paper, studies the stability of PSO as an optimizer in training the identifier, for the first time. Stable learning algorithms for the antecedent and consequent parts of fuzzy rules are proposed. Some constraints are obtained and simulation results are given to validate the results. It is shown that instability will not occur for the leaning rate and PSO factors in the presence of constraints. The learning rate can be calculated on-line and will provide an adaptive learning rate for the ANFIS structure. This new learning scheme employs adaptive learning rate that is determined by input–output data.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zhou Y, Li S, Jin R (2002) A new fuzzy neural network with fast learning algorithm and guaranteed stability for manufacturing process control. Fuzzy Sets Syst 132(2):201–216MATHCrossRefMathSciNet Zhou Y, Li S, Jin R (2002) A new fuzzy neural network with fast learning algorithm and guaranteed stability for manufacturing process control. Fuzzy Sets Syst 132(2):201–216MATHCrossRefMathSciNet
2.
Zurück zum Zitat Chen MS (1999) A comparative study of learning methods in tuning parameters of fuzzy membership functions. IEEE Conf on Syst Man Cybern 3:40–44 Chen MS (1999) A comparative study of learning methods in tuning parameters of fuzzy membership functions. IEEE Conf on Syst Man Cybern 3:40–44
3.
Zurück zum Zitat Yu W, Li X (2004) Fuzzy identification using fuzzy neural networks with stable learning algorithms. IEEE Trans Fuzzy Syst 12(3):411–420CrossRef Yu W, Li X (2004) Fuzzy identification using fuzzy neural networks with stable learning algorithms. IEEE Trans Fuzzy Syst 12(3):411–420CrossRef
4.
Zurück zum Zitat Polycarpou MM, Ioannou PA (1992) Learning and convergence analysis of neural-type structured networks. IEEE Trans Neural Netw 3(1):39–50CrossRef Polycarpou MM, Ioannou PA (1992) Learning and convergence analysis of neural-type structured networks. IEEE Trans Neural Netw 3(1):39–50CrossRef
5.
Zurück zum Zitat Kim WC, Ahn SC, Kwon WH (1995) Stability analysis and stabilization of fuzzy state space models. Fuzzy Sets Syst 71(1):131–142MATHCrossRefMathSciNet Kim WC, Ahn SC, Kwon WH (1995) Stability analysis and stabilization of fuzzy state space models. Fuzzy Sets Syst 71(1):131–142MATHCrossRefMathSciNet
6.
Zurück zum Zitat Lee C-H, Teng C-C (2000) Identification and control of dynamic systems using recurrent fuzzy neural networks. IEEE Trans Fuzzy Syst 8(4):349–366CrossRef Lee C-H, Teng C-C (2000) Identification and control of dynamic systems using recurrent fuzzy neural networks. IEEE Trans Fuzzy Syst 8(4):349–366CrossRef
7.
Zurück zum Zitat Yu W, Li X (2003) Fuzzy neural modeling using stable learning algorithm. In: Proceedings of American control conference, pp 4542–4547 Yu W, Li X (2003) Fuzzy neural modeling using stable learning algorithm. In: Proceedings of American control conference, pp 4542–4547
8.
Zurück zum Zitat Jang J-SR (1993) ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans Syst Man Cybern 23(3) Jang J-SR (1993) ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans Syst Man Cybern 23(3)
9.
Zurück zum Zitat Yager RR, Zadeh LA (1994) Fuzzy sets neural networks, and soft computing. Thomson Learning Yager RR, Zadeh LA (1994) Fuzzy sets neural networks, and soft computing. Thomson Learning
10.
Zurück zum Zitat Kumar M, Garg DP (2004) Intelligent learning of fuzzy logic controllers via neural network and genetic algorithm. In: Proceedings of Japan–USA symposium on flexible automation, Denver Co Kumar M, Garg DP (2004) Intelligent learning of fuzzy logic controllers via neural network and genetic algorithm. In: Proceedings of Japan–USA symposium on flexible automation, Denver Co
11.
Zurück zum Zitat Mascioli FM, Varazi GM, Martinelli G (1997) Constructive algorithm for neuro-fuzzy networks. In: Proceedings of the sixth IEEE international conference on fuzzy systems, vol 1, pp 459–464 Mascioli FM, Varazi GM, Martinelli G (1997) Constructive algorithm for neuro-fuzzy networks. In: Proceedings of the sixth IEEE international conference on fuzzy systems, vol 1, pp 459–464
12.
Zurück zum Zitat Jang J-SR, Mizutani E (1996) Levenberg–Marquardt method for ANFIS learning. In: Proceedings of Biennial conference of the North American fuzzy information processing society, pp 87–91 Jang J-SR, Mizutani E (1996) Levenberg–Marquardt method for ANFIS learning. In: Proceedings of Biennial conference of the North American fuzzy information processing society, pp 87–91
13.
Zurück zum Zitat Jang J-SR (1996) Input selection for ANFIS learning. In: Proceedings of the fifth IEEE international conference on fuzzy systems, vol 2, pp 1493–1499 Jang J-SR (1996) Input selection for ANFIS learning. In: Proceedings of the fifth IEEE international conference on fuzzy systems, vol 2, pp 1493–1499
14.
Zurück zum Zitat Aliyari M Sh, Teshnehlab M, Sedigh AK (2006) A novel training algorithm in ANFIS structure. In: Proceedings of the American control conferences Aliyari M Sh, Teshnehlab M, Sedigh AK (2006) A novel training algorithm in ANFIS structure. In: Proceedings of the American control conferences
15.
Zurück zum Zitat Eberhart RC, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of 6th international symposium micromachine human sci, vol 1, pp 39–43 Eberhart RC, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of 6th international symposium micromachine human sci, vol 1, pp 39–43
16.
Zurück zum Zitat Shi Y, Eberhart RC (1999) Empirical study of particle swarm optimization. In: Proceedings of IEEE congress on evolution of computation, pp 1945–1950 Shi Y, Eberhart RC (1999) Empirical study of particle swarm optimization. In: Proceedings of IEEE congress on evolution of computation, pp 1945–1950
17.
Zurück zum Zitat Mendes R, Kennedy J, Neves J (2004) The fully informed particle swarm: simpler, maybe better. IEEE Trans Evol Comput 8(3):204–210CrossRef Mendes R, Kennedy J, Neves J (2004) The fully informed particle swarm: simpler, maybe better. IEEE Trans Evol Comput 8(3):204–210CrossRef
18.
Zurück zum Zitat Eberhart RC, Hu X (1999) Human tremor analysis using particle swarm optimization. In: Proceedings of IEEE congress on evolution of computation, pp 1927–1930 Eberhart RC, Hu X (1999) Human tremor analysis using particle swarm optimization. In: Proceedings of IEEE congress on evolution of computation, pp 1927–1930
19.
Zurück zum Zitat Yoshida H, Kawata K, Fukuyama Y, Takayama S, Naknishi Y (2000) A particle swarm optimization for reactive power and voltage control considering voltage security assessment. IEEE Trans Power Syst 15(4):1232–1239CrossRef Yoshida H, Kawata K, Fukuyama Y, Takayama S, Naknishi Y (2000) A particle swarm optimization for reactive power and voltage control considering voltage security assessment. IEEE Trans Power Syst 15(4):1232–1239CrossRef
20.
Zurück zum Zitat Ciuprina G, Ioan D, Munteanu I (2002) Use of intelligent-particle swarm optimization in electromagnetics. IEEE Trans Magn 38(2):1037–1040CrossRef Ciuprina G, Ioan D, Munteanu I (2002) Use of intelligent-particle swarm optimization in electromagnetics. IEEE Trans Magn 38(2):1037–1040CrossRef
21.
Zurück zum Zitat M.Wachowiak, Smolikova R, Zheng Y, Zurada J, Elmaghraby A (2004) An approach to multimodal biomedical image registration utilizing particle swarm optimization. IEEE Trans Evol Comput 8(3):289–301CrossRef M.Wachowiak, Smolikova R, Zheng Y, Zurada J, Elmaghraby A (2004) An approach to multimodal biomedical image registration utilizing particle swarm optimization. IEEE Trans Evol Comput 8(3):289–301CrossRef
22.
Zurück zum Zitat Messerschmidt L, Engelbrecht A (2004) Learning to play games using a PSO-based competitive learning approach. IEEE Trans Evol Comput 8(3):280–288CrossRef Messerschmidt L, Engelbrecht A (2004) Learning to play games using a PSO-based competitive learning approach. IEEE Trans Evol Comput 8(3):280–288CrossRef
23.
Zurück zum Zitat Ratnaweera A, Halgamuge S, Watson H (2004) Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Trans Evol Comput 8(3):240–255CrossRef Ratnaweera A, Halgamuge S, Watson H (2004) Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Trans Evol Comput 8(3):240–255CrossRef
24.
Zurück zum Zitat Coello CAC, Pulido G, Lechuga M (2004) Handling multiple objectives with particle swarm optimization. IEEE Trans Evol Comput 8(3):256–279CrossRef Coello CAC, Pulido G, Lechuga M (2004) Handling multiple objectives with particle swarm optimization. IEEE Trans Evol Comput 8(3):256–279CrossRef
25.
Zurück zum Zitat Eberhart RC, Hu X (2002) Multiobjective optimization using dynamic neighborhood particle swarm optimization. In: Proceedings of IEEE congress on evolution of computation, pp 1677–1681 Eberhart RC, Hu X (2002) Multiobjective optimization using dynamic neighborhood particle swarm optimization. In: Proceedings of IEEE congress on evolution of computation, pp 1677–1681
26.
Zurück zum Zitat Parsopouls KE, Vrahatis MN (2002) Particle swarm optimization method in multiobjective problems. In: Proceedings of ACMSymp appl comput evol comput, pp 603–607 Parsopouls KE, Vrahatis MN (2002) Particle swarm optimization method in multiobjective problems. In: Proceedings of ACMSymp appl comput evol comput, pp 603–607
27.
Zurück zum Zitat Hu X, Eberhart RC, Shi Y (2003) Particle swarm with extended memory for multiobjective optimization. In: Proceedings of IEEE swarm Intell symp, Indianapolis, pp 193–197 Hu X, Eberhart RC, Shi Y (2003) Particle swarm with extended memory for multiobjective optimization. In: Proceedings of IEEE swarm Intell symp, Indianapolis, pp 193–197
28.
Zurück zum Zitat Angeline PJ (1998) Using selection to improve particle swami optimization. In: Proceedings of IEEE congress on evolution of computation, pp 84–89 Angeline PJ (1998) Using selection to improve particle swami optimization. In: Proceedings of IEEE congress on evolution of computation, pp 84–89
29.
Zurück zum Zitat Suganthan PN (1999) Particle swarm optimizer with neighborhood operator. In: Proceedings of IEEE congress on evolution of computation, pp 1958–1962 Suganthan PN (1999) Particle swarm optimizer with neighborhood operator. In: Proceedings of IEEE congress on evolution of computation, pp 1958–1962
30.
Zurück zum Zitat Kennedy J (1998) The behavior of particle. In: Proceedings of 7th Annu Conf Evol Program, pp 581–589 Kennedy J (1998) The behavior of particle. In: Proceedings of 7th Annu Conf Evol Program, pp 581–589
31.
Zurück zum Zitat Kadirkamanathan V, Selvarajah K, Fleming PJ (2006) Stability analysis of the particle dynamics in particle swarm optimizer. IEEE Trans Evol Comput 10(3):245–255CrossRef Kadirkamanathan V, Selvarajah K, Fleming PJ (2006) Stability analysis of the particle dynamics in particle swarm optimizer. IEEE Trans Evol Comput 10(3):245–255CrossRef
32.
Zurück zum Zitat Ozcan E, Mohan CK (1999) Particle swami optimization: surfing the waves. In: Proceedings of IEEE congress on evolution of computation, pp 1939–1944 Ozcan E, Mohan CK (1999) Particle swami optimization: surfing the waves. In: Proceedings of IEEE congress on evolution of computation, pp 1939–1944
33.
Zurück zum Zitat Mahfouf M, Chen M-Y, Linkens DA (2004) Adaptive weighted particle swarm optimization for multi-objective optimal design of alloy steels. In: Proceedings of parallel problem solving from nature VIII conference, pp 761–771 Mahfouf M, Chen M-Y, Linkens DA (2004) Adaptive weighted particle swarm optimization for multi-objective optimal design of alloy steels. In: Proceedings of parallel problem solving from nature VIII conference, pp 761–771
34.
Zurück zum Zitat Ho SL, Shiyou Yang, Guangzheng Ni, Edward WC Lo, Wong HC (2005) A particle swarm optimization-based method for multiobjective design optimizations. IEEE Trans Magn 41(5):1756–1759CrossRef Ho SL, Shiyou Yang, Guangzheng Ni, Edward WC Lo, Wong HC (2005) A particle swarm optimization-based method for multiobjective design optimizations. IEEE Trans Magn 41(5):1756–1759CrossRef
35.
Zurück zum Zitat Naka S, Genji T, Yura T, Fukuyama Y (2002) Hybrid particle swarm optimization based distribution state estimation using constriction factor approach. In: Proceedings of Int Conf SCIS & ISIS, vol 2, pp 1083–1088 Naka S, Genji T, Yura T, Fukuyama Y (2002) Hybrid particle swarm optimization based distribution state estimation using constriction factor approach. In: Proceedings of Int Conf SCIS & ISIS, vol 2, pp 1083–1088
36.
Zurück zum Zitat Miranda V, Fonseca N (2002) EPSO—evolutionary particle swarm optimization, a new algorithm with applications in power systems. In: Proceedings of IEEE Trans distribution Conf exhibition, vol 2, pp 6–10 Miranda V, Fonseca N (2002) EPSO—evolutionary particle swarm optimization, a new algorithm with applications in power systems. In: Proceedings of IEEE Trans distribution Conf exhibition, vol 2, pp 6–10
37.
Zurück zum Zitat Miranda V, Fonseca N (2002) EPSO-best-of-two-worlds meta-heuristic applied to power system problems. In: Proceedings of IEEE congress on evolution of computation, vol 2, pp 12–17 Miranda V, Fonseca N (2002) EPSO-best-of-two-worlds meta-heuristic applied to power system problems. In: Proceedings of IEEE congress on evolution of computation, vol 2, pp 12–17
38.
Zurück zum Zitat Clerc M (1999) The swarm and the queen: towards a deterministic and adaptive particle swarm optimization. In: Proceedings of IEEE Int Conf Evol Comput, pp 1951–1957 Clerc M (1999) The swarm and the queen: towards a deterministic and adaptive particle swarm optimization. In: Proceedings of IEEE Int Conf Evol Comput, pp 1951–1957
39.
Zurück zum Zitat Eberhart R, Shi Y (2000) Comparing inertia weights and constriction factors in particle swarm optimization. In: Proceedings of IEEE congress on evolution of computation, pp 84–88 Eberhart R, Shi Y (2000) Comparing inertia weights and constriction factors in particle swarm optimization. In: Proceedings of IEEE congress on evolution of computation, pp 84–88
40.
Zurück zum Zitat Heo JS, Lee KY, Garduno-Ramirez R (2006) Multiobjective control of power plants using particle swarm optimization techniques. IEEE Trans Energy Conversion 21(2):552–561CrossRef Heo JS, Lee KY, Garduno-Ramirez R (2006) Multiobjective control of power plants using particle swarm optimization techniques. IEEE Trans Energy Conversion 21(2):552–561CrossRef
41.
Zurück zum Zitat Narendra KS, Parthasarathy K (1990) Identification and control of dynamical system using neural networks. IEEE Trans Neural Netw 1(1):4–27CrossRef Narendra KS, Parthasarathy K (1990) Identification and control of dynamical system using neural networks. IEEE Trans Neural Netw 1(1):4–27CrossRef
42.
Zurück zum Zitat Chatterjee A, Watanabe K (2006) An optimized Takagi-Sugeno type neuro-fuzzy system for modeling robot manipulators. Neural Comput Appl 15(1):55–61CrossRef Chatterjee A, Watanabe K (2006) An optimized Takagi-Sugeno type neuro-fuzzy system for modeling robot manipulators. Neural Comput Appl 15(1):55–61CrossRef
43.
Zurück zum Zitat Aliyari M Sh, Teshnehlab M, Sedigh AK (2007) A novel hybrid learning algorithm for tuning ANFIS parameters using adaptive weighted PSO. In: Proceedings of IEEE Int Fuzzy Sys Conf, July 2007 Aliyari M Sh, Teshnehlab M, Sedigh AK (2007) A novel hybrid learning algorithm for tuning ANFIS parameters using adaptive weighted PSO. In: Proceedings of IEEE Int Fuzzy Sys Conf, July 2007
44.
Zurück zum Zitat Takagi H, Hayashi I (1991) NN- driven fuzzy reasoning. Int J Approx Reason 5(3):191–212MATHCrossRef Takagi H, Hayashi I (1991) NN- driven fuzzy reasoning. Int J Approx Reason 5(3):191–212MATHCrossRef
45.
Zurück zum Zitat Mackey MC, Glass L (1977) Oscillation and chaos in physical control system. Science 197:287–289CrossRef Mackey MC, Glass L (1977) Oscillation and chaos in physical control system. Science 197:287–289CrossRef
Metadaten
Titel
Identification using ANFIS with intelligent hybrid stable learning algorithm approaches
verfasst von
Mahdi Aliyari Shoorehdeli
Mohammad Teshnehlab
Ali Khaki Sedigh
Publikationsdatum
01.02.2009
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 2/2009
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-007-0168-9

Weitere Artikel der Ausgabe 2/2009

Neural Computing and Applications 2/2009 Zur Ausgabe