Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 6/2015

01.12.2015 | Original Article

Nonlinear system identification using least squares support vector machine tuned by an adaptive particle swarm optimization

verfasst von: Shuen Wang, Zhenzhen Han, Fucai Liu, Yinggan Tang

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 6/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we present a method for nonlinear system identification. The proposed method adopts least squares support vector machine (LSSVM) to approximate a nonlinear autoregressive model with eXogeneous (NARX). First, the orders of NARX model are determined from input–output data via Lipschitz quotient criterion. Then, an LSSVM model is used to approximate the NARX model. To obtain an efficient LSSVM model, a novel particle swarm optimization with adaptive inertia weight is proposed to tune the hyper-parameters of LSSVM. Two experimental results are given to illustrate the effectiveness of the proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Aadaleesan P, Miglan N, Sharma R, Saha P (2008) Nonlinear system identification using Wiener type Laguerre-wavelet network model. Chem Eng Sci 63:3932–3941CrossRef Aadaleesan P, Miglan N, Sharma R, Saha P (2008) Nonlinear system identification using Wiener type Laguerre-wavelet network model. Chem Eng Sci 63:3932–3941CrossRef
2.
Zurück zum Zitat Abdelazim T, Malik O (2005) Identification of nonlinear systems by Takagi–Sugeno fuzzy logic grey box modeling for real-time control. Control Eng Pract 13:1489–1498CrossRef Abdelazim T, Malik O (2005) Identification of nonlinear systems by Takagi–Sugeno fuzzy logic grey box modeling for real-time control. Control Eng Pract 13:1489–1498CrossRef
3.
Zurück zum Zitat Adachi S, Ogawa T (2001) A new system identification method based on support vector machines. In: IFAC workshop adaptation and learning in control and signal processing, Italy Adachi S, Ogawa T (2001) A new system identification method based on support vector machines. In: IFAC workshop adaptation and learning in control and signal processing, Italy
4.
Zurück zum Zitat Akaike H (2009) A new look at the statistical model identification. IEEE Fuzzy Set Syst 160:3518–3529CrossRef Akaike H (2009) A new look at the statistical model identification. IEEE Fuzzy Set Syst 160:3518–3529CrossRef
5.
Zurück zum Zitat Alci M, Asyali MH (1974) Nonlinear system identification via Laguerre network based fuzzy systems. IEEE Trans Autom Control 19(6):716–723CrossRef Alci M, Asyali MH (1974) Nonlinear system identification via Laguerre network based fuzzy systems. IEEE Trans Autom Control 19(6):716–723CrossRef
6.
Zurück zum Zitat Aydin I, Karakose M, Akin E (2011) A multi-objective artificial immune algorithm for parameter optimization in support vector machine. Appl Soft Comput 11(1):120–129CrossRef Aydin I, Karakose M, Akin E (2011) A multi-objective artificial immune algorithm for parameter optimization in support vector machine. Appl Soft Comput 11(1):120–129CrossRef
7.
Zurück zum Zitat Bagis A (2008) Fuzzy rule base design using tabu search algorithm for nonlinear system modeling. ISA Trans 47:32–44CrossRef Bagis A (2008) Fuzzy rule base design using tabu search algorithm for nonlinear system modeling. ISA Trans 47:32–44CrossRef
8.
Zurück zum Zitat de Barros J, Dexter A (2007) On-line identification of computationally undemanding evolving fuzzy models. Fuzzy Sets Syst 158:1997–2012CrossRefMATH de Barros J, Dexter A (2007) On-line identification of computationally undemanding evolving fuzzy models. Fuzzy Sets Syst 158:1997–2012CrossRefMATH
9.
Zurück zum Zitat Boyd S, Chua L (1985) Fading memory and the problem of approximating nonlinear operators with Volterra series. IEEE Trans Circuits Syst 32(11):1150–1161MathSciNetCrossRefMATH Boyd S, Chua L (1985) Fading memory and the problem of approximating nonlinear operators with Volterra series. IEEE Trans Circuits Syst 32(11):1150–1161MathSciNetCrossRefMATH
10.
Zurück zum Zitat Du H, Zhang N (2008) Application of evolving Takagi–Sugeno fuzzy model to nonlinear system identification. Appl Soft Comput 8:676–686CrossRef Du H, Zhang N (2008) Application of evolving Takagi–Sugeno fuzzy model to nonlinear system identification. Appl Soft Comput 8:676–686CrossRef
11.
Zurück zum Zitat Ge H, Du W, Qian F, Liang Y (2009) Identification and control of nonlinear systems by a time-delay recurrent neural network. Neurocomputing 72:2857–2864CrossRef Ge H, Du W, Qian F, Liang Y (2009) Identification and control of nonlinear systems by a time-delay recurrent neural network. Neurocomputing 72:2857–2864CrossRef
12.
Zurück zum Zitat Ge H, Qian F, Liang Y, Du W, Wang L (2008) Identification and control of nonlinear system by a dissimilation particle swarm optimization-based Elman neural network. Nonlinear Anal Real World Appl 9:1345–1360MathSciNetCrossRefMATH Ge H, Qian F, Liang Y, Du W, Wang L (2008) Identification and control of nonlinear system by a dissimilation particle swarm optimization-based Elman neural network. Nonlinear Anal Real World Appl 9:1345–1360MathSciNetCrossRefMATH
13.
Zurück zum Zitat Giri F, Bai E (2010) Block-oriented nonlinear system identification. Springer, BerlinCrossRefMATH Giri F, Bai E (2010) Block-oriented nonlinear system identification. Springer, BerlinCrossRefMATH
14.
Zurück zum Zitat Guenounou O, Belmehdi A, Dahhou B (2009) Multi-objective optimization of TSK fuzzy models. Expert Syst Appl 36:7416–7423CrossRef Guenounou O, Belmehdi A, Dahhou B (2009) Multi-objective optimization of TSK fuzzy models. Expert Syst Appl 36:7416–7423CrossRef
15.
Zurück zum Zitat Guo X, Yang J, Wu C, Wang C, Liang Y (2008) A novel LS-SVMs hyper-parameter selection based on particle swarm optimization. Neurocomputing 71(16):3211–3215CrossRef Guo X, Yang J, Wu C, Wang C, Liang Y (2008) A novel LS-SVMs hyper-parameter selection based on particle swarm optimization. Neurocomputing 71(16):3211–3215CrossRef
16.
Zurück zum Zitat He X, Asada H.: A new method for identifying orders of input-output models for nonlinear dynamic systems. In: American control conference, pp 2520–2523 (1993) He X, Asada H.: A new method for identifying orders of input-output models for nonlinear dynamic systems. In: American control conference, pp 2520–2523 (1993)
17.
Zurück zum Zitat Jeng J, Lee M, Huang H (2005) Identification of block-oriented nonlinear processes using designed relay feedback tests. Ind Eng Chem Res 44:2145–2155CrossRef Jeng J, Lee M, Huang H (2005) Identification of block-oriented nonlinear processes using designed relay feedback tests. Ind Eng Chem Res 44:2145–2155CrossRef
19.
Zurück zum Zitat Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings, IEEE international conference on neural networks, 1995, vol 4, pp 1942–1948 (1995) Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings, IEEE international conference on neural networks, 1995, vol 4, pp 1942–1948 (1995)
20.
Zurück zum Zitat Kennedy JF, Kennedy J, Eberhart RC (2001) Swarm intelligence. Morgan Kaufmann, San Francisco Kennedy JF, Kennedy J, Eberhart RC (2001) Swarm intelligence. Morgan Kaufmann, San Francisco
21.
Zurück zum Zitat Li S, Tan M (2010) Tuning SVM parameters by using a hybrid CLPSO-BFGS algorithm. Neurocomputing 73(10):2089–2096MathSciNetCrossRef Li S, Tan M (2010) Tuning SVM parameters by using a hybrid CLPSO-BFGS algorithm. Neurocomputing 73(10):2089–2096MathSciNetCrossRef
22.
Zurück zum Zitat Lima CA, Coelho AL, Von Zuben FJ (2007) Hybridizing mixtures of experts with support vector machines: investigation into nonlinear dynamic systems identification. Inf Sci 177(10):2049–2074CrossRef Lima CA, Coelho AL, Von Zuben FJ (2007) Hybridizing mixtures of experts with support vector machines: investigation into nonlinear dynamic systems identification. Inf Sci 177(10):2049–2074CrossRef
23.
Zurück zum Zitat Lu Z, Sun J (2009) Non-Mercer hybrid kernel for linear programming support vector regression in nonlinear systems identification. Appl Soft Comput 9(1):94–99CrossRef Lu Z, Sun J (2009) Non-Mercer hybrid kernel for linear programming support vector regression in nonlinear systems identification. Appl Soft Comput 9(1):94–99CrossRef
24.
Zurück zum Zitat Lu Z, Sun J, Butts KR (2009) Linear programming support vector regression with wavelet kernel: a new approach to nonlinear dynamical systems identification. Math Comput Simul 79(7):2051–2063MathSciNetCrossRefMATH Lu Z, Sun J, Butts KR (2009) Linear programming support vector regression with wavelet kernel: a new approach to nonlinear dynamical systems identification. Math Comput Simul 79(7):2051–2063MathSciNetCrossRefMATH
25.
Zurück zum Zitat Mirri D, Iuculano G, Filicori F, Pasini G, Vannini G, Gualtieri G (2002) A modified Volterra series approach for nonlinear dynamic systems modeling. IEEE Trans Circ Syst Fund Theor Appl 49:1118–1128CrossRef Mirri D, Iuculano G, Filicori F, Pasini G, Vannini G, Gualtieri G (2002) A modified Volterra series approach for nonlinear dynamic systems modeling. IEEE Trans Circ Syst Fund Theor Appl 49:1118–1128CrossRef
26.
Zurück zum Zitat Narendra K, Parthasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1(1):4–27CrossRef Narendra K, Parthasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1(1):4–27CrossRef
27.
Zurück zum Zitat Nickabadi A, Ebadzadeh MM, Safabakhsh R (2011) A novel particle swarm optimization algorithm with adaptive inertia weight. Appl Soft Comput 11(4):3658–3670CrossRef Nickabadi A, Ebadzadeh MM, Safabakhsh R (2011) A novel particle swarm optimization algorithm with adaptive inertia weight. Appl Soft Comput 11(4):3658–3670CrossRef
28.
Zurück zum Zitat Rojo-Álvarez JL, Martínez-Ramón M, de Prado-Cumplido M, Artés-Rodríguez A, Figueiras-Vidal AR (2004) Support vector method for robust ARMA system identification. IEEE Trans Signal Process 52(1):155–164MathSciNetCrossRef Rojo-Álvarez JL, Martínez-Ramón M, de Prado-Cumplido M, Artés-Rodríguez A, Figueiras-Vidal AR (2004) Support vector method for robust ARMA system identification. IEEE Trans Signal Process 52(1):155–164MathSciNetCrossRef
29.
30.
Zurück zum Zitat Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: The 1998 IEEE international conference on evolutionary computation proceedings, 1998. IEEE World Congress on computational intelligence. IEEE, pp 69–73 Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: The 1998 IEEE international conference on evolutionary computation proceedings, 1998. IEEE World Congress on computational intelligence. IEEE, pp 69–73
31.
Zurück zum Zitat Subudhia B, Jena D (2011) A differential evolution based neural network approach to nonlinear system identification. Appl Soft Comput 11:861–871CrossRef Subudhia B, Jena D (2011) A differential evolution based neural network approach to nonlinear system identification. Appl Soft Comput 11:861–871CrossRef
32.
Zurück zum Zitat Suykens J, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 3:293–300CrossRef Suykens J, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 3:293–300CrossRef
33.
Zurück zum Zitat Tang X, Zhuang L, Jiang C (2009) Prediction of silicon content in hot metal using support vector regression based on chaos particle swarm optimization. Expert Syst Appl 36(9):11853–11857CrossRef Tang X, Zhuang L, Jiang C (2009) Prediction of silicon content in hot metal using support vector regression based on chaos particle swarm optimization. Expert Syst Appl 36(9):11853–11857CrossRef
34.
Zurück zum Zitat Tötterman S, Toivonen HT (2009) Support vector method for identification of Wiener models. J Process Control 19(7):1174–1181CrossRef Tötterman S, Toivonen HT (2009) Support vector method for identification of Wiener models. J Process Control 19(7):1174–1181CrossRef
35.
Zurück zum Zitat Vapnik V (1998) Statistical learning theory. Wiley, New YorkMATH Vapnik V (1998) Statistical learning theory. Wiley, New YorkMATH
36.
Zurück zum Zitat Wu Q (2009) The forecasting model based on wavelet \(\nu\)-support vector machine. Expert Syst Appl 36(4):7604–7610CrossRef Wu Q (2009) The forecasting model based on wavelet \(\nu\)-support vector machine. Expert Syst Appl 36(4):7604–7610CrossRef
37.
Zurück zum Zitat Xie W, Zhu Y, Zhao Z, Wong Y (2009) Nonlinear system identification using optimized dynamic neural network. Neurocomputing 72:3277–3287CrossRef Xie W, Zhu Y, Zhao Z, Wong Y (2009) Nonlinear system identification using optimized dynamic neural network. Neurocomputing 72:3277–3287CrossRef
38.
Zurück zum Zitat Zhang X, Chen X, He Z (2010) An ACO-based algorithm for parameter optimization of support vector machines. Expert Syst Appl 37(9):6618–6628CrossRef Zhang X, Chen X, He Z (2010) An ACO-based algorithm for parameter optimization of support vector machines. Expert Syst Appl 37(9):6618–6628CrossRef
39.
Zurück zum Zitat Zhao H, Zhang J (2009) Nonlinear dynamic system identification using pipelined functional link artificial recurrent network network. Neurocomputing 72:3046–3054CrossRef Zhao H, Zhang J (2009) Nonlinear dynamic system identification using pipelined functional link artificial recurrent network network. Neurocomputing 72:3046–3054CrossRef
Metadaten
Titel
Nonlinear system identification using least squares support vector machine tuned by an adaptive particle swarm optimization
verfasst von
Shuen Wang
Zhenzhen Han
Fucai Liu
Yinggan Tang
Publikationsdatum
01.12.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 6/2015
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-015-0403-0

Weitere Artikel der Ausgabe 6/2015

International Journal of Machine Learning and Cybernetics 6/2015 Zur Ausgabe

Editorial

Editorial