Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 6/2015

01-12-2015 | Original Article

Nonlinear system identification using least squares support vector machine tuned by an adaptive particle swarm optimization

Authors: Shuen Wang, Zhenzhen Han, Fucai Liu, Yinggan Tang

Published in: International Journal of Machine Learning and Cybernetics | Issue 6/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we present a method for nonlinear system identification. The proposed method adopts least squares support vector machine (LSSVM) to approximate a nonlinear autoregressive model with eXogeneous (NARX). First, the orders of NARX model are determined from input–output data via Lipschitz quotient criterion. Then, an LSSVM model is used to approximate the NARX model. To obtain an efficient LSSVM model, a novel particle swarm optimization with adaptive inertia weight is proposed to tune the hyper-parameters of LSSVM. Two experimental results are given to illustrate the effectiveness of the proposed method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Aadaleesan P, Miglan N, Sharma R, Saha P (2008) Nonlinear system identification using Wiener type Laguerre-wavelet network model. Chem Eng Sci 63:3932–3941CrossRef Aadaleesan P, Miglan N, Sharma R, Saha P (2008) Nonlinear system identification using Wiener type Laguerre-wavelet network model. Chem Eng Sci 63:3932–3941CrossRef
2.
go back to reference Abdelazim T, Malik O (2005) Identification of nonlinear systems by Takagi–Sugeno fuzzy logic grey box modeling for real-time control. Control Eng Pract 13:1489–1498CrossRef Abdelazim T, Malik O (2005) Identification of nonlinear systems by Takagi–Sugeno fuzzy logic grey box modeling for real-time control. Control Eng Pract 13:1489–1498CrossRef
3.
go back to reference Adachi S, Ogawa T (2001) A new system identification method based on support vector machines. In: IFAC workshop adaptation and learning in control and signal processing, Italy Adachi S, Ogawa T (2001) A new system identification method based on support vector machines. In: IFAC workshop adaptation and learning in control and signal processing, Italy
4.
go back to reference Akaike H (2009) A new look at the statistical model identification. IEEE Fuzzy Set Syst 160:3518–3529CrossRef Akaike H (2009) A new look at the statistical model identification. IEEE Fuzzy Set Syst 160:3518–3529CrossRef
5.
go back to reference Alci M, Asyali MH (1974) Nonlinear system identification via Laguerre network based fuzzy systems. IEEE Trans Autom Control 19(6):716–723CrossRef Alci M, Asyali MH (1974) Nonlinear system identification via Laguerre network based fuzzy systems. IEEE Trans Autom Control 19(6):716–723CrossRef
6.
go back to reference Aydin I, Karakose M, Akin E (2011) A multi-objective artificial immune algorithm for parameter optimization in support vector machine. Appl Soft Comput 11(1):120–129CrossRef Aydin I, Karakose M, Akin E (2011) A multi-objective artificial immune algorithm for parameter optimization in support vector machine. Appl Soft Comput 11(1):120–129CrossRef
7.
go back to reference Bagis A (2008) Fuzzy rule base design using tabu search algorithm for nonlinear system modeling. ISA Trans 47:32–44CrossRef Bagis A (2008) Fuzzy rule base design using tabu search algorithm for nonlinear system modeling. ISA Trans 47:32–44CrossRef
8.
go back to reference de Barros J, Dexter A (2007) On-line identification of computationally undemanding evolving fuzzy models. Fuzzy Sets Syst 158:1997–2012CrossRefMATH de Barros J, Dexter A (2007) On-line identification of computationally undemanding evolving fuzzy models. Fuzzy Sets Syst 158:1997–2012CrossRefMATH
9.
go back to reference Boyd S, Chua L (1985) Fading memory and the problem of approximating nonlinear operators with Volterra series. IEEE Trans Circuits Syst 32(11):1150–1161MathSciNetCrossRefMATH Boyd S, Chua L (1985) Fading memory and the problem of approximating nonlinear operators with Volterra series. IEEE Trans Circuits Syst 32(11):1150–1161MathSciNetCrossRefMATH
10.
go back to reference Du H, Zhang N (2008) Application of evolving Takagi–Sugeno fuzzy model to nonlinear system identification. Appl Soft Comput 8:676–686CrossRef Du H, Zhang N (2008) Application of evolving Takagi–Sugeno fuzzy model to nonlinear system identification. Appl Soft Comput 8:676–686CrossRef
11.
go back to reference Ge H, Du W, Qian F, Liang Y (2009) Identification and control of nonlinear systems by a time-delay recurrent neural network. Neurocomputing 72:2857–2864CrossRef Ge H, Du W, Qian F, Liang Y (2009) Identification and control of nonlinear systems by a time-delay recurrent neural network. Neurocomputing 72:2857–2864CrossRef
12.
go back to reference Ge H, Qian F, Liang Y, Du W, Wang L (2008) Identification and control of nonlinear system by a dissimilation particle swarm optimization-based Elman neural network. Nonlinear Anal Real World Appl 9:1345–1360MathSciNetCrossRefMATH Ge H, Qian F, Liang Y, Du W, Wang L (2008) Identification and control of nonlinear system by a dissimilation particle swarm optimization-based Elman neural network. Nonlinear Anal Real World Appl 9:1345–1360MathSciNetCrossRefMATH
13.
14.
go back to reference Guenounou O, Belmehdi A, Dahhou B (2009) Multi-objective optimization of TSK fuzzy models. Expert Syst Appl 36:7416–7423CrossRef Guenounou O, Belmehdi A, Dahhou B (2009) Multi-objective optimization of TSK fuzzy models. Expert Syst Appl 36:7416–7423CrossRef
15.
go back to reference Guo X, Yang J, Wu C, Wang C, Liang Y (2008) A novel LS-SVMs hyper-parameter selection based on particle swarm optimization. Neurocomputing 71(16):3211–3215CrossRef Guo X, Yang J, Wu C, Wang C, Liang Y (2008) A novel LS-SVMs hyper-parameter selection based on particle swarm optimization. Neurocomputing 71(16):3211–3215CrossRef
16.
go back to reference He X, Asada H.: A new method for identifying orders of input-output models for nonlinear dynamic systems. In: American control conference, pp 2520–2523 (1993) He X, Asada H.: A new method for identifying orders of input-output models for nonlinear dynamic systems. In: American control conference, pp 2520–2523 (1993)
17.
go back to reference Jeng J, Lee M, Huang H (2005) Identification of block-oriented nonlinear processes using designed relay feedback tests. Ind Eng Chem Res 44:2145–2155CrossRef Jeng J, Lee M, Huang H (2005) Identification of block-oriented nonlinear processes using designed relay feedback tests. Ind Eng Chem Res 44:2145–2155CrossRef
19.
go back to reference Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings, IEEE international conference on neural networks, 1995, vol 4, pp 1942–1948 (1995) Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings, IEEE international conference on neural networks, 1995, vol 4, pp 1942–1948 (1995)
20.
go back to reference Kennedy JF, Kennedy J, Eberhart RC (2001) Swarm intelligence. Morgan Kaufmann, San Francisco Kennedy JF, Kennedy J, Eberhart RC (2001) Swarm intelligence. Morgan Kaufmann, San Francisco
21.
22.
go back to reference Lima CA, Coelho AL, Von Zuben FJ (2007) Hybridizing mixtures of experts with support vector machines: investigation into nonlinear dynamic systems identification. Inf Sci 177(10):2049–2074CrossRef Lima CA, Coelho AL, Von Zuben FJ (2007) Hybridizing mixtures of experts with support vector machines: investigation into nonlinear dynamic systems identification. Inf Sci 177(10):2049–2074CrossRef
23.
go back to reference Lu Z, Sun J (2009) Non-Mercer hybrid kernel for linear programming support vector regression in nonlinear systems identification. Appl Soft Comput 9(1):94–99CrossRef Lu Z, Sun J (2009) Non-Mercer hybrid kernel for linear programming support vector regression in nonlinear systems identification. Appl Soft Comput 9(1):94–99CrossRef
24.
go back to reference Lu Z, Sun J, Butts KR (2009) Linear programming support vector regression with wavelet kernel: a new approach to nonlinear dynamical systems identification. Math Comput Simul 79(7):2051–2063MathSciNetCrossRefMATH Lu Z, Sun J, Butts KR (2009) Linear programming support vector regression with wavelet kernel: a new approach to nonlinear dynamical systems identification. Math Comput Simul 79(7):2051–2063MathSciNetCrossRefMATH
25.
go back to reference Mirri D, Iuculano G, Filicori F, Pasini G, Vannini G, Gualtieri G (2002) A modified Volterra series approach for nonlinear dynamic systems modeling. IEEE Trans Circ Syst Fund Theor Appl 49:1118–1128CrossRef Mirri D, Iuculano G, Filicori F, Pasini G, Vannini G, Gualtieri G (2002) A modified Volterra series approach for nonlinear dynamic systems modeling. IEEE Trans Circ Syst Fund Theor Appl 49:1118–1128CrossRef
26.
go back to reference Narendra K, Parthasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1(1):4–27CrossRef Narendra K, Parthasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1(1):4–27CrossRef
27.
go back to reference Nickabadi A, Ebadzadeh MM, Safabakhsh R (2011) A novel particle swarm optimization algorithm with adaptive inertia weight. Appl Soft Comput 11(4):3658–3670CrossRef Nickabadi A, Ebadzadeh MM, Safabakhsh R (2011) A novel particle swarm optimization algorithm with adaptive inertia weight. Appl Soft Comput 11(4):3658–3670CrossRef
28.
go back to reference Rojo-Álvarez JL, Martínez-Ramón M, de Prado-Cumplido M, Artés-Rodríguez A, Figueiras-Vidal AR (2004) Support vector method for robust ARMA system identification. IEEE Trans Signal Process 52(1):155–164MathSciNetCrossRef Rojo-Álvarez JL, Martínez-Ramón M, de Prado-Cumplido M, Artés-Rodríguez A, Figueiras-Vidal AR (2004) Support vector method for robust ARMA system identification. IEEE Trans Signal Process 52(1):155–164MathSciNetCrossRef
30.
go back to reference Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: The 1998 IEEE international conference on evolutionary computation proceedings, 1998. IEEE World Congress on computational intelligence. IEEE, pp 69–73 Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: The 1998 IEEE international conference on evolutionary computation proceedings, 1998. IEEE World Congress on computational intelligence. IEEE, pp 69–73
31.
go back to reference Subudhia B, Jena D (2011) A differential evolution based neural network approach to nonlinear system identification. Appl Soft Comput 11:861–871CrossRef Subudhia B, Jena D (2011) A differential evolution based neural network approach to nonlinear system identification. Appl Soft Comput 11:861–871CrossRef
32.
go back to reference Suykens J, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 3:293–300CrossRef Suykens J, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 3:293–300CrossRef
33.
go back to reference Tang X, Zhuang L, Jiang C (2009) Prediction of silicon content in hot metal using support vector regression based on chaos particle swarm optimization. Expert Syst Appl 36(9):11853–11857CrossRef Tang X, Zhuang L, Jiang C (2009) Prediction of silicon content in hot metal using support vector regression based on chaos particle swarm optimization. Expert Syst Appl 36(9):11853–11857CrossRef
34.
go back to reference Tötterman S, Toivonen HT (2009) Support vector method for identification of Wiener models. J Process Control 19(7):1174–1181CrossRef Tötterman S, Toivonen HT (2009) Support vector method for identification of Wiener models. J Process Control 19(7):1174–1181CrossRef
35.
go back to reference Vapnik V (1998) Statistical learning theory. Wiley, New YorkMATH Vapnik V (1998) Statistical learning theory. Wiley, New YorkMATH
36.
go back to reference Wu Q (2009) The forecasting model based on wavelet \(\nu\)-support vector machine. Expert Syst Appl 36(4):7604–7610CrossRef Wu Q (2009) The forecasting model based on wavelet \(\nu\)-support vector machine. Expert Syst Appl 36(4):7604–7610CrossRef
37.
go back to reference Xie W, Zhu Y, Zhao Z, Wong Y (2009) Nonlinear system identification using optimized dynamic neural network. Neurocomputing 72:3277–3287CrossRef Xie W, Zhu Y, Zhao Z, Wong Y (2009) Nonlinear system identification using optimized dynamic neural network. Neurocomputing 72:3277–3287CrossRef
38.
go back to reference Zhang X, Chen X, He Z (2010) An ACO-based algorithm for parameter optimization of support vector machines. Expert Syst Appl 37(9):6618–6628CrossRef Zhang X, Chen X, He Z (2010) An ACO-based algorithm for parameter optimization of support vector machines. Expert Syst Appl 37(9):6618–6628CrossRef
39.
go back to reference Zhao H, Zhang J (2009) Nonlinear dynamic system identification using pipelined functional link artificial recurrent network network. Neurocomputing 72:3046–3054CrossRef Zhao H, Zhang J (2009) Nonlinear dynamic system identification using pipelined functional link artificial recurrent network network. Neurocomputing 72:3046–3054CrossRef
Metadata
Title
Nonlinear system identification using least squares support vector machine tuned by an adaptive particle swarm optimization
Authors
Shuen Wang
Zhenzhen Han
Fucai Liu
Yinggan Tang
Publication date
01-12-2015
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 6/2015
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-015-0403-0

Other articles of this Issue 6/2015

International Journal of Machine Learning and Cybernetics 6/2015 Go to the issue

Editorial

Editorial