Skip to main content
Top
Published in: Neural Computing and Applications 10/2020

07-03-2019 | Original Article

Lagrangian twin parametric insensitive support vector regression (LTPISVR)

Authors: Deepak Gupta, Kamalini Acharjee, Bharat Richhariya

Published in: Neural Computing and Applications | Issue 10/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, motivated by the works on twin parametric insensitive support vector regression (TPISVR) (Peng in Neurocomputing 79(1):26–38, 2012), and Lagrangian twin support vector regression (Balasundaram and Tanveer in Neural Comput Appl 22(1):257–267, 2013), a new efficient approach is proposed as Lagrangian twin parametric insensitive support vector regression (LTPISVR). In order to make the objective function strongly convex, we consider square of 2-norm of slack variables in the optimization problem. To reduce the computation cost, the solution of proposed LTPISVR is obtained by solving simple linearly convergent iterative schemes, instead of quadratic programming problems as in TPISVR. There is no requirement of any optimization toolbox for proposed LTPISVR. To demonstrate the effectiveness of proposed method, we present numerical results on well-known synthetic and real-world datasets. The results clearly show similar or better generalization performance of proposed method with lesser training time in comparison with support vector regression, twin support vector regression and twin parametric insensitive support vector regression.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Balasundaram S, Tanveer M (2013) On Lagrangian twin support vector regression. Neural Comput Appl 22(1):257–267CrossRef Balasundaram S, Tanveer M (2013) On Lagrangian twin support vector regression. Neural Comput Appl 22(1):257–267CrossRef
2.
go back to reference Bao Y-K, Liu Z-T, Guo L, Wang W (2005) Forecasting stock composite index by fuzzy support vector machines regression. In: Proceeding of international conference on machine learning and cybernetics, vol 6, pp 3535–3540 Bao Y-K, Liu Z-T, Guo L, Wang W (2005) Forecasting stock composite index by fuzzy support vector machines regression. In: Proceeding of international conference on machine learning and cybernetics, vol 6, pp 3535–3540
3.
go back to reference Box GEP, Jenkins GM (1976) Time series analysis: forecasting and control. Holden-Day, San FranciscoMATH Box GEP, Jenkins GM (1976) Time series analysis: forecasting and control. Holden-Day, San FranciscoMATH
4.
go back to reference Brockwell PJ, Davis RA (2002) Introduction to time series forecasting, 2nd edn. Springer, BerlinMATHCrossRef Brockwell PJ, Davis RA (2002) Introduction to time series forecasting, 2nd edn. Springer, BerlinMATHCrossRef
6.
go back to reference Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH
7.
go back to reference Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel based learning methods. Cambridge University Press, CambridgeMATHCrossRef Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel based learning methods. Cambridge University Press, CambridgeMATHCrossRef
9.
go back to reference Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNetMATH Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNetMATH
10.
go back to reference Garcia S, Herrera F (2008) An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons. J Mach Learn Res 9:2677–2694MATH Garcia S, Herrera F (2008) An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons. J Mach Learn Res 9:2677–2694MATH
11.
go back to reference Gretton A, Doucet A, Herbrich R, Rayner PJW, Scholkopf B (2001) Support vector regression for black-box system identification. In: Proceedings of the 11th IEEE workshop on statistical signal processing Gretton A, Doucet A, Herbrich R, Rayner PJW, Scholkopf B (2001) Support vector regression for black-box system identification. In: Proceedings of the 11th IEEE workshop on statistical signal processing
14.
go back to reference Hao PY, Tsai LB, Lin MS (2008) A new Support vector classification algorithm with parametric-margin model. In: IEEE international joint conference, IJCNN, neural networks, pp 420–425 Hao PY, Tsai LB, Lin MS (2008) A new Support vector classification algorithm with parametric-margin model. In: IEEE international joint conference, IJCNN, neural networks, pp 420–425
15.
go back to reference Jayadeva, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910MATHCrossRef Jayadeva, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910MATHCrossRef
16.
go back to reference Khemchandani R, Sharma S (2016) Robust least square twin support vector machine for human activity recognition. Appl Soft Comput 47:33–46CrossRef Khemchandani R, Sharma S (2016) Robust least square twin support vector machine for human activity recognition. Appl Soft Comput 47:33–46CrossRef
17.
go back to reference Kim SK, Park YJ, Toh KA, Lee S (2010) SVM-based feature extraction for face recognition. Pattern Recognit 43(8):2871–2881MATHCrossRef Kim SK, Park YJ, Toh KA, Lee S (2010) SVM-based feature extraction for face recognition. Pattern Recognit 43(8):2871–2881MATHCrossRef
18.
go back to reference Malhotra R, Malhotra DK (2003) Evaluating consumer loans using neural networks. Omega 31:83–96CrossRef Malhotra R, Malhotra DK (2003) Evaluating consumer loans using neural networks. Omega 31:83–96CrossRef
20.
go back to reference Mangasarian OL, Musicant DR (2001) Lagrangian support vector machines. J Mach Learn Res 1:161–177MathSciNetMATH Mangasarian OL, Musicant DR (2001) Lagrangian support vector machines. J Mach Learn Res 1:161–177MathSciNetMATH
21.
go back to reference Mukherjee S, Osuna E, Girosi F (1997) Nonlinear prediction of chaotic time series using support vector machines. In: NNSP’97: neural networks for signal processing VII: proceedings of IEEE signal processing society workshop, Amelia Island, FL, USA, pp 511–520 Mukherjee S, Osuna E, Girosi F (1997) Nonlinear prediction of chaotic time series using support vector machines. In: NNSP’97: neural networks for signal processing VII: proceedings of IEEE signal processing society workshop, Amelia Island, FL, USA, pp 511–520
23.
go back to reference Peng X (2010) TSVR: an efficient twin support vector machine for regression. Neural Netw 23(3):365–372MATHCrossRef Peng X (2010) TSVR: an efficient twin support vector machine for regression. Neural Netw 23(3):365–372MATHCrossRef
24.
go back to reference Peng X (2012) Efficient twin parametric insensitive support vector regression model. Neurocomputing 79(1):26–38CrossRef Peng X (2012) Efficient twin parametric insensitive support vector regression model. Neurocomputing 79(1):26–38CrossRef
25.
go back to reference Richhariya B, Tanveer M (2018) EEG signal classification using universum support vector machine. Expert Syst Appl 106:169–182CrossRef Richhariya B, Tanveer M (2018) EEG signal classification using universum support vector machine. Expert Syst Appl 106:169–182CrossRef
26.
go back to reference Rios EG, Hernandez EE, Miyatake MN, Meana HP (2017) Face recognition with occlusion using a wireframe model and support vector machine. IEEE Latin Am Trans 15(10):1960–1966CrossRef Rios EG, Hernandez EE, Miyatake MN, Meana HP (2017) Face recognition with occlusion using a wireframe model and support vector machine. IEEE Latin Am Trans 15(10):1960–1966CrossRef
27.
go back to reference Scholkopf B, Smola AJ, Williamson RC, Bartlett PL (2000) New support vector algorithms. Neural Comput 12(5):1207–1245CrossRef Scholkopf B, Smola AJ, Williamson RC, Bartlett PL (2000) New support vector algorithms. Neural Comput 12(5):1207–1245CrossRef
28.
go back to reference Shao Y, Chen W, Zhang J, Wang Z, Deng N (2014) An efficient weighted Lagrangian twin support vector machine for imbalanced data classification. Pattern Recognit 47(6):3158–3167MATHCrossRef Shao Y, Chen W, Zhang J, Wang Z, Deng N (2014) An efficient weighted Lagrangian twin support vector machine for imbalanced data classification. Pattern Recognit 47(6):3158–3167MATHCrossRef
29.
go back to reference Sjoberg J, Zhang Q, Ljung L, Berveniste A, Delyon B, Glorennec P, Hjalmarsson H, Juditsky A (1995) Nonlinear black-box modeling in system identification: a unified overview. Automatica 31:1691–1724MathSciNetMATHCrossRef Sjoberg J, Zhang Q, Ljung L, Berveniste A, Delyon B, Glorennec P, Hjalmarsson H, Juditsky A (1995) Nonlinear black-box modeling in system identification: a unified overview. Automatica 31:1691–1724MathSciNetMATHCrossRef
30.
31.
go back to reference Xu Y, Wang L (2014) K-nearest neighbor-based weighted twin support vector regression. Appl Intell 41(1):92–101MathSciNet Xu Y, Wang L (2014) K-nearest neighbor-based weighted twin support vector regression. Appl Intell 41(1):92–101MathSciNet
32.
go back to reference Xu Y, Yu J, Zhang Y (2014) KNN-based weighted rough υ–twin support vector machine. Knowl Based Syst 71:303–313CrossRef Xu Y, Yu J, Zhang Y (2014) KNN-based weighted rough υ–twin support vector machine. Knowl Based Syst 71:303–313CrossRef
33.
go back to reference Ye Q, Zhao C, Gao S, Zhang H (2012) Weighted twin support vector machines with local information and its application. Neural Netw 35:31–39MATHCrossRef Ye Q, Zhao C, Gao S, Zhang H (2012) Weighted twin support vector machines with local information and its application. Neural Netw 35:31–39MATHCrossRef
Metadata
Title
Lagrangian twin parametric insensitive support vector regression (LTPISVR)
Authors
Deepak Gupta
Kamalini Acharjee
Bharat Richhariya
Publication date
07-03-2019
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 10/2020
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04084-1

Other articles of this Issue 10/2020

Neural Computing and Applications 10/2020 Go to the issue

Advances in Parallel and Distributed Computing for Neural Computing

Trust-based security routing mechanism in mobile social networks

Premium Partner