Skip to main content
Erschienen in: Neural Processing Letters 2/2018

12.12.2017

A Novel Least Square Twin Support Vector Regression

verfasst von: Zhiqiang Zhang, Tongling Lv, Hui Wang, Liming Liu, Junyan Tan

Erschienen in: Neural Processing Letters | Ausgabe 2/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a new method for regression named lp norm least square twin support vector regression (PLSTSVR), which is formulated by the idea of twin support vector regression (TSVR). Different from TSVR, our new model is an adaptive learning procedure with p-norm SVM (\({{0<p\le 2}}\)), where p is viewed as an adjustable parameter and can be automatically chosen by data. An iterative algorithm is suggested to solve PLSTSVR efficiently. In each iteration, only a series systems of linear equations (LEs) are solved. Experiments carried out on several standard UCI datasets and synthetic datasets show the feasibility and effectiveness of the proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Vapnik V (1995) The nature of statistical learning theory. Springer, New YorkCrossRef Vapnik V (1995) The nature of statistical learning theory. Springer, New YorkCrossRef
2.
Zurück zum Zitat Tian Y, Shi Y, Liu X (2012) Recent advances on support vector machines research. Technol Econ Dev Econ 18(1):5–33CrossRef Tian Y, Shi Y, Liu X (2012) Recent advances on support vector machines research. Technol Econ Dev Econ 18(1):5–33CrossRef
3.
Zurück zum Zitat Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRef Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316CrossRef
4.
Zurück zum Zitat Qi Z, Tian Y, Shi Y (2012) Laplacian twin support vector machine for semisupervised classification. Neural Netw 35:46–53CrossRef Qi Z, Tian Y, Shi Y (2012) Laplacian twin support vector machine for semisupervised classification. Neural Netw 35:46–53CrossRef
5.
Zurück zum Zitat Qi Z, Tian Y, Shi Y (2012) Twin support vector machine with Universum data. Neural Netw 36:112–119CrossRef Qi Z, Tian Y, Shi Y (2012) Twin support vector machine with Universum data. Neural Netw 36:112–119CrossRef
6.
Zurück zum Zitat Deng N, Tian Y, Zhang C (2012) Support vector machines C optimization based theory, algorithms and extensions. CRC Press, Boca RatonCrossRef Deng N, Tian Y, Zhang C (2012) Support vector machines C optimization based theory, algorithms and extensions. CRC Press, Boca RatonCrossRef
7.
Zurück zum Zitat Jayadeva, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRef Jayadeva, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRef
8.
Zurück zum Zitat Mangasarian O, Wild E (2006) Multisurface proximal support vector classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef Mangasarian O, Wild E (2006) Multisurface proximal support vector classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74CrossRef
9.
Zurück zum Zitat Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recogn Lett 29(13):1842–1848CrossRef Kumar MA, Gopal M (2008) Application of smoothing technique on twin support vector machines. Pattern Recogn Lett 29(13):1842–1848CrossRef
10.
Zurück zum Zitat Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543CrossRef
11.
Zurück zum Zitat Khemchandani R, Jayadeva, Chandra S (2009) Optimal kernel selection in twin support vector machines. Optim Lett 3(1):77–88MathSciNetCrossRef Khemchandani R, Jayadeva, Chandra S (2009) Optimal kernel selection in twin support vector machines. Optim Lett 3(1):77–88MathSciNetCrossRef
12.
Zurück zum Zitat Ghorai S, Mukherjee A, Dutta PK (2009) Nonparallel plane proximal classifier. Signal Process 89(4):510–522CrossRef Ghorai S, Mukherjee A, Dutta PK (2009) Nonparallel plane proximal classifier. Signal Process 89(4):510–522CrossRef
13.
Zurück zum Zitat Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968CrossRef
14.
Zurück zum Zitat Shao YH, Wang Z, Chen WJ, Deng NY (2013) Least squares twin parametric-margin support vector machines for classification. Appl Intell 39(3):451–464CrossRef Shao YH, Wang Z, Chen WJ, Deng NY (2013) Least squares twin parametric-margin support vector machines for classification. Appl Intell 39(3):451–464CrossRef
15.
Zurück zum Zitat Chen W-J, Shao YH, Xu DK, Fu YF (2014) Manifold proximal support vector machine for semi-supervised classification. Appl Intell 40(4):623–638CrossRef Chen W-J, Shao YH, Xu DK, Fu YF (2014) Manifold proximal support vector machine for semi-supervised classification. Appl Intell 40(4):623–638CrossRef
16.
Zurück zum Zitat Xu YT, Guo R (2014) An improved _\(\varepsilon \)-twin support vector machine. Appl Intell 41:42–54CrossRef Xu YT, Guo R (2014) An improved _\(\varepsilon \)-twin support vector machine. Appl Intell 41:42–54CrossRef
17.
Zurück zum Zitat Xu YT, Wang LS (2014) K-nearest neighbor-based weighted twin support vector regression. Appl Intell 41:299–309CrossRef Xu YT, Wang LS (2014) K-nearest neighbor-based weighted twin support vector regression. Appl Intell 41:299–309CrossRef
18.
Zurück zum Zitat Zhang ZQ, Zhen L, Deng NY, Tan JY (2014) Sparse least square twin support vector machine with adaptive norm. Appl Intell 41:1097–1107CrossRef Zhang ZQ, Zhen L, Deng NY, Tan JY (2014) Sparse least square twin support vector machine with adaptive norm. Appl Intell 41:1097–1107CrossRef
19.
Zurück zum Zitat Peng XTSVR (2010) an efficient twin support vector machine for regression. Neural Netw 23(3):365–372CrossRef Peng XTSVR (2010) an efficient twin support vector machine for regression. Neural Netw 23(3):365–372CrossRef
20.
Zurück zum Zitat Lu ZX, Yang ZX, Gao XY (2014) Least square twin support vector regression. Comput Eng Appl 50(23):140–144 Lu ZX, Yang ZX, Gao XY (2014) Least square twin support vector regression. Comput Eng Appl 50(23):140–144
21.
Zurück zum Zitat Chen WJ, Tian YJ (2010) Lp-norm proximal support vector machine and its applications. Proced Comput Sci ICCS 1(1):2417–2423CrossRef Chen WJ, Tian YJ (2010) Lp-norm proximal support vector machine and its applications. Proced Comput Sci ICCS 1(1):2417–2423CrossRef
22.
Zurück zum Zitat Tian YJ , Yu J, Chen WJ (2010) Lp-norm support vector machine with CCCP. In: Proceedings of the 7th FSKD, pp 1560–1564 Tian YJ , Yu J, Chen WJ (2010) Lp-norm support vector machine with CCCP. In: Proceedings of the 7th FSKD, pp 1560–1564
23.
Zurück zum Zitat Tan JY, Zhang CH, Deng NY (2010) Cancer related gene identification via \(p\)-norm support vector machine. In: The 4th international conference on computational systems biology, pp. 101-108 Tan JY, Zhang CH, Deng NY (2010) Cancer related gene identification via \(p\)-norm support vector machine. In: The 4th international conference on computational systems biology, pp. 101-108
24.
Zurück zum Zitat Tan J-Y, Zhang Z-Q, Zhen L, Zhang C-H, Deng N (2013) Adaptive feature selection via a new version of support vector machine. Neural Comput Appl 23:937–945CrossRef Tan J-Y, Zhang Z-Q, Zhen L, Zhang C-H, Deng N (2013) Adaptive feature selection via a new version of support vector machine. Neural Comput Appl 23:937–945CrossRef
25.
Zurück zum Zitat Zhang C-H, Shao Y-H, Tan J-Y, Deng N-Y (2013) A mixed-norm linear support vector machine. Neural Comput Appl 23:2159–2166CrossRef Zhang C-H, Shao Y-H, Tan J-Y, Deng N-Y (2013) A mixed-norm linear support vector machine. Neural Comput Appl 23:2159–2166CrossRef
26.
Zurück zum Zitat Saad Y (2003) Iterative methods for sparse linear systems. SIAM Press, PhiladelphiaCrossRef Saad Y (2003) Iterative methods for sparse linear systems. SIAM Press, PhiladelphiaCrossRef
Metadaten
Titel
A Novel Least Square Twin Support Vector Regression
verfasst von
Zhiqiang Zhang
Tongling Lv
Hui Wang
Liming Liu
Junyan Tan
Publikationsdatum
12.12.2017
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2018
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-017-9773-5

Weitere Artikel der Ausgabe 2/2018

Neural Processing Letters 2/2018 Zur Ausgabe

Neuer Inhalt