Skip to main content
Erschienen in: Soft Computing 11/2010

01.09.2010 | Original Paper

Robust least squares support vector machine based on recursive outlier elimination

verfasst von: Wen Wen, Zhifeng Hao, Xiaowei Yang

Erschienen in: Soft Computing | Ausgabe 11/2010

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

To achieve robust estimation for noisy data set, a recursive outlier elimination-based least squares support vector machine (ROELS-SVM) algorithm is proposed in this paper. In this algorithm, statistical information from the error variables of least squares support vector machine is recursively learned and a criterion derived from robust linear regression is employed for outlier elimination. Besides, decremental learning technique is implemented in the recursive training–eliminating stage, which ensures that the outliers are eliminated with low computational cost. The proposed algorithm is compared with re-weighted least squares support vector machine on multiple data sets and the results demonstrate the remarkably robust performance of the ROELS-SVM.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov 2(2):955–974CrossRef Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov 2(2):955–974CrossRef
Zurück zum Zitat Cao LJ, Tay FEH (2003) Support vector machine with adaptive parameters in financial time series forecasting. IEEE Trans Neural Netw 14(6):1506–1518CrossRef Cao LJ, Tay FEH (2003) Support vector machine with adaptive parameters in financial time series forecasting. IEEE Trans Neural Netw 14(6):1506–1518CrossRef
Zurück zum Zitat Cawley GC, Talbot NLC (2004) Fast exact leave-one-out cross-validation of sparse least-squares support vector machines. Neural Netw 17:1467–1475MATHCrossRef Cawley GC, Talbot NLC (2004) Fast exact leave-one-out cross-validation of sparse least-squares support vector machines. Neural Netw 17:1467–1475MATHCrossRef
Zurück zum Zitat Chuang CC, Su SF, Jeng JT, Hsiao CC (2002) Robust support vector regression networks for function approximation with outliers. IEEE Trans Neural Netw 13(6):1322–1330CrossRef Chuang CC, Su SF, Jeng JT, Hsiao CC (2002) Robust support vector regression networks for function approximation with outliers. IEEE Trans Neural Netw 13(6):1322–1330CrossRef
Zurück zum Zitat Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNet Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNet
Zurück zum Zitat Grubbs FE (1969) Procedures for detecting outlying observations in samples. Technometrics 11(1):1–21CrossRef Grubbs FE (1969) Procedures for detecting outlying observations in samples. Technometrics 11(1):1–21CrossRef
Zurück zum Zitat Jiang JQ, Song CY, Wu CG, Maurizio M, Liang YC (2006) Support vector machine regression algorithm based on chunking incremental learning. In: Proceedings of ICCS’06. Lecture notes in computer science, vol 3991. Springer, Berlin, pp 547–554 Jiang JQ, Song CY, Wu CG, Maurizio M, Liang YC (2006) Support vector machine regression algorithm based on chunking incremental learning. In: Proceedings of ICCS’06. Lecture notes in computer science, vol 3991. Springer, Berlin, pp 547–554
Zurück zum Zitat Kvalseth TO (1985) Cautionary Note about R 2. Am Stat 39(4):279–285CrossRef Kvalseth TO (1985) Cautionary Note about R 2. Am Stat 39(4):279–285CrossRef
Zurück zum Zitat Mangasarian OL, Musicant DR (2000) Robust linear and support vector regression. IEEE Trans Pattern Anal Mach Intell 22(9):950–955CrossRef Mangasarian OL, Musicant DR (2000) Robust linear and support vector regression. IEEE Trans Pattern Anal Mach Intell 22(9):950–955CrossRef
Zurück zum Zitat Rousseeuw PJ, Driessen KV (2006) Computing LTS Regression for large data sets. Data Min Knowl Discov 12:29–45CrossRefMathSciNet Rousseeuw PJ, Driessen KV (2006) Computing LTS Regression for large data sets. Data Min Knowl Discov 12:29–45CrossRefMathSciNet
Zurück zum Zitat Rousseeuw PJ, Leroy A (1987) Robust regression and outlier detection. Wiley, New York, pp 9–11MATHCrossRef Rousseeuw PJ, Leroy A (1987) Robust regression and outlier detection. Wiley, New York, pp 9–11MATHCrossRef
Zurück zum Zitat Scholkopf B, Sung KK, Burges CJC, Girosi F, Niyogi P, Poggio T, Vapnik V (1997) Comparing support vector machines with Gaussian kernels to radial basis function classifiers. IEEE Trans Signal Process 45(11):2758–2765CrossRef Scholkopf B, Sung KK, Burges CJC, Girosi F, Niyogi P, Poggio T, Vapnik V (1997) Comparing support vector machines with Gaussian kernels to radial basis function classifiers. IEEE Trans Signal Process 45(11):2758–2765CrossRef
Zurück zum Zitat Smola AJ, Scholkopf B (1998) A tutorial on support vector regression. NeuroCOLT2 Technical Report NC2-TR-1998-030 Smola AJ, Scholkopf B (1998) A tutorial on support vector regression. NeuroCOLT2 Technical Report NC2-TR-1998-030
Zurück zum Zitat Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9:293–300CrossRefMathSciNet Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9:293–300CrossRefMathSciNet
Zurück zum Zitat Suykens JAK, Brabanter JD, Lukas L, Vandewalle J (2002) Weighted least squares support vector machines: robustness and sparse approximation. Neurocomputing 48:85–105MATHCrossRef Suykens JAK, Brabanter JD, Lukas L, Vandewalle J (2002) Weighted least squares support vector machines: robustness and sparse approximation. Neurocomputing 48:85–105MATHCrossRef
Zurück zum Zitat Tian SF, Huang HK (2002) A simplification algorithm to support vector machines for regression. J Softw 13(6):1169–1172 Tian SF, Huang HK (2002) A simplification algorithm to support vector machines for regression. J Softw 13(6):1169–1172
Zurück zum Zitat Vapnik V (1995) The nature of statistical learning theory. Wiley, New YorkMATH Vapnik V (1995) The nature of statistical learning theory. Wiley, New YorkMATH
Zurück zum Zitat Wen W, Hao ZF, Yang XW (2008) A heuristic weight-setting strategy and iteratively updating algorithm for weighted least-squares support vector regression. Neurocomputing 71(16–18):3096–3103CrossRef Wen W, Hao ZF, Yang XW (2008) A heuristic weight-setting strategy and iteratively updating algorithm for weighted least-squares support vector regression. Neurocomputing 71(16–18):3096–3103CrossRef
Zurück zum Zitat Wu CH (2004) Travel-time prediction with support vector regression. IEEE Trans Intell Transp Syst 5(4):276–281CrossRef Wu CH (2004) Travel-time prediction with support vector regression. IEEE Trans Intell Transp Syst 5(4):276–281CrossRef
Zurück zum Zitat Zhang JS, Gao G (2005) Reweighted robust support vector regression method. Chin J Comput Sci 28(7):1171–1177MathSciNet Zhang JS, Gao G (2005) Reweighted robust support vector regression method. Chin J Comput Sci 28(7):1171–1177MathSciNet
Zurück zum Zitat Zhao Y, Keong KC (2004) Fast Leave-one-out Evaluation and improvement on inference for LS-SVMs. In: Proceedings of ICPR’04, vol 3, pp 494–497 Zhao Y, Keong KC (2004) Fast Leave-one-out Evaluation and improvement on inference for LS-SVMs. In: Proceedings of ICPR’04, vol 3, pp 494–497
Metadaten
Titel
Robust least squares support vector machine based on recursive outlier elimination
verfasst von
Wen Wen
Zhifeng Hao
Xiaowei Yang
Publikationsdatum
01.09.2010
Verlag
Springer-Verlag
Erschienen in
Soft Computing / Ausgabe 11/2010
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-009-0535-9

Weitere Artikel der Ausgabe 11/2010

Soft Computing 11/2010 Zur Ausgabe