Skip to main content

2016 | OriginalPaper | Buchkapitel

The GEPSVM Classifier Based on L1-Norm Distance Metric

verfasst von : A. He Yan, B. Qiaolin Ye, C. Ying’an Liu, D. Tian’an Zhang

Erschienen in: Pattern Recognition

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The proximal support vector machine via generalized eigenvalues (GEPSVM) is an excellent classifier for binary classification problem. However, the distance of GEPSVM from the point to the plane is measured by L2-norm, which emphasizes the role of outliers by the square operation. To optimize this, we propose a robust and effective GEPSVM classifier based on L1-norm distance metric, referred to as L1-GEPSVM. The optimization goal is to minimize the intra-class distance dispersion and maximize the inter-class distance dispersion simultaneously. It is known that the application of L1-norm distance is often considered as a simple and powerful way to reduce the impact of outliers, which improves the generalization ability and flexibility of the model. In addition, we design an effective iterative algorithm to solve the L1-norm optimal problems, which is easy to actualize and its convergence to a logical local optimum is theoretically ensured. Thus, the classification performance of L1-GEPSVM is more robust. Finally, the feasibility and effectiveness of L1-GEPSVM are proved by extensive experimental results on both UCI datasets and artificial datasets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Vapnik, V.N.: Statistical learning theory. Encycl. Sci. Learn. 41, 3185 (2010) Vapnik, V.N.: Statistical learning theory. Encycl. Sci. Learn. 41, 3185 (2010)
2.
Zurück zum Zitat Burges, C.J.C.: A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Discov. 2, 121–167 (1998)CrossRef Burges, C.J.C.: A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Discov. 2, 121–167 (1998)CrossRef
3.
Zurück zum Zitat Deng, N., Tian, Y., Zhang, C.: Support Vector Machines. Optimization Based Theory, Algorithms, and Extensions. CRC Press, Boca Raton (2012)MATH Deng, N., Tian, Y., Zhang, C.: Support Vector Machines. Optimization Based Theory, Algorithms, and Extensions. CRC Press, Boca Raton (2012)MATH
4.
Zurück zum Zitat Lin, Y.H., Chen, C.H.: Template matching using the parametric template vector with translation, rotation and scale invariance. Pattern Recogn. 41, 2413–2421 (2008)CrossRefMATH Lin, Y.H., Chen, C.H.: Template matching using the parametric template vector with translation, rotation and scale invariance. Pattern Recogn. 41, 2413–2421 (2008)CrossRefMATH
5.
Zurück zum Zitat Mangasarian, O.L., Wild, E.W.: Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans. Pattern Anal. Mach. Intell. 28, 69–74 (2006)CrossRef Mangasarian, O.L., Wild, E.W.: Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans. Pattern Anal. Mach. Intell. 28, 69–74 (2006)CrossRef
6.
Zurück zum Zitat Fung, G.M., Mangasarian, O.L.: Proximal support vector machine classifiers. Mach. Learn. 59, 77–97 (2005)CrossRefMATH Fung, G.M., Mangasarian, O.L.: Proximal support vector machine classifiers. Mach. Learn. 59, 77–97 (2005)CrossRefMATH
7.
Zurück zum Zitat Jayadeva, Khemchandani, R., Chandra, S.: Twin support vector machines for pattern classification. IEEE Trans. Pattern Anal. Mach. Intell. 29, 905–910 (2007)CrossRefMATH Jayadeva, Khemchandani, R., Chandra, S.: Twin support vector machines for pattern classification. IEEE Trans. Pattern Anal. Mach. Intell. 29, 905–910 (2007)CrossRefMATH
8.
Zurück zum Zitat Ye, Q., Ye, N.: International Joint Conference on Computational Sciences and Optimization, CSO 2009, Sanya, Hainan, China, 24–26 April, pp. 705–709 (2009) Ye, Q., Ye, N.: International Joint Conference on Computational Sciences and Optimization, CSO 2009, Sanya, Hainan, China, 24–26 April, pp. 705–709 (2009)
9.
Zurück zum Zitat Guarracino, M.R., Cifarelli, C., Seref, O., Pardalos, P.M.: A classification method based on generalized eigenvalue problems. Optim. Methods Softw. 22, 73–81 (2007)MathSciNetCrossRefMATH Guarracino, M.R., Cifarelli, C., Seref, O., Pardalos, P.M.: A classification method based on generalized eigenvalue problems. Optim. Methods Softw. 22, 73–81 (2007)MathSciNetCrossRefMATH
10.
Zurück zum Zitat Guarracino, M.R., Irpino, A., Verde, R.: International Conference on Complex, Intelligent and Software Intensive Systems, pp. 1183–1185 Guarracino, M.R., Irpino, A., Verde, R.: International Conference on Complex, Intelligent and Software Intensive Systems, pp. 1183–1185
11.
Zurück zum Zitat Shao, Y.H., Deng, N.Y., Chen, W.J., Wang, Z.: Improved generalized eigenvalue proximal support vector machine. IEEE Signal Process. Lett. 20, 213–216 (2013)CrossRef Shao, Y.H., Deng, N.Y., Chen, W.J., Wang, Z.: Improved generalized eigenvalue proximal support vector machine. IEEE Signal Process. Lett. 20, 213–216 (2013)CrossRef
12.
Zurück zum Zitat Marghny, M.H., Elaziz, R.M.A., Taloba, A.I.: Differential search algorithm-based parametric optimization of fuzzy generalized eigenvalue proximal support vector machine. Int. J. Comput. Appl. 108, 38–46 (2015) Marghny, M.H., Elaziz, R.M.A., Taloba, A.I.: Differential search algorithm-based parametric optimization of fuzzy generalized eigenvalue proximal support vector machine. Int. J. Comput. Appl. 108, 38–46 (2015)
13.
Zurück zum Zitat Li, C.N., Shao, Y.H., Deng, N.Y.: Robust L1-norm non-parallel proximal support vector machine. Optimization 65, 1–15 (2015)MathSciNetMATH Li, C.N., Shao, Y.H., Deng, N.Y.: Robust L1-norm non-parallel proximal support vector machine. Optimization 65, 1–15 (2015)MathSciNetMATH
14.
Zurück zum Zitat Kwak, N.: Principal component analysis by Lp-norm maximization. IEEE Trans. Cybern. 44, 594–609 (2014)CrossRef Kwak, N.: Principal component analysis by Lp-norm maximization. IEEE Trans. Cybern. 44, 594–609 (2014)CrossRef
15.
Zurück zum Zitat Kwak, N.: Principal component analysis based on L1-norm maximization. IEEE Trans. Pattern Anal. Mach. Intell. 30, 1672–1680 (2008)CrossRef Kwak, N.: Principal component analysis based on L1-norm maximization. IEEE Trans. Pattern Anal. Mach. Intell. 30, 1672–1680 (2008)CrossRef
16.
Zurück zum Zitat Wang, H., Lu, X., Hu, Z., Zheng, W.: Fisher discriminant analysis with L1-norm. IEEE Trans. Cybern. 44, 828–842 (2014)CrossRef Wang, H., Lu, X., Hu, Z., Zheng, W.: Fisher discriminant analysis with L1-norm. IEEE Trans. Cybern. 44, 828–842 (2014)CrossRef
17.
Zurück zum Zitat Li, C.N., Shao, Y.H., Deng, N.Y.: Robust L1-norm two-dimensional linear discriminant analysis. Neural Netw. Off. J. Int. Neural Netw. Soc. 65C, 92–104 (2015)CrossRef Li, C.N., Shao, Y.H., Deng, N.Y.: Robust L1-norm two-dimensional linear discriminant analysis. Neural Netw. Off. J. Int. Neural Netw. Soc. 65C, 92–104 (2015)CrossRef
18.
Zurück zum Zitat Chen, X., Yang, J., Ye, Q., Liang, J.: Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn. 44, 2643–2655 (2011)CrossRefMATH Chen, X., Yang, J., Ye, Q., Liang, J.: Recursive projection twin support vector machine via within-class variance minimization. Pattern Recogn. 44, 2643–2655 (2011)CrossRefMATH
19.
Zurück zum Zitat Bache, K., Lichman, M.: UCI Machine Learning Repository (2013) Bache, K., Lichman, M.: UCI Machine Learning Repository (2013)
20.
Zurück zum Zitat Yang, X., Chen, S., Chen, B., Pan, Z.: Proximal support vector machine using local information. Neurocomputing 73, 357–365 (2009)CrossRef Yang, X., Chen, S., Chen, B., Pan, Z.: Proximal support vector machine using local information. Neurocomputing 73, 357–365 (2009)CrossRef
21.
Zurück zum Zitat Xue, H., Chen, S.: Glocalization pursuit support vector machine. Neural Comput. Appl. 20, 1043–1053 (2011)CrossRef Xue, H., Chen, S.: Glocalization pursuit support vector machine. Neural Comput. Appl. 20, 1043–1053 (2011)CrossRef
22.
Zurück zum Zitat Ye, Q., Zhao, C., Gao, S., Zheng, H.: Weighted twin support vector machines with local information and its application. Neural Netw. Off. J. Int. Neural Netw. Soc. 35, 31–39 (2012)CrossRefMATH Ye, Q., Zhao, C., Gao, S., Zheng, H.: Weighted twin support vector machines with local information and its application. Neural Netw. Off. J. Int. Neural Netw. Soc. 35, 31–39 (2012)CrossRefMATH
23.
Zurück zum Zitat Ding, S., Hua, X., Yu, J.: An overview on nonparallel hyperplane support vector machine algorithms. Neural Comput. Appl. 25, 975–982 (2013)CrossRef Ding, S., Hua, X., Yu, J.: An overview on nonparallel hyperplane support vector machine algorithms. Neural Comput. Appl. 25, 975–982 (2013)CrossRef
24.
Zurück zum Zitat Lin, G., Tang, N., Wang, H.: Locally principal component analysis based on L1-norm maximisation. IET Image Process. 9, 91–96 (2015)CrossRef Lin, G., Tang, N., Wang, H.: Locally principal component analysis based on L1-norm maximisation. IET Image Process. 9, 91–96 (2015)CrossRef
25.
Zurück zum Zitat Zhong, F., Zhang, J.: Linear discriminant analysis based on L1-norm maximization. IEEE Trans. Image Process. Publ. IEEE Signal Process. Soc. 22, 3018–3027 (2013)MathSciNetCrossRef Zhong, F., Zhang, J.: Linear discriminant analysis based on L1-norm maximization. IEEE Trans. Image Process. Publ. IEEE Signal Process. Soc. 22, 3018–3027 (2013)MathSciNetCrossRef
Metadaten
Titel
The GEPSVM Classifier Based on L1-Norm Distance Metric
verfasst von
A. He Yan
B. Qiaolin Ye
C. Ying’an Liu
D. Tian’an Zhang
Copyright-Jahr
2016
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-3002-4_57

Premium Partner