Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 10/2018

24-05-2017 | Original Article

Locality similarity and dissimilarity preserving support vector machine

Authors: Jinxin Zhang, Qiuling Hou, Ling Zhen, Ling Jing

Published in: International Journal of Machine Learning and Cybernetics | Issue 10/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Support vector machines (SVMs) are well-known machine learning algorithms, however they may not effectively detect the intrinsic manifold structure of data and give a lower classification performance when learning from structured data sets. To mitigate the above deficiency, in this article, we propose a novel method termed as Locality similarity and dissimilarity preserving support vector machine (LSDPSVM). Compared to SVMs, LSDPSVM successfully inherits the characteristics of SVMs, moreover, it exploits the intrinsic manifold structure of data from both inter-class and intra-class to improve the classification accuracy. In our LSDPSVM a squared loss function is used to reduce the complexity of the model, and an algorithm based on concave-convex procedure method is used to solve the optimal problem. Experimental results on UCI benchmark datasets and Extend Yaleface datasets demonstrate LSDPSVM has better performance than other similar methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Cortes C, Vapnik VN (1995) Support vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik VN (1995) Support vector networks. Mach Learn 20(3):273–297MATH
2.
go back to reference Deng NY, Tian YJ, Zhang CH (2013) Support vector machines: optimization based theory, algorithms, and extensions. CRC Press, Boca Raton Deng NY, Tian YJ, Zhang CH (2013) Support vector machines: optimization based theory, algorithms, and extensions. CRC Press, Boca Raton
3.
go back to reference Fukunaga F (1990) Statistical pattern recognition. Academic, San DiegoMATH Fukunaga F (1990) Statistical pattern recognition. Academic, San DiegoMATH
4.
go back to reference Zafieriou S, Tefas A, Pitas I (2007) Minimum class variance support vector machines. IEEE Trans Image Process 16(10):2551–2564MathSciNetCrossRef Zafieriou S, Tefas A, Pitas I (2007) Minimum class variance support vector machines. IEEE Trans Image Process 16(10):2551–2564MathSciNetCrossRef
5.
go back to reference Wang XM, Chung FL, Wang ST (2010) On minimum class locality preserving variance support vector machine. Pattern Recognit 43(8):2753–2762 Wang XM, Chung FL, Wang ST (2010) On minimum class locality preserving variance support vector machine. Pattern Recognit 43(8):2753–2762
6.
go back to reference He XF, Niyogi P (2005) 16(1):186–197. Locality preserving projections. Adv Neural InfProcessSyst He XF, Niyogi P (2005) 16(1):186–197. Locality preserving projections. Adv Neural InfProcessSyst
7.
go back to reference He XF, Yan SC, Hu TX, Niyogi P, Zhang HJ (2005) Face recognition using Laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340CrossRef He XF, Yan SC, Hu TX, Niyogi P, Zhang HJ (2005) Face recognition using Laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340CrossRef
8.
go back to reference Kokiopoulou K, Saad Y (2007) Orthogonal neighborhood preserving projections: a projection-based dimensionality reduction technique. IEEE Trans Pattern Anal Mach Intell 29(12):2143–2156CrossRef Kokiopoulou K, Saad Y (2007) Orthogonal neighborhood preserving projections: a projection-based dimensionality reduction technique. IEEE Trans Pattern Anal Mach Intell 29(12):2143–2156CrossRef
9.
go back to reference Zhang HX, Cao LL, Gao S<background-color:#96C864;> (</background-color:#96C864;>2014) A locality correlation preserving support vector machine. Pattern Recognit 47(9):3168–3178 Zhang HX, Cao LL, Gao S<background-color:#96C864;> (</background-color:#96C864;>2014) A locality correlation preserving support vector machine. Pattern Recognit 47(9):3168–3178
10.
go back to reference Tanaka Y, Zhang F, Yang W (2003) Diagnostics in multivariate data analysis: sensitivity analysis for principal components and canonical correlations. Exploratory data analysis in empirical research. Springer, Berlin Tanaka Y, Zhang F, Yang W (2003) Diagnostics in multivariate data analysis: sensitivity analysis for principal components and canonical correlations. Exploratory data analysis in empirical research. Springer, Berlin
11.
go back to reference Tenenhaus A, Philippe C, Frouin V (2015) Kernel generalized canonical correlation analysis. Computational statistics and data. Analysis 90(C):114–131MATH Tenenhaus A, Philippe C, Frouin V (2015) Kernel generalized canonical correlation analysis. Computational statistics and data. Analysis 90(C):114–131MATH
12.
go back to reference Wu F, Wang F, Yang Y, Zhuang Y, Nie F (2010) Classification by semi-supervised discriminative regularization. Neurocomputing 73(10–12):254–263 Wu F, Wang F, Yang Y, Zhuang Y, Nie F (2010) Classification by semi-supervised discriminative regularization. Neurocomputing 73(10–12):254–263
13.
go back to reference Wang F, Zhang C (2008) On discriminative semi-supervised classification. Proceeding of the 23nd AAAI conference on Artificial intelligence, Chicago, pp 720–725 Wang F, Zhang C (2008) On discriminative semi-supervised classification. Proceeding of the 23nd AAAI conference on Artificial intelligence, Chicago, pp 720–725
14.
go back to reference Wang YY, Chen SC, Xue H, Fu ZY (2014) Semi-supervised classification learning by discrimination-aware manifold regularization. Neurocomputing 147(1):299–306 Wang YY, Chen SC, Xue H, Fu ZY (2014) Semi-supervised classification learning by discrimination-aware manifold regularization. Neurocomputing 147(1):299–306
15.
go back to reference Gao QS, Huang YF, Gao XB, Shen WG, Zhang HL (2015) A novel semi-supervised learning for face recognition. Neurocomputing 152(C):69–75 Gao QS, Huang YF, Gao XB, Shen WG, Zhang HL (2015) A novel semi-supervised learning for face recognition. Neurocomputing 152(C):69–75
16.
go back to reference Suykens JAK, Vandewalle J (2007) Least squares support vector machines. Neural Process Lett 9(3):293–300CrossRef Suykens JAK, Vandewalle J (2007) Least squares support vector machines. Neural Process Lett 9(3):293–300CrossRef
17.
go back to reference Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(12):7535–7543CrossRef Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(12):7535–7543CrossRef
18.
go back to reference Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recognit 45(6):2299–2307CrossRefMATH Shao YH, Deng NY, Yang ZM (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recognit 45(6):2299–2307CrossRefMATH
19.
go back to reference Ding SF, Hua XP (2014) Recursive least squares projection twin support vector machines. Neurocomputing 130(3):3–9 Ding SF, Hua XP (2014) Recursive least squares projection twin support vector machines. Neurocomputing 130(3):3–9
20.
go back to reference Hua XP, Ding SF (2015) Weighted least squares projection twin support vector machines with local information. Neurocomputing 160:228–237 Hua XP, Ding SF (2015) Weighted least squares projection twin support vector machines with local information. Neurocomputing 160:228–237
21.
22.
go back to reference Duda RO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New YorkMATH Duda RO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New YorkMATH
23.
go back to reference Diamantaras KI, Kung SY (1996) Principal component neural networks. Wiley, New YorkMATH Diamantaras KI, Kung SY (1996) Principal component neural networks. Wiley, New YorkMATH
24.
go back to reference Scholkopf A, Smola B, Muller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef Scholkopf A, Smola B, Muller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef
Metadata
Title
Locality similarity and dissimilarity preserving support vector machine
Authors
Jinxin Zhang
Qiuling Hou
Ling Zhen
Ling Jing
Publication date
24-05-2017
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 10/2018
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-017-0671-y

Other articles of this Issue 10/2018

International Journal of Machine Learning and Cybernetics 10/2018 Go to the issue