Skip to main content

2018 | OriginalPaper | Buchkapitel

Sparse Support Vector Machines in Reproducing Kernel Banach Spaces

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present a novel approach for support vector machines in reproducing kernel Banach spaces induced by a finite basis. In particular, we show that the support vector classification in the 1-norm reproducing kernel Banach space is mathematically equivalent to the sparse support vector machine. Finally, we develop fixed-point proximity algorithms for finding the solution of the non-smooth minimization problem that describes the sparse support vector machine. Numerical results are presented to demonstrate that the sparse support vector machine outperforms the classical support vector machine for the binary classification of simulation data.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Alpaydin, E.: Introduction to Machine Learning. MIT, Cambridge, MA (2010)MATH Alpaydin, E.: Introduction to Machine Learning. MIT, Cambridge, MA (2010)MATH
3.
Zurück zum Zitat Bruckstein, A., Donoho, D., Elad, M.: From sparse solutions of systems of equations to sparse modeling of signals and images. SIAM Rev. 51(1), 34–81 (2009)MathSciNetCrossRef Bruckstein, A., Donoho, D., Elad, M.: From sparse solutions of systems of equations to sparse modeling of signals and images. SIAM Rev. 51(1), 34–81 (2009)MathSciNetCrossRef
4.
Zurück zum Zitat Chen, S.S., Donoho, D.L., Saunders, M.A.: Atomic decomposition by basis pursuit. SIAM Rev. 43(1), 129–159 (2001)MathSciNetCrossRef Chen, S.S., Donoho, D.L., Saunders, M.A.: Atomic decomposition by basis pursuit. SIAM Rev. 43(1), 129–159 (2001)MathSciNetCrossRef
5.
Zurück zum Zitat Cucker, F., Smale, S.: On the mathematical foundations of learning. Bull. Am. Math. Soc. (N.S.) 39(1), 1–49 (2002) (electronic)MathSciNetCrossRef Cucker, F., Smale, S.: On the mathematical foundations of learning. Bull. Am. Math. Soc. (N.S.) 39(1), 1–49 (2002) (electronic)MathSciNetCrossRef
6.
Zurück zum Zitat Fasshauer, G., Hickernell, F., Ye, Q.: Solving support vector machines in reproducing kernel Banach spaces with positive definite functions. Appl. Comput. Harmon. Anal. 38, 115–139 (2015)MathSciNetCrossRef Fasshauer, G., Hickernell, F., Ye, Q.: Solving support vector machines in reproducing kernel Banach spaces with positive definite functions. Appl. Comput. Harmon. Anal. 38, 115–139 (2015)MathSciNetCrossRef
7.
Zurück zum Zitat García, A., Portal, A.: Sampling in reproducing kernel Banach spaces. Mediterr. J. Math. 10, 1401–1417 (2013)MathSciNetCrossRef García, A., Portal, A.: Sampling in reproducing kernel Banach spaces. Mediterr. J. Math. 10, 1401–1417 (2013)MathSciNetCrossRef
8.
Zurück zum Zitat Li, Q., Micchelli, C.A., Shen, L., Xu, Y.: A proximity algorithm accelerated by Gauss-Seidel iterations for L1/TV denoising models. Inverse Prob. 28(9), 095003 (2012)MathSciNetCrossRef Li, Q., Micchelli, C.A., Shen, L., Xu, Y.: A proximity algorithm accelerated by Gauss-Seidel iterations for L1/TV denoising models. Inverse Prob. 28(9), 095003 (2012)MathSciNetCrossRef
9.
Zurück zum Zitat Li, Q., Shen, L., Xu, Y., Zhang, N.: Multi-step proximity algorithms for solving a class of convex optimization problems. Adv. Comput. Math. 41(2), 387–422 (2014)CrossRef Li, Q., Shen, L., Xu, Y., Zhang, N.: Multi-step proximity algorithms for solving a class of convex optimization problems. Adv. Comput. Math. 41(2), 387–422 (2014)CrossRef
10.
Zurück zum Zitat Li, Z., Song, G., Xu, Y.: Fixed-point proximity algorithms for solving sparse machine learning models. Int. J. Numer. Anal. Model. 15(1–2), 154–169 (2018)MathSciNet Li, Z., Song, G., Xu, Y.: Fixed-point proximity algorithms for solving sparse machine learning models. Int. J. Numer. Anal. Model. 15(1–2), 154–169 (2018)MathSciNet
11.
Zurück zum Zitat Li, Q., Xu, Y., Zhang, N.: Two-step fixed-point proximity algorithms for multi-block separable convex problems. J. Sci. Comput. 70, 1204–1228 (2017)MathSciNetCrossRef Li, Q., Xu, Y., Zhang, N.: Two-step fixed-point proximity algorithms for multi-block separable convex problems. J. Sci. Comput. 70, 1204–1228 (2017)MathSciNetCrossRef
12.
Zurück zum Zitat Micchelli, C.A., Shen, L., Xu, Y.: Proximity algorithms for image models: denoising. Inverse Prob. 27(4), 045009, 30 (2011)MathSciNetCrossRef Micchelli, C.A., Shen, L., Xu, Y.: Proximity algorithms for image models: denoising. Inverse Prob. 27(4), 045009, 30 (2011)MathSciNetCrossRef
13.
Zurück zum Zitat Micchelli, C.A., Shen, L., Xu, Y., Zeng, X.: Proximity algorithms for the L1/TV image denoising model. Adv. Comput. Math. 38(2), 401–426 (2013)MathSciNetCrossRef Micchelli, C.A., Shen, L., Xu, Y., Zeng, X.: Proximity algorithms for the L1/TV image denoising model. Adv. Comput. Math. 38(2), 401–426 (2013)MathSciNetCrossRef
14.
Zurück zum Zitat Schaback, R., Wendland, H.: Kernel techniques: from machine learning to meshless methods. Acta Numer. 15, 543–639 (2006)MathSciNetCrossRef Schaback, R., Wendland, H.: Kernel techniques: from machine learning to meshless methods. Acta Numer. 15, 543–639 (2006)MathSciNetCrossRef
15.
Zurück zum Zitat Sriperumbudur, B., Fukumizu, K., Lanckriet, G.: Learning in Hilbert vs.Banach spaces: a measure embedding viewpoint. In: Advances in Neural Information Processing Systems, pp. 1773–1781. MIT, Cambridge (2011) Sriperumbudur, B., Fukumizu, K., Lanckriet, G.: Learning in Hilbert vs.Banach spaces: a measure embedding viewpoint. In: Advances in Neural Information Processing Systems, pp. 1773–1781. MIT, Cambridge (2011)
16.
Zurück zum Zitat Steinwart, I.: Sparseness of support vector machines. J. Mach. Learn. Res. 4, 1071–1105 (2003)MathSciNetMATH Steinwart, I.: Sparseness of support vector machines. J. Mach. Learn. Res. 4, 1071–1105 (2003)MathSciNetMATH
17.
Zurück zum Zitat Steinwart, I., Christmann, A.: Support Vector Machines. Springer, New York (2008)MATH Steinwart, I., Christmann, A.: Support Vector Machines. Springer, New York (2008)MATH
18.
Zurück zum Zitat Villmann, T., Haase, S., Kästner, M.: Gradient based learning in vector quantization using differentiable kernels. In: Advances in Self-Organizing Maps, pp. 193–204. Springer, Santiago (2013) Villmann, T., Haase, S., Kästner, M.: Gradient based learning in vector quantization using differentiable kernels. In: Advances in Self-Organizing Maps, pp. 193–204. Springer, Santiago (2013)
19.
Zurück zum Zitat Xu, Y., Ye, Q.: Generalized Mercer kernels and reproducing kernel Banach spaces. Mem. AMS (accepted). arXiv:1412.8663 Xu, Y., Ye, Q.: Generalized Mercer kernels and reproducing kernel Banach spaces. Mem. AMS (accepted). arXiv:1412.8663
20.
Zurück zum Zitat Zhang, H., Xu, Y., Zhang, J.: Reproducing kernel Banach spaces for machine learning. J. Mach. Learn. Res. 10, 2741–2775 (2009)MathSciNetMATH Zhang, H., Xu, Y., Zhang, J.: Reproducing kernel Banach spaces for machine learning. J. Mach. Learn. Res. 10, 2741–2775 (2009)MathSciNetMATH
21.
Zurück zum Zitat Zhu, J., Rosset, S., Hastie, T., Tibshirani, R.: 1-norm support vector machines. In: Thrun, S., Saul, L., Schölkopf, B. (eds.) The Annual Conference on Neural Information Processing Systems 16, pp. 1–8 (2004) Zhu, J., Rosset, S., Hastie, T., Tibshirani, R.: 1-norm support vector machines. In: Thrun, S., Saul, L., Schölkopf, B. (eds.) The Annual Conference on Neural Information Processing Systems 16, pp. 1–8 (2004)
Metadaten
Titel
Sparse Support Vector Machines in Reproducing Kernel Banach Spaces
verfasst von
Zheng Li
Yuesheng Xu
Qi Ye
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-72456-0_38

Premium Partner