Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 1/2011

01-03-2011 | Original Article

Separating theorem of samples in Banach space for support vector machine learning

Authors: Qiang He, Congxin Wu

Published in: International Journal of Machine Learning and Cybernetics | Issue 1/2011

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The theory of machine learning in Banach space is a new research topic and has drawn much attention in recent years. The theoretical foundation of this topic is that under what conditions two sample sets can be separated in Banach space. In this paper, motivated by developing new support vector machine (SVM) in Banach space, we present a necessary and sufficient condition of separating two finite classes of samples by a hyper-plane in Banach space. We also present an attainable expression of maximal margin of the separating hyper-planes which includes some cases of the classes of infinite samples in Banach space.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Bennett K, Bredensteiner E (2000) Duality and geometry in SVM classifiers. In: Proceedings of the 17th international conference on machine learning, San Francisco, USA, pp 57–64 Bennett K, Bredensteiner E (2000) Duality and geometry in SVM classifiers. In: Proceedings of the 17th international conference on machine learning, San Francisco, USA, pp 57–64
2.
go back to reference Bern M, Eppstein D (2001) Optimization over zonotopes and training support vector machines. Lect Notes Comput Sci 2125:111–121MathSciNetCrossRef Bern M, Eppstein D (2001) Optimization over zonotopes and training support vector machines. Lect Notes Comput Sci 2125:111–121MathSciNetCrossRef
3.
go back to reference Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2:121–167CrossRef Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2:121–167CrossRef
4.
go back to reference Ding GG (1999) Introduction to Banach space. Science Press, Beijing Ding GG (1999) Introduction to Banach space. Science Press, Beijing
5.
go back to reference Hein M, Bousquet O, Scholkopf B (2005) Maximal margin classification for metric spaces. J Comput Syst Sci 21:333–359MathSciNetCrossRef Hein M, Bousquet O, Scholkopf B (2005) Maximal margin classification for metric spaces. J Comput Syst Sci 21:333–359MathSciNetCrossRef
6.
go back to reference Der R, Lee D (2007) Large-margin classification in Banach spaces. In: Proceedings of the 11th international conference on artificial intelligence and statistics, San Juan, Puerto Rico, pp 91–98 Der R, Lee D (2007) Large-margin classification in Banach spaces. In: Proceedings of the 11th international conference on artificial intelligence and statistics, San Juan, Puerto Rico, pp 91–98
7.
go back to reference Luxburg U, Bousquet O (2004) Distance-based classification with Lipschitz functions. J Mach Learn Res 5:669–695 Luxburg U, Bousquet O (2004) Distance-based classification with Lipschitz functions. J Mach Learn Res 5:669–695
8.
go back to reference Osuna E, Castro OD (2002) Convex hull in feature space for support vector machines. In: Lecture notes in computer science. Proceedings of the 8th Ibero-American conference on AI, Seville, Spain, pp 411–419 Osuna E, Castro OD (2002) Convex hull in feature space for support vector machines. In: Lecture notes in computer science. Proceedings of the 8th Ibero-American conference on AI, Seville, Spain, pp 411–419
9.
go back to reference Minh HQ, Hofmann T (2004) Learning over compact metric spaces. In: Lecture notes in artificial intelligence, vol 3120, pp 239–254 Minh HQ, Hofmann T (2004) Learning over compact metric spaces. In: Lecture notes in artificial intelligence, vol 3120, pp 239–254
10.
go back to reference Rockafellar RT (1970) Convex analysis. Princeton University Press, PrincetonMATH Rockafellar RT (1970) Convex analysis. Princeton University Press, PrincetonMATH
11.
go back to reference Schaefer HH (1971) Topological vector spaces. Springer, Berlin Schaefer HH (1971) Topological vector spaces. Springer, Berlin
12.
go back to reference Schölkopf B, Smola A (2002) Learning with kernels. The MIT Press, Cambridge Schölkopf B, Smola A (2002) Learning with kernels. The MIT Press, Cambridge
13.
go back to reference Taylor AE, Lay CD (1980) Introduction to functional analysis, 2nd edn. Wiley, New YorkMATH Taylor AE, Lay CD (1980) Introduction to functional analysis, 2nd edn. Wiley, New YorkMATH
14.
go back to reference Vapnik VN (1998) Statistical learning theory. Wiley, New YorkMATH Vapnik VN (1998) Statistical learning theory. Wiley, New YorkMATH
15.
go back to reference Vapnik VN (2000) The nature of statistical learning theory. Springer, New YorkMATH Vapnik VN (2000) The nature of statistical learning theory. Springer, New YorkMATH
16.
go back to reference Vapnik VN (1999) An overview of statistical learning theory. IEEE Trans Neural Netw 10(5):988–999CrossRef Vapnik VN (1999) An overview of statistical learning theory. IEEE Trans Neural Netw 10(5):988–999CrossRef
18.
go back to reference Yosida K (1980) Functional analysis, 6th edn. Springer, BerlinMATH Yosida K (1980) Functional analysis, 6th edn. Springer, BerlinMATH
19.
go back to reference Zadeh LA (1973) Outline of a new approach to the analysis of complex systems and decision processes. IEEE Trans Syst Man Cybern SMC -3:28–44MathSciNetCrossRef Zadeh LA (1973) Outline of a new approach to the analysis of complex systems and decision processes. IEEE Trans Syst Man Cybern SMC -3:28–44MathSciNetCrossRef
20.
go back to reference Zhou D, Xiao B, Zhou H, Dai R (2002) Global geometry of SVM classifiers. In: Technical Report 30 May 2002. Institute of automation, Chinese Academy of Sciences, Beijing Zhou D, Xiao B, Zhou H, Dai R (2002) Global geometry of SVM classifiers. In: Technical Report 30 May 2002. Institute of automation, Chinese Academy of Sciences, Beijing
21.
go back to reference Huang GB, Chen YQ, Babri HA (2000) Classification ability of single hidden layer feed forward neural networks. IEEE Trans Neural Netw 11:799–801CrossRef Huang GB, Chen YQ, Babri HA (2000) Classification ability of single hidden layer feed forward neural networks. IEEE Trans Neural Netw 11:799–801CrossRef
22.
go back to reference Huang GB, Ding X, Zhou H (2010) Optimization method based extreme learning machine for classification. Neurocomputing 74:155–163CrossRef Huang GB, Ding X, Zhou H (2010) Optimization method based extreme learning machine for classification. Neurocomputing 74:155–163CrossRef
Metadata
Title
Separating theorem of samples in Banach space for support vector machine learning
Authors
Qiang He
Congxin Wu
Publication date
01-03-2011
Publisher
Springer-Verlag
Published in
International Journal of Machine Learning and Cybernetics / Issue 1/2011
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-011-0013-4

Other articles of this Issue 1/2011

International Journal of Machine Learning and Cybernetics 1/2011 Go to the issue