Skip to main content
Top

2017 | OriginalPaper | Chapter

Online Support Vector Machine Based on Minimum Euclidean Distance

Authors : Kalpana Dahiya, Vinod Kumar Chauhan, Anuj Sharma

Published in: Proceedings of International Conference on Computer Vision and Image Processing

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The present study includes development of an online support vector machine (SVM) based on minimum euclidean distance (MED). We have proposed a MED support vector algorithm where SVM model is initialized with small amount of training data and test data is merged to SVM model for incorrect predictions only. This method provides a simpler and more computationally efficient implementation as it assign previously computed support vector coefficients. To merge test data in SVM model, we find the euclidean distance between test data and support vector of target class and the coefficients of MED of support vector of training class are assigned to test data. The proposed technique has been implemented on benchmark data set mnist where SVM model initialized with 20 K images and tested for 40 K data images. The proposed technique of online SVM results in overall error rate as 1.69 % and without using online SVM results in error rate as 7.70 %. The overall performance of the developed system is stable in nature and produce smaller error rate.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference A. Bordes, L. Bottou, and J. Gallinari. Solving multiclass support vector machines with larank. International Conference on Machine Learning, 227:89–96, 2007. A. Bordes, L. Bottou, and J. Gallinari. Solving multiclass support vector machines with larank. International Conference on Machine Learning, 227:89–96, 2007.
2.
go back to reference A. Bordes, S. Ertekin, J. Weston, and L. Bottou. Fast kernel classifiers with online and active learning. Journal of Machine Learning and Research, 6:1579–1619, 2005. A. Bordes, S. Ertekin, J. Weston, and L. Bottou. Fast kernel classifiers with online and active learning. Journal of Machine Learning and Research, 6:1579–1619, 2005.
3.
go back to reference C.J.C. Burges. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2:121–167, 1998. C.J.C. Burges. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2:121–167, 1998.
4.
go back to reference C. Chang, C, W. Hsu, C, and J. Lin, C. The analysis of decomposition methods for support vector machines. IEEE Transactions on Neural Networks, 11(4):1003–1008, 2000. C. Chang, C, W. Hsu, C, and J. Lin, C. The analysis of decomposition methods for support vector machines. IEEE Transactions on Neural Networks, 11(4):1003–1008, 2000.
5.
go back to reference S. Cheng and F. Shih. An improved incremental training algorithm for support vector machines using active query. Pattern Recognition, 40(3):964–971, 2007. S. Cheng and F. Shih. An improved incremental training algorithm for support vector machines using active query. Pattern Recognition, 40(3):964–971, 2007.
6.
go back to reference C. Cortes and V. Vapnik. Support-vector networks. Machine Learning, 20:273–297, 1995. C. Cortes and V. Vapnik. Support-vector networks. Machine Learning, 20:273–297, 1995.
7.
go back to reference R.E. Fan, P.H. Chen, and C.J. Lin. Working set selection using second order information for training support vector machines. Journal of Machine learning Research, 6:1889–1918, 2005. R.E. Fan, P.H. Chen, and C.J. Lin. Working set selection using second order information for training support vector machines. Journal of Machine learning Research, 6:1889–1918, 2005.
8.
go back to reference W. Lau, K and H. Wu, Q. Online training of support vector classifier. Pattern Recognition, 36(8):1913–1920, 2003. W. Lau, K and H. Wu, Q. Online training of support vector classifier. Pattern Recognition, 36(8):1913–1920, 2003.
9.
go back to reference Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, pages 2278–2324, 1998. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, pages 2278–2324, 1998.
10.
go back to reference J. Lin, C. A formal analysis of stopping criteria of decomposition methods for support vector machines. IEEE Transactions on Neural Networks, 13(5):1045–1052, 2002. J. Lin, C. A formal analysis of stopping criteria of decomposition methods for support vector machines. IEEE Transactions on Neural Networks, 13(5):1045–1052, 2002.
11.
go back to reference F. Orabona, C. Castellini, B. Caputo, L. Jie, and G. Sandini. On-line independent support vector machines. Pattern Recognition, 43:1402–1412, 2010. F. Orabona, C. Castellini, B. Caputo, L. Jie, and G. Sandini. On-line independent support vector machines. Pattern Recognition, 43:1402–1412, 2010.
12.
go back to reference J. Platt. Sequential minimal optimization: A fast algorithm for training support vector machines. Microsoft Research, pages MSR–TR–98–14, 1998. J. Platt. Sequential minimal optimization: A fast algorithm for training support vector machines. Microsoft Research, pages MSR–TR–98–14, 1998.
13.
go back to reference A. Shilton, M. Palaniswami, and T. A. Incremental training of support vector machines. IEEE Transactions on Neural Networks, 16(1):114–131, 2005. A. Shilton, M. Palaniswami, and T. A. Incremental training of support vector machines. IEEE Transactions on Neural Networks, 16(1):114–131, 2005.
14.
go back to reference R. Singh, M. Vatsa, A. Ross, and A. Noore. Biometric classifier update using online learning: A case study in near infrared face verification. Image and Vision Computing, 28:1098–1105, 2010. R. Singh, M. Vatsa, A. Ross, and A. Noore. Biometric classifier update using online learning: A case study in near infrared face verification. Image and Vision Computing, 28:1098–1105, 2010.
15.
go back to reference V. Vapnik. The overview of statistical learning theory. IEEE Transactions on Neural Networks, 10(5):988–999, 1999. V. Vapnik. The overview of statistical learning theory. IEEE Transactions on Neural Networks, 10(5):988–999, 1999.
16.
go back to reference D. Wand, H. Qiao, and B. Zhang. Online support vector machine based on convex hull vertices selection. IEEE Transactions on Neural Networks and Learning Systems, 24(4):593–609, 2013. D. Wand, H. Qiao, and B. Zhang. Online support vector machine based on convex hull vertices selection. IEEE Transactions on Neural Networks and Learning Systems, 24(4):593–609, 2013.
17.
go back to reference D. Wang, B. Zhang, P. Zhang, and H. Qiao. An online core vector machine with adaptive meb adjustment. Pattern Recognition, 43:3468–3482, 2010. D. Wang, B. Zhang, P. Zhang, and H. Qiao. An online core vector machine with adaptive meb adjustment. Pattern Recognition, 43:3468–3482, 2010.
18.
go back to reference M. Wang, X. Zhou, F. Li, J. Huckins, R. W. King, and S. T. Wong. Novel cell segmentation and online svm for cell cycle phase identification in automated microscopy. Bioinformatics, 24(1):94–101, 2008. M. Wang, X. Zhou, F. Li, J. Huckins, R. W. King, and S. T. Wong. Novel cell segmentation and online svm for cell cycle phase identification in automated microscopy. Bioinformatics, 24(1):94–101, 2008.
Metadata
Title
Online Support Vector Machine Based on Minimum Euclidean Distance
Authors
Kalpana Dahiya
Vinod Kumar Chauhan
Anuj Sharma
Copyright Year
2017
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-2104-6_9