Skip to main content
Top
Published in: Soft Computing 14/2018

25-05-2017 | Methodologies and Application

A fast partition-based batch-mode active learning technique using SVM classifier

Authors: Anshu Singla, Swarnajyoti Patra

Published in: Soft Computing | Issue 14/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The selection of informative samples known as query selection is the most challenging task in active learning. In this article, a batch-mode active learning technique is presented by defining a novel query function. The proposed technique first divides the unlabeled samples into uniform partitions in one-dimensional feature space according to their distribution in the original feature space. Then to select the most informative samples from the unlabeled pool, one sample from each partition is selected based on an uncertainty criterion defined by exploiting SVM classifier. The number of unlabeled samples selected at each iteration of active learning is determined automatically and depends on the number of non-empty partitions generated. The effectiveness of the proposed technique is measured by comparing it with four state-of-the-art techniques exist in the literature by using four different UCI repository data sets. The experimental analysis proved that the proposed technique is robust and computationally less demanding.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Brezhneva O, Tret’yakov AA (2011) An elementary proof of the Karush–Kuhn–Tucker theorem in normed linear spaces for problems with a finite number of inequality constraints. Optimization 60(5):613–618MathSciNetCrossRefMATH Brezhneva O, Tret’yakov AA (2011) An elementary proof of the Karush–Kuhn–Tucker theorem in normed linear spaces for problems with a finite number of inequality constraints. Optimization 60(5):613–618MathSciNetCrossRefMATH
go back to reference Brinker K (2003) Incorporating diversity in active learning with support vector machines. ICML 3:59–66 Brinker K (2003) Incorporating diversity in active learning with support vector machines. ICML 3:59–66
go back to reference Burges CJ (1998) A tutorial on support vector machines for pattern recognition. Data Mining Knowl Discov 2(2):121–167CrossRef Burges CJ (1998) A tutorial on support vector machines for pattern recognition. Data Mining Knowl Discov 2(2):121–167CrossRef
go back to reference Campbell C, Cristianini N, Smola A, et al (2000) Query learning with large margin classifiers. In: ICML, pp 111–118 Campbell C, Cristianini N, Smola A, et al (2000) Query learning with large margin classifiers. In: ICML, pp 111–118
go back to reference Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):27CrossRef Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):27CrossRef
go back to reference Cheng S, Shih FY (2007) An improved incremental training algorithm for support vector machines using active query. Pattern Recogn 40(3):964–971CrossRefMATH Cheng S, Shih FY (2007) An improved incremental training algorithm for support vector machines using active query. Pattern Recogn 40(3):964–971CrossRefMATH
go back to reference Cohn DA, Ghahramani Z, Jordan MI (1996) Active learning with statistical models. J Artif Intell Res 4(1):129–145MATH Cohn DA, Ghahramani Z, Jordan MI (1996) Active learning with statistical models. J Artif Intell Res 4(1):129–145MATH
go back to reference Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH
go back to reference Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines. Cambridge University Press, CambridgeMATH Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines. Cambridge University Press, CambridgeMATH
go back to reference Demir B, Persello C, Bruzzone L (2011) Batch-mode active-learning methods for the interactive classification of remote sensing images. IEEE Tran Geosci Remote Sens 49(3):1014–1031CrossRef Demir B, Persello C, Bruzzone L (2011) Batch-mode active-learning methods for the interactive classification of remote sensing images. IEEE Tran Geosci Remote Sens 49(3):1014–1031CrossRef
go back to reference Freund Y, Seung HS, Shamir E, Tishby N (1997) Selective sampling using the query by committee algorithm. Mach Learn 28(2–3):133–168CrossRefMATH Freund Y, Seung HS, Shamir E, Tishby N (1997) Selective sampling using the query by committee algorithm. Mach Learn 28(2–3):133–168CrossRefMATH
go back to reference Fukumizu K (2000) Statistical active learning in multilayer perceptrons. IEEE Trans Neural Netw 11(1):17–26CrossRef Fukumizu K (2000) Statistical active learning in multilayer perceptrons. IEEE Trans Neural Netw 11(1):17–26CrossRef
go back to reference Huo LZ, Tang P (2014) A batch-mode active learning algorithm using region-partitioning diversity for SVM classifier. IEEE J Sel Top Appl Earth Obs Remote Sensing 7(4):1036–1046CrossRef Huo LZ, Tang P (2014) A batch-mode active learning algorithm using region-partitioning diversity for SVM classifier. IEEE J Sel Top Appl Earth Obs Remote Sensing 7(4):1036–1046CrossRef
go back to reference Jiawei H, Kamber M (2001) Data mining: concepts and techniques. Morgan Kaufmann Ltd, San Francisco, p 5MATH Jiawei H, Kamber M (2001) Data mining: concepts and techniques. Morgan Kaufmann Ltd, San Francisco, p 5MATH
go back to reference Li M, Sethi IK (2006) Confidence-based active learning. IEEE Trans Pattern Anal Mach Intell 28(8):1251–1261CrossRef Li M, Sethi IK (2006) Confidence-based active learning. IEEE Trans Pattern Anal Mach Intell 28(8):1251–1261CrossRef
go back to reference Mamitsuka NAH (1998) Query learning strategies using boosting and bagging. In: Proceedings of the fifteenth international conference on machine learning (ICML’98), vol 1, Morgan Kaufmann Pub., San Francisco Mamitsuka NAH (1998) Query learning strategies using boosting and bagging. In: Proceedings of the fifteenth international conference on machine learning (ICML’98), vol 1, Morgan Kaufmann Pub., San Francisco
go back to reference Mitra P, Shankar BU, Pal SK (2004) Segmentation of multispectral remote sensing images using active support vector machines. Pattern Recogn Lett 25(9):1067–1074CrossRef Mitra P, Shankar BU, Pal SK (2004) Segmentation of multispectral remote sensing images using active support vector machines. Pattern Recogn Lett 25(9):1067–1074CrossRef
go back to reference Patra S, Bruzzone L (2011) A fast cluster-assumption based active-learning technique for classification of remote sensing images. IEEE Trans Geosci Remote Sens 49(5):1617–1626CrossRef Patra S, Bruzzone L (2011) A fast cluster-assumption based active-learning technique for classification of remote sensing images. IEEE Trans Geosci Remote Sens 49(5):1617–1626CrossRef
go back to reference Patra S, Bruzzone L (2012) A cluster-assumption based batch mode active learning technique. Pattern Recogn Lett 33(9):1042–1048CrossRef Patra S, Bruzzone L (2012) A cluster-assumption based batch mode active learning technique. Pattern Recogn Lett 33(9):1042–1048CrossRef
go back to reference Patra S, Bruzzone L (2014) A novel SOM-SVM based active learning technique for remote sensing image classification. IEEE Trans Geosci Remote Sens 52(11):6899–6910CrossRef Patra S, Bruzzone L (2014) A novel SOM-SVM based active learning technique for remote sensing image classification. IEEE Trans Geosci Remote Sens 52(11):6899–6910CrossRef
go back to reference Rajan S, Ghosh J, Crawford MM (2008) An active learning approach to hyperspectral data classification. IEEE Trans Geosci Remote Sens 46(4):1231–1242CrossRef Rajan S, Ghosh J, Crawford MM (2008) An active learning approach to hyperspectral data classification. IEEE Trans Geosci Remote Sens 46(4):1231–1242CrossRef
go back to reference Ren J (2012) ANN vs. SVM: which one performs better in classification of MCCS in mammogram imaging. Knowl Based Syst 26:144–153CrossRef Ren J (2012) ANN vs. SVM: which one performs better in classification of MCCS in mammogram imaging. Knowl Based Syst 26:144–153CrossRef
go back to reference Schohn G, Cohn D (2000) Less is more: active learning with support vector machines. In: ICML, Citeseer, pp 839–846 Schohn G, Cohn D (2000) Less is more: active learning with support vector machines. In: ICML, Citeseer, pp 839–846
go back to reference Seung HS, Opper M, Sompolinsky H (1992) Query by committee. In: Proceedings of the fifth annual workshop on computational learning theory ACM, New York, pp 287–294 Seung HS, Opper M, Sompolinsky H (1992) Query by committee. In: Proceedings of the fifth annual workshop on computational learning theory ACM, New York, pp 287–294
go back to reference Shigeo A (2005) Support vector machines for pattern classification. Advances in pattern recognition. Springer, Heidelberg Shigeo A (2005) Support vector machines for pattern classification. Advances in pattern recognition. Springer, Heidelberg
go back to reference Tong S, Koller D (2001) Support vector machine active learning with applications to text classification. J Mach Learn Res 2:45–66MATH Tong S, Koller D (2001) Support vector machine active learning with applications to text classification. J Mach Learn Res 2:45–66MATH
go back to reference Tuia D, Ratle F, Pacifici F, Kanevski MF, Emery WJ (2009) Active learning methods for remote sensing image classification. IEEE Trans Geosci Remote Sens 47(7):2218–2232CrossRef Tuia D, Ratle F, Pacifici F, Kanevski MF, Emery WJ (2009) Active learning methods for remote sensing image classification. IEEE Trans Geosci Remote Sens 47(7):2218–2232CrossRef
go back to reference Vapnik V (2001) The nature of statistical learning theory, 2nd edn. Springer, New YorkMATH Vapnik V (2001) The nature of statistical learning theory, 2nd edn. Springer, New YorkMATH
Metadata
Title
A fast partition-based batch-mode active learning technique using SVM classifier
Authors
Anshu Singla
Swarnajyoti Patra
Publication date
25-05-2017
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 14/2018
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-017-2645-0

Other articles of this Issue 14/2018

Soft Computing 14/2018 Go to the issue

Premium Partner