Skip to main content
Erschienen in: Soft Computing 14/2018

25.05.2017 | Methodologies and Application

A fast partition-based batch-mode active learning technique using SVM classifier

verfasst von: Anshu Singla, Swarnajyoti Patra

Erschienen in: Soft Computing | Ausgabe 14/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The selection of informative samples known as query selection is the most challenging task in active learning. In this article, a batch-mode active learning technique is presented by defining a novel query function. The proposed technique first divides the unlabeled samples into uniform partitions in one-dimensional feature space according to their distribution in the original feature space. Then to select the most informative samples from the unlabeled pool, one sample from each partition is selected based on an uncertainty criterion defined by exploiting SVM classifier. The number of unlabeled samples selected at each iteration of active learning is determined automatically and depends on the number of non-empty partitions generated. The effectiveness of the proposed technique is measured by comparing it with four state-of-the-art techniques exist in the literature by using four different UCI repository data sets. The experimental analysis proved that the proposed technique is robust and computationally less demanding.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Brezhneva O, Tret’yakov AA (2011) An elementary proof of the Karush–Kuhn–Tucker theorem in normed linear spaces for problems with a finite number of inequality constraints. Optimization 60(5):613–618MathSciNetCrossRefMATH Brezhneva O, Tret’yakov AA (2011) An elementary proof of the Karush–Kuhn–Tucker theorem in normed linear spaces for problems with a finite number of inequality constraints. Optimization 60(5):613–618MathSciNetCrossRefMATH
Zurück zum Zitat Brinker K (2003) Incorporating diversity in active learning with support vector machines. ICML 3:59–66 Brinker K (2003) Incorporating diversity in active learning with support vector machines. ICML 3:59–66
Zurück zum Zitat Burges CJ (1998) A tutorial on support vector machines for pattern recognition. Data Mining Knowl Discov 2(2):121–167CrossRef Burges CJ (1998) A tutorial on support vector machines for pattern recognition. Data Mining Knowl Discov 2(2):121–167CrossRef
Zurück zum Zitat Campbell C, Cristianini N, Smola A, et al (2000) Query learning with large margin classifiers. In: ICML, pp 111–118 Campbell C, Cristianini N, Smola A, et al (2000) Query learning with large margin classifiers. In: ICML, pp 111–118
Zurück zum Zitat Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):27CrossRef Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):27CrossRef
Zurück zum Zitat Cheng S, Shih FY (2007) An improved incremental training algorithm for support vector machines using active query. Pattern Recogn 40(3):964–971CrossRefMATH Cheng S, Shih FY (2007) An improved incremental training algorithm for support vector machines using active query. Pattern Recogn 40(3):964–971CrossRefMATH
Zurück zum Zitat Cohn DA, Ghahramani Z, Jordan MI (1996) Active learning with statistical models. J Artif Intell Res 4(1):129–145MATH Cohn DA, Ghahramani Z, Jordan MI (1996) Active learning with statistical models. J Artif Intell Res 4(1):129–145MATH
Zurück zum Zitat Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH
Zurück zum Zitat Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines. Cambridge University Press, CambridgeMATH Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines. Cambridge University Press, CambridgeMATH
Zurück zum Zitat Demir B, Persello C, Bruzzone L (2011) Batch-mode active-learning methods for the interactive classification of remote sensing images. IEEE Tran Geosci Remote Sens 49(3):1014–1031CrossRef Demir B, Persello C, Bruzzone L (2011) Batch-mode active-learning methods for the interactive classification of remote sensing images. IEEE Tran Geosci Remote Sens 49(3):1014–1031CrossRef
Zurück zum Zitat Freund Y, Seung HS, Shamir E, Tishby N (1997) Selective sampling using the query by committee algorithm. Mach Learn 28(2–3):133–168CrossRefMATH Freund Y, Seung HS, Shamir E, Tishby N (1997) Selective sampling using the query by committee algorithm. Mach Learn 28(2–3):133–168CrossRefMATH
Zurück zum Zitat Fukumizu K (2000) Statistical active learning in multilayer perceptrons. IEEE Trans Neural Netw 11(1):17–26CrossRef Fukumizu K (2000) Statistical active learning in multilayer perceptrons. IEEE Trans Neural Netw 11(1):17–26CrossRef
Zurück zum Zitat Huo LZ, Tang P (2014) A batch-mode active learning algorithm using region-partitioning diversity for SVM classifier. IEEE J Sel Top Appl Earth Obs Remote Sensing 7(4):1036–1046CrossRef Huo LZ, Tang P (2014) A batch-mode active learning algorithm using region-partitioning diversity for SVM classifier. IEEE J Sel Top Appl Earth Obs Remote Sensing 7(4):1036–1046CrossRef
Zurück zum Zitat Jiawei H, Kamber M (2001) Data mining: concepts and techniques. Morgan Kaufmann Ltd, San Francisco, p 5MATH Jiawei H, Kamber M (2001) Data mining: concepts and techniques. Morgan Kaufmann Ltd, San Francisco, p 5MATH
Zurück zum Zitat Li M, Sethi IK (2006) Confidence-based active learning. IEEE Trans Pattern Anal Mach Intell 28(8):1251–1261CrossRef Li M, Sethi IK (2006) Confidence-based active learning. IEEE Trans Pattern Anal Mach Intell 28(8):1251–1261CrossRef
Zurück zum Zitat Mamitsuka NAH (1998) Query learning strategies using boosting and bagging. In: Proceedings of the fifteenth international conference on machine learning (ICML’98), vol 1, Morgan Kaufmann Pub., San Francisco Mamitsuka NAH (1998) Query learning strategies using boosting and bagging. In: Proceedings of the fifteenth international conference on machine learning (ICML’98), vol 1, Morgan Kaufmann Pub., San Francisco
Zurück zum Zitat Mitra P, Shankar BU, Pal SK (2004) Segmentation of multispectral remote sensing images using active support vector machines. Pattern Recogn Lett 25(9):1067–1074CrossRef Mitra P, Shankar BU, Pal SK (2004) Segmentation of multispectral remote sensing images using active support vector machines. Pattern Recogn Lett 25(9):1067–1074CrossRef
Zurück zum Zitat Patra S, Bruzzone L (2011) A fast cluster-assumption based active-learning technique for classification of remote sensing images. IEEE Trans Geosci Remote Sens 49(5):1617–1626CrossRef Patra S, Bruzzone L (2011) A fast cluster-assumption based active-learning technique for classification of remote sensing images. IEEE Trans Geosci Remote Sens 49(5):1617–1626CrossRef
Zurück zum Zitat Patra S, Bruzzone L (2012) A cluster-assumption based batch mode active learning technique. Pattern Recogn Lett 33(9):1042–1048CrossRef Patra S, Bruzzone L (2012) A cluster-assumption based batch mode active learning technique. Pattern Recogn Lett 33(9):1042–1048CrossRef
Zurück zum Zitat Patra S, Bruzzone L (2014) A novel SOM-SVM based active learning technique for remote sensing image classification. IEEE Trans Geosci Remote Sens 52(11):6899–6910CrossRef Patra S, Bruzzone L (2014) A novel SOM-SVM based active learning technique for remote sensing image classification. IEEE Trans Geosci Remote Sens 52(11):6899–6910CrossRef
Zurück zum Zitat Rajan S, Ghosh J, Crawford MM (2008) An active learning approach to hyperspectral data classification. IEEE Trans Geosci Remote Sens 46(4):1231–1242CrossRef Rajan S, Ghosh J, Crawford MM (2008) An active learning approach to hyperspectral data classification. IEEE Trans Geosci Remote Sens 46(4):1231–1242CrossRef
Zurück zum Zitat Ren J (2012) ANN vs. SVM: which one performs better in classification of MCCS in mammogram imaging. Knowl Based Syst 26:144–153CrossRef Ren J (2012) ANN vs. SVM: which one performs better in classification of MCCS in mammogram imaging. Knowl Based Syst 26:144–153CrossRef
Zurück zum Zitat Schohn G, Cohn D (2000) Less is more: active learning with support vector machines. In: ICML, Citeseer, pp 839–846 Schohn G, Cohn D (2000) Less is more: active learning with support vector machines. In: ICML, Citeseer, pp 839–846
Zurück zum Zitat Seung HS, Opper M, Sompolinsky H (1992) Query by committee. In: Proceedings of the fifth annual workshop on computational learning theory ACM, New York, pp 287–294 Seung HS, Opper M, Sompolinsky H (1992) Query by committee. In: Proceedings of the fifth annual workshop on computational learning theory ACM, New York, pp 287–294
Zurück zum Zitat Shigeo A (2005) Support vector machines for pattern classification. Advances in pattern recognition. Springer, Heidelberg Shigeo A (2005) Support vector machines for pattern classification. Advances in pattern recognition. Springer, Heidelberg
Zurück zum Zitat Tong S, Koller D (2001) Support vector machine active learning with applications to text classification. J Mach Learn Res 2:45–66MATH Tong S, Koller D (2001) Support vector machine active learning with applications to text classification. J Mach Learn Res 2:45–66MATH
Zurück zum Zitat Tuia D, Ratle F, Pacifici F, Kanevski MF, Emery WJ (2009) Active learning methods for remote sensing image classification. IEEE Trans Geosci Remote Sens 47(7):2218–2232CrossRef Tuia D, Ratle F, Pacifici F, Kanevski MF, Emery WJ (2009) Active learning methods for remote sensing image classification. IEEE Trans Geosci Remote Sens 47(7):2218–2232CrossRef
Zurück zum Zitat Vapnik V (2001) The nature of statistical learning theory, 2nd edn. Springer, New YorkMATH Vapnik V (2001) The nature of statistical learning theory, 2nd edn. Springer, New YorkMATH
Metadaten
Titel
A fast partition-based batch-mode active learning technique using SVM classifier
verfasst von
Anshu Singla
Swarnajyoti Patra
Publikationsdatum
25.05.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 14/2018
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-017-2645-0

Weitere Artikel der Ausgabe 14/2018

Soft Computing 14/2018 Zur Ausgabe