Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 3/2019

13-10-2017 | Original Article

A dynamic selection ensemble method for target recognition based on clustering and randomized reference classifier

Authors: Xueman Fan, Shengliang Hu, Jingbo He

Published in: International Journal of Machine Learning and Cybernetics | Issue 3/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In order to improve the generalization ability and recognition efficiency of the maritime surveillance radar, a novel selection ensemble technique, termed KMRRC, based on k-medoids clustering and random reference classifier (RRC) is proposed. By disturbing the training set base classifiers are generated, which are then divided into several clusters based on pairwise diversity metrics, finally the RRC model is used to select several most competent classifiers from each cluster to classify each query object. The performance of KMRRC is compared against nine ensemble learning methods using a self-built high range resolution profile (HRRP) data set and twenty UCI databases. The experimental results clearly show the KMMRRC’s feasibility and effectiveness. In addition, the influence of the selection of diversity measures is studied concurrently.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Kittler J, Hatef M, Duin R P W, Matas J (1998) On combining classifiers. IEEE T Pattern Anal 20(3):226–239CrossRef Kittler J, Hatef M, Duin R P W, Matas J (1998) On combining classifiers. IEEE T Pattern Anal 20(3):226–239CrossRef
2.
go back to reference Wang XZ, Xing HJ, Li Y et al.(2015) A study on relationship between generalization abilities and fuzziness of base classifiers in ensemble learning. IEEE T Fuzzy Syst 23(5):1638–1654CrossRef Wang XZ, Xing HJ, Li Y et al.(2015) A study on relationship between generalization abilities and fuzziness of base classifiers in ensemble learning. IEEE T Fuzzy Syst 23(5):1638–1654CrossRef
3.
go back to reference Ludmila IK (2014) Combining pattern classifiers: methods and algorithms, 2nd edn. Wiley, New York, pp 178–183MATH Ludmila IK (2014) Combining pattern classifiers: methods and algorithms, 2nd edn. Wiley, New York, pp 178–183MATH
4.
go back to reference Woźniak M, Graña M, Corchado E (2014) A survey of multiple classifier systems as hybrid systems. Inf Fusion 16(1):3–17CrossRef Woźniak M, Graña M, Corchado E (2014) A survey of multiple classifier systems as hybrid systems. Inf Fusion 16(1):3–17CrossRef
5.
go back to reference Kuncheva LI (2002) Switching between selection and fusion in combining classifiers: an experiment. IEEE T Syst Man Cybern 32(2):146–156CrossRef Kuncheva LI (2002) Switching between selection and fusion in combining classifiers: an experiment. IEEE T Syst Man Cybern 32(2):146–156CrossRef
6.
go back to reference Azizi N, Farah N, Ennaji A (2012) New dynamic classifiers selection approach for handwritten recognition. In: Proceedings of international conference on artificial neural networks and machine learning, Springer, pp 189–196 Azizi N, Farah N, Ennaji A (2012) New dynamic classifiers selection approach for handwritten recognition. In: Proceedings of international conference on artificial neural networks and machine learning, Springer, pp 189–196
7.
go back to reference Mousavi R, Eftekhari M (2015) A new ensemble learning methodology based on hybridization of classifier ensemble selection approaches. Appl Soft Comput 37(C):652–666CrossRef Mousavi R, Eftekhari M (2015) A new ensemble learning methodology based on hybridization of classifier ensemble selection approaches. Appl Soft Comput 37(C):652–666CrossRef
8.
go back to reference Britto AS, Sabourin R, Oliveira L E S (2014) Dynamic selection of classifiers—a comprehensive review. Pattern Recogn 47(11):3665–3680CrossRef Britto AS, Sabourin R, Oliveira L E S (2014) Dynamic selection of classifiers—a comprehensive review. Pattern Recogn 47(11):3665–3680CrossRef
9.
go back to reference Ko AH, Sabourin R, Britto AS (2008) From dynamic classifier selection to dynamic ensemble selection. Pattern Recogn 41(5):1735–1748CrossRef Ko AH, Sabourin R, Britto AS (2008) From dynamic classifier selection to dynamic ensemble selection. Pattern Recogn 41(5):1735–1748CrossRef
10.
go back to reference Cavalin PR, Sabourin R, Suen CY (2013) Dynamic selection approaches for multiple classifier systems. Neural Comput Appl 22(3–4):673–688CrossRef Cavalin PR, Sabourin R, Suen CY (2013) Dynamic selection approaches for multiple classifier systems. Neural Comput Appl 22(3–4):673–688CrossRef
11.
go back to reference Cruz R M O, Cavalcanti G D C, Ren TI (2011) A method for dynamic ensemble selection based on a filter and an adaptive distance to improve the quality of the regions of competence. In: Proceedings of International Joint Conference on Neural Networks, IEEE, pp 1126–1133 Cruz R M O, Cavalcanti G D C, Ren TI (2011) A method for dynamic ensemble selection based on a filter and an adaptive distance to improve the quality of the regions of competence. In: Proceedings of International Joint Conference on Neural Networks, IEEE, pp 1126–1133
12.
go back to reference Azizi N, Farah N, Khadir T (2015) Multi stage dynamic ensemble selection using heterogeneous learning algorithms: application on classification problems. Int J Knowl Manag Stud 142(1):98–104 Azizi N, Farah N, Khadir T (2015) Multi stage dynamic ensemble selection using heterogeneous learning algorithms: application on classification problems. Int J Knowl Manag Stud 142(1):98–104
13.
go back to reference Santos E M D, Sabourin R, Maupin P (2008) A dynamic overproduce-and-choose strategy for the selection of classifier ensembles. Pattern Recogn 41(10):2993–3009CrossRef Santos E M D, Sabourin R, Maupin P (2008) A dynamic overproduce-and-choose strategy for the selection of classifier ensembles. Pattern Recogn 41(10):2993–3009CrossRef
14.
go back to reference Giacinto G, Roli F (2001) Dynamic classifier selection based on multiple classifier behavior. Pattern Recogn 34(9):1879–1881CrossRef Giacinto G, Roli F (2001) Dynamic classifier selection based on multiple classifier behavior. Pattern Recogn 34(9):1879–1881CrossRef
15.
go back to reference Krijthe JH, Ho TK, Loog M (2012) Improving cross-validation based classifier selection using meta-learning. In: Proceedings of international conference on pattern recognition, IEEE, pp 2873–2876 Krijthe JH, Ho TK, Loog M (2012) Improving cross-validation based classifier selection using meta-learning. In: Proceedings of international conference on pattern recognition, IEEE, pp 2873–2876
16.
go back to reference Cruz RM, Sabourin R, Cavalcanti GDC et al.(2015) META-DES: A dynamic ensemble selection framework using meta-learning. Pattern Recogn 48(5):1925–1935CrossRef Cruz RM, Sabourin R, Cavalcanti GDC et al.(2015) META-DES: A dynamic ensemble selection framework using meta-learning. Pattern Recogn 48(5):1925–1935CrossRef
17.
go back to reference Woloszynski T, Kurzynski M (2011) A probabilistic model of classifier competence for dynamic ensemble selection. Pattern Recogn 44(10–11):2656–2668CrossRef Woloszynski T, Kurzynski M (2011) A probabilistic model of classifier competence for dynamic ensemble selection. Pattern Recogn 44(10–11):2656–2668CrossRef
18.
go back to reference Huang D, Lai JH, Wang CD (2016) Ensemble clustering using factor graph. Pattern Recognition Pattern Recogn 50:131–142CrossRef Huang D, Lai JH, Wang CD (2016) Ensemble clustering using factor graph. Pattern Recognition Pattern Recogn 50:131–142CrossRef
19.
go back to reference Huang D, Lai JH, Wang CD (2016) Robust ensemble clustering using probability trajectories. IEEE T Knowl Data Eng 28(5):1312–1326CrossRef Huang D, Lai JH, Wang CD (2016) Robust ensemble clustering using probability trajectories. IEEE T Knowl Data Eng 28(5):1312–1326CrossRef
20.
go back to reference Zenobi G, Cunningham P (2001) Using Diversity in Preparing Ensembles of Classifiers Based on Different Feature Subsets to Minimize Generalization Error. In: Proceedings of European conference on machine learning, Springe, pp 576–587 Zenobi G, Cunningham P (2001) Using Diversity in Preparing Ensembles of Classifiers Based on Different Feature Subsets to Minimize Generalization Error. In: Proceedings of European conference on machine learning, Springe, pp 576–587
21.
go back to reference Canuto AMP, Abreu MCC, Oliveira LDM et al.(2007) Investigating the influence of the choice of the ensemble members in accuracy and diversity of selection-based and fusion-based methods for ensembles. Pattern Recogn Lett 28(4):472–486CrossRef Canuto AMP, Abreu MCC, Oliveira LDM et al.(2007) Investigating the influence of the choice of the ensemble members in accuracy and diversity of selection-based and fusion-based methods for ensembles. Pattern Recogn Lett 28(4):472–486CrossRef
22.
go back to reference Woloszynski T, Kurzynski M, Podsiadlo P et al.(2012) A measure of competence based on random classification for dynamic ensemble selection. Inf Fusion 13(3):207–213CrossRef Woloszynski T, Kurzynski M, Podsiadlo P et al.(2012) A measure of competence based on random classification for dynamic ensemble selection. Inf Fusion 13(3):207–213CrossRef
23.
go back to reference Cameron WL, Leung LK (1990) Feature motivated polarization scattering matrix decomposition. In: Proceedings of international conference on radar, IEEE, pp 549–557 Cameron WL, Leung LK (1990) Feature motivated polarization scattering matrix decomposition. In: Proceedings of international conference on radar, IEEE, pp 549–557
24.
go back to reference Chen Y, Jiang H, Li C, Jia X (2016) Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE T Geosci Rem 54(10):1–20CrossRef Chen Y, Jiang H, Li C, Jia X (2016) Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE T Geosci Rem 54(10):1–20CrossRef
25.
go back to reference Pilcher CM, Khotanzad A (2011) Maritime ATR using classifier combination and high resolution range profiles. IEEE Trans Aerosp Electron Syst 47(4):2558–2573CrossRef Pilcher CM, Khotanzad A (2011) Maritime ATR using classifier combination and high resolution range profiles. IEEE Trans Aerosp Electron Syst 47(4):2558–2573CrossRef
26.
go back to reference Cloude SR, Pottier E (1997) An entropy based classification scheme for land applications of polarimetric SAR. IEEE T Geosci Remote 35(1):68–78CrossRef Cloude SR, Pottier E (1997) An entropy based classification scheme for land applications of polarimetric SAR. IEEE T Geosci Remote 35(1):68–78CrossRef
27.
go back to reference Berizzi F, Martorella M, Capria A et al.(2008) H/α polarimetric features for man-made target classification. In: Proceedings of international conference on radar conference, IEEE, pp 1–6 Berizzi F, Martorella M, Capria A et al.(2008) H/α polarimetric features for man-made target classification. In: Proceedings of international conference on radar conference, IEEE, pp 1–6
28.
go back to reference Lei L, Wang XD, Xing YQ et al.(2013) Multi-polarized HRRP classification by SVM and DS evidence theory. Control Decis 28(6):861–866 (Chinese)MATH Lei L, Wang XD, Xing YQ et al.(2013) Multi-polarized HRRP classification by SVM and DS evidence theory. Control Decis 28(6):861–866 (Chinese)MATH
29.
go back to reference Guo L (2009) Wideband radar target polarimetric feature extraction and recognition method based on kernel method. Dissertation, National University of Defense Technology. (in chinese) Guo L (2009) Wideband radar target polarimetric feature extraction and recognition method based on kernel method. Dissertation, National University of Defense Technology. (in chinese)
30.
go back to reference Fan XM, Hu SL, He JB (2016) Feature extraction and selection of Full Polarization HRRP in the target recognition process of maritime surveillance radar. J Electrs Inf Technol 38(12):3261–3268 Fan XM, Hu SL, He JB (2016) Feature extraction and selection of Full Polarization HRRP in the target recognition process of maritime surveillance radar. J Electrs Inf Technol 38(12):3261–3268
31.
go back to reference Yeung DS, Wang XZ (2002) Improving performance of similarity-based clustering by feature weight learning. IEEE T Pattern Anal 24(4):556–561CrossRef Yeung DS, Wang XZ (2002) Improving performance of similarity-based clustering by feature weight learning. IEEE T Pattern Anal 24(4):556–561CrossRef
32.
go back to reference Tang EK, Suganthan PN, Yao X (2006) An analysis of diversity measures. Mach Learn 65(1):247–271CrossRef Tang EK, Suganthan PN, Yao X (2006) An analysis of diversity measures. Mach Learn 65(1):247–271CrossRef
33.
go back to reference Balabantaray RC, Sarma C, Jha M (2015) Document clustering using K-means and K-medoids. Int J Knowl Based Comput Syst 1:7–13 Balabantaray RC, Sarma C, Jha M (2015) Document clustering using K-means and K-medoids. Int J Knowl Based Comput Syst 1:7–13
34.
go back to reference Azizi N, Farah N (2012) From static to dynamic ensemble of classifiers selection: application to Arabic handwritten recognition. IOS press, USA, pp 279–288 Azizi N, Farah N (2012) From static to dynamic ensemble of classifiers selection: application to Arabic handwritten recognition. IOS press, USA, pp 279–288
35.
go back to reference Demsar J (2015) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7(1):1–30MathSciNetMATH Demsar J (2015) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7(1):1–30MathSciNetMATH
Metadata
Title
A dynamic selection ensemble method for target recognition based on clustering and randomized reference classifier
Authors
Xueman Fan
Shengliang Hu
Jingbo He
Publication date
13-10-2017
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 3/2019
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-017-0732-2

Other articles of this Issue 3/2019

International Journal of Machine Learning and Cybernetics 3/2019 Go to the issue