Skip to main content

2014 | OriginalPaper | Buchkapitel

6. Rotation-Based Ensemble Classifiers for High-Dimensional Data

verfasst von : Junshi Xia, Jocelyn Chanussot, Peijun Du, Xiyan He

Erschienen in: Fusion in Computer Vision

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In past 20 years, Multiple Classifier System (MCS) has shown great potential to improve the accuracy and reliability of pattern classification. In this chapter, we discuss the major issues of MCS, including MCS topology, classifier generation, and classifier combination, providing a summary of MCS applied to remote sensing image classification, especially in high-dimensional data. Furthermore, the recently rotation-based ensemble classifiers, which encourage both individual accuracy and diversity within the ensemble simultaneously, are presented to classify high-dimensional data, taking hyperspectral and multidate remote sensing images as examples. Rotation-based ensemble classifiers project the original data into a new feature space using feature extraction and subset selection methods to generate the diverse individual classifiers. Two classifiers: Decision Tree (DT) and Support Vector Machine (SVM), are selected as the base classifier. Unsupervised and supervised feature extraction methods are employed in the rotation-based ensemble classifiers. Experimental results demonstrated that rotation-based ensemble classifiers are superior to Bagging, AdaBoost and random-based ensemble classifiers.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Achlioptas, D (2001) Database-friendly random projections. In: Proceedings of the twentieth ACM SIGMOD-SIGACT-SIGART symposium on principles of database systems, New York, NY, USA, 2001, pp 274–281 Achlioptas, D (2001) Database-friendly random projections. In: Proceedings of the twentieth ACM SIGMOD-SIGACT-SIGART symposium on principles of database systems, New York, NY, USA, 2001, pp 274–281
2.
Zurück zum Zitat Aksela M, Laaksonen J (2006) Using diversity of errors for selecting members of a committee classifier. Pattern Recogn 39(4):608–623CrossRefMATH Aksela M, Laaksonen J (2006) Using diversity of errors for selecting members of a committee classifier. Pattern Recogn 39(4):608–623CrossRefMATH
3.
Zurück zum Zitat Bakos KL, Gamba P (2011) Hierarchical hybrid decision tree fusion of multiple hyperspectral data processing chains. IEEE Trans Geosci Remote Sens 49(1–2):388–394CrossRef Bakos KL, Gamba P (2011) Hierarchical hybrid decision tree fusion of multiple hyperspectral data processing chains. IEEE Trans Geosci Remote Sens 49(1–2):388–394CrossRef
4.
Zurück zum Zitat Benediktsson JA, Chanussot J, Fauvel M (2007) Multiple classifier systems in remote sensing: from basics to recent developments. Lect Notes Comput Sci 4472:501–512CrossRef Benediktsson JA, Chanussot J, Fauvel M (2007) Multiple classifier systems in remote sensing: from basics to recent developments. Lect Notes Comput Sci 4472:501–512CrossRef
5.
Zurück zum Zitat Benediktsson JA, Sveinsson JR (1997) Hybrid consensus theoretic classification. IEEE Trans Geosci Remote Sens 35(4):833–843CrossRef Benediktsson JA, Sveinsson JR (1997) Hybrid consensus theoretic classification. IEEE Trans Geosci Remote Sens 35(4):833–843CrossRef
6.
Zurück zum Zitat Benediktsson JA, Swain PH (1992) Consensus theoretic classification methods. IEEE Trans Syst Man Cybern 22(4):688–704CrossRefMATH Benediktsson JA, Swain PH (1992) Consensus theoretic classification methods. IEEE Trans Syst Man Cybern 22(4):688–704CrossRefMATH
7.
Zurück zum Zitat Biggio B, Fumera G, Roli F (2010) Multiple classifier systems for robust classifier design in adversarial environments. J Mach Learn Cybern 1:27–41CrossRef Biggio B, Fumera G, Roli F (2010) Multiple classifier systems for robust classifier design in adversarial environments. J Mach Learn Cybern 1:27–41CrossRef
8.
Zurück zum Zitat Braun AC, Weidner U, Hinz S (2012) Classification in high-dimensional feature spaces assessment using SVM, IVM and RVM with focus on simulated EnMap data. IEEE J Sel Top Appl Earth Observations Remote Sens 5(2):436–443CrossRef Braun AC, Weidner U, Hinz S (2012) Classification in high-dimensional feature spaces assessment using SVM, IVM and RVM with focus on simulated EnMap data. IEEE J Sel Top Appl Earth Observations Remote Sens 5(2):436–443CrossRef
11.
Zurück zum Zitat Briem G, Benediktsson J, Sveinsson J (2002) Multiple classifiers applied to multisource remote sensing data. IEEE Trans Geosci Remote Sens 40(10):2291–2299CrossRef Briem G, Benediktsson J, Sveinsson J (2002) Multiple classifiers applied to multisource remote sensing data. IEEE Trans Geosci Remote Sens 40(10):2291–2299CrossRef
12.
Zurück zum Zitat Brown G, Wyatt J, Harris R, Yao X (2005) Diversity creation methods: a survey and categorisation. Inf Fusion 6(1):5–20CrossRef Brown G, Wyatt J, Harris R, Yao X (2005) Diversity creation methods: a survey and categorisation. Inf Fusion 6(1):5–20CrossRef
13.
Zurück zum Zitat Bryll RK, Gutierrez-Osuna R, Quek FKH (2003) Attribute bagging: improving accuracy of classifier ensembles by using random feature subsets. Pattern Recogn 36(6):1291–1302CrossRefMATH Bryll RK, Gutierrez-Osuna R, Quek FKH (2003) Attribute bagging: improving accuracy of classifier ensembles by using random feature subsets. Pattern Recogn 36(6):1291–1302CrossRefMATH
14.
Zurück zum Zitat Chan JC, Paelinckx D (2008) Evaluation of Random Forest and AdBboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery. Remote Sens Environ 112(6):2999–3011CrossRef Chan JC, Paelinckx D (2008) Evaluation of Random Forest and AdBboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery. Remote Sens Environ 112(6):2999–3011CrossRef
15.
Zurück zum Zitat Chandra A, Yao X (2006) Evolving hybrid ensembles of learning machines for better generalisation. Neurocomputing 69(7–9):686–700CrossRef Chandra A, Yao X (2006) Evolving hybrid ensembles of learning machines for better generalisation. Neurocomputing 69(7–9):686–700CrossRef
16.
Zurück zum Zitat Cheriyadat A, Bruce LM (2003) Why principal component analysis is not an appropriate feature extraction method for hyperspectral data. In: Proceedings of IEEE geoscience and remote sensing symposium (IGARSS), Toulouse, France, 2003, pp 3420–3422 Cheriyadat A, Bruce LM (2003) Why principal component analysis is not an appropriate feature extraction method for hyperspectral data. In: Proceedings of IEEE geoscience and remote sensing symposium (IGARSS), Toulouse, France, 2003, pp 3420–3422
17.
Zurück zum Zitat Cunningham P, Carney J (2000) Diversity versus quality in classification ensembles based on feature selection. In: 11th European conference on machine learning, Barcelona, Spain, 2000, pp 109–116 Cunningham P, Carney J (2000) Diversity versus quality in classification ensembles based on feature selection. In: 11th European conference on machine learning, Barcelona, Spain, 2000, pp 109–116
18.
Zurück zum Zitat Dell’Acqua F, Gamba P, Ferari A, Palmason BJA, Arnason K (2004) Exploiting spectral and spatial information in hyperspectral urban data with high resolution. IEEE Geosci Remote Sens Lett 1(4):322–326CrossRef Dell’Acqua F, Gamba P, Ferari A, Palmason BJA, Arnason K (2004) Exploiting spectral and spatial information in hyperspectral urban data with high resolution. IEEE Geosci Remote Sens Lett 1(4):322–326CrossRef
19.
Zurück zum Zitat Dietterich TG, Bakiri G (1995) Solving multiclass learning problems via error-correcting output codes. J Artif Intell Res 2(1):263–286MATH Dietterich TG, Bakiri G (1995) Solving multiclass learning problems via error-correcting output codes. J Artif Intell Res 2(1):263–286MATH
20.
Zurück zum Zitat Doan HTX, Foody GM (2007) Increasing soft classification accuracy through the use of an ensemble of classifiers. Int J Remote Sens 28(20):4609–4623CrossRef Doan HTX, Foody GM (2007) Increasing soft classification accuracy through the use of an ensemble of classifiers. Int J Remote Sens 28(20):4609–4623CrossRef
21.
Zurück zum Zitat Du P, Xia J, Zhang W, Tan K, Liu Y, Liu S (2012) Multiple classifier system for remote sensing image classification: a review. Sensors 12(4):4764–4792CrossRef Du P, Xia J, Zhang W, Tan K, Liu Y, Liu S (2012) Multiple classifier system for remote sensing image classification: a review. Sensors 12(4):4764–4792CrossRef
22.
Zurück zum Zitat Du P, Zhang W, Xia J (2011) Hyperspectral remote sensing image classification based on decision level fusion. Chin Optics Lett 9(3):031002–031004CrossRef Du P, Zhang W, Xia J (2011) Hyperspectral remote sensing image classification based on decision level fusion. Chin Optics Lett 9(3):031002–031004CrossRef
23.
Zurück zum Zitat Duca R, Frate FD (2008) Hyperspectral and multiangle CHRIS-PROBA images for the generation of land cover maps. IEEE Trans Geosci Remote Sens 10:2857–2866CrossRef Duca R, Frate FD (2008) Hyperspectral and multiangle CHRIS-PROBA images for the generation of land cover maps. IEEE Trans Geosci Remote Sens 10:2857–2866CrossRef
24.
Zurück zum Zitat Fauvel M, Chanussot J, Benediktsson JA (2009) Kernel principal component analysis for the classification of hyperspectral remote sensing data over urban areas. EURASIP J Adv Signal Process 2:1–15CrossRef Fauvel M, Chanussot J, Benediktsson JA (2009) Kernel principal component analysis for the classification of hyperspectral remote sensing data over urban areas. EURASIP J Adv Signal Process 2:1–15CrossRef
25.
Zurück zum Zitat Fleiss J (1981) Statistical methods for rates and proportions. Wiley, New York Fleiss J (1981) Statistical methods for rates and proportions. Wiley, New York
26.
Zurück zum Zitat Foody GM (2009) Classification accuracy comparison: hypothesis tests and the use of confidence intervals in evaluations of difference, equivalence and non-inferiority. Remote Sens Environ 113(8):1658–1663CrossRef Foody GM (2009) Classification accuracy comparison: hypothesis tests and the use of confidence intervals in evaluations of difference, equivalence and non-inferiority. Remote Sens Environ 113(8):1658–1663CrossRef
27.
Zurück zum Zitat Foody GM, Boyd DS, Sanchez-Hernandez C (2007) Mapping a specific class with an ensemble of classifiers. Int J Remote Sens 28:1733–1746CrossRef Foody GM, Boyd DS, Sanchez-Hernandez C (2007) Mapping a specific class with an ensemble of classifiers. Int J Remote Sens 28:1733–1746CrossRef
28.
Zurück zum Zitat Freund Y, Schapire RE (1996) Experiments with a new Boosting algorithm. In: International conference on machine learning, Bari, Italy, 1996, pp 148–156 Freund Y, Schapire RE (1996) Experiments with a new Boosting algorithm. In: International conference on machine learning, Bari, Italy, 1996, pp 148–156
29.
Zurück zum Zitat Gao J, Liang F, Fan W, Sun Y, Han J (2013) A graph-based consensus maximization approach for combining multiple supervised and unsupervised models. IEEE Trans Knowl Data Eng 25(1):15–28CrossRef Gao J, Liang F, Fan W, Sun Y, Han J (2013) A graph-based consensus maximization approach for combining multiple supervised and unsupervised models. IEEE Trans Knowl Data Eng 25(1):15–28CrossRef
30.
Zurück zum Zitat Giacinto G, Roli F (2001) Design of effective neural network ensembles for image classification. Image Vis Comput J 19(9/10):697–705 Giacinto G, Roli F (2001) Design of effective neural network ensembles for image classification. Image Vis Comput J 19(9/10):697–705
31.
Zurück zum Zitat Giacinto G, Roli F, Fumera G (2000) Selection of image classifiers. Electron Lett 36:420–422CrossRef Giacinto G, Roli F, Fumera G (2000) Selection of image classifiers. Electron Lett 36:420–422CrossRef
32.
Zurück zum Zitat Giacinto G, Roli F, Vernazza G (1997) Comparison and combination of statistical and neural network algorithms for remote-sensing image classification. Neurocomputation in remote sensing data analysis. Springer, Berlin, pp 117–124 Giacinto G, Roli F, Vernazza G (1997) Comparison and combination of statistical and neural network algorithms for remote-sensing image classification. Neurocomputation in remote sensing data analysis. Springer, Berlin, pp 117–124
33.
Zurück zum Zitat Gislason PO, Benediktsson JA, Sveinsson JR (2006) Random forests for land cover classification. Pattern Recogn Lett 27(4):294–300CrossRef Gislason PO, Benediktsson JA, Sveinsson JR (2006) Random forests for land cover classification. Pattern Recogn Lett 27(4):294–300CrossRef
34.
Zurück zum Zitat Gmez-Chova L, Fernndez-Prieto D, Calpe-Maravilla J, Soria-Olivas E, Vila-Francs J, Camps-Valls G (2006) Urban monitoring using multi-temporal SAR and multi-spectral data. Pattern Recogn Lett 27(4):234–243 Gmez-Chova L, Fernndez-Prieto D, Calpe-Maravilla J, Soria-Olivas E, Vila-Francs J, Camps-Valls G (2006) Urban monitoring using multi-temporal SAR and multi-spectral data. Pattern Recogn Lett 27(4):234–243
35.
Zurück zum Zitat Guyon I, Gunn S, Nikravesh M, Zadeh L (2006) Feature extraction: foundations and applications. Springer, New York Guyon I, Gunn S, Nikravesh M, Zadeh L (2006) Feature extraction: foundations and applications. Springer, New York
36.
Zurück zum Zitat Ham J, Chen Y, Crawford MM, Ghosh J (2005) Investigation of the random forest framework for classification of hyperspectral data. IEEE Trans Geosci Remote Sens 43(3):492–501CrossRef Ham J, Chen Y, Crawford MM, Ghosh J (2005) Investigation of the random forest framework for classification of hyperspectral data. IEEE Trans Geosci Remote Sens 43(3):492–501CrossRef
37.
Zurück zum Zitat Hansen LK, Salamon P (1990) Neural network ensembles. IEEE Trans Pattern Anal Mach Intell 12(10):993–1001CrossRef Hansen LK, Salamon P (1990) Neural network ensembles. IEEE Trans Pattern Anal Mach Intell 12(10):993–1001CrossRef
38.
Zurück zum Zitat He Z, Xu X, Deng S (2005) A cluster ensemble method for clustering categorical data. Inf Fusion 6(2):143–151CrossRef He Z, Xu X, Deng S (2005) A cluster ensemble method for clustering categorical data. Inf Fusion 6(2):143–151CrossRef
39.
Zurück zum Zitat Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8):832–844CrossRef Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8):832–844CrossRef
40.
Zurück zum Zitat Hughes G (1968) On the mean accuracy of statistical pattern recognizers. IEEE Trans Inf Theory 14(1):55–63CrossRef Hughes G (1968) On the mean accuracy of statistical pattern recognizers. IEEE Trans Inf Theory 14(1):55–63CrossRef
41.
Zurück zum Zitat Iam-On N, Boongoen T, Garrett S, Price C (2011) A link-based approach to the cluster ensemble problem. IEEE Trans Pattern Anal Mach Intell 33(12):2396–2409CrossRef Iam-On N, Boongoen T, Garrett S, Price C (2011) A link-based approach to the cluster ensemble problem. IEEE Trans Pattern Anal Mach Intell 33(12):2396–2409CrossRef
42.
Zurück zum Zitat Richards JA, Jia X (2006) Remote sensing digital image analysis: an introduction. Springer, New York Richards JA, Jia X (2006) Remote sensing digital image analysis: an introduction. Springer, New York
43.
Zurück zum Zitat Kang H-J, Lee S-W (2000) An information-theoretic strategy for constructing multiple classifier systems. In: International conference on pattern recognition (ICPR), Barcelona, Spain, 2000, pp 2483–2486 Kang H-J, Lee S-W (2000) An information-theoretic strategy for constructing multiple classifier systems. In: International conference on pattern recognition (ICPR), Barcelona, Spain, 2000, pp 2483–2486
44.
Zurück zum Zitat Kawaguchi K, Nishii R (2007) Hyperspectral image classification by bootstrap AdaBoost with random decision stumps. IEEE Trans Geosci Remote Sens 45(11–2):3845–3851CrossRef Kawaguchi K, Nishii R (2007) Hyperspectral image classification by bootstrap AdaBoost with random decision stumps. IEEE Trans Geosci Remote Sens 45(11–2):3845–3851CrossRef
45.
Zurück zum Zitat Kohavi R, Wolpert DH (1996) Bias plus variance decomposition for zero-one loss functions. In: 13th international conference on machine learning (ICML), Bari, Italy, 1996, pp 275–283 Kohavi R, Wolpert DH (1996) Bias plus variance decomposition for zero-one loss functions. In: 13th international conference on machine learning (ICML), Bari, Italy, 1996, pp 275–283
46.
Zurück zum Zitat Kong Z, Cai Z (2007) Advances of research in fuzzy integral for classifiers’ fusion. In: Proceedings of the eigth ACIS international conference on software engineering, artificial intelligence, networking, and parallel/distributed computing, Washington, DC, USA pp 809–814 Kong Z, Cai Z (2007) Advances of research in fuzzy integral for classifiers’ fusion. In: Proceedings of the eigth ACIS international conference on software engineering, artificial intelligence, networking, and parallel/distributed computing, Washington, DC, USA pp 809–814
47.
Zurück zum Zitat Krogh A, Vedelsby J (1995) Neural network ensembles, cross validation, and active learning. Adv Neural Inf Process Syst 7:231–238 Krogh A, Vedelsby J (1995) Neural network ensembles, cross validation, and active learning. Adv Neural Inf Process Syst 7:231–238
48.
Zurück zum Zitat Kumar S, Ghosh J, Crawford MM (2002) Hierarchical fusion of multiple classifiers for hyperspectral data analysis. Pattern Anal Appl 5:210–220CrossRefMATHMathSciNet Kumar S, Ghosh J, Crawford MM (2002) Hierarchical fusion of multiple classifiers for hyperspectral data analysis. Pattern Anal Appl 5:210–220CrossRefMATHMathSciNet
49.
Zurück zum Zitat Kuncheva L, Whitaker C, Shipp C, Duin R (2000) Is independence good for combining classifiers? In: International conference on pattern recognition (ICPR), 2000, p 2168 Kuncheva L, Whitaker C, Shipp C, Duin R (2000) Is independence good for combining classifiers? In: International conference on pattern recognition (ICPR), 2000, p 2168
50.
Zurück zum Zitat Kuncheva LI (2004) Combining pattern classifiers: methods and algorithms. Wiley-Interscience, New Jersey Kuncheva LI (2004) Combining pattern classifiers: methods and algorithms. Wiley-Interscience, New Jersey
52.
Zurück zum Zitat Kuncheva LI, Rodriguez JJ (2007) An experimental study on rotation forest ensembles. In: Proceedings of the 7th international workshop on multiple classifier systems, Prague, Czech Republic, 2007, pp 459–468 Kuncheva LI, Rodriguez JJ (2007) An experimental study on rotation forest ensembles. In: Proceedings of the 7th international workshop on multiple classifier systems, Prague, Czech Republic, 2007, pp 459–468
53.
Zurück zum Zitat Kuncheva LI, Whitaker CJ (2003) Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Mach Learn 51(2):181–207CrossRefMATH Kuncheva LI, Whitaker CJ (2003) Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Mach Learn 51(2):181–207CrossRefMATH
54.
Zurück zum Zitat Landgrebe DA (1984) Signal theory methods in multispectral remote sensing. Wiley, New York Landgrebe DA (1984) Signal theory methods in multispectral remote sensing. Wiley, New York
55.
Zurück zum Zitat Lawrence R, Bunna A, Powellb S, Zambon M (2004) Classification of remotely sensed imagery using stochastic gradient boosting as a refinement of classification tree analysis. Remote Sens Environ 90(3):331–336CrossRef Lawrence R, Bunna A, Powellb S, Zambon M (2004) Classification of remotely sensed imagery using stochastic gradient boosting as a refinement of classification tree analysis. Remote Sens Environ 90(3):331–336CrossRef
56.
Zurück zum Zitat Lu D, Weng Q (2007) A survey of image classification methods and techniques for improving classification performance. Int J Remote Sens 28(5):823–870CrossRef Lu D, Weng Q (2007) A survey of image classification methods and techniques for improving classification performance. Int J Remote Sens 28(5):823–870CrossRef
57.
Zurück zum Zitat Margineantu DD, Dietterich TG (1997) Pruning adaptive boosting. In: Proceedings of the fourteenth international conference on machine learning, San Francisco, CA, USA, 1997, pp 211–218 Margineantu DD, Dietterich TG (1997) Pruning adaptive boosting. In: Proceedings of the fourteenth international conference on machine learning, San Francisco, CA, USA, 1997, pp 211–218
58.
Zurück zum Zitat Martinez-Munoz G, Suarez A (2005) Switching class labels to generate classification ensembles. Pattern Recogn 38(10):1483–1494CrossRef Martinez-Munoz G, Suarez A (2005) Switching class labels to generate classification ensembles. Pattern Recogn 38(10):1483–1494CrossRef
59.
Zurück zum Zitat Melgani F, Bruzzone L (2004) Classification of hyperspectral remote sensing images with support vector machines. IEEE Trans Geosci Remote Sens 42(8):1778–1790CrossRef Melgani F, Bruzzone L (2004) Classification of hyperspectral remote sensing images with support vector machines. IEEE Trans Geosci Remote Sens 42(8):1778–1790CrossRef
60.
Zurück zum Zitat Michail P, Benediktsson JA, Ioannis K (2002) The effect of classifier agreement on the accuracy of the combined classifier in decision level fusion. IEEE Trans Geosci Remote Sens 39(11):2539–2546 Michail P, Benediktsson JA, Ioannis K (2002) The effect of classifier agreement on the accuracy of the combined classifier in decision level fusion. IEEE Trans Geosci Remote Sens 39(11):2539–2546
61.
Zurück zum Zitat Mojaradi B, Abrishami-Moghaddam H, Zoej M, Duin R (2009) Dimensionality reduction of hyperspectral data via spectral feature extraction. IEEE Trans Geosci Remote Sens 47(7):2091–2105CrossRef Mojaradi B, Abrishami-Moghaddam H, Zoej M, Duin R (2009) Dimensionality reduction of hyperspectral data via spectral feature extraction. IEEE Trans Geosci Remote Sens 47(7):2091–2105CrossRef
62.
Zurück zum Zitat Moon H, Ahn H, Kodell RL, Baek S, Lin C-J, Chen JJ (2007) Ensemble methods for classification of patients for personalized medicine with high-dimensional data. Artif Intell Med 41(3):197–207CrossRef Moon H, Ahn H, Kodell RL, Baek S, Lin C-J, Chen JJ (2007) Ensemble methods for classification of patients for personalized medicine with high-dimensional data. Artif Intell Med 41(3):197–207CrossRef
63.
Zurück zum Zitat Moreno-Seco F, Inesta J, Ponce De Leon P, Mico L (2006) Comparison of classifier fusion methods for classification in pattern recognition tasks. Lect Notes Comput Sci 4109:705–713CrossRef Moreno-Seco F, Inesta J, Ponce De Leon P, Mico L (2006) Comparison of classifier fusion methods for classification in pattern recognition tasks. Lect Notes Comput Sci 4109:705–713CrossRef
64.
Zurück zum Zitat Navalgund RR, Jayaraman V, Roy PS (2007) Remote sensing applications: an overview. Current 93(12):1747–1766 Navalgund RR, Jayaraman V, Roy PS (2007) Remote sensing applications: an overview. Current 93(12):1747–1766
65.
Zurück zum Zitat Nemmour H, Chibani Y (2006) Multiple support vector machines for land cover change detection: an application for mapping urban extensions. ISPRS J Photogrammetry Remote Sens 61(2):125–133CrossRef Nemmour H, Chibani Y (2006) Multiple support vector machines for land cover change detection: an application for mapping urban extensions. ISPRS J Photogrammetry Remote Sens 61(2):125–133CrossRef
66.
Zurück zum Zitat Ozcift A, Gulten A (2011) Classifier ensemble construction with rotation forest to improve medical diagnosis performance of machine learning algorithms. Comput Methods Programs Biomed 104(3):443–451CrossRef Ozcift A, Gulten A (2011) Classifier ensemble construction with rotation forest to improve medical diagnosis performance of machine learning algorithms. Comput Methods Programs Biomed 104(3):443–451CrossRef
67.
Zurück zum Zitat Pal M, Foody GM (2010) Feature selection for classification of hyperspectral data by SVM. IEEE Trans Geosci Remote Sens 48(5):2297–2307CrossRef Pal M, Foody GM (2010) Feature selection for classification of hyperspectral data by SVM. IEEE Trans Geosci Remote Sens 48(5):2297–2307CrossRef
68.
Zurück zum Zitat Partridge D, Krzanowski W (1997) Software diversity: practical statistics for its measurement and exploitation. Inf Softw Technol 39(10):707–717CrossRef Partridge D, Krzanowski W (1997) Software diversity: practical statistics for its measurement and exploitation. Inf Softw Technol 39(10):707–717CrossRef
69.
Zurück zum Zitat Plaza A, Martinez P, Plaza J, Perez R (2005) Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations. IEEE Trans Geosci Remote Sens 43(3):466–479CrossRef Plaza A, Martinez P, Plaza J, Perez R (2005) Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations. IEEE Trans Geosci Remote Sens 43(3):466–479CrossRef
70.
Zurück zum Zitat Rahman A, Fairhurst M (1999) Serial combination of multiple experts: a unified evaluation. Pattern Anal Appl 2:292–311CrossRef Rahman A, Fairhurst M (1999) Serial combination of multiple experts: a unified evaluation. Pattern Anal Appl 2:292–311CrossRef
71.
Zurück zum Zitat Ranawana R, Palade V (2006) Multi-classifier systems: review and a roadmap for developers. Int J Hybrid Intell Syst 3(1):1–41 Ranawana R, Palade V (2006) Multi-classifier systems: review and a roadmap for developers. Int J Hybrid Intell Syst 3(1):1–41
72.
Zurück zum Zitat Rodriguez JJ, Kuncheva LI (2009) Rotation forest: a new classifier ensemble method. IEEE Trans Pattern Anal Mach Intell 28(10):1619–1630CrossRef Rodriguez JJ, Kuncheva LI (2009) Rotation forest: a new classifier ensemble method. IEEE Trans Pattern Anal Mach Intell 28(10):1619–1630CrossRef
73.
Zurück zum Zitat Rodriguez-Galianoa VF, Ghimireb B, Roganb J, Chica-Olmoa M, Rigol-Sanchezc JP (2011) An assessment of the effectiveness of a random forest classifier for land-cover classification. ISPRS J Photogrammetry Remote Sens 67:93–104CrossRef Rodriguez-Galianoa VF, Ghimireb B, Roganb J, Chica-Olmoa M, Rigol-Sanchezc JP (2011) An assessment of the effectiveness of a random forest classifier for land-cover classification. ISPRS J Photogrammetry Remote Sens 67:93–104CrossRef
74.
Zurück zum Zitat Rokach L (2010) Pattern classification using ensemble methods. World Scientific, Singapore Rokach L (2010) Pattern classification using ensemble methods. World Scientific, Singapore
75.
Zurück zum Zitat Ruitenbeek F, Debba P, Meer F, Cudahy T, Meijde M, Hale M (2006) Mapping white micas and their absorption wavelengths using hyperspectral band ratios. Remote Sens Environ 102 (3–4):211–222 Ruitenbeek F, Debba P, Meer F, Cudahy T, Meijde M, Hale M (2006) Mapping white micas and their absorption wavelengths using hyperspectral band ratios. Remote Sens Environ 102 (3–4):211–222
76.
Zurück zum Zitat Ruta D, Gabrys B (2000) An overview of classifier fusion methods. Comput Inf Syst 7(1):1–10 Ruta D, Gabrys B (2000) An overview of classifier fusion methods. Comput Inf Syst 7(1):1–10
77.
Zurück zum Zitat Schölkopf B, Platt JC, Shawe-Taylor J, Smola AJ, Williamson RC (2001) Estimating the support of a high-dimensional distribution. Neural Comput 13(7):1443–1471CrossRefMATH Schölkopf B, Platt JC, Shawe-Taylor J, Smola AJ, Williamson RC (2001) Estimating the support of a high-dimensional distribution. Neural Comput 13(7):1443–1471CrossRefMATH
78.
Zurück zum Zitat Smits PC (2002) Multiple classifier systems for supervised remote sensing image classification based on dynamic classifier selection. IEEE Trans Geosci Remote Sens 40:801–813CrossRef Smits PC (2002) Multiple classifier systems for supervised remote sensing image classification based on dynamic classifier selection. IEEE Trans Geosci Remote Sens 40:801–813CrossRef
79.
Zurück zum Zitat Steele BM (2000) Combining multiple classifiers: an application using spatial and remotely sensed information for land cover type mapping. Remote Sens Environ 74(3):545–556CrossRef Steele BM (2000) Combining multiple classifiers: an application using spatial and remotely sensed information for land cover type mapping. Remote Sens Environ 74(3):545–556CrossRef
80.
Zurück zum Zitat Sugiyama M (2007) Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis. J Mach Learn Res 27(8):1021–1064 Sugiyama M (2007) Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis. J Mach Learn Res 27(8):1021–1064
81.
Zurück zum Zitat Sun Q, Ye XQ, Gu WK (2000) A new combination rules of evidence theory (in chinese). Acta Electronica Sinica 8(1):117–119 Sun Q, Ye XQ, Gu WK (2000) A new combination rules of evidence theory (in chinese). Acta Electronica Sinica 8(1):117–119
82.
Zurück zum Zitat Tsoumakas G, Partalas I, Vlahavas I (2009) An ensemble pruning primer. In: Okun O, Valentini G (eds) Applications of supervised and unsupervised ensemble methods. Springer, Berlin, pp 1–13 Tsoumakas G, Partalas I, Vlahavas I (2009) An ensemble pruning primer. In: Okun O, Valentini G (eds) Applications of supervised and unsupervised ensemble methods. Springer, Berlin, pp 1–13
83.
Zurück zum Zitat Vapnik VN (1995) The nature of statistical learning theory. Springer, Berlin Vapnik VN (1995) The nature of statistical learning theory. Springer, Berlin
84.
Zurück zum Zitat Waske B, Benediktsson JA, Arnason K, Sveinsson JR (2009) Mapping of hyperspectral aviris data using machine-learning algorithms. Can J Remote Sens 35:106–116CrossRef Waske B, Benediktsson JA, Arnason K, Sveinsson JR (2009) Mapping of hyperspectral aviris data using machine-learning algorithms. Can J Remote Sens 35:106–116CrossRef
85.
Zurück zum Zitat Waske B, Van Der Linden S, Benediktsson JA, Rabe A, Hostert P (2010) Sensitivity of support vector machines to random feature selection in classification of hyperspectral data. IEEE Trans Geosci Remote Sens 48(7):2880–2889CrossRef Waske B, Van Der Linden S, Benediktsson JA, Rabe A, Hostert P (2010) Sensitivity of support vector machines to random feature selection in classification of hyperspectral data. IEEE Trans Geosci Remote Sens 48(7):2880–2889CrossRef
86.
Zurück zum Zitat Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82CrossRef Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82CrossRef
87.
Zurück zum Zitat Woods K, Kegelmeyer WP, Bowyer K (1997) Combination of multiple classifiers using local accuracy estimates. IEEE Trans Pattern Anal Mach Intell 19(4):405–410CrossRef Woods K, Kegelmeyer WP, Bowyer K (1997) Combination of multiple classifiers using local accuracy estimates. IEEE Trans Pattern Anal Mach Intell 19(4):405–410CrossRef
88.
Zurück zum Zitat Wozniak M, Grana M, Corchado E (2014) A survey of multiple classifier systems as hybrid systems. Inf Fusion 16(1):3–17CrossRef Wozniak M, Grana M, Corchado E (2014) A survey of multiple classifier systems as hybrid systems. Inf Fusion 16(1):3–17CrossRef
89.
Zurück zum Zitat Xia J, Du P, He X, Chanussot J (2014) Hyperspectral remote sensing image classification based on rotation forest. IEEE Geosci Remote Sens Lett 11:239–243CrossRef Xia J, Du P, He X, Chanussot J (2014) Hyperspectral remote sensing image classification based on rotation forest. IEEE Geosci Remote Sens Lett 11:239–243CrossRef
90.
Zurück zum Zitat Xu L, Krzyzak A, Suen CY (1992) Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Trans Syst Man Cybern 22(3):418–435CrossRef Xu L, Krzyzak A, Suen CY (1992) Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Trans Syst Man Cybern 22(3):418–435CrossRef
91.
Zurück zum Zitat Yang J-M, Kuo B-C, Yu P-T, Chuang C-H (2010) A dynamic subspace method for hyperspectral image classification. IEEE Trans Geosci Remote Sens 48(7):2840–2853CrossRef Yang J-M, Kuo B-C, Yu P-T, Chuang C-H (2010) A dynamic subspace method for hyperspectral image classification. IEEE Trans Geosci Remote Sens 48(7):2840–2853CrossRef
92.
Zurück zum Zitat Zeng H, Triosell HJ (2004) Dimensionality reduction in hyperspectral image classification. In: IEEE International Conference on Image Processing (ICIP), Singapore, 2004, pp 913–916 Zeng H, Triosell HJ (2004) Dimensionality reduction in hyperspectral image classification. In: IEEE International Conference on Image Processing (ICIP), Singapore, 2004, pp 913–916
93.
Zurück zum Zitat Zhang Y (2010) Ten years of technology advancement in remote sensing and the research in the crc-agip lab in gce. Geomatica 64(2):173–189 Zhang Y (2010) Ten years of technology advancement in remote sensing and the research in the crc-agip lab in gce. Geomatica 64(2):173–189
Metadaten
Titel
Rotation-Based Ensemble Classifiers for High-Dimensional Data
verfasst von
Junshi Xia
Jocelyn Chanussot
Peijun Du
Xiyan He
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-05696-8_6