Skip to main content
Top

2020 | OriginalPaper | Chapter

A Novel Method to Solve the Separation Problem of LDA

Authors : Meng Zhang, Wei Li, Bo Zhang

Published in: Intelligent Information Processing X

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Linear discriminant analysis (LDA) is one of the most classical linear projection techniques for feature extraction, widely used in kinds of fields. Classical LDA is contributed to finding an optimal projection subspace that can maximize the between-class scatter and minimize the average within-class scatter of each class. However, the class separation problem always exists and classical LDA can not guarantee that the within-class scatter of each class get its minimum. In this paper, we proposed the k-classifiers method, which can reduce every within-class scatter of classes respectively and alleviate the class separation problem. This method will be applied in LDA and Norm LDA and achieve significant improvement. Extensive experiments performed on MNIST data sets demonstrate the effectiveness of k-classifiers.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bian, W., Tao, D.: Max-min distance analysis by using sequential SDP relaxation for dimension reduction. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 1037–1050 (2010)CrossRef Bian, W., Tao, D.: Max-min distance analysis by using sequential SDP relaxation for dimension reduction. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 1037–1050 (2010)CrossRef
2.
go back to reference Fisher, R.A.: The use of multiple measurements in taxonomic problems. Ann. Eugenics 7(2), 179–188 (1936)CrossRef Fisher, R.A.: The use of multiple measurements in taxonomic problems. Ann. Eugenics 7(2), 179–188 (1936)CrossRef
3.
go back to reference Hamsici, O.C., Martinez, A.M.: Bayes optimality in linear discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 30(4), 647–657 (2008)CrossRef Hamsici, O.C., Martinez, A.M.: Bayes optimality in linear discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 30(4), 647–657 (2008)CrossRef
4.
go back to reference LeCun, Y., Cortes, C., Burges, C.: MNIST handwritten digit database (2010) LeCun, Y., Cortes, C., Burges, C.: MNIST handwritten digit database (2010)
5.
go back to reference Loog, M., Duin, R.P.W., Haeb-Umbach, R.: Multiclass linear dimension reduction by weighted pairwise fisher criteria. IEEE Trans. Pattern Anal. Mach. Intell. 23(7), 762–766 (2001)CrossRef Loog, M., Duin, R.P.W., Haeb-Umbach, R.: Multiclass linear dimension reduction by weighted pairwise fisher criteria. IEEE Trans. Pattern Anal. Mach. Intell. 23(7), 762–766 (2001)CrossRef
6.
go back to reference Rao, C.R.: The utilization of multiple measurements in problems of biological classification. J. Roy. Stat. Soc. Ser. B (Methodol.) 10(2), 159–203 (1948) Rao, C.R.: The utilization of multiple measurements in problems of biological classification. J. Roy. Stat. Soc. Ser. B (Methodol.) 10(2), 159–203 (1948)
7.
go back to reference Schervish, M.J.: Linear discrimination for three known normal populations. J. Stat. Plan. Infer. 10(2), 167–175 (1984)MathSciNetCrossRef Schervish, M.J.: Linear discrimination for three known normal populations. J. Stat. Plan. Infer. 10(2), 167–175 (1984)MathSciNetCrossRef
8.
go back to reference Shao, G., Sang, N.: Max-min distance analysis by making a uniform distribution of class centers for dimensionality reduction. Neurocomputing 143, 208–221 (2014)CrossRef Shao, G., Sang, N.: Max-min distance analysis by making a uniform distribution of class centers for dimensionality reduction. Neurocomputing 143, 208–221 (2014)CrossRef
10.
go back to reference Tao, D., Li, X., Wu, X., Maybank, S.J.: Geometric mean for subspace selection. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 260–274 (2008) Tao, D., Li, X., Wu, X., Maybank, S.J.: Geometric mean for subspace selection. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 260–274 (2008)
11.
go back to reference Wang, H., Yan, S., Xu, D., Tang, X., Huang, T.: Trace ratio vs. ratio trace for dimensionality reduction. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2007) Wang, H., Yan, S., Xu, D., Tang, X., Huang, T.: Trace ratio vs. ratio trace for dimensionality reduction. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2007)
12.
go back to reference Yao, C., Cheng, G.: Approximative bayes optimality linear discriminant analysis for Chinese handwriting character recognition. Neurocomputing 207, 346–353 (2016)CrossRef Yao, C., Cheng, G.: Approximative bayes optimality linear discriminant analysis for Chinese handwriting character recognition. Neurocomputing 207, 346–353 (2016)CrossRef
13.
go back to reference Zhang, Y., Yeung, D.Y.: Worst-case linear discriminant analysis. In: Advances in Neural Information Processing Systems, pp. 2568–2576 (2010) Zhang, Y., Yeung, D.Y.: Worst-case linear discriminant analysis. In: Advances in Neural Information Processing Systems, pp. 2568–2576 (2010)
Metadata
Title
A Novel Method to Solve the Separation Problem of LDA
Authors
Meng Zhang
Wei Li
Bo Zhang
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-46931-3_6

Premium Partner