Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 3/2015

01.06.2015 | Original Article

Linear discriminant analysis for the small sample size problem: an overview

verfasst von: Alok Sharma, Kuldip K. Paliwal

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 3/2015

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Dimensionality reduction is an important aspect in the pattern classification literature, and linear discriminant analysis (LDA) is one of the most widely studied dimensionality reduction technique. The application of variants of LDA technique for solving small sample size (SSS) problem can be found in many research areas e.g. face recognition, bioinformatics, text recognition, etc. The improvement of the performance of variants of LDA technique has great potential in various fields of research. In this paper, we present an overview of these methods. We covered the type, characteristics and taxonomy of these methods which can overcome SSS problem. We have also highlighted some important datasets and software/packages.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Fußnoten
1
These four spaces can also be represented in Fig. 2 without performing a preprocessing step. In that case, r t in the figure will be replaced by the dimensionality d and the size of the spaces will change accordingly.
 
2
For this experiment, first we project the original feature vectors onto the range space of \({\mathbf{S}}_{T}\) matrix as a pre-processing step. Then all the spaces are utilized individually to do dimensionality reduction and to classify a test feature vector, the nearest neighbor classifier is used. To obtain performance in terms of average classification accuracy, \(k\)-fold cross-validation process has been applied, where k = 5. The details of the datasets have been given later in Sect. 10.1.
 
3
For more datasets on face see Ralph Gross [19], Zhao et al. [70] and http://​www.​face-rec.​org/​databases/​. For bio-medical data see Kent Ridge Bio-medical Repository (http://​datam.​i2r.​a-star.​edu.​sg/​datasets/​krbd/​).
 
Literatur
1.
Zurück zum Zitat Aas K, Eikvil L (1999) Text categorization: a survey. Norwegian Computing Center Report NR 941 Aas K, Eikvil L (1999) Text categorization: a survey. Norwegian Computing Center Report NR 941
2.
Zurück zum Zitat Alon U, Barkai N, Notterman DA, Gish K, Ybarra S, Mack D, Levine AJ (1999) Broad patterns of gene expression revealed by clustering of tumor and normal colon tissues probed by oligonucleotide arrays. PNAS 96:6745–6750CrossRef Alon U, Barkai N, Notterman DA, Gish K, Ybarra S, Mack D, Levine AJ (1999) Broad patterns of gene expression revealed by clustering of tumor and normal colon tissues probed by oligonucleotide arrays. PNAS 96:6745–6750CrossRef
3.
Zurück zum Zitat Armstrong SA, Staunton JE, Silverman LB, Pieters R, den Boer ML, Minden MD, Sallan SE, Lander ES, Golub TR, Korsemeyer SJ (2002) MLL translocations specify a distinct gene expression profile that distinguishes a unique leukemia. Nat Genet 30:41–47CrossRef Armstrong SA, Staunton JE, Silverman LB, Pieters R, den Boer ML, Minden MD, Sallan SE, Lander ES, Golub TR, Korsemeyer SJ (2002) MLL translocations specify a distinct gene expression profile that distinguishes a unique leukemia. Nat Genet 30:41–47CrossRef
4.
Zurück zum Zitat Beer DG, Kardia SLR, Huang C–C, Giordano TJ, Levin AM, Misek DE, Lin L, Chen G, Gharib TG, Thomas DG, Lizyness ML, Kuick R, Hayasaka S, Taylor JMG, Iannettoni MD, Orringer MB, Hanash S (2002) Gene-expression profiles predict survival of patients with lung adenocarcinoma. Nat Med 8:816–824 Beer DG, Kardia SLR, Huang C–C, Giordano TJ, Levin AM, Misek DE, Lin L, Chen G, Gharib TG, Thomas DG, Lizyness ML, Kuick R, Hayasaka S, Taylor JMG, Iannettoni MD, Orringer MB, Hanash S (2002) Gene-expression profiles predict survival of patients with lung adenocarcinoma. Nat Med 8:816–824
5.
Zurück zum Zitat Belhumeur PN, Hespanhaand JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Machine Intell 19(7):711–720CrossRef Belhumeur PN, Hespanhaand JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Machine Intell 19(7):711–720CrossRef
6.
Zurück zum Zitat Bhattacharjee A, Richards WG, Staunton J, Li C, Monti S, Vasa P, Ladd C, Beheshti J, Bueno R, Gillette M, Loda M, Weber G, Mark EJ, Lander ES, Wong W, Johnson BE, Golub TR, Sugarbaker DJ, Meyerson M (2001) Classification of human lung carcinomas by mRNA expression profiling reveals distinct adenocarcinoma sub-classes. PNAS 98(24):13790–13795CrossRef Bhattacharjee A, Richards WG, Staunton J, Li C, Monti S, Vasa P, Ladd C, Beheshti J, Bueno R, Gillette M, Loda M, Weber G, Mark EJ, Lander ES, Wong W, Johnson BE, Golub TR, Sugarbaker DJ, Meyerson M (2001) Classification of human lung carcinomas by mRNA expression profiling reveals distinct adenocarcinoma sub-classes. PNAS 98(24):13790–13795CrossRef
8.
Zurück zum Zitat Cevikalp H, Neamtu M, Wilkes MA, Barkana A (2005) Discriminative common vectors for face recognition. IEEE Trans Pattern Anal Machine Intell 27(1):4–13CrossRef Cevikalp H, Neamtu M, Wilkes MA, Barkana A (2005) Discriminative common vectors for face recognition. IEEE Trans Pattern Anal Machine Intell 27(1):4–13CrossRef
9.
Zurück zum Zitat Chen L-F, Liao H-YM, Ko M-T, Lin J-C, Yu G-J (2000) A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recogn 33:1713–1726CrossRef Chen L-F, Liao H-YM, Ko M-T, Lin J-C, Yu G-J (2000) A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recogn 33:1713–1726CrossRef
10.
Zurück zum Zitat Chu D, Thye GS (2010) A new and fast implementation for null space based linear discriminant analysis. Pattern Recogn 43:1373–1379CrossRefMATH Chu D, Thye GS (2010) A new and fast implementation for null space based linear discriminant analysis. Pattern Recogn 43:1373–1379CrossRefMATH
11.
Zurück zum Zitat Cui X, Zhao H, Wilson J (2010) Optimized ranking and selection methods for feature selection with application in microarray experiments. J Biopharm Stat 20(2):223–239CrossRefMathSciNet Cui X, Zhao H, Wilson J (2010) Optimized ranking and selection methods for feature selection with application in microarray experiments. J Biopharm Stat 20(2):223–239CrossRefMathSciNet
12.
Zurück zum Zitat Dai DQ, Yuen PC (2007) Face recognition by regularized discriminant analysis. IEEE Trans SMC Part B 37(4):1080–1085 Dai DQ, Yuen PC (2007) Face recognition by regularized discriminant analysis. IEEE Trans SMC Part B 37(4):1080–1085
13.
Zurück zum Zitat Dudoit S, Fridlyand J, Speed TP (2002) Comparison of discrimination methods for the classification of tumors using gene expression data. J Am Stat Assoc 97(457):77–87CrossRefMATHMathSciNet Dudoit S, Fridlyand J, Speed TP (2002) Comparison of discrimination methods for the classification of tumors using gene expression data. J Am Stat Assoc 97(457):77–87CrossRefMATHMathSciNet
14.
Zurück zum Zitat Friedman JH (1989) Regularized discriminant analysis. J Am Stat Assoc 84(405):165–175CrossRef Friedman JH (1989) Regularized discriminant analysis. J Am Stat Assoc 84(405):165–175CrossRef
15.
Zurück zum Zitat Fukunaga K (1990) Introduction to statistical pattern recognition. Academic Press Inc., Hartcourt Brace Jovanovich, San Diego, CA Fukunaga K (1990) Introduction to statistical pattern recognition. Academic Press Inc., Hartcourt Brace Jovanovich, San Diego, CA
16.
Zurück zum Zitat Furey TS, Cristianini N, Duffy N, Bednarski DW, Schummer M, Haussler D (2000) Support vector machine classification and validation of cancer tissue samples using microarray expression data. Bioinformatics 16:906–914CrossRef Furey TS, Cristianini N, Duffy N, Bednarski DW, Schummer M, Haussler D (2000) Support vector machine classification and validation of cancer tissue samples using microarray expression data. Bioinformatics 16:906–914CrossRef
17.
Zurück zum Zitat Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP, Coller H, Loh ML, Downing JR, Caligiuri MA, Bloomfield CD, Lander ES (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286:531–537CrossRef Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP, Coller H, Loh ML, Downing JR, Caligiuri MA, Bloomfield CD, Lander ES (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286:531–537CrossRef
18.
Zurück zum Zitat Gordon GJ, Jensen RV, Hsiao L–L, Gullans SR, Blumenstock JE, Ramaswamy S, Richards WG, Sugarbaker DJ, Bueno R (2002) Translation of microarray data into clinically relevant cancer diagnostic tests using gene expression ratios in lung cancer and mesothelioma. Cancer Res 62:4963–4967 Gordon GJ, Jensen RV, Hsiao L–L, Gullans SR, Blumenstock JE, Ramaswamy S, Richards WG, Sugarbaker DJ, Bueno R (2002) Translation of microarray data into clinically relevant cancer diagnostic tests using gene expression ratios in lung cancer and mesothelioma. Cancer Res 62:4963–4967
19.
Zurück zum Zitat Gross R (2005) Face databases. In: Handbook of face recognition. Springer, New York, pp 301–327CrossRef Gross R (2005) Face databases. In: Handbook of face recognition. Springer, New York, pp 301–327CrossRef
21.
Zurück zum Zitat Huang R, Liu Q, Lu H, Ma S (2002) Solving the small sample size problem of LDA. Proc ICPR 3(2002):29–32 Huang R, Liu Q, Lu H, Ma S (2002) Solving the small sample size problem of LDA. Proc ICPR 3(2002):29–32
22.
Zurück zum Zitat Jiang X, Mandal B, Kot A (2008) Eigenfeature regularization and extraction in face recognition. IEEE Trans Pattern Anal Machine Intell 30(3):383–394CrossRef Jiang X, Mandal B, Kot A (2008) Eigenfeature regularization and extraction in face recognition. IEEE Trans Pattern Anal Machine Intell 30(3):383–394CrossRef
23.
Zurück zum Zitat Khan J, Wei JS, Ringner M, Saal LH, Ladanyi M, Westermann F, Berthold F, Schwab M, Antonescu CR, Peterson C, Meltzer PS (2001) Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural network. Nat Med 7:673–679CrossRef Khan J, Wei JS, Ringner M, Saal LH, Ladanyi M, Westermann F, Berthold F, Schwab M, Antonescu CR, Peterson C, Meltzer PS (2001) Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural network. Nat Med 7:673–679CrossRef
25.
Zurück zum Zitat Li H, Zhang K, Jiang T (2005) Robust and accurate cancer classification with gene expression profiling. In: Proceedings of IEEE Comput. Syst. Bioinform. Conf., pp 310–321 Li H, Zhang K, Jiang T (2005) Robust and accurate cancer classification with gene expression profiling. In: Proceedings of IEEE Comput. Syst. Bioinform. Conf., pp 310–321
26.
Zurück zum Zitat Li H, Jiang T, Zhang K (2003) Efficient and robust feature extraction by maximum margin criterion. In: Advances in neural information processing systems Li H, Jiang T, Zhang K (2003) Efficient and robust feature extraction by maximum margin criterion. In: Advances in neural information processing systems
27.
Zurück zum Zitat Liu J, Chen SC, Tan XY (2007) Efficient pseudo-inverse linear discriminant analysis and its nonlinear form for face recognition. Int J Pattern Recogn Artif Intell 21(8):1265–1278CrossRef Liu J, Chen SC, Tan XY (2007) Efficient pseudo-inverse linear discriminant analysis and its nonlinear form for face recognition. Int J Pattern Recogn Artif Intell 21(8):1265–1278CrossRef
28.
Zurück zum Zitat Lu J, Plataniotis K, Venetsanopoulos A (2003) Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans Neural Netw 14(1):117–126CrossRef Lu J, Plataniotis K, Venetsanopoulos A (2003) Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans Neural Netw 14(1):117–126CrossRef
29.
Zurück zum Zitat Lu J, Plataniotis KN, Venetsanopoulos AN (2003) Regularized discriminant analysis for the small sample. Pattern Recogn Lett 24:3079–3087CrossRef Lu J, Plataniotis KN, Venetsanopoulos AN (2003) Regularized discriminant analysis for the small sample. Pattern Recogn Lett 24:3079–3087CrossRef
30.
Zurück zum Zitat Lu J, Plataniotis KN, Venetsanopoulos AN (2005) Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition. Pattern Recogn Lett 26(2):181–191CrossRef Lu J, Plataniotis KN, Venetsanopoulos AN (2005) Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition. Pattern Recogn Lett 26(2):181–191CrossRef
31.
Zurück zum Zitat Mak MW, Kung SY (2006) A solution to the curse of dimensionality problem in pairwise scoring techniques. In: Int. Conf. on Neural Info. Process. (ICONIP’06), pp 314–323 Mak MW, Kung SY (2006) A solution to the curse of dimensionality problem in pairwise scoring techniques. In: Int. Conf. on Neural Info. Process. (ICONIP’06), pp 314–323
32.
Zurück zum Zitat Martinez AM (2002) Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans Pattern Anal Machine Intell 24(6):748–763CrossRef Martinez AM (2002) Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans Pattern Anal Machine Intell 24(6):748–763CrossRef
33.
Zurück zum Zitat Moghaddam B, Weiss Y, Avidan S (2006) Generalized spectral bounds for sparse LDA. In: Int. Conf. Mach. Learn., ICML’06, pp 641–648 Moghaddam B, Weiss Y, Avidan S (2006) Generalized spectral bounds for sparse LDA. In: Int. Conf. Mach. Learn., ICML’06, pp 641–648
34.
Zurück zum Zitat Paliwal KK, Sharma A (2012) Improved pseudoinverse linear discriminant analysis method for dimensionality reduction. Int J Pattern Recogn Artif Intell 26(1):1250002-1–1250002-9MathSciNet Paliwal KK, Sharma A (2012) Improved pseudoinverse linear discriminant analysis method for dimensionality reduction. Int J Pattern Recogn Artif Intell 26(1):1250002-1–1250002-9MathSciNet
35.
Zurück zum Zitat Paliwal KK, Sharma A (2011) Approximate LDA technique for dimensionality reduction in the small sample size case. J Pattern Recogn Res 6(2):298–306CrossRef Paliwal KK, Sharma A (2011) Approximate LDA technique for dimensionality reduction in the small sample size case. J Pattern Recogn Res 6(2):298–306CrossRef
36.
Zurück zum Zitat Paliwal KK, Sharma A (2010) Improved direct LDA and its application to DNA microarray gene expression data. Pattern Recogn Lett 31:2489–2492CrossRef Paliwal KK, Sharma A (2010) Improved direct LDA and its application to DNA microarray gene expression data. Pattern Recogn Lett 31:2489–2492CrossRef
37.
Zurück zum Zitat Petricoin EF III, Ardekani AM, Hitt BA, Levine PJ, Fusaro VA, Steinberg MS, Mills GB, Simone C, Fishman DA, Kohn EC, Liotta LA (2002) Use of proteomic patterns in serum to identify ovarian cancer. Lancet 359:572–577CrossRef Petricoin EF III, Ardekani AM, Hitt BA, Levine PJ, Fusaro VA, Steinberg MS, Mills GB, Simone C, Fishman DA, Kohn EC, Liotta LA (2002) Use of proteomic patterns in serum to identify ovarian cancer. Lancet 359:572–577CrossRef
38.
Zurück zum Zitat Phillips PJ, Moon H, Rauss PJ, Rizvi S (2000) The FERET evaluation methodology for face recognition algorithms. IEEE Trans Pattern Anal Mach Intell 22(10):1090–1104CrossRef Phillips PJ, Moon H, Rauss PJ, Rizvi S (2000) The FERET evaluation methodology for face recognition algorithms. IEEE Trans Pattern Anal Mach Intell 22(10):1090–1104CrossRef
39.
Zurück zum Zitat Pomeroy SL, Tamayo P, Gaasenbeek M, Sturla LM, Angelo M, McLaughlin ME, Kim JYH, Goumnerova LC, Black PM, Lau C, Allen JC, Zagzag D, Olson JM, Curran T, Wetmore C, Biegel JA, Poggio T, Mukherjee S, Rifkin R, Califano A, Stolovitzky G, Louis DN, Mesirov JP, Lander ES, Golub TR (2002) Gene expression-based classification and outcome prediction of central nervous system embryonal tumors. Nature 415:436–442CrossRef Pomeroy SL, Tamayo P, Gaasenbeek M, Sturla LM, Angelo M, McLaughlin ME, Kim JYH, Goumnerova LC, Black PM, Lau C, Allen JC, Zagzag D, Olson JM, Curran T, Wetmore C, Biegel JA, Poggio T, Mukherjee S, Rifkin R, Califano A, Stolovitzky G, Louis DN, Mesirov JP, Lander ES, Golub TR (2002) Gene expression-based classification and outcome prediction of central nervous system embryonal tumors. Nature 415:436–442CrossRef
40.
Zurück zum Zitat Ramaswamy S, Tamayo P, Rifkin R, Mukherjee S, Yeang C-H, Angelo M, Ladd C, Reich M, Latulippe E, Mesirov JP, Poggio T, Gerald W, Loda M, Lander ES, Golub TR (2001) Multiclass cancer diagnosis using tumor gene expression signatures. Proc Natl Acad Sci USA 98(26):15149–15154CrossRef Ramaswamy S, Tamayo P, Rifkin R, Mukherjee S, Yeang C-H, Angelo M, Ladd C, Reich M, Latulippe E, Mesirov JP, Poggio T, Gerald W, Loda M, Lander ES, Golub TR (2001) Multiclass cancer diagnosis using tumor gene expression signatures. Proc Natl Acad Sci USA 98(26):15149–15154CrossRef
41.
Zurück zum Zitat Samaria F, Harter A (1994) Parameterization of a stochastic model for human face identification. In: Proceedings of the Second IEEE Workshop Appl. of Comp. Vis., pp 138–142 Samaria F, Harter A (1994) Parameterization of a stochastic model for human face identification. In: Proceedings of the Second IEEE Workshop Appl. of Comp. Vis., pp 138–142
42.
Zurück zum Zitat Sanderson C, Paliwal KK (2003) Fast features for face authentication under illumination direction changes. Pattern Recogn Lett 24:2409–2419CrossRef Sanderson C, Paliwal KK (2003) Fast features for face authentication under illumination direction changes. Pattern Recogn Lett 24:2409–2419CrossRef
43.
Zurück zum Zitat Sharma A, Paliwal KK (2006) Class-dependent PCA, LDA and MDC: a combined classifier for pattern classification. Pattern Recogn 39(7):1215–1229CrossRefMATH Sharma A, Paliwal KK (2006) Class-dependent PCA, LDA and MDC: a combined classifier for pattern classification. Pattern Recogn 39(7):1215–1229CrossRefMATH
44.
Zurück zum Zitat Sharma A, Paliwal KK (2007) Fast principal component analysis using fixed-point algorithm. Pattern Recogn Lett 28(10):1151–1155CrossRef Sharma A, Paliwal KK (2007) Fast principal component analysis using fixed-point algorithm. Pattern Recogn Lett 28(10):1151–1155CrossRef
45.
Zurück zum Zitat Sharma A, Paliwal KK (2008) Cancer classification by gradient LDA technique using microarray gene expression data. Data Knowl Eng 66(2):338–347CrossRef Sharma A, Paliwal KK (2008) Cancer classification by gradient LDA technique using microarray gene expression data. Data Knowl Eng 66(2):338–347CrossRef
46.
Zurück zum Zitat Sharma A, Paliwal KK (2008) Rotational linear discriminant analysis technique for dimensionality reduction. IEEE Trans Knowl Data Eng 20(10):1336–1347CrossRef Sharma A, Paliwal KK (2008) Rotational linear discriminant analysis technique for dimensionality reduction. IEEE Trans Knowl Data Eng 20(10):1336–1347CrossRef
47.
Zurück zum Zitat Sharma A, Paliwal KK (2010) Regularisation of eigenfeatures by extrapolation of scatter-matrix in face-recognition problem. Electron Lett IEEE 46(10):450–475CrossRef Sharma A, Paliwal KK (2010) Regularisation of eigenfeatures by extrapolation of scatter-matrix in face-recognition problem. Electron Lett IEEE 46(10):450–475CrossRef
48.
49.
Zurück zum Zitat Sharma A, Paliwal KK (2012) A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices. Pattern Recogn 45:2205–2213CrossRefMATH Sharma A, Paliwal KK (2012) A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices. Pattern Recogn 45:2205–2213CrossRefMATH
50.
Zurück zum Zitat Sharma A, Paliwal KK (2012) A two-stage linear discriminant analysis for face-recognition. Pattern Recogn Lett 33:1157–1162CrossRef Sharma A, Paliwal KK (2012) A two-stage linear discriminant analysis for face-recognition. Pattern Recogn Lett 33:1157–1162CrossRef
51.
Zurück zum Zitat Sharma A, Imoto S, Miyano S (2012) A top-r feature selection algorithm for microarray gene expression data. IEEE/ACM Trans Comput Biol Bioinf 9(3):754–764CrossRef Sharma A, Imoto S, Miyano S (2012) A top-r feature selection algorithm for microarray gene expression data. IEEE/ACM Trans Comput Biol Bioinf 9(3):754–764CrossRef
52.
Zurück zum Zitat Sharma A, Imoto S, Miyano S (2012) A between-class overlapping filter-based method for transcriptome data analysis. J Bioinf Comput Biol 10(5):1250010-1–1250010-20CrossRef Sharma A, Imoto S, Miyano S (2012) A between-class overlapping filter-based method for transcriptome data analysis. J Bioinf Comput Biol 10(5):1250010-1–1250010-20CrossRef
53.
Zurück zum Zitat Sharma A, Imoto S, Miyano S (2012) A filter based feature selection algorithm using null space of covariance matrix for DNA microarray gene expression data. Curr Bioinf 7(3):6CrossRef Sharma A, Imoto S, Miyano S (2012) A filter based feature selection algorithm using null space of covariance matrix for DNA microarray gene expression data. Curr Bioinf 7(3):6CrossRef
54.
Zurück zum Zitat Sharma A, Paliwal KK, Imoto S, Miyano S (2013) A feature selection method using improved regularized linear discriminant analysis. Mach Vis Appl. doi:10.1007/s00138-013-0577-y Sharma A, Paliwal KK, Imoto S, Miyano S (2013) A feature selection method using improved regularized linear discriminant analysis. Mach Vis Appl. doi:10.​1007/​s00138-013-0577-y
55.
Zurück zum Zitat Singh D, Febbo PG, Ross K, Jackson DG, Manola J, Ladd C, Tamayo P, Renshaw AA, D’Amico AV, Richie JP, Lander ES, Loda M, Kantoff PW, Golub TR, Sellers WR (2002) Gene expression correlates of clinical prostate cancer behavior. Cancer Cell 1:203–209CrossRef Singh D, Febbo PG, Ross K, Jackson DG, Manola J, Ladd C, Tamayo P, Renshaw AA, D’Amico AV, Richie JP, Lander ES, Loda M, Kantoff PW, Golub TR, Sellers WR (2002) Gene expression correlates of clinical prostate cancer behavior. Cancer Cell 1:203–209CrossRef
56.
Zurück zum Zitat Song F, Zhang D, Wang J, Liu H, Tao Q (2007) A parameterized direct LDA and its application to face recognition. Neurocomputing 71:191–196CrossRef Song F, Zhang D, Wang J, Liu H, Tao Q (2007) A parameterized direct LDA and its application to face recognition. Neurocomputing 71:191–196CrossRef
57.
Zurück zum Zitat Swets DL, Weng J (1996) Using discriminative eigenfeatures for image retrieval. IEEE Trans Pattern Anal Mach Intell 18(8):831–836CrossRef Swets DL, Weng J (1996) Using discriminative eigenfeatures for image retrieval. IEEE Trans Pattern Anal Mach Intell 18(8):831–836CrossRef
58.
Zurück zum Zitat Thomaz CE, Kitani EC, Gillies DF (2005) A maximum uncertainty LDA-based approach for limited sample size problems with application to face recognition. In: Proceedings of 18th Brazilian Symp. On Computer Graphics and Image Processing, (IEEE CS Press), pp 89–96 Thomaz CE, Kitani EC, Gillies DF (2005) A maximum uncertainty LDA-based approach for limited sample size problems with application to face recognition. In: Proceedings of 18th Brazilian Symp. On Computer Graphics and Image Processing, (IEEE CS Press), pp 89–96
59.
Zurück zum Zitat Tian Q, Barbero M, Gu ZH, Lee SH (1986) Image classification by the Foley-Sammon transform. Opt Eng 25(7):834–840CrossRef Tian Q, Barbero M, Gu ZH, Lee SH (1986) Image classification by the Foley-Sammon transform. Opt Eng 25(7):834–840CrossRef
60.
Zurück zum Zitat van’t Veer LJ, Dai H, van de Vijver MJ, He YD, Hart AMH, Mao M, Peterse HL, van der Kooy K, Marton MJ, Witteveen AT, Schreiber GJ, Kerkhoven RM, Roberts C, Linsley PS, Bernards R, Friend SH (2002) Gene expression profiling predicts clinical outcome of breast cancer. Lett Nat Nat 415:530–536CrossRef van’t Veer LJ, Dai H, van de Vijver MJ, He YD, Hart AMH, Mao M, Peterse HL, van der Kooy K, Marton MJ, Witteveen AT, Schreiber GJ, Kerkhoven RM, Roberts C, Linsley PS, Bernards R, Friend SH (2002) Gene expression profiling predicts clinical outcome of breast cancer. Lett Nat Nat 415:530–536CrossRef
62.
Zurück zum Zitat Ye J (2005) Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems. J Mach Learn Res 6:483–502MATHMathSciNet Ye J (2005) Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems. J Mach Learn Res 6:483–502MATHMathSciNet
63.
Zurück zum Zitat Ye J, Janardan R, Li Q, Park H (2004) Feature extraction via generalized uncorrelated linear discriminant analysis. In: The Twenty-First International Conference on Machine Learning, pp 895–902 Ye J, Janardan R, Li Q, Park H (2004) Feature extraction via generalized uncorrelated linear discriminant analysis. In: The Twenty-First International Conference on Machine Learning, pp 895–902
64.
Zurück zum Zitat Ye J, Li Q (2005) A two-stage linear discriminant analysis via QR-decomposition. IEEE Trans Pattern Anal Mach Intell 27(6):929–941CrossRef Ye J, Li Q (2005) A two-stage linear discriminant analysis via QR-decomposition. IEEE Trans Pattern Anal Mach Intell 27(6):929–941CrossRef
65.
Zurück zum Zitat Ye J, Xiong T (2006) Computational and theoretical analysis of null space and orthogonal linear discriminant analysis. J Mach Learn Res 7:1183–1204MATHMathSciNet Ye J, Xiong T (2006) Computational and theoretical analysis of null space and orthogonal linear discriminant analysis. J Mach Learn Res 7:1183–1204MATHMathSciNet
66.
Zurück zum Zitat Yeoh EJ, Ross ME, Shurtleff SA, Williams WK, Patel D, Mahfouz R, Behm FG, Raimondi SC, Relling MV, Patel A, Cheng C, Campana D, Wilkins D, Zhou X, Li J, Liu H, Pui CH, Evans WE, Naeve C, Wong L, Downing JR (2002) Classification, subtype discovery, and prediction of outcome in pediatric acute lymphoblastic leukemia by gene expression profiling. Cancer 1(2):133–143 Yeoh EJ, Ross ME, Shurtleff SA, Williams WK, Patel D, Mahfouz R, Behm FG, Raimondi SC, Relling MV, Patel A, Cheng C, Campana D, Wilkins D, Zhou X, Li J, Liu H, Pui CH, Evans WE, Naeve C, Wong L, Downing JR (2002) Classification, subtype discovery, and prediction of outcome in pediatric acute lymphoblastic leukemia by gene expression profiling. Cancer 1(2):133–143
67.
Zurück zum Zitat Yu H, Yang J (2001) A direct LDA algorithm for high-dimensional data-with application to face recognition. Pattern Recogn 34:2067–2070CrossRefMATH Yu H, Yang J (2001) A direct LDA algorithm for high-dimensional data-with application to face recognition. Pattern Recogn 34:2067–2070CrossRefMATH
68.
Zurück zum Zitat Zhao W, Chellappa R, Krishnaswamy A (1998) Discriminant analysis of principal components for face recognition. In: Proceedings of Thir Int. Conf. on Automatic Face and Gesture Recognition, Nara, Japan, pp 336–341 Zhao W, Chellappa R, Krishnaswamy A (1998) Discriminant analysis of principal components for face recognition. In: Proceedings of Thir Int. Conf. on Automatic Face and Gesture Recognition, Nara, Japan, pp 336–341
69.
Zurück zum Zitat Zhao W, Chellappa R, Phillips PJ (1999) Subspace linear discriminant analysis for face recognition, Technical Report CAR-TR-914, CS-TR-4009. University of Maryland at College Park, USA Zhao W, Chellappa R, Phillips PJ (1999) Subspace linear discriminant analysis for face recognition, Technical Report CAR-TR-914, CS-TR-4009. University of Maryland at College Park, USA
70.
Zurück zum Zitat Zhao W, Chellappa R, Phillips PJ (2003) Face recognition: a literature survey. ACM Comput Surv 35(4):399–458CrossRef Zhao W, Chellappa R, Phillips PJ (2003) Face recognition: a literature survey. ACM Comput Surv 35(4):399–458CrossRef
Metadaten
Titel
Linear discriminant analysis for the small sample size problem: an overview
verfasst von
Alok Sharma
Kuldip K. Paliwal
Publikationsdatum
01.06.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 3/2015
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-013-0226-9

Weitere Artikel der Ausgabe 3/2015

International Journal of Machine Learning and Cybernetics 3/2015 Zur Ausgabe