Skip to main content
Top
Published in: Pattern Analysis and Applications 4/2019

04-08-2018 | Theoretical Advances

L1-norm orthogonal neighbourhood preserving projection and its applications

Authors: Purvi A. Koringa, Suman K. Mitra

Published in: Pattern Analysis and Applications | Issue 4/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Dimensionality reduction techniques based on manifold learning are becoming very popular for computer vision tasks like image recognition and image classification. Generally, most of these techniques involve optimizing a cost function in L2-norm and thus they are susceptible to outliers. However, recently, due to capability of handling outliers, L1-norm optimization is drawing the attention of researchers. The work documented here is the first attempt towards the same goal where orthogonal neighbourhood preserving projection (ONPP) technique is performed using optimization in terms of L1-norm to handle data having outliers. In particular, the relationship between ONPP and PCA is established theoretically in the light of L2-norm and then ONPP is optimized using an already proposed mechanism of PCA-L1. Extensive experiments are performed on synthetic as well as real data for applications like classification and recognition. It has been observed that when larger number of training data is available L1-ONPP outperforms its counterpart L2-ONPP.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Baccini A, Besse P, De Falguerolles A (1996) A L1-norm PCA and a heuristic approach. Ordinal Symb Data Anal 1:359–368CrossRefMATH Baccini A, Besse P, De Falguerolles A (1996) A L1-norm PCA and a heuristic approach. Ordinal Symb Data Anal 1:359–368CrossRefMATH
2.
go back to reference Bhattacharya U, Chaudhuri B (2005) Databases for research on recognition of handwritten characters of indian scripts. In: Proceedings eighth international conference on document analysis and recognition, 2005. IEEE, pp 789–793 Bhattacharya U, Chaudhuri B (2005) Databases for research on recognition of handwritten characters of indian scripts. In: Proceedings eighth international conference on document analysis and recognition, 2005. IEEE, pp 789–793
3.
go back to reference Ding C, Zhou D, He X, Zha H (2006) R1-PCA: rotational invariant l 1-norm principal component analysis for robust subspace factorization. In: Proceedings of the 23rd international conference on machine learning, pp 281–288 Ding C, Zhou D, He X, Zha H (2006) R1-PCA: rotational invariant l 1-norm principal component analysis for robust subspace factorization. In: Proceedings of the 23rd international conference on machine learning, pp 281–288
5.
go back to reference Goswami MM, Mitra SK (2015) Offline handwritten gujarati numeral recognition using low-level strokes. Int J Appl Pattern Recognit 2(4):353–379CrossRef Goswami MM, Mitra SK (2015) Offline handwritten gujarati numeral recognition using low-level strokes. Int J Appl Pattern Recognit 2(4):353–379CrossRef
6.
go back to reference He X, Niyogi P (2004) Locality preserving projections. Adv Neural Inf Process Syst 16:153–160 He X, Niyogi P (2004) Locality preserving projections. Adv Neural Inf Process Syst 16:153–160
7.
go back to reference He X, Cai D, Yan S, Zhang HJ (2005) Neighborhood preserving embedding. In: Tenth IEEE international conference on computer vision, ICCV 2005, vol 2. IEEE, pp 1208–1213 He X, Cai D, Yan S, Zhang HJ (2005) Neighborhood preserving embedding. In: Tenth IEEE international conference on computer vision, ICCV 2005, vol 2. IEEE, pp 1208–1213
8.
go back to reference Ke Q, Kanade T (2005a) Robust L1 norm factorization in the presence of outliers and missing data by alternative convex programming. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 1, pp 739–746 Ke Q, Kanade T (2005a) Robust L1 norm factorization in the presence of outliers and missing data by alternative convex programming. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 1, pp 739–746
9.
go back to reference Ke Q, Kanade T (2005b) Robust L1 norm factorization in the presence of outliers and missing data by alternative convex programming. In: IEEE computer society conference on computer vision and pattern recognition, 2005. CVPR 2005, vol 1. IEEE, pp 739–746 Ke Q, Kanade T (2005b) Robust L1 norm factorization in the presence of outliers and missing data by alternative convex programming. In: IEEE computer society conference on computer vision and pattern recognition, 2005. CVPR 2005, vol 1. IEEE, pp 739–746
10.
go back to reference Kokiopoulou E, Saad Y (2007) Orthogonal neighborhood preserving projections: a projection-based dimensionality reduction technique. IEEE Trans Pattern Anal Mach Intell 29(12):2143–2156CrossRef Kokiopoulou E, Saad Y (2007) Orthogonal neighborhood preserving projections: a projection-based dimensionality reduction technique. IEEE Trans Pattern Anal Mach Intell 29(12):2143–2156CrossRef
11.
go back to reference Koringa P, Shikkenawis G, Mitra SK, Parulkar S (2015) Modified orthogonal neighborhood preserving projection for face recognition. In: Kryszkiewicz M, Bandyopadhyay S, Rybinski H, Pal SK (eds) Pattern recognition and machine intelligence. Springer, Berlin, pp 225–235CrossRef Koringa P, Shikkenawis G, Mitra SK, Parulkar S (2015) Modified orthogonal neighborhood preserving projection for face recognition. In: Kryszkiewicz M, Bandyopadhyay S, Rybinski H, Pal SK (eds) Pattern recognition and machine intelligence. Springer, Berlin, pp 225–235CrossRef
12.
go back to reference Kwak N (2008) Principal component analysis based on L1-norm maximization. IEEE Trans Pattern Anal Mach Intell 30(9):1672–1680CrossRef Kwak N (2008) Principal component analysis based on L1-norm maximization. IEEE Trans Pattern Anal Mach Intell 30(9):1672–1680CrossRef
14.
go back to reference Li M, Yuan B (2005) 2D-LDA: a statistical linear discriminant analysis for image matrix. Pattern Recognit Lett 26(5):527–532CrossRef Li M, Yuan B (2005) 2D-LDA: a statistical linear discriminant analysis for image matrix. Pattern Recognit Lett 26(5):527–532CrossRef
15.
go back to reference Li X, Pang Y, Yuan Y (2010a) L1-norm-based 2DPCA. IEEE Trans Syst Man Cybern Part B (Cybern) 40(4):1170–1175CrossRef Li X, Pang Y, Yuan Y (2010a) L1-norm-based 2DPCA. IEEE Trans Syst Man Cybern Part B (Cybern) 40(4):1170–1175CrossRef
16.
go back to reference Li X, Pang Y, Yuan Y (2010b) L1-norm-based 2DPCA. IEEE Trans Syst Man Cybern Part B (Cybern) 40(4):1170–1175CrossRef Li X, Pang Y, Yuan Y (2010b) L1-norm-based 2DPCA. IEEE Trans Syst Man Cybern Part B (Cybern) 40(4):1170–1175CrossRef
17.
go back to reference Lu J, Plataniotis KN, Venetsanopoulos AN (2003) Face recognition using LDA-based algorithms. IEEE Trans Neural Netw 14(1):195–200CrossRef Lu J, Plataniotis KN, Venetsanopoulos AN (2003) Face recognition using LDA-based algorithms. IEEE Trans Neural Netw 14(1):195–200CrossRef
18.
go back to reference Nagar R, Mitra SK (2015) Feature extraction based on stroke orientation estimation technique for handwritten numeral. In: 2015 eighth international conference on advances in pattern recognition (ICAPR), pp 1–6 Nagar R, Mitra SK (2015) Feature extraction based on stroke orientation estimation technique for handwritten numeral. In: 2015 eighth international conference on advances in pattern recognition (ICAPR), pp 1–6
19.
go back to reference Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
20.
go back to reference Shikkenawis G, Mitra SK (2012) Improving the locality preserving projection for dimensionality reduction. In: Third international conference on emerging applications of information technology (EAIT), 2012. IEEE, pp 161–164 Shikkenawis G, Mitra SK (2012) Improving the locality preserving projection for dimensionality reduction. In: Third international conference on emerging applications of information technology (EAIT), 2012. IEEE, pp 161–164
21.
go back to reference Turk M, Pentland A (1991) Eigenfaces for recognition. J Cognit Neurosci 3(1):71–86CrossRef Turk M, Pentland A (1991) Eigenfaces for recognition. J Cognit Neurosci 3(1):71–86CrossRef
23.
go back to reference Zhang D, Zhou ZH (2005) (2D) 2PCA: two-directional two-dimensional pca for efficient face representation and recognition. Neurocomputing 69(1):224–231CrossRef Zhang D, Zhou ZH (2005) (2D) 2PCA: two-directional two-dimensional pca for efficient face representation and recognition. Neurocomputing 69(1):224–231CrossRef
24.
go back to reference Zhang H, Wu QJ, Chow TW, Zhao M (2012) A two-dimensional neighborhood preserving projection for appearance-based face recognition. Pattern Recognit 45(5):1866–1876CrossRefMATH Zhang H, Wu QJ, Chow TW, Zhao M (2012) A two-dimensional neighborhood preserving projection for appearance-based face recognition. Pattern Recognit 45(5):1866–1876CrossRefMATH
25.
Metadata
Title
L1-norm orthogonal neighbourhood preserving projection and its applications
Authors
Purvi A. Koringa
Suman K. Mitra
Publication date
04-08-2018
Publisher
Springer London
Published in
Pattern Analysis and Applications / Issue 4/2019
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-018-0745-9

Other articles of this Issue 4/2019

Pattern Analysis and Applications 4/2019 Go to the issue

Premium Partner