Skip to main content

2018 | OriginalPaper | Buchkapitel

Relative Stability of Random Projection-Based Image Classification

verfasst von : Ewa Skubalska-Rafajłowicz

Erschienen in: Artificial Intelligence and Soft Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Our aim is to show that randomly generated transformation of high-dimensional data vectors, for example, images, could provide low dimensional features which are stable and suitable for classification tasks. We examine two types of projections: (a) global random projections, i.e., projections of the whole images, and (b) concatenated local projections of spatially-organized parts of an image (for example rectangular image blocks). In both cases, the transformed images provide good features for correct classification. The computational complexity of designing the transformation is linear with respect to the size of images and in case (b) it does not depend on the form of image partition. We have analyzed the stability of classification results with respect to random projection and to different randomly generated training sets. Experiments on the images of ten persons taken from the Extended Yale Database B demonstrate that the methods of classification based on Gaussian random projection are effective and positively comparable with PCA-based methods, both from the point of view of stability and classification accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Achlioptas, D.: Database-friendly random projections: Johnson-Lindenstrauss with binary coins. J. Comput. Syst. Sci. 66, 671–687 (2003)MathSciNetCrossRef Achlioptas, D.: Database-friendly random projections: Johnson-Lindenstrauss with binary coins. J. Comput. Syst. Sci. 66, 671–687 (2003)MathSciNetCrossRef
2.
Zurück zum Zitat Ailon, N., Chazelle, B.: The fast Johnson-Lindenstrauss transform and approximate nearest neighbors. SIAM J. Comput. 39(1), 302–322 (2009)MathSciNetCrossRef Ailon, N., Chazelle, B.: The fast Johnson-Lindenstrauss transform and approximate nearest neighbors. SIAM J. Comput. 39(1), 302–322 (2009)MathSciNetCrossRef
3.
Zurück zum Zitat Amador, J.J.: Random projection and orthonormality for lossy image compression. Image Vis. Comput. 25, 754–766 (2007)CrossRef Amador, J.J.: Random projection and orthonormality for lossy image compression. Image Vis. Comput. 25, 754–766 (2007)CrossRef
4.
Zurück zum Zitat Baraniuk, R., Davenport, M., DeVore, R., Wakin, M.: A simple proof of the restricted isometry property for random matrices. Constr. Approx. 28(3), 253–263 (2008)MathSciNetCrossRef Baraniuk, R., Davenport, M., DeVore, R., Wakin, M.: A simple proof of the restricted isometry property for random matrices. Constr. Approx. 28(3), 253–263 (2008)MathSciNetCrossRef
6.
7.
Zurück zum Zitat Briand, B., Ducharme, G.R., Parache, V., Mercat-Rommens, C.: A similarity measure to assess the stability of classification trees. Comput. Stat. Data Anal. 53(4), 1208–1217 (2009)MathSciNetCrossRef Briand, B., Ducharme, G.R., Parache, V., Mercat-Rommens, C.: A similarity measure to assess the stability of classification trees. Comput. Stat. Data Anal. 53(4), 1208–1217 (2009)MathSciNetCrossRef
8.
Zurück zum Zitat Brigham, E., Mannila, H.: Random projection in dimensionality reduction: applications to image and text data. In: Proceedings of the Conference on Knowledge Discovery and Data Mining, vol. 16, pp. 245–250 (2001) Brigham, E., Mannila, H.: Random projection in dimensionality reduction: applications to image and text data. In: Proceedings of the Conference on Knowledge Discovery and Data Mining, vol. 16, pp. 245–250 (2001)
9.
Zurück zum Zitat Fodor, I.K.: A survey of dimension reduction techniques. Technical report, Lawrence Livermore National Lab., CA (US) (2002) Fodor, I.K.: A survey of dimension reduction techniques. Technical report, Lawrence Livermore National Lab., CA (US) (2002)
10.
Zurück zum Zitat Du, Q., Fowler, J.E.: Low-complexity principal component analysis for hyperspectral image compression. Int. J. High Perform. Comput. Appl. 22, 438–448 (2008)CrossRef Du, Q., Fowler, J.E.: Low-complexity principal component analysis for hyperspectral image compression. Int. J. High Perform. Comput. Appl. 22, 438–448 (2008)CrossRef
11.
Zurück zum Zitat Frankl, P., Maehara, H.: Some geometric applications of the beta distribution. Ann. Inst. Stat. Math. 42(3), 463–474 (1990)MathSciNetCrossRef Frankl, P., Maehara, H.: Some geometric applications of the beta distribution. Ann. Inst. Stat. Math. 42(3), 463–474 (1990)MathSciNetCrossRef
12.
Zurück zum Zitat Fowler, J.E., Du, Q.: Anomaly detection and reconstruction from random projections. IEEE Trans. Image Process. 21(1), 184–195 (2012)MathSciNetCrossRef Fowler, J.E., Du, Q.: Anomaly detection and reconstruction from random projections. IEEE Trans. Image Process. 21(1), 184–195 (2012)MathSciNetCrossRef
13.
Zurück zum Zitat Gottmukkal, R., Asari, V.K.: An improved face recognition technique based on modular PCA approach. Pattern Recogn. Lett. 24(4), 429–436 (2004)CrossRef Gottmukkal, R., Asari, V.K.: An improved face recognition technique based on modular PCA approach. Pattern Recogn. Lett. 24(4), 429–436 (2004)CrossRef
14.
Zurück zum Zitat Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 21(6), 643–660 (2001)CrossRef Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 21(6), 643–660 (2001)CrossRef
16.
Zurück zum Zitat Jeong, K., Principe, J.C.: Enhancing the correntropy MACE filter with random projections. Neurocomputing 72(1–2), 102–111 (2008)CrossRef Jeong, K., Principe, J.C.: Enhancing the correntropy MACE filter with random projections. Neurocomputing 72(1–2), 102–111 (2008)CrossRef
18.
Zurück zum Zitat Johnson, W.B., Lindenstrauss, J.: Extensions of Lipshitz mapping into Hilbert space. Contemp. Math. 26, 189–206 (1984)CrossRef Johnson, W.B., Lindenstrauss, J.: Extensions of Lipshitz mapping into Hilbert space. Contemp. Math. 26, 189–206 (1984)CrossRef
19.
Zurück zum Zitat Lee, K.-C., Ho, J., Driegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. 27(5), 684–698 (2005)CrossRef Lee, K.-C., Ho, J., Driegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. 27(5), 684–698 (2005)CrossRef
20.
Zurück zum Zitat Matouŝek, J.: On variants of the Johnson-Lindenstrauss lemma. Random Struct. Algorithms 33(2), 142–156 (2008)MathSciNetCrossRef Matouŝek, J.: On variants of the Johnson-Lindenstrauss lemma. Random Struct. Algorithms 33(2), 142–156 (2008)MathSciNetCrossRef
21.
Zurück zum Zitat Marzetta, T.L., Tucci, G.H., Simon, S.H.: A random matrix-theoretic approach to handling singular covariance estimates. IEEE Trans. Inf. Theory 57, 6256–6271 (2011)MathSciNetCrossRef Marzetta, T.L., Tucci, G.H., Simon, S.H.: A random matrix-theoretic approach to handling singular covariance estimates. IEEE Trans. Inf. Theory 57, 6256–6271 (2011)MathSciNetCrossRef
22.
Zurück zum Zitat Ng, A.Y., Jordan, M.I.: On discriminative vs. generative classifiers: a comparison of logistic regression and Naive Bayes. In: Advances in Neural Information Processing Systems, vol. 14, pp. 841–848 (2002) Ng, A.Y., Jordan, M.I.: On discriminative vs. generative classifiers: a comparison of logistic regression and Naive Bayes. In: Advances in Neural Information Processing Systems, vol. 14, pp. 841–848 (2002)
23.
Zurück zum Zitat Skubalska-Rafajłowicz, E.: Random projections and Hotelling’s T 2 statistics for change detection in high-dimensional data streams. Int. J. Appl. Math. Comput. Sci. 23(2), 447–461 (2013)MathSciNetCrossRef Skubalska-Rafajłowicz, E.: Random projections and Hotelling’s T 2 statistics for change detection in high-dimensional data streams. Int. J. Appl. Math. Comput. Sci. 23(2), 447–461 (2013)MathSciNetCrossRef
24.
Zurück zum Zitat Skubalska-Rafajłowicz, E.: Neural networks with sigmoidal activation functions – dimension reduction using normal random projection. Nonlinear Anal.: Theory Methods Appl. 71(12), e1255–e1263 (2009)CrossRef Skubalska-Rafajłowicz, E.: Neural networks with sigmoidal activation functions – dimension reduction using normal random projection. Nonlinear Anal.: Theory Methods Appl. 71(12), e1255–e1263 (2009)CrossRef
25.
Zurück zum Zitat Skubalska-Rafajłowicz, E.: Spatially-organized random projections of images for dimensionality reduction and privacy-preserving classification. In: Proceedings of 10th International Workshop on Multidimensional (nD) Systems (nDS), pp. 1–5 (2017) Skubalska-Rafajłowicz, E.: Spatially-organized random projections of images for dimensionality reduction and privacy-preserving classification. In: Proceedings of 10th International Workshop on Multidimensional (nD) Systems (nDS), pp. 1–5 (2017)
27.
Zurück zum Zitat Tsagkatakis, G., Savakis, A.: A random projections model for object tracking under variable pose and multi-camera views. In: Proceedings of the Third ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC, pp. 1–7 (2009) Tsagkatakis, G., Savakis, A.: A random projections model for object tracking under variable pose and multi-camera views. In: Proceedings of the Third ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC, pp. 1–7 (2009)
28.
Zurück zum Zitat Turk, M., Pentland, A.: Eigenfaces for recognition. J. Cogn. Neurosci. 3(1), 71–86 (1991)CrossRef Turk, M., Pentland, A.: Eigenfaces for recognition. J. Cogn. Neurosci. 3(1), 71–86 (1991)CrossRef
29.
Zurück zum Zitat Vempala, S.: The Random Projection Method. American Mathematical Society, Providence (2004)MATH Vempala, S.: The Random Projection Method. American Mathematical Society, Providence (2004)MATH
30.
Zurück zum Zitat Yang, J., Zhang, D., Frangi, A.F., Yang, J.: Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 26(1), 131–137 (2004)CrossRef Yang, J., Zhang, D., Frangi, A.F., Yang, J.: Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 26(1), 131–137 (2004)CrossRef
Metadaten
Titel
Relative Stability of Random Projection-Based Image Classification
verfasst von
Ewa Skubalska-Rafajłowicz
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-91253-0_65