Skip to main content

2016 | OriginalPaper | Buchkapitel

A Manifold Learning Algorithm Based on Incremental Tangent Space Alignment

verfasst von : Chao Tan, Genlin Ji

Erschienen in: Cloud Computing and Security

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Manifold learning is developed to find the observed data’s low dimension embeddings in high dimensional data space. As a type of effective nonlinear dimension reduction method, it has been widely applied to data mining, pattern recognition and machine learning. However, most existing manifold learning algorithms work in a “batch” mode and cannot effectively process data collected sequentially (or data streams). In order to explore the intrinsic low dimensional manifold structures in data streams on-line or incrementally, in this paper we propose a new manifold Learning algorithm based on Incremental Tangent Space Alignment, LITSA for short. By constructing data points’ local tangent spaces to preserve local coordinates incrementally, we can accurately obtain the low dimensional global coordinates. Experiments on both synthetic and real datasets show that the proposed algorithm can achieve a more accurate low-dimensional representation of the data than state-of-the-art incremental algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Tenenbaum, J., Silva, V., Langford, J.: A global geometric framework for nonlinear dimensionality reduction. Science 290, 2319–2323 (2000)CrossRef Tenenbaum, J., Silva, V., Langford, J.: A global geometric framework for nonlinear dimensionality reduction. Science 290, 2319–2323 (2000)CrossRef
2.
Zurück zum Zitat Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 15(6), 1373–1396 (2003)CrossRefMATH Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 15(6), 1373–1396 (2003)CrossRefMATH
3.
Zurück zum Zitat Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323–2326 (2000)CrossRef Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323–2326 (2000)CrossRef
4.
Zurück zum Zitat Zhang, Z.Y., Zha, H.Y.: Principal manifolds and nonlinear dimensionality reduction via tangent space alignment. SIAM J. Sci. Comput. 26, 313–338 (2004)MathSciNetCrossRefMATH Zhang, Z.Y., Zha, H.Y.: Principal manifolds and nonlinear dimensionality reduction via tangent space alignment. SIAM J. Sci. Comput. 26, 313–338 (2004)MathSciNetCrossRefMATH
5.
Zurück zum Zitat Law, M.H.C., Jain, A.K.: Incremental nonlinear dimensionality reduction by manifold learning. IEEE Trans. Pattern Anal. Mach. Intell. 28, 377–391 (2006)CrossRef Law, M.H.C., Jain, A.K.: Incremental nonlinear dimensionality reduction by manifold learning. IEEE Trans. Pattern Anal. Mach. Intell. 28, 377–391 (2006)CrossRef
6.
Zurück zum Zitat Jia, P., Yin, J., et al.: Incremental Laplacian eigenmaps by preserving adjacent information between data points. Pattern Recogn. Lett. 30, 1457–1463 (2009)CrossRef Jia, P., Yin, J., et al.: Incremental Laplacian eigenmaps by preserving adjacent information between data points. Pattern Recogn. Lett. 30, 1457–1463 (2009)CrossRef
7.
Zurück zum Zitat Kouropteva, O., Okun, O., et al.: Incremental locally linear embedding. Pattern Recogn. 38, 1764–1767 (2005)CrossRefMATH Kouropteva, O., Okun, O., et al.: Incremental locally linear embedding. Pattern Recogn. 38, 1764–1767 (2005)CrossRefMATH
8.
Zurück zum Zitat Abdel-Mannan, O., Ben Hamza, A., et al.: Incremental line tangent space alignment algorithm. In: Proceedings of Canadian Conference on Electrical and Computer Engineering (CCECE), pp. 1329–1332. IEEE (2007) Abdel-Mannan, O., Ben Hamza, A., et al.: Incremental line tangent space alignment algorithm. In: Proceedings of Canadian Conference on Electrical and Computer Engineering (CCECE), pp. 1329–1332. IEEE (2007)
9.
Zurück zum Zitat Liu, X., Yin, J., Feng, Z., Dong, J.: Incremental manifold learning via tangent space alignment. In: Schwenker, F., Marinai, S. (eds.) ANNPR 2006. LNCS, vol. 4087, pp. 107–121. Springer, Heidelberg (2006). doi:10.1007/11829898_10 CrossRef Liu, X., Yin, J., Feng, Z., Dong, J.: Incremental manifold learning via tangent space alignment. In: Schwenker, F., Marinai, S. (eds.) ANNPR 2006. LNCS, vol. 4087, pp. 107–121. Springer, Heidelberg (2006). doi:10.​1007/​11829898_​10 CrossRef
10.
Zurück zum Zitat Zhao, D.F., Yang, L.: Incremental isometric embedding of high-dimensional data using connected neighborhood graphs. IEEE Trans. Pattern Anal. Mach. Intell. 31, 86–98 (2009)CrossRef Zhao, D.F., Yang, L.: Incremental isometric embedding of high-dimensional data using connected neighborhood graphs. IEEE Trans. Pattern Anal. Mach. Intell. 31, 86–98 (2009)CrossRef
11.
Zurück zum Zitat Abdel-Mannan, O., Ben Hamza, A., et al.: Incremental Hessian locally linear embedding algorithm. In: Proceedings of 9th International Symposium on Signal Processing and Its Applications (ISSPA), pp. 1–4. IEEE (2007) Abdel-Mannan, O., Ben Hamza, A., et al.: Incremental Hessian locally linear embedding algorithm. In: Proceedings of 9th International Symposium on Signal Processing and Its Applications (ISSPA), pp. 1–4. IEEE (2007)
12.
Zurück zum Zitat Min, W.L., Lu, L., He, X.F.: Locality pursuit embedding. Pattern Recogn. 37(4), 781–788 (2004)CrossRefMATH Min, W.L., Lu, L., He, X.F.: Locality pursuit embedding. Pattern Recogn. 37(4), 781–788 (2004)CrossRefMATH
13.
Zurück zum Zitat Ling, G, Han, P., et al.: Face recognition via semi-supervised discriminant local analysis. In: Proceedings of International Conference on Signal and Image Processing Applications (ICSIPA), pp. 292–297. IEEE (2015) Ling, G, Han, P., et al.: Face recognition via semi-supervised discriminant local analysis. In: Proceedings of International Conference on Signal and Image Processing Applications (ICSIPA), pp. 292–297. IEEE (2015)
14.
Zurück zum Zitat Li, B., Du, J., Zhang, X.: Feature extraction using maximum nonparametric margin projection. Neurocomputing 188, 225–232 (2016)CrossRef Li, B., Du, J., Zhang, X.: Feature extraction using maximum nonparametric margin projection. Neurocomputing 188, 225–232 (2016)CrossRef
15.
Zurück zum Zitat Han, P., Yin, O., Ling, G.: Semi-supervised generic descriptor in face recognition. In: Proceedings of International Colloquium on Signal Processing and Its Applications (CSPA), pp. 21–25. IEEE (2015) Han, P., Yin, O., Ling, G.: Semi-supervised generic descriptor in face recognition. In: Proceedings of International Colloquium on Signal Processing and Its Applications (CSPA), pp. 21–25. IEEE (2015)
16.
Zurück zum Zitat Xu, Y., Huang, H., et al.: Semi-supervised local fisher discriminant analysis for speaker verification. Adv. Inf. Sci. Serv. Sci. 6, 1–11 (2014) Xu, Y., Huang, H., et al.: Semi-supervised local fisher discriminant analysis for speaker verification. Adv. Inf. Sci. Serv. Sci. 6, 1–11 (2014)
17.
Zurück zum Zitat Artac, M., Jogan, M., Leonardis, A.: Incremental PCA for on-line visual learning and recognition. In: Proceedings of International Conference on Pattern Recognition (ICPR), pp. 781–784. IEEE (2002) Artac, M., Jogan, M., Leonardis, A.: Incremental PCA for on-line visual learning and recognition. In: Proceedings of International Conference on Pattern Recognition (ICPR), pp. 781–784. IEEE (2002)
18.
Zurück zum Zitat Zhao, H., Yuen, P.C., Kwok, J.T.: A novel incremental principal component analysis and its application for face recognition. IEEE Trans. Syst. 36(4), 873–886 (2006) Zhao, H., Yuen, P.C., Kwok, J.T.: A novel incremental principal component analysis and its application for face recognition. IEEE Trans. Syst. 36(4), 873–886 (2006)
19.
Zurück zum Zitat Li, Y.M.: On incremental and robust subspace learning. Pattern Recogn. 37(7), 1509–1518 (2004)CrossRefMATH Li, Y.M.: On incremental and robust subspace learning. Pattern Recogn. 37(7), 1509–1518 (2004)CrossRefMATH
20.
Zurück zum Zitat Weng, J.Y., Zhang, Y.L., Hwang, W.S.: Candid covariance-free incremental principal component analysis. IEEE Trans. Pattern Anal. Mach. Intell. 25(8), 1034–1040 (2003)CrossRef Weng, J.Y., Zhang, Y.L., Hwang, W.S.: Candid covariance-free incremental principal component analysis. IEEE Trans. Pattern Anal. Mach. Intell. 25(8), 1034–1040 (2003)CrossRef
21.
Zurück zum Zitat Golub, G.H., Van Loan, C.F.: Matrix Computations. Johns Hopkins University Press, Baltimore (2012)MATH Golub, G.H., Van Loan, C.F.: Matrix Computations. Johns Hopkins University Press, Baltimore (2012)MATH
Metadaten
Titel
A Manifold Learning Algorithm Based on Incremental Tangent Space Alignment
verfasst von
Chao Tan
Genlin Ji
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-48674-1_48