Skip to main content
Erschienen in:
Buchtitelbild

2014 | OriginalPaper | Buchkapitel

4. Intrinsic Dimensionality

verfasst von : Harry Strange, Reyer Zwiggelaar

Erschienen in: Open Problems in Spectral Dimensionality Reduction

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this chapter, various approaches are considered to estimate the intrinsic dimensionality of datasets. These approaches look at the spectrum of eigenvalues and also local and global aspects of the data. In addition, limitations of existing dimensionality reduction approaches are discussed, especially with respect to the range of possible embedding dimensions and reduced performance at higher embedding dimensionalities.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Nene, S.A., Nayar, S.K., Murase, H.: Columbia Object Image Library (COIL-20). Tech. rep., Technical Report CUCS-005-96. (1996) Nene, S.A., Nayar, S.K., Murase, H.: Columbia Object Image Library (COIL-20). Tech. rep., Technical Report CUCS-005-96. (1996)
2.
Zurück zum Zitat Strange, H., Zwiggelaar, R.: Classification performance related to intrinsic dimensionality in mammographic image analysis. In: Proceedings of the Thirteenth Annual Conference on Medical Image Understanding and Analysis, pp. 219–223 (2009) Strange, H., Zwiggelaar, R.: Classification performance related to intrinsic dimensionality in mammographic image analysis. In: Proceedings of the Thirteenth Annual Conference on Medical Image Understanding and Analysis, pp. 219–223 (2009)
3.
Zurück zum Zitat Joliffe, I.T.: Principal Component Analysis. Springer-Verlag, New York (1986) Joliffe, I.T.: Principal Component Analysis. Springer-Verlag, New York (1986)
4.
Zurück zum Zitat Xiao, L., Sun, J., Boyd, S.: A duality view of spectral methods for dimensionality reduction. In: Proceedings of the twenty-third International Conference on Machine Learning (ICML), pp. 1041–1048 (2006) Xiao, L., Sun, J., Boyd, S.: A duality view of spectral methods for dimensionality reduction. In: Proceedings of the twenty-third International Conference on Machine Learning (ICML), pp. 1041–1048 (2006)
5.
Zurück zum Zitat Perona, P., Polito, M.: Grouping and dimensionality reduction by locally linear embedding. In: Advances in Neural Information Processing Systems 14: Proceedings of the 2002 Conference (NIPS), pp. 1255–1262 (2002) Perona, P., Polito, M.: Grouping and dimensionality reduction by locally linear embedding. In: Advances in Neural Information Processing Systems 14: Proceedings of the 2002 Conference (NIPS), pp. 1255–1262 (2002)
6.
Zurück zum Zitat Saul, L.K., Roweis, S.: Think globally, fit locally: Unsupervised learning of low dimensional manifolds. Journal of Machine Learning Research 4, 119–155 (2003) Saul, L.K., Roweis, S.: Think globally, fit locally: Unsupervised learning of low dimensional manifolds. Journal of Machine Learning Research 4, 119–155 (2003)
7.
Zurück zum Zitat Eckmann, J.P., Ruelle, D.: Ergodic theory of chaos and strange attractors. Reviews of Modern Physics 57, 617–659 (1985) Eckmann, J.P., Ruelle, D.: Ergodic theory of chaos and strange attractors. Reviews of Modern Physics 57, 617–659 (1985)
8.
Zurück zum Zitat Mo, D., Huang, S.H.: Fractal-Based intrinsic dimension estiation and its application in dimensionality reduction. IEEE Transactions on Knowledge and Data Engineering 24(1), 59–71 (2012) Mo, D., Huang, S.H.: Fractal-Based intrinsic dimension estiation and its application in dimensionality reduction. IEEE Transactions on Knowledge and Data Engineering 24(1), 59–71 (2012)
9.
Zurück zum Zitat Grassberger, P.: An optimized box-assisted algorithm for fractal dimension. Physics Letters A 148, 63–68 (1990) Grassberger, P.: An optimized box-assisted algorithm for fractal dimension. Physics Letters A 148, 63–68 (1990)
10.
Zurück zum Zitat Kégl, B.: Intrinsic dimension estimation using packing numbers. In: Advances in Neural Information Processing Systems 14: Proceedings of the 2002 Conference (NIPS), pp. 681–688 (2002) Kégl, B.: Intrinsic dimension estimation using packing numbers. In: Advances in Neural Information Processing Systems 14: Proceedings of the 2002 Conference (NIPS), pp. 681–688 (2002)
11.
Zurück zum Zitat Grassberger, P., Procaccia, I.: Measuring the strangeness of strange attractors. Physica D 9(189), 189–208 (1983) Grassberger, P., Procaccia, I.: Measuring the strangeness of strange attractors. Physica D 9(189), 189–208 (1983)
12.
Zurück zum Zitat Camastra, F.: Data dimensionality estimation methods: A survey. Pattern Recognition 36, 2945–2954 (2003) Camastra, F.: Data dimensionality estimation methods: A survey. Pattern Recognition 36, 2945–2954 (2003)
13.
Zurück zum Zitat Eckmann, J.P., Ruelle, D.: Fundamental limitations for estimating dimensions and lyapounov exponents in dynamical systems. Physica D 56, 185–187 (1992) Eckmann, J.P., Ruelle, D.: Fundamental limitations for estimating dimensions and lyapounov exponents in dynamical systems. Physica D 56, 185–187 (1992)
14.
Zurück zum Zitat Smith, L.A.: Intrinsic limits on dimension calculations. Physics Letters A 133, 283–288 (1988) Smith, L.A.: Intrinsic limits on dimension calculations. Physics Letters A 133, 283–288 (1988)
15.
Zurück zum Zitat Efron, B., Tibshirani, R.J.: An Introduction to the Bootstrap. Chapman and Hall (1993) Efron, B., Tibshirani, R.J.: An Introduction to the Bootstrap. Chapman and Hall (1993)
16.
Zurück zum Zitat Theiler, J., Eubank, S., Longtin, A., Galdrikian, B., Farmer, J.D.: Testing for nonlinearity in time series: the method for surrogate data. Physica D 58, 77–94 (1992) Theiler, J., Eubank, S., Longtin, A., Galdrikian, B., Farmer, J.D.: Testing for nonlinearity in time series: the method for surrogate data. Physica D 58, 77–94 (1992)
17.
Zurück zum Zitat Costa, J.A., Hero, A.O.: Geodesic entropic graphs for dimension and entropy estimation in manifold learning. IEEE Transactions on Signal Processing 52(8), 2210–2221 (2004) Costa, J.A., Hero, A.O.: Geodesic entropic graphs for dimension and entropy estimation in manifold learning. IEEE Transactions on Signal Processing 52(8), 2210–2221 (2004)
18.
Zurück zum Zitat Fukunaga, K., Olsen, D.R.: An algorithm for finding the intrinsic dimensionality of data. IEEE Transactions on Computers C-20(2), 176–193 (1971) Fukunaga, K., Olsen, D.R.: An algorithm for finding the intrinsic dimensionality of data. IEEE Transactions on Computers C-20(2), 176–193 (1971)
19.
Zurück zum Zitat Pettis, K.W., Bailey, T.A., Jain, A.K., Dubes, R.C.: An intrinsic dimensionality estimator from near-neighbor information. IEEE Transactions on Pattern Analysis and Machine Intelligence 1, 25–37 (1979) Pettis, K.W., Bailey, T.A., Jain, A.K., Dubes, R.C.: An intrinsic dimensionality estimator from near-neighbor information. IEEE Transactions on Pattern Analysis and Machine Intelligence 1, 25–37 (1979)
20.
Zurück zum Zitat Verveer, P.J., Duin, R.P.W.: An evaluation of intrinsic dimensionality estimators. IEEE Transactions on Pattern Analysis and Machine Intelligence 17(1), 81–86 (1995) Verveer, P.J., Duin, R.P.W.: An evaluation of intrinsic dimensionality estimators. IEEE Transactions on Pattern Analysis and Machine Intelligence 17(1), 81–86 (1995)
21.
Zurück zum Zitat Levina, E., Bickel, P.J.: Maximum likelihood estimation of intrinsic dimension. In: Advances in Neural Information Processing Systems 16: Proceedings of the 2004 Conference (NIPS), pp. 777–784 (2004) Levina, E., Bickel, P.J.: Maximum likelihood estimation of intrinsic dimension. In: Advances in Neural Information Processing Systems 16: Proceedings of the 2004 Conference (NIPS), pp. 777–784 (2004)
22.
Zurück zum Zitat Fan, M., Qiao, H., Zhang, B.: Intrinsic dimension estimation of manifolds by incising balls. Pattern Recognition 42, 780–787 (2009) Fan, M., Qiao, H., Zhang, B.: Intrinsic dimension estimation of manifolds by incising balls. Pattern Recognition 42, 780–787 (2009)
23.
Zurück zum Zitat Lee, J.A., Verleysen, M.: Nonlinear Dimensionality Reduction. Springer (2007) Lee, J.A., Verleysen, M.: Nonlinear Dimensionality Reduction. Springer (2007)
Metadaten
Titel
Intrinsic Dimensionality
verfasst von
Harry Strange
Reyer Zwiggelaar
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-03943-5_4