Skip to main content

2017 | OriginalPaper | Buchkapitel

6. Dimensionality Reduction

verfasst von : Daniel Durstewitz

Erschienen in: Advanced Data Analysis in Neuroscience

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

For the purpose of visualization and for the ease of interpretation, to remove redundancies from the data or to combat the curse of dimensionality (Sect. 4.​4), it may be useful to reduce the dimensionality of the original p-dimensional feature space. This, of course, should be done in a way that minimizes the potential loss of information, where the precise definition of “loss of information” may depend on the statistical and scientific questions asked. There are both linear and nonlinear methods for dimensionality reduction. This chapter will start with the by far most popular procedure, principal component analysis.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Bell, A.J., Sejnowski, T.J.: An information maximisation approach to blind separation and blind deconvolution. Neural Comput. 7, 1129–1159 (1995)CrossRef Bell, A.J., Sejnowski, T.J.: An information maximisation approach to blind separation and blind deconvolution. Neural Comput. 7, 1129–1159 (1995)CrossRef
Zurück zum Zitat Benchenane, K., Peyrache, A., Khamassi, M., Tierney, P.L., Gioanni, Y., Battaglia, F.P., Wiener, S.I.: Coherent theta oscillations and reorganization of spike timing in the hippocampal-prefrontal network upon learning. Neuron. 66, 921–936 (2010)CrossRef Benchenane, K., Peyrache, A., Khamassi, M., Tierney, P.L., Gioanni, Y., Battaglia, F.P., Wiener, S.I.: Coherent theta oscillations and reorganization of spike timing in the hippocampal-prefrontal network upon learning. Neuron. 66, 921–936 (2010)CrossRef
Zurück zum Zitat Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, New York (2006)MATH Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, New York (2006)MATH
Zurück zum Zitat Cardoso, J.-F., Souloumiac, A.: Blind beamforming for non Gaussian signals. IEEE Proceedings-F. 140, 362–370 (1993) Cardoso, J.-F., Souloumiac, A.: Blind beamforming for non Gaussian signals. IEEE Proceedings-F. 140, 362–370 (1993)
Zurück zum Zitat Carroll, J.D., Chang, J.J.: Analysis of individual differences in multidimensional scaling via an N-way generalization of “Eckart-Young” decomposition. Psychometrika. 35, 283–319 (1970)CrossRefMATH Carroll, J.D., Chang, J.J.: Analysis of individual differences in multidimensional scaling via an N-way generalization of “Eckart-Young” decomposition. Psychometrika. 35, 283–319 (1970)CrossRefMATH
Zurück zum Zitat Chapin, J.K., Nicolelis, M.A.: Principal component analysis of neuronal ensemble activity reveals multidimensional somatosensory representations. J. Neurosci. Methods. 94, 121–140 (1999)CrossRef Chapin, J.K., Nicolelis, M.A.: Principal component analysis of neuronal ensemble activity reveals multidimensional somatosensory representations. J. Neurosci. Methods. 94, 121–140 (1999)CrossRef
Zurück zum Zitat Compte, A., Constantinidis, C., Tegner, J., Raghavachari, S., Chafee, M.V., Goldman-Rakic, P.S., Wang, X.J.: Temporally irregular mnemonic persistent activity in prefrontal neurons of monkeys during a delayed response task. J. Neurophysiol. 90, 3441–3454 (2003)CrossRef Compte, A., Constantinidis, C., Tegner, J., Raghavachari, S., Chafee, M.V., Goldman-Rakic, P.S., Wang, X.J.: Temporally irregular mnemonic persistent activity in prefrontal neurons of monkeys during a delayed response task. J. Neurophysiol. 90, 3441–3454 (2003)CrossRef
Zurück zum Zitat Demanuele, C., Bähner, F., Plichta, M.M., Kirsch, P., Tost, H., Meyer-Lindenberg, A., Durstewitz, D.: A statistical approach for segregating cognitive task stages from multivariate fMRI BOLD time series. Front. Human Neurosci. 9, 537 (2015a)CrossRef Demanuele, C., Bähner, F., Plichta, M.M., Kirsch, P., Tost, H., Meyer-Lindenberg, A., Durstewitz, D.: A statistical approach for segregating cognitive task stages from multivariate fMRI BOLD time series. Front. Human Neurosci. 9, 537 (2015a)CrossRef
Zurück zum Zitat Durstewitz, D., Balaguer-Ballester, E.: Statistical approaches for reconstructing neuro-cognitive dynamics from high-dimensional neural recordings. Neuroforum. 1, 89–98 (2010) Durstewitz, D., Balaguer-Ballester, E.: Statistical approaches for reconstructing neuro-cognitive dynamics from high-dimensional neural recordings. Neuroforum. 1, 89–98 (2010)
Zurück zum Zitat Eysenck, H.J.: The Structure of Human Personality. Methuen, London (1953) Eysenck, H.J.: The Structure of Human Personality. Methuen, London (1953)
Zurück zum Zitat Groppe, D.M., Makeig, S., Kutas, M.: Identifying reliable independent components via split-half comparisons. Neuroimage. 45, 1199–1211 (2009)CrossRef Groppe, D.M., Makeig, S., Kutas, M.: Identifying reliable independent components via split-half comparisons. Neuroimage. 45, 1199–1211 (2009)CrossRef
Zurück zum Zitat Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning (Vol. 2, No. 1) Springer, New York (2009) Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning (Vol. 2, No. 1) Springer, New York (2009)
Zurück zum Zitat Hill, E.S., Moore-Kochlacs, C., Vasireddi, S.K., Sejnowski, T.J., Frost, W.N.: Validation of independent component analysis for rapid spike sorting of optical recording data. J. Neurophysiol. 104, 3721–3331 (2010)CrossRef Hill, E.S., Moore-Kochlacs, C., Vasireddi, S.K., Sejnowski, T.J., Frost, W.N.: Validation of independent component analysis for rapid spike sorting of optical recording data. J. Neurophysiol. 104, 3721–3331 (2010)CrossRef
Zurück zum Zitat Horn, J.L., Cattell, R.B.: Refinement and test of the theory of fluid and crystallized intelligence. J. Educ. Psychol. 57, 253–270 (1966)CrossRef Horn, J.L., Cattell, R.B.: Refinement and test of the theory of fluid and crystallized intelligence. J. Educ. Psychol. 57, 253–270 (1966)CrossRef
Zurück zum Zitat Hyman, J.M., Ma, L., Balaguer-Ballester, E., Durstewitz, D., Seamans, J.K.: Contextual encoding by ensembles of medial prefrontal cortex neurons. Proc. Natl. Acad. Sci. USA. 109(13), 5086–5091 (2012)CrossRef Hyman, J.M., Ma, L., Balaguer-Ballester, E., Durstewitz, D., Seamans, J.K.: Contextual encoding by ensembles of medial prefrontal cortex neurons. Proc. Natl. Acad. Sci. USA. 109(13), 5086–5091 (2012)CrossRef
Zurück zum Zitat Hyvärinen, A.: Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Netw. 10, 626–634 (1999)CrossRef Hyvärinen, A.: Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Netw. 10, 626–634 (1999)CrossRef
Zurück zum Zitat Hyvärinen, A., Karhunen, J., Oja, E.: Independent Component Analysis. Wiley, New York (2001)CrossRef Hyvärinen, A., Karhunen, J., Oja, E.: Independent Component Analysis. Wiley, New York (2001)CrossRef
Zurück zum Zitat James, C.J., Demanuele, C.: On spatio-temporal component selection in space-time independent component analysis: an application to ictal EEG. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2009, 3154–3157 (2009) James, C.J., Demanuele, C.: On spatio-temporal component selection in space-time independent component analysis: an application to ictal EEG. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2009, 3154–3157 (2009)
Zurück zum Zitat James, C.J., Hesse, C.W.: Independent component analysis for biomedical signals. Physiol. Meas. 26, R15–R39 (2005)CrossRef James, C.J., Hesse, C.W.: Independent component analysis for biomedical signals. Physiol. Meas. 26, R15–R39 (2005)CrossRef
Zurück zum Zitat Jung, T.P., Makeig, S., McKeown, M.J., Bell, A.J., Lee, T.W., Sejnowski, T.J.: Imaging brain dynamics using independent component analysis. Proc. IEEE Inst. Electr. Electron. Eng. 89, 1107–1122 (2001)CrossRef Jung, T.P., Makeig, S., McKeown, M.J., Bell, A.J., Lee, T.W., Sejnowski, T.J.: Imaging brain dynamics using independent component analysis. Proc. IEEE Inst. Electr. Electron. Eng. 89, 1107–1122 (2001)CrossRef
Zurück zum Zitat Kruskal, J.B.: Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika. 29, 1–27 (1964b)MathSciNetCrossRefMATH Kruskal, J.B.: Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika. 29, 1–27 (1964b)MathSciNetCrossRefMATH
Zurück zum Zitat Lapish, C.C., Durstewitz, D., Chandler, L.J., Seamans, J.K.: Successful choice behavior is associated with distinct and coherent network states in anterior cingulate cortex. Proc. Natl. Acad. Sci. U S A. 105, 11963–11968 (2008)CrossRef Lapish, C.C., Durstewitz, D., Chandler, L.J., Seamans, J.K.: Successful choice behavior is associated with distinct and coherent network states in anterior cingulate cortex. Proc. Natl. Acad. Sci. U S A. 105, 11963–11968 (2008)CrossRef
Zurück zum Zitat Laubach, M., Shuler, M., Nicolelis, M.A.: Independent component analyses for quantifying neuronal ensemble interactions. J. Neurosci. Methods. 94, 141–154 (1999)CrossRef Laubach, M., Shuler, M., Nicolelis, M.A.: Independent component analyses for quantifying neuronal ensemble interactions. J. Neurosci. Methods. 94, 141–154 (1999)CrossRef
Zurück zum Zitat Laubach, M., Wessberg, J., Nicolelis, M.A.: Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task. Nature. 405, 567–571 (2000)CrossRef Laubach, M., Wessberg, J., Nicolelis, M.A.: Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task. Nature. 405, 567–571 (2000)CrossRef
Zurück zum Zitat Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature. 401, 788–791 (1999)CrossRefMATH Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature. 401, 788–791 (1999)CrossRefMATH
Zurück zum Zitat Lopes-dos-Santos, V., Ribeiro, S., Tort, A.B.: Detecting cell assemblies in large neuronal populations. J. Neurosci. Methods. 220, 149–166 (2013)CrossRef Lopes-dos-Santos, V., Ribeiro, S., Tort, A.B.: Detecting cell assemblies in large neuronal populations. J. Neurosci. Methods. 220, 149–166 (2013)CrossRef
Zurück zum Zitat Markram, H., Lübke, J., Frotscher, M., Sakmann, B.: Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science. 275, 213–215 (1997)CrossRef Markram, H., Lübke, J., Frotscher, M., Sakmann, B.: Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science. 275, 213–215 (1997)CrossRef
Zurück zum Zitat Mazor, O., Laurent, G.: Transient dynamics versus fixed points in odor representations by locust antennal lobe projection neurons. Neuron. 48, 661–673 (2005)CrossRef Mazor, O., Laurent, G.: Transient dynamics versus fixed points in odor representations by locust antennal lobe projection neurons. Neuron. 48, 661–673 (2005)CrossRef
Zurück zum Zitat Narayanan, N.S., Laubach, M.: Delay activity in rodent frontal cortex during a simple reaction time task. J. Neurophysiol. 101, 2859–2871 (2009)CrossRef Narayanan, N.S., Laubach, M.: Delay activity in rodent frontal cortex during a simple reaction time task. J. Neurophysiol. 101, 2859–2871 (2009)CrossRef
Zurück zum Zitat Ostwald, D., Kirilina, E., Starke, L., Blankenburg, F.: A tutorial on variational Bayes for latent linear stochastic time-series models. J. Math. Psychol. 60, 1–19 (2014)MathSciNetCrossRefMATH Ostwald, D., Kirilina, E., Starke, L., Blankenburg, F.: A tutorial on variational Bayes for latent linear stochastic time-series models. J. Math. Psychol. 60, 1–19 (2014)MathSciNetCrossRefMATH
Zurück zum Zitat Peyrache, A., Khamassi, M., Benchenane, K., Wiener, S.I., Battaglia, F.P.: Replay of rule-learning related neural patterns in the prefrontal cortex during sleep. Nat. Neurosci. 12, 919–926 (2009)CrossRef Peyrache, A., Khamassi, M., Benchenane, K., Wiener, S.I., Battaglia, F.P.: Replay of rule-learning related neural patterns in the prefrontal cortex during sleep. Nat. Neurosci. 12, 919–926 (2009)CrossRef
Zurück zum Zitat Pernice, V., Staude, B., Cardanobile, S., Rotter, S.: How structure determines correlations in neuronal networks. PLoS Comput. Biol. 7, (2011) Pernice, V., Staude, B., Cardanobile, S., Rotter, S.: How structure determines correlations in neuronal networks. PLoS Comput. Biol. 7, (2011)
Zurück zum Zitat Russo, E., Durstewitz, D.: Cell assemblies at multiple time scales with arbitrary lag constellations. Elife. 6, e19428 (2017)CrossRef Russo, E., Durstewitz, D.: Cell assemblies at multiple time scales with arbitrary lag constellations. Elife. 6, e19428 (2017)CrossRef
Zurück zum Zitat Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science. 290, 2323–2326 (2000)CrossRef Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science. 290, 2323–2326 (2000)CrossRef
Zurück zum Zitat Schölkopf, B., Smola, A.J., Müller, K.R.: Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10, 1299–1319 (1998)CrossRef Schölkopf, B., Smola, A.J., Müller, K.R.: Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10, 1299–1319 (1998)CrossRef
Zurück zum Zitat Shepard, R.N.: The analysis of proximities: multidimensional scaling with an unknown distance function. I. Psychometrika. 27, 125–140 (1962a)MathSciNetCrossRefMATH Shepard, R.N.: The analysis of proximities: multidimensional scaling with an unknown distance function. I. Psychometrika. 27, 125–140 (1962a)MathSciNetCrossRefMATH
Zurück zum Zitat Shepard, R.N.: The analysis of proximities: multidimensional scaling with an unknown distance function. II. Psychometrika. 27, 219–246 (1962b)MathSciNetCrossRefMATH Shepard, R.N.: The analysis of proximities: multidimensional scaling with an unknown distance function. II. Psychometrika. 27, 219–246 (1962b)MathSciNetCrossRefMATH
Zurück zum Zitat Sokal, R.R., Rohlf, F.J.: The comparison of dendrograms by objective methods. Taxon. 11, 33–40 (1962)CrossRef Sokal, R.R., Rohlf, F.J.: The comparison of dendrograms by objective methods. Taxon. 11, 33–40 (1962)CrossRef
Zurück zum Zitat Spearman, C.: Some issues in the theory of “g” (including the Law of Diminishing Returns). Nature. 116, 436 (1925)CrossRef Spearman, C.: Some issues in the theory of “g” (including the Law of Diminishing Returns). Nature. 116, 436 (1925)CrossRef
Zurück zum Zitat Stone, J.V.: Independent Component Analysis: A Tutorial Introduction. MIT Press, Cambridge, MA (2004) Stone, J.V.: Independent Component Analysis: A Tutorial Introduction. MIT Press, Cambridge, MA (2004)
Zurück zum Zitat Takahashi, S., Anzai, Y., Sakurai, Y.: A new approach to spike sorting for multi-neuronal activities recorded with a tetrode–how ICA can be practical. Neurosci. Res. 46, 265–272 (2003a)CrossRef Takahashi, S., Anzai, Y., Sakurai, Y.: A new approach to spike sorting for multi-neuronal activities recorded with a tetrode–how ICA can be practical. Neurosci. Res. 46, 265–272 (2003a)CrossRef
Zurück zum Zitat Takahashi, S., Anzai, Y., Sakurai, Y.: Automatic sorting for multi-neuronal activity recorded with tetrodes in the presence of overlapping spikes. J. Neurophysiol. 89, 2245–2258 (2003b)CrossRef Takahashi, S., Anzai, Y., Sakurai, Y.: Automatic sorting for multi-neuronal activity recorded with tetrodes in the presence of overlapping spikes. J. Neurophysiol. 89, 2245–2258 (2003b)CrossRef
Zurück zum Zitat Tenenbaum, J.B., de Silva, V., Langford, J.C.: A global geometric framework for nonlinear dimensionality reduction. Science. 290, 2319–2323 (2000)CrossRef Tenenbaum, J.B., de Silva, V., Langford, J.C.: A global geometric framework for nonlinear dimensionality reduction. Science. 290, 2319–2323 (2000)CrossRef
Zurück zum Zitat Torgerson, W.S.: Theory & Methods of Scaling. Wiley, New York (1958) Torgerson, W.S.: Theory & Methods of Scaling. Wiley, New York (1958)
Zurück zum Zitat Witten, D.M., Tibshirani, R.: A framework for feature selection in clustering. J. Am. Stat. Assoc. 105, 490 (2010)MathSciNetMATH Witten, D.M., Tibshirani, R.: A framework for feature selection in clustering. J. Am. Stat. Assoc. 105, 490 (2010)MathSciNetMATH
Zurück zum Zitat Young, G., Householder, A.S.: Discussion of a set of points in terms of their mutual distances. Psychometrika. 3, 19–22 (1938)CrossRefMATH Young, G., Householder, A.S.: Discussion of a set of points in terms of their mutual distances. Psychometrika. 3, 19–22 (1938)CrossRefMATH
Zurück zum Zitat Yu, B.M., Cunningham, J.P., Santhanam, G., Ryu, S.I., Shenoy, K.V., Sahani, M.: Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity. J. Neurophysiol. 102, 614–635 (2009)CrossRef Yu, B.M., Cunningham, J.P., Santhanam, G., Ryu, S.I., Shenoy, K.V., Sahani, M.: Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity. J. Neurophysiol. 102, 614–635 (2009)CrossRef
Metadaten
Titel
Dimensionality Reduction
verfasst von
Daniel Durstewitz
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-59976-2_6