Skip to main content

2018 | OriginalPaper | Buchkapitel

13. Sufficient Dimension Reduction for Tensor Data

verfasst von : Yiwen Liu, Xin Xing, Wenxuan Zhong

Erschienen in: Handbook of Big Data Analytics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the rapid development of science and technology, a large volume of array data has been collected in areas such as genomics, finance, image processing, and Internet search. How to extract useful information from massive data becomes the key issue nowadays. In spite of the urgent need for statistical tools to deal with such data, there are limited methods that can fully address the high-dimensional problem. In this chapter, we review the general setting of sufficient dimension reduction framework and its generalization to tensor data. Tensor is a multi-way array, and its usage is becoming more and more important with the advancement of social and behavioral science, chemistry, and imaging technology. The vector-based statistical methods can be applied to tensor data by vectorizing a tensor into a vector. However, vectorized tensor usually has a large dimension which may largely exceed the number of samples. To preserve the tensor structure and reduce the dimensionality simultaneously, we revisit the tensor sufficient dimension reduction model and apply it to colorimetric sensor arrays. Tensor sufficient dimension reduction method is simple but powerful and exhibits a competent empirical performance in real data analysis.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Bendel RB, Afifi AA (1977) Comparison of stopping rules in forward “stepwise” regression. J Am Stat Assoc 72(357):46–53MATH Bendel RB, Afifi AA (1977) Comparison of stopping rules in forward “stepwise” regression. J Am Stat Assoc 72(357):46–53MATH
Zurück zum Zitat Bura E, Cook RD (2001) Extending sliced inverse regression: the weighted chi-squared test. J Am Stat Assoc 96(455):996–1003MathSciNetCrossRef Bura E, Cook RD (2001) Extending sliced inverse regression: the weighted chi-squared test. J Am Stat Assoc 96(455):996–1003MathSciNetCrossRef
Zurück zum Zitat Chen C-H, Li K-C (1998) Can SIR be as popular as multiple linear regression? Stat Sin 8(2):289–316 Chen C-H, Li K-C (1998) Can SIR be as popular as multiple linear regression? Stat Sin 8(2):289–316
Zurück zum Zitat Cook RD, Weisberg S (2009) An introduction to regression graphics, vol 405. Wiley, New York Cook RD, Weisberg S (2009) An introduction to regression graphics, vol 405. Wiley, New York
Zurück zum Zitat Cook RD et al (2004) Testing predictor contributions in sufficient dimension reduction. Ann Stat 32(3):1062–1092MathSciNetCrossRef Cook RD et al (2004) Testing predictor contributions in sufficient dimension reduction. Ann Stat 32(3):1062–1092MathSciNetCrossRef
Zurück zum Zitat Efroymson M (1960) Multiple regression analysis. Math Methods Digit Comput 1:191–203 Efroymson M (1960) Multiple regression analysis. Math Methods Digit Comput 1:191–203
Zurück zum Zitat Fan J, Li R (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. J Am Stat Assoc 96(456):1348–1360MathSciNetCrossRef Fan J, Li R (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. J Am Stat Assoc 96(456):1348–1360MathSciNetCrossRef
Zurück zum Zitat Fan J, Peng H, et al (2004) Nonconcave penalized likelihood with a diverging number of parameters. Ann Stat 32(3):928–961 Fan J, Peng H, et al (2004) Nonconcave penalized likelihood with a diverging number of parameters. Ann Stat 32(3):928–961
Zurück zum Zitat Friedman JH, Tukey JW (1974) A projection pursuit algorithm for exploratory data analysis. IEEE Trans Comput 23(9):881–890CrossRef Friedman JH, Tukey JW (1974) A projection pursuit algorithm for exploratory data analysis. IEEE Trans Comput 23(9):881–890CrossRef
Zurück zum Zitat Harshman RA, Lundy ME (1984) The PARAFAC model for three-way factor analysis and multidimensional scaling. In: Research methods for multimode data analysis. Praeger, New York, pp 122–215 Harshman RA, Lundy ME (1984) The PARAFAC model for three-way factor analysis and multidimensional scaling. In: Research methods for multimode data analysis. Praeger, New York, pp 122–215
Zurück zum Zitat Kroonenberg PM (2008) Applied multiway data analysis, vol 702. Wiley, New York Kroonenberg PM (2008) Applied multiway data analysis, vol 702. Wiley, New York
Zurück zum Zitat Kruskal JB (1969) Toward a practical method which helps uncover the structure of a set of multivariate observations by finding the linear transformation which optimizes a new ‘index of condensation’. In: Statistical computation. Academic, New York, pp 427–440CrossRef Kruskal JB (1969) Toward a practical method which helps uncover the structure of a set of multivariate observations by finding the linear transformation which optimizes a new ‘index of condensation’. In: Statistical computation. Academic, New York, pp 427–440CrossRef
Zurück zum Zitat Li B, Kim MK, Altman N (2010) On dimension folding of matrix-or array-valued statistical objects. Ann Stat 38(2):1094–1121MathSciNetCrossRef Li B, Kim MK, Altman N (2010) On dimension folding of matrix-or array-valued statistical objects. Ann Stat 38(2):1094–1121MathSciNetCrossRef
Zurück zum Zitat Miller A (2002) Subset selection in regression. CRC Press, Boca RatonCrossRef Miller A (2002) Subset selection in regression. CRC Press, Boca RatonCrossRef
Zurück zum Zitat Rakow NA, Suslick KS (2000) A colorimetric sensor array for odour visualization. Nature 406(6797):710–713CrossRef Rakow NA, Suslick KS (2000) A colorimetric sensor array for odour visualization. Nature 406(6797):710–713CrossRef
Zurück zum Zitat Smilde A, Bro R, Geladi P (2005) Multi-way analysis: applications in the chemical sciences. Wiley, New York Smilde A, Bro R, Geladi P (2005) Multi-way analysis: applications in the chemical sciences. Wiley, New York
Zurück zum Zitat Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc Ser B Methodol 58(1):267–288 Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc Ser B Methodol 58(1):267–288
Zurück zum Zitat Tucker LR (1951) A method for synthesis of factor analysis studies. Technical report, DTIC Document Tucker LR (1951) A method for synthesis of factor analysis studies. Technical report, DTIC Document
Zurück zum Zitat Wilkinson L (1979) Tests of significance in stepwise regression. Psychol Bull 86(1):168CrossRef Wilkinson L (1979) Tests of significance in stepwise regression. Psychol Bull 86(1):168CrossRef
Zurück zum Zitat Yuan M, Lin Y (2007) On the non-negative garrotte estimator. J R Stat Soc Ser B Stat Methodol 69(2):143–161MathSciNetCrossRef Yuan M, Lin Y (2007) On the non-negative garrotte estimator. J R Stat Soc Ser B Stat Methodol 69(2):143–161MathSciNetCrossRef
Zurück zum Zitat Zeng P, Zhu Y (2010) An integral transform method for estimating the central mean and central subspaces. J Multivar Anal 101(1):271–290MathSciNetCrossRef Zeng P, Zhu Y (2010) An integral transform method for estimating the central mean and central subspaces. J Multivar Anal 101(1):271–290MathSciNetCrossRef
Zurück zum Zitat Zhong W, Suslick K (2014) Matrix discriminant analysis with application to colorimetric sensor array data. Technometrics 57(4):524–534MathSciNetCrossRef Zhong W, Suslick K (2014) Matrix discriminant analysis with application to colorimetric sensor array data. Technometrics 57(4):524–534MathSciNetCrossRef
Zurück zum Zitat Zhong W, Zhang T, Zhu Y, Liu JS (2012) Correlation pursuit: forward stepwise variable selection for index models. J R Stat Soc Ser B Stat Methodol 74(5):849–870MathSciNetCrossRef Zhong W, Zhang T, Zhu Y, Liu JS (2012) Correlation pursuit: forward stepwise variable selection for index models. J R Stat Soc Ser B Stat Methodol 74(5):849–870MathSciNetCrossRef
Zurück zum Zitat Zhong W, Xing X, Suslick K (2015) Tensor sufficient dimension reduction. Wiley Interdiscip Rev Comput Stat 7(3):178–184MathSciNetCrossRef Zhong W, Xing X, Suslick K (2015) Tensor sufficient dimension reduction. Wiley Interdiscip Rev Comput Stat 7(3):178–184MathSciNetCrossRef
Zurück zum Zitat Zhu L, Miao B, Peng H (2006) On sliced inverse regression with high-dimensional covariates. J Am Stat Assoc 101(474):630–643MathSciNetCrossRef Zhu L, Miao B, Peng H (2006) On sliced inverse regression with high-dimensional covariates. J Am Stat Assoc 101(474):630–643MathSciNetCrossRef
Zurück zum Zitat Zou H, Hastie T (2005) Regularization and variable selection via the elastic net. J R Stat Soc Ser B Stat Methodol 67(2):301–320MathSciNetCrossRef Zou H, Hastie T (2005) Regularization and variable selection via the elastic net. J R Stat Soc Ser B Stat Methodol 67(2):301–320MathSciNetCrossRef
Zurück zum Zitat Zou H, Zhang HH (2009) On the adaptive elastic-net with a diverging number of parameters. Ann Stat 37(4):1733MathSciNetCrossRef Zou H, Zhang HH (2009) On the adaptive elastic-net with a diverging number of parameters. Ann Stat 37(4):1733MathSciNetCrossRef
Metadaten
Titel
Sufficient Dimension Reduction for Tensor Data
verfasst von
Yiwen Liu
Xin Xing
Wenxuan Zhong
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-18284-1_13

Premium Partner