nach oben

Erschienen in:

2023 | OriginalPaper | Buchkapitel

39. Statistical Methods for Tensor Data Analysis

verfasst von : Qing Mai, Xin Zhang

Erschienen in: Springer Handbook of Engineering Statistics

Verlag: Springer London

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

This book chapter provides a brief introduction of tensors and a selective overview of tensor data analysis. Tensor data analysis has been an increasingly popular and also a challenging topic in multivariate statistics. In this book chapter, we aim to review the current literature on statistical models and methods for tensor data analysis.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Data Mining Methods and Applications

Nächstes Kapitel Random Forests for Survival Analysis and High-Dimensional Data

Research is partially supported by CCF-1617691, CCF-1908969 and DMS-1613154, from the U.S. National Science Foundation.

Bao, Y.T., Chien, J.T.: Tensor classification network. In: 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP), pp. 1–6 (2015)

Becker, N., Werft, W., Toedt, G., Lichter, P., Benner, A.: Penalizedsvm: a r-package for feature selection svm classification. Bioinformatics 25(13), 1711–1712 (2009)

Bi, X., Qu, A., Shen, X.: Multilayer tensor factorization with applications to recommender systems. arXiv preprint arXiv:1711.01598 (2017)

Bradley, P.S., Mangasarian, O.L.: Feature selection via concave minimization and support vector machines. ICML 98, 82–90 (1998)

Bro, R.: Multiway calibration. multilinear pls. J. Chemom. 10(1), 47–61 (1996)

Bura, E., Cook, R.D.: Extending sliced inverse regression: The weighted chi-squared test. J. Am. Stat. Assoc. 96, 996–1003 (2001)MathSciNetMATH

Cai, T., Liu, W.: A direct estimation approach to sparse linear discriminant analysis. J. Am. Stat. Assoc. 106(496), 1566–1577 (2011)MathSciNetMATH

Carroll, J.D., Chang, J.-J.: Analysis of individual differences in multidimensional scaling via an n-way generalization of “eckart-young” decomposition. Psychometrika 35(3), 283–319 (1970)MATH

Chi, E.C., Kolda, T.G.: On tensors, sparsity, and nonnegative factorizations. SIAM J. Matrix Anal. Appl. 33(4), 1272–1299 (2012)MathSciNetMATH

10.

Clemmensen, L., Hastie, T., Witten, D., Ersbøll, B.: Sparse discriminant analysis. Technometrics 53(4), 406–413 (2011)MathSciNet

11.

Cook, R., Helland, I., Su, Z.: Envelopes and partial least squares regression. J. R. Stat. Soc. Ser. B (Stat Methodol.) 75(5), 851–877 (2013)

12.

Cook, R.D.: Principal components, sufficient dimension reduction, and envelopes. Annu. Rev. Stat. Appl. 5(1), 533–559 (2018)MathSciNet

13.

Cook, R.D., Li, B., Chiaromonte, F.: Envelope models for parsimonious and efficient multivariate linear regression. Stat. Sin. 20(3), 927–960 (2010)MathSciNetMATH

14.

Cook, R.D., Ni, L.: Sufficient dimension reduction via inverse regression: A minimum discrepancy approach. J. Am. Stat. Assoc. 100(470), 410–428 (2005)MathSciNetMATH

15.

Cook, R.D., Weisberg, S.: Comment: Sliced inverse regression for dimension reduction. J. Am. Stat. Assoc. 86(414), 328–332 (1991)MATH

16.

Cook, R.D., Zhang, X.: Fused estimators of the central subspace in sufficient dimension reduction. J. Am. Stat. Assoc. 109(506), 815–827 (2014)MathSciNetMATH

17.

Cook, R.D., Zhang, X.: Foundations for envelope models and methods. J. Am. Stat. Assoc. 110(510), 599–611 (2015)MathSciNetMATH

18.

Cook, R.D., Zhang, X.: Simultaneous envelopes for multivariate linear regression. Technometrics 57(1), 11–25 (2015)MathSciNet

19.

Cook, R.D., Zhang, X.: Algorithms for envelope estimation. J. Comput. Graph. Stat. 25(1), 284–300 (2016)MathSciNet

20.

Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)MATH

21.

De Jong, S.: Simpls: an alternative approach to partial least squares regression. Chemom. Intell. Lab. Syst. 18(3), 251–263 (1993)

22.

Dimitriadou, E., Hornik, K., Leisch, F., Meyer, D., Weingessel, A.: E1071: Misc functions of the department of statistics (e1071), TU Wien. In: CRAN R package, vol. 11 (2009)

23.

Dutilleul, P.: The MLE algorithm for the matrix normal distribution. J. Stat. Comput. Simul. 64(2), 105–123 (1999)MATH

24.

Eliseyev, A., Aksenova, T.: Recursive n-way partial least squares for brain-computer interface. PloS One 8(7), e69962 (2013)

25.

Fan, J., Fan, Y.: High dimensional classification using features annealed independence rules. Ann. Stat. 36(6), 2605–2637 (2008)MathSciNetMATH

26.

Fan, J., Feng, Y., Song, R.: Nonparametric independence screening in sparse ultra-high-dimensional additive models. J. Amer. Statist. Assoc. 106, 544–557 (2011)MathSciNetMATH

27.

Fan, J., Feng, Y., Tong, X.: A road to classification in high dimensional space: the regularized optimal affine discriminant. J. R. Stat. Soc. Ser. B (Stat Methodol.) 74(4), 745–771 (2012)

28.

Fan, J., Li, R.: Variable selection via nonconcave penalized likelihood and its oracle properties. J. Am. Stat. Assoc. 96(456), 1348–1360 (2001)MathSciNetMATH

29.

Fan, J., Lv, J.: Sure independence screening for ultra-high dimensional feature space. J. R. Statist. Soc. B 20, 101–148 (2008)

30.

Fosdick, B.K., Hoff, P.D.: Separable factor analysis with applications to mortality data. Ann. Appl. Stat. 8(1), 120–147 (2014)MathSciNetMATH

31.

Friedman, J., Hastie, T., Tibshirani, R.: Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33(1), 1–22 (2010)

32.

Fung, G.M., Mangasarian, O.L.: A feature selection newton method for support vector machine classification. Comput. Optim. Appl. 28(2), 185–202 (2004)MathSciNetMATH

33.

Goeman, J., Meijer, R., Chaturvedi, N.: penalized: L1 (lasso and fused lasso) and L2 (ridge) penalized estimation in GLMs and in the cox model. In: CRAN R package (2012)

34.

Goldsmith, J., Huang, L., Crainiceanu, C.M.: Smooth scalar-on-image regression via spatial bayesian variable selection. J. Comput. Graph. Stat. 23(1), 46–64 (2014)MathSciNet

35.

Gupta, A.K., Nagar, D.K.: Matrix Variate Distributions, vol. 104. CRC Press, New York (1999)MATH

36.

Hand, D.J.: Classifier technology and the illusion of progress. Stat. Sci. 21(1), 1–14 (2006)MathSciNetMATH

37.

Harshman, R.A., et al. Foundations of the PARAFAC procedure: Models and conditions for an” explanatory” multimodal factor analysis (1970)

38.

Helland, I.S.: On the structure of partial least squares regression. Commun. Stat. Simul. Comput. 17(2), 581–607 (1988)MathSciNetMATH

39.

Hoff, P.D.: Separable covariance arrays via the Tucker product, with applications to multivariate relational data. Bayesian Anal. 6(2), 179–196 (2011)MathSciNetMATH

40.

Hoff, P.D.: Multilinear tensor regression for longitudinal relational data. Ann. Appl. Stat. 9(3), 1169–1193 (2015)MathSciNetMATH

41.

Kiers, H.A.: A three–step algorithm for candecomp/parafac analysis of large data sets with multicollinearity. Journal of Chemometrics: A Journal of the Chemometrics Society 12(3), 155–171 (1998)

42.

Kolda, T.G., Bader, B.W.: Tensor decompositions and applications. SIAM Rev. 51(3), 455–500 (2009)MathSciNetMATH

43.

Lai, Z., Xu, Y., Yang, J., Tang, J., Zhang, D.: Sparse tensor discriminant analysis. IEEE Trans. Image Process. 22(10), 3904–3915 (2013)MathSciNetMATH

44.

Lazar, N.: The Statistical Analysis of Functional MRI Data. Springer, Berlin (2008)MATH

45.

Li, B., Kim, M.K., Altman, N.: On dimension folding of matrix- or array-valued statistical objects. Ann. Stat. 38(2), 1094–1121 (2009)MathSciNetMATH

46.

Li, B., Wang, S.: On directional regression for dimension reduction. J. Am. Stat. Assoc. 102, 997–1008 (2007)MathSciNetMATH

47.

Li, G., Peng, H., Zhang, J., Zhu, L.-X.: Robust rank correlation based screening. Ann. Statist. 40, 1846–1877 (2012)MathSciNetMATH

48.

Li, K.-C.: Sliced inverse regression for dimension reduction. J. Am. Stat. Assoc. 86(414), 316–327 (1991)MathSciNetMATH

49.

Li, L., Zhang, X.: Parsimonious tensor response regression. J. Am. Stat. Assoc. 112(519), 1131–1146 (2017)MathSciNet

50.

Li, Q., Schonfeld, D.: Multilinear discriminant analysis for higher-order tensor data classification. IEEE Trans. Pattern Anal. Mach. Intell. 36(12), 2524–2537 (2014)

51.

Li, R., Zhong, W., Zhu, L.-P.: Feature screening via distance correlation learning. J. Am. Statist. Assoc. 107, 1129–1139 (2012)MathSciNetMATH

52.

Liu, T., Yuan, M., Zhao, H.: Characterizing spatiotemporal transcriptome of human brain via low rank tensor decomposition. arXiv preprint arXiv:1702.07449 (2017)

53.

Lock, E.F.: Tensor-on-tensor regression. J. Comput. Graph. Stat. 27(3), 638–647 (2017)MathSciNetMATH

54.

Mai, Q., Yang, Y., Zou, H.: Multiclass sparse discriminant analysis. Stat. Sin. 29(1), 97–111 (2019)MathSciNetMATH

55.

Mai, Q., Zou, H.: The Kolmogorov filter for variable screening in high-dimensional binary classification. Biometrika 100, 229–234 (2013)MathSciNetMATH

56.

Mai, Q., Zou, H.: Nonparametric variable transformation in sufficient dimension reduction. Technometrics 57, 1–10 (2015)MathSciNet

57.

Mai, Q., Zou, H.: The fused Kolmogorov filter: A nonparametric model-free screening method. Ann. Statist. 43, 1471–1497 (2015)MathSciNetMATH

58.

Mai, Q., Zou, H., Yuan, M.: A direct approach to sparse discriminant analysis in ultra-high dimensions. Biometrika 99(1), 29–42 (2012)MathSciNetMATH

59.

Manceur, A.M., Dutilleul, P.: Maximum likelihood estimation for the tensor normal distribution: algorithm, minimum sample size, and empirical bias and dispersion. J. Comput. Appl. Math. 239, 37–49 (2013)MathSciNetMATH

60.

Mardia, K., Kent, J., Bibby, J.: Multivariate analysis. In: Probability and Mathematical Statistics. Academic Press Inc, New Year (1979)MATH

61.

Pan, Y., Mai, Q., Zhang, X.: Covariate-adjusted tensor classification in high dimensions. J. Am. Stat. Assoc. 114(527), 1305–1319 (2019)MathSciNetMATH

62.

Rajih, M., Comon, P., Harshman, R.A.: Enhanced line search: A novel method to accelerate parafac. SIAM J. Matrix Anal. Appl. 30(3), 1128–1147 (2008)MathSciNetMATH

63.

Raskutti, G., Yuan, M.: Convex regularization for high-dimensional tensor regression. arXiv preprint arXiv:1512.01215 (2015)

64.

Reiss, P., Ogden, R.: Functional generalized linear models with images as predictors. Biometrics 66, 61–69 (2010)MathSciNetMATH

65.

Shao, J., Wang, Y., Deng, X., Wang, S.: Sparse linear discriminant analysis by thresholding for high dimensional data. Ann. Stat. 39(2), 1241–1265 (2011)MathSciNetMATH

66.

Su, Z., Cook, R.D.: Inner envelopes: efficient estimation in multivariate linear regression. Biometrika 99(3), 687–702 (2012)MathSciNetMATH

67.

Su, Z., Cook, R.D.: Estimation of multivariate means with heteroscedastic errors using envelope models. Stat. Sin. 23(1), 213–230 (2013)MathSciNetMATH

68.

Sun, W.W., Li, L.: Store: sparse tensor response regression and neuroimaging analysis. J. Mach. Learn. Res. 18(1), 4908–4944 (2017)MathSciNetMATH

69.

Sun, W.W., Li, L.: Dynamic tensor clustering. J. Am. Stat. Assoc. 114(528), 1894–1907 (2019)MathSciNetMATH

70.

Sun, W.W., Lu, J., Liu, H., Cheng, G.: Provable sparse tensor decomposition. J. R. Stat. Soc. Ser. B (Stat Methodol.) 79(3), 899–916 (2016)

71.

Tao, D., Li, X., Wu, X., Maybank, S.J.: General tensor discriminant analysis and gabor features for gait recognition. IEEE Trans. Pattern Anal. Mach. Intell. 29(10), 1700–1715 (2007)

72.

Tibshirani, R.: Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B 58(1), 267–288 (1996)MathSciNetMATH

73.

Tomasi, G.: Use of the properties of the khatri-rao product for the computation of Jacobian. In: Hessian, and Gradient of the PARAFAC Model Under MATLAB (2005)

74.

Tomasi, G.: Practical and computational aspects in chemometric data analysis. In: Center for Skov, Landskab og Planlægning/Københavns Universitet (2006)

75.

Wang, M., Fischer, J., Song, Y.S., et al.: Three-way clustering of multi-tissue multi-individual gene expression data using semi-nonnegative tensor decomposition. Ann. Appl. Stat. 13(2), 1103–1127 (2019)MathSciNetMATH

76.

Wang, X., Nan, B., Zhu, J., Koeppe, R.: Regularized 3d functional regression for brain image data via haar wavelets. Ann. Appl. Stat. 8(2), 1045 (2014)MathSciNetMATH

77.

Wang, X., Zhu, H.: Generalized scalar-on-image regression models via total variation. J. Am. Stat. Assoc. 112(519), 1156–1168 (2017)MathSciNet

78.

Witten, D.M., Tibshirani, R.: Penalized classification using fisher’s linear discriminant. J. R. Stat. Soc. Ser. B (Stat Methodol.) 73(5), 753–772 (2011)

79.

Wold, H.: Estimation of principal components and related models by iterative least squares. In: Multivariate Analysis, pp. 391–420 (1966)

80.

Worsley, K.J., Taylor, J.E., Tomaiuolo, F., Lerch, J.: Unified univariate and multivariate random field theory. Neuroimage 23, S189–S195 (2004)

81.

Xu, P., Zhu, J., Zhu, L., Li, Y.: Covariance-enhanced discriminant analysis. Biometrica 102(1), 33–45 (2015)MathSciNetMATH

82.

Yan, S., Xu, D., Yang, Q., Zhang, L., Tang, X., Zhang, H.-J.: Discriminant analysis with tensor representation. In: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), pp. 526–532 (2005)

83.

Yuan, M., Lin, Y.: Model selection and estimation in regression with grouped variables. J. R. Stat. Soc. Ser. B (Stat Methodol.) 68(1), 49–67 (2006)

84.

Yuan, M., Zhang, C.-H.: On tensor completion via nuclear norm minimization. Found. Comput. Math. 16(4), 1031–1068 (2016)MathSciNetMATH

85.

Zeng, R., Wu, J., Senhadji, L., Shu, H.: Tensor object classification via multilinear discriminant analysis network. In: Proceedings of the2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1971–1975 (2015)

86.

Zhang, A., et al.: Cross: Efficient low-rank tensor completion. Ann. Stat. 47(2), 936–964 (2019)MathSciNetMATH

87.

Zhang, A., Xia, D.: Tensor SVD: Statistical and computational limits. IEEE Trans. Inf. Theory 64(11), 7311–7338 (2018)MathSciNetMATH

88.

Zhang, C.: Nearly unbiased variable selection under minimax concave penalty. Ann. Statist. 38, 894–942 (2010)MathSciNetMATH

89.

Zhang, X., Li, L.: Tensor envelope partial least-squares regression. Technometrics 59(4), 426–436 (2017)MathSciNet

90.

Zhang, X., Mai, Q.: Efficient integration of sufficient dimension reduction and prediction in discriminant analysis. Technometrics, accepted (2018)

91.

Zhang, X., Mai, Q.: Model-free envelope dimension selection. Electronic Journal of Statistics 12(2), 2193–2216 (2018)MathSciNetMATH

92.

Zhao, J., Leng, C.: Structured lasso for regression with matrix covariates. Stat. Sin. 24(2), 799–814 (2014)MathSciNetMATH

93.

Zhao, Q., Caiafa, C.F., Mandic, D.P., Chao, Z.C., Nagasaka, Y., Fujii, N., Zhang, L., Cichocki, A.: Higher order partial least squares (HOPLS): a generalized multilinear regression method. IEEE Trans. Pattern Anal. Mach. Intell. 35(7), 1660–1673 (2012)

94.

Zhong, W., Suslick, K.S.: Matrix discriminant analysis with application to colorimetric sensor array data. Technometrics 57(4), 524–534 (2015)MathSciNet

95.

Zhou, H., Li, L.: Regularized matrix regression. J. R. Stat. Soc. Ser. B (Stat Methodol.) 76(2), 463–483 (2014)

96.

Zhou, J., He, X.: Dimension reduction based on constrained canonical correlation and variable filtering. Ann. Stat. 36, 1649–1668 (2008)MathSciNetMATH

97.

Zhu, H., Fan, J., Kong, L.: Spatially varying coefficient model for neuroimaging data with jump discontinuities. J. Am. Stat. Assoc. 109(507), 1084–1098 (2014)MathSciNetMATH

98.

Zhu, L.-P., Li, L., Li, R., Zhu, L.-X.: Model-free feature screening for ultrahigh dimensional data. J. Am. Statist. Assoc. 106, 1464–1475 (2011)MathSciNetMATH

99.

Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B (Stat Methodol.) 67(2), 301–320 (2005)

Titel: Statistical Methods for Tensor Data Analysis
verfasst von: Qing Mai
Xin Zhang
Verlag: Springer London
Buch: Springer Handbook of Engineering Statistics
Print ISBN: 978-1-4471-7502-5

Electronic ISBN: 978-1-4471-7503-2

Copyright-Jahr: 2023
DOI: https://doi.org/10.1007/978-1-4471-7503-2_39

Premium Partner

Marktübersichten

Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.

Zur Marktübersicht

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner

Marktübersichten