Skip to main content

2015 | OriginalPaper | Buchkapitel

Spatially Weighted Principal Component Regression for High-Dimensional Prediction

verfasst von : Dan Shen, Hongtu Zhu

Erschienen in: Information Processing in Medical Imaging

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We consider the problem of using high dimensional data residing on graphs to predict a low-dimensional outcome variable, such as disease status. Examples of data include time series and genetic data measured on linear graphs and imaging data measured on triangulated graphs (or lattices), among many others. Many of these data have two key features including spatial smoothness and intrinsically low dimensional structure. We propose a simple solution based on a general statistical framework, called spatially weighted principal component regression (SWPCR). In SWPCR, we introduce two sets of weights including importance score weights for the selection of individual features at each node and spatial weights for the incorporation of the neighboring pattern on the graph. We integrate the importance score weights with the spatial weights in order to recover the low dimensional structure of high dimensional data. We demonstrate the utility of our methods through extensive simulations and a real data analysis based on Alzheimer’s disease neuroimaging initiative data.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aharon, M., Elad, M., Bruckstein, A.: K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process. 54, 4311–4322 (2006)CrossRef Aharon, M., Elad, M., Bruckstein, A.: K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process. 54, 4311–4322 (2006)CrossRef
2.
Zurück zum Zitat Bair, E., Hastie, T., Paul, D., Tibshirani, R.: Prediction by supervised principal components. J. Am. Stat. Assoc. 101(473), 119–137 (2006)MATHMathSciNetCrossRef Bair, E., Hastie, T., Paul, D., Tibshirani, R.: Prediction by supervised principal components. J. Am. Stat. Assoc. 101(473), 119–137 (2006)MATHMathSciNetCrossRef
3.
Zurück zum Zitat Basak, D., Pal, S., Patranabis, D.C.: Support vector regression. Neural Inf. Process. Lett. Rev. 11(10), 203–224 (2007) Basak, D., Pal, S., Patranabis, D.C.: Support vector regression. Neural Inf. Process. Lett. Rev. 11(10), 203–224 (2007)
4.
Zurück zum Zitat Buades, A., Coll, B., Morel, J.M.: A non-local algorithm for image denoising. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 2, pp. 60–65. IEEE (2005) Buades, A., Coll, B., Morel, J.M.: A non-local algorithm for image denoising. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 2, pp. 60–65. IEEE (2005)
5.
Zurück zum Zitat Chun, H., Keles, S.: Sparse partial least squares regression for simultaneous dimension reduction and variable selection. J. Roy. Stat. Soc. Ser. B 72, 3–25 (2010)MathSciNetCrossRef Chun, H., Keles, S.: Sparse partial least squares regression for simultaneous dimension reduction and variable selection. J. Roy. Stat. Soc. Ser. B 72, 3–25 (2010)MathSciNetCrossRef
6.
Zurück zum Zitat Clemmensen, L., Hastie, T., Witten, D., Ersbøll, B.: Sparse discriminant analysis. Technometrics 53(4), 406–413 (2011)MathSciNetCrossRef Clemmensen, L., Hastie, T., Witten, D., Ersbøll, B.: Sparse discriminant analysis. Technometrics 53(4), 406–413 (2011)MathSciNetCrossRef
7.
Zurück zum Zitat Fan, J., Lv, J.: Sure independence screening for ultrahigh dimensional feature space. J. Roy. Stat. Soc.: Ser. B (Stat. Methodol.) 70(5), 849–911 (2008)MathSciNetCrossRef Fan, J., Lv, J.: Sure independence screening for ultrahigh dimensional feature space. J. Roy. Stat. Soc.: Ser. B (Stat. Methodol.) 70(5), 849–911 (2008)MathSciNetCrossRef
8.
Zurück zum Zitat Fan, J., Feng, Y., Tong, X.: A road to classification in high dimensional space: the regularized optimal affine discriminant. J. Roy. Stat. Soc.: Ser. B (Stat. Methodol.) 74(4), 745–771 (2012)MathSciNetCrossRef Fan, J., Feng, Y., Tong, X.: A road to classification in high dimensional space: the regularized optimal affine discriminant. J. Roy. Stat. Soc.: Ser. B (Stat. Methodol.) 74(4), 745–771 (2012)MathSciNetCrossRef
9.
Zurück zum Zitat Friston, K.J.: Modalities, modes, and models in functional neuroimaging. Sci. 326, 399–403 (2009)CrossRef Friston, K.J.: Modalities, modes, and models in functional neuroimaging. Sci. 326, 399–403 (2009)CrossRef
10.
Zurück zum Zitat Grenander, U., Miller, M.I.: Pattern Theory From Representation to Inference. Oxford University Press, New York (2007)MATH Grenander, U., Miller, M.I.: Pattern Theory From Representation to Inference. Oxford University Press, New York (2007)MATH
11.
Zurück zum Zitat Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2nd). Springer, Hoboken (2009)CrossRef Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2nd). Springer, Hoboken (2009)CrossRef
12.
Zurück zum Zitat Lee, M., Shen, H., Huang, J.Z., Marron, J.S.: Biclustering via sparse singular value decomposition. Biom. 66, 1087–1095 (2010)MATHMathSciNetCrossRef Lee, M., Shen, H., Huang, J.Z., Marron, J.S.: Biclustering via sparse singular value decomposition. Biom. 66, 1087–1095 (2010)MATHMathSciNetCrossRef
13.
Zurück zum Zitat Li, Y., Zhu, H., Shen, D., Lin, W., Gilmore, J.H., Ibrahim, J.G.: Multiscale adaptive regression models for neuroimaging data. J. Roy. Stat. Soc.: Ser. B (Stat. Methodol.) 73, 559–578 (2011)MATHMathSciNetCrossRef Li, Y., Zhu, H., Shen, D., Lin, W., Gilmore, J.H., Ibrahim, J.G.: Multiscale adaptive regression models for neuroimaging data. J. Roy. Stat. Soc.: Ser. B (Stat. Methodol.) 73, 559–578 (2011)MATHMathSciNetCrossRef
14.
Zurück zum Zitat Lin, Y.: Support vector machines and the bayes rule in classification. Data Min. Knowl. Disc. 6, 259–275 (2002)CrossRef Lin, Y.: Support vector machines and the bayes rule in classification. Data Min. Knowl. Disc. 6, 259–275 (2002)CrossRef
15.
Zurück zum Zitat Manjón, J.V., Carbonell-Caballero, J., Lull, J.J., García-Martí, G., Martí-Bonmatí, L., Robles, M.: MRI denoising using non-local means. Med. Image Anal. 12(4), 514–523 (2008)CrossRef Manjón, J.V., Carbonell-Caballero, J., Lull, J.J., García-Martí, G., Martí-Bonmatí, L., Robles, M.: MRI denoising using non-local means. Med. Image Anal. 12(4), 514–523 (2008)CrossRef
16.
Zurück zum Zitat Polzehl, J., Spokoiny, V.G.: Propagation-separation approach for local likelihood estimation. Probab. Theory Relat. Fields 135, 335–362 (2006)MATHMathSciNetCrossRef Polzehl, J., Spokoiny, V.G.: Propagation-separation approach for local likelihood estimation. Probab. Theory Relat. Fields 135, 335–362 (2006)MATHMathSciNetCrossRef
17.
Zurück zum Zitat Skočaj, D., Leonardis, A., Bischof, H.: Weighted and robust learning of subspace representations. Pattern Recognit 40(5), 1556–1569 (2007)MATHCrossRef Skočaj, D., Leonardis, A., Bischof, H.: Weighted and robust learning of subspace representations. Pattern Recognit 40(5), 1556–1569 (2007)MATHCrossRef
19.
Zurück zum Zitat Tibshirani, R.: Regression shrinkage and selection via the lasso. J. Roy. Stat. Soc. Ser B (Methodol.) 58, 267–288 (1996)MATHMathSciNet Tibshirani, R.: Regression shrinkage and selection via the lasso. J. Roy. Stat. Soc. Ser B (Methodol.) 58, 267–288 (1996)MATHMathSciNet
21.
Zurück zum Zitat Yan, S., Xu, D., Zhang, B., Zhang, H.J., Yang, Q., Lin, S.: Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29, 40–51 (2007)CrossRef Yan, S., Xu, D., Zhang, B., Zhang, H.J., Yang, Q., Lin, S.: Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29, 40–51 (2007)CrossRef
Metadaten
Titel
Spatially Weighted Principal Component Regression for High-Dimensional Prediction
verfasst von
Dan Shen
Hongtu Zhu
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-19992-4_60

Premium Partner