Skip to main content

2015 | OriginalPaper | Buchkapitel

Constructing Graphical Models via the Focused Information Criterion

verfasst von : Gerda Claeskens, Eugen Pircalabelu, Lourens Waldorp

Erschienen in: Modeling and Stochastic Learning for Forecasting in High Dimensions

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A focused information criterion is developed to estimate undirected graphical models where for each node in the graph a generalized linear model is put forward conditioned upon the other nodes in the graph. The proposed method selects a graph with a small estimated mean squared error for a user-specified focus, which is a function of the parameters in the generalized linear models, by selecting an appropriate model at each node. For situations where the number of nodes is large in comparison with the number of cases, the procedure performs penalized estimation with quadratic approximations to several popular penalties. To show the procedure’s applicability and usefulness we have applied it to two datasets involving voting behavior of U.S. senators and to a clinical dataset on psychopathology.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Banerjee, O., El Ghaoui, L., & d’Aspremont, A. (2008). Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data. Journal of Machine Learning Research, 9, 485–516.MATH Banerjee, O., El Ghaoui, L., & d’Aspremont, A. (2008). Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data. Journal of Machine Learning Research, 9, 485–516.MATH
2.
Zurück zum Zitat Borsboom, D., Cramer, A. O. J., Schmittmann, V. D., Epskamp, S., & Waldorp, L. J. (2011). The small world of psychopathology. PLoS ONE, 6(11), e27407.CrossRef Borsboom, D., Cramer, A. O. J., Schmittmann, V. D., Epskamp, S., & Waldorp, L. J. (2011). The small world of psychopathology. PLoS ONE, 6(11), e27407.CrossRef
3.
Zurück zum Zitat Claeskens, G., & Hjort, N. (2003). The focused information criterion. Journal of the American Statistical Association, 98, 900–916. With discussion and a rejoinder by the authors. Claeskens, G., & Hjort, N. (2003). The focused information criterion. Journal of the American Statistical Association, 98, 900–916. With discussion and a rejoinder by the authors.
5.
Zurück zum Zitat Claeskens, G., & Hjort, N. (2008). Model selection and model averaging. Cambridge: Cambridge University Press.MATHCrossRef Claeskens, G., & Hjort, N. (2008). Model selection and model averaging. Cambridge: Cambridge University Press.MATHCrossRef
6.
Zurück zum Zitat Cox, D. R., & Wermuth, N. (1996). Multivariate dependencies: Models, analysis and interpretation. London: Chapman & Hall.MATH Cox, D. R., & Wermuth, N. (1996). Multivariate dependencies: Models, analysis and interpretation. London: Chapman & Hall.MATH
7.
Zurück zum Zitat Dempster, A. (1972). Covariance selection. Biometrics, 28(1), 157–175.CrossRef Dempster, A. (1972). Covariance selection. Biometrics, 28(1), 157–175.CrossRef
8.
Zurück zum Zitat Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96(456), 1348–1360.MATHMathSciNetCrossRef Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96(456), 1348–1360.MATHMathSciNetCrossRef
9.
Zurück zum Zitat Fiocco, M., & van Zwet, W. (2004). Maximum likelihood estimation for the contact process. Institute of Mathematical Statistics Lecture Notes - Monograph Series, 45, 309–318. Fiocco, M., & van Zwet, W. (2004). Maximum likelihood estimation for the contact process. Institute of Mathematical Statistics Lecture Notes - Monograph Series, 45, 309–318.
10.
Zurück zum Zitat Frank, I. E., & Friedman, J. H. (1993). A statistical view of some chemometrics regression tools. Technometrics, 35(2), 109–135.MATHCrossRef Frank, I. E., & Friedman, J. H. (1993). A statistical view of some chemometrics regression tools. Technometrics, 35(2), 109–135.MATHCrossRef
11.
Zurück zum Zitat Jalali, A., Ravikumar, P., Vasuki, V., & Sanghavi, S. (2010). On learning discrete graphical models using group-sparse regularization. In Proceedings of the 13th international conference on artificial intelligence and statistics, Chia Laguna Resort, Sardinia, Italy. Jalali, A., Ravikumar, P., Vasuki, V., & Sanghavi, S. (2010). On learning discrete graphical models using group-sparse regularization. In Proceedings of the 13th international conference on artificial intelligence and statistics, Chia Laguna Resort, Sardinia, Italy.
12.
Zurück zum Zitat Lauritzen, S. (1996). Graphical models. New York: Oxford University Press. Lauritzen, S. (1996). Graphical models. New York: Oxford University Press.
13.
Zurück zum Zitat Lee, J., & Hastie, T. (2012). Learning mixed graphical models. Preprint arXiv:1205.5012v3. Lee, J., & Hastie, T. (2012). Learning mixed graphical models. Preprint arXiv:1205.5012v3.
14.
Zurück zum Zitat Loh, P. L., & Wainwright, M. J. (2013). Structure estimation for discrete graphical models: Generalized covariance matrices and their inverses. The Annals of Statistics, 41(6), 3022–3049. Loh, P. L., & Wainwright, M. J. (2013). Structure estimation for discrete graphical models: Generalized covariance matrices and their inverses. The Annals of Statistics, 41(6), 3022–3049.
15.
Zurück zum Zitat McCullagh, P., & Nelder, J. (1989). Generalized linear models. London: Chapman & Hall.MATHCrossRef McCullagh, P., & Nelder, J. (1989). Generalized linear models. London: Chapman & Hall.MATHCrossRef
16.
Zurück zum Zitat Meinshausen, N., & Bühlmann, P. (2006). High-dimensional graphs and variable selection with the lasso. The Annals of Statistics, 34(3), 1436–1462.MATHMathSciNetCrossRef Meinshausen, N., & Bühlmann, P. (2006). High-dimensional graphs and variable selection with the lasso. The Annals of Statistics, 34(3), 1436–1462.MATHMathSciNetCrossRef
17.
Zurück zum Zitat Pircalabelu, E., Claeskens, G., Jahfari, S., & Waldorp, L. (2013). Focused information criterion for graphical models. Large p, small n considerations (Technical report). KBI, Faculty of Economics and Business, KU Leuven. Pircalabelu, E., Claeskens, G., Jahfari, S., & Waldorp, L. (2013). Focused information criterion for graphical models. Large p, small n considerations (Technical report). KBI, Faculty of Economics and Business, KU Leuven.
18.
Zurück zum Zitat Pircalabelu, E., Claeskens, G., & Waldorp, L. (2012). Structure learning using a focused information criterion in graphical models (Technical report). KBI, Faculty of Economics and Business, KU Leuven. Pircalabelu, E., Claeskens, G., & Waldorp, L. (2012). Structure learning using a focused information criterion in graphical models (Technical report). KBI, Faculty of Economics and Business, KU Leuven.
19.
Zurück zum Zitat Schmidt, M., Niculescu-Mizil, A., & Murphy, K. (2007). Learning graphical model structure using ℓ 1-regularization paths. In Proceedings of the 22nd national conference on artificial intelligence, Vancouver, Canada (Vol. 2, pp. 1278–1283). Schmidt, M., Niculescu-Mizil, A., & Murphy, K. (2007). Learning graphical model structure using 1-regularization paths. In Proceedings of the 22nd national conference on artificial intelligence, Vancouver, Canada (Vol. 2, pp. 1278–1283).
20.
Zurück zum Zitat Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society (SERIES B), 58, 267–288.MATHMathSciNet Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society (SERIES B), 58, 267–288.MATHMathSciNet
21.
Zurück zum Zitat van Borkulo, C. D., Kamphuis, J. H., & Waldorp, L. J. (2013). Predicting behaviour of networks of mental disorders: The contact process as a model for dynamics of psychopathology (Technical report). University of Amsterdam. van Borkulo, C. D., Kamphuis, J. H., & Waldorp, L. J. (2013). Predicting behaviour of networks of mental disorders: The contact process as a model for dynamics of psychopathology (Technical report). University of Amsterdam.
22.
Zurück zum Zitat van der Aart, P. J. M., & Smeenk-Enserink, N. (1975). Correlations between distributions of hunting spiders (Lycosidae, Ctenidae) and environmental characteristics in a dune area. Netherlands Journal of Zoology, 25, 1–45.CrossRef van der Aart, P. J. M., & Smeenk-Enserink, N. (1975). Correlations between distributions of hunting spiders (Lycosidae, Ctenidae) and environmental characteristics in a dune area. Netherlands Journal of Zoology, 25, 1–45.CrossRef
23.
Zurück zum Zitat Wainwright, M. J., & Jordan, M. I. (2008). Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1(1–2), 1–305.MATH Wainwright, M. J., & Jordan, M. I. (2008). Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1(1–2), 1–305.MATH
24.
Zurück zum Zitat Wainwright, M. J., Ravikumar, P., & Lafferty, J. D. (2007). High-dimensional graphical model selection using ℓ 1-regularized logistic regression. In B. Schölkopf, J. Platt, & T. Hoffman (Eds.), Advances in neural information processing systems, 20 (NIPS 2007), (Vol. 19, pp. 1465–1472). Cambridge: MIT Press. Wainwright, M. J., Ravikumar, P., & Lafferty, J. D. (2007). High-dimensional graphical model selection using 1-regularized logistic regression. In B. Schölkopf, J. Platt, & T. Hoffman (Eds.), Advances in neural information processing systems, 20 (NIPS 2007), (Vol. 19, pp. 1465–1472). Cambridge: MIT Press.
25.
Zurück zum Zitat Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The panas scales. Journal of Personality and Social Psychology, 54(6), 1063–1070.CrossRef Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The panas scales. Journal of Personality and Social Psychology, 54(6), 1063–1070.CrossRef
26.
Zurück zum Zitat Yang, E., Ravikumar, P. K., Allen, G. I., & Liu, Z. (2012). Graphical models via generalized linear models. In P. Bartlett, F. Pereira, C. Burges, L. Bottou, & K. Weinberger (Eds.), Advances in neural information processing systems, Curran Associates, Inc. (Vol. 25, pp. 1367–1375). Yang, E., Ravikumar, P. K., Allen, G. I., & Liu, Z. (2012). Graphical models via generalized linear models. In P. Bartlett, F. Pereira, C. Burges, L. Bottou, & K. Weinberger (Eds.), Advances in neural information processing systems, Curran Associates, Inc. (Vol. 25, pp. 1367–1375).
27.
Zurück zum Zitat Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association, 101(476), 1418–1429.MATHMathSciNetCrossRef Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association, 101(476), 1418–1429.MATHMathSciNetCrossRef
Metadaten
Titel
Constructing Graphical Models via the Focused Information Criterion
verfasst von
Gerda Claeskens
Eugen Pircalabelu
Lourens Waldorp
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-18732-7_4