Skip to main content
Top

2015 | OriginalPaper | Chapter

Constructing Graphical Models via the Focused Information Criterion

Authors : Gerda Claeskens, Eugen Pircalabelu, Lourens Waldorp

Published in: Modeling and Stochastic Learning for Forecasting in High Dimensions

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

A focused information criterion is developed to estimate undirected graphical models where for each node in the graph a generalized linear model is put forward conditioned upon the other nodes in the graph. The proposed method selects a graph with a small estimated mean squared error for a user-specified focus, which is a function of the parameters in the generalized linear models, by selecting an appropriate model at each node. For situations where the number of nodes is large in comparison with the number of cases, the procedure performs penalized estimation with quadratic approximations to several popular penalties. To show the procedure’s applicability and usefulness we have applied it to two datasets involving voting behavior of U.S. senators and to a clinical dataset on psychopathology.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Banerjee, O., El Ghaoui, L., & d’Aspremont, A. (2008). Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data. Journal of Machine Learning Research, 9, 485–516.MATH Banerjee, O., El Ghaoui, L., & d’Aspremont, A. (2008). Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data. Journal of Machine Learning Research, 9, 485–516.MATH
2.
go back to reference Borsboom, D., Cramer, A. O. J., Schmittmann, V. D., Epskamp, S., & Waldorp, L. J. (2011). The small world of psychopathology. PLoS ONE, 6(11), e27407.CrossRef Borsboom, D., Cramer, A. O. J., Schmittmann, V. D., Epskamp, S., & Waldorp, L. J. (2011). The small world of psychopathology. PLoS ONE, 6(11), e27407.CrossRef
3.
go back to reference Claeskens, G., & Hjort, N. (2003). The focused information criterion. Journal of the American Statistical Association, 98, 900–916. With discussion and a rejoinder by the authors. Claeskens, G., & Hjort, N. (2003). The focused information criterion. Journal of the American Statistical Association, 98, 900–916. With discussion and a rejoinder by the authors.
5.
go back to reference Claeskens, G., & Hjort, N. (2008). Model selection and model averaging. Cambridge: Cambridge University Press.MATHCrossRef Claeskens, G., & Hjort, N. (2008). Model selection and model averaging. Cambridge: Cambridge University Press.MATHCrossRef
6.
go back to reference Cox, D. R., & Wermuth, N. (1996). Multivariate dependencies: Models, analysis and interpretation. London: Chapman & Hall.MATH Cox, D. R., & Wermuth, N. (1996). Multivariate dependencies: Models, analysis and interpretation. London: Chapman & Hall.MATH
7.
8.
go back to reference Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96(456), 1348–1360.MATHMathSciNetCrossRef Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96(456), 1348–1360.MATHMathSciNetCrossRef
9.
go back to reference Fiocco, M., & van Zwet, W. (2004). Maximum likelihood estimation for the contact process. Institute of Mathematical Statistics Lecture Notes - Monograph Series, 45, 309–318. Fiocco, M., & van Zwet, W. (2004). Maximum likelihood estimation for the contact process. Institute of Mathematical Statistics Lecture Notes - Monograph Series, 45, 309–318.
10.
go back to reference Frank, I. E., & Friedman, J. H. (1993). A statistical view of some chemometrics regression tools. Technometrics, 35(2), 109–135.MATHCrossRef Frank, I. E., & Friedman, J. H. (1993). A statistical view of some chemometrics regression tools. Technometrics, 35(2), 109–135.MATHCrossRef
11.
go back to reference Jalali, A., Ravikumar, P., Vasuki, V., & Sanghavi, S. (2010). On learning discrete graphical models using group-sparse regularization. In Proceedings of the 13th international conference on artificial intelligence and statistics, Chia Laguna Resort, Sardinia, Italy. Jalali, A., Ravikumar, P., Vasuki, V., & Sanghavi, S. (2010). On learning discrete graphical models using group-sparse regularization. In Proceedings of the 13th international conference on artificial intelligence and statistics, Chia Laguna Resort, Sardinia, Italy.
12.
go back to reference Lauritzen, S. (1996). Graphical models. New York: Oxford University Press. Lauritzen, S. (1996). Graphical models. New York: Oxford University Press.
13.
go back to reference Lee, J., & Hastie, T. (2012). Learning mixed graphical models. Preprint arXiv:1205.5012v3. Lee, J., & Hastie, T. (2012). Learning mixed graphical models. Preprint arXiv:1205.5012v3.
14.
go back to reference Loh, P. L., & Wainwright, M. J. (2013). Structure estimation for discrete graphical models: Generalized covariance matrices and their inverses. The Annals of Statistics, 41(6), 3022–3049. Loh, P. L., & Wainwright, M. J. (2013). Structure estimation for discrete graphical models: Generalized covariance matrices and their inverses. The Annals of Statistics, 41(6), 3022–3049.
15.
16.
go back to reference Meinshausen, N., & Bühlmann, P. (2006). High-dimensional graphs and variable selection with the lasso. The Annals of Statistics, 34(3), 1436–1462.MATHMathSciNetCrossRef Meinshausen, N., & Bühlmann, P. (2006). High-dimensional graphs and variable selection with the lasso. The Annals of Statistics, 34(3), 1436–1462.MATHMathSciNetCrossRef
17.
go back to reference Pircalabelu, E., Claeskens, G., Jahfari, S., & Waldorp, L. (2013). Focused information criterion for graphical models. Large p, small n considerations (Technical report). KBI, Faculty of Economics and Business, KU Leuven. Pircalabelu, E., Claeskens, G., Jahfari, S., & Waldorp, L. (2013). Focused information criterion for graphical models. Large p, small n considerations (Technical report). KBI, Faculty of Economics and Business, KU Leuven.
18.
go back to reference Pircalabelu, E., Claeskens, G., & Waldorp, L. (2012). Structure learning using a focused information criterion in graphical models (Technical report). KBI, Faculty of Economics and Business, KU Leuven. Pircalabelu, E., Claeskens, G., & Waldorp, L. (2012). Structure learning using a focused information criterion in graphical models (Technical report). KBI, Faculty of Economics and Business, KU Leuven.
19.
go back to reference Schmidt, M., Niculescu-Mizil, A., & Murphy, K. (2007). Learning graphical model structure using ℓ 1-regularization paths. In Proceedings of the 22nd national conference on artificial intelligence, Vancouver, Canada (Vol. 2, pp. 1278–1283). Schmidt, M., Niculescu-Mizil, A., & Murphy, K. (2007). Learning graphical model structure using 1-regularization paths. In Proceedings of the 22nd national conference on artificial intelligence, Vancouver, Canada (Vol. 2, pp. 1278–1283).
20.
go back to reference Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society (SERIES B), 58, 267–288.MATHMathSciNet Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society (SERIES B), 58, 267–288.MATHMathSciNet
21.
go back to reference van Borkulo, C. D., Kamphuis, J. H., & Waldorp, L. J. (2013). Predicting behaviour of networks of mental disorders: The contact process as a model for dynamics of psychopathology (Technical report). University of Amsterdam. van Borkulo, C. D., Kamphuis, J. H., & Waldorp, L. J. (2013). Predicting behaviour of networks of mental disorders: The contact process as a model for dynamics of psychopathology (Technical report). University of Amsterdam.
22.
go back to reference van der Aart, P. J. M., & Smeenk-Enserink, N. (1975). Correlations between distributions of hunting spiders (Lycosidae, Ctenidae) and environmental characteristics in a dune area. Netherlands Journal of Zoology, 25, 1–45.CrossRef van der Aart, P. J. M., & Smeenk-Enserink, N. (1975). Correlations between distributions of hunting spiders (Lycosidae, Ctenidae) and environmental characteristics in a dune area. Netherlands Journal of Zoology, 25, 1–45.CrossRef
23.
go back to reference Wainwright, M. J., & Jordan, M. I. (2008). Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1(1–2), 1–305.MATH Wainwright, M. J., & Jordan, M. I. (2008). Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1(1–2), 1–305.MATH
24.
go back to reference Wainwright, M. J., Ravikumar, P., & Lafferty, J. D. (2007). High-dimensional graphical model selection using ℓ 1-regularized logistic regression. In B. Schölkopf, J. Platt, & T. Hoffman (Eds.), Advances in neural information processing systems, 20 (NIPS 2007), (Vol. 19, pp. 1465–1472). Cambridge: MIT Press. Wainwright, M. J., Ravikumar, P., & Lafferty, J. D. (2007). High-dimensional graphical model selection using 1-regularized logistic regression. In B. Schölkopf, J. Platt, & T. Hoffman (Eds.), Advances in neural information processing systems, 20 (NIPS 2007), (Vol. 19, pp. 1465–1472). Cambridge: MIT Press.
25.
go back to reference Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The panas scales. Journal of Personality and Social Psychology, 54(6), 1063–1070.CrossRef Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The panas scales. Journal of Personality and Social Psychology, 54(6), 1063–1070.CrossRef
26.
go back to reference Yang, E., Ravikumar, P. K., Allen, G. I., & Liu, Z. (2012). Graphical models via generalized linear models. In P. Bartlett, F. Pereira, C. Burges, L. Bottou, & K. Weinberger (Eds.), Advances in neural information processing systems, Curran Associates, Inc. (Vol. 25, pp. 1367–1375). Yang, E., Ravikumar, P. K., Allen, G. I., & Liu, Z. (2012). Graphical models via generalized linear models. In P. Bartlett, F. Pereira, C. Burges, L. Bottou, & K. Weinberger (Eds.), Advances in neural information processing systems, Curran Associates, Inc. (Vol. 25, pp. 1367–1375).
27.
go back to reference Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association, 101(476), 1418–1429.MATHMathSciNetCrossRef Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association, 101(476), 1418–1429.MATHMathSciNetCrossRef
Metadata
Title
Constructing Graphical Models via the Focused Information Criterion
Authors
Gerda Claeskens
Eugen Pircalabelu
Lourens Waldorp
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-18732-7_4

Premium Partner