Skip to main content
Top
Published in: Quality & Quantity 4/2016

02-06-2015

Variable selection for discrete competing risks models

Authors: Stephanie Möst, Wolfgang Pößnecker, Gerhard Tutz

Published in: Quality & Quantity | Issue 4/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In competing risks models one distinguishes between several distinct target events that end duration. Since the effects of covariates are specific to the target events, the model contains a large number of parameters even when the number of predictors is not very large. Therefore, reduction of the complexity of the model, in particular by deletion of all irrelevant predictors, is of major importance. A selection procedure is proposed that aims at selection of variables rather than parameters. It is based on penalization techniques and reduces the complexity of the model more efficiently than techniques that penalize parameters separately. An algorithm is proposed that yields stable estimates. We consider reduction of complexity by variable selection in two applications, the evolution of congressional careers of members of the US congress and the duration of unemployment.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Beck, A., Teboulle, M.: A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2, 183–202 (2009)CrossRef Beck, A., Teboulle, M.: A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2, 183–202 (2009)CrossRef
go back to reference Beyersmann, J., Allignol, A., Schumacher, M.: Competing Risks and Multistate Models with R. Springer, New York (2011) Beyersmann, J., Allignol, A., Schumacher, M.: Competing Risks and Multistate Models with R. Springer, New York (2011)
go back to reference Box-Steffensmeier, J.M., Jones, B.S.: Event History Modeling: A Guide for Social Scientists. Cambridge University Press, New York (2004)CrossRef Box-Steffensmeier, J.M., Jones, B.S.: Event History Modeling: A Guide for Social Scientists. Cambridge University Press, New York (2004)CrossRef
go back to reference Candes, E., Tao, T.: The dantzig selector: statistical estimation when p is much larger than n. Ann. Stat. 35, 2313–2351 (2007)CrossRef Candes, E., Tao, T.: The dantzig selector: statistical estimation when p is much larger than n. Ann. Stat. 35, 2313–2351 (2007)CrossRef
go back to reference Efron, B.: Bootstrap methods: another look at the jackknife. Ann. Stat. 7, 1–26 (1979)CrossRef Efron, B.: Bootstrap methods: another look at the jackknife. Ann. Stat. 7, 1–26 (1979)CrossRef
go back to reference Eilers, P.H., Marx, B.D.: Flexible smoothing with b-splines and penalties. Stat. Sci. 11, 89–121 (1996)CrossRef Eilers, P.H., Marx, B.D.: Flexible smoothing with b-splines and penalties. Stat. Sci. 11, 89–121 (1996)CrossRef
go back to reference Enberg, J., Gottschalk, P., Wolf, D.: A random-effects logit model of work-welfare transitions. J. Econ. 43, 63–75 (1990)CrossRef Enberg, J., Gottschalk, P., Wolf, D.: A random-effects logit model of work-welfare transitions. J. Econ. 43, 63–75 (1990)CrossRef
go back to reference Fahrmeir, L., Tutz, G.: Multivariate Statistical Modelling Based on Generalized Linear Models, 2nd edn. Springer, New York (2001)CrossRef Fahrmeir, L., Tutz, G.: Multivariate Statistical Modelling Based on Generalized Linear Models, 2nd edn. Springer, New York (2001)CrossRef
go back to reference Fahrmeir, L., Wagenpfeil, S.: Smoothing hazard functions and time-varying effects in discrete duration and competing risks models. J. Am. Stat. Assoc. 91, 1584–1594 (1996)CrossRef Fahrmeir, L., Wagenpfeil, S.: Smoothing hazard functions and time-varying effects in discrete duration and competing risks models. J. Am. Stat. Assoc. 91, 1584–1594 (1996)CrossRef
go back to reference Fan, J., Li, R.: Variable selection via nonconcave penalized likelihood and its oracle properties. J. Am. Stat. Assoc. 96, 1348–1360 (2001)CrossRef Fan, J., Li, R.: Variable selection via nonconcave penalized likelihood and its oracle properties. J. Am. Stat. Assoc. 96, 1348–1360 (2001)CrossRef
go back to reference Friedman, J., Hastie, T., Tibshirani, R.: Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33(1), 1–22 (2010)CrossRef Friedman, J., Hastie, T., Tibshirani, R.: Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33(1), 1–22 (2010)CrossRef
go back to reference Gertheiss, J., Tutz, G.: Penalized regression with ordinal predictors. Int. Stat. Rev. 77, 345–365 (2009)CrossRef Gertheiss, J., Tutz, G.: Penalized regression with ordinal predictors. Int. Stat. Rev. 77, 345–365 (2009)CrossRef
go back to reference Han, A., Hausman, J.A.: Flexible parametric estimation of duration and competing risk models. J. Appl. Econ. 5(1), 1–28 (1990)CrossRef Han, A., Hausman, J.A.: Flexible parametric estimation of duration and competing risk models. J. Appl. Econ. 5(1), 1–28 (1990)CrossRef
go back to reference Hastie, T., Tibshirani, R., Friedman, J.H.: The Elements of Statistical Learning, 2nd edn. Springer, New York (2009)CrossRef Hastie, T., Tibshirani, R., Friedman, J.H.: The Elements of Statistical Learning, 2nd edn. Springer, New York (2009)CrossRef
go back to reference Jones, B.: A Longitudinal Perspective on Congressional Elections. Ph. D. thesis, State University of New York at Stony Brook (1994) Jones, B.: A Longitudinal Perspective on Congressional Elections. Ph. D. thesis, State University of New York at Stony Brook (1994)
go back to reference Kalbfleisch, J.D., Prentice, R.L.: The Statistical Analysis of Failure Time Data, 2nd edn. Wiley, New York (2002)CrossRef Kalbfleisch, J.D., Prentice, R.L.: The Statistical Analysis of Failure Time Data, 2nd edn. Wiley, New York (2002)CrossRef
go back to reference Kauermann, G., Khomski, P.: Full time or part time reemployment: a competing risk model with frailties and smooth effects using a penalty based approach. J. Comput. Gr. Stat. 18, 106–125 (2009)CrossRef Kauermann, G., Khomski, P.: Full time or part time reemployment: a competing risk model with frailties and smooth effects using a penalty based approach. J. Comput. Gr. Stat. 18, 106–125 (2009)CrossRef
go back to reference Klein, J., Moeschberger, M.: Survival Analysis: Statistical Methods for Censored and Truncated Data, 2nd edn. Springer, New York (2003) Klein, J., Moeschberger, M.: Survival Analysis: Statistical Methods for Censored and Truncated Data, 2nd edn. Springer, New York (2003)
go back to reference Kleinbaum, D.G., Klein, M.: Survival Analysis: A Self-learning Text, 3rd edn. Springer, New York (2013) Kleinbaum, D.G., Klein, M.: Survival Analysis: A Self-learning Text, 3rd edn. Springer, New York (2013)
go back to reference Krishnapuram, B., Carin, L., Figueiredo, M.A., Hartemink, A.J.: Sparse multinomial logistic regression: fast algorithms and generalization bounds. IEEE Trans. Pattern Anal. Mach. Intell. 27, 957–968 (2005)CrossRef Krishnapuram, B., Carin, L., Figueiredo, M.A., Hartemink, A.J.: Sparse multinomial logistic regression: fast algorithms and generalization bounds. IEEE Trans. Pattern Anal. Mach. Intell. 27, 957–968 (2005)CrossRef
go back to reference Narendranathan, W., Stewart, M.B.: Modelling the probability of leaving unemployment: competing risks models with flexible base-line hazards. Appl. Stat. 42(1), 63–83 (1993)CrossRef Narendranathan, W., Stewart, M.B.: Modelling the probability of leaving unemployment: competing risks models with flexible base-line hazards. Appl. Stat. 42(1), 63–83 (1993)CrossRef
go back to reference Parikh, N., Boyd, S.: Proximal algorithms. Found. Trends Optim. 1, 123–231 (2013) Parikh, N., Boyd, S.: Proximal algorithms. Found. Trends Optim. 1, 123–231 (2013)
go back to reference Pößnecker, W.: MRSP: Multinomial Response Models with Structured Penalties. R package version 0.4.3. (2014) Pößnecker, W.: MRSP: Multinomial Response Models with Structured Penalties. R package version 0.4.3. (2014)
go back to reference R Development Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna (2014) R Development Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna (2014)
go back to reference Simon, N., Friedman, J., Hastie, T.: A blockwise descent algorithm for group-penalized multiresponse and multinomial regression. arXiv preprint (2013) Simon, N., Friedman, J., Hastie, T.: A blockwise descent algorithm for group-penalized multiresponse and multinomial regression. arXiv preprint (2013)
go back to reference Steele, F., Goldstein, H., Browne, W.: A general multilevel multistate competing risks model for event history data, with an application to a study of contraceptive use dynamics. Stat. Model. 4(2), 145–159 (2004)CrossRef Steele, F., Goldstein, H., Browne, W.: A general multilevel multistate competing risks model for event history data, with an application to a study of contraceptive use dynamics. Stat. Model. 4(2), 145–159 (2004)CrossRef
go back to reference Tibshirani, R.: Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B 58, 267–288 (1996) Tibshirani, R.: Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B 58, 267–288 (1996)
go back to reference Tutz, G.: Competing risks models in discrete time with nominal or ordinal categories of response. Quality Quant. 29, 405–420 (1995)CrossRef Tutz, G.: Competing risks models in discrete time with nominal or ordinal categories of response. Quality Quant. 29, 405–420 (1995)CrossRef
go back to reference Tutz, G.: Regression for Categorical Data. Cambridge University Press, Cambridge (2012) Tutz, G.: Regression for Categorical Data. Cambridge University Press, Cambridge (2012)
go back to reference Tutz, G., Pößnecker, W., Uhlmann, L.: Variable selection in general multinomial logit models. Comput. Stat. Data Anal. 82, 207–222 (2015)CrossRef Tutz, G., Pößnecker, W., Uhlmann, L.: Variable selection in general multinomial logit models. Comput. Stat. Data Anal. 82, 207–222 (2015)CrossRef
go back to reference Wang, H., Leng, C.: A note on adaptive group lasso. Comput. Stat. Data Anal. 52, 5277–5286 (2008)CrossRef Wang, H., Leng, C.: A note on adaptive group lasso. Comput. Stat. Data Anal. 52, 5277–5286 (2008)CrossRef
go back to reference Yuan, M., Lin, Y.: Model selection and estimation in regression with grouped variables. J. R. Stat. Soc. Ser. B 68, 49–67 (2006)CrossRef Yuan, M., Lin, Y.: Model selection and estimation in regression with grouped variables. J. R. Stat. Soc. Ser. B 68, 49–67 (2006)CrossRef
go back to reference Zou, H.: The adaptive lasso and its oracle properties. J. Am. Stat. Assoc. 101, 1418–1429 (2006)CrossRef Zou, H.: The adaptive lasso and its oracle properties. J. Am. Stat. Assoc. 101, 1418–1429 (2006)CrossRef
go back to reference Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B 67, 301–320 (2005)CrossRef Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B 67, 301–320 (2005)CrossRef
Metadata
Title
Variable selection for discrete competing risks models
Authors
Stephanie Möst
Wolfgang Pößnecker
Gerhard Tutz
Publication date
02-06-2015
Publisher
Springer Netherlands
Published in
Quality & Quantity / Issue 4/2016
Print ISSN: 0033-5177
Electronic ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-015-0222-0

Other articles of this Issue 4/2016

Quality & Quantity 4/2016 Go to the issue

Premium Partner