Skip to main content
Top

2012 | OriginalPaper | Chapter

A Practical Variable Selection for Linear Models

Authors : Hidehisa Noguchi, Yoshikazu Ojima, Seiichi Yasui

Published in: Frontiers in Statistical Quality Control 10

Publisher: Physica-Verlag HD

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In the analysis of experiments, there are many variable selection algorithms for linear models. Most of these approaches select the best model based on some criteria such as AIC. These criteria do not allow for any relationship between predictors. However, in practice, the analysis is driven by following three principles: Effect Hierarchy, Effect Sparsity, and Effect Heredity Principle. The approach depending solely on those criteria ignore these principles, so it would often select a hard to interpretable models, for instance, which are consisted with only interaction terms. In this article, we extend the LASSO method to identify significant interaction terms mainly focusing on the heredity principle. And we compare the proposed method with ordinary LASSO and traditional variable selection approach. In the example, we analyze the data obtained from designed experiments such as Placket-Burman design and supersaturated design.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
.
go back to reference Breiman, L. (1995). Better subset regression using the non-negative garrote. Technometrics, 37, 373–384. Breiman, L. (1995). Better subset regression using the non-negative garrote. Technometrics, 37, 373–384.
.
go back to reference Chipman, H., Hamada, M., & Wu, C. F. J. (1997). A Bayesian variable-selection approach for analyzing designed experiments with complex aliasing. Technometrics, 39, 372–381. Chipman, H., Hamada, M., & Wu, C. F. J. (1997). A Bayesian variable-selection approach for analyzing designed experiments with complex aliasing. Technometrics, 39, 372–381.
.
go back to reference Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004). Least angle regressionh (with discussion). The Annals of Statistics, 32(2), 407–499. Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004). Least angle regressionh (with discussion). The Annals of Statistics, 32(2), 407–499.
.
go back to reference Hamada, M., & Wu, C. F. J. (1992). Analysis of designed experiments with complex aliasing. Journal of Quality Technology, 24, 130–137. Hamada, M., & Wu, C. F. J. (1992). Analysis of designed experiments with complex aliasing. Journal of Quality Technology, 24, 130–137.
.
go back to reference Lin, D. K. J. (1993). A new class of supersaturated designs. Technometrics, 35, 28–31. Lin, D. K. J. (1993). A new class of supersaturated designs. Technometrics, 35, 28–31.
.
go back to reference Nam, H. C., William, L., & Ji. Z. (2010). Variable selection with the strong heredity constraint and its oracle property. Journal of the American Statistical Association, 105, 354–364. Nam, H. C., William, L., & Ji. Z. (2010). Variable selection with the strong heredity constraint and its oracle property. Journal of the American Statistical Association, 105, 354–364.
.
go back to reference Nelder, J. A. (1998). The selection of terms in response-surface models: How strong is the weak-heredity principle? The American Statistician, 52, 315–318. Nelder, J. A. (1998). The selection of terms in response-surface models: How strong is the weak-heredity principle? The American Statistician, 52, 315–318.
.
go back to reference Tibshirani, R. (1996). Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society Series B, 58, 267–288. Tibshirani, R. (1996). Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society Series B, 58, 267–288.
.
go back to reference Wu, C. F. J., & Hamada, M. (2000). Experiments: Planning, analysis, and parameter design optimization. New York: Wiley. Wu, C. F. J., & Hamada, M. (2000). Experiments: Planning, analysis, and parameter design optimization. New York: Wiley.
.
go back to reference Yuan, M., Joseph, V., & Lin, Y. (2007). An efficient variable selection approach for analyzing designed experiments. Technometrics, 49(4), 430–439. Yuan, M., Joseph, V., & Lin, Y. (2007). An efficient variable selection approach for analyzing designed experiments. Technometrics, 49(4), 430–439.
.
go back to reference Zhang, H., & Lu, W. (2007). Adaptive LASSO for Cox’s proportional hazard model. Biometrika, 94, 691–703. Zhang, H., & Lu, W. (2007). Adaptive LASSO for Cox’s proportional hazard model. Biometrika, 94, 691–703.
.
go back to reference Zou, H. (2006). The adaptive Lasso and its oracle properties. Journal of the American Statistical Association, 101(476), 1418–1429. Zou, H. (2006). The adaptive Lasso and its oracle properties. Journal of the American Statistical Association, 101(476), 1418–1429.
Metadata
Title
A Practical Variable Selection for Linear Models
Authors
Hidehisa Noguchi
Yoshikazu Ojima
Seiichi Yasui
Copyright Year
2012
Publisher
Physica-Verlag HD
DOI
https://doi.org/10.1007/978-3-7908-2846-7_23

Premium Partner