Skip to main content
Top

2006 | OriginalPaper | Chapter

38. Random Effects

Author : Yi Li

Published in: Springer Handbook of Engineering Statistics

Publisher: Springer London

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter includes well-known as well as state-of-the-art statistical modeling techniques for drawing inference on correlated data, which occur in a wide variety of studies (during quality control studies of similar products made on different assembly lines, community-based studies on cancer prevention, and familial research of linkage analysis, to name a few).
The first section briefly introduces statistical models that incorporate random effect terms, which are increasingly being applied to the analysis of correlated data. An effect is classified as a random effect when inferences are to be made on an entire population, and the levels of that effect represent only a sample from that population.
The second section introduces the linear mixed model for clustered data, which explicitly models complex covariance structure among observations by adding random terms into the linear predictor part of the linear regression model. The third section discusses its extension – generalized linear mixed models (GLMMs) – for correlated nonnormal data.
The fourth section reviews several common estimating techniques for GLMMs, including the EM and penalized quasi-likelihood approaches, Markov chain Newton-Raphson, the stochastic approximation, and the S-U algorithm. The fifth section focuses on some special topics related to hypothesis tests of random effects, including score tests for various models. The last section is a general discussion of the content of the chapter and some other topics relevant to random effects models.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
38.1.
go back to reference J. A. Nelder, R. W. Wedderburn: Generalized linear models, J. R. Stat. Soc. A 135, 370–384 (1972)CrossRef J. A. Nelder, R. W. Wedderburn: Generalized linear models, J. R. Stat. Soc. A 135, 370–384 (1972)CrossRef
38.2.
go back to reference P. McCullagh, J. A. Nelder: Generalized Linear Models, 2 edn. (Chapman Hall, London 1989) 1st edition, 1983MATH P. McCullagh, J. A. Nelder: Generalized Linear Models, 2 edn. (Chapman Hall, London 1989) 1st edition, 1983MATH
38.3.
go back to reference N. M. Laird, J. H. Ware: Random-effects models for longitudinal data, Biometrics 38, 963–974 (1982)CrossRefMATH N. M. Laird, J. H. Ware: Random-effects models for longitudinal data, Biometrics 38, 963–974 (1982)CrossRefMATH
38.4.
go back to reference R. Stiratelli, N. M. Laird, J. H. Ware: Random effects models for serial observations with binary response, Biometrics 40, 961–971 (1984)CrossRef R. Stiratelli, N. M. Laird, J. H. Ware: Random effects models for serial observations with binary response, Biometrics 40, 961–971 (1984)CrossRef
38.5.
go back to reference R. Schall: Estimation in generalized linear models with random effects, Biometrika 78, 719–727 (1991)CrossRefMATH R. Schall: Estimation in generalized linear models with random effects, Biometrika 78, 719–727 (1991)CrossRefMATH
38.6.
go back to reference S. L. Zeger, M. R. Karim: Generalized linear model with random effects: a Gibbs sampling approach, J. Am. Stat. Assoc. 86, 79–86 (1991)CrossRefMathSciNet S. L. Zeger, M. R. Karim: Generalized linear model with random effects: a Gibbs sampling approach, J. Am. Stat. Assoc. 86, 79–86 (1991)CrossRefMathSciNet
38.7.
38.8.
go back to reference N. E. Breslow, D. G. Clayton: Approximate inference in generalized linear mixed models, J. Am. Stat. Assoc. 88, 9–25 (1993)CrossRefMATH N. E. Breslow, D. G. Clayton: Approximate inference in generalized linear mixed models, J. Am. Stat. Assoc. 88, 9–25 (1993)CrossRefMATH
38.9.
go back to reference N. A. Cressie: Statistics for Spatial Data (Wiley, New York 1991)MATH N. A. Cressie: Statistics for Spatial Data (Wiley, New York 1991)MATH
38.10.
38.11.
go back to reference C. E. McCulloch, S. R. Searle: Generalized, Linear, and Mixed Models (Wiley, New York 2001)MATH C. E. McCulloch, S. R. Searle: Generalized, Linear, and Mixed Models (Wiley, New York 2001)MATH
38.12.
go back to reference C. R. Henderson, O. Kempthorne, S. R. Searle, C. N. von Krosigk: Estimation of environmental, genetic trends from records subject to culling, Biometrics 15, 192–218 (1959)CrossRefMATH C. R. Henderson, O. Kempthorne, S. R. Searle, C. N. von Krosigk: Estimation of environmental, genetic trends from records subject to culling, Biometrics 15, 192–218 (1959)CrossRefMATH
38.13.
38.14.
38.15.
go back to reference A. P. Dempster, N. M. Laird, D. B. Rubin: Maximum likelihood from incomplete data via the EM algorithm, J. R. Stat. Soc. B 39, 1–22 (1977)MathSciNetMATH A. P. Dempster, N. M. Laird, D. B. Rubin: Maximum likelihood from incomplete data via the EM algorithm, J. R. Stat. Soc. B 39, 1–22 (1977)MathSciNetMATH
38.16.
go back to reference N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth: Equation of state calculations by fast computing machines, J. Chem. Phys. 21, 1087–1092 (1953)CrossRef N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth: Equation of state calculations by fast computing machines, J. Chem. Phys. 21, 1087–1092 (1953)CrossRef
38.17.
go back to reference W. Hastings: Monte Carlo sampling methods using Markov chains and their applications, Biometrika 57, 97–109 (1970)CrossRefMATH W. Hastings: Monte Carlo sampling methods using Markov chains and their applications, Biometrika 57, 97–109 (1970)CrossRefMATH
38.18.
go back to reference B. P. Carlin, T. A. Louis: Bayes and Empirical Bayes Methods for Data Analysis (Chapman Hall, New York 2000)CrossRefMATH B. P. Carlin, T. A. Louis: Bayes and Empirical Bayes Methods for Data Analysis (Chapman Hall, New York 2000)CrossRefMATH
38.19.
go back to reference A. Gelman, J. B. Carlin, H. S. Stern, D. B. Rubin: Bayesian Data Analysis (Chapman Hall, London 1995) A. Gelman, J. B. Carlin, H. S. Stern, D. B. Rubin: Bayesian Data Analysis (Chapman Hall, London 1995)
38.20.
go back to reference C. J. Geyer, E. A. Thompson: Constrained Monte Carlo maximization likelihood for dependent data, J. R. Stat. Soc. B 54, 657–699 (1992)MathSciNet C. J. Geyer, E. A. Thompson: Constrained Monte Carlo maximization likelihood for dependent data, J. R. Stat. Soc. B 54, 657–699 (1992)MathSciNet
38.21.
go back to reference A. E. Gelfand, B. P. Carlin: Maximum likelihood estimation for constrained- or missing-data problems, Can. J. Stat. 21, 303–311 (1993)CrossRefMathSciNetMATH A. E. Gelfand, B. P. Carlin: Maximum likelihood estimation for constrained- or missing-data problems, Can. J. Stat. 21, 303–311 (1993)CrossRefMathSciNetMATH
38.22.
go back to reference C. P. Robert, G. Casella: Monte Carlo Statistical Methods (Springer, Berlin Heidelberg 1999)MATH C. P. Robert, G. Casella: Monte Carlo Statistical Methods (Springer, Berlin Heidelberg 1999)MATH
38.23.
go back to reference M. A. Tanner, W. H. Wong: The calculation of posterior distributions by data augmentation, J. Am. Stat. Assoc. 82, 528–549 (1987)CrossRefMathSciNetMATH M. A. Tanner, W. H. Wong: The calculation of posterior distributions by data augmentation, J. Am. Stat. Assoc. 82, 528–549 (1987)CrossRefMathSciNetMATH
38.25.
go back to reference G. Satten: Rank-based inference in the proportional hazards model for interval censored data, Biometrika 83, 355–370 (1996)CrossRefMATH G. Satten: Rank-based inference in the proportional hazards model for interval censored data, Biometrika 83, 355–370 (1996)CrossRefMATH
38.26.
go back to reference P. J. Green: Penalized likelihood for general semi-parametric regression models, Int. Stat. Rev. 55, 245–259 (1987)CrossRefMATH P. J. Green: Penalized likelihood for general semi-parametric regression models, Int. Stat. Rev. 55, 245–259 (1987)CrossRefMATH
38.27.
go back to reference Y. Lee, J. A. Nelder: Hierarchical generalized linear models, J. R. Stat. Soc. B 58, 619–678 (1996)MathSciNetMATH Y. Lee, J. A. Nelder: Hierarchical generalized linear models, J. R. Stat. Soc. B 58, 619–678 (1996)MathSciNetMATH
38.30.
go back to reference X. Lin, N. E. Breslow: Bias correction in generalized linear mixed models with multiple components of dispersion, J. Am. Stat. Assoc. 91, 1007–1016 (1996)CrossRefMathSciNetMATH X. Lin, N. E. Breslow: Bias correction in generalized linear mixed models with multiple components of dispersion, J. Am. Stat. Assoc. 91, 1007–1016 (1996)CrossRefMathSciNetMATH
38.31.
go back to reference D. Commenges, L. Letenneur, H. Jacqmin, J. Moreau, J. Dartigues: Test of homogeneity of binary data with explanatory variables, Biometrics 50, 613–20 (1994)CrossRefMathSciNetMATH D. Commenges, L. Letenneur, H. Jacqmin, J. Moreau, J. Dartigues: Test of homogeneity of binary data with explanatory variables, Biometrics 50, 613–20 (1994)CrossRefMathSciNetMATH
38.32.
38.33.
go back to reference Y. Li, X. Lin: Testing random effects in uncensored/censored clustered data with categorical responses, Biometrics 59, 25–35 (2003)CrossRefMathSciNetMATH Y. Li, X. Lin: Testing random effects in uncensored/censored clustered data with categorical responses, Biometrics 59, 25–35 (2003)CrossRefMathSciNetMATH
38.34.
go back to reference C. G. Collier: Applications of Weather Radar Systems: A Guide to Uses of Radar in Meteorology and Hydrology (Wiley, New York 1996) C. G. Collier: Applications of Weather Radar Systems: A Guide to Uses of Radar in Meteorology and Hydrology (Wiley, New York 1996)
38.35.
go back to reference A. A. Tsiatis, V. Degruttola, M. S. Wulfsohn: Modeling the relationship of survival to longitudinal data measured with error: applications to survival, CD4 counts in patients with AIDS, J. Am. Stat. Assoc. 90, 27–37 (1995)CrossRefMATH A. A. Tsiatis, V. Degruttola, M. S. Wulfsohn: Modeling the relationship of survival to longitudinal data measured with error: applications to survival, CD4 counts in patients with AIDS, J. Am. Stat. Assoc. 90, 27–37 (1995)CrossRefMATH
38.36.
go back to reference J. R. Cook, L. A. Stefanski: Simulation-extrapolation estimation in parametric measurement error models, J. Am. Stat. Assoc. 89, 1314–1328 (1994)CrossRefMATH J. R. Cook, L. A. Stefanski: Simulation-extrapolation estimation in parametric measurement error models, J. Am. Stat. Assoc. 89, 1314–1328 (1994)CrossRefMATH
38.37.
go back to reference X. Lin, R. J. Carroll: SIMEX variance component tests in generalized linear mixed measurement error models, Biometrics 55, 613–619 (1999)CrossRefMATH X. Lin, R. J. Carroll: SIMEX variance component tests in generalized linear mixed measurement error models, Biometrics 55, 613–619 (1999)CrossRefMATH
38.38.
go back to reference D. A. Harville, R. W. Mee: A mixed-model procedure for analyzing ordered categorical data, Biometrics 40, 393–408 (1984)CrossRefMathSciNetMATH D. A. Harville, R. W. Mee: A mixed-model procedure for analyzing ordered categorical data, Biometrics 40, 393–408 (1984)CrossRefMathSciNetMATH
38.39.
go back to reference D. Hedeker, R. Gibbons: A random-effects ordinal regression model for multilevel analysis, Biometrics 50, 933–945 (1994)CrossRefMATH D. Hedeker, R. Gibbons: A random-effects ordinal regression model for multilevel analysis, Biometrics 50, 933–945 (1994)CrossRefMATH
38.40.
go back to reference S. G. Self, K. Y. Liang: Asymptotic properties of maximum likelihood estimators, likelihood ratio tests under nonstandard conditions, J. Am. Stat. Assoc. 82, 605–610 (1987)CrossRefMathSciNetMATH S. G. Self, K. Y. Liang: Asymptotic properties of maximum likelihood estimators, likelihood ratio tests under nonstandard conditions, J. Am. Stat. Assoc. 82, 605–610 (1987)CrossRefMathSciNetMATH
38.41.
go back to reference R. J. Carroll, D. Ruppert, L. A. Stefanski: Measurement Error in Nonlinear Models (Chapman Hall, London 1995)MATH R. J. Carroll, D. Ruppert, L. A. Stefanski: Measurement Error in Nonlinear Models (Chapman Hall, London 1995)MATH
38.42.
go back to reference M. L. Macknin, S. Mathew, S. V. Medendorp: Effect of inhaling heated vapor on symptoms of the common cold, J. Am. Med. Assoc. 264, 989–991 (1990)CrossRef M. L. Macknin, S. Mathew, S. V. Medendorp: Effect of inhaling heated vapor on symptoms of the common cold, J. Am. Med. Assoc. 264, 989–991 (1990)CrossRef
38.43.
go back to reference P. J. Diggle, K. Y. Liang, S. L. Zeger: Analysis of longitudinal data (Oxford Univ. Press, New York 1994) P. J. Diggle, K. Y. Liang, S. L. Zeger: Analysis of longitudinal data (Oxford Univ. Press, New York 1994)
38.44.
go back to reference B. Zheng: Summarizing the goodness of fit of generalized linear models for longitudinal data, Stat. Med. 19, 1265–1275 (2000)CrossRef B. Zheng: Summarizing the goodness of fit of generalized linear models for longitudinal data, Stat. Med. 19, 1265–1275 (2000)CrossRef
38.45.
go back to reference G. Verbeke, E. Lesaffre: A linear mixed-effects model with heterogeneity in the random-effects population, J. Am. Stat. Assoc. 91, 217–221 (1996)CrossRefMATH G. Verbeke, E. Lesaffre: A linear mixed-effects model with heterogeneity in the random-effects population, J. Am. Stat. Assoc. 91, 217–221 (1996)CrossRefMATH
38.46.
go back to reference P. J. Lindsey, J. K. Lindsey: Diagnostic tools for random effects in the repeated measures growth curve model, Comput. Stat. Data Anal. 33, 79–100 (2000)CrossRefMATH P. J. Lindsey, J. K. Lindsey: Diagnostic tools for random effects in the repeated measures growth curve model, Comput. Stat. Data Anal. 33, 79–100 (2000)CrossRefMATH
38.47.
go back to reference E. A. Houseman, L. M. Ryan, B. A. Coull: Cholesky residuals for assessing normal errors in a linear model with correlated outcomes, J. Am. Stat. Assoc. 99, 383–394 (2004)CrossRefMathSciNetMATH E. A. Houseman, L. M. Ryan, B. A. Coull: Cholesky residuals for assessing normal errors in a linear model with correlated outcomes, J. Am. Stat. Assoc. 99, 383–394 (2004)CrossRefMathSciNetMATH
Metadata
Title
Random Effects
Author
Yi Li
Copyright Year
2006
Publisher
Springer London
DOI
https://doi.org/10.1007/978-1-84628-288-1_38