Skip to main content

2013 | OriginalPaper | Buchkapitel

2. Likelihood Construction and Estimation

verfasst von : Denni D Boos, L A Stefanski

Erschienen in: Essential Statistical Inference

Verlag: Springer New York

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

After a statistical model for the observed data has been formulated, the likelihood of the data is the natural starting point for inference in many statistical problems. This function typically leads to essentially automatic methods of inference, including point and interval estimation, and hypothesis testing. In fact, likelihood methods are generally asymptotically optimal provided the assumed statistical model is correct. Thus, the likelihood is the foundation of classical model-based statistical inference. In this chapter we describe, and often derive, basic likelihood methods and results. We start with construction of the likelihood in numerous examples and then move to various inferential techniques. The development in this chapter follows the classical frequentist approach to inference. However, the Bayesian approach to inference is equally dependent on the likelihood, and the material in this chapter is essential to understanding the Bayesian methods in Chapter 4.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Barndorff-Nielsen, O. (1978).Information and Exponential Families in Statistical Theory. John Wiley & Sons. Barndorff-Nielsen, O. (1978).Information and Exponential Families in Statistical Theory. John Wiley & Sons.
Zurück zum Zitat Barndorff-Nielsen, O. (1982). Exponential families. In Banks, D. L., Read, C. B., and Kotz, S., editors,Encyclopedia of Statistical Sciences (9 vols. plus Supplement), Volume 2, pages 587–596. John Wiley & Sons. Barndorff-Nielsen, O. (1982). Exponential families. In Banks, D. L., Read, C. B., and Kotz, S., editors,Encyclopedia of Statistical Sciences (9 vols. plus Supplement), Volume 2, pages 587–596. John Wiley & Sons.
Zurück zum Zitat Bartholomew, D. J. (1957). A problem in life testing.Journal of the American Statistical Association, 52:350–355.CrossRef Bartholomew, D. J. (1957). A problem in life testing.Journal of the American Statistical Association, 52:350–355.CrossRef
Zurück zum Zitat Berger, J. O. and Wolpert, R. L. (1984).The Likelihood Principle. Institute of Mathematical Statistics. Berger, J. O. and Wolpert, R. L. (1984).The Likelihood Principle. Institute of Mathematical Statistics.
Zurück zum Zitat Bickel, P. J. and Doksum, K. A. (1981). An analysis of transformations revisited.Journal of the American Statistical Association, 76:296–311.CrossRefMATHMathSciNet Bickel, P. J. and Doksum, K. A. (1981). An analysis of transformations revisited.Journal of the American Statistical Association, 76:296–311.CrossRefMATHMathSciNet
Zurück zum Zitat Box, G. E. P. and Cox, D. R. (1964). An analysis of transformations.Journal of the Royal Statistical Society Series B-Statistical Methodology, 26:211–252.MATHMathSciNet Box, G. E. P. and Cox, D. R. (1964). An analysis of transformations.Journal of the Royal Statistical Society Series B-Statistical Methodology, 26:211–252.MATHMathSciNet
Zurück zum Zitat Breslow, N. E. and Clayton, D. G. (1993). Approximate inference in generalized linear mixed models.Journal of the American Statistical Association, 88:9–25.MATH Breslow, N. E. and Clayton, D. G. (1993). Approximate inference in generalized linear mixed models.Journal of the American Statistical Association, 88:9–25.MATH
Zurück zum Zitat Brown, L. D. (1986).Fundamentals of Statistical Exponential Families: with Applications in Statistical Decision Theory. Institute of Mathematical Statistics. Brown, L. D. (1986).Fundamentals of Statistical Exponential Families: with Applications in Statistical Decision Theory. Institute of Mathematical Statistics.
Zurück zum Zitat Brownie, C., Anderson, D. R., Burnham, K. P., and Robson, D. S. (1985).Statistical Inference from Band Recovery Data: A Handbook (Second Edition). U.S. Fish and Wildlife Service [U.S. Department of Interior]. Brownie, C., Anderson, D. R., Burnham, K. P., and Robson, D. S. (1985).Statistical Inference from Band Recovery Data: A Handbook (Second Edition). U.S. Fish and Wildlife Service [U.S. Department of Interior].
Zurück zum Zitat Carroll, R. J., Ruppert, D., Stefanski, L. A., and Crainiceanu, C. M. (2006).Measurement error in nonlinear models: a modern perspective. Chapman & Hall. Carroll, R. J., Ruppert, D., Stefanski, L. A., and Crainiceanu, C. M. (2006).Measurement error in nonlinear models: a modern perspective. Chapman & Hall.
Zurück zum Zitat Casella, G. and Berger, R. L. (2002).Statistical Inference. Duxbury Press. Casella, G. and Berger, R. L. (2002).Statistical Inference. Duxbury Press.
Zurück zum Zitat Chernoff, H. and Lehmann, E. L. (1954). The use of maximum likelihood estimates in χ2 tests for goodness of fit.Annals of Mathematical Statistics, 25:579–586.CrossRefMATHMathSciNet Chernoff, H. and Lehmann, E. L. (1954). The use of maximum likelihood estimates in χ2 tests for goodness of fit.Annals of Mathematical Statistics, 25:579–586.CrossRefMATHMathSciNet
Zurück zum Zitat Cox, D. R. (1970).Analysis of binary Data. Chapman & Hall. Cox, D. R. (1970).Analysis of binary Data. Chapman & Hall.
Zurück zum Zitat Cox, D. R. and Snell, E. J. (1989).Analysis of Binary Data. Chapman & Hall Ltd. Cox, D. R. and Snell, E. J. (1989).Analysis of Binary Data. Chapman & Hall Ltd.
Zurück zum Zitat Cressie, N. and Read, T. R. C. (1984). Multinomial goodness-of-fit tests.Journal of the Royal Statistical Society, Series B: Methodological, 46:440–464.MATHMathSciNet Cressie, N. and Read, T. R. C. (1984). Multinomial goodness-of-fit tests.Journal of the Royal Statistical Society, Series B: Methodological, 46:440–464.MATHMathSciNet
Zurück zum Zitat Darmois, G. (1935). The laws of probability to exhaustive estimation.Comptes rendus hebdomadaires des seances de l academie des sciences, 200:1265–1266. Darmois, G. (1935). The laws of probability to exhaustive estimation.Comptes rendus hebdomadaires des seances de l academie des sciences, 200:1265–1266.
Zurück zum Zitat Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977). Maximum likelihood from incomplete data via em algorithm.Journal of the Royal Statistical Society Series B-Methodological, 39:1–38.MATHMathSciNet Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977). Maximum likelihood from incomplete data via em algorithm.Journal of the Royal Statistical Society Series B-Methodological, 39:1–38.MATHMathSciNet
Zurück zum Zitat Efron, B. and Hinkley, D. V. (1978). Assessing the accuracy of the maximum likelihood estimator: Observed versus expected Fisher information (C/R: P482-487).Biometrika, 65:457–481.CrossRefMATHMathSciNet Efron, B. and Hinkley, D. V. (1978). Assessing the accuracy of the maximum likelihood estimator: Observed versus expected Fisher information (C/R: P482-487).Biometrika, 65:457–481.CrossRefMATHMathSciNet
Zurück zum Zitat Embrechts, P. A. L., Pugh, D., and Smith, R. L. (1985).Statistical Extremes and Risks. Course Notes. Imperial College, London, Dept. of Mathematics. Embrechts, P. A. L., Pugh, D., and Smith, R. L. (1985).Statistical Extremes and Risks. Course Notes. Imperial College, London, Dept. of Mathematics.
Zurück zum Zitat Fisher, R. A. (1912). On an absolute criterion for fitting frequency curves.Messenger of Mathematics, 41:155–160. Fisher, R. A. (1912). On an absolute criterion for fitting frequency curves.Messenger of Mathematics, 41:155–160.
Zurück zum Zitat Fisher, R. A. (1922). On the mathematical foundations of theoretical statistics.Philos. Trans. Roy. Soc. London Ser. A, 222:309–368.CrossRefMATH Fisher, R. A. (1922). On the mathematical foundations of theoretical statistics.Philos. Trans. Roy. Soc. London Ser. A, 222:309–368.CrossRefMATH
Zurück zum Zitat Fouskakis, D. and Draper, D. (2002). Stochastic optimization: A review.International Statistical Review, 70(3):315–349.CrossRefMATH Fouskakis, D. and Draper, D. (2002). Stochastic optimization: A review.International Statistical Review, 70(3):315–349.CrossRefMATH
Zurück zum Zitat Graybill, F. A. (1988).Matrices with Applications in Statistics. Wadsworth. Graybill, F. A. (1988).Matrices with Applications in Statistics. Wadsworth.
Zurück zum Zitat Hald, A. (1998).A History of Mathematical Statistics from 1750 to 1930. Wiley, New York.MATH Hald, A. (1998).A History of Mathematical Statistics from 1750 to 1930. Wiley, New York.MATH
Zurück zum Zitat Harville, D. A. (1977). Maximum likelihood approaches to variance component estimation and to related problems (C/R: P338-340).Journal of the American Statistical Association, 72:320–338.CrossRefMATHMathSciNet Harville, D. A. (1977). Maximum likelihood approaches to variance component estimation and to related problems (C/R: P338-340).Journal of the American Statistical Association, 72:320–338.CrossRefMATHMathSciNet
Zurück zum Zitat Hernandez, F. and Johnson, R. A. (1980). The large-sample behavior of transformations to normality.Journal of the American Statistical Association, 75:855–861.CrossRefMATHMathSciNet Hernandez, F. and Johnson, R. A. (1980). The large-sample behavior of transformations to normality.Journal of the American Statistical Association, 75:855–861.CrossRefMATHMathSciNet
Zurück zum Zitat Hinkley, D. V. and Runger, G. (1984). The analysis of transformed data (C/R: P309-320).Journal of the American Statistical Association, 79:302–309.CrossRefMATHMathSciNet Hinkley, D. V. and Runger, G. (1984). The analysis of transformed data (C/R: P309-320).Journal of the American Statistical Association, 79:302–309.CrossRefMATHMathSciNet
Zurück zum Zitat Hirji, K. F., Mehta, C. R., and Patel, N. R. (1987). Computing distributions for exact logistic regression.Journal of the American Statistical Association, 82:1110–1117.CrossRefMATHMathSciNet Hirji, K. F., Mehta, C. R., and Patel, N. R. (1987). Computing distributions for exact logistic regression.Journal of the American Statistical Association, 82:1110–1117.CrossRefMATHMathSciNet
Zurück zum Zitat Johansen, S. (1979).Introduction to the Theory of Regular Exponential Families. University of Copenhagen. Johansen, S. (1979).Introduction to the Theory of Regular Exponential Families. University of Copenhagen.
Zurück zum Zitat Koopman, B. O. (1936). On distributions admitting a sufficient statistic.Transactions of the American Mathematical Society, 39(3):399–409.CrossRefMathSciNet Koopman, B. O. (1936). On distributions admitting a sufficient statistic.Transactions of the American Mathematical Society, 39(3):399–409.CrossRefMathSciNet
Zurück zum Zitat Lambert, D. (1992). Zero-inflated Poisson regression, with an application to defects in manufacturing.Technometrics, 34:1–14.CrossRefMATH Lambert, D. (1992). Zero-inflated Poisson regression, with an application to defects in manufacturing.Technometrics, 34:1–14.CrossRefMATH
Zurück zum Zitat Larsen, R. J. and Marx, M. L. (2001).An Introduction to Mathematical Statistics and Its Applications. Prentice-Hall Inc. Larsen, R. J. and Marx, M. L. (2001).An Introduction to Mathematical Statistics and Its Applications. Prentice-Hall Inc.
Zurück zum Zitat Lawless, J. F. (1982).Statistical Models and Methods for Lifetime Data. John Wiley & Sons. Lawless, J. F. (1982).Statistical Models and Methods for Lifetime Data. John Wiley & Sons.
Zurück zum Zitat Lehmann, E. L. (1983).Theory of Point Estimation. John Wiley & Sons. Lehmann, E. L. (1983).Theory of Point Estimation. John Wiley & Sons.
Zurück zum Zitat Lehmann, E. L. (1986).Testing Statistical Hypotheses. John Wiley & Sons. Lehmann, E. L. (1986).Testing Statistical Hypotheses. John Wiley & Sons.
Zurück zum Zitat Lehmann, E. L. and Casella, G. (1998).Theory of Point Estimation. Springer-Verlag Inc. Lehmann, E. L. and Casella, G. (1998).Theory of Point Estimation. Springer-Verlag Inc.
Zurück zum Zitat Leroux, B. G. and Puterman, M. L. (1992). Maximum-penalized-likelihood estimation for independent and Markov-dependent mixture models.Biometrics, 48:545–558.CrossRef Leroux, B. G. and Puterman, M. L. (1992). Maximum-penalized-likelihood estimation for independent and Markov-dependent mixture models.Biometrics, 48:545–558.CrossRef
Zurück zum Zitat Lindley, D. V. and Phillips, L. D. (1976). Inference for a Bernoulli process (A Bayesian view).The American Statistician, 30:112–119.MATHMathSciNet Lindley, D. V. and Phillips, L. D. (1976). Inference for a Bernoulli process (A Bayesian view).The American Statistician, 30:112–119.MATHMathSciNet
Zurück zum Zitat Lindsay, B. G. (1994). Efficiency versus robustness: The case for minimum Hellinger distance and related methods.The Annals of Statistics, 22:1081–1114.CrossRefMATHMathSciNet Lindsay, B. G. (1994). Efficiency versus robustness: The case for minimum Hellinger distance and related methods.The Annals of Statistics, 22:1081–1114.CrossRefMATHMathSciNet
Zurück zum Zitat Little, R. J. A. and Rubin, D. B. (1987).Statistical Analysis with Missing Data. J. Wiley & Sons. Little, R. J. A. and Rubin, D. B. (1987).Statistical Analysis with Missing Data. J. Wiley & Sons.
Zurück zum Zitat Makelainen, T., Schmidt, K., and Styan, G. P. H. (1981). On the existence and uniqueness of the maximum-likelihood estimate of a vector-valued parameter in fixed-size samples.Annals of Statistics, 9:758–767.CrossRefMathSciNet Makelainen, T., Schmidt, K., and Styan, G. P. H. (1981). On the existence and uniqueness of the maximum-likelihood estimate of a vector-valued parameter in fixed-size samples.Annals of Statistics, 9:758–767.CrossRefMathSciNet
Zurück zum Zitat McCullagh, P. (1997). Linear models, vector spaces, and residual likelihood. In Gregoire, T. G., Brillinger, D. R., Diggle, P. J., Russek-Cohen, E., Warren, W. G., and Wolfinger, R. D., editors,Modelling Longitudinal and Spatially Correlated Data: Methods, Applications, and Future Directions. Lecture Notes in Statistics, Vol. 122, pages 1–10. Springer-Verlag Inc. McCullagh, P. (1997). Linear models, vector spaces, and residual likelihood. In Gregoire, T. G., Brillinger, D. R., Diggle, P. J., Russek-Cohen, E., Warren, W. G., and Wolfinger, R. D., editors,Modelling Longitudinal and Spatially Correlated Data: Methods, Applications, and Future Directions. Lecture Notes in Statistics, Vol. 122, pages 1–10. Springer-Verlag Inc.
Zurück zum Zitat McLachlan, G.J. & Krishnan, T. (1997).The EM Algorithm and Extensions. J. Wiley & Sons. McLachlan, G.J. & Krishnan, T. (1997).The EM Algorithm and Extensions. J. Wiley & Sons.
Zurück zum Zitat Messig, M. A. and Strawderman, W. E. (1993). Minimal sufficiency and completeness for dichotomous quantal response models.The Annals of Statistics, 21:2149–2157.CrossRefMATHMathSciNet Messig, M. A. and Strawderman, W. E. (1993). Minimal sufficiency and completeness for dichotomous quantal response models.The Annals of Statistics, 21:2149–2157.CrossRefMATHMathSciNet
Zurück zum Zitat Monahan, J. F. (2001).Numerical Methods of Statistics. Cambridge University Press. Monahan, J. F. (2001).Numerical Methods of Statistics. Cambridge University Press.
Zurück zum Zitat Nelder, J. A. and Wedderburn, R. W. M. (1972). Generalized linear models.Journal of the Royal Statistical Society, Series A: General, 135:370–384.CrossRef Nelder, J. A. and Wedderburn, R. W. M. (1972). Generalized linear models.Journal of the Royal Statistical Society, Series A: General, 135:370–384.CrossRef
Zurück zum Zitat Neyman, J. and Scott, E. L. (1948). Consistent estimates based on partially consistent observations.Econometrica, 16:1–32.CrossRefMathSciNet Neyman, J. and Scott, E. L. (1948). Consistent estimates based on partially consistent observations.Econometrica, 16:1–32.CrossRefMathSciNet
Zurück zum Zitat Pace, L. and Salvan, A. (1997).Principles of Statistical Inference: from a Neo-Fisherian Perspective. World Scientific Publishing Company. Pace, L. and Salvan, A. (1997).Principles of Statistical Inference: from a Neo-Fisherian Perspective. World Scientific Publishing Company.
Zurück zum Zitat Pirazzoli, P. A. (1982). Maree estreme a venezia (periodo 1872-1981).Acqua Aria, 10:1023–1029. Pirazzoli, P. A. (1982). Maree estreme a venezia (periodo 1872-1981).Acqua Aria, 10:1023–1029.
Zurück zum Zitat Pitman, E. J. G. (1936). Sufficient statistics and intrinsic accuracy.Proc. Camb. Phil. Soc., 32:567–579.CrossRef Pitman, E. J. G. (1936). Sufficient statistics and intrinsic accuracy.Proc. Camb. Phil. Soc., 32:567–579.CrossRef
Zurück zum Zitat Quesenberry, C. P. (1975). Transforming samples from truncation parameter distributions to uniformity.Communications in Statistics, 4:1149–1156.CrossRefMathSciNet Quesenberry, C. P. (1975). Transforming samples from truncation parameter distributions to uniformity.Communications in Statistics, 4:1149–1156.CrossRefMathSciNet
Zurück zum Zitat Read, T. R. C. and Cressie, N. A. C. (1988).Goodness-of-fit Statistics for Discrete Multivariate Data. Springer-Verlag Inc. Read, T. R. C. and Cressie, N. A. C. (1988).Goodness-of-fit Statistics for Discrete Multivariate Data. Springer-Verlag Inc.
Zurück zum Zitat Siegel, A. F. (1985). Modelling data containing exact zeroes using zero degrees of freedom.Journal of the Royal Statistical Society, Series B: Methodological, 47:267–271.MATHMathSciNet Siegel, A. F. (1985). Modelling data containing exact zeroes using zero degrees of freedom.Journal of the Royal Statistical Society, Series B: Methodological, 47:267–271.MATHMathSciNet
Zurück zum Zitat Simpson, D. G. (1987). Minimum Hellinger distance estimation for the analysis of count data.Journal of the American Statistical Association, 82:802–807.CrossRefMATHMathSciNet Simpson, D. G. (1987). Minimum Hellinger distance estimation for the analysis of count data.Journal of the American Statistical Association, 82:802–807.CrossRefMATHMathSciNet
Zurück zum Zitat Stefanski, L. A. and Carroll, R. J. (1987). Conditional scores and optimal scores for generalized linear measurement-error models.Biometrika, 74:703–716.MATHMathSciNet Stefanski, L. A. and Carroll, R. J. (1987). Conditional scores and optimal scores for generalized linear measurement-error models.Biometrika, 74:703–716.MATHMathSciNet
Zurück zum Zitat Tsiatis, A. A. and Davidian, M. (2001). A semiparametric estimator for the proportional hazards model with longitudinal covariates measured with error.Biometrika, 88:447–458.CrossRefMATHMathSciNet Tsiatis, A. A. and Davidian, M. (2001). A semiparametric estimator for the proportional hazards model with longitudinal covariates measured with error.Biometrika, 88:447–458.CrossRefMATHMathSciNet
Zurück zum Zitat Weir, B. S. (1996).Genetic Data Analysis 2: Methods for Discrete Population Genetic Data. Sunderland: Sinauer Associates. Weir, B. S. (1996).Genetic Data Analysis 2: Methods for Discrete Population Genetic Data. Sunderland: Sinauer Associates.
Metadaten
Titel
Likelihood Construction and Estimation
verfasst von
Denni D Boos
L A Stefanski
Copyright-Jahr
2013
Verlag
Springer New York
DOI
https://doi.org/10.1007/978-1-4614-4818-1_2

Premium Partner