Skip to main content

2016 | OriginalPaper | Buchkapitel

Indirect Maximum Likelihood Estimation

verfasst von : Daniel Berend, Luba Sapir

Erschienen in: Optimization and Its Applications in Control and Data Sciences

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We study maximum likelihood estimators (henceforth MLE) in experiments consisting of two stages, where the first-stage sample is unknown to us, but the second-stage samples are known and depend on the first-stage sample. The setup is similar to that in parametric empirical Bayes models, and arises naturally in numerous applications. However, problems arise when the number of second-level observations is not the same for all first-stage observations. As far as we know, this situation has been discussed in very few cases (see Brandel, Empirical Bayes methods for missing data analysis. Technical Report 2004:11, Department of Mathematics, Uppsala University, Sweden, 2004 and Carlin and Louis, Bayes and Empirical Bayes Methods for Data Analysis, 2nd edn. Chapman & Hall, Boca Raton, 2000) and no analytic expression for the indirect maximum likelihood estimator was derived there. The novelty of our paper is that it details and exemplifies this point. Specifically, we study in detail two situations:
1.
Both levels correspond to normal distributions; here we are able to find an explicit formula for the MLE and show that it forms uniformly minimum-variance unbiased estimator (henceforth UMVUE).
 
2.
Exponential first-level and Poissonian second-level; here the MLE can usually be expressed only implicitly as a solution of a certain polynomial equation. It seems that the MLE is usually not a UMVUE.
 
In both cases we discuss the intuitive meaning of our estimator, its properties, and show its advantages vis-\(\grave{\mathrm{a}}\)-vis other natural estimators.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aït-Sahalia, Y., Kimmela, R.: Maximum likelihood estimation of stochastic volatility models. J. Financ. Econ. 83 (2), 413–452 (2007)CrossRef Aït-Sahalia, Y., Kimmela, R.: Maximum likelihood estimation of stochastic volatility models. J. Financ. Econ. 83 (2), 413–452 (2007)CrossRef
2.
Zurück zum Zitat Anderson, M.P., Woessner, W.W.: Applied Groundwater Modeling: Simulation of Flow and Advective Transport, 2nd edn. Academc, New York (1992) Anderson, M.P., Woessner, W.W.: Applied Groundwater Modeling: Simulation of Flow and Advective Transport, 2nd edn. Academc, New York (1992)
3.
Zurück zum Zitat Assefi, T.: Stochastic Processes and Estimation Theory with Applications. Wiley, New York (1979)MATH Assefi, T.: Stochastic Processes and Estimation Theory with Applications. Wiley, New York (1979)MATH
4.
Zurück zum Zitat Ayebo, A., Kozubowski, T.J.: An asymmetric generalization of Gaussian and Laplace laws. J. Probab. Stat. Sci. 1 (2), 187–210 (2003) Ayebo, A., Kozubowski, T.J.: An asymmetric generalization of Gaussian and Laplace laws. J. Probab. Stat. Sci. 1 (2), 187–210 (2003)
5.
Zurück zum Zitat Berouti, M., Schwartz, R., Makhoul, J.: Enhancement of speech corrupted by acoustic noise. In: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), vol. 4, pp.208–211 (1979) Berouti, M., Schwartz, R., Makhoul, J.: Enhancement of speech corrupted by acoustic noise. In: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), vol. 4, pp.208–211 (1979)
6.
Zurück zum Zitat Bishop, C.M.: Latent variable models. In: Jordan, M. (ed.) Learning in Graphical Models, pp. 371–403. MIT, London (1999) Bishop, C.M.: Latent variable models. In: Jordan, M. (ed.) Learning in Graphical Models, pp. 371–403. MIT, London (1999)
7.
Zurück zum Zitat Brenner, J.L.: A unified treatment and extension of some means of classical analysis–I: comparison theorems. J. Combin. Inform. Syst. Sci. 3, 175–199 (1978)MathSciNetMATH Brenner, J.L.: A unified treatment and extension of some means of classical analysis–I: comparison theorems. J. Combin. Inform. Syst. Sci. 3, 175–199 (1978)MathSciNetMATH
8.
Zurück zum Zitat Brandel, J.: Empirical Bayes methods for missing data analysis. Technical Report 2004:11, Department of Mathematics, Uppsala University, Sweden (2004) Brandel, J.: Empirical Bayes methods for missing data analysis. Technical Report 2004:11, Department of Mathematics, Uppsala University, Sweden (2004)
9.
Zurück zum Zitat Carlin, B.P., Louis, T.A.: Bayes and Empirical Bayes Methods for Data Analysis, 2nd edn. Chapman & Hall, Boca Raton (2000)CrossRefMATH Carlin, B.P., Louis, T.A.: Bayes and Empirical Bayes Methods for Data Analysis, 2nd edn. Chapman & Hall, Boca Raton (2000)CrossRefMATH
10.
11.
Zurück zum Zitat DeGroot, M.: Probability and Statistics, 2nd edn. Addison-Wesley, Boston (1986)MATH DeGroot, M.: Probability and Statistics, 2nd edn. Addison-Wesley, Boston (1986)MATH
12.
Zurück zum Zitat Douarche, F., Buisson, L., Ciliberto, S., Petrosyan, A.: A simple noise subtraction technique. Rev. Sci. Instrum. 75 (12), 5084–5089 (2004)CrossRef Douarche, F., Buisson, L., Ciliberto, S., Petrosyan, A.: A simple noise subtraction technique. Rev. Sci. Instrum. 75 (12), 5084–5089 (2004)CrossRef
13.
Zurück zum Zitat Gertsbakh, I.: Reliability Theory: With Applications to Preventive Maintenance. Springer, New York (2000)MATH Gertsbakh, I.: Reliability Theory: With Applications to Preventive Maintenance. Springer, New York (2000)MATH
14.
Zurück zum Zitat Gourieroux, C., Monfort, A., Renault, E.: Indirect inference. J. Appl. Econ. 8, S85–S118 (1993)CrossRefMATH Gourieroux, C., Monfort, A., Renault, E.: Indirect inference. J. Appl. Econ. 8, S85–S118 (1993)CrossRefMATH
15.
Zurück zum Zitat Hardy, G.H., Littlewood, J.E., Pólya, G.: Inequalities, 2nd edn. Cambridge University Press, Cambridge (1952)MATH Hardy, G.H., Littlewood, J.E., Pólya, G.: Inequalities, 2nd edn. Cambridge University Press, Cambridge (1952)MATH
16.
Zurück zum Zitat Ideker, T., Thorsson, V., Siegel, A.F., Hood, L.E.: Testing for differentially-expressed genes by maximum-likelihood analysis of microarray data. J. Comput. Biol. 7 (6), 805–817 (2000)CrossRef Ideker, T., Thorsson, V., Siegel, A.F., Hood, L.E.: Testing for differentially-expressed genes by maximum-likelihood analysis of microarray data. J. Comput. Biol. 7 (6), 805–817 (2000)CrossRef
17.
Zurück zum Zitat Jøsang, A., Ismail, R.: The beta reputation system. In: Proceedings of the 15-th Bled Conference on Electronic Commerce, Bled, Slovenia, pp.17–19 (2002) Jøsang, A., Ismail, R.: The beta reputation system. In: Proceedings of the 15-th Bled Conference on Electronic Commerce, Bled, Slovenia, pp.17–19 (2002)
18.
Zurück zum Zitat Jøsang, A., Haller, J.: Dirichlet reputation systems. In: Proceedings of the Second International Conference on Availability, Reliability and Security (ARES 2007), Vienna, pp.112–119 (2007) Jøsang, A., Haller, J.: Dirichlet reputation systems. In: Proceedings of the Second International Conference on Availability, Reliability and Security (ARES 2007), Vienna, pp.112–119 (2007)
19.
Zurück zum Zitat Kagan, A., Li, B.: An identity for the Fisher information and Mahalanobis distance. J. Stat. Plann. Inference 138 (12), 3950–3959 (2008)MathSciNetCrossRefMATH Kagan, A., Li, B.: An identity for the Fisher information and Mahalanobis distance. J. Stat. Plann. Inference 138 (12), 3950–3959 (2008)MathSciNetCrossRefMATH
20.
Zurück zum Zitat Lehmann, E.L., Casella, G.: Theory of Point Estimation, 2nd edn. Springer, New York (1998)MATH Lehmann, E.L., Casella, G.: Theory of Point Estimation, 2nd edn. Springer, New York (1998)MATH
21.
Zurück zum Zitat Linhard, K., Haulick, T.: Spectral noise subtraction with recursive gain curves. In: Fifth International Conference on Spoken Language Processing, (ICSLP-1998), paper 0109, Sydney (1998) Linhard, K., Haulick, T.: Spectral noise subtraction with recursive gain curves. In: Fifth International Conference on Spoken Language Processing, (ICSLP-1998), paper 0109, Sydney (1998)
22.
Zurück zum Zitat Maritz, J. S., Lwin, T.: Assessing the performance of empirical Bayes estimators. Ann. Inst. Stat. Math. 44 (4), 641–657 (1992)MathSciNetCrossRefMATH Maritz, J. S., Lwin, T.: Assessing the performance of empirical Bayes estimators. Ann. Inst. Stat. Math. 44 (4), 641–657 (1992)MathSciNetCrossRefMATH
23.
Zurück zum Zitat Mood, A.M., Graybill, F., Boes, D.: Introduction to the Theory of Statistics, 3rd edn. McGraw Hill, Singapore (1974)MATH Mood, A.M., Graybill, F., Boes, D.: Introduction to the Theory of Statistics, 3rd edn. McGraw Hill, Singapore (1974)MATH
24.
Zurück zum Zitat Shi, G., Nehorai, A.: Maximum likelihood estimation of point scatterers for computational time-reversal imaging. Commun. Inform. Syst. 5 (2), 227–256 (2005)MathSciNetCrossRefMATH Shi, G., Nehorai, A.: Maximum likelihood estimation of point scatterers for computational time-reversal imaging. Commun. Inform. Syst. 5 (2), 227–256 (2005)MathSciNetCrossRefMATH
25.
26.
Zurück zum Zitat Tuchler, M., Singer, A.C., Koetter, R.: Minimum mean squared error equalization using a priori information. IEEE Trans. Signal Process. 50 (3), 673–683 (2002)CrossRef Tuchler, M., Singer, A.C., Koetter, R.: Minimum mean squared error equalization using a priori information. IEEE Trans. Signal Process. 50 (3), 673–683 (2002)CrossRef
27.
Zurück zum Zitat Walter, G.G., Hamedani, G.G.: Bayes empirical Bayes estimation for discrete exponential families. Ann. Inst. Stat. Math. 41 (1), 101–119 (1989)MathSciNetMATH Walter, G.G., Hamedani, G.G.: Bayes empirical Bayes estimation for discrete exponential families. Ann. Inst. Stat. Math. 41 (1), 101–119 (1989)MathSciNetMATH
Metadaten
Titel
Indirect Maximum Likelihood Estimation
verfasst von
Daniel Berend
Luba Sapir
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-42056-1_4