Skip to main content

2014 | OriginalPaper | Buchkapitel

6. Mixture Models

verfasst von : Jean-Michel Marin, Christian P. Robert

Erschienen in: Bayesian Essentials with R

Verlag: Springer New York

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter covers a class of models where a rather simple distribution is made more complex and less informative by a mechanism that mixes together several known or unknown distributions. This representation is naturally called a mixture of distributions, as illustrated above. Inference about the parameters of the elements of the mixtures and the weights is called mixture estimation, while recovery of the original distribution of each observation is called classification (or, more exactly, unsupervised classification to distinguish it from the supervised classification to be discussed in Chap. 8).

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
This is not a definition in the mathematical sense since all densities can formally be represented that way. We thus stress that the model itself must be introduced that way. This point is not to be mistaken for a requirement that the variable z be meaningful for the data at hand. In many cases, for instance the probit model, the missing variable representation remains formal.
 
2
We will see later that the missing structure of a mixture actually need not be simulated but, for more complex missing-variable structures like hidden Markov models (introduced in Chap.​ 7), this completion cannot be avoided.
 
3
The Frenchman Alphonse Bertillon is also the father of scientific police investigation. For instance, he originated the use of fingerprints in criminal investigations.
 
4
To get a better understanding of this second mode, consider the limiting setting when p = 0.5. In that case, there are two equivalent modes of the likelihood, \((\mu _{1},\mu _{2})\) and \((\mu _{2},\mu _{1})\). As p moves away from 0.5, this second mode gets lower and lower compared with the other mode, but it still remains.
 
5
In non-Bayesian statistics, the EM algorithm is certainly the most ubiquitous numerical method, even though it only applies to (real or artificial) missing variable models.
 
6
Historically, missing-variable models constituted one of the first instances where the Gibbs sampler was used by completing the missing variables by simulation under the name of data augmentation (see Tanner, 1996, and Robert and Casella, 2004, Chaps. 9 and 10).
 
7
That this is a natural estimate of the model, compared with the “plug-in” density using the estimates of the parameters, will be explained more clearly in Sect. 6.5.
 
8
In practice, the Gibbs sampler never leaves the vicinity of a given mode if the attraction of this mode is strong enough, for instance in the case of many observations.
 
9
While this resolution seems intuitive enough, there is still a lot of debate in academic circles on whether or not label switching should be observed on an MCMC output and, in case it should, on which substitute to the posterior mean should be used.
 
10
This section may be skipped by most readers, as it only addresses the very specific issue of handling improper priors in mixture estimation.
 
11
By nature, ill-posed problems are not precisely defined. They cover classes of models such as inverse problems, where the complexity of getting back from the data to the parameters is huge. They are not to be confused with nonidentifiable problems, though.
 
Literatur
Zurück zum Zitat Frühwirth-Schnatter, S. (2006). Finite Mixture and Markov Switching Models. Springer-Verlag, New York, New York.MATH Frühwirth-Schnatter, S. (2006). Finite Mixture and Markov Switching Models. Springer-Verlag, New York, New York.MATH
Zurück zum Zitat Gelfand, A. and Dey, D. (1994). Bayesian model choice: asymptotics and exact calculations. J. Royal Statist. Society Series B, 56:501–514.MathSciNetMATH Gelfand, A. and Dey, D. (1994). Bayesian model choice: asymptotics and exact calculations. J. Royal Statist. Society Series B, 56:501–514.MathSciNetMATH
Zurück zum Zitat Hjort, N., Holmes, C., Müller, P., and Walker, S. (2010). Bayesian Nonparametrics. Cambridge University Press, Cambridge.CrossRefMATH Hjort, N., Holmes, C., Müller, P., and Walker, S. (2010). Bayesian Nonparametrics. Cambridge University Press, Cambridge.CrossRefMATH
Zurück zum Zitat Marin, J.-M. and Robert, C. (2007). Bayesian Core. Springer-Verlag, New York.MATH Marin, J.-M. and Robert, C. (2007). Bayesian Core. Springer-Verlag, New York.MATH
Zurück zum Zitat Robert, C. and Casella, G. (2004). Monte Carlo Statistical Methods. Springer-Verlag, New York, second edition. Robert, C. and Casella, G. (2004). Monte Carlo Statistical Methods. Springer-Verlag, New York, second edition.
Zurück zum Zitat Tanner, M. (1996). Tools for Statistical Inference: Observed Data and Data Augmentation Methods. Springer-Verlag, New York, third edition. Tanner, M. (1996). Tools for Statistical Inference: Observed Data and Data Augmentation Methods. Springer-Verlag, New York, third edition.
Metadaten
Titel
Mixture Models
verfasst von
Jean-Michel Marin
Christian P. Robert
Copyright-Jahr
2014
Verlag
Springer New York
DOI
https://doi.org/10.1007/978-1-4614-8687-9_6