Skip to main content

2017 | OriginalPaper | Buchkapitel

A Comparative Study on Lagrange Ying-Yang Alternation Method in Gaussian Mixture-Based Clustering

verfasst von : Weijian Long, Shikui Tu, Lei Xu

Erschienen in: Intelligent Data Engineering and Automated Learning – IDEAL 2017

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Gaussian Mixture Model (GMM) has been applied to clustering with wide applications in image segmentation, object detection and so on. Many algorithms were proposed to learn GMM with appropriate number of Gaussian components automatically determined. Lagrange Ying-Yang alternation method (LYYA) is one of them and it has advantages of no priors as well as the posterior probability bounded by traditional probability space. This paper aims to investigate the performance of LYYA, in comparisons with other methods including Bayesian Ying-Yang (BYY) learning, Rival penalized competitive learning (RPCL), hard-cut Expectation Maximization (EM) method, and classic EM with Bayesian Information Criterion (BIC). Systematic simulations show that LYYA is generally more robust than others on the data generated by varying sample size, data dimensionality and real components number. Unsupervised image segmentation results on Berkeley datasets also confirm LYYA advantages when comparing to the Mean shift and Multiscale graph decomposition algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Constantinopoulos, C., Titsias, M.K., Likas, A.: Bayesian feature and model selection for Gaussian mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 28(6), 1013–1018 (2006)CrossRef Constantinopoulos, C., Titsias, M.K., Likas, A.: Bayesian feature and model selection for Gaussian mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 28(6), 1013–1018 (2006)CrossRef
2.
Zurück zum Zitat Xu, L., Krzyzak, A., Oja, E.: Rival penalized competitive learning for clustering analysis, RBF net and curve detection. IEEE Trans. Neural Netw. 4(4), 636–649 (1993)CrossRef Xu, L., Krzyzak, A., Oja, E.: Rival penalized competitive learning for clustering analysis, RBF net and curve detection. IEEE Trans. Neural Netw. 4(4), 636–649 (1993)CrossRef
3.
Zurück zum Zitat Xu, L.: Bayesian-Kullback coupled Ying-Yang machines: unified learnings and new results on vector quantization. In: Proceedings of International Conference on Neural Information Processing, pp. 977–988 (1995) Xu, L.: Bayesian-Kullback coupled Ying-Yang machines: unified learnings and new results on vector quantization. In: Proceedings of International Conference on Neural Information Processing, pp. 977–988 (1995)
4.
Zurück zum Zitat Figueiredo, M.A.T., Jain, A.K.: Unsupervised learning of finite mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 381–396 (2002)CrossRef Figueiredo, M.A.T., Jain, A.K.: Unsupervised learning of finite mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 381–396 (2002)CrossRef
5.
Zurück zum Zitat Jaakkola, T.S., Jordan, M.I.: Bayesian parameter estimation via variational methods. Stat. Comput. 10(1), 25–37 (2000)CrossRef Jaakkola, T.S., Jordan, M.I.: Bayesian parameter estimation via variational methods. Stat. Comput. 10(1), 25–37 (2000)CrossRef
6.
Zurück zum Zitat Shi, L., Tu, S., Xu, L.: Learning Gaussian mixture with automatic model selection: A comparative study on three Bayesian related approaches. A special issue on Machine learning and intelligence science: IScIDE2010 (B). J. Front. Electr. Electron. Eng. China 6(2), 215–244 (2011)CrossRef Shi, L., Tu, S., Xu, L.: Learning Gaussian mixture with automatic model selection: A comparative study on three Bayesian related approaches. A special issue on Machine learning and intelligence science: IScIDE2010 (B). J. Front. Electr. Electron. Eng. China 6(2), 215–244 (2011)CrossRef
7.
Zurück zum Zitat Chen, G., Heng, P.A., Xu, L.: Projection-embedded BYY learning algorithm for Gaussian mixture-based clustering. SpringerOpen J. Appl. Inform. 1(2) (2014) Chen, G., Heng, P.A., Xu, L.: Projection-embedded BYY learning algorithm for Gaussian mixture-based clustering. SpringerOpen J. Appl. Inform. 1(2) (2014)
8.
Zurück zum Zitat Xu, L.: Further advances on Bayesian Ying-Yang harmony learning. SpringerOpen J. Appl. Inform. 2(5), (2015) Xu, L.: Further advances on Bayesian Ying-Yang harmony learning. SpringerOpen J. Appl. Inform. 2(5), (2015)
9.
Zurück zum Zitat Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603–619 (2002)CrossRef Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603–619 (2002)CrossRef
10.
Zurück zum Zitat Carson, C., Belongie, S., Greenspan, H., Malik, J.: Blobworld: image segmentation using expectation-maximization and its application to image querying. IEEE Trans. Pattern Anal. Mach. Intell. 24(8), 1026–1038 (2002)CrossRef Carson, C., Belongie, S., Greenspan, H., Malik, J.: Blobworld: image segmentation using expectation-maximization and its application to image querying. IEEE Trans. Pattern Anal. Mach. Intell. 24(8), 1026–1038 (2002)CrossRef
11.
Zurück zum Zitat Nikou, C., Likas, A.C., Galatsanos, N.P.: A Bayesian framework for image segmentation with spatially varying mixtures. IEEE Trans. Image Process. Publ. IEEE Sig. Process. Soc. 19(9), 2278–2289 (2010)MathSciNetCrossRef Nikou, C., Likas, A.C., Galatsanos, N.P.: A Bayesian framework for image segmentation with spatially varying mixtures. IEEE Trans. Image Process. Publ. IEEE Sig. Process. Soc. 19(9), 2278–2289 (2010)MathSciNetCrossRef
12.
Zurück zum Zitat Cour, T., Bènèzit, F., Shi, J.: Spectral segmentation with multiscale graph decomposition. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn. 2(2), 1124–1131 (2005) Cour, T., Bènèzit, F., Shi, J.: Spectral segmentation with multiscale graph decomposition. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn. 2(2), 1124–1131 (2005)
13.
Zurück zum Zitat Carpineto, C., Romano, G.: Consensus clustering based on a new probabilistic rand index with application to subtopic retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2315–2326 (2012)CrossRef Carpineto, C., Romano, G.: Consensus clustering based on a new probabilistic rand index with application to subtopic retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2315–2326 (2012)CrossRef
Metadaten
Titel
A Comparative Study on Lagrange Ying-Yang Alternation Method in Gaussian Mixture-Based Clustering
verfasst von
Weijian Long
Shikui Tu
Lei Xu
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-68935-7_53

Premium Partner