Skip to main content

2016 | OriginalPaper | Buchkapitel

Labeled Phrase Latent Dirichlet Allocation

verfasst von : Yi-Kun Tang, Xian-Ling Mao, Heyan Huang

Erschienen in: Web Information Systems Engineering – WISE 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In recent years, topic modeling, such as Latent Dirichlet Allocation (LDA) and its variations, has been widely used to discover the abstract topics in text corpora. There are two state-of-the-art topic models: Labeled LDA (LLDA) and PhraseLDA. LLDA is a supervised generative model which considers the label information, but it does not take into consideration word order under the bag-of-words assumption. On the contrary, PhraseLDA regards each document as a mixture of phrases, which partly considers the word order. However, PhraseLDA cannot model the supervised label information. In this paper, in order to overcome the defects of two models above while combining their merits, we propose a novel topic model, called Labeled Phrase LDA, which synchronously considers the supervised information and word order. Lots of experiments were conducted among the proposed model and two state-of-the-art models, which show the proposed model significantly outperforms baselines in terms of case study, perplexity and scalability.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Blei, D., Ng, A., Jordan, M.: Latent dirichlet allocation. J. Mach. Learn. Res., 993–1022 (2003) Blei, D., Ng, A., Jordan, M.: Latent dirichlet allocation. J. Mach. Learn. Res., 993–1022 (2003)
2.
Zurück zum Zitat Ramage, D., et al.: Labeled LDA: a supervised topic model for credit attribution in multi-labeled corpora. Empirical Methods in Natural Language Processing (2009) Ramage, D., et al.: Labeled LDA: a supervised topic model for credit attribution in multi-labeled corpora. Empirical Methods in Natural Language Processing (2009)
3.
Zurück zum Zitat Elkishky, A., et al.: Scalable topical phrase mining from text corpora. In: Proceedings of the Vldb Endowment 8.3, pp. 305–316 (2014) Elkishky, A., et al.: Scalable topical phrase mining from text corpora. In: Proceedings of the Vldb Endowment 8.3, pp. 305–316 (2014)
4.
Zurück zum Zitat Blei, D., Mcauliffe, J.: Supervised Topic Models. Neural Information Processing Systems (2008) Blei, D., Mcauliffe, J.: Supervised Topic Models. Neural Information Processing Systems (2008)
5.
Zurück zum Zitat Lacostejulien, S., Sha, F., Ijordan, M.: DiscLDA: discriminative learning for dimensionality reduction and classification. In: Neural Information Processing Systems (2009) Lacostejulien, S., Sha, F., Ijordan, M.: DiscLDA: discriminative learning for dimensionality reduction and classification. In: Neural Information Processing Systems (2009)
6.
Zurück zum Zitat Ramage, D., et al.: Clustering the tagged web. In: Web Search and Data Mining (2009) Ramage, D., et al.: Clustering the tagged web. In: Web Search and Data Mining (2009)
7.
Zurück zum Zitat Rosenzvi, M., et al.: The author-topic model for authors and documents. In: Uncertainty in Artificial Intelligence (2004) Rosenzvi, M., et al.: The author-topic model for authors and documents. In: Uncertainty in Artificial Intelligence (2004)
8.
Zurück zum Zitat Nrubin, T., et al.: Statistical topic models for multi-label document classification. Mach. Learn. 88(1), 157–208 (2012)MathSciNet Nrubin, T., et al.: Statistical topic models for multi-label document classification. Mach. Learn. 88(1), 157–208 (2012)MathSciNet
9.
Zurück zum Zitat Xiao, H., Wang, X., Du, C.: Injecting structured data to generative topic model in enterprise settings. In: Asian Conference on Machine Learning (2009) Xiao, H., Wang, X., Du, C.: Injecting structured data to generative topic model in enterprise settings. In: Asian Conference on Machine Learning (2009)
10.
Zurück zum Zitat Ramage, D., Dmanning, C., Tdumais, S.: Partially labeled topic models for interpretable text mining. In: Knowledge Discovery and Data Mining (2011) Ramage, D., Dmanning, C., Tdumais, S.: Partially labeled topic models for interpretable text mining. In: Knowledge Discovery and Data Mining (2011)
11.
Zurück zum Zitat Wang, X., Mccallum, A., Wei, X.: Topical N-Grams: phrase and topic discovery, with an application to information retrieval. In: International Conference on Data Mining (2007) Wang, X., Mccallum, A., Wei, X.: Topical N-Grams: phrase and topic discovery, with an application to information retrieval. In: International Conference on Data Mining (2007)
12.
Zurück zum Zitat Vlindsey, R., Pheadden, W., Jstipicevic, M.: A phrase-discovering topic model using hierarchical pitman-yor processes. In: Empirical Methods in Natural Language Processing (2012) Vlindsey, R., Pheadden, W., Jstipicevic, M.: A phrase-discovering topic model using hierarchical pitman-yor processes. In: Empirical Methods in Natural Language Processing (2012)
13.
Zurück zum Zitat Xiao, X., et al.: A topic similarity model for hierarchical phrase-based translation (2012) Xiao, X., et al.: A topic similarity model for hierarchical phrase-based translation (2012)
14.
Zurück zum Zitat Wang, C., et al.: A phrase mining framework for recursive construction of a topical hierarchy. In: Knowledge Discovery and Data Mining (2013) Wang, C., et al.: A phrase mining framework for recursive construction of a topical hierarchy. In: Knowledge Discovery and Data Mining (2013)
15.
Zurück zum Zitat Petinot, Y., Mckeown, K., Thadani, K.: A hierarchical model of web summaries. In: Meeting of the Association for Computational Linguistics (2011) Petinot, Y., Mckeown, K., Thadani, K.: A hierarchical model of web summaries. In: Meeting of the Association for Computational Linguistics (2011)
16.
Zurück zum Zitat Perotte, A., et al.: Hierarchically supervised latent Dirichlet allocation. In: Neural Information Processing Systems (2011) Perotte, A., et al.: Hierarchically supervised latent Dirichlet allocation. In: Neural Information Processing Systems (2011)
17.
Zurück zum Zitat Mao, X., et al.: SSHLDA: a semi-supervised hierarchical topic model. In: Empirical Methods in Natural Language Processing (2012) Mao, X., et al.: SSHLDA: a semi-supervised hierarchical topic model. In: Empirical Methods in Natural Language Processing (2012)
18.
Zurück zum Zitat Deerwester, S., et al.: Indexing by latent semantic analysis. J. Am. Soc. Inf. Sci. 41(6), 391–407 (1990)CrossRef Deerwester, S., et al.: Indexing by latent semantic analysis. J. Am. Soc. Inf. Sci. 41(6), 391–407 (1990)CrossRef
19.
Zurück zum Zitat Hofmann, T.: Probabilistic latent semantic indexing. In: International ACM SIGIR Conference on Research and Development in Information Retrieval (1999) Hofmann, T.: Probabilistic latent semantic indexing. In: International ACM SIGIR Conference on Research and Development in Information Retrieval (1999)
20.
Zurück zum Zitat Lgriffiths, T., et al.: Hierarchical topic models and the nested chinese restaurant process. In: Neural Information Processing Systems (2004) Lgriffiths, T., et al.: Hierarchical topic models and the nested chinese restaurant process. In: Neural Information Processing Systems (2004)
21.
Zurück zum Zitat Whyeteh, Y., et al.: Hierarchical Dirichlet processes. J. Am. Stat. Assoc., 1566–1581 (2012) Whyeteh, Y., et al.: Hierarchical Dirichlet processes. J. Am. Stat. Assoc., 1566–1581 (2012)
22.
Zurück zum Zitat Li, W., Mccallum, A.: Pachinko allocation (DAG-structured mixture models of topic correlations). In: Machine Learning (2006) Li, W., Mccallum, A.: Pachinko allocation (DAG-structured mixture models of topic correlations). In: Machine Learning (2006)
Metadaten
Titel
Labeled Phrase Latent Dirichlet Allocation
verfasst von
Yi-Kun Tang
Xian-Ling Mao
Heyan Huang
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-48740-3_39

Premium Partner