Skip to main content

2018 | OriginalPaper | Buchkapitel

Semi-supervised Sentiment Classification Based on Auxiliary Task Learning

verfasst von : Huan Liu, Jingjing Wang, Shoushan Li, Junhui Li, Guodong Zhou

Erschienen in: Natural Language Processing and Chinese Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Sentiment classification is an important task in the community of Nature Language Processing. This task aims to determine the sentiment category towards a piece of text. One challenging problem of this task is that it is difficult to obtain a large number of labeled samples. Therefore, a large number of studies are focused on semi-supervised learning, i.e., learning information from unlabeled samples. However, one disadvantage of the previous methods is that the unlabeled samples and the labeled samples are studied in different models, and there is no interaction between them. Based on this, this paper tackles the problem by proposing a semi-supervised sentiment classification based on auxiliary task learning, namely Aux-LSTM, which is used to assist learning the sentiment classification task with a small amount of human-annotated samples by training auto-annotated samples. Specifically, the two tasks are allowed to share the auxiliary LSTM layer, and the auxiliary expression obtained by the auxiliary LSTM layer is used to assist the main task. Empirical studies demonstrate that the proposed method can effectively improve the experimental performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ye, Q., Zhang, Z., Law, R.: Sentiment classification of online reviews to travel destinations by supervised machine learning approaches. Expert Syst. Appl. 36(3), 6527–6535 (2009)CrossRef Ye, Q., Zhang, Z., Law, R.: Sentiment classification of online reviews to travel destinations by supervised machine learning approaches. Expert Syst. Appl. 36(3), 6527–6535 (2009)CrossRef
2.
Zurück zum Zitat Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of EMNLP, Philadelphia, pp. 79–86 (2002) Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of EMNLP, Philadelphia, pp. 79–86 (2002)
3.
Zurück zum Zitat Wan, X.: Co-training for cross-lingual sentiment classification. In: Proceedings of ACL-IJCNLP, Singapore, pp. 235–243 (2009) Wan, X.: Co-training for cross-lingual sentiment classification. In: Proceedings of ACL-IJCNLP, Singapore, pp. 235–243 (2009)
4.
Zurück zum Zitat Zhu, X., Ghahramani, Z.: Learning from Labeled and Unlabeled Data with Label Propagation. CMU CALD Technical report, CMU-CALD-02-107 Zhu, X., Ghahramani, Z.: Learning from Labeled and Unlabeled Data with Label Propagation. CMU CALD Technical report, CMU-CALD-02-107
5.
Zurück zum Zitat Zhou, S., Chen, Q., Wang, X.: Active deep networks for semi-supervised sentiment classification. In: Proceedings of COLING, Beijing, pp. 1515–1523 (2010) Zhou, S., Chen, Q., Wang, X.: Active deep networks for semi-supervised sentiment classification. In: Proceedings of COLING, Beijing, pp. 1515–1523 (2010)
6.
Zurück zum Zitat Li, S., Xue, Y., Wang, Z., et al.: Active learning for cross-domain sentiment classification. In: Proceedings of IJCAI, Beijing, pp. 2127–2133 (2013) Li, S., Xue, Y., Wang, Z., et al.: Active learning for cross-domain sentiment classification. In: Proceedings of IJCAI, Beijing, pp. 2127–2133 (2013)
7.
Zurück zum Zitat Xia, R., Wang, C., Dai, X., et al.: Co-training for semi-supervised sentiment classification based on dual-view bags-of-words representation. In: Proceedings of ACL-IJCNLP, Beijing, pp. 1054–1063 (2015) Xia, R., Wang, C., Dai, X., et al.: Co-training for semi-supervised sentiment classification based on dual-view bags-of-words representation. In: Proceedings of ACL-IJCNLP, Beijing, pp. 1054–1063 (2015)
8.
Zurück zum Zitat Sharma, R., Somani, A., Kumar, L., et al.: Sentiment intensity ranking among adjectives using sentiment bearing word embeddings. In: Proceddings of EMNLP, pp. 547–552 (2017) Sharma, R., Somani, A., Kumar, L., et al.: Sentiment intensity ranking among adjectives using sentiment bearing word embeddings. In: Proceddings of EMNLP, pp. 547–552 (2017)
9.
Zurück zum Zitat Yu, J., Jiang, J.: Learning sentence embeddings with auxiliary tasks for cross-domain sentiment classification. In: Proceddings of EMNLP, pp. 236–246 (2016) Yu, J., Jiang, J.: Learning sentence embeddings with auxiliary tasks for cross-domain sentiment classification. In: Proceddings of EMNLP, pp. 236–246 (2016)
10.
Zurück zum Zitat Shi, H., Jia, D., Miao, P.: Improved information gain text feature selection algorithm based on word frequency information. J. Comput. Appl. 34, 3279–3282 (2014) Shi, H., Jia, D., Miao, P.: Improved information gain text feature selection algorithm based on word frequency information. J. Comput. Appl. 34, 3279–3282 (2014)
11.
Zurück zum Zitat Xu, J., Jiang, H.: An improved information gain feature selection algorithm for SVM text classifier. In: Proceddings of IEEE, pp. 273–276 (2015) Xu, J., Jiang, H.: An improved information gain feature selection algorithm for SVM text classifier. In: Proceddings of IEEE, pp. 273–276 (2015)
12.
Zurück zum Zitat Zhang, H., Ren, Y.G., Yang, X.: Research on text feature selection algorithm based on information gain and feature relation tree. In: Proceddings of IEEE, pp. 446–449 (2014) Zhang, H., Ren, Y.G., Yang, X.: Research on text feature selection algorithm based on information gain and feature relation tree. In: Proceddings of IEEE, pp. 446–449 (2014)
13.
Zurück zum Zitat Hochreiter, K., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef Hochreiter, K., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef
14.
Zurück zum Zitat Graves, A.: Generating sequences with recurrent neural networks. Computer Science (2013) Graves, A.: Generating sequences with recurrent neural networks. Computer Science (2013)
15.
Zurück zum Zitat Glorot, X., Bordes, A., Bengio, Y.: Deep sparse rectifier neural networks. In: JMLR W&CP, vol. 15, pp. 315–323 (2012) Glorot, X., Bordes, A., Bengio, Y.: Deep sparse rectifier neural networks. In: JMLR W&CP, vol. 15, pp. 315–323 (2012)
16.
Zurück zum Zitat Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. Computer Science (2014) Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. Computer Science (2014)
17.
Zurück zum Zitat Blitzer, J., Dredze, M., Pereira, F.: Biographies, bollywood, boom-boxes and blenders: domain adaptation for sentiment classification. In: Proceedings of ACL, Prague, pp. 440–447 (2007) Blitzer, J., Dredze, M., Pereira, F.: Biographies, bollywood, boom-boxes and blenders: domain adaptation for sentiment classification. In: Proceedings of ACL, Prague, pp. 440–447 (2007)
18.
Zurück zum Zitat Li, S., Huang, L., Wang, J., et al.: Semi-stacking for semi-supervised sentiment classification. In: Proceedings of ACL-IJCNLP, Beijing, pp. 27–31 (2015) Li, S., Huang, L., Wang, J., et al.: Semi-stacking for semi-supervised sentiment classification. In: Proceedings of ACL-IJCNLP, Beijing, pp. 27–31 (2015)
Metadaten
Titel
Semi-supervised Sentiment Classification Based on Auxiliary Task Learning
verfasst von
Huan Liu
Jingjing Wang
Shoushan Li
Junhui Li
Guodong Zhou
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-99501-4_33

Premium Partner