Skip to main content

2018 | Supplement | Buchkapitel

Sentiment Analysis Model Based on Structure Attention Mechanism

verfasst von : Kai Lin, Dazhen Lin, Donglin Cao

Erschienen in: Advances in Computational Intelligence Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Since the long short-term memory (LSTM) network is a sequential structure, it is difficult to effectively represent the structural level information of the context. Sentiment analysis based on the original LSTM causes a problem of structural level information loss, and its capacity to capture the context information is finite. To address this problem, we proposed a novel structure-attention-based LSTM as a hierarchical structure model. It may capture relevant information in the context as much as possible. We propose HM (ht matrix) to storage the structural information of the context. Furthermore, we introduce the attention mechanism to realize vector selection. Compared with the original LSTM and normal attention-based sentiment classification methods, our model obtains a higher classification precision. It is proved that the structure-attention-based method proposed in this study has an advantage in capturing the potential semantic structure.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Pang, B., Lee, L., Vaithyanathan, S.: Sentiment classification using machine learning techniques. In: Conference on Empirical Methods in Natural Language Processing, vol. 10, pp. 79–86. ACM, Stroudsburg, PA, USA (2002) Pang, B., Lee, L., Vaithyanathan, S.: Sentiment classification using machine learning techniques. In: Conference on Empirical Methods in Natural Language Processing, vol. 10, pp. 79–86. ACM, Stroudsburg, PA, USA (2002)
2.
Zurück zum Zitat Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retr. 2(1–2), 1–135 (2008)CrossRef Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retr. 2(1–2), 1–135 (2008)CrossRef
3.
Zurück zum Zitat Yu, H., Hatzivassiloglou, V.: Towards answering opinion questions: separating facts from opinions and identifying the polarity of opinion sentences. In: EMNLP, pp. 129–136 (2003) Yu, H., Hatzivassiloglou, V.: Towards answering opinion questions: separating facts from opinions and identifying the polarity of opinion sentences. In: EMNLP, pp. 129–136 (2003)
4.
Zurück zum Zitat Khoo, H., Zhou, Na, J.C., et al.: Effectiveness of simple linguistic processing in automatic sentiment classification of product reviews. In: ISKO, pp. 49–54. Ergon Verlag, Wurzburg, Germany (2004) Khoo, H., Zhou, Na, J.C., et al.: Effectiveness of simple linguistic processing in automatic sentiment classification of product reviews. In: ISKO, pp. 49–54. Ergon Verlag, Wurzburg, Germany (2004)
5.
Zurück zum Zitat Bengio, Y., Ducharme, R., Vincent, P., et al.: A neural probabilistic language model. J. Mach. Learn. Res. 3, 1137–1155 (2003)MATH Bengio, Y., Ducharme, R., Vincent, P., et al.: A neural probabilistic language model. J. Mach. Learn. Res. 3, 1137–1155 (2003)MATH
6.
Zurück zum Zitat Gers, F.A., Schmidhuber, J., Cummins, F.: Learning to forget: continual prediction with LSTM. In: 9th International Conference on IET, pp. 2002–2451 (1999) Gers, F.A., Schmidhuber, J., Cummins, F.: Learning to forget: continual prediction with LSTM. In: 9th International Conference on IET, pp. 2002–2451 (1999)
7.
Zurück zum Zitat Stollenga, M.F., Byeon, W., Liwicki, M., et al.: Parallel multi-dimensional LSTM, with application to fast biomedical volumetric image segmentation. Comput. Sci. (2015) Stollenga, M.F., Byeon, W., Liwicki, M., et al.: Parallel multi-dimensional LSTM, with application to fast biomedical volumetric image segmentation. Comput. Sci. (2015)
8.
Zurück zum Zitat Tang, D., Qin, B., Liu, T.: Document modeling with gated recurrent neural network for sentiment classification. In: EMNLP, pp. 1422–1432 (2005) Tang, D., Qin, B., Liu, T.: Document modeling with gated recurrent neural network for sentiment classification. In: EMNLP, pp. 1422–1432 (2005)
9.
Zurück zum Zitat Mnih, V., Heess, N., Graves, A.: Recurrent models of visual attention. In: Advances in Neural Information Processing Systems, 2014, pp. 2204–2212 (2014) Mnih, V., Heess, N., Graves, A.: Recurrent models of visual attention. In: Advances in Neural Information Processing Systems, 2014, pp. 2204–2212 (2014)
10.
Zurück zum Zitat Bahdanau, D., Cho, K., Bengio, Y.: Neural Machine Translation by Jointly Learning to Align and Translate. In: ICLR 2015, pp. 1–15 (2015) Bahdanau, D., Cho, K., Bengio, Y.: Neural Machine Translation by Jointly Learning to Align and Translate. In: ICLR 2015, pp. 1–15 (2015)
11.
Zurück zum Zitat Luong, M.T., Pham, H., Manning, C.D.: Effective approaches to attention-based neural machine translation. Comput. Sci. (2015) Luong, M.T., Pham, H., Manning, C.D.: Effective approaches to attention-based neural machine translation. Comput. Sci. (2015)
12.
Zurück zum Zitat Kokkinos, F., Potamianos, A.: Structural attention neural networks for improved sentiment analysis (2017) Kokkinos, F., Potamianos, A.: Structural attention neural networks for improved sentiment analysis (2017)
Metadaten
Titel
Sentiment Analysis Model Based on Structure Attention Mechanism
verfasst von
Kai Lin
Dazhen Lin
Donglin Cao
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-66939-7_2