Skip to main content
Erschienen in: International Journal of Speech Technology 2/2020

26.05.2020

Bi-directional LSTM–CNN Combined method for Sentiment Analysis in Part of Speech Tagging (PoS)

verfasst von: N. K. Senthil Kumar, N. Malarvizhi

Erschienen in: International Journal of Speech Technology | Ausgabe 2/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In past few years, the popularity of social media has increased drastically, sentiment analysis on the reviews, comments and opinions from social media has become more active in research area. A high grade, sentiment analysis portrays the opinion about the real time objects, topics, products and tweet reviews. The social trends or customer opinion is better understood with sentiment analysis. The state-of-art methods in analyzing the sentiments are based on textual features and with different neural network models. In this paper, we demonstrate and generalize a model combining bi-directional long short term memory (LSTM) and convolutional neural network (CNN), as bi-directional LSTM used to hold the temporal data for part-of-speech (PoS) tagging and CNN to extract the potential features. The experiment results validate our combined model performance with individual models. Our combined model indicates performance accurately and efficiently, achieving a reduced execution time and increased accuracy rate 98.6% in sentiment analysis is achieved by using combined bi-directional LSTM-CNN technique as when compared with traditional techniques.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Ahmed, S., & Danti, A. (2016). Effective sentimental analysis and opinion mining of web reviews using rule based classifiers. In Computational intelligence in data mining (Vol. 1, pp. 171–179). New Delhi: Springer. Ahmed, S., & Danti, A. (2016). Effective sentimental analysis and opinion mining of web reviews using rule based classifiers. In Computational intelligence in data mining (Vol. 1, pp. 171–179). New Delhi: Springer.
Zurück zum Zitat Boia, M., Faltings, B., Musat, C.-C., & Pu, P. (2013). A): Is worth a thousandwords: How people attach sentiment to emoticons and words in tweets. In Proc. Int. Conf. Social Comput., p. 345. Boia, M., Faltings, B., Musat, C.-C., & Pu, P. (2013). A): Is worth a thousandwords: How people attach sentiment to emoticons and words in tweets. In Proc. Int. Conf. Social Comput., p. 345.
Zurück zum Zitat Deng, L., Hinton, G., & Kingsbury, B. (2013). New types of deep neural network learning for speech recognition and related applications: an overview. In 2013 IEEE Int. Conf. Acoust. Speech Signal Process, p. 85998603 Deng, L., Hinton, G., & Kingsbury, B. (2013). New types of deep neural network learning for speech recognition and related applications: an overview. In 2013 IEEE Int. Conf. Acoust. Speech Signal Process, p. 85998603
Zurück zum Zitat Ghag, Shah, K. (2013). Comparative analysis of the techniques for sentiment analysis. In Proc. Int. Conf. Adv. Technol. Eng., Jan. 2013, pp. 1–7 Ghag, Shah, K. (2013). Comparative analysis of the techniques for sentiment analysis. In Proc. Int. Conf. Adv. Technol. Eng., Jan. 2013, pp. 1–7
Zurück zum Zitat Greff, K., Srivastava, R. K., Koutník, J., Steunebrink, B. R., & Schmidhuber, J. (2015). LSTM: A search space odyssey. arXiv2015, arXiv:1503.040692. Greff, K., Srivastava, R. K., Koutník, J., Steunebrink, B. R., & Schmidhuber, J. (2015). LSTM: A search space odyssey. arXiv2015, arXiv:1503.040692.
Zurück zum Zitat Guo, Y., Liu, Y., Oerlemans, A., Lao, S., Wu, S., & Lew, M. S. (2016). Deep learning for visual understanding: A review. NeuroComputing,187, 2748.CrossRef Guo, Y., Liu, Y., Oerlemans, A., Lao, S., Wu, S., & Lew, M. S. (2016). Deep learning for visual understanding: A review. NeuroComputing,187, 2748.CrossRef
Zurück zum Zitat Hu, Y., Yi, Y., Yang, T., & Pan, Q. (2018). Short text classification with a convolutional neural networks based method. In 15th International Conference on Control, Automation, Robotics and Vision (ICARCV) IEEE Xplore. Hu, Y., Yi, Y., Yang, T., & Pan, Q. (2018). Short text classification with a convolutional neural networks based method. In 15th International Conference on Control, Automation, Robotics and Vision (ICARCV) IEEE Xplore.
Zurück zum Zitat Kim, Y. (2014). Convolutional neural networks for sentence classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP 2014), pp. 1746–1751. Kim, Y. (2014). Convolutional neural networks for sentence classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP 2014), pp. 1746–1751.
Zurück zum Zitat Kowsari, K., Brown, D. E., Heidarysafa, M., & Meimandi, K. J. (2018). HDLTex: Hierarchical deep learning for text classification. In IEEE Xplore 16th IEEE International Conference on Machine Learning and Applications (ICMLA). Kowsari, K., Brown, D. E., Heidarysafa, M., & Meimandi, K. J. (2018). HDLTex: Hierarchical deep learning for text classification. In IEEE Xplore 16th IEEE International Conference on Machine Learning and Applications (ICMLA).
Zurück zum Zitat Lei, T., Barzilay, R., & Jaakkola, T. (2015). Molding cnns for text: Non-linear, non-consecutive convolutions. arXiv 2015, arXiv:1508.04112 Lei, T., Barzilay, R., & Jaakkola, T. (2015). Molding cnns for text: Non-linear, non-consecutive convolutions. arXiv 2015, arXiv:1508.04112
Zurück zum Zitat Li, C., Guo, K., & Mei, Q. (2017). Deep memory networks for attitude identification. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, pp. 671–680 Li, C., Guo, K., & Mei, Q. (2017). Deep memory networks for attitude identification. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, pp. 671–680
Zurück zum Zitat Liu, B. (2015). Sentiment analysis: mining opinions, sentiments, and emotions. Cambridge: The Cambridge University Press.CrossRef Liu, B. (2015). Sentiment analysis: mining opinions, sentiments, and emotions. Cambridge: The Cambridge University Press.CrossRef
Zurück zum Zitat Ma, Y., Peng, H., & Cambria, E. (2018). Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM. In AAAI Publications, Thirty-Second AAAI Conference on Artificial Intelligence, April 2018. Ma, Y., Peng, H., & Cambria, E. (2018). Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM. In AAAI Publications, Thirty-Second AAAI Conference on Artificial Intelligence, April 2018.
Zurück zum Zitat Matthew, D. Z. (2013). ADAM: An adaptive learning rate method. In arXiv:1212.5701 [cs.LG]. Matthew, D. Z. (2013). ADAM: An adaptive learning rate method. In arXiv:1212.5701 [cs.LG].
Zurück zum Zitat Mohsen, F., & Erik, R. (2013). Multi-class sentiment analysis with clustering and score representation. In IEEE 13th International Conference on Data Mining Workshops, March 2013. Mohsen, F., & Erik, R. (2013). Multi-class sentiment analysis with clustering and score representation. In IEEE 13th International Conference on Data Mining Workshops, March 2013.
Zurück zum Zitat Mouthami, K., Nirmala Devi, K., & MuraliBhaskaran, V. (2013). Sentiment analysis and classification based on textual reviews. In Published, Information Communication and Embedded Systems, Vol. (ICICES), IEEE Mouthami, K., Nirmala Devi, K., & MuraliBhaskaran, V. (2013). Sentiment analysis and classification based on textual reviews. In Published, Information Communication and Embedded Systems, Vol. (ICICES), IEEE
Zurück zum Zitat Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis. Found and Trends in Information.,2, 1–135.CrossRef Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis. Found and Trends in Information.,2, 1–135.CrossRef
Zurück zum Zitat Ruder, S. (2017). An overview of gradient descent optimization algorithms. arXiv:1609.04747v2 [cs.LG]. Ruder, S. (2017). An overview of gradient descent optimization algorithms. arXiv:1609.04747v2 [cs.LG].
Zurück zum Zitat Severyn, A., & Moschitti, A. (2015) Twitter sentiment analysis with deep convolutional neural networks. In Proc. 38th Int. ACM SIGIR Conf. Res.Dev. Inf. Retr. - SIGIR 15, pp. 959962, 2015 Severyn, A., & Moschitti, A. (2015) Twitter sentiment analysis with deep convolutional neural networks. In Proc. 38th Int. ACM SIGIR Conf. Res.Dev. Inf. Retr. - SIGIR 15, pp. 959962, 2015
Zurück zum Zitat Shayaa, S., Jaafar, N. I., & Bahri, S. (2018). Sentiment analysis of big data: methods. In IEEE Access on Applications, and Open Challenges, Vol. 6, June 2018, pp. 37807–37827 Shayaa, S., Jaafar, N. I., & Bahri, S. (2018). Sentiment analysis of big data: methods. In IEEE Access on Applications, and Open Challenges, Vol. 6, June 2018, pp. 37807–37827
Zurück zum Zitat Shobana, G., Vigneshwara, B., & Maniraj Sai, A. (2018). Twitter sentimental analysis. International Journal of Recent Technology and Engineering (IJRTE). Shobana, G., Vigneshwara, B., & Maniraj Sai, A. (2018). Twitter sentimental analysis. International Journal of Recent Technology and Engineering (IJRTE).
Zurück zum Zitat Srira, B., Fuhry, D., Demir, E., Ferhatosmanoglu, H., & Demirbas, M. (2016). Short text classification in Twitter to improve information filtering. In Proc. 33rd Int. ACM SIGIR Conf. Res. Develop. Inf. Retr., pp. 841–842 Srira, B., Fuhry, D., Demir, E., Ferhatosmanoglu, H., & Demirbas, M. (2016). Short text classification in Twitter to improve information filtering. In Proc. 33rd Int. ACM SIGIR Conf. Res. Develop. Inf. Retr., pp. 841–842
Zurück zum Zitat Tang, D., Wei, F., Yang, N., Zhou, M., Liu, T., & Qin, B. (2014). Learning sentiment-specific word embedding for Twitter sentiment classification. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, pp. 1555–1565 Tang, D., Wei, F., Yang, N., Zhou, M., Liu, T., & Qin, B. (2014). Learning sentiment-specific word embedding for Twitter sentiment classification. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, pp. 1555–1565
Zurück zum Zitat Wang, Y., Huang, M., Zhu, X., & Zhao, L. (2016). Attention-based LSTM for aspect level sentiment classification. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016, pp. 606–615. Wang, Y., Huang, M., Zhu, X., & Zhao, L. (2016). Attention-based LSTM for aspect level sentiment classification. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016, pp. 606–615.
Zurück zum Zitat Wong, F. M. F., Tan, C. W., Sen, S., & Chiang, M. (2016). Quantifying political leaning from tweets, retweets, and retweeters. IEEE Transactions on Knowledge and Data Engineering,28(8), 2158–2172.CrossRef Wong, F. M. F., Tan, C. W., Sen, S., & Chiang, M. (2016). Quantifying political leaning from tweets, retweets, and retweeters. IEEE Transactions on Knowledge and Data Engineering,28(8), 2158–2172.CrossRef
Zurück zum Zitat Yeole, A. V., Chavan, P. V., & Nikose, M. C. (2015). Opinion mining for emotions determination. In ICIIECS 2015 - 2015 IEEE Int. Conf. Innov. Information, Embed. Commun. Syst. Yeole, A. V., Chavan, P. V., & Nikose, M. C. (2015). Opinion mining for emotions determination. In ICIIECS 2015 - 2015 IEEE Int. Conf. Innov. Information, Embed. Commun. Syst.
Zurück zum Zitat Yeole, A. V., Chavan, P. V., & Nikose, M. C. (2015). Opinion mining for emotions determination. In ICIIECS 2015–2015 IEEE Int. Conf. Innov. Information, Embed. Commun. Syst. 2015 Yeole, A. V., Chavan, P. V., & Nikose, M. C. (2015). Opinion mining for emotions determination. In ICIIECS 2015–2015 IEEE Int. Conf. Innov. Information, Embed. Commun. Syst. 2015
Zurück zum Zitat Yin, W., Kann, K., Yu, M., & Schütze, H. (2017). Comparative study of CNN and RNN for natural language processing. Computing Research Repository (CoRR), Vol. abs/1702.01923. Yin, W., Kann, K., Yu, M., & Schütze, H. (2017). Comparative study of CNN and RNN for natural language processing. Computing Research Repository (CoRR), Vol. abs/1702.01923.
Zurück zum Zitat Zhu, Y., Gao, X., Zhang, W., Liu, S., & Zhang, Y. (2018). A bi-directional LSTM-CNN model with attention for aspect-level text classification. Future Internet,10(12), 116.CrossRef Zhu, Y., Gao, X., Zhang, W., Liu, S., & Zhang, Y. (2018). A bi-directional LSTM-CNN model with attention for aspect-level text classification. Future Internet,10(12), 116.CrossRef
Metadaten
Titel
Bi-directional LSTM–CNN Combined method for Sentiment Analysis in Part of Speech Tagging (PoS)
verfasst von
N. K. Senthil Kumar
N. Malarvizhi
Publikationsdatum
26.05.2020
Verlag
Springer US
Erschienen in
International Journal of Speech Technology / Ausgabe 2/2020
Print ISSN: 1381-2416
Elektronische ISSN: 1572-8110
DOI
https://doi.org/10.1007/s10772-020-09716-9

Weitere Artikel der Ausgabe 2/2020

International Journal of Speech Technology 2/2020 Zur Ausgabe

Neuer Inhalt