skip to main content
10.1145/3297280.3297620acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
poster

Evaluating neural word embeddings created from online course reviews for sentiment analysis

Published:08 April 2019Publication History

ABSTRACT

Social media are providing the humus for the sharing of knowledge and experiences and the growth of community activities (e.g., debating about different topics). The analysis of the user-generated content in this area usually relies on Sentiment Analysis. Word embeddings and Deep Learning have attracted extensive attention in various sentiment detection tasks. In parallel, the literature exposed the drawbacks of traditional approaches when content belonging to specific contexts is processed with general techniques. Thus, ad-hoc solutions are needed to improve the effectiveness of such systems. In this paper, we focus on user-generated content coming from the e-learning context to demonstrate how distributional semantic approaches trained on smaller context-specific textual resources are more effective with respect to approaches trained on bigger general-purpose ones. To this end, we build context-trained embeddings from online course reviews using state-of-the-art generators. Then, those embeddings are integrated in a deep neural network we designed to solve a polarity detection task on reviews in the e-learning context, modeled as a regression. By applying our approach on embeddings trained using background corpora from different contexts, we show that the performance is better when the background context is aligned with the regression context.

References

  1. M. Atzeni and D. Reforgiato. 2018. Deep Learning and Sentiment Analysis for Human-Robot Interaction. In Europ. Semantic Web Conference. Springer, 14--18.Google ScholarGoogle Scholar
  2. K. L. Cela, M. Á. Sicilia, and S. Sánchez. 2015. Social Network Analysis in E-Learning Environments. Educational Psychology Review 27, 1 (2015), 219--246.Google ScholarGoogle ScholarCross RefCross Ref
  3. D. Dessì, G. Fenu, M. Marras, and D. Reforgiato Recupero. 2018. Bridging learning analytics and Cognitive Computing for Big Data classification in micro-learning video collections. Computers in Human Behavior (2018).Google ScholarGoogle Scholar
  4. D. Dessì, G. Fenu, M. Marras, and D. Reforgiato Recupero. 2018. COCO: Semantic-Enriched Collection of Online Courses at Scale with Experimental Use Cases. In Trends and Advances in Infor. Systems and Technologies. Springer, 1386--1396.Google ScholarGoogle Scholar
  5. G. Dragoni and M. Petrucci. 2017. A Neural Word Embeddings Approach for Multi-Domain Sentiment Analysis. IEEE Trans. Affect. Comput. 8, 4 (2017), 457--470.Google ScholarGoogle ScholarCross RefCross Ref
  6. A. Dridi and D. Reforgiato. 2017. Leveraging semantics for sentiment polarity detection in social media. Int. Jour. of Machine Learning and Cybernetics (2017).Google ScholarGoogle Scholar
  7. G. Esparza, A. de Luna, A. O. Zezzatti, A. Hernandez, J. Ponce, M. Álvarez, E. Cossio, and J. de Jesus Nava. 2017. A sentiment analysis model to analyze students reviews of teacher performance using support vector machines. In Int. Symp. on Distributed Computing and Artificial Intelligence. Springer, 157--164.Google ScholarGoogle Scholar
  8. M. Giatsoglou, M. G Vozalis, K. Diamantaras, A. Vakali, G. Sarigiannidis, and K. Chatzisavvas. 2017. Sentiment analysis leveraging emotions and word embeddings. Expert Systems with Applications 69 (2017), 214--224.Google ScholarGoogle ScholarCross RefCross Ref
  9. S. Hochreiter and J. Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735--1780. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. A. Joulin, E. Grave, P. Bojanowski, M. Douze, H. Jégou, and T. Mikolov. 2016. Fasttext. zip: Compressing text classification models. arXiv:1612.03651 (2016).Google ScholarGoogle Scholar
  11. Y. Li, Q. Pan, T. Yang, S. Wang, J. Tang, and E. Cambria. 2017. Learning Word Representations for Sentiment Analysis. Cogn. Computation 9, 6 (2017), 843--851.Google ScholarGoogle ScholarCross RefCross Ref
  12. A. L. Maas, R. E. Daly, P. T. Pham, D. Huang, A. Y. Ng, and C. Potts. 2011. Learning Word Vectors for Sentiment Analysis. In Proc. of the Annual Meeting of the Assoc. for Computational Linguistics: Human Language Technologies - Vol. 1. 142--150. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. T. Mikolov, K. Chen, G. Corrado, and J. Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013).Google ScholarGoogle Scholar
  14. J. Pennington, R. Socher, and C. Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532--1543.Google ScholarGoogle Scholar
  15. C. Raffel and D. P. Ellis. 2015. Feed-forward networks with attention can solve some long-term memory problems. arXiv:1512.08756 (2015).Google ScholarGoogle Scholar
  16. D. Reforgiato, V. Presutti, S. Consoli, A. Gangemi, and A. Nuzzolese. 2015. Sentilo: Frame-Based Sentiment Analysis. Cogn. Computation 7, 2 (2015), 211--225.Google ScholarGoogle Scholar
  17. D. Reforgiato Recupero, E. Cambria, and E. Di Rosa. 2017. Semantic Sentiment Analysis Challenge ESWC 2017. In Semantic Web Challenges. Springer, 109--123.Google ScholarGoogle Scholar
  18. E. Rudkowsky, M. Haselmayer, M. Wastian, M. Jenny, S. Emrich, and M. Sedlmair. 2018. More than Bags of Words: Sentiment Analysis with Word Embeddings. Communication Methods and Measures 12, 2-3 (2018), 140--157.Google ScholarGoogle ScholarCross RefCross Ref
  19. B. Shi, Z. Fu, L. Bing, and W. Lam. 2018. Learning Domain-Sensitive and Sentiment-Aware Word Embeddings. arXiv:1805.03801 (2018).Google ScholarGoogle Scholar
  20. D. Tang, F. Wei, B. Qin, N. Yang, T. Liu, and M. Zhou. 2016. Sentiment Embeddings with Applications to Sentiment Analysis. IEEE Transactions on Knowledge and Data Engineering 28, 2 (2016), 496--509. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. D. Tang, F. Wei, N. Yang, M. Zhou, T. Liu, and B. Qin. 2014. Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification. In Proc. of the Annual Meeting of the Association for Computational Linguistics. 1555--1565.Google ScholarGoogle Scholar
  22. Z. Zhang and M. Lan. 2015. Learning sentiment-inherent word embedding for word-level and sentence-level sentiment analysis. In 2015 International Conference on Asian Language Processing (IALP). 94--97.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    SAC '19: Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing
    April 2019
    2682 pages
    ISBN:9781450359337
    DOI:10.1145/3297280

    Copyright © 2019 Owner/Author

    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 8 April 2019

    Check for updates

    Qualifiers

    • poster

    Acceptance Rates

    Overall Acceptance Rate1,650of6,669submissions,25%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader