Skip to main content
Erschienen in: Social Network Analysis and Mining 1/2022

01.12.2022 | Original Article

OpExHAN: opinion extraction using hierarchical attention network from unstructured reviews

verfasst von: Ankur Ratmele, Ramesh Thakur

Erschienen in: Social Network Analysis and Mining | Ausgabe 1/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In recent decades, sellers and merchants have asked their customers to share their opinion on the products at online marketplace. Analysis of the massive amounts of reviews for a potential customer is an immense challenge, to decide whether to purchase a product or not. In this paper, a hierarchical attention network-based framework is presented to resolve this challenge. In this proposed framework, the Amazon’s Smartphone review dataset is preprocessed using NLP approaches and then applied Glove embedding to extract word vector representation of reviews which identifies contextual information of words. These word vectors are fed into the hierarchical attention network, which produces vectors at the word and sentence levels. Bi-GRU model encodes the words and sentences into hidden vectors. Finally, reviews are classified into five opinion classes like extremely positive, positive, extremely negative, negative and neutral. Furthermore, to perform the experiments with the proposed method, the dataset is divided into three parts such as 80% train, 10% validation and 10% test. Experiments reveal that the proposed framework outperforms baseline methods in terms of accuracy, precision and recall. The OpExHAN model achieved admirable results like 94.6% accuracy, 91% both precision and recall after a lot of hyper-parameter experimentation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Abdalgader K, Al Shibli A (2020) Experimental results on customer reviews using lexicon-based word polarity identification method. IEEE Access 8:179955–179969CrossRef Abdalgader K, Al Shibli A (2020) Experimental results on customer reviews using lexicon-based word polarity identification method. IEEE Access 8:179955–179969CrossRef
Zurück zum Zitat Abrahams AS, Jiao J, Fan W, Wang GA, Zhang Z (2013) What’s buzzing in the blizzard of buzz? Automotive component isolation in social media postings. Decis Support Syst 55:871–882CrossRef Abrahams AS, Jiao J, Fan W, Wang GA, Zhang Z (2013) What’s buzzing in the blizzard of buzz? Automotive component isolation in social media postings. Decis Support Syst 55:871–882CrossRef
Zurück zum Zitat Alharbi NM, Alghamdi NS, Alkhammash EH, Al Amri JF (2021) Evaluation of sentiment analysis via word embedding and RNN variants for Amazon online reviews. Math Probl Eng 2021:1–10CrossRef Alharbi NM, Alghamdi NS, Alkhammash EH, Al Amri JF (2021) Evaluation of sentiment analysis via word embedding and RNN variants for Amazon online reviews. Math Probl Eng 2021:1–10CrossRef
Zurück zum Zitat Balahur A, Kabadjov M, Steinberger J, Steinberger R, Montoyo A (2012) Challenges and solutions in the opinion summarization of user-generated content. J Intell Inf Syst 39:375–398CrossRef Balahur A, Kabadjov M, Steinberger J, Steinberger R, Montoyo A (2012) Challenges and solutions in the opinion summarization of user-generated content. J Intell Inf Syst 39:375–398CrossRef
Zurück zum Zitat Chen Y, Xie J (2008) Online consumer review: word-of-mouth as a new element of marketing communication mix. Manag Sci 54:477–491CrossRef Chen Y, Xie J (2008) Online consumer review: word-of-mouth as a new element of marketing communication mix. Manag Sci 54:477–491CrossRef
Zurück zum Zitat Dhokrat A, Khillare S, Mahender CN (2015) Review on techniques and tools used for opinion mining. Int J Comput Appl Technol Res 4:419–424 Dhokrat A, Khillare S, Mahender CN (2015) Review on techniques and tools used for opinion mining. Int J Comput Appl Technol Res 4:419–424
Zurück zum Zitat Do HH, Prasad P, Maag A, Alsadoon A (2019) Deep learning for aspect-based sentiment analysis: a comparative review. Expert Syst Appl 118:272–299CrossRef Do HH, Prasad P, Maag A, Alsadoon A (2019) Deep learning for aspect-based sentiment analysis: a comparative review. Expert Syst Appl 118:272–299CrossRef
Zurück zum Zitat Feng J, Cai S, Ma X (2019) Enhanced sentiment labeling and implicit aspect identification by integration of deep convolution neural network and sequential algorithm. Clust Comput 22:5839–5857CrossRef Feng J, Cai S, Ma X (2019) Enhanced sentiment labeling and implicit aspect identification by integration of deep convolution neural network and sequential algorithm. Clust Comput 22:5839–5857CrossRef
Zurück zum Zitat Gu X, Gu Y, Wu H (2017) Cascaded convolutional neural networks for aspect-based opinion summary. Neural Process Lett 46:581–594CrossRef Gu X, Gu Y, Wu H (2017) Cascaded convolutional neural networks for aspect-based opinion summary. Neural Process Lett 46:581–594CrossRef
Zurück zum Zitat Gupta V, Joshi N, Mathur I (2016) Design and development of a rule-based Urdu lemmatizer. In: Proceedings of international conference on ICT for sustainable development. Springer, pp 161–169 Gupta V, Joshi N, Mathur I (2016) Design and development of a rule-based Urdu lemmatizer. In: Proceedings of international conference on ICT for sustainable development. Springer, pp 161–169
Zurück zum Zitat Hajek P, Barushka A, Munk M (2020) Opinion mining of consumer reviews using deep neural networks with word-sentiment associations. In: IFIP international conference on artificial intelligence applications and innovations. Springer, pp 419–429 Hajek P, Barushka A, Munk M (2020) Opinion mining of consumer reviews using deep neural networks with word-sentiment associations. In: IFIP international conference on artificial intelligence applications and innovations. Springer, pp 419–429
Zurück zum Zitat Haque TU, Saber NN, Shah FM (2018) Sentiment analysis on large scale Amazon product reviews. In: 2018 IEEE international conference on innovative research and development (ICIRD). IEEE, pp 1–6 Haque TU, Saber NN, Shah FM (2018) Sentiment analysis on large scale Amazon product reviews. In: 2018 IEEE international conference on innovative research and development (ICIRD). IEEE, pp 1–6
Zurück zum Zitat Hussein DME-DM (2018) A survey on sentiment analysis challenges. J King Saud Univ Eng Sci 30:330–338 Hussein DME-DM (2018) A survey on sentiment analysis challenges. J King Saud Univ Eng Sci 30:330–338
Zurück zum Zitat Jianqiang Z, Xiaolin G (2017) Comparison research on text pre-processing methods on twitter sentiment analysis. IEEE Access 5:2870–2879CrossRef Jianqiang Z, Xiaolin G (2017) Comparison research on text pre-processing methods on twitter sentiment analysis. IEEE Access 5:2870–2879CrossRef
Zurück zum Zitat Jianqiang Z, Xiaolin G, Xuejun Z (2018) Deep convolution neural networks for twitter sentiment analysis. IEEE Access 6:23253–23260CrossRef Jianqiang Z, Xiaolin G, Xuejun Z (2018) Deep convolution neural networks for twitter sentiment analysis. IEEE Access 6:23253–23260CrossRef
Zurück zum Zitat Kardakis S, Perikos I, Grivokostopoulou F, Hatzilygeroudis I (2021) Examining attention mechanisms in deep learning models for sentiment analysis. Appl Sci 11:3883CrossRef Kardakis S, Perikos I, Grivokostopoulou F, Hatzilygeroudis I (2021) Examining attention mechanisms in deep learning models for sentiment analysis. Appl Sci 11:3883CrossRef
Zurück zum Zitat Kauffmann E, Peral J, Gil D, Ferrández A, Sellers R, Mora H (2019) Managing marketing decision-making with sentiment analysis: an evaluation of the main product features using text data mining. Sustainability 11:4235CrossRef Kauffmann E, Peral J, Gil D, Ferrández A, Sellers R, Mora H (2019) Managing marketing decision-making with sentiment analysis: an evaluation of the main product features using text data mining. Sustainability 11:4235CrossRef
Zurück zum Zitat Khalid M, Ashraf I, Mehmood A, Ullah S, Ahmad M, Choi GS (2020) GBSVM: sentiment classification from unstructured reviews using ensemble classifier. Appl Sci 10:2788CrossRef Khalid M, Ashraf I, Mehmood A, Ullah S, Ahmad M, Choi GS (2020) GBSVM: sentiment classification from unstructured reviews using ensemble classifier. Appl Sci 10:2788CrossRef
Zurück zum Zitat Khan K, Baharudin B, Khan A, Ullah A (2014) Mining opinion components from unstructured reviews: a review. J King Saud Univ Comput Inf Sci 26:258–275 Khan K, Baharudin B, Khan A, Ullah A (2014) Mining opinion components from unstructured reviews: a review. J King Saud Univ Comput Inf Sci 26:258–275
Zurück zum Zitat Li X, Bing L, Li P, Lam W, Yang Z (2018) Aspect term extraction with history attention and selective transformation. arXiv preprint arXiv:1805.00760 Li X, Bing L, Li P, Lam W, Yang Z (2018) Aspect term extraction with history attention and selective transformation. arXiv preprint arXiv:​1805.​00760
Zurück zum Zitat Liu B (2012) Sentiment analysis and opinion mining. In: Synthesis lectures on human language technologies, vol 5, no 1, p 167 Liu B (2012) Sentiment analysis and opinion mining. In: Synthesis lectures on human language technologies, vol 5, no 1, p 167
Zurück zum Zitat Ma R, Wang K, Qiu T, Sangaiah AK, Lin D, Liaqat HB (2019) Feature-based compositing memory networks for aspect-based sentiment classification in social internet of things. Futur Gener Comput Syst 92:879–888CrossRef Ma R, Wang K, Qiu T, Sangaiah AK, Lin D, Liaqat HB (2019) Feature-based compositing memory networks for aspect-based sentiment classification in social internet of things. Futur Gener Comput Syst 92:879–888CrossRef
Zurück zum Zitat Mai L, Le B (2018) Aspect-based sentiment analysis of vietnamese texts with deep learning. In: Asian conference on intelligent information and database systems. Springer, pp 149–158 Mai L, Le B (2018) Aspect-based sentiment analysis of vietnamese texts with deep learning. In: Asian conference on intelligent information and database systems. Springer, pp 149–158
Zurück zum Zitat Pang B, Lee L (2008) Opinion mining and sentiment analysis. In: Foundations and Trends® in Information Retrieval, vol 2, pp 1–135 Pang B, Lee L (2008) Opinion mining and sentiment analysis. In: Foundations and Trends® in Information Retrieval, vol 2, pp 1–135
Zurück zum Zitat Park Y-J (2018) Predicting the helpfulness of online customer reviews across different product types. Sustainability 10:1735CrossRef Park Y-J (2018) Predicting the helpfulness of online customer reviews across different product types. Sustainability 10:1735CrossRef
Zurück zum Zitat Pennington J, Socher R, Manning CD (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532–1543 Pennington J, Socher R, Manning CD (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532–1543
Zurück zum Zitat Qiu G, Liu B, Bu J, Chen C (2011) Opinion word expansion and target extraction through double propagation. Comput Linguist 37:9–27CrossRef Qiu G, Liu B, Bu J, Chen C (2011) Opinion word expansion and target extraction through double propagation. Comput Linguist 37:9–27CrossRef
Zurück zum Zitat Ratmele A, Thakur R (2019) Statistical analysis & survey of research work in opinion mining. In: Proceedings of Recent Advances in Interdisciplinary Trends in Engineering & Applications (RAITEA). Ratmele A, Thakur R (2019) Statistical analysis & survey of research work in opinion mining. In: Proceedings of Recent Advances in Interdisciplinary Trends in Engineering & Applications (RAITEA).
Zurück zum Zitat Ratmele A, Thakur R (2020) Feature based opinion classification (FBOC) of customer reviews. Indian J Comput Sci Eng 11(6):892–898 CrossRef Ratmele A, Thakur R (2020) Feature based opinion classification (FBOC) of customer reviews. Indian J Comput Sci Eng 11(6):892–898 CrossRef
Zurück zum Zitat Ratmele A, Thakur R (2021) Feature extraction of unstructured product reviews. In: Innovative data communication technologies and application. Springer Ratmele A, Thakur R (2021) Feature extraction of unstructured product reviews. In: Innovative data communication technologies and application. Springer
Zurück zum Zitat Tan W, Wang X, & Xu X (2019) Sentiment analysis for Amazon reviews. Reseaechgate, 0-9. Tan W, Wang X, & Xu X (2019) Sentiment analysis for Amazon reviews. Reseaechgate, 0-9.
Zurück zum Zitat Tay Y, Tuan LA, Hui SC (2018) Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis. In: Proceedings of the AAAI conference on artificial intelligence Tay Y, Tuan LA, Hui SC (2018) Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis. In: Proceedings of the AAAI conference on artificial intelligence
Zurück zum Zitat Turney PD (2002) Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. arXiv preprint cs/0212032 Turney PD (2002) Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. arXiv preprint cs/0212032
Zurück zum Zitat Vo A-D, Nguyen Q-P, Ock C-Y (2018) Opinion–aspect relations in cognizing customer feelings via reviews. IEEE Access 6:5415–5426CrossRef Vo A-D, Nguyen Q-P, Ock C-Y (2018) Opinion–aspect relations in cognizing customer feelings via reviews. IEEE Access 6:5415–5426CrossRef
Zurück zum Zitat Wang Y, Huang M, Zhu X, Zhao L (2016) Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing, pp 606–615 Wang Y, Huang M, Zhu X, Zhao L (2016) Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing, pp 606–615
Zurück zum Zitat Wang R, Zhou D, Jiang M, Si J, Yang Y (2019) A survey on opinion mining: from stance to product aspect. IEEE Access 7:41101–41124CrossRef Wang R, Zhou D, Jiang M, Si J, Yang Y (2019) A survey on opinion mining: from stance to product aspect. IEEE Access 7:41101–41124CrossRef
Zurück zum Zitat Wei J, Liao J, Yang Z, Wang S, Zhao Q (2020) BiLSTM with multi-polarity orthogonal attention for implicit sentiment analysis. Neurocomputing 383:165–173CrossRef Wei J, Liao J, Yang Z, Wang S, Zhao Q (2020) BiLSTM with multi-polarity orthogonal attention for implicit sentiment analysis. Neurocomputing 383:165–173CrossRef
Zurück zum Zitat Wu C, Wu F, Wu S, Yuan Z, Huang Y (2018) A hybrid unsupervised method for aspect term and opinion target extraction. Knowl-Based Syst 148:66–73CrossRef Wu C, Wu F, Wu S, Yuan Z, Huang Y (2018) A hybrid unsupervised method for aspect term and opinion target extraction. Knowl-Based Syst 148:66–73CrossRef
Zurück zum Zitat Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E (2016) Hierarchical attention networks for document classification. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies, pp 1480–1489 Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E (2016) Hierarchical attention networks for document classification. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies, pp 1480–1489
Zurück zum Zitat Yi S, Liu X (2020) Machine learning based customer sentiment analysis for recommending shoppers, shops based on customers’ review. Complex Intell Syst 6:621–634CrossRef Yi S, Liu X (2020) Machine learning based customer sentiment analysis for recommending shoppers, shops based on customers’ review. Complex Intell Syst 6:621–634CrossRef
Zurück zum Zitat Zhang M, Fan B, Zhang N, Wang W, Fan W (2021) Mining product innovation ideas from online reviews. Inf Process Manag 58:102389CrossRef Zhang M, Fan B, Zhang N, Wang W, Fan W (2021) Mining product innovation ideas from online reviews. Inf Process Manag 58:102389CrossRef
Metadaten
Titel
OpExHAN: opinion extraction using hierarchical attention network from unstructured reviews
verfasst von
Ankur Ratmele
Ramesh Thakur
Publikationsdatum
01.12.2022
Verlag
Springer Vienna
Erschienen in
Social Network Analysis and Mining / Ausgabe 1/2022
Print ISSN: 1869-5450
Elektronische ISSN: 1869-5469
DOI
https://doi.org/10.1007/s13278-022-00971-z

Weitere Artikel der Ausgabe 1/2022

Social Network Analysis and Mining 1/2022 Zur Ausgabe

Premium Partner