Skip to main content
Top
Published in: Service Oriented Computing and Applications 1/2023

22-02-2023 | Original Research Paper

Optimization-enabled deep learning for sentiment rating prediction using review data

Authors: Jyotsna Anthal, Bhavna Sharma, Jatinder Manhas

Published in: Service Oriented Computing and Applications | Issue 1/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

At present, websites, such as Amazon and Yelp, permit consumers to submit reviews for different businesses, services, and products. In recent times, the customer’s shopping decision is highly influenced by the online reviews posted by the customers using star ratings, as well as, texts. Generally, customers believe that ratings are consistent with the reviews provided, but it may not be in the case of intermediate ratings. Conversely, the reviews posted by the customers will be in an unstructured format, which makes it highly complicated in understanding and analysis of the review, thereby requiring efficient approaches to estimate ratings considering the sentiment of the customer. In this paper, a novel sentiment rating prediction approach is devised by utilizing a deep learning network with hybrid optimization. Here, Random Multimodel Deep Learning (RMDL) network is used to estimate the sentiment rating, where the RMDL is trained using the devised Honey-based Exponential Poor Rich Optimization (HEPRO) algorithm. Moreover, the presented HEPRO-RMDL is examined for its effectiveness based on various metrics, like True Positive Rate (TPR), True Negative Rate (TNR), and accuracy is observed to have achieved high values of accuracy, TNR, and TPR at 0.935, 0.925, and 0.956, respectively.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Park HJ, Song M, Shin KS (2020) Deep learning models and datasets for aspect term sentiment classification: implementing holistic recurrent attention on target-dependent memories. Knowl-Based Syst 187:104825CrossRef Park HJ, Song M, Shin KS (2020) Deep learning models and datasets for aspect term sentiment classification: implementing holistic recurrent attention on target-dependent memories. Knowl-Based Syst 187:104825CrossRef
2.
go back to reference Sánchez-Rada JF, Iglesias CA (2019) Social context in sentiment analysis: formal definition, overview of current trends and framework for comparison. Inform Fusion 52:344–356CrossRef Sánchez-Rada JF, Iglesias CA (2019) Social context in sentiment analysis: formal definition, overview of current trends and framework for comparison. Inform Fusion 52:344–356CrossRef
3.
go back to reference Jin J, Liu Y, Ji P, Liu H (2016) Understanding big consumer opinion data for market-driven product design. Int J Prod Res 54(10):3019–3041CrossRef Jin J, Liu Y, Ji P, Liu H (2016) Understanding big consumer opinion data for market-driven product design. Int J Prod Res 54(10):3019–3041CrossRef
4.
go back to reference Li J, Xue W, Yang F, Li Y (2017) An integrated research framework for effect of EWOM. J Syst Sci Inform 5(4):343–355 Li J, Xue W, Yang F, Li Y (2017) An integrated research framework for effect of EWOM. J Syst Sci Inform 5(4):343–355
5.
go back to reference Cao J, Li J, Yin M, Wang Y (2022) Online reviews sentiment analysis and product feature improvement with deep learning. Transactions on Asian and Low-Resource Language Information Processing Cao J, Li J, Yin M, Wang Y (2022) Online reviews sentiment analysis and product feature improvement with deep learning. Transactions on Asian and Low-Resource Language Information Processing
6.
go back to reference Wankhade M, Rao ACS, Kulkarni C (202) A survey on sentiment analysis methods, applications, and challenges, Artificial Intelligence Review, pp.1–50 Wankhade M, Rao ACS, Kulkarni C (202) A survey on sentiment analysis methods, applications, and challenges, Artificial Intelligence Review, pp.1–50
7.
go back to reference Ligthart A, Catal C, Tekinerdogan B (2021) Systematic reviews in sentiment analysis: a tertiary study. Artif Intell Rev 54(7):4997–5053CrossRef Ligthart A, Catal C, Tekinerdogan B (2021) Systematic reviews in sentiment analysis: a tertiary study. Artif Intell Rev 54(7):4997–5053CrossRef
8.
go back to reference Xu G, Meng Y, Qiu X, Yu Z, Wu X (2019) Sentiment analysis of comment texts based on BiLSTM. IEEE Access 7:51522–51532CrossRef Xu G, Meng Y, Qiu X, Yu Z, Wu X (2019) Sentiment analysis of comment texts based on BiLSTM. IEEE Access 7:51522–51532CrossRef
9.
go back to reference Tian H, Gao C, Xiao X, Liu H, He B, Wu H, Wang H, Wu F (2020) SKEP: Sentiment knowledge enhanced pre-training for sentiment analysis. arXiv preprint arXiv:2005.05635, 2020. Tian H, Gao C, Xiao X, Liu H, He B, Wu H, Wang H, Wu F (2020) SKEP: Sentiment knowledge enhanced pre-training for sentiment analysis. arXiv preprint arXiv:​2005.​05635, 2020.
10.
go back to reference Fan C, Yan H, Du J, Gui L, Bing L, Yang M, Xu R, Mao R (2019) A knowledge regularized hierarchical approach for emotion cause analysis, In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 5614–5624, November Fan C, Yan H, Du J, Gui L, Bing L, Yang M, Xu R, Mao R (2019) A knowledge regularized hierarchical approach for emotion cause analysis, In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 5614–5624, November
11.
go back to reference Xing B, Tsang I (2022) Dignet: Digging clues from local-global interactive graph for aspect-level sentiment classification. arXiv preprint arXiv:2201.00989 Xing B, Tsang I (2022) Dignet: Digging clues from local-global interactive graph for aspect-level sentiment classification. arXiv preprint arXiv:​2201.​00989
12.
go back to reference Mutinda J, Mwangi W, Okeyo G (2021) Lexicon-pointed hybrid N-gram features extraction model (LeNFEM) for sentence level sentiment analysis. Eng Rep 3(8):e12374CrossRef Mutinda J, Mwangi W, Okeyo G (2021) Lexicon-pointed hybrid N-gram features extraction model (LeNFEM) for sentence level sentiment analysis. Eng Rep 3(8):e12374CrossRef
13.
go back to reference Trisna KW, Jie HJ (2022) Deep learning approach for aspect-based sentiment classification: a comparative review. Appl Artificial Intell, pp.1–37 Trisna KW, Jie HJ (2022) Deep learning approach for aspect-based sentiment classification: a comparative review. Appl Artificial Intell, pp.1–37
14.
go back to reference Fazzolari M, Cozza V, Petrocchi M, Spognardi A (2017) A study on text-score disagreement in online reviews. Cogn Comput 9(5):689–701CrossRef Fazzolari M, Cozza V, Petrocchi M, Spognardi A (2017) A study on text-score disagreement in online reviews. Cogn Comput 9(5):689–701CrossRef
15.
go back to reference Cuizon JC, Agravante CG (2020) Sentiment analysis for review rating prediction in a travel journal, In: Proceedings of the 4th International Conference on Natural Language Processing and Information Retrieval (pp. 70–74 Cuizon JC, Agravante CG (2020) Sentiment analysis for review rating prediction in a travel journal, In: Proceedings of the 4th International Conference on Natural Language Processing and Information Retrieval (pp. 70–74
16.
go back to reference Song K, Gao W, FENG SF, Wang D, Wong KF, Zhang C (2017) Recommendation vs sentiment analysis: a text-driven latent factor model for rating prediction with cold-start awareness Song K, Gao W, FENG SF, Wang D, Wong KF, Zhang C (2017) Recommendation vs sentiment analysis: a text-driven latent factor model for rating prediction with cold-start awareness
17.
go back to reference Jin Z, Li Q, Zeng DD, Zhan Y, Liu R, Wang L, Ma H Jointly modeling review content and aspect ratings for review rating prediction. In: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, pp. 893–896 Jin Z, Li Q, Zeng DD, Zhan Y, Liu R, Wang L, Ma H Jointly modeling review content and aspect ratings for review rating prediction. In: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, pp. 893–896
18.
go back to reference Salur MU, Aydin I (2020) A novel hybrid deep learning model for sentiment classification. IEEE Access 8:58080–58093CrossRef Salur MU, Aydin I (2020) A novel hybrid deep learning model for sentiment classification. IEEE Access 8:58080–58093CrossRef
19.
go back to reference Ahmed BH, Ghabayen AS (2020) Review rating prediction framework using deep learning. J Ambient Intell Human Comput pp.1–10 Ahmed BH, Ghabayen AS (2020) Review rating prediction framework using deep learning. J Ambient Intell Human Comput pp.1–10
20.
go back to reference Li D, Rzepka R, Ptaszynski M, Araki K (2020) HEMOS: a novel deep learning-based fine-grained humor detecting method for sentiment analysis of social media. Inf Process Manage 57(6):102290CrossRef Li D, Rzepka R, Ptaszynski M, Araki K (2020) HEMOS: a novel deep learning-based fine-grained humor detecting method for sentiment analysis of social media. Inf Process Manage 57(6):102290CrossRef
21.
go back to reference Kumar A, Srinivasan K, Cheng WH, Zomaya AY (2020) Hybrid context enriched deep learning model for fine-grained sentiment analysis in textual and visual semiotic modality social data. Inf Process Manage 57(1):102141CrossRef Kumar A, Srinivasan K, Cheng WH, Zomaya AY (2020) Hybrid context enriched deep learning model for fine-grained sentiment analysis in textual and visual semiotic modality social data. Inf Process Manage 57(1):102141CrossRef
22.
go back to reference Sadr H, Pedram MM, Teshnehlab M (2020) Multi-view deep network: a deep model based on learning features from heterogeneous neural networks for sentiment analysis. IEEE Access 8:86984–86997CrossRef Sadr H, Pedram MM, Teshnehlab M (2020) Multi-view deep network: a deep model based on learning features from heterogeneous neural networks for sentiment analysis. IEEE Access 8:86984–86997CrossRef
23.
go back to reference Hassan J, Shoaib U (2020) Multi-class review rating classification using deep recurrent neural network. Neural Process Lett 51(1):1031–1048CrossRef Hassan J, Shoaib U (2020) Multi-class review rating classification using deep recurrent neural network. Neural Process Lett 51(1):1031–1048CrossRef
24.
go back to reference Feng S, Song K, Wang D, Gao W, Zhang Y (2021) InterSentiment: combining deep neural models on interaction and sentiment for review rating prediction. Int J Mach Learn Cybern 12(2):477–488CrossRef Feng S, Song K, Wang D, Gao W, Zhang Y (2021) InterSentiment: combining deep neural models on interaction and sentiment for review rating prediction. Int J Mach Learn Cybern 12(2):477–488CrossRef
25.
go back to reference Khan ZY, Niu Z (2021) CNN with depthwise separable convolutions and combined kernels for rating prediction. Expert Syst Appl 170:114528CrossRef Khan ZY, Niu Z (2021) CNN with depthwise separable convolutions and combined kernels for rating prediction. Expert Syst Appl 170:114528CrossRef
27.
go back to reference Jacob D, Ming-Wei C, Kenton L, Kristina T (2018) Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. Jacob D, Ming-Wei C, Kenton L, Kristina T (2018) Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:​1810.​04805.
28.
go back to reference Chen Z, Chen Y, Wu L, Cheng S, Lin P (2019) Deep residual network based fault detection and diagnosis of photovoltaic arrays using current-voltage curves and ambient conditions. Energy Convers Manage 198:111793CrossRef Chen Z, Chen Y, Wu L, Cheng S, Lin P (2019) Deep residual network based fault detection and diagnosis of photovoltaic arrays using current-voltage curves and ambient conditions. Energy Convers Manage 198:111793CrossRef
29.
go back to reference Kowsari K, Heidarysafa M, Brown DE, Meimandi KJ, Barnes LE (2018) Rmdl: Random multimodel deep learning for classification. In: Proceedings of the 2nd International Conference on Information System and Data Mining, pp. 19–28 Kowsari K, Heidarysafa M, Brown DE, Meimandi KJ, Barnes LE (2018) Rmdl: Random multimodel deep learning for classification. In: Proceedings of the 2nd International Conference on Information System and Data Mining, pp. 19–28
30.
go back to reference Hashim FA, Houssein EH, Hussain K, Mabrouk MS, Al-Atabany W (2022) Honey Badger Algorithm: New metaheuristic algorithm for solving optimization problems. Mathematics and Computers in Simulation, vol.192, pp.84–110, 2022. Hashim FA, Houssein EH, Hussain K, Mabrouk MS, Al-Atabany W (2022) Honey Badger Algorithm: New metaheuristic algorithm for solving optimization problems. Mathematics and Computers in Simulation, vol.192, pp.84–110, 2022.
31.
go back to reference Shamma SE, Amin RW, Shamma AK (1991) A double exponentially weighted moving average control procedure with variable sampling intervals. Commun Statistics-simulation Comput 20(2–3):511–528MathSciNetCrossRefMATH Shamma SE, Amin RW, Shamma AK (1991) A double exponentially weighted moving average control procedure with variable sampling intervals. Commun Statistics-simulation Comput 20(2–3):511–528MathSciNetCrossRefMATH
32.
go back to reference Moosavi SHS, Bardsiri VK (2019) Poor and rich optimization algorithm: a new human-based and multi populations algorithm. Eng Appl Artif Intell 86:165–181CrossRef Moosavi SHS, Bardsiri VK (2019) Poor and rich optimization algorithm: a new human-based and multi populations algorithm. Eng Appl Artif Intell 86:165–181CrossRef
33.
go back to reference Ghosh M, Kar A (2013) Unsupervised linguistic approach for sentiment classification from online reviews using SentiWordNet 3.0. Int J Eng Res Technol 2(9):1–6 Ghosh M, Kar A (2013) Unsupervised linguistic approach for sentiment classification from online reviews using SentiWordNet 3.0. Int J Eng Res Technol 2(9):1–6
34.
go back to reference Rakhmanov O (2020) A comparative study on vectorization and classification techniques in sentiment analysis to classify student-lecturer comments. Procedia Comput Sci 178:194–204CrossRef Rakhmanov O (2020) A comparative study on vectorization and classification techniques in sentiment analysis to classify student-lecturer comments. Procedia Comput Sci 178:194–204CrossRef
35.
go back to reference Wang P, Fu H, Zhang K (2018) A pixel-level entropy-weighted image fusion algorithm based on bidimensional ensemble empirical mode decomposition. Int J Distrib Sens Netw 14(12):1550147718818755CrossRef Wang P, Fu H, Zhang K (2018) A pixel-level entropy-weighted image fusion algorithm based on bidimensional ensemble empirical mode decomposition. Int J Distrib Sens Netw 14(12):1550147718818755CrossRef
36.
go back to reference Shahzad K, Pervaz I, Nawab A (2018) WordNet based semantic similarity measures for process model matching. In: BIR Workshops, pp. 33–44 Shahzad K, Pervaz I, Nawab A (2018) WordNet based semantic similarity measures for process model matching. In: BIR Workshops, pp. 33–44
37.
go back to reference Tang D, Qin B, Wei F, Dong L, Liu T, Zhou M (2015) A joint segmentation and classification framework for sentence level sentiment classification. IEEE/ACM Trans Audio, Speech, and Language Process 23(11):1750–1761CrossRef Tang D, Qin B, Wei F, Dong L, Liu T, Zhou M (2015) A joint segmentation and classification framework for sentence level sentiment classification. IEEE/ACM Trans Audio, Speech, and Language Process 23(11):1750–1761CrossRef
38.
go back to reference Thakur RK, Deshpande MV (2019) Kernel Optimized-Support Vector Machine and Mapreduce framework for sentiment classification of train reviews. Internat J Uncertain Fuzziness Knowl-Based Syst 27(06):1025–1050CrossRef Thakur RK, Deshpande MV (2019) Kernel Optimized-Support Vector Machine and Mapreduce framework for sentiment classification of train reviews. Internat J Uncertain Fuzziness Knowl-Based Syst 27(06):1025–1050CrossRef
39.
go back to reference Liu Q, Wang J, Zhang D, Yang Y, Wang N (2018) Text features extraction based on TF-IDF associating semantic. In: proceedings of IEEE 4th International Conference on Computer and Communications (ICCC), pp. 2338–2343. Liu Q, Wang J, Zhang D, Yang Y, Wang N (2018) Text features extraction based on TF-IDF associating semantic. In: proceedings of IEEE 4th International Conference on Computer and Communications (ICCC), pp. 2338–2343.
40.
go back to reference Jack Russel F (2021) ALOA: Ant lion optimization algorithm-based deep learning for breast cancer classification. Multimed Res, vol.4, no.1, 2021. Jack Russel F (2021) ALOA: Ant lion optimization algorithm-based deep learning for breast cancer classification. Multimed Res, vol.4, no.1, 2021.
41.
go back to reference Srinivas K (2020) Prediction of e-learning efficiency by deep learning in E-khool online portal networks. Multimed Res vol.3, no.4 Srinivas K (2020) Prediction of e-learning efficiency by deep learning in E-khool online portal networks. Multimed Res vol.3, no.4
42.
go back to reference Yuying C (2020) Crowd behaviour recognition using enhanced butterfly optimization algorithm based recurrent neural network. Multimed Res, vol.3, no.3, 2020. Yuying C (2020) Crowd behaviour recognition using enhanced butterfly optimization algorithm based recurrent neural network. Multimed Res, vol.3, no.3, 2020.
43.
go back to reference Chandanapalli SB, Reddy ES, Lakshmi DR (2019) Convolutional neural network for water quality prediction in WSN. J Netw Commun Syst 2(3):40–47 Chandanapalli SB, Reddy ES, Lakshmi DR (2019) Convolutional neural network for water quality prediction in WSN. J Netw Commun Syst 2(3):40–47
44.
go back to reference Kaviyaraj R, Uma M (2022) Augmented reality application in classroom: an immersive taxonomy. In: the proceedings of the 2022 4th International Conference on Smart Systems and Inventive Technology (ICSSIT), pp.1221–1226 Kaviyaraj R, Uma M (2022) Augmented reality application in classroom: an immersive taxonomy. In: the proceedings of the 2022 4th International Conference on Smart Systems and Inventive Technology (ICSSIT), pp.1221–1226
45.
go back to reference Srinivas V, Santhirani Ch (2020) Hybrid particle swarm optimization-deep neural network model for speaker recognition. Multimed Res 3(1):1–10 Srinivas V, Santhirani Ch (2020) Hybrid particle swarm optimization-deep neural network model for speaker recognition. Multimed Res 3(1):1–10
Metadata
Title
Optimization-enabled deep learning for sentiment rating prediction using review data
Authors
Jyotsna Anthal
Bhavna Sharma
Jatinder Manhas
Publication date
22-02-2023
Publisher
Springer London
Published in
Service Oriented Computing and Applications / Issue 1/2023
Print ISSN: 1863-2386
Electronic ISSN: 1863-2394
DOI
https://doi.org/10.1007/s11761-023-00357-9

Other articles of this Issue 1/2023

Service Oriented Computing and Applications 1/2023 Go to the issue

Premium Partner