Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 2/2021

26.08.2020 | Original Article

InterSentiment: combining deep neural models on interaction and sentiment for review rating prediction

verfasst von: Shi Feng, Kaisong Song, Daling Wang, Wei Gao, Yifei Zhang

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 2/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Review rating prediction is commonly approached from the perspective of either Collaborative Filtering (CF) or Sentiment Classification (SC). CF-based approach usually resorts to matrix factorization based on user–item interaction, and does not fully utilize the valuable review text features. In contrast, SC-based approach is focused on mining review content, but can just incorporate some user- and product-level features, and fails to capture sufficient interactions between them represented typically in a sparse matrix as CF can do. In this paper, we propose a novel, extensible review rating prediction model called InterSentiment by bridging the user-product interaction model and the sentiment model based on deep learning. InterSentiment is a specific instance of our proposed Deep Learning based Collaborative Filtering framework. The proposed model aims to learn the high-level representations combining user-product interaction and review sentiment, and jointly project them into the rating scores. Results of experiments conducted on IMDB and two Yelp datasets demonstrate clear advantage of our proposed approach over strong baseline methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Fußnoten
5
The improvement is calculated by \(|RMSE(\mathrm{Ours})-RMSE(\mathrm{UPNN})|/RMSE(\mathrm{UPNN})\).
 
6
The improvement is calculated by \(|RMSE(\mathrm{Ours})-RMSE(\mathrm{TLFM})|/RMSE(\mathrm{TLFM})\).
 
Literatur
1.
Zurück zum Zitat Amplayo RK, Kim J, Sung S, Hwang S (2018) Cold-start aware user and product attention for sentiment classification. In: Proceedings of the 56th annual meeting of the association for computational linguistics, ACL 2018, Melbourne, Australia, July 15–20, 2018, vol 1: Long Papers, pp 2535–2544 Amplayo RK, Kim J, Sung S, Hwang S (2018) Cold-start aware user and product attention for sentiment classification. In: Proceedings of the 56th annual meeting of the association for computational linguistics, ACL 2018, Melbourne, Australia, July 15–20, 2018, vol 1: Long Papers, pp 2535–2544
2.
Zurück zum Zitat Bell RM, Koren Y (2007) Lessons from the netflix prize challenge. SIGKDD Explorr 9(2):75–79CrossRef Bell RM, Koren Y (2007) Lessons from the netflix prize challenge. SIGKDD Explorr 9(2):75–79CrossRef
3.
Zurück zum Zitat Cai Y, Yang K, Huang D, Zhou Z, Lei X, Xie H, Wong T (2019) A hybrid model for opinion mining based on domain sentiment dictionary. Int. J. Mach. Learn. Cybernet. 10(8):2131–2142CrossRef Cai Y, Yang K, Huang D, Zhou Z, Lei X, Xie H, Wong T (2019) A hybrid model for opinion mining based on domain sentiment dictionary. Int. J. Mach. Learn. Cybernet. 10(8):2131–2142CrossRef
4.
Zurück zum Zitat Diao Q, Qiu M, Wu C, Smola AJ, Jiang J, Wang C (2014) Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS). In: SIGKDD, pp 193–202 Diao Q, Qiu M, Wu C, Smola AJ, Jiang J, Wang C (2014) Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS). In: SIGKDD, pp 193–202
5.
Zurück zum Zitat Ding X, Liu B, Yu PS (2008) A holistic lexicon-based approach to opinion mining. In: WSDM, pp 231–240 Ding X, Liu B, Yu PS (2008) A holistic lexicon-based approach to opinion mining. In: WSDM, pp 231–240
6.
Zurück zum Zitat Dou Z (2017) Capturing user and product information for document level sentiment analysis with deep memory network. In: Proceedings of the 2017 conference on empirical methods in natural language processing, EMNLP 2017, Copenhagen, Denmark, September 9–11, 2017, pp 521–526 Dou Z (2017) Capturing user and product information for document level sentiment analysis with deep memory network. In: Proceedings of the 2017 conference on empirical methods in natural language processing, EMNLP 2017, Copenhagen, Denmark, September 9–11, 2017, pp 521–526
7.
Zurück zum Zitat Dridi A, Recupero DR (2019) Leveraging semantics for sentiment polarity detection in social media. Int. J. Mach. Learn. Cybernet. 10(8):2045–2055CrossRef Dridi A, Recupero DR (2019) Leveraging semantics for sentiment polarity detection in social media. Int. J. Mach. Learn. Cybernet. 10(8):2045–2055CrossRef
8.
Zurück zum Zitat Fan R, Chang K, Hsieh C, Wang X, Lin C (2008) LIBLINEAR: a library for large linear classification. JMLR 9:1871–1874MATH Fan R, Chang K, Hsieh C, Wang X, Lin C (2008) LIBLINEAR: a library for large linear classification. JMLR 9:1871–1874MATH
9.
Zurück zum Zitat Feng S, Wang D, Yu G, Gao W, Wong K (2011) Extracting common emotions from blogs based on fine-grained sentiment clustering. Knowl Inf Syst 27(2):281–302CrossRef Feng S, Wang D, Yu G, Gao W, Wong K (2011) Extracting common emotions from blogs based on fine-grained sentiment clustering. Knowl Inf Syst 27(2):281–302CrossRef
10.
Zurück zum Zitat Firdaus SN, Ding C, Sadeghian A (2019) Topic specific emotion detection for retweet prediction. Int. J. Mach. Learn. Cybernet. 10(8):2071–2083CrossRef Firdaus SN, Ding C, Sadeghian A (2019) Topic specific emotion detection for retweet prediction. Int. J. Mach. Learn. Cybernet. 10(8):2071–2083CrossRef
11.
Zurück zum Zitat Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: AISTATS, pp 249–256 Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: AISTATS, pp 249–256
12.
Zurück zum Zitat He X, Liao L, Zhang H, Nie L, Hu X, Chua TS (2017) Neural collaborative filtering. In: WWW He X, Liao L, Zhang H, Nie L, Hu X, Chua TS (2017) Neural collaborative filtering. In: WWW
13.
Zurück zum Zitat Kim DH, Park C, Oh J, Lee S, Yu H (2016) Convolutional matrix factorization for document context-aware recommendation. In: RecSys, pp 233–240 Kim DH, Park C, Oh J, Lee S, Yu H (2016) Convolutional matrix factorization for document context-aware recommendation. In: RecSys, pp 233–240
14.
Zurück zum Zitat Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: ICDM, pp 426–434 Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: ICDM, pp 426–434
15.
Zurück zum Zitat Li F, Liu NN, Jin H, Zhao K, Yang Q, Zhu X (2011) Incorporating reviewer and product information for review rating prediction. In: IJCAI, pp 1820–1825 Li F, Liu NN, Jin H, Zhao K, Yang Q, Zhu X (2011) Incorporating reviewer and product information for review rating prediction. In: IJCAI, pp 1820–1825
16.
Zurück zum Zitat Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: NIPS, pp 3111–3119 Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: NIPS, pp 3111–3119
17.
Zurück zum Zitat Mukherjee S, Basu G, Joshi S (2013) Incorporating author preference in sentiment rating prediction of reviews. In: 22nd International World Wide Web Conference, WWW ’13, Rio de Janeiro, Brazil, May 13–17, 2013, Companion Volume, pp 47–48 Mukherjee S, Basu G, Joshi S (2013) Incorporating author preference in sentiment rating prediction of reviews. In: 22nd International World Wide Web Conference, WWW ’13, Rio de Janeiro, Brazil, May 13–17, 2013, Companion Volume, pp 47–48
18.
Zurück zum Zitat Pang B, Lee L (2005) Seeing stars: exploiting class relationships for sentiment categorization with respect to rating scales. In: ACL, pp 115–124 Pang B, Lee L (2005) Seeing stars: exploiting class relationships for sentiment categorization with respect to rating scales. In: ACL, pp 115–124
19.
Zurück zum Zitat Rendle S (2010) Factorization machines. In: ICDM 2010, The 10th IEEE international conference on data mining, 2010, pp 995–1000 Rendle S (2010) Factorization machines. In: ICDM 2010, The 10th IEEE international conference on data mining, 2010, pp 995–1000
20.
Zurück zum Zitat Ren Y, Zhang Y, Zhang M, Ji D (2016) Context-sensitive twitter sentiment classification using neural network. In: AAAI, pp 215–221 Ren Y, Zhang Y, Zhang M, Ji D (2016) Context-sensitive twitter sentiment classification using neural network. In: AAAI, pp 215–221
21.
Zurück zum Zitat Salakhutdinov R, Mnih A (2007) Probabilistic matrix factorization. In: NIPS, pp 1257–1264 Salakhutdinov R, Mnih A (2007) Probabilistic matrix factorization. In: NIPS, pp 1257–1264
22.
Zurück zum Zitat Shen R, Zhang H, Yu H, Min F (2019) Sentiment based matrix factorization with reliability for recommendation. Expert Syst Appl 135:249–258CrossRef Shen R, Zhang H, Yu H, Min F (2019) Sentiment based matrix factorization with reliability for recommendation. Expert Syst Appl 135:249–258CrossRef
23.
Zurück zum Zitat Song K, Feng S, Gao W, Wang D, Yu G, Wong K (2015) Personalized sentiment classification based on latent individuality of microblog users. In: IJCAI, pp 2277–2283 Song K, Feng S, Gao W, Wang D, Yu G, Wong K (2015) Personalized sentiment classification based on latent individuality of microblog users. In: IJCAI, pp 2277–2283
24.
Zurück zum Zitat Song K, Chen L, Gao W, Feng S, Wang D, Zhang C (2016) Persentiment: A personalized sentiment classification system for microblog users. In: Proceedings of the 25th international conference on World Wide Web, WWW 2016, pp 255–258 Song K, Chen L, Gao W, Feng S, Wang D, Zhang C (2016) Persentiment: A personalized sentiment classification system for microblog users. In: Proceedings of the 25th international conference on World Wide Web, WWW 2016, pp 255–258
25.
Zurück zum Zitat Song K, Gao W, Feng S, Wang D, Wong K, Zhang C (2017) Recommendation vs sentiment analysis: a text-driven latent factor model for rating prediction with cold-start awareness. In: IJCAI, pp 2744–2750 Song K, Gao W, Feng S, Wang D, Wong K, Zhang C (2017) Recommendation vs sentiment analysis: a text-driven latent factor model for rating prediction with cold-start awareness. In: IJCAI, pp 2744–2750
26.
Zurück zum Zitat Tang D, Wei F, Yang N, Zhou M, Liu T, Qin B (2014) Learning sentiment-specific word embedding for twitter sentiment classification. In: ACL, pp 1555–1565 Tang D, Wei F, Yang N, Zhou M, Liu T, Qin B (2014) Learning sentiment-specific word embedding for twitter sentiment classification. In: ACL, pp 1555–1565
27.
Zurück zum Zitat Tang D, Qin B, Liu T (2015) Learning semantic representations of users and products for document level sentiment classification. In: ACL, pp 1014–1023 Tang D, Qin B, Liu T (2015) Learning semantic representations of users and products for document level sentiment classification. In: ACL, pp 1014–1023
28.
Zurück zum Zitat Tang D, Qin B, Liu T, Yang Y (2015) User modeling with neural network for review rating prediction. In: IJCAI, pp 1340–1346 Tang D, Qin B, Liu T, Yang Y (2015) User modeling with neural network for review rating prediction. In: IJCAI, pp 1340–1346
29.
Zurück zum Zitat Wang H, Wang N, Yeung D (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, 2015, pp 1235–1244 Wang H, Wang N, Yeung D (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, 2015, pp 1235–1244
30.
Zurück zum Zitat Wu F, Huang Y (2016) Personalized microblog sentiment classification via multi-task learning. In: Proceedings of the thirtieth AAAI conference on artificial intelligence, pp 3059–3065 Wu F, Huang Y (2016) Personalized microblog sentiment classification via multi-task learning. In: Proceedings of the thirtieth AAAI conference on artificial intelligence, pp 3059–3065
31.
Zurück zum Zitat Xu J, Yao Y, Tong H, Tao X, Lu J (2015) Ice-breaking: Mitigating cold-start recommendation problem by rating comparison. In: Proceedings of the twenty-fourth international joint conference on artificial intelligence, IJCAI 2015, pp 3981–3987 Xu J, Yao Y, Tong H, Tao X, Lu J (2015) Ice-breaking: Mitigating cold-start recommendation problem by rating comparison. In: Proceedings of the twenty-fourth international joint conference on artificial intelligence, IJCAI 2015, pp 3981–3987
32.
Zurück zum Zitat Yuan Y, Luo X, Shang M (2018) Effects of preprocessing and training biases in latent factor models for recommender systems. Neurocomputing 275:2019–2030CrossRef Yuan Y, Luo X, Shang M (2018) Effects of preprocessing and training biases in latent factor models for recommender systems. Neurocomputing 275:2019–2030CrossRef
33.
Zurück zum Zitat Yue L, Chen W, Li X, Zuo W, Yin M (2019) A survey of sentiment analysis in social media. Knowl Inf Syst 60(2):617–663CrossRef Yue L, Chen W, Li X, Zuo W, Yin M (2019) A survey of sentiment analysis in social media. Knowl Inf Syst 60(2):617–663CrossRef
34.
Zurück zum Zitat Zhang Y, Lai G, Zhang M, Zhang Y, Liu Y, Ma S (2014) Explicit factor models for explainable recommendation based on phrase-level sentiment analysis. In: SIGIR, pp 83–92 Zhang Y, Lai G, Zhang M, Zhang Y, Liu Y, Ma S (2014) Explicit factor models for explainable recommendation based on phrase-level sentiment analysis. In: SIGIR, pp 83–92
35.
Zurück zum Zitat Zhang M, Tang J, Zhang X, Xue X (2014) Addressing cold start in recommender systems: a semi-supervised co-training algorithm. In: Proceedings of the 37th international ACM SIGIR conference on research and development in information retrieval, SIGIR ’14, pp 73–82 Zhang M, Tang J, Zhang X, Xue X (2014) Addressing cold start in recommender systems: a semi-supervised co-training algorithm. In: Proceedings of the 37th international ACM SIGIR conference on research and development in information retrieval, SIGIR ’14, pp 73–82
36.
Zurück zum Zitat Zhang J, Chow C, Xu J (2017) Enabling kernel-based attribute-aware matrix factorization for rating prediction. IEEE Trans Knowl Data Eng 29(4):798–812CrossRef Zhang J, Chow C, Xu J (2017) Enabling kernel-based attribute-aware matrix factorization for rating prediction. IEEE Trans Knowl Data Eng 29(4):798–812CrossRef
37.
Zurück zum Zitat Zhao J, Dong L, Wu J, Xu K (2012) Moodlens: an emoticon-based sentiment analysis system for Chinese tweets. In: The 18th ACM SIGKDD international conference on knowledge discovery and data mining, KDD ’12, pp 1528–1531 Zhao J, Dong L, Wu J, Xu K (2012) Moodlens: an emoticon-based sentiment analysis system for Chinese tweets. In: The 18th ACM SIGKDD international conference on knowledge discovery and data mining, KDD ’12, pp 1528–1531
Metadaten
Titel
InterSentiment: combining deep neural models on interaction and sentiment for review rating prediction
verfasst von
Shi Feng
Kaisong Song
Daling Wang
Wei Gao
Yifei Zhang
Publikationsdatum
26.08.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 2/2021
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-020-01181-9

Weitere Artikel der Ausgabe 2/2021

International Journal of Machine Learning and Cybernetics 2/2021 Zur Ausgabe

Neuer Inhalt