Jin Yao Chin
ABSTRACT
Textual reviews, which are readily available on many e-commerce and review websites such as Amazon and Yelp, serve as an invaluable source of information for recommender systems. However, not all parts of the reviews are equally important, and the same choice of words may reflect a different meaning based on its context. In this paper, we propose a novel end-to-end Aspect-based Neural Recommender (ANR) to perform aspect-based representation learning for both users and items via an attention-based component. Furthermore, we model the multi-faceted process behind how users rate items by estimating the aspect-level user and item importance by adapting the neural co-attention mechanism. Our proposed model concurrently address several shortcomings of existing recommender systems, and a thorough experimental study on 25 benchmark datasets from Amazon and Yelp shows that ANR significantly outperforms recently proposed state-of-the-art baselines such as DeepCoNN, D-Attn and ALFM.
- Amjad Almahairi, Kyle Kastner, Kyunghyun Cho, and Aaron Courville. 2015. Learning Distributed Representations from Reviews for Collaborative Filtering. In RecSys '15 . ACM, New York, NY, USA, 147--154. Google Scholar
Digital Library
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural Machine Translation by Jointly Learning to Align and Translate. CoRR , Vol. abs/1409.0473 (2014). http://arxiv.org/abs/1409.0473Google Scholar
- Trapit Bansal, David Belanger, and Andrew McCallum. 2016. Ask the GRU: Multi-task Learning for Deep Text Recommendations. In RecSys '16 . ACM, 107--114. Google ScholarDigital Library
- Yang Bao, Hui Fang, and Jie Zhang. 2014. TopicMF: Simultaneously Exploiting Ratings and Reviews for Recommendation. In AAAI '14 . AAAI Press, 2--8. Google ScholarDigital Library
- Konstantin Bauman, Bing Liu, and Alexander Tuzhilin. 2017. Aspect Based Recommendations: Recommending Items with the Most Valuable Aspects Based on User Reviews. In KDD '17. ACM, 717--725. Google ScholarDigital Library
- David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet Allocation. JMLR , Vol. 3 (March 2003), 993--1022. Google Scholar
- Rose Catherine and William Cohen. 2017. TransNets: Learning to Transform for Recommendation. In RecSys '17 . ACM, New York, NY, USA, 288--296. Google ScholarDigital Library
- Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2018. Neural Attentional Rating Regression with Review-level Explanations. In WWW '18 . 1583--1592. Google ScholarDigital Library
- Xu Chen, Zheng Qin, Yongfeng Zhang, and Tao Xu. 2016. Learning to Rank Features for Recommendation over Multiple Categories. In SIGIR '16 . ACM, New York, NY, USA, 305--314. Google ScholarDigital Library
- Zhiyong Cheng, Ying Ding, Lei Zhu, and Mohan Kankanhalli. 2018. Aspect-Aware Latent Factor Model: Rating Prediction with Ratings and Reviews. In WWW '18 . 639--648. Google ScholarDigital Library
- Alexis Conneau, Holger Schwenk, Loïc Barrault, and Yann Lecun. 2017. Very Deep Convolutional Networks for Text Classification. In EACL '17 . ACL, 1107--1116.Google Scholar
- Qiming Diao, Minghui Qiu, Chao-Yuan Wu, Alexander J. Smola, Jing Jiang, and Chong Wang. 2014. Jointly Modeling Aspects, Ratings and Sentiments for Movie Recommendation (JMARS). In KDD '14 . ACM, New York, NY, USA, 193--202. Google ScholarDigital Library
- Dumitru Erhan, Yoshua Bengio, Aaron Courville, Pierre-Antoine Manzagol, Pascal Vincent, and Samy Bengio. 2010. Why Does Unsupervised Pre-training Help Deep Learning? JMLR , Vol. 11 (March 2010), 625--660. Google ScholarDigital Library
- Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning .MIT Press. http://www.deeplearningbook.org. Google ScholarDigital Library
- Ruining He and Julian McAuley. 2016. Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering. In WWW '16. 507--517. Google ScholarDigital Library
- Xiangnan He, Tao Chen, Min-Yen Kan, and Xiao Chen. 2015. TriRank: Review-aware Explainable Recommendation by Modeling Aspects. In CIKM '15 . ACM, New York, NY, USA, 1661--1670. Google ScholarDigital Library
- Minqing Hu and Bing Liu. 2004. Mining and Summarizing Customer Reviews. In KDD '04. ACM, New York, NY, USA, 168--177. Google ScholarDigital Library
- Rie Johnson and Tong Zhang. 2017. Deep Pyramid Convolutional Neural Networks for Text Categorization. In ACL '17 . ACL, 562--570.Google Scholar
- Donghyun Kim, Chanyoung Park, Jinoh Oh, Sungyoung Lee, and Hwanjo Yu. 2016. Convolutional Matrix Factorization for Document Context-Aware Recommendation. In RecSys '16 . ACM, New York, NY, USA, 233--240. Google ScholarDigital Library
- Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In EMNLP '14 . ACL, 1746--1751.Google Scholar
- Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. CoRR , Vol. abs/1412.6980 (2014). http://arxiv.org/abs/1412.6980Google Scholar
- Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix Factorization Techniques for Recommender Systems. Computer , Vol. 42, 8 (Aug. 2009), 30--37. Google ScholarDigital Library
- Sheng Li, Jaya Kawale, and Yun Fu. 2015. Deep Collaborative Filtering via Marginalized Denoising Auto-encoder. In CIKM '15 . ACM, New York, NY, USA, 811--820. Google ScholarDigital Library
- Guang Ling, Michael R. Lyu, and Irwin King. 2014. Ratings Meet Reviews, a Combined Approach to Recommend. In RecSys '14 . ACM, New York, NY, USA, 105--112. Google ScholarDigital Library
- Jiasen Lu, Jianwei Yang, Dhruv Batra, and Devi Parikh. 2016. Hierarchical Question-image Co-attention for Visual Question Answering. In NIPS '16 . Curran Associates Inc., USA, 289--297. Google ScholarDigital Library
- Julian McAuley and Jure Leskovec. 2013. Hidden Factors and Hidden Topics: Understanding Rating Dimensions with Review Text. In RecSys '13. ACM, New York, NY, USA, 165--172. Google ScholarDigital Library
- Julian McAuley, Christopher Targett, Qinfeng Shi, and Anton van den Hengel. 2015. Image-Based Recommendations on Styles and Substitutes. In SIGIR '15 . ACM, New York, NY, USA, 43--52. Google ScholarDigital Library
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Distributed Representations of Words and Phrases and Their Compositionality. In NIPS '13 . 3111--3119. Google ScholarDigital Library
- Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global Vectors for Word Representation. In EMNLP '14. 1532--1543.Google Scholar
- Guang Qiu, Bing Liu, Jiajun Bu, and Chun Chen. 2011. Opinion Word Expansion and Target Extraction Through Double Propagation. COLING , Vol. 37, 1 (March 2011), 9--27. Google ScholarDigital Library
- Steffen Rendle. 2010. Factorization Machines. In ICDM '10. IEEE Computer Society, Washington, DC, USA, 995--1000. Google ScholarDigital Library
- Alexander M. Rush, Sumit Chopra, and Jason Weston. 2015. A Neural Attention Model for Abstractive Sentence Summarization. In EMNLP '15 . ACL, 379--389.Google ScholarCross Ref
- Sungyong Seo, Jing Huang, Hao Yang, and Yan Liu. 2017. Interpretable Convolutional Neural Networks with Dual Local and Global Attention for Review Rating Prediction. In RecSys '17. ACM, New York, NY, USA, 297--305. Google ScholarDigital Library
- Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A Simple Way to Prevent Neural Networks from Overfitting. JMLR , Vol. 15 (2014), 1929--1958. Google ScholarDigital Library
- Yunzhi Tan, Min Zhang, Yiqun Liu, and Shaoping Ma. 2016. Rating-boosted Latent Topics: Understanding Users and Items with Ratings and Reviews. In IJCAI '16. AAAI Press, 2640--2646. Google ScholarDigital Library
- Yi Tay, Anh Tuan Luu, and Siu Cheung Hui. 2018. Multi-Pointer Co-Attention Networks for Recommendation. In KDD '18 . ACM, 2309--2318. Google ScholarDigital Library
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In NIPS '17. Curran Associates, Inc., 5998--6008.Google Scholar
- Chong Wang and David M. Blei. 2011. Collaborative Topic Modeling for Recommending Scientific Articles. In KDD '11 . ACM, New York, NY, USA, 448--456. Google ScholarDigital Library
- Hao Wang, Naiyan Wang, and Dit-Yan Yeung. 2015. Collaborative Deep Learning for Recommender Systems. In KDD '15. ACM, New York, NY, USA, 1235--1244. Google ScholarDigital Library
- Yao Wu and Martin Ester. 2015. FLAME: A Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering. In WSDM '15. ACM, New York, NY, USA, 199--208. Google ScholarDigital Library
- Caiming Xiong, Victor Zhong, and Richard Socher. 2016. Dynamic Coattention Networks For Question Answering. CoRR , Vol. abs/1611.01604 (2016). http://arxiv.org/abs/1611.01604Google Scholar
- Yongfeng Zhang. 2015. Incorporating Phrase-level Sentiment Analysis on Textual Reviews for Personalized Recommendation. In WSDM '15. ACM, New York, NY, USA, 435--440. Google ScholarDigital Library
- Yongfeng Zhang, Guokun Lai, Min Zhang, Yi Zhang, Yiqun Liu, and Shaoping Ma. 2014. Explicit Factor Models for Explainable Recommendation Based on Phrase-level Sentiment Analysis. In SIGIR '14. ACM, New York, NY, USA, 83--92. Google ScholarDigital Library
- Lei Zheng, Vahid Noroozi, and Philip S. Yu. 2017. Joint Deep Modeling of Users and Items Using Reviews for Recommendation. In WSDM '17 . ACM, 425--434. Google ScholarDigital Library
Index Terms
- ANR: Aspect-based Neural Recommender
Recommendations
A comparative analysis of recommender systems based on item aspect opinions extracted from user reviews
In popular applications such as e-commerce sites and social media, users provide online reviews giving personal opinions about a wide array of items, such as products, services and people. These reviews are usually in the form of free text, and ...
Multilingual Review-aware Deep Recommender System via Aspect-based Sentiment Analysis
With the dramatic expansion of international markets, consumers write reviews in different languages, which poses a new challenge for Recommender Systems (RSs) dealing with this increasing amount of multilingual information. Recent studies that leverage ...
CADPP: An Effective Approach to Recommend Attentive and Diverse Long-tail Items
WI-IAT '21: IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent TechnologyAs the long-tail items are widely seen in various recommendation related applications, e.g., E-commerce and music recommendation, the long-tail recommendation consequently becomes an important research issue attracting both academic and industrial ...
Comments