Skip to main content
Top

2019 | OriginalPaper | Chapter

A Comparative Study of Different Similarity Metrics in Highly Sparse Rating Dataset

Authors : Pradeep Kumar Singh, Pijush Kanti Dutta Pramanik, Prasenjit Choudhury

Published in: Data Management, Analytics and Innovation

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recommender system has been popularly used for recommending products and services to the online buyers and users. Collaborative Filtering (CF) is one of the most popular filtering approaches used to find the preferences of users for the recommendation. CF works on the ratings given by the users for a particular item. It predicts the rating that is not explicitly given for any item and build the recommendation list for a particular user. Different similarity metrics and prediction approaches are used for this purpose. But these metrics and approaches have some issues in dealing with highly sparse datasets. In this paper, we sought to find the most accurate combinations of similarity metrics and prediction approaches for both user and item similarity based CF. In this comparative study, we deliberately instill sparsity of different magnitudes (10, 20, 30 and 40%) by deleting given ratings in an existing dataset. We then predict the deleted ratings using different combinations of similarity metrics and prediction approach. We assessed the accuracy of the prediction with the help of two evaluation metrics (MAE and RMSE).

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
3.
go back to reference García-Cumbreras, M. Á., Montejo-Ráez, A., & Díaz-Galiano, M. C. (2013). Pessimists and optimists: Improving collaborative filtering through sentiment analysis. Expert Systems with Applications: An International Journal, 40(17), 6758–6765.CrossRef García-Cumbreras, M. Á., Montejo-Ráez, A., & Díaz-Galiano, M. C. (2013). Pessimists and optimists: Improving collaborative filtering through sentiment analysis. Expert Systems with Applications: An International Journal, 40(17), 6758–6765.CrossRef
4.
go back to reference Boratto, L., & Salvatore, C. (2014). Using collaborative filtering to overcome the curse of dimensionality when clustering users in a group recommender system. In 16th International Conference on Enterprise Information Systems. Boratto, L., & Salvatore, C. (2014). Using collaborative filtering to overcome the curse of dimensionality when clustering users in a group recommender system. In 16th International Conference on Enterprise Information Systems.
5.
go back to reference Said, A., Fields, B., Jain, B. J., & Albayrak, S. (2013). User-centric evaluation of a K-furthest neighbor collaborative filtering recommender algorithm. In 16th ACM Conference on Computer Supported Cooperative Work and Social Computing. Said, A., Fields, B., Jain, B. J., & Albayrak, S. (2013). User-centric evaluation of a K-furthest neighbor collaborative filtering recommender algorithm. In 16th ACM Conference on Computer Supported Cooperative Work and Social Computing.
6.
go back to reference Pirasteh, P., Jung, J. J., & Hwang, D. (2014). Item-based collaborative filtering with attribute correlation: A case study on movie recommendation. In Intelligent Information and Database Systems: 6th Asian Conference. Pirasteh, P., Jung, J. J., & Hwang, D. (2014). Item-based collaborative filtering with attribute correlation: A case study on movie recommendation. In Intelligent Information and Database Systems: 6th Asian Conference.
7.
go back to reference Jawaheer, G., Szomszor, M., & Kostkova, P. (2010). Comparison of implicit and explicit feedback from an online music recommendation service. 1st International Workshop on Information Heterogeneity and Fusion in Recommender Systems. Jawaheer, G., Szomszor, M., & Kostkova, P. (2010). Comparison of implicit and explicit feedback from an online music recommendation service. 1st International Workshop on Information Heterogeneity and Fusion in Recommender Systems.
8.
go back to reference Sun, D., Luo, Z., & Zhang, F. (2011). A novel approach for collaborative filtering to alleviate the new item cold-start problem. In 11th International Symposium on Communications and Information Technologies. Sun, D., Luo, Z., & Zhang, F. (2011). A novel approach for collaborative filtering to alleviate the new item cold-start problem. In 11th International Symposium on Communications and Information Technologies.
9.
go back to reference Hu, R., & Lu, Y. (2006). A hybrid user and item-based collaborative filtering with smoothing on sparse data. ICAT Workshops. Hu, R., & Lu, Y. (2006). A hybrid user and item-based collaborative filtering with smoothing on sparse data. ICAT Workshops.
10.
go back to reference Sarwar, B. M., Karypis, G., Konstan, J. A., & Riedl, J. T. (2000). Application of dimensionality reduction in recommender system—A case study. ACM WEBKDD Workshop. Sarwar, B. M., Karypis, G., Konstan, J. A., & Riedl, J. T. (2000). Application of dimensionality reduction in recommender system—A case study. ACM WEBKDD Workshop.
11.
go back to reference Bokde, D. K., Girase, S., & Mukhopadhyay, D. (2015). An item-based collaborative filtering using dimensionality reduction techniques on mahout framework. CoRR. Bokde, D. K., Girase, S., & Mukhopadhyay, D. (2015). An item-based collaborative filtering using dimensionality reduction techniques on mahout framework. CoRR.
12.
go back to reference Puntheeranurak, S., & Chaiwitooanukool, T. (2011). An item-based collaborative filtering method using Item-based hybrid similarity. In 2nd International Conference on Software Engineering and Service Science. Puntheeranurak, S., & Chaiwitooanukool, T. (2011). An item-based collaborative filtering method using Item-based hybrid similarity. In 2nd International Conference on Software Engineering and Service Science.
13.
go back to reference Fikir, O. B., Yaz, I. O., & Özyer, T. (2010). A movie rating prediction algorithm with collaborative filtering. In International Conference on Advances in Social Networks Analysis and Mining. Fikir, O. B., Yaz, I. O., & Özyer, T. (2010). A movie rating prediction algorithm with collaborative filtering. In International Conference on Advances in Social Networks Analysis and Mining.
14.
go back to reference Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2001). Item-based collaborative filtering recommendation algorithms. In 10th International Conference on World Wide Web. Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2001). Item-based collaborative filtering recommendation algorithms. In 10th International Conference on World Wide Web.
15.
go back to reference Bilge, A., & Kaleli, C. (2014). A multi-criteria item-based collaborative filtering framework. In 11th International Joint Conference on Computer Science and Software Engineering. Bilge, A., & Kaleli, C. (2014). A multi-criteria item-based collaborative filtering framework. In 11th International Joint Conference on Computer Science and Software Engineering.
16.
go back to reference Bobadilla, J., Hernando, A., Ortega, F., & Abraham, G. (2012). Collaborative filtering based on significances. Information Sciences, 185(1), 1–17.CrossRef Bobadilla, J., Hernando, A., Ortega, F., & Abraham, G. (2012). Collaborative filtering based on significances. Information Sciences, 185(1), 1–17.CrossRef
17.
go back to reference Xu, J., & Man, H. (2011). Dictionary learning based on Laplacian score in sparse coding. In Machine Learning and Data Mining in Pattern Recognition—7th International Conference. Xu, J., & Man, H. (2011). Dictionary learning based on Laplacian score in sparse coding. In Machine Learning and Data Mining in Pattern Recognition—7th International Conference.
18.
go back to reference Liu, H., Hu, Z., Mian, A. U., Tian, H., & Zhu, X. (2014). A new user similarity model to improve the accuracy of collaborative filtering. Knowledge-Based Systems, 56, 156–166.CrossRef Liu, H., Hu, Z., Mian, A. U., Tian, H., & Zhu, X. (2014). A new user similarity model to improve the accuracy of collaborative filtering. Knowledge-Based Systems, 56, 156–166.CrossRef
19.
go back to reference Wu, J., Chen, L., Feng, Z., Zhou, M., & Wu, Z. (2013). Predicting quality of service for selection by neighborhood based collaborative filtering. IEEE Transactions Systems, Man, and Cybernetics: Systems, 43(2), 428–439. Wu, J., Chen, L., Feng, Z., Zhou, M., & Wu, Z. (2013). Predicting quality of service for selection by neighborhood based collaborative filtering. IEEE Transactions Systems, Man, and Cybernetics: Systems, 43(2), 428–439.
20.
go back to reference Herlocker, J. L., Konstan, J. A., Borchers, A., & Riedl, J. (1999). An algorithmic framework for performing collaborative filtering. In 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Herlocker, J. L., Konstan, J. A., Borchers, A., & Riedl, J. (1999). An algorithmic framework for performing collaborative filtering. In 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.
21.
go back to reference Herlocker, J. L., Konstan, J. A., & Riedl, J. (2002). An empirical analysis of design choices in neighborhood-based collaborative filtering algorithms. Information Retrieval, 5, 287–310.CrossRef Herlocker, J. L., Konstan, J. A., & Riedl, J. (2002). An empirical analysis of design choices in neighborhood-based collaborative filtering algorithms. Information Retrieval, 5, 287–310.CrossRef
22.
go back to reference Yang, X., Guo, Y., Liu, Y., & Steck, H. (2014). A survey of collaborative filtering based social recommender systems. Computer Communications, 41, 1–10.CrossRef Yang, X., Guo, Y., Liu, Y., & Steck, H. (2014). A survey of collaborative filtering based social recommender systems. Computer Communications, 41, 1–10.CrossRef
Metadata
Title
A Comparative Study of Different Similarity Metrics in Highly Sparse Rating Dataset
Authors
Pradeep Kumar Singh
Pijush Kanti Dutta Pramanik
Prasenjit Choudhury
Copyright Year
2019
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-1274-8_4