skip to main content
10.1145/564376.564419acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
Article

Collaborative filtering with privacy via factor analysis

Published:11 August 2002Publication History

ABSTRACT

Collaborative filtering (CF) is valuable in e-commerce, and for direct recommendations for music, movies, news etc. But today's systems have several disadvantages, including privacy risks. As we move toward ubiquitous computing, there is a great potential for individuals to share all kinds of information about places and things to do, see and buy, but the privacy risks are severe. In this paper we describe a new method for collaborative filtering which protects the privacy of individual data. The method is based on a probabilistic factor analysis model. Privacy protection is provided by a peer-to-peer protocol which is described elsewhere, but outlined in this paper. The factor analysis approach handles missing data without requiring default values for them. We give several experiments that suggest that this is most accurate method for CF to date. The new algorithm has other advantages in speed and storage over previous algorithms. Finally, we suggest applications of the approach to other kinds of statistical analyses of survey or questionaire data.

References

  1. C. Basu, H. Hirsh, and W. W. Cohen. Recommendation as classification: Using social and content-based information in recommendation. In AAAI/IAAI, pages 714--720, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Breese, Heckermen, and Kadie. Empirical analysis of predictive algorithms for collaborative filtering. Technical report, Microsoft Research, October 1998.Google ScholarGoogle Scholar
  3. J. Canny. Collaborative filtering with privacy. In IEEE Symposium on Security and Privacy, pages 45--57, Oakland, CA, May 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. J. Canny. Some techniques for privacy in ubicomp and context-aware applications. In UBICOMP-2002, Goteborg, Sweden, Sept. 2002. (submitted).Google ScholarGoogle Scholar
  5. M. Claypool, A. Gokhale, T. Miranda, P. Murnikov, D. Netes, and M. Sartin. Combining content-based and collaborative filters in an online newspaper. In ACM SIGIR WS on Recommender Systems, 1999.Google ScholarGoogle Scholar
  6. A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 39(1):1--38, 1977.Google ScholarGoogle ScholarCross RefCross Ref
  7. J. DeTreville, 2002. personal communication.Google ScholarGoogle Scholar
  8. B. Frey. Turbo factor analysis. Adv. Neural Information Processing, 1999. (submitted).Google ScholarGoogle Scholar
  9. Z. Ghahramani and M. I. Jordan. Learning from incomplete data. Technical Report AIM-1509, MIT AI Lab, 1994. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. K. Goldberg, D. Gupta, M. Digiovanni, and H. Narita. Jester 2.0 : Evaluation of a new linear time collaborative filtering algorithm. In ACM SIGIR, August 1999. Poster Session and Demonstration. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. N. Good, J. B. Schafer, J. A. Konstan, A. Borchers, B. M. Sarwar, J. L. Herlocker, and J. Riedl. Combining collaborative filtering with personal agents for better recommendations. In AAAI/IAAI, pages 439--446, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. Herlocker, J. Konstan, A. Borchers, and J. Riedl. An algorithmic framework for performing collaborative filtering. In Proc. ACM SIGIR, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. O. P. John. The "big five" factor taxonomy: Dimensions of personality in the natural language and in questionnaires. In L. A. Pervin, editor, Handbook of personality: Theory and research. Guilford, NY, 1990.Google ScholarGoogle Scholar
  14. M. Jordan and C. Bishop. An Introduction to Graphical Models. MIT Press, 2002. In press.Google ScholarGoogle Scholar
  15. J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells, and B. Zhao. Oceanstore: An architecture for global-scale persistent storage. In ACM ASPLOS, November 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. D. Pennock and E. Horvitz. Collaborative filtering by personality diagnosis: A hybrid memory- and model-based approach. In IJCAI Workshop on Machine Learning for Information Filtering, Stockholm, Sweden, August 1999.Google ScholarGoogle Scholar
  17. A. Popescul, L. Ungar, D. Pennock, and S. Lawrence. Probabilistic models for unified collaborative and content-based recommendation in sparse-data environments. In 17th Conference on Uncertainty in Artificial Intelligence, Seattle, WA, August 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. E. M. Rogers. Diffusion of Innovations, Fourth Edition. The Free Press, 1995.Google ScholarGoogle Scholar
  19. B. M. Sarwar, G. Karypis, J. A. Konstan, and J. Riedl. Application of dimensionality reduction in recommender system -- a case study. In ACM WebKDD 2000 Web Mining for E-Commerce Workshop, 2000. Full length paper.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Collaborative filtering with privacy via factor analysis

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Conferences
            SIGIR '02: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
            August 2002
            478 pages
            ISBN:1581135610
            DOI:10.1145/564376

            Copyright © 2002 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 11 August 2002

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • Article

            Acceptance Rates

            SIGIR '02 Paper Acceptance Rate44of219submissions,20%Overall Acceptance Rate792of3,983submissions,20%

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader