skip to main content
10.1145/1250910.1250929acmconferencesArticle/Chapter ViewAbstractPublication PagesecConference Proceedingsconference-collections
Article

Evaluating compound critiquing recommenders: a real-user study

Published:11 June 2007Publication History

ABSTRACT

Conversational recommender systems are designed to help users to more efficiently navigate complex product spaces by alternatively making recommendations and inviting users' feedback. Compound critiquing techniques provide an efficient way for users to feed back their preferences (in terms of several simultaneous product attributes) when interfacing with conversational recommender systems. For example, in the laptop domain a user might wish to express a preference for a laptop that is "Cheaper, Lighter, with a Larger Screen". While recently a number of techniques for dynamically generating compound critiques have been proposed, to date there has been a lack of direct comparison of these approaches in a real-user study. In this paper we will compare two alternative approaches to the dynamic generation of compound critiques based on ideas from data mining and multi-attribute utility theory. We will demonstrate how both approaches support users to more efficiently navigate complex product spaces highlighting, in particular, the influence of product complexity and interface strategy on recommendation performance and user satisfaction.

References

  1. R. Agrawal, H. Mannila, R. Srikant, H. Toivonen, and A. I. Verkamo. Fast discovery of association rules. In Advances in Knowledge Discovery and Data Mining, pages 307--328. AAAI/MIT Press, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. D. Aha, L. Breslow, and H. Munoz-Avila. Conversational case-based reasoning. Applied Intel ligence, 14:9--32, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. R. Burke, K. Hammond, and B. Young. Knowledge-based navigation of complex information spaces. In Proceedings of the 13th National Conference on Artificial Intel ligence, pages 462--468. AAAI Press, 1996. Portland, OR. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. R. Burke, K. Hammond, and B. Young. The findme approach to assisted browsing. IEEE Expert, 12(4):32--40, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. A. Jameson, B. Großmann-Hutter, L. March, R. Rummer, T. Bohnenberger, and F. Wittig. When actions have consequences: Empirically based decision making for intelligent user interfaces. Knowledge-Based Systems, 14(1-2):75--92, 2001.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. R. Keeney and H. Raiffa. Decisions with Multiple Objectives: Preferences and Value Tradeoffs. John Wiley and Sons, New York, 1976.Google ScholarGoogle Scholar
  7. K. McCarthy, L. McGinty, B. Smyth, and J. Reilly. On the evaluation of dynamic critiquing: A large-scale user study. In Proceedings of the Twentieth National Conference on Artificial Intel ligence and the 17th Innovative Applications of Artificial Intel ligence Conference (AAAI-2005), pages 535--540. AAAI Press AAAI Press / The MIT Press, 2005. July 9-13, 2005, Pittsburgh, Pennsylvania, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. K. McCarthy, J. Reilly, L. McGinty, and B. Smyth. Experiments in dynamic critiquing. In Proceedings of the 10th International Conference on Intel ligent User Interfaces (IUI '05), pages 175--182. ACM Press, 2005. San Diego, CA, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. K. McCarthy, J. Reilly, L. McGinty, and B. Smyth.Generating diverse compound critiques. Artifical Intel ligence Review, 24:339--357, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. L. McGinty and B. Smyth. Evaluating preference-based feedback in recommender systems. In Proceedings of the 13th Irish International Conference on Artificial Intel ligence and Cognitive Science (AICS-2002), pages 209--214. Springer, 2002. Limerick, Ireland. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. L. McGinty and B. Smyth. Tweaking critiquing. In Proceedings of the Workshop on Intel ligent Techniques for Personalization as part of The 18th International Joint Conference on Artificial Intel ligence, (IJCAI-03), pages 20--27, 2003. Acapulco, Mexico.Google ScholarGoogle Scholar
  12. D. McSherry. Similarity and compromise. In Proceedings of the 5th International Conference on Case-Based Reasoning (ICCBR 2003), pages 291--305. Springer, 2003. Trondheim, Norway, June 23-26, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. P. Pu and L. Chen. Integrating tradeoff support in product search tools for e-commerce sits. In Proceedings of the ACM Conference on Electronic Commerce (EC'05), pages 269--278, Vancouver, Canada, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. P. Pu and P. Kumar. Evaluating example-based search tools. In Proceedings of the ACM Conference on Electronic Commerce (EC'04), pages 208--217, New York, USA, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. J. Reilly, K. McCarthy, L. McGinty, and B. Smyth. Dynamic critiquing. In Proceedings of the 7th European Conference on Case-Based Reasoning (ECCBR-04), pages 763--777. Springer, 2004. Madrid, Spain.Google ScholarGoogle ScholarCross RefCross Ref
  16. J. Reilly, K. McCarthy, L. McGinty, and B. Smyth. Incremental critiquing. In Research and Development in Intel ligent Systems XXI. Proceedings of AI-2004, pages 101--114. Springer, 2004. Cambridge, UK.Google ScholarGoogle Scholar
  17. J. Reilly, J. Zhang, L. McGinty, P. Pu, and B. Smyth. A comparison of two compound critiquing systems. In Proceedings of the 12th International Conference on Intel ligent User Interfaces (IUI '07). ACM Press, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. P. Resnick, N. Iacovou, M. Suchak, P. Bergstorm, and J. Riedl. Grouplens: An open architecture for collaborative filtering of netnews. In Proceedings of ACM 1994 Conference on Computer Supported Cooperative Work, pages 175--186, Chapel Hill, North Carolina, 1994. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. J. B. Schafer, J. Konstan, and J. Riedl. E-commerce recommendation applications. Data Mining and Knowledge Discovery, 5(1/2):115--153, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. J. Zhang and P. Pu. A comparative study of compound critique generation in conversational recommender systems. In Proceedings of the 4th International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems (AH 2006), pages 234--243. Springer, 2006. Dublin, Ireland, June 21-23, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Evaluating compound critiquing recommenders: a real-user study

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        EC '07: Proceedings of the 8th ACM conference on Electronic commerce
        June 2007
        384 pages
        ISBN:9781595936530
        DOI:10.1145/1250910

        Copyright © 2007 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 11 June 2007

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • Article

        Acceptance Rates

        Overall Acceptance Rate664of2,389submissions,28%

        Upcoming Conference

        EC '24
        The 25th ACM Conference on Economics and Computation
        July 8 - 11, 2024
        New Haven , CT , USA

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader