skip to main content
10.1145/3025453.3025496acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

A New Chatbot for Customer Service on Social Media

Published:02 May 2017Publication History

ABSTRACT

Users are rapidly turning to social media to request and receive customer service; however, a majority of these requests were not addressed timely or even not addressed at all. To overcome the problem, we create a new conversational system to automatically generate responses for users requests on social media. Our system is integrated with state-of-the-art deep learning techniques and is trained by nearly 1M Twitter conversations between users and agents from over 60 brands. The evaluation reveals that over 40% of the requests are emotional, and the system is about as good as human agents in showing empathy to help users cope with emotional situations. Results also show our system outperforms information retrieval system based on both human judgments and an automatic evaluation metric.

References

  1. Natalya N. Bazarova, Yoon Hyung Choi, Victoria Schwanda Sosik, Dan Cosley, and Janis Whitlock. Social Sharing of Emotions on Facebook: Channel Differences, Satisfaction, and Replies. In Proc. of CSCW, 2015, 154--164. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Joan-Isaac Biel, Oya Aran, and Daniel Gatica-Perez. You Are Known by How You Vlog: Personality Impressions and Nonverbal Behavior in Youtube. In Proc. of ICWSM, 2011, 446--449.Google ScholarGoogle Scholar
  3. Keith S. Coulter, Johanna Gummerus, Veronica Liljander, Emil Weman, and Minna Pihlström. Customer Engagement in a Facebook Brand Community. Management Research Review, 2012, 35, 9, 857--877. Google ScholarGoogle ScholarCross RefCross Ref
  4. Ethan Fast, Binbin Chen, and Michael S. Bernstein. Empath: Understanding Topic Signals in Large-Scale Text. In Proc. of CHI, 2016, 4647--4657. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. F. Maxwell Harper, Daniel Moy, and Joseph A. Konstan. Facts or Friends?: Distinguishing Informational and Conversational Questions in Social Q&A Sites. In Proc. of CHI, 2009, 759--768.Google ScholarGoogle Scholar
  6. F. Maxwell Harper, Daphne Raban, Sheizaf Rafaeli, and Joseph A. Konstan. Predictors of Answer Quality in Online Q&A Sites. In Proc. of CHI, 2008, 865--874.Google ScholarGoogle Scholar
  7. Anjuli Kannan, Karol Kurach, Sujith Ravi, Tobias Kaufmann, Andrew Tomkins, Balint Miklos, Greg Corrado, Laszlo Lukacs, Marina Ganea, Peter Young, and Vivek Ramavajjala. Smart Reply: Automated Response Suggestion for Email. In Proc. of KDD, 2016, 955--964. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. Distributed Representations of Words and Phrases and Their Compositionality. In Proc. of NIPS, 2013, 3111--3119.Google ScholarGoogle Scholar
  9. Keith B. Murray. A Test of Services Marketing Theory: Consumer Information Acquisition Activities. The Journal of Marketing, 1991, 10--25. Google ScholarGoogle ScholarCross RefCross Ref
  10. NIELSEN. State of the Media: Social Media Report. 2011.Google ScholarGoogle Scholar
  11. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. Bleu: A Method for Automatic Evaluation of Machine Translation. In Proc. of ACL, 2002, 311--318.Google ScholarGoogle Scholar
  12. James W. Pennebaker, Martha E. Francis, and Roger J. Booth. Linguistic Inquiry and Word Count: Liwc 2001. Mahway: Lawrence Erlbaum Associates, 2001, 71, 2001.Google ScholarGoogle Scholar
  13. Tiziano Piccardi, Gregorio Convertino, Massimo Zancanaro, Ji Wang, and Cedric Archambeau. Towards Crowd-Based Customer Service: A Mixed-Initiative Tool for Managing Q&a Sites. In Proc. of CHI, 2014, 2725--2734. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Leyland F. Pitt, Richard T. Watson, and C. Bruce Kavan. Service Quality: A Measure of Information Systems Effectiveness. Management Information Systems Quarterly, 1995, 173--187. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Alan Ritter, Colin Cherry, and William B Dolan. Data-Driven Response Generation in Social Media. In Proc. of EMNLP, 2011, 583--593.Google ScholarGoogle Scholar
  16. Anselm L. Strauss Qualitative Analysis for Social Scientists. Cambridge University Press, 1987.Google ScholarGoogle Scholar
  17. Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. Sequence to Sequence Learning with Neural Networks. In Proc. of NIPS, 2014, 3104--3112.Google ScholarGoogle Scholar
  18. Anbang Xu, Haibin Liu, Liang Gou, Rama Akkiraju, Jalal Mahmud, Vibha Sinha, Yuheng Hu, and Mu Qiao. Predicting Perceived Brand Personality with Social Media. In Proc. of ICWSM, 2016, 436--445.Google ScholarGoogle Scholar
  19. http://blog.hubspot.com/marketing/twitter-response-time-data.Google ScholarGoogle Scholar
  20. http://lucene.apache.org.Google ScholarGoogle Scholar

Index Terms

  1. A New Chatbot for Customer Service on Social Media

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
      May 2017
      7138 pages
      ISBN:9781450346559
      DOI:10.1145/3025453

      Copyright © 2017 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 2 May 2017

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      CHI '17 Paper Acceptance Rate600of2,400submissions,25%Overall Acceptance Rate6,199of26,314submissions,24%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader