Skip to main content

2024 | OriginalPaper | Buchkapitel

Instant Answering in E-Commerce Buyer-Seller Messaging Using Message-to-Question Reformulation

verfasst von : Besnik Fetahu, Tejas Mehta, Qun Song, Nikhita Vedula, Oleg Rokhlenko, Shervin Malmasi

Erschienen in: Advances in Information Retrieval

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

E-commerce customers frequently seek detailed product information for purchase decisions, commonly contacting sellers directly with extended queries. This manual response requirement imposes additional costs and disrupts buyer’s shopping experience with response time fluctuations ranging from hours to days. We seek to automate buyer inquiries to sellers in a leading e-commerce store using a domain-specific federated Question Answering (QA) system. The main challenge is adapting current QA systems, designed for single questions, to address detailed customer queries. We address this with a low-latency, sequence-to-sequence approach, Message-to-Question (M2Q). It reformulates buyer messages into succinct questions by identifying and extracting the most salient information from a message. Evaluation against baselines shows that M2Q yields relative increases of 757% in question understanding, and 1,746% in answering rate from the federated QA system. Live deployment shows that automatic answering saves sellers from manually responding to millions of messages per year, and also accelerates customer purchase decisions by eliminating the need for buyers to wait for a reply.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Our human annotators are expert in-house annotators that provide their relevance judgements based on a pre-determined annotation protocol, which was designed specifically for this task.
 
2
Due to privacy regulations, we cannot use external API-based LLMs like ChatGPT.
 
3
We assess the proportion of questions answered when the QA confidence surpasses a threshold.
 
4
If unsatisfied with an instant answer, users can forward their question to the seller.
 
Literatur
2.
Zurück zum Zitat Cao, Y., et al.: TASA: deceiving question answering models by twin answer sentences attack. arXiv preprint arXiv:2210.15221 (2022) Cao, Y., et al.: TASA: deceiving question answering models by twin answer sentences attack. arXiv preprint arXiv:​2210.​15221 (2022)
3.
Zurück zum Zitat Chen, M., et al.: The JDDC corpus: a large-scale multi-turn Chinese dialogue dataset for e-commerce customer service. In: Proceedings of the 12th Language Resources and Evaluation Conference, pp. 459–466 (2020) Chen, M., et al.: The JDDC corpus: a large-scale multi-turn Chinese dialogue dataset for e-commerce customer service. In: Proceedings of the 12th Language Resources and Evaluation Conference, pp. 459–466 (2020)
6.
Zurück zum Zitat Cui, L., Huang, S., Wei, F., Tan, C., Duan, C., Zhou, M.: SuperAgent: a customer service Chatbot for e-commerce websites. In: Proceedings of ACL 2017, System Demonstrations, pp. 97–102 (2017) Cui, L., Huang, S., Wei, F., Tan, C., Duan, C., Zhou, M.: SuperAgent: a customer service Chatbot for e-commerce websites. In: Proceedings of ACL 2017, System Demonstrations, pp. 97–102 (2017)
7.
8.
Zurück zum Zitat Do, X.L., Zou, B., Pan, L., Chen, N., Joty, S., Aw, A.: CoHS-CQG: context and history selection for conversational question generation. In: Proceedings of the 29th International Conference on Computational Linguistics, pp. 580–591 (2022) Do, X.L., Zou, B., Pan, L., Chen, N., Joty, S., Aw, A.: CoHS-CQG: context and history selection for conversational question generation. In: Proceedings of the 29th International Conference on Computational Linguistics, pp. 580–591 (2022)
9.
Zurück zum Zitat Faustini, P., Chen, Z., Fetahu, B., Rokhlenko, O., Malmasi, S.: Answering unanswered questions through semantic reformulations in spoken QA. In: Sitaram, S., Klebanov, B.B., Williams, J.D. (eds.) Proceedings of The 61st Annual Meeting of the Association for Computational Linguistics: Industry Track, ACL 2023, Toronto, Canada, 9–14 July 2023, pp. 729–743. Association for Computational Linguistics (2023). https://aclanthology.org/2023.acl-industry.70 Faustini, P., Chen, Z., Fetahu, B., Rokhlenko, O., Malmasi, S.: Answering unanswered questions through semantic reformulations in spoken QA. In: Sitaram, S., Klebanov, B.B., Williams, J.D. (eds.) Proceedings of The 61st Annual Meeting of the Association for Computational Linguistics: Industry Track, ACL 2023, Toronto, Canada, 9–14 July 2023, pp. 729–743. Association for Computational Linguistics (2023). https://​aclanthology.​org/​2023.​acl-industry.​70
10.
Zurück zum Zitat Feng, X., Feng, X., Qin, B.: A survey on dialogue summarization: recent advances and new frontiers. arXiv preprint arXiv:2107.03175 (2021) Feng, X., Feng, X., Qin, B.: A survey on dialogue summarization: recent advances and new frontiers. arXiv preprint arXiv:​2107.​03175 (2021)
11.
Zurück zum Zitat Ferguson, N., Guillou, L., Nuamah, K., Bundy, A.: Investigating the use of paraphrase generation for question reformulation in the FRANK QA system. arXiv preprint arXiv:2206.02737 (2022) Ferguson, N., Guillou, L., Nuamah, K., Bundy, A.: Investigating the use of paraphrase generation for question reformulation in the FRANK QA system. arXiv preprint arXiv:​2206.​02737 (2022)
12.
Zurück zum Zitat Gao, S., Chen, X., Ren, Z., Zhao, D., Yan, R.: Meaningful answer generation of e-commerce question-answering. ACM Trans. Inf. Syst. (TOIS) 39(2), 1–26 (2021) Gao, S., Chen, X., Ren, Z., Zhao, D., Yan, R.: Meaningful answer generation of e-commerce question-answering. ACM Trans. Inf. Syst. (TOIS) 39(2), 1–26 (2021)
13.
Zurück zum Zitat Kumar, G., Henderson, M., Chan, S., Nguyen, H., Ngoo, L.: Question-answer selection in user to user marketplace conversations. In: D’Haro, L.F., Banchs, R.E., Li, H. (eds.) 9th International Workshop on Spoken Dialogue System Technology. LNEE, vol. 579, pp. 397–403. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-9443-0_35CrossRef Kumar, G., Henderson, M., Chan, S., Nguyen, H., Ngoo, L.: Question-answer selection in user to user marketplace conversations. In: D’Haro, L.F., Banchs, R.E., Li, H. (eds.) 9th International Workshop on Spoken Dialogue System Technology. LNEE, vol. 579, pp. 397–403. Springer, Singapore (2019). https://​doi.​org/​10.​1007/​978-981-13-9443-0_​35CrossRef
15.
Zurück zum Zitat Liao, L.Y., Fares, T.: A practical 2-step approach to assist enterprise question-answering live chat. In: Proceedings of the 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue, pp. 457–468 (2021) Liao, L.Y., Fares, T.: A practical 2-step approach to assist enterprise question-answering live chat. In: Proceedings of the 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue, pp. 457–468 (2021)
16.
Zurück zum Zitat Lyu, Q., Zhang, H., Sulem, E., Roth, D.: Zero-shot event extraction via transfer learning: challenges and insights. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pp. 322–332 (2021) Lyu, Q., Zhang, H., Sulem, E., Roth, D.: Zero-shot event extraction via transfer learning: challenges and insights. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pp. 322–332 (2021)
17.
18.
Zurück zum Zitat Masterov, D.V., Mayer, U.F., Tadelis, S.: Canary in the e-commerce coal mine: detecting and predicting poor experiences using buyer-to-seller messages. In: Proceedings of the Sixteenth ACM Conference on Economics and Computation, pp. 81–93 (2015) Masterov, D.V., Mayer, U.F., Tadelis, S.: Canary in the e-commerce coal mine: detecting and predicting poor experiences using buyer-to-seller messages. In: Proceedings of the Sixteenth ACM Conference on Economics and Computation, pp. 81–93 (2015)
19.
Zurück zum Zitat McDonald, T., et al.: Detect, retrieve, comprehend: a flexible framework for zero-shot document-level question answering. arXiv preprint arXiv:2210.01959 (2022) McDonald, T., et al.: Detect, retrieve, comprehend: a flexible framework for zero-shot document-level question answering. arXiv preprint arXiv:​2210.​01959 (2022)
20.
Zurück zum Zitat Peng, B., et al.: Check your facts and try again: improving large language models with external knowledge and automated feedback. arXiv preprint arXiv:2302.12813 (2023) Peng, B., et al.: Check your facts and try again: improving large language models with external knowledge and automated feedback. arXiv preprint arXiv:​2302.​12813 (2023)
21.
Zurück zum Zitat Raffel, C., et al.: Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res. 21(1), 5485–5551 (2020)MathSciNet Raffel, C., et al.: Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res. 21(1), 5485–5551 (2020)MathSciNet
22.
Zurück zum Zitat Rennard, V., Shang, G., Hunter, J., Vazirgiannis, M.: Abstractive meeting summarization: a survey. arXiv preprint arXiv:2208.04163 (2022) Rennard, V., Shang, G., Hunter, J., Vazirgiannis, M.: Abstractive meeting summarization: a survey. arXiv preprint arXiv:​2208.​04163 (2022)
23.
Zurück zum Zitat Samarakoon, L., Kumarawadu, S., Pulasinghe, K.: Automated question answering for customer helpdesk applications. In: 2011 6th International Conference on Industrial and Information Systems, pp. 328–333. IEEE (2011) Samarakoon, L., Kumarawadu, S., Pulasinghe, K.: Automated question answering for customer helpdesk applications. In: 2011 6th International Conference on Industrial and Information Systems, pp. 328–333. IEEE (2011)
24.
25.
Zurück zum Zitat Vakulenko, S., Longpre, S., Tu, Z., Anantha, R.: Question rewriting for conversational question answering. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining, pp. 355–363 (2021) Vakulenko, S., Longpre, S., Tu, Z., Anantha, R.: Question rewriting for conversational question answering. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining, pp. 355–363 (2021)
26.
27.
Zurück zum Zitat Zaib, M., Zhang, W.E., Sheng, Q.Z., Mahmood, A., Zhang, Y.: Conversational question answering: a survey. Knowl. Inf. Syst. 64(12), 3151–3195 (2022)CrossRef Zaib, M., Zhang, W.E., Sheng, Q.Z., Mahmood, A., Zhang, Y.: Conversational question answering: a survey. Knowl. Inf. Syst. 64(12), 3151–3195 (2022)CrossRef
Metadaten
Titel
Instant Answering in E-Commerce Buyer-Seller Messaging Using Message-to-Question Reformulation
verfasst von
Besnik Fetahu
Tejas Mehta
Qun Song
Nikhita Vedula
Oleg Rokhlenko
Shervin Malmasi
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/978-3-031-56066-8_7

Premium Partner