Skip to main content
Top

2015 | OriginalPaper | Chapter

Statistical Response Method and Learning Data Acquisition using Gamified Crowdsourcing for a Non-task-oriented Dialogue Agent

Authors : Michimasa Inaba, Naoyuki Iwata, Fujio Toriumi, Takatsugu Hirayama, Yu Enokibori, Kenichi Takahashi, Kenji Mase

Published in: Agents and Artificial Intelligence

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents a proposal of a construction method for non-task-oriented dialogue agents (chatbots) that are based on the statistical response method. The method prepares candidate utterances in advance. From the data, it learns which utterances are suitable for context. Therefore, a dialogue agent constructed using our method automatically selects a suitable utterance depending on a context from candidate utterances. This paper also proposes a low-cost quality-assured method of learning data acquisition for the proposed response method. The method uses crowdsourcing and brings game mechanics to data acquisition.
Results of an experiment using learning data obtained using the proposed data acquisition method demonstrate that the appropriate utterance is selected with high accuracy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Zue, V., Seneff, S., Polifroni, J., Phillips, M., Pao, C., Goodine, D., Goddeau, D., Glass, J.: Pegasus: a spoken dialogue interface for on-line air travel planning. Speech Commun. 15(3–4), 331–340 (1994)CrossRef Zue, V., Seneff, S., Polifroni, J., Phillips, M., Pao, C., Goodine, D., Goddeau, D., Glass, J.: Pegasus: a spoken dialogue interface for on-line air travel planning. Speech Commun. 15(3–4), 331–340 (1994)CrossRef
2.
go back to reference Chu-Carroll, J., Nickerson, J.S.: Evaluating automatic dialogue strategy adaptation for a spoken dialogue system. In: Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference, pp. 202–209 (2000) Chu-Carroll, J., Nickerson, J.S.: Evaluating automatic dialogue strategy adaptation for a spoken dialogue system. In: Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference, pp. 202–209 (2000)
3.
go back to reference Bickmore, T., Cassell, J.: Relational agents: a model and implementation of building user trust. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 396–403 (2001) Bickmore, T., Cassell, J.: Relational agents: a model and implementation of building user trust. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 396–403 (2001)
4.
go back to reference Weizenbaum, J.: ELIZA-a computer program for the study of natural language communication between man and machine. Commun. ACM 9(1), 36–45 (1966)CrossRef Weizenbaum, J.: ELIZA-a computer program for the study of natural language communication between man and machine. Commun. ACM 9(1), 36–45 (1966)CrossRef
5.
go back to reference Wallace, R.S.: The anatomy of alice, pp. 181–210. Parsing the Turing, Test (2009) Wallace, R.S.: The anatomy of alice, pp. 181–210. Parsing the Turing, Test (2009)
8.
go back to reference Murao, H., Kawaguchi, N., Matsubara, S., Yamaguchi, Y., Inagaki, Y.: Example-based spoken dialogue system using woz system log. In: SIGdial Workshop on Discourse and Dialogue, pp. 140–148 (2003) Murao, H., Kawaguchi, N., Matsubara, S., Yamaguchi, Y., Inagaki, Y.: Example-based spoken dialogue system using woz system log. In: SIGdial Workshop on Discourse and Dialogue, pp. 140–148 (2003)
9.
go back to reference Banchs, R.E., Li, H.: Iris: a chat-oriented dialogue system based on the vector space model. In: Proceedings of the ACL 2012 System Demonstrations, pp. 37–42. Association for Computational Linguistics (2012) Banchs, R.E., Li, H.: Iris: a chat-oriented dialogue system based on the vector space model. In: Proceedings of the ACL 2012 System Demonstrations, pp. 37–42. Association for Computational Linguistics (2012)
10.
go back to reference Ritter, A., Cherry, C., Dolan, W.B.: Data-driven response generation in social media. In: Proceedings of the conference on empirical methods in natural language processing, pp. 583–593. Association for Computational Linguistics (2011) Ritter, A., Cherry, C., Dolan, W.B.: Data-driven response generation in social media. In: Proceedings of the conference on empirical methods in natural language processing, pp. 583–593. Association for Computational Linguistics (2011)
11.
go back to reference Cao, Z., Qin, T., Liu, Y., Tsai, M.F., Li, H.: Learning to rank: from pairwise approach to listwise approach. In: Proceedings of the 24th international conference on Machine learning, pp. 129–136 (2007) Cao, Z., Qin, T., Liu, Y., Tsai, M.F., Li, H.: Learning to rank: from pairwise approach to listwise approach. In: Proceedings of the 24th international conference on Machine learning, pp. 129–136 (2007)
12.
go back to reference Plackett, R.L.: The analysis of permutations. Applied Statistics, pp. 193–202 (1975) Plackett, R.L.: The analysis of permutations. Applied Statistics, pp. 193–202 (1975)
13.
go back to reference Luce, R.D.: Individual Choice Behavior: A Theoretical Analysis. Wiley, New York (1959)MATH Luce, R.D.: Individual Choice Behavior: A Theoretical Analysis. Wiley, New York (1959)MATH
14.
go back to reference Ipeirotis, P.G., Provost, F., Wang, J.: Quality management on amazon mechanical turk. In: Proceedings of the ACM SIGKDD workshop on human computation, pp. 64–67. ACM (2010) Ipeirotis, P.G., Provost, F., Wang, J.: Quality management on amazon mechanical turk. In: Proceedings of the ACM SIGKDD workshop on human computation, pp. 64–67. ACM (2010)
15.
go back to reference Lease, M.: On quality control and machine learning in crowdsourcing. In: Proceedings of the AAAI workshop on human computation, pp. 97–102 (2011) Lease, M.: On quality control and machine learning in crowdsourcing. In: Proceedings of the AAAI workshop on human computation, pp. 97–102 (2011)
16.
go back to reference Dekel, O., Shamir, O.: Vox populi: collecting high-quality labels from a crowd. In: Proceedings of the 22nd Annual Conference on Learning Theory (COLT) (2009) Dekel, O., Shamir, O.: Vox populi: collecting high-quality labels from a crowd. In: Proceedings of the 22nd Annual Conference on Learning Theory (COLT) (2009)
17.
go back to reference Von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 319–326. ACM (2004) Von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 319–326. ACM (2004)
18.
go back to reference Deterding, S., Sicart, M., Nacke, L., O’Hara, K., Dixon, D.: Gamification. using game-design elements in non-gaming contexts. In: Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems, pp. 2425–2428. ACM (2011) Deterding, S., Sicart, M., Nacke, L., O’Hara, K., Dixon, D.: Gamification. using game-design elements in non-gaming contexts. In: Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems, pp. 2425–2428. ACM (2011)
19.
go back to reference Platt, J., et al.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv. Large Margin Classifiers 10(3), 61–74 (1999) Platt, J., et al.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv. Large Margin Classifiers 10(3), 61–74 (1999)
Metadata
Title
Statistical Response Method and Learning Data Acquisition using Gamified Crowdsourcing for a Non-task-oriented Dialogue Agent
Authors
Michimasa Inaba
Naoyuki Iwata
Fujio Toriumi
Takatsugu Hirayama
Yu Enokibori
Kenichi Takahashi
Kenji Mase
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-25210-0_8

Premium Partner