Skip to main content

2019 | OriginalPaper | Buchkapitel

Acoustic-Prosodic Entrainment in Multi-party Spoken Dialogues: Does Simple Averaging Extend Existing Pair Measures Properly?

verfasst von : Zahra Rahimi, Diane Litman, Susannah Paletz

Erschienen in: Advanced Social Interaction with Agents

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Linguistic entrainment, the tendency of interlocutors to become similar to each other during spoken interaction, is an important characteristic of human speech. Implementing linguistic entrainment in spoken dialogue systems helps to improve the naturalness of the conversation, likability of the agents, and dialogue and task success. The first step toward implementation of such systems is to design proper measures to quantify entrainment. Multi-party entrainment and multi-party spoken dialogue systems have received less attention compared to dyads. In this study, we analyze an existing approach of extending pair measures to team-level entrainment measures, which is based on simple averaging of pairs. We argue that although simple averaging is a good starting point to measure team entrainment, it has several weaknesses in terms of capturing team-specific behaviors specifically related to convergence.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
The average absolute difference between the amplitudes of consecutive periods, divided by the average amplitude.
 
2
The average absolute difference between consecutive periods, divided by the average amplitude.
 
3
We included the gender of speakers in the plots. But, there is no significant effect of gender composition of the teams on convergence value.
 
Literatur
1.
Zurück zum Zitat Boersma P, Heuven VV (2002) Praat, a system for doing phonetics by computer. Glot Int 5(9/10):341–345 Boersma P, Heuven VV (2002) Praat, a system for doing phonetics by computer. Glot Int 5(9/10):341–345
2.
Zurück zum Zitat Borrie SA, Lubold N, Pon-Barry H (2015) Disordered speech disrupts conversational entrainment: a study of acoustic-prosodic entrainment and communicative success in populations with communication challenges. Front Psychol 6 Borrie SA, Lubold N, Pon-Barry H (2015) Disordered speech disrupts conversational entrainment: a study of acoustic-prosodic entrainment and communicative success in populations with communication challenges. Front Psychol 6
3.
Zurück zum Zitat Brennan SE, Clark HH (1996) Conceptual pacts and lexical choice in conversation. J Exp Psychol Learn Memory Cogn 22(6):1482–1493CrossRef Brennan SE, Clark HH (1996) Conceptual pacts and lexical choice in conversation. J Exp Psychol Learn Memory Cogn 22(6):1482–1493CrossRef
4.
Zurück zum Zitat Danescu-Niculescu-Mizil C, Gamon M, Dumais S (2011) Mark my words!: linguistic style accommodation in social media. In: Proceedings of the 20th international conference on world wide web, pp 745–754 Danescu-Niculescu-Mizil C, Gamon M, Dumais S (2011) Mark my words!: linguistic style accommodation in social media. In: Proceedings of the 20th international conference on world wide web, pp 745–754
5.
Zurück zum Zitat Danescu-Niculescu-Mizil C, Lee L, Pang B, Kleinberg J (20120 Echoes of power: language effects and power differences in social interaction. In: Proceedings of WWW, pp 699–708 Danescu-Niculescu-Mizil C, Lee L, Pang B, Kleinberg J (20120 Echoes of power: language effects and power differences in social interaction. In: Proceedings of WWW, pp 699–708
6.
Zurück zum Zitat Foster ME, Gaschler A, Giuliani M, Isard A, Pateraki M, Petrick RP (2012) Two people walk into a bar: dynamic multi-party social interaction with a robot agent. In: Proceedings of the 14th ACM international conference on multimodal interaction, ICMI’12, pp 3–10 Foster ME, Gaschler A, Giuliani M, Isard A, Pateraki M, Petrick RP (2012) Two people walk into a bar: dynamic multi-party social interaction with a robot agent. In: Proceedings of the 14th ACM international conference on multimodal interaction, ICMI’12, pp 3–10
7.
Zurück zum Zitat Friedberg H, Litman D, Paletz SBF (2012) Lexical entrainment and success in student engineering groups. In: Proceedings fourth IEEE workshop on spoken language technology (SLT). Miami, Florida Friedberg H, Litman D, Paletz SBF (2012) Lexical entrainment and success in student engineering groups. In: Proceedings fourth IEEE workshop on spoken language technology (SLT). Miami, Florida
8.
Zurück zum Zitat Gonzales AL, Hancock JT, Pennebaker JW (2009) Language style matching as a predictor of social dynamics in small groups. Commun Res Gonzales AL, Hancock JT, Pennebaker JW (2009) Language style matching as a predictor of social dynamics in small groups. Commun Res
9.
Zurück zum Zitat Hiraoka T, Georgila K, Nouri E, Traum D, Nakamura S (2015) Reinforcement learning in multi-party trading dialog. In: 16th annual meeting of the special interest group on discourse and dialogue, p 32 Hiraoka T, Georgila K, Nouri E, Traum D, Nakamura S (2015) Reinforcement learning in multi-party trading dialog. In: 16th annual meeting of the special interest group on discourse and dialogue, p 32
10.
Zurück zum Zitat Lee CC, Katsamanis A, Black MP, Baucom BR, Georgiou PG, Narayanan S (2011) An analysis of PCA-based vocal entrainment measures in married couples’ affective spoken interactions. In: INTERSPEECH, pp 3101–3104 Lee CC, Katsamanis A, Black MP, Baucom BR, Georgiou PG, Narayanan S (2011) An analysis of PCA-based vocal entrainment measures in married couples’ affective spoken interactions. In: INTERSPEECH, pp 3101–3104
11.
Zurück zum Zitat Levitan R (2013) Entrainment in spoken dialogue systems: adopting, predicting and influencing user behavior. In: HLT-NAACL, pp 84–90 Levitan R (2013) Entrainment in spoken dialogue systems: adopting, predicting and influencing user behavior. In: HLT-NAACL, pp 84–90
12.
Zurück zum Zitat Levitan R, Benuš Š, Gálvez RH, Gravano A, Savoretti F, Trnka M, Weise A, Hirschberg J (2016) Implementing acoustic-prosodic entrainment in a conversational avatar. Interspeech 2016:1166–1170CrossRef Levitan R, Benuš Š, Gálvez RH, Gravano A, Savoretti F, Trnka M, Weise A, Hirschberg J (2016) Implementing acoustic-prosodic entrainment in a conversational avatar. Interspeech 2016:1166–1170CrossRef
13.
Zurück zum Zitat Levitan R, Hirschberg J (2011) Measuring acoustic-prosodic entrainment with respect to multiple levels and dimensions. In: Interspeech Levitan R, Hirschberg J (2011) Measuring acoustic-prosodic entrainment with respect to multiple levels and dimensions. In: Interspeech
14.
Zurück zum Zitat Litman D, Paletz S, Rahimi Z, Allegretti S, Rice C (2016)The teams corpus and entrainment in multi-party spoken dialogues. In: 2016 conference on empirical methods in natural language processing (EMNLP). Austin, Texas Litman D, Paletz S, Rahimi Z, Allegretti S, Rice C (2016)The teams corpus and entrainment in multi-party spoken dialogues. In: 2016 conference on empirical methods in natural language processing (EMNLP). Austin, Texas
15.
Zurück zum Zitat Lopes J, Eskenazi M, Trancoso I (2013) Automated two-way entrainment to improve spoken dialog system performance. In: ICASSP, pp 8372–8376 Lopes J, Eskenazi M, Trancoso I (2013) Automated two-way entrainment to improve spoken dialog system performance. In: ICASSP, pp 8372–8376
16.
Zurück zum Zitat Lopes J, Eskenazi M, Trancoso I (2015) From rule-based to data-driven lexical entrainment models in spoken dialog systems. Comput Speech Lang 31(1):87–112 Lopes J, Eskenazi M, Trancoso I (2015) From rule-based to data-driven lexical entrainment models in spoken dialog systems. Comput Speech Lang 31(1):87–112
17.
Zurück zum Zitat Lubold N., Pon-Barry H (2014) Acoustic-prosodic entrainment and rapport in collaborative learning dialogues. In: Proceedings of the 2014 ACM workshop on multimodal learning analytics workshop and grand challenge. ACM, pp 5–12 Lubold N., Pon-Barry H (2014) Acoustic-prosodic entrainment and rapport in collaborative learning dialogues. In: Proceedings of the 2014 ACM workshop on multimodal learning analytics workshop and grand challenge. ACM, pp 5–12
18.
Zurück zum Zitat Lubold N, Pon-Barry H, Walker E (2015) Naturalness and rapport in a pitch adaptive learning companion. In: 2015 IEEE workshop on automatic speech recognition and understanding (ASRU). IEEE, pp 103–110 Lubold N, Pon-Barry H, Walker E (2015) Naturalness and rapport in a pitch adaptive learning companion. In: 2015 IEEE workshop on automatic speech recognition and understanding (ASRU). IEEE, pp 103–110
19.
Zurück zum Zitat Mitchell CM, Boyer KE, Lester JC (2012) From strangers to partners: Examining convergence within a longitudinal study of task-oriented dialogue. In: SIGDIAL Conference, pp 94–98 Mitchell CM, Boyer KE, Lester JC (2012) From strangers to partners: Examining convergence within a longitudinal study of task-oriented dialogue. In: SIGDIAL Conference, pp 94–98
20.
Zurück zum Zitat Nenkova A, Gravano A, Hirschberg J (2008) High frequency word entrainment in spoken dialogue. In: Proceedings of the 46th annual meeting of the association for computational linguistics on human language technologies: short papers, HLT-Short’08, pp 169–172 Nenkova A, Gravano A, Hirschberg J (2008) High frequency word entrainment in spoken dialogue. In: Proceedings of the 46th annual meeting of the association for computational linguistics on human language technologies: short papers, HLT-Short’08, pp 169–172
21.
Zurück zum Zitat Porzel R, Scheffler A, Malaka R (2006) How entrainment increases dialogical effectiveness. In: Proceedings of the IUI’06 workshop on effective multimodal dialogue interaction, pp 35–42 Porzel R, Scheffler A, Malaka R (2006) How entrainment increases dialogical effectiveness. In: Proceedings of the IUI’06 workshop on effective multimodal dialogue interaction, pp 35–42
22.
Zurück zum Zitat Reitter D, Moore JD (2007) Predicting success in dialogue. In: Proceedings of the 45th meeting of the association of computational linguistics, pp 808–815 Reitter D, Moore JD (2007) Predicting success in dialogue. In: Proceedings of the 45th meeting of the association of computational linguistics, pp 808–815
Metadaten
Titel
Acoustic-Prosodic Entrainment in Multi-party Spoken Dialogues: Does Simple Averaging Extend Existing Pair Measures Properly?
verfasst von
Zahra Rahimi
Diane Litman
Susannah Paletz
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-319-92108-2_18

Neuer Inhalt