Top

Published in:

2018 | OriginalPaper | Chapter

Automated Pitch Convergence Improves Learning in a Social, Teachable Robot for Middle School Mathematics

Authors : Nichola Lubold, Erin Walker, Heather Pon-Barry, Amy Ogan

Published in: Artificial Intelligence in Education

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Pedagogical agents have the potential to provide not only cognitive support to learners but socio-emotional support through social behavior. Socio-emotional support can be a critical element to a learner’s success, influencing their self-efficacy and motivation. Several social behaviors have been explored with pedagogical agents including facial expressions, movement, and social dialogue; social dialogue has especially been shown to positively influence interactions. In this work, we explore the role of paraverbal social behavior or social behavior in the form of paraverbal cues such as tone of voice and intensity. To do this, we focus on the phenomenon of entrainment, where individuals adapt their paraverbal features of speech to one another. Paraverbal entrainment in human-human studies has been found to be correlated with rapport and learning. In a study with 72 middle school students, we evaluate the effects of entrainment with a teachable robot, a pedagogical agent that learners teach how to solve ratio problems. We explore how a teachable robot which entrains and introduces social dialogue influences rapport and learning; we compare with two baseline conditions: a social condition, in which the robot speaks socially, and a non-social condition, in which the robot neither entrains nor speaks socially. We find that a robot that does entrain and speaks socially results in significantly more learning.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Students’ Academic Language Use When Constructing Scientific Explanations in an Intelligent Tutoring System

next chapter The Influence of Gender, Personality, Cognitive and Affective Student Engagement on Academic Engagement in Educational Virtual Worlds

Survey questions can be found at www.public.asu.edu/~nlubold/surveys/nico_rapport.pdf

Blanchard, E.G., Volfson, B., Hong, Y.J., Lajoie, S.P.: Affective artificial intelligence in education: from detection to adaptation. In: AIED, pp. 81–88. Springer, Heidelberg (2009)

Girard, S., Chavez-Echeagaray, M.E., Gonzalez-Sanchez, J., Hidalgo-Pontet, Y., Zhang, L., Burleson, W., VanLehn, K.: Defining the behavior of an affective learning companion in the affective meta-tutor project. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 21–30. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39112-5_3CrossRef

Lane, H.C., Cahill, C., Foutz, S., Auerbach, D., Noren, D., Lussenhop, C., Swartout, W.: The effects of a pedagogical agent for informal science education on learner behaviors and self-efficacy. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 309–318. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39112-5_32CrossRef

Afzal, S., Robinson, P.: A study of affect in intelligent tutoring. In: Workshop on Modeling and Scaffolding Affective Experiences to Impact Learning, vol. 57 (2006)

McDaniel, B.T., et al.: Facial features for affective state detection in learning environments. In: Proceedings of the Annual Meeting of the Cognitive Science Society, vol. 29 (2007)

Gulz, A., Haake, M., Silvervarg, A.: Extending a teachable agent with a social conversation module – effects on student experiences and learning. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds.) AIED 2011. LNCS (LNAI), vol. 6738, pp. 106–114. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21869-9_16CrossRef

Kumar, R., Ai, H., Beuth, J.L., Rosé, C.P.: Socially capable conversational tutors can be effective in collaborative learning situations. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010. LNCS, vol. 6094, pp. 156–164. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-13388-6_20CrossRef

Gallois, C., Giles, H.: Communication accommodation theory. The International Encyclopedia of Language and Social Interaction (2015)

Giles, H.: A new theory of the dynamics of speech. Diogenes 106, 119–136 (1979)

10.

Sadoughi, N., Pereira, A., Jain, R., Leite, I., Lehman, J.F.: Creating prosodic synchrony for a robot co-player in a speech-controlled game for children. In: HRI, pp. 91–99. ACM (2017)

11.

Levitan, R., et al.: Implementing acoustic-prosodic entrainment in a conversational avatar. In: INTERSPEECH, vol. 16, pp. 1166–1170 (2016)

12.

Lubold, N., Walker, E., Pon-Barry, H.: Effects of voice-adaptation and social dialogue on perceptions of a robotic learning companion. In: HRI, pp. 255–262. IEEE (2016)

13.

Roscoe, R.D., Chi, M.T.: Understanding tutor learning: knowledge-building and knowledge-telling in peer tutors’ explanations and questions. Rev. Educ. Res. 77(4), 534–574 (2007)

14.

Leelawong, K., Biswas, G.: Designing learning by teaching agents: the betty’s brain system. Int. J. Artif. Intell. Educ. 18(3), 181–208 (2008)

15.

Pareto, L., Arvemo, T., Dahl, Y., Haake, M., Gulz, A.: A teachable-agent arithmetic game’s effects on mathematics understanding, attitude and self-efficacy. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds.) AIED 2011. LNCS (LNAI), vol. 6738, pp. 247–255. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21869-9_33CrossRef

16.

Ogan, A., et al.: Oh dear stacy!: social interaction, elaboration, and learning with teachable agents. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 39–48. ACM (2012)

17.

Biswas, G., Jeong, H., Kinnebrew, J.S., Sulcer, B., Roscoe, R.: Measuring self-regulated learning skills through social interactions in a teachable agent environment. Res. Pract. Technol. Enhanced Learn. 5(02), 123–152 (2011)CrossRef

18.

Chase, C.C., Chin, D.B., Oppezzo, M.A., Schwartz, D.L.: Teachable agents and the protégé effect: increasing the effort towards learning. J. Sci. Educ. Technol. 18(4), 334–352 (2009)CrossRef

19.

Hood, D., Lemaignan, S., Dillenbourg, P.: When children teach a robot to write: an autonomous teachable humanoid uses simulated handwriting. In: HRI, pp. 83–90. ACM (2015)

20.

Tanaka, F., Matsuzoe, S.: Children teach a care-receiving robot to promote their learning: field experiments in a classroom for vocabulary learning. J. Hum.-Robot Interact. 1(1) (2012)

21.

Arroyo, I., et al.: Affective gendered learning companions. In: AIED, pp. 21–48 (2009)

22.

Liu, P., Glas, D.F., Kanda, T., Ishiguro, H., Hagita, N.: It’s not polite to point: generating socially appropriate deictic behaviors towards people. In: HRI, pp. 267–274. IEEE (2013)

23.

Westlund, K., et al.: Flat vs. expressive storytelling: young children’s learning and retention of a social robot’s narrative. Front. Hum. Neurosci. 11, 295 (2017)CrossRef

24.

Pezzullo, L.G., Wiggins, J.B., Frankosky, M.H., Min, W., Boyer, K.E., Mott, B.W., Wiebe, E.N., Lester, J.C.: “Thanks Alisha, keep in touch”: gender effects and engagement with virtual learning companions. In: André, E., Baker, R., Hu, X., Rodrigo, M.M.T., du Boulay, B. (eds.) AIED 2017. LNCS (LNAI), vol. 10331, pp. 299–310. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-61425-0_25CrossRef

25.

Thomason, J., Nguyen, H.V., Litman, D.: Prosodic entrainment and tutoring dialogue success. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 750–753. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39112-5_104CrossRef

26.

Sinha, T., Cassell, J.: We click, we align, we learn: impact of influence and convergence processes on student learning and rapport building. In: Proceedings of the 1st Workshop on Modeling INTERPERsonal SynchrONy And infLuence, pp. 13–20. ACM (2015)

27.

Lubold, N., Pon-Barry, H.: Acoustic-prosodic entrainment and rapport in collaborative learning dialogues. In: Proceedings of the 2014 ACM Workshop on Multimodal Learning Analytics Workshop and Grand Challenge, pp. 5–12. ACM (2014)

28.

Tickle-Degnen, L., Rosenthal, R.: The nature of rapport and its nonverbal correlates. Psychol. Inq. 1(4), 285–293 (1990)CrossRef

29.

Common Core State Standards Initiative. Common Core State Standards for Mathematics. National Governors Association Center for Best Practices and the Council of Chief State School Officers, Washington, DC (2010)

30.

Spencer-Oatey, H.: (Im) Politeness, face and perceptions of rapport: unpackaging their bases and interrelationships. Politeness Res. 1(1)(Im), 95–119 (2005)

31.

Bell, D., Arnold, H., Haddock, R.: Linguistic politeness and peer tutoring. Learn. Assistance Rev. 14(1), pp. 37–54 (2009)

32.

Lubold, N., Walker, E., Pon-Barry, H.: Naturalness and rapport in a pitch adaptive learning companion. In: ASRU, pp. 103–110. IEEE (2015)

33.

Burleson, W., Picard, R.: Gender-specific approaches to developing emotionally intelligent learning companions. IEEE Intell. Syst. 22(4) (2007)

34.

Saerbeck, M., Schut, T., Bartneck, C., Janse, M.D.: Expressive robots in education: varying the degree of social supportive behavior of a robotic tutor. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1613–1622. ACM (2010)

35.

Pickering, M.J., Garrod, S.: An integrated theory of language production and comprehension. Behav. Brain Sci. 36(4), 329–347 (2013)CrossRef

36.

Hake, R.R.: Relationship of individual student normalized learning gains in mechanics with gender, high-school physics, and pretest scores on mathematics and spatial visualization. In: Physics Education Research Conference, pp. 30–45, (2002)

37.

Maldonado, H., et al.: We learn better together: enhancing elearning with emotional characters. In: CSCL, pp. 408–417. International Society of the Learning Sciences (2005)

38.

Wang, N., et al.: the politeness effect. Int. J. Hum Comput Stud. 66, 96–112 (2008)CrossRef

39.

Litman, D.J., et al.: Spoken versus typed human and computer dialogue tutoring. Int. J. Artif. Intell. Educ. 16(2), 145–170 (2006)

40.

Rosé, C.P., Bhembe, D., Siler, S., Srivastava, R., VanLehn, K.: The role of why questions in effective human tutoring. In: Hoppe, U., Verdejo, F., Kay, J. (eds.) AIED (2003)

41.

Wallace, R.: The elements of AIML style. Alice AI Foundation (2003)

42.

Kim, Y., Baylor, A., Shen, E.: Pedagogical agents as learning companions: the impact of agent emotion and gender. J. Comput. Assist. Learn. 23(3), 220–234 (2007)CrossRef

43.

Spencer-Oatey, H.: Managing rapport in talk: using rapport sensitive incidents to explore the motivational concerns underlying the management of relations. J. Pragmat. 34(5), 529–545 (2002)CrossRef

Title: Automated Pitch Convergence Improves Learning in a Social, Teachable Robot for Middle School Mathematics
Authors: Nichola Lubold
Erin Walker
Heather Pon-Barry
Amy Ogan
Publisher: Springer International Publishing
Book: Artificial Intelligence in Education
Print ISBN: 978-3-319-93842-4

Electronic ISBN: 978-3-319-93843-1

Copyright Year: 2018
DOI: https://doi.org/10.1007/978-3-319-93843-1_21

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner