Skip to main content

2017 | OriginalPaper | Buchkapitel

Gaze Awareness in Agent-Based Early-Childhood Learning Application

verfasst von : Deepak Akkil, Prasenjit Dey, Deepshika Salian, Nitendra Rajput

Erschienen in: Human-Computer Interaction - INTERACT 2017

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Use of technological devices for early childhood learning is increasing. Now, kindergarten and primary school children use interactive applications on mobile phones and tablet computers to support and complement classroom learning. With increase in cognitive technologies, there is further potential to make such applications more engaging by understanding the user context. In this paper, we present the Little Bear, a gaze aware pedagogical agent, that tailors its verbal and non-verbal behavior based on the visual attention of the child and employs means to reorient the attention of the child, when distracted from the learning activity. We used the Little Bear agent in a learning application to enable teaching the vocabulary of everyday fruits and vegetables. Our user-study (n = 12) with preschoolers shows that children interacted longer and showed improved short-term retention of the vocabulary using the gaze aware agent compared to a baseline touch-based application. Our results demonstrate the potential of gaze aware application design for early childhood learning.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aladé, F., Lauricella, A.R., Beaudoin-Ryan, L., Wartella, E.: Measuring with Murray: touchscreen technology and preschoolers’ STEM learning. Comput. Hum. Behav. 62, 433–441 (2016)CrossRef Aladé, F., Lauricella, A.R., Beaudoin-Ryan, L., Wartella, E.: Measuring with Murray: touchscreen technology and preschoolers’ STEM learning. Comput. Hum. Behav. 62, 433–441 (2016)CrossRef
2.
Zurück zum Zitat Atkinson, R.K.: Optimizing learning from examples using animated pedagogical agents. J. Educ. Psychol. 94(2), 416 (2002)CrossRef Atkinson, R.K.: Optimizing learning from examples using animated pedagogical agents. J. Educ. Psychol. 94(2), 416 (2002)CrossRef
3.
Zurück zum Zitat Bee, N., Wagner, J., André, E., Charles, F., Pizzi, D., Cavazza, M.: Interacting with a gaze-aware virtual character. In: Proceedings of the 2010 workshop on Eye Gaze in Intelligent Human Machine Interaction, pp. 71–77. ACM (2010) Bee, N., Wagner, J., André, E., Charles, F., Pizzi, D., Cavazza, M.: Interacting with a gaze-aware virtual character. In: Proceedings of the 2010 workshop on Eye Gaze in Intelligent Human Machine Interaction, pp. 71–77. ACM (2010)
4.
Zurück zum Zitat Black, M., Chang, J., Chang, J., Narayanan, S.: Comparison of child-human and child-computer interactions based on manual annotations. In: Proceedings of the 2nd Workshop on Child, Computer and Interaction, p. 2. ACM (2009) Black, M., Chang, J., Chang, J., Narayanan, S.: Comparison of child-human and child-computer interactions based on manual annotations. In: Proceedings of the 2nd Workshop on Child, Computer and Interaction, p. 2. ACM (2009)
5.
Zurück zum Zitat Borgestig, M., Sandqvist, J., Parsons, R., Falkmer, T., Hemmingsson, H.: Eye gaze performance for children with severe physical impairments using gaze-based assistive technology: a longitudinal study. Assist. Technol. 28(2), 93–102 (2016)CrossRef Borgestig, M., Sandqvist, J., Parsons, R., Falkmer, T., Hemmingsson, H.: Eye gaze performance for children with severe physical impairments using gaze-based assistive technology: a longitudinal study. Assist. Technol. 28(2), 93–102 (2016)CrossRef
6.
Zurück zum Zitat Chipman, G., Druin, A., Beer, D., Fails, J.A., Guha, M.L., Simms, S.: A case study of tangible flags: a collaborative technology to enhance field trips. In: Proceedings of Conference on Interaction Design and Children, pp. 1–8. ACM (2006) Chipman, G., Druin, A., Beer, D., Fails, J.A., Guha, M.L., Simms, S.: A case study of tangible flags: a collaborative technology to enhance field trips. In: Proceedings of Conference on Interaction Design and Children, pp. 1–8. ACM (2006)
7.
Zurück zum Zitat D’Mello, S., Olney, A., Williams, C., Hays, P.: Gaze tutor: a gaze-reactive intelligent tutoring system. Int. J. Hum.-Comput. Stud. 70(5), 377–398 (2012)CrossRef D’Mello, S., Olney, A., Williams, C., Hays, P.: Gaze tutor: a gaze-reactive intelligent tutoring system. Int. J. Hum.-Comput. Stud. 70(5), 377–398 (2012)CrossRef
8.
Zurück zum Zitat Dugard, P.: Randomization tests: a new gold standard? J. Context. Behav. Sci. 3(1), 65–68 (2014)CrossRef Dugard, P.: Randomization tests: a new gold standard? J. Context. Behav. Sci. 3(1), 65–68 (2014)CrossRef
9.
Zurück zum Zitat Eichner, T., Prendinger, H., André, E., Ishizuka, M.: Attentive presentation agents. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS, vol. 4722, pp. 283–295. Springer, Heidelberg (2007). doi:10.1007/978-3-540-74997-4_26 CrossRef Eichner, T., Prendinger, H., André, E., Ishizuka, M.: Attentive presentation agents. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS, vol. 4722, pp. 283–295. Springer, Heidelberg (2007). doi:10.​1007/​978-3-540-74997-4_​26 CrossRef
10.
Zurück zum Zitat Evans, M.A., Drechsel, E., Woods, E., Cui, G.: Multi-touch tabletop computing for early childhood mathematics: 3D interaction with tangible user interfaces. In: Proceedings of the 9th International Conference of the Learning Sciences, pp. 274–275 (2010) Evans, M.A., Drechsel, E., Woods, E., Cui, G.: Multi-touch tabletop computing for early childhood mathematics: 3D interaction with tangible user interfaces. In: Proceedings of the 9th International Conference of the Learning Sciences, pp. 274–275 (2010)
11.
Zurück zum Zitat Feng, G.: Eye tracking: a brief guide for developmental researchers. J. Cogn. Dev. 12(1), 1–11 (2011)CrossRef Feng, G.: Eye tracking: a brief guide for developmental researchers. J. Cogn. Dev. 12(1), 1–11 (2011)CrossRef
12.
Zurück zum Zitat Fisher, A.V., Godwin, K.E., Seltman, H.: Visual environment, attention allocation, and learning in young children when too much of a good thing may be bad. Psychol. Sci. 25(7), 1362–1370 (2014)CrossRef Fisher, A.V., Godwin, K.E., Seltman, H.: Visual environment, attention allocation, and learning in young children when too much of a good thing may be bad. Psychol. Sci. 25(7), 1362–1370 (2014)CrossRef
13.
Zurück zum Zitat McKnight, L., Fitton, D.: Touch-screen technology for children: giving the right instructions and getting the right responses. In: Proceedings of the 9th International Conference on Interaction Design and Children, pp. 238–241. ACM (2010) McKnight, L., Fitton, D.: Touch-screen technology for children: giving the right instructions and getting the right responses. In: Proceedings of the 9th International Conference on Interaction Design and Children, pp. 238–241. ACM (2010)
14.
Zurück zum Zitat Heidig, S., Clarebout, G.: Do pedagogical agents make a difference to student motivation and learning? Educ. Res. Rev. 6(1), 27–54 (2011)CrossRef Heidig, S., Clarebout, G.: Do pedagogical agents make a difference to student motivation and learning? Educ. Res. Rev. 6(1), 27–54 (2011)CrossRef
15.
Zurück zum Zitat Helo, A., Pannasch, S., Sirri, L., Rämä, P.: The maturation of eye movement behavior: scene viewing characteristics in children and adults. Vis. Res. 103, 83–91 (2014)CrossRef Helo, A., Pannasch, S., Sirri, L., Rämä, P.: The maturation of eye movement behavior: scene viewing characteristics in children and adults. Vis. Res. 103, 83–91 (2014)CrossRef
16.
Zurück zum Zitat Hiniker, A., Sobel, K., Hong, S.R., Suh, H., Kim, D., Kientz, J.A.: Touchscreen prompts for preschoolers: designing developmentally appropriate techniques for teaching young children to perform gestures. In: Proceedings of International Conference on Interaction Design and Children, pp. 109–118. ACM (2015) Hiniker, A., Sobel, K., Hong, S.R., Suh, H., Kim, D., Kientz, J.A.: Touchscreen prompts for preschoolers: designing developmentally appropriate techniques for teaching young children to perform gestures. In: Proceedings of International Conference on Interaction Design and Children, pp. 109–118. ACM (2015)
17.
Zurück zum Zitat Homer, B.D., Kinzer, C.K., Plass, J.L., Letourneau, S.M., Hoffman, D., Bromley, M., Hayward, E.O., Turkay, S., Kornak, Y.: Moved to learn: the effects of interactivity in a Kinect-based literacy game for beginning readers. Comput. Educ. 74, 37–49 (2014)CrossRef Homer, B.D., Kinzer, C.K., Plass, J.L., Letourneau, S.M., Hoffman, D., Bromley, M., Hayward, E.O., Turkay, S., Kornak, Y.: Moved to learn: the effects of interactivity in a Kinect-based literacy game for beginning readers. Comput. Educ. 74, 37–49 (2014)CrossRef
18.
Zurück zum Zitat Hornof, A.J., Cavender, A.: EyeDraw: enabling children with severe motor impairments to draw with their eyes. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 161–170. ACM (2005) Hornof, A.J., Cavender, A.: EyeDraw: enabling children with severe motor impairments to draw with their eyes. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 161–170. ACM (2005)
19.
Zurück zum Zitat Hourcade, J.P.: Interaction design and children. Found. Trends Hum.-Comput. Interact. 1(4), 277–392 (2008)CrossRef Hourcade, J.P.: Interaction design and children. Found. Trends Hum.-Comput. Interact. 1(4), 277–392 (2008)CrossRef
20.
Zurück zum Zitat Gottlieb, J., Oudeyer, P.Y., Lopes, M., Baranes, A.: Information-seeking, curiosity, and attention: computational and neural mechanisms. Trends Cogn. Sci. 17(11), 585–593 (2013)CrossRef Gottlieb, J., Oudeyer, P.Y., Lopes, M., Baranes, A.: Information-seeking, curiosity, and attention: computational and neural mechanisms. Trends Cogn. Sci. 17(11), 585–593 (2013)CrossRef
21.
Zurück zum Zitat Kam, M., Rudraraju, V., Tewari, A., Canny, J.: Mobile gaming with children in rural India: contextual factors in the use of game design patterns. In: Proceedings of 3rd Digital Games Research Association International Conference (2007) Kam, M., Rudraraju, V., Tewari, A., Canny, J.: Mobile gaming with children in rural India: contextual factors in the use of game design patterns. In: Proceedings of 3rd Digital Games Research Association International Conference (2007)
22.
Zurück zum Zitat Kangas, J., Akkil, D., Rantala, J., Isokoski, P., Majaranta, P., Raisamo, R.: Gaze gestures and haptic feedback in mobile devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 435–438. ACM (2014) Kangas, J., Akkil, D., Rantala, J., Isokoski, P., Majaranta, P., Raisamo, R.: Gaze gestures and haptic feedback in mobile devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 435–438. ACM (2014)
23.
Zurück zum Zitat Krämer, N.C., Bente, G.: Personalizing e-learning. the social effects of pedagogical agents. Educ. Psychol. Rev. 22(1), 71–87 (2010)CrossRef Krämer, N.C., Bente, G.: Personalizing e-learning. the social effects of pedagogical agents. Educ. Psychol. Rev. 22(1), 71–87 (2010)CrossRef
24.
Zurück zum Zitat LaFrance, M., Mayo, C.: Cultural aspects of nonverbal communication. Int. J. Interc. Relat. 2(1), 71–89 (1978)CrossRef LaFrance, M., Mayo, C.: Cultural aspects of nonverbal communication. Int. J. Interc. Relat. 2(1), 71–89 (1978)CrossRef
25.
Zurück zum Zitat Lahiri, U., Warren, Z., Sarkar, N.: Design of a gaze-sensitive virtual social interactive system for children with autism. IEEE Trans. Neural Syst. Rehabil. Eng. 4, 443–452 (2014) Lahiri, U., Warren, Z., Sarkar, N.: Design of a gaze-sensitive virtual social interactive system for children with autism. IEEE Trans. Neural Syst. Rehabil. Eng. 4, 443–452 (2014)
26.
Zurück zum Zitat Lu, C., Frye, D.: Mastering the machine: a comparison of the mouse and touch screen for children’s use of computers. In: Tomek, I. (ed.) ICCAL 1992. LNCS, vol. 602, pp. 417–427. Springer, Heidelberg (1992). doi:10.1007/3-540-55578-1_88 CrossRef Lu, C., Frye, D.: Mastering the machine: a comparison of the mouse and touch screen for children’s use of computers. In: Tomek, I. (ed.) ICCAL 1992. LNCS, vol. 602, pp. 417–427. Springer, Heidelberg (1992). doi:10.​1007/​3-540-55578-1_​88 CrossRef
27.
Zurück zum Zitat Luna, B.: Developmental changes in cognitive control through adolescence. Adv. Child Dev. Behav. 37, 233–278 (2009)CrossRef Luna, B.: Developmental changes in cognitive control through adolescence. Adv. Child Dev. Behav. 37, 233–278 (2009)CrossRef
28.
Zurück zum Zitat Nacher, V., Jaen, J., Navarro, E., Catala, A., González, P.: Multi-touch gestures for pre-kindergarten children. Int. J. Hum.-Comput. Stud. 73, 37–51 (2015)CrossRef Nacher, V., Jaen, J., Navarro, E., Catala, A., González, P.: Multi-touch gestures for pre-kindergarten children. Int. J. Hum.-Comput. Stud. 73, 37–51 (2015)CrossRef
29.
Zurück zum Zitat Ovaska, S., Hietala, P., Kangassalo, M.: Electronic whiteboard in kindergarten: opportunities and requirements. In: Proceedings of the 2003 Conference on Interaction Design and Children, pp. 15–22. ACM (2003) Ovaska, S., Hietala, P., Kangassalo, M.: Electronic whiteboard in kindergarten: opportunities and requirements. In: Proceedings of the 2003 Conference on Interaction Design and Children, pp. 15–22. ACM (2003)
30.
Zurück zum Zitat Pfeuffer, K., Alexander, J., Chong, M.K., Gellersen, H.: Gaze-touch: combining gaze with multi-touch for interaction on the same surface. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 509–518. ACM (2014) Pfeuffer, K., Alexander, J., Chong, M.K., Gellersen, H.: Gaze-touch: combining gaze with multi-touch for interaction on the same surface. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 509–518. ACM (2014)
31.
Zurück zum Zitat Plowman, L., McPake, J.: Seven myths about young children and technology. Child. Educ. 89(1), 27–33 (2013)CrossRef Plowman, L., McPake, J.: Seven myths about young children and technology. Child. Educ. 89(1), 27–33 (2013)CrossRef
32.
Zurück zum Zitat Ramloll, R., Trepagnier, C., Sebrechts, M., Finkelmeyer, A.: A gaze contingent environment for fostering social attention in autistic children. In: Proceedings of the 2004 Symposium on Eye Tracking Research & Applications, pp. 19–26. ACM (2004) Ramloll, R., Trepagnier, C., Sebrechts, M., Finkelmeyer, A.: A gaze contingent environment for fostering social attention in autistic children. In: Proceedings of the 2004 Symposium on Eye Tracking Research & Applications, pp. 19–26. ACM (2004)
33.
Zurück zum Zitat Robertson, J., Macvean, A., Howland, K.: Robust evaluation for a maturing field: the train the teacher method. Int. J. Child-Comput. Interact. 1(2), 50–60 (2013)CrossRef Robertson, J., Macvean, A., Howland, K.: Robust evaluation for a maturing field: the train the teacher method. Int. J. Child-Comput. Interact. 1(2), 50–60 (2013)CrossRef
34.
Zurück zum Zitat Rogers, Y., Price, S., Randell, C., Fraser, D.S., Weal, M., Fitzpatrick, G.: Ubi-learning integrates indoor and outdoor experiences. Commun. ACM 48(1), 55–59 (2005)CrossRef Rogers, Y., Price, S., Randell, C., Fraser, D.S., Weal, M., Fitzpatrick, G.: Ubi-learning integrates indoor and outdoor experiences. Commun. ACM 48(1), 55–59 (2005)CrossRef
35.
Zurück zum Zitat Romeo, G., Edwards, S., McNamara, S., Walker, I., Ziguras, C.: Touching the screen: issues related to the use of touchscreen technology in early childhood education. Br. J. Educ. Technol. 34(3), 329–339 (2003)CrossRef Romeo, G., Edwards, S., McNamara, S., Walker, I., Ziguras, C.: Touching the screen: issues related to the use of touchscreen technology in early childhood education. Br. J. Educ. Technol. 34(3), 329–339 (2003)CrossRef
36.
Zurück zum Zitat Schroeder, E.L., Kirkorian, H.L.: When seeing is better than doing: preschoolers’ transfer of STEM skills using touchscreen games. Front. Psychol. 7, 1–10 (2016)CrossRef Schroeder, E.L., Kirkorian, H.L.: When seeing is better than doing: preschoolers’ transfer of STEM skills using touchscreen games. Front. Psychol. 7, 1–10 (2016)CrossRef
37.
Zurück zum Zitat Sibert, J.L., Gokturk, M., Lavine, R.A.: The reading assistant: eye gaze triggered auditory prompting for reading remediation. In: Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, pp. 101–107. ACM (2000) Sibert, J.L., Gokturk, M., Lavine, R.A.: The reading assistant: eye gaze triggered auditory prompting for reading remediation. In: Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, pp. 101–107. ACM (2000)
38.
Zurück zum Zitat Vatavu, R.D., Cramariuc, G., Schipor, D.M.: Touch interaction for children aged 3 to 6 years: experimental findings and relationship to motor skills. Int. J. Hum.-Comput. Stud. 74, 54–76 (2015)CrossRef Vatavu, R.D., Cramariuc, G., Schipor, D.M.: Touch interaction for children aged 3 to 6 years: experimental findings and relationship to motor skills. Int. J. Hum.-Comput. Stud. 74, 54–76 (2015)CrossRef
39.
Zurück zum Zitat Vidal, M., Turner, J., Bulling, A., Gellersen, H.: Wearable eye tracking for mental health monitoring. Comput. Commun. 35(11), 1306–1311 (2011)CrossRef Vidal, M., Turner, J., Bulling, A., Gellersen, H.: Wearable eye tracking for mental health monitoring. Comput. Commun. 35(11), 1306–1311 (2011)CrossRef
40.
Zurück zum Zitat Ygge, J., Aring, E., Han, Y., Bolzani, R., Hellström, A.: Fixation stability in normal children. Ann. N. Y. Acad. Sci. 1039(1), 480–483 (2005)CrossRef Ygge, J., Aring, E., Han, Y., Bolzani, R., Hellström, A.: Fixation stability in normal children. Ann. N. Y. Acad. Sci. 1039(1), 480–483 (2005)CrossRef
41.
Zurück zum Zitat Zaman, B., Abeele, V.V., De Grooff, D.: Measuring product liking in preschool children: an evaluation of the Smileyometer and this or that methods. Int. J. Child-Comput. Interact. 1(2), 61–70 (2013)CrossRef Zaman, B., Abeele, V.V., De Grooff, D.: Measuring product liking in preschool children: an evaluation of the Smileyometer and this or that methods. Int. J. Child-Comput. Interact. 1(2), 61–70 (2013)CrossRef
Metadaten
Titel
Gaze Awareness in Agent-Based Early-Childhood Learning Application
verfasst von
Deepak Akkil
Prasenjit Dey
Deepshika Salian
Nitendra Rajput
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-67684-5_28

Neuer Inhalt