Skip to main content

2022 | OriginalPaper | Buchkapitel

Interface, Pedagogical Agents and Chatbox in Virtual Learning Environments: An Eye Tracking Experiment

verfasst von : Lai Wei, Kenny K. N. Chow

Erschienen in: [ ] With Design: Reinventing Design Modes

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Scholars in education over the past few decades have discussed at length computer-based interactive learning through the conceptual framework of cognitive science. Yet, very few studies look at the design of visual content in technology-mediated learning and its effects on information dissemination. During the COVID-19 pandemic, the situation in online education revealed that the potential of visual and non-verbal design attributes in learning is underexplored. This study employed a 2 × 2 experimental design. An Eyelink 1000 plus eye-tracker was used to record student participants’ eye movements to determine how they looked at the interface layout, the chat box, and pedagogical agents with text cues. The participants’ learning performance were measured with retention and transfer tests. Results showed that the interface design, chat box and pedagogical agents interfere with students’ learning performance and visual attendance, which proves spatial contiguity effect, coherence effect and redundancy effect from the cognitive theory of multimedia learning. The present study results support the hypothesis that visual design is fundamental for effective virtual learning environments.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Anon: Proceedings of the 10th International Conference on Education Technology and Computers. ACM (2018) Anon: Proceedings of the 10th International Conference on Education Technology and Computers. ACM (2018)
Zurück zum Zitat Bandura, A.: Social Learning Theory. Prentice Hall, Englewood Cliffs (1977) Bandura, A.: Social Learning Theory. Prentice Hall, Englewood Cliffs (1977)
Zurück zum Zitat Beege, M., et al.: Investigating the effects of beat and deictic gestures of a lecturer in educational videos. Comput. Educ. 156, 103955 (2020)CrossRef Beege, M., et al.: Investigating the effects of beat and deictic gestures of a lecturer in educational videos. Comput. Educ. 156, 103955 (2020)CrossRef
Zurück zum Zitat Biocca, F., Harms, C., Burgoon, J.K.: Toward a more robust theory and measure of social presence: review and suggested criteria. Presence 12(5), 456–480 (2003) Biocca, F., Harms, C., Burgoon, J.K.: Toward a more robust theory and measure of social presence: review and suggested criteria. Presence 12(5), 456–480 (2003)
Zurück zum Zitat Castro-Alonso, J.C., et al.: Effectiveness of multimedia pedagogical agents predicted by diverse theories: a meta-analysis. Educ. Psychol. Rev. 33, 989–1015 (2021) Castro-Alonso, J.C., et al.: Effectiveness of multimedia pedagogical agents predicted by diverse theories: a meta-analysis. Educ. Psychol. Rev. 33, 989–1015 (2021)
Zurück zum Zitat Ciolacu, M., Beer, R.: Adaptive user interface for higher education based on web technology. In: 2016 IEEE 22nd International Symposium for Design and Technology in Electronic Packaging (SIITME), pp. 300–303 (2016) Ciolacu, M., Beer, R.: Adaptive user interface for higher education based on web technology. In: 2016 IEEE 22nd International Symposium for Design and Technology in Electronic Packaging (SIITME), pp. 300–303 (2016)
Zurück zum Zitat Chen, G., Zhou, S., Zhi, T.: Viewing mechanism of lonely audience: evidence from an eye movement experiment on barrage video. Comput. Hum. Behav. 101, 327–333 (2019)CrossRef Chen, G., Zhou, S., Zhi, T.: Viewing mechanism of lonely audience: evidence from an eye movement experiment on barrage video. Comput. Hum. Behav. 101, 327–333 (2019)CrossRef
Zurück zum Zitat Davis, R.O., Vincent, J.: Sometimes more is better: agent gestures, procedural knowledge and the foreign language learner. Br. J. Edu. Technol. 50(6), 3252–3263 (2019)CrossRef Davis, R.O., Vincent, J.: Sometimes more is better: agent gestures, procedural knowledge and the foreign language learner. Br. J. Edu. Technol. 50(6), 3252–3263 (2019)CrossRef
Zurück zum Zitat Dincer, S., Doganay, A.: The effects of multiple-pedagogical agents on learners’ academic success, motivation, and cognitive load. Comput. Educ. 111, 74–100 (2017)CrossRef Dincer, S., Doganay, A.: The effects of multiple-pedagogical agents on learners’ academic success, motivation, and cognitive load. Comput. Educ. 111, 74–100 (2017)CrossRef
Zurück zum Zitat Fakhrunisa, F., Prabawanto, S.: Online learning in COVID-19 pandemic: an investigation of mathematics teachers’ perception. In: 2020 The 4th International Conference on Education and E-Learning (ICEEL 2020), pp. 207–213. Association for Computing Machinery, New York (2020) Fakhrunisa, F., Prabawanto, S.: Online learning in COVID-19 pandemic: an investigation of mathematics teachers’ perception. In: 2020 The 4th International Conference on Education and E-Learning (ICEEL 2020), pp. 207–213. Association for Computing Machinery, New York (2020)
Zurück zum Zitat Farhan, W., et al.: E-learning systems versus instructional communication tools: developing and testing a new e-learning user interface from the perspectives of teachers and students. Technol. Soc. 59, 101192 (2019)CrossRef Farhan, W., et al.: E-learning systems versus instructional communication tools: developing and testing a new e-learning user interface from the perspectives of teachers and students. Technol. Soc. 59, 101192 (2019)CrossRef
Zurück zum Zitat Gillis, A., Krull, L.M.: COVID-19 remote learning transition in spring 2020: class structures, student perceptions, and inequality in college courses. Teach. Sociol. 48(4), 283–299 (2020)CrossRef Gillis, A., Krull, L.M.: COVID-19 remote learning transition in spring 2020: class structures, student perceptions, and inequality in college courses. Teach. Sociol. 48(4), 283–299 (2020)CrossRef
Zurück zum Zitat Gnewuch, U., Morana, S., Maedche, A.: Towards designing cooperative and social conversational agents for customer service. In: ICIS, December 2017 Gnewuch, U., Morana, S., Maedche, A.: Towards designing cooperative and social conversational agents for customer service. In: ICIS, December 2017
Zurück zum Zitat Horovitz, T., Mayer, R.E.: Learning with human and virtual instructors who display happy or bored emotions in video lectures. Comput. Hum. Behav. 119, 106724 (2021)CrossRef Horovitz, T., Mayer, R.E.: Learning with human and virtual instructors who display happy or bored emotions in video lectures. Comput. Hum. Behav. 119, 106724 (2021)CrossRef
Zurück zum Zitat Hu, T.-W., et al.: Research on interface improvement of English vocabulary learning APP. In: Proceedings of the 2019 7th International Conference on Information Technology: IoT and Smart City, pp. 165–169 (2019) Hu, T.-W., et al.: Research on interface improvement of English vocabulary learning APP. In: Proceedings of the 2019 7th International Conference on Information Technology: IoT and Smart City, pp. 165–169 (2019)
Zurück zum Zitat Hung, I.C., Chen, N.S.: Embodied interactive video lectures for improving learning comprehension and retention. Comput. Educ. 117, 116–131 (2018)CrossRef Hung, I.C., Chen, N.S.: Embodied interactive video lectures for improving learning comprehension and retention. Comput. Educ. 117, 116–131 (2018)CrossRef
Zurück zum Zitat Koning, B.B., Rop, G., Paas, F.: Effects of spatial distance on the effectiveness of mental and physical integration strategies in learning from split-attention examples. Comput. Hum. Behav. 110, 106379 (2020)CrossRef Koning, B.B., Rop, G., Paas, F.: Effects of spatial distance on the effectiveness of mental and physical integration strategies in learning from split-attention examples. Comput. Hum. Behav. 110, 106379 (2020)CrossRef
Zurück zum Zitat Lam, W., et al.: Investigating online collaborative learning on students’ learning outcomes in higher education. In: Proceedings of the 2019 3rd International Conference on Education and E-Learning, pp. 13–19 (2019) Lam, W., et al.: Investigating online collaborative learning on students’ learning outcomes in higher education. In: Proceedings of the 2019 3rd International Conference on Education and E-Learning, pp. 13–19 (2019)
Zurück zum Zitat Li, W., et al.: Getting the point: which kinds of gestures by pedagogical agents improve multimedia learning? J. Educ. Psychol. 111(8), 1382–1395 (2019)CrossRef Li, W., et al.: Getting the point: which kinds of gestures by pedagogical agents improve multimedia learning? J. Educ. Psychol. 111(8), 1382–1395 (2019)CrossRef
Zurück zum Zitat Makransky, G., et al.: Equivalence of using a desktop virtual reality science simulation at home and in class. PLoS ONE 14(4), e0214944 (2019)CrossRef Makransky, G., et al.: Equivalence of using a desktop virtual reality science simulation at home and in class. PLoS ONE 14(4), e0214944 (2019)CrossRef
Zurück zum Zitat Makransky, G., Wismer, P., Mayer, R.E.: A gender matching effect in learning with pedagogical agents in an immersive virtual reality science simulation. J. Comput. Assist. Learn. 35(3), 349–358 (2019)CrossRef Makransky, G., Wismer, P., Mayer, R.E.: A gender matching effect in learning with pedagogical agents in an immersive virtual reality science simulation. J. Comput. Assist. Learn. 35(3), 349–358 (2019)CrossRef
Zurück zum Zitat Mayer, R.E.: Multimedia Learning. Cambridge University Press, New York (2002) Mayer, R.E.: Multimedia Learning. Cambridge University Press, New York (2002)
Zurück zum Zitat Mirsarraf, M.R., Khazaei, M., Ahmadpanah, A.: Role of pictorial symbols in the web interface design. Int. J. Arts 7, 17–22 (2017) Mirsarraf, M.R., Khazaei, M., Ahmadpanah, A.: Role of pictorial symbols in the web interface design. Int. J. Arts 7, 17–22 (2017)
Zurück zum Zitat Moreno, R., Mayer, R.: Interactive multimodal learning environments: special issue on interactive learning environments: contemporary issues and trends. Educ. Psychol. Rev. 19(3), pp. 309–326 (2007) Moreno, R., Mayer, R.: Interactive multimodal learning environments: special issue on interactive learning environments: contemporary issues and trends. Educ. Psychol. Rev. 19(3), pp. 309–326 (2007)
Zurück zum Zitat Moreno, R., Mayer, R.E.: Personalized messages that promote science learning in virtual environments. J. Educ. Psychol. 96(1), 165–173 (2004)CrossRef Moreno, R., Mayer, R.E.: Personalized messages that promote science learning in virtual environments. J. Educ. Psychol. 96(1), 165–173 (2004)CrossRef
Zurück zum Zitat Rahal, R.M., Fiedler, S.: Understanding cognitive and affective mechanisms in social psychology through eye-tracking. J. Exp. Soc. Psychol. 85, 103842 (2019)CrossRef Rahal, R.M., Fiedler, S.: Understanding cognitive and affective mechanisms in social psychology through eye-tracking. J. Exp. Soc. Psychol. 85, 103842 (2019)CrossRef
Zurück zum Zitat Rapanta, C., et al.: Online university teaching during and after the Covid-19 crisis: refocusing teacher presence and learning activity. Postdigit. Sci. Educ. 2, 923–945 (2020) Rapanta, C., et al.: Online university teaching during and after the Covid-19 crisis: refocusing teacher presence and learning activity. Postdigit. Sci. Educ. 2, 923–945 (2020)
Zurück zum Zitat Rey, G.D.: Seductive details and attention distraction – an eye tracker experiment. Comput. Hum. Behav. 32, 133–144 (2014)CrossRef Rey, G.D.: Seductive details and attention distraction – an eye tracker experiment. Comput. Hum. Behav. 32, 133–144 (2014)CrossRef
Zurück zum Zitat Russ, S., Hamidi, F.: Online learning accessibility during the COVID-19 pandemic. In: Proceedings of the 18th International Web for All Conference (W4A 2021), pp. 1–7, Article no. 8. Association for Computing Machinery, New York (2021) Russ, S., Hamidi, F.: Online learning accessibility during the COVID-19 pandemic. In: Proceedings of the 18th International Web for All Conference (W4A 2021), pp. 1–7, Article no. 8. Association for Computing Machinery, New York (2021)
Zurück zum Zitat Schroeder, N.L., Adesope, O.O., Gilbert, R.B.: How effective are pedagogical agents for learning? A meta-analytic review. J. Educ. Comput. Res. 49(1), 1–39 (2013)CrossRef Schroeder, N.L., Adesope, O.O., Gilbert, R.B.: How effective are pedagogical agents for learning? A meta-analytic review. J. Educ. Comput. Res. 49(1), 1–39 (2013)CrossRef
Zurück zum Zitat Shin, K., Downing, K.: User centred e-learning platform design. In: Proceedings of the 2011 Conference on Designing Pleasurable Products and Interfaces (DPPI 2011), pp. 1–4. Article no. 8. Association for Computing Machinery, New York (2011) Shin, K., Downing, K.: User centred e-learning platform design. In: Proceedings of the 2011 Conference on Designing Pleasurable Products and Interfaces (DPPI 2011), pp. 1–4. Article no. 8. Association for Computing Machinery, New York (2011)
Zurück zum Zitat Short, J., Williams, E., Christie, B.: The Social Psychology of Telecommunications. Wiley, London (1976) Short, J., Williams, E., Christie, B.: The Social Psychology of Telecommunications. Wiley, London (1976)
Zurück zum Zitat Stull, A.T., Fiorella, L., Mayer, R.E.: An eye-tracking analysis of instructor presence in video lectures. Comput. Hum. Behav. 88, 263–272 (2018)CrossRef Stull, A.T., Fiorella, L., Mayer, R.E.: An eye-tracking analysis of instructor presence in video lectures. Comput. Hum. Behav. 88, 263–272 (2018)CrossRef
Zurück zum Zitat Sutton, R.E., Wheatley, K.F.: Teachers’ emotions and teaching: a review of the literature and directions for future research. Educ. Psychol. Rev. 15(4), 327–358 (2003)CrossRef Sutton, R.E., Wheatley, K.F.: Teachers’ emotions and teaching: a review of the literature and directions for future research. Educ. Psychol. Rev. 15(4), 327–358 (2003)CrossRef
Zurück zum Zitat Sweller, J.: Cognitive load theory, learning difficulty, and instructional design. Learn. Instr. 4(4), 295–312 (1994)CrossRef Sweller, J.: Cognitive load theory, learning difficulty, and instructional design. Learn. Instr. 4(4), 295–312 (1994)CrossRef
Zurück zum Zitat Sweller, J.: Cognitive load theory. In: Psychology of Learning and Motivation, vol. 55, pp. 37–76. Academic Press (2011) Sweller, J.: Cognitive load theory. In: Psychology of Learning and Motivation, vol. 55, pp. 37–76. Academic Press (2011)
Zurück zum Zitat Turumogon, P., Baharum, A.: Identifying a user interface web design standard for higher learning institutions using Kansei engineering. Indonesian J. Electr. Eng. Comput. Sci. 11(1), 90–97 (2018) Turumogon, P., Baharum, A.: Identifying a user interface web design standard for higher learning institutions using Kansei engineering. Indonesian J. Electr. Eng. Comput. Sci. 11(1), 90–97 (2018)
Zurück zum Zitat Tu, C.-H.: On-line learning migration: from social learning theory to social presence theory in a CMC environment. J. Netw. Comput. Appl. 23(1), 27–37 (2000)CrossRef Tu, C.-H.: On-line learning migration: from social learning theory to social presence theory in a CMC environment. J. Netw. Comput. Appl. 23(1), 27–37 (2000)CrossRef
Zurück zum Zitat Wang, F., et al.: Animated pedagogical agents as aids in multimedia learning: effects on eye-fixations during learning and learning outcomes. J. Educ. Psychol. 110(2), 250–268 (2018a)CrossRef Wang, F., et al.: Animated pedagogical agents as aids in multimedia learning: effects on eye-fixations during learning and learning outcomes. J. Educ. Psychol. 110(2), 250–268 (2018a)CrossRef
Zurück zum Zitat Wang, J., Antonenko, P.D.: Instructor presence in instructional video: effects on visual attention, recall, and perceived learning. Comput. Hum. Behav. 71, 79–89 (2017)CrossRef Wang, J., Antonenko, P.D.: Instructor presence in instructional video: effects on visual attention, recall, and perceived learning. Comput. Hum. Behav. 71, 79–89 (2017)CrossRef
Zurück zum Zitat Wang, X., et al.: Impacts of cues on learning: using eye-tracking technologies to examine the functions and designs of added cues in short instructional videos. Comput. Hum. Behav. 107, 106279 (2020)CrossRef Wang, X., et al.: Impacts of cues on learning: using eye-tracking technologies to examine the functions and designs of added cues in short instructional videos. Comput. Hum. Behav. 107, 106279 (2020)CrossRef
Zurück zum Zitat Wang, Y., Zhu, X., Yang, Z.: Design and development of online practice teaching platform of new information technologies. In: Proceedings of the 10th International Conference on Education Technology and Computers (ICETC 2018), pp. 321–325. Association for Computing Machinery, New York (2018b) Wang, Y., Zhu, X., Yang, Z.: Design and development of online practice teaching platform of new information technologies. In: Proceedings of the 10th International Conference on Education Technology and Computers (ICETC 2018), pp. 321–325. Association for Computing Machinery, New York (2018b)
Zurück zum Zitat Wang, Z., Cruz, F.I.: Analysis of the impact of COVID-19 on education based on geotagged Twitter. In: Proceedings of the 1st ACM SIGSPATIAL International Workshop on Modeling and Understanding the Spread of COVID-19 (COVID-19), pp. 15–23. Association for Computing Machinery, New York (2020) Wang, Z., Cruz, F.I.: Analysis of the impact of COVID-19 on education based on geotagged Twitter. In: Proceedings of the 1st ACM SIGSPATIAL International Workshop on Modeling and Understanding the Spread of COVID-19 (COVID-19), pp. 15–23. Association for Computing Machinery, New York (2020)
Zurück zum Zitat Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Presence 7(3), 225–240 (1998) Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Presence 7(3), 225–240 (1998)
Zurück zum Zitat Xie, H., et al.: Coordinating visual and auditory cueing in multimedia learning. J. Educ. Psychol. 111(2), 235–255 (2019)CrossRef Xie, H., et al.: Coordinating visual and auditory cueing in multimedia learning. J. Educ. Psychol. 111(2), 235–255 (2019)CrossRef
Zurück zum Zitat Zeng, L.: Which kind of learning form do students want in china during COVID-19 outbreak. In: 2020 The 4th International Conference on Education and Multimedia Technology (ICEMT 2020), pp. 51–56. Association for Computing Machinery, New York (2020) Zeng, L.: Which kind of learning form do students want in china during COVID-19 outbreak. In: 2020 The 4th International Conference on Education and Multimedia Technology (ICEMT 2020), pp. 51–56. Association for Computing Machinery, New York (2020)
Metadaten
Titel
Interface, Pedagogical Agents and Chatbox in Virtual Learning Environments: An Eye Tracking Experiment
verfasst von
Lai Wei
Kenny K. N. Chow
Copyright-Jahr
2022
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-19-4472-7_28