Skip to main content
Top

2020 | OriginalPaper | Chapter

The Modality Effect of Cognitive Load Theory

Authors : Juan C. Castro-Alonso, John Sweller

Published in: Advances in Human Factors in Training, Education, and Learning Sciences

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The modality effect, which has been investigated by cognitive load theory, predicts that learning from visualizations supplemented with written text should be less effective than learning from the same visualizations supplemented with comparable spoken text. An explanation of the effect assumes a degree of separation between the processing of visuospatial and auditory information. Due to this separability, learning only from visuospatial information (visualizations and visual text) is more likely to overload visuospatial processing, as compared to learning from visuospatial and auditory information (visualizations and auditory text), in which both the visuospatial and the auditory processors share the load of the learning material. The aims of this review chapter are to: (a) describe the modality effect, (b) provide supporting evidence using computer multimedia about STEM topics, and (c) describe studies indicating the separability of visuospatial and auditory processing. We finish by suggesting future directions for research on the modality effect.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Sweller, J., Ayres, P., Kalyuga, S.: Cognitive Load Theory. Springer, New York (2011) CrossRef Sweller, J., Ayres, P., Kalyuga, S.: Cognitive Load Theory. Springer, New York (2011) CrossRef
2.
go back to reference Mayer, R.E. (ed.): The Cambridge Handbook of Multimedia Learning, 2nd edn. Cambridge University Press, New York (2014) Mayer, R.E. (ed.): The Cambridge Handbook of Multimedia Learning, 2nd edn. Cambridge University Press, New York (2014)
3.
go back to reference Mousavi, S.Y., Low, R., Sweller, J.: Reducing cognitive load by mixing auditory and visual presentation modes. J. Educ. Psychol. 87(2), 319–334 (1995) CrossRef Mousavi, S.Y., Low, R., Sweller, J.: Reducing cognitive load by mixing auditory and visual presentation modes. J. Educ. Psychol. 87(2), 319–334 (1995) CrossRef
4.
go back to reference Low, R., Sweller, J.: The modality principle in multimedia learning. In: Mayer, R.E. (ed.) The Cambridge Handbook of Multimedia Learning, 2nd edn., pp. 227–246. Cambridge University Press, New York (2014) Low, R., Sweller, J.: The modality principle in multimedia learning. In: Mayer, R.E. (ed.) The Cambridge Handbook of Multimedia Learning, 2nd edn., pp. 227–246. Cambridge University Press, New York (2014)
5.
6.
go back to reference Clark, J., Paivio, A.: Dual coding theory and education. Educ. Psychol. Rev. 3(3), 149–210 (1991) CrossRef Clark, J., Paivio, A.: Dual coding theory and education. Educ. Psychol. Rev. 3(3), 149–210 (1991) CrossRef
7.
go back to reference Chen, O., Kalyuga, S., Sweller, J.: The expertise reversal effect is a variant of the more general element interactivity effect. Educ. Psychol. Rev. 29(2), 393–405 (2017) CrossRef Chen, O., Kalyuga, S., Sweller, J.: The expertise reversal effect is a variant of the more general element interactivity effect. Educ. Psychol. Rev. 29(2), 393–405 (2017) CrossRef
8.
go back to reference Ginns, P.: Meta-analysis of the modality effect. Learn. Instr. 15(4), 313–331 (2005) CrossRef Ginns, P.: Meta-analysis of the modality effect. Learn. Instr. 15(4), 313–331 (2005) CrossRef
9.
go back to reference Cohen, J.: Statistical Power Analysis for the Behavioral Sciences. Erlbaum, Hillsdale (1988) Cohen, J.: Statistical Power Analysis for the Behavioral Sciences. Erlbaum, Hillsdale (1988)
10.
go back to reference Schmidt-Weigand, F., Kohnert, A., Glowalla, U.: A closer look at split visual attention in system- and self-paced instruction in multimedia learning. Learn. Instr. 20(2), 100–110 (2010) CrossRef Schmidt-Weigand, F., Kohnert, A., Glowalla, U.: A closer look at split visual attention in system- and self-paced instruction in multimedia learning. Learn. Instr. 20(2), 100–110 (2010) CrossRef
11.
go back to reference Kalyuga, S., Chandler, P., Sweller, J.: Managing split-attention and redundancy in multimedia instruction. Appl. Cogn. Psychol. 13(4), 351–371 (1999) CrossRef Kalyuga, S., Chandler, P., Sweller, J.: Managing split-attention and redundancy in multimedia instruction. Appl. Cogn. Psychol. 13(4), 351–371 (1999) CrossRef
12.
go back to reference Moreno, R., Mayer, R.E.: Cognitive principles of multimedia learning: the role of modality and contiguity. J. Educ. Psychol. 91(2), 358–368 (1999) CrossRef Moreno, R., Mayer, R.E.: Cognitive principles of multimedia learning: the role of modality and contiguity. J. Educ. Psychol. 91(2), 358–368 (1999) CrossRef
13.
go back to reference Kühl, T., Scheiter, K., Gerjets, P., Edelmann, J.: The influence of text modality on learning with static and dynamic visualizations. Comput. Hum. Behav. 27(1), 29–35 (2011) CrossRef Kühl, T., Scheiter, K., Gerjets, P., Edelmann, J.: The influence of text modality on learning with static and dynamic visualizations. Comput. Hum. Behav. 27(1), 29–35 (2011) CrossRef
14.
go back to reference Seufert, T., Schütze, M., Brünken, R.: Memory characteristics and modality in multimedia learning: an aptitude-treatment-interaction study. Learn. Instr. 19(1), 28–42 (2009) CrossRef Seufert, T., Schütze, M., Brünken, R.: Memory characteristics and modality in multimedia learning: an aptitude-treatment-interaction study. Learn. Instr. 19(1), 28–42 (2009) CrossRef
15.
go back to reference de Koning, B.B., van Hooijdonk, C.M.J., Lagerwerf, L.: Verbal redundancy in a procedural animation: on-screen labels improve retention but not behavioral performance. Comput. Educ. 107, 45–53 (2017) CrossRef de Koning, B.B., van Hooijdonk, C.M.J., Lagerwerf, L.: Verbal redundancy in a procedural animation: on-screen labels improve retention but not behavioral performance. Comput. Educ. 107, 45–53 (2017) CrossRef
16.
go back to reference Penney, C.G.: Modality effects and the structure of short-term verbal memory. Mem. Cogn. 17(4), 398–422 (1989) CrossRef Penney, C.G.: Modality effects and the structure of short-term verbal memory. Mem. Cogn. 17(4), 398–422 (1989) CrossRef
17.
go back to reference Kroll, N.E.A., Parks, T., Parkinson, S.R., Bieber, S.L., Johnson, A.L.: Short-term memory while shadowing: recall of visually and of aurally presented letters. J. Exp. Psychol. 85(2), 220–224 (1970) CrossRef Kroll, N.E.A., Parks, T., Parkinson, S.R., Bieber, S.L., Johnson, A.L.: Short-term memory while shadowing: recall of visually and of aurally presented letters. J. Exp. Psychol. 85(2), 220–224 (1970) CrossRef
18.
go back to reference Brünken, R., Steinbacher, S., Plass, J.L., Leutner, D.: Assessment of cognitive load in multimedia learning using dual-task methodology. Exp. Psychol. 49(2), 109–119 (2002) CrossRef Brünken, R., Steinbacher, S., Plass, J.L., Leutner, D.: Assessment of cognitive load in multimedia learning using dual-task methodology. Exp. Psychol. 49(2), 109–119 (2002) CrossRef
19.
go back to reference Bruyer, R., Scailquin, J.-C.: The visuospatial sketchpad for mental images: testing the multicomponent model of working memory. Acta Psychol. 98(1), 17–36 (1998) CrossRef Bruyer, R., Scailquin, J.-C.: The visuospatial sketchpad for mental images: testing the multicomponent model of working memory. Acta Psychol. 98(1), 17–36 (1998) CrossRef
20.
go back to reference Robinson, D.H., Katayama, A.D., Fan, A.-C.: Evidence for conjoint retention of information encoded from spatial adjunct displays. Contemp. Educ. Psychol. 21(3), 221–239 (1996) CrossRef Robinson, D.H., Katayama, A.D., Fan, A.-C.: Evidence for conjoint retention of information encoded from spatial adjunct displays. Contemp. Educ. Psychol. 21(3), 221–239 (1996) CrossRef
21.
go back to reference Robinson, D.H., Robinson, S.L., Katayama, A.D.: When words are represented in memory like pictures: evidence for spatial encoding of study materials. Contemp. Educ. Psychol. 24(1), 38–54 (1999) CrossRef Robinson, D.H., Robinson, S.L., Katayama, A.D.: When words are represented in memory like pictures: evidence for spatial encoding of study materials. Contemp. Educ. Psychol. 24(1), 38–54 (1999) CrossRef
22.
go back to reference Murdock Jr., B.B.: Four-channel effects in short-term memory. Psychon. Sci. 24(4), 197–198 (1971) CrossRef Murdock Jr., B.B.: Four-channel effects in short-term memory. Psychon. Sci. 24(4), 197–198 (1971) CrossRef
23.
go back to reference Kirsner, K., Smith, M.C.: Modality effects in word identification. Mem. Cogn. 2(4), 637–640 (1974) CrossRef Kirsner, K., Smith, M.C.: Modality effects in word identification. Mem. Cogn. 2(4), 637–640 (1974) CrossRef
24.
go back to reference Penney, C.G.: Order of report in bisensory verbal short-term memory. Can. J. Psychol. 34(2), 190–195 (1980) CrossRef Penney, C.G.: Order of report in bisensory verbal short-term memory. Can. J. Psychol. 34(2), 190–195 (1980) CrossRef
25.
go back to reference Castro-Alonso, J.C., Ayres, P., Wong, M., Paas, F.: Learning symbols from permanent and transient visual presentations: don’t overplay the hand. Comput. Educ. 116, 1–13 (2018) CrossRef Castro-Alonso, J.C., Ayres, P., Wong, M., Paas, F.: Learning symbols from permanent and transient visual presentations: don’t overplay the hand. Comput. Educ. 116, 1–13 (2018) CrossRef
26.
go back to reference Mayer, R.E., DaPra, C.S.: An embodiment effect in computer-based learning with animated pedagogical agents. J. Exp. Psychol. Appl. 18(3), 239–252 (2012) CrossRef Mayer, R.E., DaPra, C.S.: An embodiment effect in computer-based learning with animated pedagogical agents. J. Exp. Psychol. Appl. 18(3), 239–252 (2012) CrossRef
27.
go back to reference Chen, O., Castro-Alonso, J.C., Paas, F., Sweller, J.: Extending cognitive load theory to incorporate working memory resource depletion: evidence from the spacing effect. Educ. Psychol. Rev. 30(2), 483–501 (2018) CrossRef Chen, O., Castro-Alonso, J.C., Paas, F., Sweller, J.: Extending cognitive load theory to incorporate working memory resource depletion: evidence from the spacing effect. Educ. Psychol. Rev. 30(2), 483–501 (2018) CrossRef
28.
go back to reference Kalyuga, S., Sweller, J.: The redundancy principle in multimedia learning. In: Mayer, R.E. (ed.) The Cambridge Handbook of Multimedia Learning, 2nd edn., pp. 247–262. Cambridge University Press, New York (2014) Kalyuga, S., Sweller, J.: The redundancy principle in multimedia learning. In: Mayer, R.E. (ed.) The Cambridge Handbook of Multimedia Learning, 2nd edn., pp. 247–262. Cambridge University Press, New York (2014)
29.
go back to reference Kalyuga, S., Ayres, P., Chandler, P., Sweller, J.: The expertise reversal effect. Educ. Psychol. 38(1), 23–31 (2003) CrossRef Kalyuga, S., Ayres, P., Chandler, P., Sweller, J.: The expertise reversal effect. Educ. Psychol. 38(1), 23–31 (2003) CrossRef
30.
go back to reference Ayres, P., Paas, F.: Making instructional animations more effective: a cognitive load approach. Appl. Cogn. Psychol. 21(6), 695–700 (2007) CrossRef Ayres, P., Paas, F.: Making instructional animations more effective: a cognitive load approach. Appl. Cogn. Psychol. 21(6), 695–700 (2007) CrossRef
31.
go back to reference van Gog, T.: The signaling (or cueing) principle in multimedia learning. In: Mayer, R.E. (ed.) The Cambridge Handbook of Multimedia Learning, 2nd edn., pp. 263–278. Cambridge University Press, New York (2014) van Gog, T.: The signaling (or cueing) principle in multimedia learning. In: Mayer, R.E. (ed.) The Cambridge Handbook of Multimedia Learning, 2nd edn., pp. 263–278. Cambridge University Press, New York (2014)
32.
go back to reference Leahy, W., Sweller, J.: Cognitive load theory, modality of presentation and the transient information effect. Appl. Cogn. Psychol. 25(6), 943–951 (2011) CrossRef Leahy, W., Sweller, J.: Cognitive load theory, modality of presentation and the transient information effect. Appl. Cogn. Psychol. 25(6), 943–951 (2011) CrossRef
33.
go back to reference Castro-Alonso, J.C., Wong, M., Adesope, O.O., Ayres, P., Paas, F.: Gender imbalance in instructional dynamic versus static visualizations: a meta-analysis. Educ. Psychol. Rev. (2019). Advance Online Publication Castro-Alonso, J.C., Wong, M., Adesope, O.O., Ayres, P., Paas, F.: Gender imbalance in instructional dynamic versus static visualizations: a meta-analysis. Educ. Psychol. Rev. (2019). Advance Online Publication
34.
go back to reference Castro-Alonso, J.C., Uttal, D.H.: Spatial ability for university biology education. In: Nazir, S., Teperi, A.-M., Polak-Sopińska, A. (eds.) Advances in Human Factors in Training, Education, and Learning Sciences: Proceedings of the AHFE 2018 International Conference on Human Factors in Training, Education, and Learning Sciences, pp. 283–291. Springer (2019) Castro-Alonso, J.C., Uttal, D.H.: Spatial ability for university biology education. In: Nazir, S., Teperi, A.-M., Polak-Sopińska, A. (eds.) Advances in Human Factors in Training, Education, and Learning Sciences: Proceedings of the AHFE 2018 International Conference on Human Factors in Training, Education, and Learning Sciences, pp. 283–291. Springer (2019)
Metadata
Title
The Modality Effect of Cognitive Load Theory
Authors
Juan C. Castro-Alonso
John Sweller
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-20135-7_7

Premium Partner