Skip to main content

2016 | OriginalPaper | Buchkapitel

3. Theoretical Aspects of Multimodal Cognitive Load Measures

verfasst von : Fang Chen, Jianlong Zhou, Yang Wang, Kun Yu, Syed Z. Arshad, Ahmad Khawaji, Dan Conway

Erschienen in: Robust Multimodal Cognitive Load Measurement

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In Chap. 3, the theoretical aspects that result in the framework for Multimodal Cognitive Load Measures (MCLM) are discussed. This chapter brings together the critical elements of mental effort and performance studies from the domain of human factors and ergonomics. These elements are then linked to the extensive investigations of cognitive load measures in the context of CLT. Finally, multimodality and Load-Effort Homeostasis (LEH) models are presented as contributing to robustness within a real-time framework of MCLM.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat N. Chater, J.B. Tenenbaum, A. Yuille, Probabilistic models of cognition: Conceptual foundations. Trends Cogn. Sci. 10(7), 287–291 (2006)CrossRef N. Chater, J.B. Tenenbaum, A. Yuille, Probabilistic models of cognition: Conceptual foundations. Trends Cogn. Sci. 10(7), 287–291 (2006)CrossRef
2.
Zurück zum Zitat T. Griffiths, C. Kemp, J. Tenenbaum, Bayesian models of cognition, in The Cambridge Handbook of Computational Psychology, ed. by R. Sun (Cambridge University Press, Cambridge, 2008) T. Griffiths, C. Kemp, J. Tenenbaum, Bayesian models of cognition, in The Cambridge Handbook of Computational Psychology, ed. by R. Sun (Cambridge University Press, Cambridge, 2008)
3.
Zurück zum Zitat J.L. Austerweil, S.J. Gershman, T.L. Griffiths, Structure and flexibility in Bayesian models of cognition, in The Oxford Handbook of Computational and Mathematical Psychology, ed. by J.T. Townsend, J.R. Busemeyer (Oxford University Press, Oxford, 2015) J.L. Austerweil, S.J. Gershman, T.L. Griffiths, Structure and flexibility in Bayesian models of cognition, in The Oxford Handbook of Computational and Mathematical Psychology, ed. by J.T. Townsend, J.R. Busemeyer (Oxford University Press, Oxford, 2015)
4.
Zurück zum Zitat P.D. Bruza, Z. Wang, J.R. Busemeyer, Quantum cognition: A new theoretical approach to psychology. Trends Cogn. Sci. 19(7), 383–393 (2015)CrossRef P.D. Bruza, Z. Wang, J.R. Busemeyer, Quantum cognition: A new theoretical approach to psychology. Trends Cogn. Sci. 19(7), 383–393 (2015)CrossRef
5.
Zurück zum Zitat N. Moray (ed.), Mental Workload: Its Theory and Measurement (Springer, Boston, 1979) N. Moray (ed.), Mental Workload: Its Theory and Measurement (Springer, Boston, 1979)
6.
Zurück zum Zitat A. Westbrook, T.S. Braver, Cognitive effort: A neuroeconomic approach. Cogn. Affect. Behav. Neurosci. 15(2), 395–415 (2015)CrossRef A. Westbrook, T.S. Braver, Cognitive effort: A neuroeconomic approach. Cogn. Affect. Behav. Neurosci. 15(2), 395–415 (2015)CrossRef
7.
Zurück zum Zitat G. Johannsen, Workload and workload measurement, in Mental Workload: Its Theory and Measurement, ed. by N. Moray (Springer, Boston, 1979), pp. 3–11CrossRef G. Johannsen, Workload and workload measurement, in Mental Workload: Its Theory and Measurement, ed. by N. Moray (Springer, Boston, 1979), pp. 3–11CrossRef
8.
Zurück zum Zitat W.W. Wierwille, Physiological measures of aircrew mental workload. Hum. Factors: J. Hum. Factors. Ergonomics. Soc. 21(5), 575–593 (1979) W.W. Wierwille, Physiological measures of aircrew mental workload. Hum. Factors: J. Hum. Factors. Ergonomics. Soc. 21(5), 575–593 (1979)
9.
Zurück zum Zitat R.C. Williges, W.W. Wierwille, Behavioral measures of aircrew mental workload. Hum. Factors: J. Hum. Factors. Ergonomics. Soc. 21(5), 549–574 (1979) R.C. Williges, W.W. Wierwille, Behavioral measures of aircrew mental workload. Hum. Factors: J. Hum. Factors. Ergonomics. Soc. 21(5), 549–574 (1979)
10.
Zurück zum Zitat S. Hart, L. Staveland, Development of the NASA-TLX (Task Load Index): Results of empirical and theoretical research, in Human Mental Workload, ed. by P.A. Hancock, N. Meshkati, North Holland Press, Amsterdam (1988) S. Hart, L. Staveland, Development of the NASA-TLX (Task Load Index): Results of empirical and theoretical research, in Human Mental Workload, ed. by P.A. Hancock, N. Meshkati, North Holland Press, Amsterdam (1988)
11.
Zurück zum Zitat G.B. Reid, T.E. Nygren, The subjective workload assessment technique: A scaling procedure for measuring mental workload. Adv. Psychol. 52, 185–218 (1988)CrossRef G.B. Reid, T.E. Nygren, The subjective workload assessment technique: A scaling procedure for measuring mental workload. Adv. Psychol. 52, 185–218 (1988)CrossRef
12.
Zurück zum Zitat A. Miyake, N.P. Friedman, D.A. Rettinger, P. Shah, M. Hegarty, How are visuospatial working memory, executive functioning, and spatial abilities related? A latent-variable analysis. J. Exp. Psychol. Gen. 130(4), 621–640 (2001)CrossRef A. Miyake, N.P. Friedman, D.A. Rettinger, P. Shah, M. Hegarty, How are visuospatial working memory, executive functioning, and spatial abilities related? A latent-variable analysis. J. Exp. Psychol. Gen. 130(4), 621–640 (2001)CrossRef
13.
Zurück zum Zitat C. Collet, P. Averty, A. Dittmar, Autonomic nervous system and subjective ratings of strain in air-traffic control. Appl. Ergon. 40(1), 23–32 (2009)CrossRef C. Collet, P. Averty, A. Dittmar, Autonomic nervous system and subjective ratings of strain in air-traffic control. Appl. Ergon. 40(1), 23–32 (2009)CrossRef
15.
Zurück zum Zitat M.S. Young, K.A. Brookhuis, C.D. Wickens, P.A. Hancock, State of science: Mental workload in ergonomics. Ergonomics 58(1), 1–17 (2015)CrossRef M.S. Young, K.A. Brookhuis, C.D. Wickens, P.A. Hancock, State of science: Mental workload in ergonomics. Ergonomics 58(1), 1–17 (2015)CrossRef
16.
Zurück zum Zitat S.G. Hart, C.D. Wickens, Cognitive workload, in NASA Human Systems Integration Handbook (National Aeronautics and Space Administration, Washington, DC, 2010) S.G. Hart, C.D. Wickens, Cognitive workload, in NASA Human Systems Integration Handbook (National Aeronautics and Space Administration, Washington, DC, 2010)
17.
Zurück zum Zitat C.D. Wickens, P.S. Tsang, Workload, in Handbook of Human-Systems Intergration, ed. by F. Durso, J.D. Lee, D.A. Boehm-Davis (APA, Washington, DC, 2014) C.D. Wickens, P.S. Tsang, Workload, in Handbook of Human-Systems Intergration, ed. by F. Durso, J.D. Lee, D.A. Boehm-Davis (APA, Washington, DC, 2014)
18.
Zurück zum Zitat C.D. Wickens, A. Santamaria, A. Sebok, A computational model of task overload management and task switching, in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2013, vol. 57, pp. 763–767 C.D. Wickens, A. Santamaria, A. Sebok, A computational model of task overload management and task switching, in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2013, vol. 57, pp. 763–767
19.
Zurück zum Zitat C.D. Wickens, Multiple resources and mental workload. Hum. Factors: J. Hum. Factors. Ergonomics. Soc. 50(3), 449–455 (2008)CrossRef C.D. Wickens, Multiple resources and mental workload. Hum. Factors: J. Hum. Factors. Ergonomics. Soc. 50(3), 449–455 (2008)CrossRef
20.
Zurück zum Zitat C.D. Wickens, Multiple resources and performance prediction. Theor. Issues. Ergonomics. Sci. 3, 159–177 (2002)CrossRef C.D. Wickens, Multiple resources and performance prediction. Theor. Issues. Ergonomics. Sci. 3, 159–177 (2002)CrossRef
21.
Zurück zum Zitat C.D. Wickens, Multiple resource time sharing models, in Handbook of Human Factors and Ergonomics Methods, ed. by N.A. Stanton, A. Hedge, K. Brookhuis, E. Salas, H.W. Hendrick (CRC Press, Boca Raton, 2005), pp. 40.1–40.7 C.D. Wickens, Multiple resource time sharing models, in Handbook of Human Factors and Ergonomics Methods, ed. by N.A. Stanton, A. Hedge, K. Brookhuis, E. Salas, H.W. Hendrick (CRC Press, Boca Raton, 2005), pp. 40.1–40.7
22.
Zurück zum Zitat J.L. Plass, R. Moreno, R. Brünken, Cognitive Load Theory, 1st edn. (Cambridge University Press, Cambridge/NewYork, 2010)CrossRef J.L. Plass, R. Moreno, R. Brünken, Cognitive Load Theory, 1st edn. (Cambridge University Press, Cambridge/NewYork, 2010)CrossRef
23.
Zurück zum Zitat J. Sweller, P. Ayres, S. Kalyuga, Cognitive Load Theory (Springer, New York, 2011)CrossRef J. Sweller, P. Ayres, S. Kalyuga, Cognitive Load Theory (Springer, New York, 2011)CrossRef
24.
Zurück zum Zitat R.E. Mayer, Multimedia learning: Are we asking the right questions? Educ. Psychol. 32(1), 1–19 (1997)CrossRef R.E. Mayer, Multimedia learning: Are we asking the right questions? Educ. Psychol. 32(1), 1–19 (1997)CrossRef
25.
Zurück zum Zitat R.E. Mayer, J. Heiser, S. Lonn, Cognitive constraints on multimedia learning: When presenting more material results in less understanding. J. Educ. Psychol. 93(1), 187 (2001)CrossRef R.E. Mayer, J. Heiser, S. Lonn, Cognitive constraints on multimedia learning: When presenting more material results in less understanding. J. Educ. Psychol. 93(1), 187 (2001)CrossRef
26.
Zurück zum Zitat R.E. Mayer, Cognitive theory of multimedia learning, in The Cambridge Handbook of Multimedia Learning, ed. by R.E. Mayer (Cambridge University Press, New York, 2005)CrossRef R.E. Mayer, Cognitive theory of multimedia learning, in The Cambridge Handbook of Multimedia Learning, ed. by R.E. Mayer (Cambridge University Press, New York, 2005)CrossRef
27.
Zurück zum Zitat R. Moreno, B. Park, Cognitive load theory: Historical development and relation to other theories, in Cognitive Load Theory, ed. by J.L. Plass, R. Moreno, R. Brünken (Cambridge University Press, Cambridge, 2010), pp. 9–28CrossRef R. Moreno, B. Park, Cognitive load theory: Historical development and relation to other theories, in Cognitive Load Theory, ed. by J.L. Plass, R. Moreno, R. Brünken (Cambridge University Press, Cambridge, 2010), pp. 9–28CrossRef
28.
Zurück zum Zitat R.E. Mayer, Multimedia Learning, 2nd edn. (Cambridge University Press, Cambridge, 2009)CrossRef R.E. Mayer, Multimedia Learning, 2nd edn. (Cambridge University Press, Cambridge, 2009)CrossRef
29.
Zurück zum Zitat S. Kalyuga, P. Chandler, J. Sweller, When redundant on-screen text in multimedia technical instruction can interfere with learning. Hum. Factors 46(3), 567–581 (2004)CrossRef S. Kalyuga, P. Chandler, J. Sweller, When redundant on-screen text in multimedia technical instruction can interfere with learning. Hum. Factors 46(3), 567–581 (2004)CrossRef
30.
Zurück zum Zitat F. Paas, J.E. Tuovinen, H. Tabbers, P.W.M. Van Gerven, Cognitive load measurement as a means to advance cognitive load theory. Educ. Psychol. 38(1), 63–71 (2003)CrossRef F. Paas, J.E. Tuovinen, H. Tabbers, P.W.M. Van Gerven, Cognitive load measurement as a means to advance cognitive load theory. Educ. Psychol. 38(1), 63–71 (2003)CrossRef
31.
Zurück zum Zitat P. Ayres, J. Sweller, Locus of difficulty in multistage mathematics problems. Am. J. Psychol. 103(2), 167–193 (1990)CrossRef P. Ayres, J. Sweller, Locus of difficulty in multistage mathematics problems. Am. J. Psychol. 103(2), 167–193 (1990)CrossRef
32.
Zurück zum Zitat P.L. Ayres, Systematic mathematical errors and cognitive load. Contemp. Educ. Psychol. 26(2), 227–248 (2001)CrossRef P.L. Ayres, Systematic mathematical errors and cognitive load. Contemp. Educ. Psychol. 26(2), 227–248 (2001)CrossRef
33.
Zurück zum Zitat F.G.W.C. Paas, J.J.G.V. Merriënboer, The efficiency of instructional conditions: An approach to combine mental effort and performance measures. Hum. Factors: J. Hum. Factors. Ergonomics. Soc. 35(4), 737–743 (1993) F.G.W.C. Paas, J.J.G.V. Merriënboer, The efficiency of instructional conditions: An approach to combine mental effort and performance measures. Hum. Factors: J. Hum. Factors. Ergonomics. Soc. 35(4), 737–743 (1993)
34.
Zurück zum Zitat B. Hoffman, G. Schraw, Conceptions of efficiency: Applications in learning and problem solving. Educ. Psychol. 45(1), 1–14 (2010)CrossRef B. Hoffman, G. Schraw, Conceptions of efficiency: Applications in learning and problem solving. Educ. Psychol. 45(1), 1–14 (2010)CrossRef
35.
Zurück zum Zitat F.G. Paas, Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. J. Educ. Psychol. 84(4), 429–434 (1992)CrossRef F.G. Paas, Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. J. Educ. Psychol. 84(4), 429–434 (1992)CrossRef
36.
Zurück zum Zitat P. Ayres, Using subjective measures to detect variations of intrinsic load within problems. Learn. Instr. 16(5), 389–400 (2006)CrossRef P. Ayres, Using subjective measures to detect variations of intrinsic load within problems. Learn. Instr. 16(5), 389–400 (2006)CrossRef
37.
Zurück zum Zitat B.D. Homer, J.L. Plass, L. Blake, The effects of video on cognitive load and social presence in multimedia-learning. Comput. Hum. Behav. 24(3), 786–797 (2008)CrossRef B.D. Homer, J.L. Plass, L. Blake, The effects of video on cognitive load and social presence in multimedia-learning. Comput. Hum. Behav. 24(3), 786–797 (2008)CrossRef
38.
Zurück zum Zitat P.W.M. Van Gerven, F. Paas, J.J.G. Van Merriënboer, H.G. Schmidt, Memory load and the cognitive pupillary response in aging. Psychophysiology 41(2), 167–174 (2004)CrossRef P.W.M. Van Gerven, F. Paas, J.J.G. Van Merriënboer, H.G. Schmidt, Memory load and the cognitive pupillary response in aging. Psychophysiology 41(2), 167–174 (2004)CrossRef
39.
Zurück zum Zitat T. Van Gog, F. Paas, Instructional efficiency: Revisiting the original construct in educational research. Educ. Psychol. 43(1), 16–26 (2008)CrossRef T. Van Gog, F. Paas, Instructional efficiency: Revisiting the original construct in educational research. Educ. Psychol. 43(1), 16–26 (2008)CrossRef
40.
Zurück zum Zitat A. Schmeck, M. Opfermann, T. Van Gog, F. Paas, D. Leutner, Measuring cognitive load with subjective rating scales during problem solving: Differences between immediate and delayed ratings. Instr. Sci. 43(1), 93–114 (2015)CrossRef A. Schmeck, M. Opfermann, T. Van Gog, F. Paas, D. Leutner, Measuring cognitive load with subjective rating scales during problem solving: Differences between immediate and delayed ratings. Instr. Sci. 43(1), 93–114 (2015)CrossRef
41.
Zurück zum Zitat M.A. Khawaja, F. Chen, N. Marcus, Using language complexity to measure cognitive load for adaptive interaction design, in Proceedings of International Conference on Intelligent User Interfaces (IUI 2010), Hong Kong, China, 2010, pp. 333–336 M.A. Khawaja, F. Chen, N. Marcus, Using language complexity to measure cognitive load for adaptive interaction design, in Proceedings of International Conference on Intelligent User Interfaces (IUI 2010), Hong Kong, China, 2010, pp. 333–336
42.
Zurück zum Zitat B. Xie, G. Salvendy, Prediction of mental workload in single and multiple tasks environments. Int. J. Cogn. Ergon. 4(3), 213–242 (2000)CrossRef B. Xie, G. Salvendy, Prediction of mental workload in single and multiple tasks environments. Int. J. Cogn. Ergon. 4(3), 213–242 (2000)CrossRef
43.
Zurück zum Zitat P. Ayres, F. Paas, Cognitive load theory: New directions and challenges. Appl. Cogn. Psychol. 26(6), 827–832 (2012)CrossRef P. Ayres, F. Paas, Cognitive load theory: New directions and challenges. Appl. Cogn. Psychol. 26(6), 827–832 (2012)CrossRef
44.
Zurück zum Zitat P. Kirschner, P. Ayres, P. Chandler, Contemporary cognitive load theory research: The good, the bad and the ugly. Comput. Hum. Behav. 27(1), 99–105 (2011)CrossRef P. Kirschner, P. Ayres, P. Chandler, Contemporary cognitive load theory research: The good, the bad and the ugly. Comput. Hum. Behav. 27(1), 99–105 (2011)CrossRef
45.
Zurück zum Zitat E. Galy, M. Cariou, C. Mélan, What is the relationship between mental workload factors and cognitive load types? Int. J. Psychophysiol. 83(3), 269–275 (2012)CrossRef E. Galy, M. Cariou, C. Mélan, What is the relationship between mental workload factors and cognitive load types? Int. J. Psychophysiol. 83(3), 269–275 (2012)CrossRef
46.
Zurück zum Zitat K.E. DeLeeuw, R.E. Mayer, A comparison of three measures of cognitive load: Evidence for separable measures of intrinsic, extraneous, and germane load. J. Educ. Psychol. 100(1), 223–234 (2008)CrossRef K.E. DeLeeuw, R.E. Mayer, A comparison of three measures of cognitive load: Evidence for separable measures of intrinsic, extraneous, and germane load. J. Educ. Psychol. 100(1), 223–234 (2008)CrossRef
47.
Zurück zum Zitat J. Leppink, F. Paas, C.P.M. Van der Vleuten, T. Van Gog, J.J.G. Van Merriënboer, Development of an instrument for measuring different types of cognitive load. Behav. Res. Methods 45(4), 1058–1072 (2013)CrossRef J. Leppink, F. Paas, C.P.M. Van der Vleuten, T. Van Gog, J.J.G. Van Merriënboer, Development of an instrument for measuring different types of cognitive load. Behav. Res. Methods 45(4), 1058–1072 (2013)CrossRef
48.
Zurück zum Zitat S. Kalyuga, Cognitive load theory: How many types of load does it really need? Educ. Psychol. Rev. 23(1), 1–19 (2011)CrossRef S. Kalyuga, Cognitive load theory: How many types of load does it really need? Educ. Psychol. Rev. 23(1), 1–19 (2011)CrossRef
49.
Zurück zum Zitat A. Tricot, J. Sweller, Domain-specific knowledge and why teaching generic skills does not work. Educ. Psychol. Rev. 26(2), 265–283 (2014)CrossRef A. Tricot, J. Sweller, Domain-specific knowledge and why teaching generic skills does not work. Educ. Psychol. Rev. 26(2), 265–283 (2014)CrossRef
50.
Zurück zum Zitat H.-H. Choi, J.J.V. Merriënboer, F. Paas, Effects of the physical environment on cognitive load and learning: Towards a new model of cognitive load. Educ. Psychol. Rev. 26(2), 225–244 (2014)CrossRef H.-H. Choi, J.J.V. Merriënboer, F. Paas, Effects of the physical environment on cognitive load and learning: Towards a new model of cognitive load. Educ. Psychol. Rev. 26(2), 225–244 (2014)CrossRef
51.
Zurück zum Zitat F.G.W.C. Paas, J.J.G.V. Merriënboer, Instructional control of cognitive load in the training of complex cognitive tasks. Educ. Psychol. Rev. 6(4), 351–371 (1994)CrossRef F.G.W.C. Paas, J.J.G.V. Merriënboer, Instructional control of cognitive load in the training of complex cognitive tasks. Educ. Psychol. Rev. 6(4), 351–371 (1994)CrossRef
52.
Zurück zum Zitat S. Oviatt, Human-centered design meets cognitive load theory: Designing interfaces that help people think, in Proceedings of the 14th annual ACM international conference on Multimedia (MULTIMEDIA 2006), 2006 S. Oviatt, Human-centered design meets cognitive load theory: Designing interfaces that help people think, in Proceedings of the 14th annual ACM international conference on Multimedia (MULTIMEDIA 2006), 2006
53.
Zurück zum Zitat L. Nigay, J. Coutaz, A design space for multimodal systems: Concurrent processing and data fusion, in Proceedings of the INTERACT ’93 and CHI ’93 Conference on Human Factors in Computing Systems, New York, NY, USA, 1993, pp. 172–178 L. Nigay, J. Coutaz, A design space for multimodal systems: Concurrent processing and data fusion, in Proceedings of the INTERACT ’93 and CHI ’93 Conference on Human Factors in Computing Systems, New York, NY, USA, 1993, pp. 172–178
54.
Zurück zum Zitat M. Turk, Review article: Multimodal interaction: A review. Pattern Recogn. Lett. 36, 189–195 (2014)CrossRef M. Turk, Review article: Multimodal interaction: A review. Pattern Recogn. Lett. 36, 189–195 (2014)CrossRef
55.
Zurück zum Zitat N. Ruiz, F. Chen, S. Oviatt, Multimodal input, in Multimodal Signal Processing, ed. by J.-P. Thiran, F. Marqués, H. Bourlard (Elsevier, London, 2010) N. Ruiz, F. Chen, S. Oviatt, Multimodal input, in Multimodal Signal Processing, ed. by J.-P. Thiran, F. Marqués, H. Bourlard (Elsevier, London, 2010)
56.
Zurück zum Zitat S. Oviatt, P. Cohen, Perceptual user interfaces: Multimodal interfaces that process what comes naturally. Commun. ACM 43(3), 45–53 (2000)CrossRef S. Oviatt, P. Cohen, Perceptual user interfaces: Multimodal interfaces that process what comes naturally. Commun. ACM 43(3), 45–53 (2000)CrossRef
57.
Zurück zum Zitat S. Oviatt, Ten myths of multimodal interaction. Commun. ACM 42(11), 74–81 (1999)CrossRef S. Oviatt, Ten myths of multimodal interaction. Commun. ACM 42(11), 74–81 (1999)CrossRef
58.
Zurück zum Zitat S. Oviatt, R. Coulston, .R. Lunsford, When do we interact multimodally?: Cognitive load and multimodal communication patterns, in Proceedings of the 6th international conference on Multimodal interfaces (ICMI 2004), New York, USA, 2004 S. Oviatt, R. Coulston, .R. Lunsford, When do we interact multimodally?: Cognitive load and multimodal communication patterns, in Proceedings of the 6th international conference on Multimodal interfaces (ICMI 2004), New York, USA, 2004
59.
Zurück zum Zitat B.K. Britton, A. Tesser, Effects of prior knowledge on use of cognitive capacity in three complex cognitive tasks. J. Verbal Learn. Verbal Behav. 21, 421–436 (1982)CrossRef B.K. Britton, A. Tesser, Effects of prior knowledge on use of cognitive capacity in three complex cognitive tasks. J. Verbal Learn. Verbal Behav. 21, 421–436 (1982)CrossRef
60.
Zurück zum Zitat R. Brunken, J.L. Plass, D. Leutner, Direct measurement of cognitive load in multimedia learning. Educ. Psychol. 38(1), 53–61 (2003)CrossRef R. Brunken, J.L. Plass, D. Leutner, Direct measurement of cognitive load in multimedia learning. Educ. Psychol. 38(1), 53–61 (2003)CrossRef
61.
Zurück zum Zitat R. Brunken, S. Steinbacher, J.L. Plass, D. Leutner, Assessment of cognitive load in multimedia learning with dual-task methodology. Exp. Psychol. 49, 109–119 (2002)CrossRef R. Brunken, S. Steinbacher, J.L. Plass, D. Leutner, Assessment of cognitive load in multimedia learning with dual-task methodology. Exp. Psychol. 49, 109–119 (2002)CrossRef
62.
Zurück zum Zitat R. Brunken, J.L. Plass, D. Leutner, Assessment of cognitive load in multimedia learning with dual-task methodology: Auditory load and modality effects. Instr. Sci.: Int. J. Lear. Sci. 32(1), 115–132 (2004)CrossRef R. Brunken, J.L. Plass, D. Leutner, Assessment of cognitive load in multimedia learning with dual-task methodology: Auditory load and modality effects. Instr. Sci.: Int. J. Lear. Sci. 32(1), 115–132 (2004)CrossRef
63.
Zurück zum Zitat A. Baddeley, Working Memory (Oxford University Press, Oxford, 1986) A. Baddeley, Working Memory (Oxford University Press, Oxford, 1986)
64.
Zurück zum Zitat R. Brünken, T. Seufert, F. Paas, Measuring cognitive load, in Cognitive Load Theory, ed. by J.L. Plass, R. Moreno, R. Brünken, 1st edn. (Cambridge University Press, Cambridge/New York, 2010), pp. 181–202CrossRef R. Brünken, T. Seufert, F. Paas, Measuring cognitive load, in Cognitive Load Theory, ed. by J.L. Plass, R. Moreno, R. Brünken, 1st edn. (Cambridge University Press, Cambridge/New York, 2010), pp. 181–202CrossRef
65.
Zurück zum Zitat B. Park, R. Brünken, The rhythm method: A new method for measuring cognitive load—an experimental dual-task study. Appl. Cogn. Psychol. 29(2), 232–243 (2015)CrossRef B. Park, R. Brünken, The rhythm method: A new method for measuring cognitive load—an experimental dual-task study. Appl. Cogn. Psychol. 29(2), 232–243 (2015)CrossRef
66.
Zurück zum Zitat W.W. Wierwille, F.T. Eggemeier, Recommendations for mental workload measurement in a test and evaluation environment. Hum. Factors: J. Hum. Factors. Ergonomics. Soc. 35(2), 263–281 (1993) W.W. Wierwille, F.T. Eggemeier, Recommendations for mental workload measurement in a test and evaluation environment. Hum. Factors: J. Hum. Factors. Ergonomics. Soc. 35(2), 263–281 (1993)
67.
Zurück zum Zitat F. Chen, N. Ruiz, E. Choi, J. Epps, M.A. Khawaja, R. Taib, B. Yin, Y. Wang, Multimodal behavior and interaction as indicators of cognitive load. ACM Trans. Interact. Intell. Syst. 2(4), 22:1–22:36 (2012)CrossRef F. Chen, N. Ruiz, E. Choi, J. Epps, M.A. Khawaja, R. Taib, B. Yin, Y. Wang, Multimodal behavior and interaction as indicators of cognitive load. ACM Trans. Interact. Intell. Syst. 2(4), 22:1–22:36 (2012)CrossRef
68.
Zurück zum Zitat G.A. Miller, The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychol. Rev. 63(2), 81–97 (1956)CrossRef G.A. Miller, The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychol. Rev. 63(2), 81–97 (1956)CrossRef
69.
Zurück zum Zitat A. Heathcote, J.R. Coleman, A. Eidels, J.M. Watson, J. Houpt, D.L. Strayer, Working memory’s workload capacity. Mem. Cogn. 43(7), 973–989 (2015)CrossRef A. Heathcote, J.R. Coleman, A. Eidels, J.M. Watson, J. Houpt, D.L. Strayer, Working memory’s workload capacity. Mem. Cogn. 43(7), 973–989 (2015)CrossRef
70.
Zurück zum Zitat T. Van Zandt, How to fit a response time distribution. Psychon. Bull. Rev. 7(3), 424–465 (2000)CrossRef T. Van Zandt, How to fit a response time distribution. Psychon. Bull. Rev. 7(3), 424–465 (2000)CrossRef
71.
Zurück zum Zitat T.V. Zandt, J.T. Townsend, Designs for and analyses of response time experiments, in The Oxford Handbook of Quantitative Methods in Psychology: Foundations, 1st edn. (Oxford University Press, Oxford, 2013) T.V. Zandt, J.T. Townsend, Designs for and analyses of response time experiments, in The Oxford Handbook of Quantitative Methods in Psychology: Foundations, 1st edn. (Oxford University Press, Oxford, 2013)
72.
Zurück zum Zitat F.C. Donders, Over de snelheid van psychische processen [On the speed of mental processes], in Attention and performance II, Amsterdam: North-Holland (original work published 1868), 1969, pp. 92–120 F.C. Donders, Over de snelheid van psychische processen [On the speed of mental processes], in Attention and performance II, Amsterdam: North-Holland (original work published 1868), 1969, pp. 92–120
73.
74.
Zurück zum Zitat J.W. Houpt, L.M. Blaha, J.P. McIntire, P.R. Havig, J.T. Townsend, Systems factorial technology with R. Behav. Res. Methods 46(2), 307–330 (2014)CrossRef J.W. Houpt, L.M. Blaha, J.P. McIntire, P.R. Havig, J.T. Townsend, Systems factorial technology with R. Behav. Res. Methods 46(2), 307–330 (2014)CrossRef
75.
Zurück zum Zitat J.T. Townsend, G. Nozawa, Spatio-temporal properties of elementary perception: An investigation of parallel, serial, and coactive theories. J. Math. Psychol. 39(4), 321–359 (1995)CrossRefMATH J.T. Townsend, G. Nozawa, Spatio-temporal properties of elementary perception: An investigation of parallel, serial, and coactive theories. J. Math. Psychol. 39(4), 321–359 (1995)CrossRefMATH
76.
Zurück zum Zitat J.T. Townsend, M.J. Wenger, A theory of interactive parallel processing: New capacity measures and predictions for a response time inequality series. Psychol. Rev. 111(4), 1003–1035 (2004)CrossRef J.T. Townsend, M.J. Wenger, A theory of interactive parallel processing: New capacity measures and predictions for a response time inequality series. Psychol. Rev. 111(4), 1003–1035 (2004)CrossRef
77.
Zurück zum Zitat A.D. Baddeley, G.J. Hitch, Working memory, in The Psychology of Learning and Motivation: Advances in Research and Theory, ed. by G.A. Bower, vol. 8 (Academic, New York, 1974), pp. 47–89 A.D. Baddeley, G.J. Hitch, Working memory, in The Psychology of Learning and Motivation: Advances in Research and Theory, ed. by G.A. Bower, vol. 8 (Academic, New York, 1974), pp. 47–89
78.
Zurück zum Zitat A. Baddeley, Working memory: Looking back and looking forward. Nat. Rev. Neurosci. 4(10), 829–839 (2003)CrossRef A. Baddeley, Working memory: Looking back and looking forward. Nat. Rev. Neurosci. 4(10), 829–839 (2003)CrossRef
79.
Zurück zum Zitat A. Baddeley, The episodic buffer: A new component of working memory? Trends Cogn. Sci. 4(11), 417–423 (2000)CrossRef A. Baddeley, The episodic buffer: A new component of working memory? Trends Cogn. Sci. 4(11), 417–423 (2000)CrossRef
80.
Zurück zum Zitat A. Baddeley, Working memory: Theories, models, and controversies. Annu. Rev. Psychol. 63(1), 1–29 (2012)CrossRef A. Baddeley, Working memory: Theories, models, and controversies. Annu. Rev. Psychol. 63(1), 1–29 (2012)CrossRef
81.
Zurück zum Zitat P. Barrouillet, S. Bernardin, V. Camos, Time constraints and resource sharing in adults’ working memory spans. J. Exp. Psychol. Gen. 133(1), 83–100 (2004)CrossRef P. Barrouillet, S. Bernardin, V. Camos, Time constraints and resource sharing in adults’ working memory spans. J. Exp. Psychol. Gen. 133(1), 83–100 (2004)CrossRef
82.
Zurück zum Zitat N. Cowan, Attention and Memory: An Integrated Framework (Oxford University Press, Oxford, 1998)CrossRef N. Cowan, Attention and Memory: An Integrated Framework (Oxford University Press, Oxford, 1998)CrossRef
83.
Zurück zum Zitat N. Cowan, An embedded-processes model of working memory, in Models of Working Memory: Mechanisms of Active Maintenance and Executive Control (Cambridge University Press, Cambridge, 1999) N. Cowan, An embedded-processes model of working memory, in Models of Working Memory: Mechanisms of Active Maintenance and Executive Control (Cambridge University Press, Cambridge, 1999)
84.
Zurück zum Zitat J. Schweppe, R. Rummer, Attention, working memory, and long-term memory in multimedia learning: An integrated perspective based on process models of working memory. Educ. Psychol. Rev. 26(2), 285–306 (2014)CrossRef J. Schweppe, R. Rummer, Attention, working memory, and long-term memory in multimedia learning: An integrated perspective based on process models of working memory. Educ. Psychol. Rev. 26(2), 285–306 (2014)CrossRef
85.
Zurück zum Zitat C.L. Hull, Principles of Behavior (D. Appleton-Century Company, Incorporated, New York/London, 1943) C.L. Hull, Principles of Behavior (D. Appleton-Century Company, Incorporated, New York/London, 1943)
86.
Zurück zum Zitat J.T. Cacioppo, R.E. Petty, The need for cognition. J. Pers. Soc. Psychol. 42(1), 116–131 (1982)CrossRef J.T. Cacioppo, R.E. Petty, The need for cognition. J. Pers. Soc. Psychol. 42(1), 116–131 (1982)CrossRef
87.
Zurück zum Zitat P. Morgado, N. Sousa, J.J. Cerqueira, The impact of stress in decision making in the context of uncertainty. J. Neurosci. Res. 93(6), 839–847 (2015)CrossRef P. Morgado, N. Sousa, J.J. Cerqueira, The impact of stress in decision making in the context of uncertainty. J. Neurosci. Res. 93(6), 839–847 (2015)CrossRef
88.
Zurück zum Zitat R. Mayer, J.H. Davis, F.D. Schoorman, An integrative model of organizational trust. Acad. Manag. Rev. 20, 709–734 (1995) R. Mayer, J.H. Davis, F.D. Schoorman, An integrative model of organizational trust. Acad. Manag. Rev. 20, 709–734 (1995)
89.
Zurück zum Zitat D. Schmorrow, K. Stanney, Augmented Cognition: A Practitioner’s Guide (Human Factors and Ergonomics Society Press, Santa Monica, 2008) D. Schmorrow, K. Stanney, Augmented Cognition: A Practitioner’s Guide (Human Factors and Ergonomics Society Press, Santa Monica, 2008)
90.
Zurück zum Zitat K.T. Dirks, D.L. Ferrin, The role of trust in organizational settings. Organ. Sci. 12(4), 450–467 (2001)CrossRef K.T. Dirks, D.L. Ferrin, The role of trust in organizational settings. Organ. Sci. 12(4), 450–467 (2001)CrossRef
91.
Zurück zum Zitat D.M. Rousseau, S.B. Sitkin, R.S. Burt, C. Camerer, Not so different after all: A cross-discipline view of trust. Acad. Manag. Rev. 23(3), 393–404 (1998)CrossRef D.M. Rousseau, S.B. Sitkin, R.S. Burt, C. Camerer, Not so different after all: A cross-discipline view of trust. Acad. Manag. Rev. 23(3), 393–404 (1998)CrossRef
92.
Zurück zum Zitat B. Misztal, Trust in Modern Societies: The Search for the Bases of Social Order (Wiley, Oxford, 2013) B. Misztal, Trust in Modern Societies: The Search for the Bases of Social Order (Wiley, Oxford, 2013)
93.
Zurück zum Zitat A. Khawaji, F. Chen, N. Marcus, J. Zhou, Trust and cooperation in text-based computer-mediated communication, in Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration, New York, NY, USA, 2013, pp. 37–40 A. Khawaji, F. Chen, N. Marcus, J. Zhou, Trust and cooperation in text-based computer-mediated communication, in Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration, New York, NY, USA, 2013, pp. 37–40
Metadaten
Titel
Theoretical Aspects of Multimodal Cognitive Load Measures
verfasst von
Fang Chen
Jianlong Zhou
Yang Wang
Kun Yu
Syed Z. Arshad
Ahmad Khawaji
Dan Conway
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-31700-7_3

Neuer Inhalt