Skip to main content
Top
Published in: International Journal of Educational Technology in Higher Education 1/2020

Open Access 01-12-2020 | Review article

Technology-supported management education: a systematic review of antecedents of learning effectiveness

Authors: Fabian Alexander Müller, Torsten Wulf

Published in: International Journal of Educational Technology in Higher Education | Issue 1/2020

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper provides a systematic, multidisciplinary review of antecedents of the effectiveness of technology-supported management learning and highlights potential directions for future research. Passive knowledge acquisition in physical classrooms is no longer the hallmark of higher education. Instead, the introduction of new technologies allows for active knowledge construction in increasingly virtual spaces. Such changes in the learning environment affect the education of the managers of tomorrow. Nevertheless, research on technology-supported management learning and its implications for management educators is fragmented and inconsistent across research areas. This paper uses a systematic approach to structure and integrate results from the fields of educational psychology, educational technology, higher education, and management education. This allows us to derive a comprehensive overview of the antecedents of the effectiveness of technology-supported management learning from the various disciplines. Our work reveals several areas that require further investigation, including: (i) the best way to blend and flip formats for different management disciplines and content types, (ii) the selection, design, and richness of the technologies used, (iii) the instructor’s teaching style, including feedback and deliberate confusion, and (iv) learners’ affective states, such as their motivations and emotions, and the role of prior knowledge.
Notes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Introduction

Technology has reshaped management education—in contrast to the traditional format of passive knowledge acquisition in synchronous and analog classrooms, much of management education now involves active knowledge construction in increasingly asynchronous and virtual learning spaces (Arbaugh, 2000c; Garrison & Kanuka, 2004). The formerly prevalent objectivist model of learning assumes that there is an objective reality that can be transferred, which supports the traditional lecture format (Leidner & Jarvenpaa, 1995). In contrast, the constructivist model of learning posits several representations of reality, and assumes that students learn better when they construct knowledge themselves by actively engaging with and making sense of information (Arbaugh & Benbunan-Fich, 2006). The constructivist model is typically facilitated by technology. Sun, Tsai, Finger, Chen, and Yeh (2008) thus regard technology-supported management learning as the “paradigm of modern education.”
This technological penetration of management education has triggered a substantial amount of research into management learning beyond the traditional classroom (Arbaugh, 2014; Arbaugh & Duray, 2002; Redpath, 2012). Both conceptual and empirical work has been conducted in various disciplines. For instance, research has emerged in the fields of educational psychology (Leutner, 2014; Mayer, 2002; Moreno & Mayer, 2007; Park, Plass, & Brünken, 2014), educational technology (Alavi, 1994; Evans, 2008; Piccoli, Ahmad, & Ives, 2001; Selim, 2003, 2007; Sun et al., 2008), higher education (Liu, 2012; O’Neill & Sai, 2014; Snowball, 2014; Xu & Jaggars, 2014), and management education (Alavi & Gallupe, 2003; Arbaugh & Benbunan-Fich, 2006; Arbaugh, DeArmond, & Rau, 2013). According to Arbaugh et al. (2009), “the volume and quality of research in online and blended business education has increased dramatically during the past decade.”
However, the different research areas pursue different objectives and approaches. For example, educational psychologists, on the one hand, tend to follow a learner-centered approach: They investigate how learning occurs through the human cognitive architecture and they propose technical applications to facilitate related processes. Educational technology scholars, on the other hand, take a technology-centered approach in which they suggest pushing technological innovations into the classroom while expecting learners to adapt (Mayer, 2002). Moreover, the extant research shows that some antecedents of technology-supported management learning have similar effects across disciplines, while others lead to contradictory outcomes. Thus, the current state of the literature is highly fragmented and partially inconsistent. No literature review that integrates findings from the various fields, much less one with a dedicated focus on management education, is available.
Therefore, this paper addresses the widespread academic discourse on technology-supported management learning by systematically investigating the antecedents of that learning. As Buttner and Black (2014) note, “no single learning theory accounts for all aspects of learning.” Thus, we contrast and integrate prevailing concepts from educational psychology and educational technology research with central themes in the management education and higher education literature. In addition, this paper enriches established theories with more recent research topics, such as confusion and emotions (D’Mello, Lehman, Pekrun, & Graesser, 2014; Dindar & Akbulut, 2016; Knoerzer, Bruenken, & Park, 2016).
Our paper makes two contributions. First, by conducting a systematic, interdisciplinary review of the extant literature, we integrate the dispersed knowledge on the antecedents of the effectiveness of technology-supported management learning from the various disciplines. Second, we critically reflect on conceptual and empirical findings from prior work, and we derive an agenda for future research based on the identified commonalities, inconsistencies, and research gaps. On this basis, we encourage scholars to explore different ways of blending and flipping management learning environments to identify the ideal instruction formats for the different management disciplines and content types. This includes an in-depth study of the impact of collaboration and interaction. In addition, we ask researchers to examine different technology applications and related features to more systematically and effectively select and design learning technologies. We also emphasize the importance of additional research on instructors’ teaching styles in technology-supported management education, as instructors continue to play a critical but changing role. This examination includes feedback and deliberate confusion. Moreover, we call for more research on the prior knowledge and affective states of learners, particularly regarding motivation and emotions, which are still under-researched but can be expected to play an important mediating and/or moderating role in learning outcomes.

Background on the research topic

Management education research is a subdiscipline of the business sciences. According to Arbaugh and Hwang (2015), it can be defined as “formal business and management education learning in the context of higher education in academic institutions.” Even though precursors of the Journal of Education for Business date back to 1928, today’s predominant publication outlet, the Academy of Management Learning and Education, only came into existence in 2002. The most-cited articles in this field were published during the last 20 years (Arbaugh & Hwang, 2015). Hence, management education is an emerging research area.
One stream of research in the management education literature investigates the importance of information technologies and attempts to bring them into the management learning space (Arbaugh, 2000b; Arbaugh & Duray, 2002). Publications include narratives by instructors, examinations of learner perceptions, and experiments with different formats and technologies. Experimental conditions range from technological advances in traditional lectures (Alavi, 1994) to flipped environments (Lancellotti, Thomas, & Kohli, 2016) to full online programs (Eom, Wen, & Ashill, 2006). Given the limited history of the field of management education (Arbaugh & Hwang, 2015) and the lack of dedicated scholars of management learning and education (Arbaugh, 2016), the respective studies build on research from related disciplines, such as educational psychology (Mayer, 2002; Moreno & Mayer, 2007), education technology (Selim, 2007; Sun et al., 2008), and higher education (Liu, 2012; Snowball, 2014).
Educational psychology research follows a learner-centered approach (Mayer, 2002). It assumes that the human system for information processing remains constant in different learning environments (Mayer, 2003). Therefore, educational psychologists study how learning occurs in the human cognitive system, explore the cognitive processes behind selected learner characteristics, and propose technical applications to facilitate these processes. Research results indicate that cognitive and affective factors, such as learner attitude (Scheiter & Gerjets, 2007), motivation (Mayer, 2014), metacognition (Moreno & Mayer, 2007), and emotions (Leutner, 2014), as well as prior knowledge (Seufert, 2003) are important for learning effectiveness independent of the learning environment. These learner characteristics can partially be influenced by the instructor’s teaching style, guidance and feedback behavior (D’Mello et al., 2014; Mayer & Moreno, 2003; Park, Moreno, Seufert, & Brünken, 2011).
Educational technology research, on the other hand, follows a technology-centered approach, which attempts to bring technological innovations into the classroom, while learners are expected to adapt (Mayer, 2002). It primarily examines the role of technology characteristics based on the technology acceptance model (TAM) developed by Davis (1986) and the task-technology fit (TTF) proposed by Goodhue and Thompson (1995). Frequently analyzed factors resulting from these concepts are perceived ease of use, perceived usefulness, technology quality, technology reliability, and technology richness (Huang, 2014; McGill & Klobas, 2009; Selim, 2003; Song, Singleton, Hill, & Koh, 2004). The effects of these technology characteristics are further differentiated based on learner characteristics, such as demographics, prior experiences, and motivation (López-Pérez, Pérez-López, & Rodríguez-Ariza, 2011; Woo, 2014), instructor characteristics, such as attitude, control over the technology, and teaching style (Selim, 2007; Webster & Hackley, 1997), and format characteristics, such as flexibility, interaction, and assessment diversity (Concannon, Flynn, & Campbell, 2005; Sun et al., 2008).
Higher education research on technology-supported learning environments builds on these two approaches and examines learners’ perceptions and their engagement with different formats of instruction, i.e., different levels of technology use in higher education (Carini, Kuh, & Klein, 2006; Ituma, 2011; Zhao & Kuh, 2004). This includes an investigation of the opinions of learners who are in favor of or against technology-supported learning (O’Neill & Sai, 2014; Snowball, 2014). Furthermore, scholars examine the impact of different learner characteristics, such as demographics, motivation, and learning approaches (Haggis, 2009; Xu & Jaggars, 2014), format characteristics, such as flexibility and community (Reed & Reay, 2015; Zhao & Kuh, 2004), and technology characteristics, such as technology selection and quality (Kintu, Zhu, & Kagambe, 2017). In addition, higher education research places particular emphasis on student engagement (Carini et al., 2006; Ituma, 2011).
Across these disciplines, online activity (Asarta & Schmidt, 2013; Fritz, 2011), technology self-efficacy (Piccoli et al., 2001; Webster & Hackley, 1997), cognitive processing (Mayer, 2003; Mayer & Moreno, 2003), perceived learning (Arbaugh, 2000a; Evans, 2008), test performance (Arbaugh, 2000c; Krentler & Willis-Flurry, 2005), satisfaction (Concannon et al., 2005; Wu, Tennyson, & Hsia, 2010), and dropout rates (Deschacht & Goeman, 2015; López-Pérez et al., 2011) are commonly used as measures of effectiveness.
The brief overview of research activities in the fields of management education, educational psychology, educational technology, and higher education highlights that the antecedents of technology-supported management learning effectiveness can be classified into four dimensions: learner, instructor, format, and technology characteristics. These dimensions are illustrated in Fig. 1 and serve as the basis for our work.

Methodology

The search for relevant literature was carried out in three steps as illustrated in Fig. 2. First, we identified potentially relevant publications through a database search and snowballing. Second, those publications were prioritized by skimming abstracts and full texts. Third, prioritized publications were classified according to their analytical focus.
In the first step, we conducted a keyword search for leading peer-reviewed publications to ensure the relevance and quality of potential sources. We searched the EBSCO Academic Search Premier and EBSCO Business Source Premier databases for the following journals in the educational psychology, educational technology, higher education, and management education fields: Academy of Management Learning and Education, British Journal of Educational Technology, Computers and Education, Decision Sciences Journal of Innovative Education, Educational Psychologist, Educational Psychology Review, Educational Technology Research and Development, Higher Education, Information Systems Research, Innovative Higher Education, International Journal of Management Education, Internet and Higher Education, Journal of Computer Assisted Learning, Journal of Education for Business, Journal of Educational Psychology, Journal of Educational Technology and Society, Journal of Higher Education, Journal of Management Education, Learning and Instruction, Management Learning, MIS Quarterly, Research in Higher Education, and Studies in Higher Education. We then searched the abstracts in these journals for keywords related to student learning (i.e., education, learner, learning, student), learning effectiveness (i.e., achievement, effective, effectiveness, outcome, performance, success), technology support (i.e., computer, digital, electronic, internet, multimedia, online, technology), and management (i.e., accounting, business, economics, finance, management, marketing). Literature with abstracts containing any of the following terms was excluded, as it typically does not focus on technology-supported management education: children, knowledge management, machine learning, organizational learning, school. In addition, we searched the reference lists of the identified articles to uncover any frequently cited scholars and publications that had not yet been found. We repeated this process several times. A total of 317 potentially relevant publications were identified.
In the second step, the abstracts of the identified publications were reviewed to determine whether the findings were related to this paper’s objective. Papers had to meet five criteria for inclusion in our review: investigate human learning rather than organizational learning, study learning effectiveness, go beyond the traditional lecture mode to take technology support into account, focus on higher education situations in which management is taught, and enable a transfer of findings to management education if the findings were not already related to management. If the abstracts appeared to indicate that the focal paper was insufficient for evaluation, full texts were searched. As a result, we selected 79 publications for this review.
In the third step, the selected publications were classified for a detailed review. Based on their analytical focus, the articles were assigned to one or more of the previously identified dimensions of antecedents of the effectiveness of technology-supported management learning: learner, instructor, format, and technology. The selected publications and their key findings are listed in Table 1.
Table 1
Overview of Findings from the Extant Literature
Author
Method
Sample
Dimension
Selected findings
Alavi (1994)
Empirical
79 treatment, 48 control students (MBA)
Format, technology
Computer-mediated collaborative learning increases skill development, perceived and actual learning, and satisfaction.
Arbaugh (2000a)
Empirical
97 MBA students
Learner, instructor, format, technology
Instructor efforts to create an interactive environment (i.e., interaction ease and emphasis, classroom dynamics) predict perceived internet-based learning. Technology features (i.e., ease of use, usefulness), student characteristics (i.e., gender, age, prior experience, time online), and flexibility (i.e., course flexibility, program flexibility) are not significant.
Arbaugh (2000b)
Empirical
111 MBA students in 5 courses
Format, technology
Technology flexibility and an interactive environment are more important for learner satisfaction than the ease or frequency with which the medium can be used.
Arbaugh (2000c)
Empirical
27 treatment, 33 control students (MBA)
Format, technology
Internet-based courses do not diminish learning and lead to increased female participation in class discussions.
Arbaugh (2008)
Empirical
656 students in 55 MBA courses
Learner, instructor, format, technology
The Community of Inquiry framework (i.e., social, teaching, and cognitive presence) predicts perceived online learning and satisfaction with the delivery medium. Gender affects perceived learning. Gender, semester, and number of prior online courses predict satisfaction.
Arbaugh (2014)
Review
n/a
Format, technology
Learner control and group collaboration enhance learning in blended environments.
Arbaugh and Benbunan-Fich (2006)
Empirical
579 MBA students in 40 course sections
Instructor, format
Collaborative online learning results in higher perceived learning and satisfaction than individual online learning, independent of the teaching approach. Group learning is positively moderated by objectivist teaching (i.e., knowledge transmission), while individual learning is positively moderated by constructivist teaching.
Arbaugh and Duray (2002)
Empirical
120 MBA students
Format, technology
Perceived web-based learning and satisfaction are positively affected by flexibility and negatively affected by class size. Prior online learning experience influences satisfaction.
Arbaugh et al. (2009)
Review
n/a
Learner, instructor, format, technology
Online courses are at least comparable to classroom courses with respect to learning outcomes. Antecedents of learning effectiveness differ across business disciplines.
Arbaugh and Rau (2007)
Empirical
575 MBA students in 40 course sections
Format, technology
Different management disciplines cease to be significant predictors of perceived online learning when accounting for structural (i.e., class size, media variety, exams, projects) and behavioral (i.e., interaction with peers, instructor, interface) characteristics. However, differences among disciplines remain significant predictors of satisfaction. Some characteristics predict satisfaction and outcomes in opposite directions (e.g., media variety, peer interaction).
Asarta and Schmidt (2013)
Empirical
179 students in 3 course sections
Learner, technology
Timing and regularity of online access predict student performance, while number and length of access do not.
Asarta and Schmidt (2017)
Empirical
347 students across 4 treatment groups, 257 students across 3 control groups
Learner
Previously weak students perform better in traditional environments, while previously strong students perform better in blended environments. The environment does not matter for average students.
Beege, Schneider, Nebel, and Rey (2017)
Empirical
88 mostly undergraduate students across 4 treatment groups
Instructor, technology
Educational videos with a frontal (rather than lateral) instructor orientation positively influence retention, as para-social interaction may trigger beneficial affective states and deeper cognitive processing. Instructor proximity does not affect learning.
Buttner and Black (2014)
Empirical
82 treatment, 64 control students
Learner, format, technology
Implementation of an online learning system improves test results. Neither an additional test nor more time invested moderate outcomes.
Concannon et al. (2005)
Empirical
600 undergraduate students
Learner, instructor, format
Preferred educational resources, attitudes toward computers, study patterns, and career plans affect e-learner satisfaction. However, the main antecedents are peer interaction and instructor support.
D’Mello et al. (2014)
Empirical
Study 1: 63 undergraduate students; Study 2: 76 undergraduate students
Learner, format
Deliberate confusion positively affects actual learning. Prior knowledge shows small moderation effects.
Daspit and D’Souza (2012)
Empirical
203 undergraduate students
Format, instructor
In a wiki environment, teaching and social presence affect cognitive presence, which confirms that the instructor retains an important role in technology-mediated settings.
Demetriadis, Papadopoulos, Stamelos, and Fischer (2008)
Empirical
Study 1/Study 2: 8 treatment, 8 control undergraduate students
Learner, instructor, format
Scaffolding (e.g., via appropriate questioning) positively influences knowledge acquisition and transfer in a technology-enhanced environment. Learners with critical thinking skills benefit the most from scaffolding.
Deschacht and Goeman (2015)
Empirical
1883 undergraduate students
Format
Blended environments lead to increased dropout rates and better exam performance.
Dindar and Akbulut (2016)
Empirical
572 undergraduate students across 7 treatment conditions
Learner
Concurrent multitasking and daily media exposure negatively affect retention. Concurrent multitasking impedes topic interest. Sequential multitasking, digital device experience, and daily multitasking habits are not related to retention.
Eid and Al-Jabri (2016)
Empirical
203 undergraduate and 105 graduate students
Format, technology
Chatting, online discussions, and file sharing predict knowledge sharing, which in turn predicts perceived learning. Enjoyment and entertainment also predict learning.
Eom and Ashill (2018)
Empirical
305 undergraduate and 67 graduate students
Learner, instructor, format
Six interdependent factors (i.e., course-design quality, instructor, student motivation, student-student dialog, student-instructor dialog, and self-regulated learning) explain perceived e-learning, which predicts satisfaction.
Eom et al. (2006)
Empirical
397 graduate and undergraduate students
Learner, instructor, format
While course structure, instructor feedback, self-motivation, learning style, interaction, and instructor facilitation affect satisfaction, only instructor feedback and learning style directly predict perceived e-learning. Satisfaction also predicts perceived e-learning.
Evans (2008)
Empirical
196 undergraduate students
Technology
For review, podcasts are superior to textbooks or student notes in terms of time required and perceived learning.
Fritz (2011)
Empirical
Students in 131 courses
Learner, technology
Students who are more active in the learning management system earn higher grades.
Fryer and Bovee (2016)
Empirical
975 undergraduate students
Learner, instructor
Instructor support has direct and indirect effects on learner motivation. Effort beliefs predict task value and ability beliefs, which predict e-learning completion.
Garrison and Kanuka (2004)
Review
n/a
Format
Communities of Inquiry (i.e., cognitive, social, and teaching presence) are relevant for both face-to-face and online settings. Blended environments can enhance meaningful learning.
Grabe and Christopherson (2008)
Empirical
329 undergraduate students
Learner, technology
The use of online resources and class attendance is positively related to exam performance. Online resources may compensate for a lack of class attendance.
Guo, Kim, and Rubin (2014)
Empirical
6.9 million sessions across 4 edX courses, interviews with 6 edX staff
Instructor, technology
Shorter videos are more engaging. Videos with a personal feel can be more engaging than high-quality studio recordings. Informal videos in which the speaker is visible are more engaging than slides alone. Instructors who speak faster and with enthusiasm are more engaging.
Hazari, CO’M, and Rutledge (2013)
Empirical
102 undergraduate students
Format, technology
Blogs can improve outcomes by fostering deeper learning and engagement in an interactive environment. Peer interaction can be used as part of constructive feedback and self-evaluation.
Huang (2014)
Empirical
389 undergraduate students
Learner, technology
Perceived usefulness and playfulness are related to mobile learning satisfaction, which in turn predicts the intent to continue. Resistance to change has a minor influence on satisfaction. Self-management moderates the relationships between perceived usefulness, playfulness, and resistance to change and satisfaction as well as the relationship between satisfaction and the intent to continue.
Hwang and Arbaugh (2006)
Empirical
196 undergraduate students
Learner, technology
Discussion board feedback-seeking behaviors are related to actual learning if triggered by a competitive attitude (i.e., preventing others from getting ahead of oneself or personal diligence to get ahead of others). Traditional feedback-seeking measures of asking the instructor or peers do not have a positive effect on learning performance.
Kember, McNaught, Chong, Lam, and Cheng (2010)
Empirical
595 students
Technology
Features that promote constructive dialogue and interactive activities encourage deeper learning and enhance understanding of contents.
Kizilcec, Bailenson, and Gomez (2015)
Empirical
Study 1: 2951 participants; Study 2: 12,468 participants
Instructor, technology
Videos in which the instructor can be seen need to balance the increased extraneous load with gains from social and other nonverbal cues. When the instructor is visible, the cognitive load and perceived social presence increase, but learning outcomes and attrition remain constant. There is no “one-size-fits-all” approach.
Knoerzer et al. (2016)
Empirical
75 students across 3 treatment groups
Learner, format
Negative emotions positively affect online learning, perhaps due to more detailed information processing. Positive emotions negatively affect learning, perhaps because they distract from the material. Emotions do not influence motivation.
Kreijns, Kirschner, and Vermeulen (2013)
Conceptual
n/a
Format
Sociability, social space, and social presence determine social interaction, which predicts learning.
Krentler and Willis-Flurry (2005)
Empirical
549 undergraduate students
Learner, technology
Online discussion boards enhance student learning. The relationship between technology usage and learning is moderated by student major (i.e., marketing and computer information systems) and total amount of internet use (i.e., university and private use).
Lancellotti et al. (2016)
Empirical
247 treatment, 232 control undergraduate students
Technology
Watching a set of short, concept-focused videos improves exam scores. Gender and ethnicity do not moderate this effect.
Liu (2012)
Empirical
11,351 undergraduate and graduate students
Format
Motivation for taking a course, students’ class status, and instructors’ academic rank have significant impacts on distance learning.
López-Pérez et al. (2011)
Empirical
985 students in 17 groups
Learner, format
Blended environments reduce dropout rates and improve exam performance. Learning depends on motivation, age, prior experience, and class attendance for both face-to-face and online elements. Gender, perceived utility, and satisfaction do not predict learning.
Macfadyen and Dawson (2010)
Empirical
118 undergraduate students in 5 classes
Learner, technology
15 variables tracked by the learning management system predict actual learning. They correctly predict 81% of failing students. Key variables, such as number of contributions, mails sent, and completed assessments, explain more than 30% of the variance in final grades.
Markel (1999)
Review
n/a
Format, instructor
The literature offers negative descriptions of teacher-centered lectures, which can scare away potential teachers. The false dichotomy between boring lecturers and exciting distance educators inaccurately suggests that the technology, not the teacher, makes a good course.
Mayer (2002)
Review
n/a
Format
Nine instructional design principles affect cognitive processing: multimedia, spatial contiguity, temporal contiguity, coherence, modality, redundancy, pretraining, signaling, and personalization.
Mayer, Dow, and Mayer (2003)
Review
n/a
Format
Four methods foster cognitive processing and, thereby, learning across media. The multimedia effect combines words and pictures, the coherence effect excludes extraneous material, the spatial contiguity effect places text next to corresponding pictures, and the personalization effect applies a less formal presentation style.
Mayer and Chandler (2001)
Empirical
Study 1: 30 undergraduate students; Study 2: 29 undergraduate students (2 treatment groups in both studies)
Format
Presenting information in separate parts allows learners to build multiple mental representations that can be integrated when watching the parts or the entire presentation again (i.e., partial revision). Learner control over pace leads to skipping of sections (i.e., learners end up with shorter parts), which benefits cognitive processing.
Mayer et al. (2003)
Empirical
Study 1: 52 students across 2 treatment groups; Study 2: 78 students across 4 treatment groups; Study 3: 54 students across 2 treatment groups; Study 4: 39 students across 2 treatment groups
Format
Students learn better if animations are complemented with spoken language rather than printed text (i.e., modality principle), if they are able to control the pace and order of the presentation (i.e., interactivity principle), and if they answer conceptual questions while learning (i.e., self-explanation principle). Complementing narrated text with the instructor’s image does not enhance actual learning due to the additional extraneous load (i.e., presence principle).
Mayer and Moreno (2003)
Conceptual
n/a
Format
Cognitive load is central to multimedia design. Strategies such as off-loading, segmenting, pretraining, weeding (i.e., cutting into parts), signaling, aligning, eliminating redundancy, synchronizing, and individualizing diminish extraneous load and free up capacity for germane load.
McGill and Klobas (2009)
Empirical
267 students
Technology
Task-technology fit (TTF) directly and indirectly predicts perceived learning through attitude toward technology use and actual technology use. The direct effect on actual learning is marginal. TTF also predicts expected consequences of technology use but these are not related to actual technology use. Instructor norms predict technology use. Perceived learning does not predict actual learning.
McLaren (2004)
Empirical
208 undergraduate students in 5 courses, 2 treatment types each
Format
While online delivery increases dropout rates, actual learning is independent of the format of instruction.
Moreno (2006)
Review
n/a
Format, technology
The modality principle (i.e., combination of visual and audio) moderates learning across media. A method that has learning benefits in a lower technology environment also supports learning with higher technologies. The latter does not have additional learning benefits. A “media-enables-method” hypothesis is derived (as opposed to “method-affects-learning” and “media-affects-learning”).
Moreno and Mayer (2007)
Review
n/a
Learner, format
Cognitive learning theories should account for learner motivation, metacognition, and prior knowledge. Design principles for interactive multimedia environments include guidance, reflection, feedback, control, and pretraining, as they encourage relevant and/or reduce extraneous cognitive load.
Nemanich, Banks, and Dusya (2009)
Empirical
149 undergraduate students across 2 treatment groups
Learner, instructor, format
Perceived instructor expertise, content relevance, and social richness enhance student enjoyment. Perceived confidence in instructor expertise and content relevance also strengthen the understanding of course concepts. Enjoyment is positively associated with learning performance in the classroom, while student ability is positively associated with learning performance online.
Nihalani, Mayrath, and Robinson (2011)
Empirical
Study 1: 42 students across 2 treatment groups, 24 control students (“novice” undergraduates); Study 2: 42 students across 2 treatment groups, 20 control students (“expert” undergraduates)
Learner, instructor
Learners with little prior knowledge benefit more from individual feedback than from collaboration with other novices. For students with high prior knowledge, individual feedback may inhibit learning and reverse the benefits of expertise.
O’Flaherty and Phillips (2015)
Review
n/a
Format
There is no “one-size-fits-all” approach to flipped learning, but core features include content in advance, educator awareness of students’ understanding, and higher-order learning during classes.
O’Neill and Sai (2014)
Empirical
48 students
Format
Respondents believe they learn better face-to-face. They are aware of the greater risk of failure or dropout in online courses.
Owston, York, and Murtha (2013)
Empirical
577 students in 11 courses
Format
High achievers are most satisfied with blended courses, would take one again, and prefer them to fully face-to-face or online courses. They also find blended courses more convenient engaging, and feel they learn key concepts better in blended courses than in traditional face-to-face courses.
Palocsay and Stevens (2008)
Empirical
327 undergraduate students across 4 treatment groups
Learner, instructor, technology
Teacher experience and student academic competence predict actual learning. The specific technology used for web-based homework does not affect learning.
Piccoli et al. (2001)
Empirical
70 students across 2 treatment groups, 76 students across 2 control groups (all undergraduate)
Learner, format, technology
Actual learning in virtual versus traditional environments is similar. Hence, the increased learner control in the virtual environment does not benefit learning. Satisfaction in the virtual environment is even lower. Only computer self-efficacy is higher.
Plass, Heidig, Hayward, Homer, and Um (2014)
Empirical
Study 1/Study 2: 121/103 graduate students across 4 treatment conditions
Learner, format
Distinct choices and combinations of instructional design features (e.g., colors, shapes) can induce positive emotions, which predict comprehension and knowledge transfer in multimedia learning.
Redpath (2012)
Review
n/a
Format, technology
Online delivery provides sufficient interaction, collaboration, and learning outcomes to support a quality business education.
Scheiter and Gerjets (2007)
Review
n/a
Learner, format, technology
Self-controlled multimedia environments are well suited for improving learning among students with high prior knowledge, better self-regulatory skills, and more positive attitudes.
Selim (2003)
Empirical
403 undergraduate students
Technology
Usefulness and ease of use predict acceptance and use of a course website. Ease of use is mainly mediated by usefulness.
Selim (2007)
Empirical
538 undergraduate students
Learner, instructor, format, technology
Eight determinants of e-learning satisfaction across four categories: instructor characteristics (attitude toward and control of technology, teaching style), student characteristics (motivation and technical competency, interactive collaboration, course content and design), technology (ease of access, infrastructure), and university support.
Seufert (2003)
Empirical
86 students across 2 treatment groups and one control group
Learner, instructor
The effect of help depends on learners’ prior knowledge. In cases of low prior knowledge, help negatively effects comprehension and recall performance. For medium prior knowledge, directive (as opposed to non-directive) help enhances both recall and comprehension due to its summarizing and repeating function. In cases of high prior knowledge, help barely affects learning.
Sloan and Lewis (2014)
Empirical
70 undergraduate students in 2 course sections
Learner, technology
Access to lecture-capture videos is associated with higher exam scores, even after controlling for previous exam performance.
Snowball (2014)
Empirical
50 undergraduate students
Format, technology
Partially replacing lectures with online activities and resources improves actual learning. More active online resources (e.g., multiple-choice questions) are most beneficial for student performance. Some essentially passive activities (e.g., short online lectures, mini-movies) may be useful for demonstrating how to explain and apply concepts.
Solimeno, Mebane, Tomai, and Francescato (2008)
Empirical
82 treatment students, 88 control students (all graduate)
Learner, instructor, technology
Technology improves perceived and actual learning among students with low anxiety, high problem-solving efficacy, and time-management problems. Tutor characteristics do not influence learning.
Song et al. (2004)
Empirical
76 graduate students (all participated in a survey, 14 were also interviewed)
Learner, format
Course design, learner motivation, time management, and comfort with the technology affect perceived online learning. Technical problems, a lack of community, time constraints, and difficulty in understanding the course objectives are challenges.
Sun et al. (2008)
Empirical
295 students
Learner, instructor, format, technology
E-learner satisfaction is affected by learner computer anxiety, instructor attitude toward e-learning, course flexibility, course quality, perceived usefulness of e-learning, perceived ease of use, and diversity in assessments. Learners’ attitude toward computers, learners’ internet self-efficacy, timeliness of instructors’ responses, technology quality, internet quality, and perceived interaction with others do not predict satisfaction.
Terpend, Gattiker, and Lowe (2014)
Empirical
180 undergraduate students in 6 course sections
Technology
Perceived ease-of-use and price predict e-textbook adoption. Perceived usefulness, internet self-efficacy, and environmental concerns are not significant. The grades of e-textbook adopters and hardcopy users do not differ.
Um, Plass, Hayward, and Homer (2012)
Empirical
118 undergraduate students across 4 treatment groups
Learner, format
Positive emotional design negatively influences perceived task difficulty and positively affects motivation. It promotes comprehension, transfer, and satisfaction. Emotional design does not increase extraneous cognitive processing.
Volery and Lord (2000)
Empirical
47 students
Learner, instructor, format, technology
Technology (ease of access and navigation, interface design, interaction), instructor (attitude toward students, technology control/technical competence, teaching style/interaction), and learners’ prior technology experience predict perceived learning. Internet access at home, study program, country of origin, and gender are not significant.
Walker, Curren, Kiesler, Lammers, and Goldenson (2013)
Empirical
516 students
Format, technology
Peer networking via discussion boards leads to better performance. Reading discussions and posting improve final grades.
Webster and Hackley (1997)
Empirical
247 mainly graduate distance-learning students
Learner, instructor, format, technology
Medium richness relates to all perceived outcome variables. Other important antecedents include technology reliability, technology quality, instructors’ attitudes, teaching style, instructors’ control over the technology, number of student locations, students’ comfort with their images on screen, and classmates’ attitudes.
Woo (2014)
Empirical
63 undergraduate students
Learner
Motivation and cognitive processing predict actual online learning.
Wu et al. (2010)
Empirical
212 e-learning participants
Learner, format, technology
Computer self-efficacy, system functionality, content features, and interaction affect performance expectations. Interaction also affects the learning climate. Performance expectations and the learning climate affect satisfaction with blended environments.
Xu and Jaggars (2014)
Empirical
More than 40,000 students
Learner, technology
All types of students suffer in online courses. Those exhibiting the most decline are males, younger students, black students, and students with lower GPAs. Controlling for individual and peer effects as well as disciplines shows the widest performance gaps.
Yourstone, Kraye, and Albaum (2008)
Empirical
190 undergraduate students in 4 course sections across 2 treatment types
Technology
Immediate feedback technologies, such as clickers, have a positive impact on actual learning.
Zacharis (2015)
Empirical
134 undergraduate students
Format, technology
Four out of 29 system measures predict 52% of the variance in final grades: reading and posting messages, content creation, quiz efforts, and number of files viewed.

Antecedents of effectiveness of technology-supported management learning

Technology characteristics

The integration of technologies into learning environments has been studied for about 30 years. Davis (1986) developed the first version of the technology acceptance model (TAM) to examine antecedents of a technology’s acceptance. He proposed that the capabilities of a technology trigger learners’ motivation to use it, which in turn leads to actual use. More specifically, the features of a technology are assumed to affect perceived ease of use and perceived usefulness, which then affect attitudes toward using that technology and, thus, actual use. Although this model is not explicitly tailored to learning, it has evolved as a basis for educational technology research. Several studies of technology-supported management learning show that perceived ease of use and perceived usefulness affect satisfaction but do not directly predict perceived learning (Arbaugh, 2000a, 2000b; Huang, 2014). Terpend et al. (2014) find that perceived ease of use predicts technology adoption. Selim (2003) also provides evidence that perceived ease of use and usefulness predict technology acceptance, and reveals that ease of use is mostly mediated by usefulness. Sun et al. (2008) conclude that ease of use enables e-learners to focus on the content rather than the technology.
Goodhue and Thompson (1995) introduce task-technology fit (TTF) and argue that “for an information technology to have a positive impact on individual performance, the technology must be utilized and must be a good fit with the tasks it supports.” Related antecedents of technology-supported management learning effectiveness that are frequently analyzed include technology quality and technology reliability. In an early experiment with synchronous technology-supported distance learning based on online lectures and videos, Webster and Hackley (1997) find that both variables influence attitude toward the format and the technology, and that technology quality also influences the relative advantage of the format (i.e., perceived learning). They argue that reliable, efficient, and effective technology interfaces promote learner motivation, while technical complications have the opposite effect. However, they do not find relationships with involvement and participation, cognitive engagement, technology-self-efficacy, or usefulness of the technology. Song et al. (2004) confirm that technical problems are perceived as disadvantages for online learning. Sun et al. (2008) examine technology and internet quality in e-learning but find no effects on the satisfaction of management students. Notably, internet quality may be taken for granted. McGill and Klobas (2009) examine the role of learning management systems and provide empirical evidence that TTF strongly influences perceived learning and weakly affects actual learning. They also show an indirect relationship between TTF and perceived learning through learners’ attitudes toward technology utilization and actual use. Interestingly, they also reveal an effect of TTF on the expected consequences of technology use, although this does not affect actual usage.
Webster and Hackley (1997) note that technology richness has a positive impact on involvement and participation, cognitive engagement, technology self-efficacy, perceived usefulness, attitudes toward technology and format, and perceived learning. They argue that technology richness supports the accessibility of instructors and their feedback, which moderates learner motivation, thereby predicting technology use and perceived learning. Yourstone et al. (2008) state that immediate feedback technologies, such as clickers, can have a positive impact on learning outcomes. Work by Snowball (2014) confirms that passive online activities, such as videos, can be useful for introducing new concepts, while more active components, such as quizzes, are more beneficial for learning. Sloan and Lewis (2014) suggest that lecture-capture videos are related to higher exam scores. Kember et al. (2010) find that technological features that promote constructive dialogue and interactive learning improve understanding. Volery and Lord (2000) and Wu et al. (2010) note that the design and functionality of a learning management system predict perceived learning. Arbaugh and Rau (2007) investigate online learning with different systems and, interestingly, find a negative relationship between technology variety and perceived learning but a positive relationship between technology variety and satisfaction. In addition, Huang (2014) identifies a positive relationship between technology playfulness and satisfaction in a mobile learning environment. He finds that learners’ self-management skills moderate the effects of usefulness and playfulness on satisfaction. These technology-related antecedents of the effectiveness of technology-supported management learning are summarized in Fig. 3.

Format characteristics

While the format of instruction has traditionally been based on the physical classroom, the advent of technologies in management education allows for the emergence of new settings. Higher education research proposes a blended learning environment that is independent from the technology employed. According to Garrison and Kanuka (2004), this format is an “integration of face-to-face and online learning experiences – not a layering of one on top of the other.” López-Pérez et al. (2011) show that blended environments that combine face-to-face classes with online activities (e.g., crosswords, matching, fill in the blank, multiple-choice tests, wikis, forums) reduce dropout rates and improve exam performance. In line with TAM, they show that the perceived utility of online learning is correlated with the motivation generated by the technology, which in turn predicts satisfaction. However, they find that actual learning mainly depends on variables unrelated to blended environments, such as learners’ age, class attendance, or prior experiences—perceived utility and satisfaction do not predict actual learning. Notably, according to Grabe and Christopherson (2008), a lack of class attendance may be offset through online resources. Deschacht and Goeman (2015) find better exam performance for blended environments that integrate self-study, online collaboration, and classroom teaching. However, they also find that these environments are associated with higher dropout rates. They argue that the learning effect may be subject to survivorship bias. McLaren (2004) demonstrates that persistence in online delivery is significantly lower, while learning performance is independent of the format.
Although blended learning environments capture the benefits of technological innovations, such as flexibility in terms of time and place and learner control over pace and content, they also capture the benefits of physical classrooms (i.e., personal interaction through collaboration and community) (Arbaugh, 2014; Concannon et al., 2005). Educational technology research has found that course flexibility leads to e-learning satisfaction (Arbaugh, 2000b; Sun et al., 2008). The rationale is that flexibility allows learners to balance their personal commitments, such as work, family, and other activities, with their studies. Higher education research suggests that learner independence is crucial for building critical thinking skills (Garrison & Kanuka, 2004). Educational psychology research emphasizes that learner control over materials can have a positive impact on cognitive processing due to the possibility of pacing (Mayer et al., 2003; Moreno & Mayer, 2007). Pacing refers to a flexible presentation speed that encompasses pause, rewind, and fast-forward options. While pausing allows learners to restrict cognitive processing at a certain point of time, rewinding can intensify cognitive processing because the learner repeatedly receives the same information. The fast-forward option allows for certain sections to be skipped so that learners end up with shorter sections, which also benefit cognitive processing. The presentation of information in separate parts gives learners the opportunity to gradually build multiple mental representations that can be integrated later (Mayer & Chandler, 2001). Scheiter and Gerjets (2007) note that learner control in multimedia environments stimulates interest and motivation and, thereby, triggers more active and constructive processing. While Arbaugh and Duray (2002) show positive relationships between flexibility and both perceived learning and satisfaction in web-based environments, Arbaugh (2000a) finds no direct relationship between flexibility and perceived learning.
In blended learning environments, the flexibility of online learning is integrated with the preeminent characteristic of classroom teaching: interaction. Alavi (1994) finds that technology-supported learner collaboration and the associated interaction lead to greater satisfaction, self-reported learning, and enhanced exam performance. Collaboration can empower the structuring and sharing of information, leading to exposure to different views and opinions. This requires reiterating prior information when explaining knowledge to others, resolving opposing perspectives through discussions, and internalizing explanations from more knowledgeable peers. Eventually, this leads to more active knowledge processing and construction (Kreijns et al., 2013).
Eid and Al-Jabri (2016) provide evidence that online discussions and chats promote the exchange of knowledge that predicts perceived learning. Furthermore, networking via discussion forums leads to better performance (Walker et al., 2013). Arbaugh (2000a) also finds connections between perceived learning and interaction ease, interaction emphasis, and classroom dynamics. Arbaugh and Benbunan-Fich (2006) investigate online learning among 579 MBA students and find that group learning leads to higher perceived learning and satisfaction than individual learning. While group learning is moderated by an objectivist teaching approach, individual learning is moderated by constructivist instruction. Song et al. (2004) find that a perceived lack of community is detrimental to perceived online learning. In contrast, Eom et al. (2006) state that distance interactions lead to an adaptation of information that assists learners in overcoming feelings of remoteness. They find that interaction predicts satisfaction with online learning, which in turn fosters perceived learning. However, they do not find a direct link between interaction and perceived learning. Concannon et al. (2005) also find that interaction affects the satisfaction of e-learners, while Sun et al. (2008) find no relationship. Eom and Ashill (2018) find direct relationships between both learner-learner and learner-instructor interaction and perceived online learning. They also show that peer interactions in e-learning are beneficial for the self-regulation that predicts perceived learning. Perceived learning, in turn, causes satisfaction (Wu et al., 2010). Hazari et al. (2013) suggest that peer interactions via blogs lead to constructive feedback and self-assessments. On the other hand, Arbaugh and Rau (2007) find that peer interaction in online courses can negatively influence satisfaction, while it can positively affect perceived learning. Wu et al. (2010) reveal that the learning climate in a blended environment mediates the effect of interaction on satisfaction. According to Solimeno et al. (2008), online interaction can be even more beneficial for learning than personal interaction, as the former overcomes much of the interpersonal noise.
A variant of blended environments is flipped learning. According to higher education research, there is no single approach to flipped learning. However, the most important aspects include the provision of content in advance and higher-order learning during face time (O’Flaherty & Phillips, 2015). Therefore, introductions, explanations, and theories are studied individually and asynchronously at each student’s own pace, typically facilitated by a learning management system, while application and transfer problems are handled during class time. Solimeno et al. (2008) emphasize the benefits of asynchronous preparation, including flexibility in consulting materials and reviewing online comments from peers. Such a shift in the individual workload from reworking to preparing fosters ownership before class and enables deeper discussions in class that can be initiated by the learners themselves (O’Flaherty & Phillips, 2015). Flipped learning also supports the pretraining effect proposed in educational psychology research (Moreno & Mayer, 2007). The aim in this regard is to provide learners with relevant prior knowledge or to reactivate it if it is already available. This prepares the human memory with selected knowledge, which can later be integrated with new information. Consequently, pretraining facilitates meaning making and improves cognitive processing (Moreno & Mayer, 2007).
Educational technology research finds that assessment diversity in online environments increases satisfaction, as it enables multiple forms of feedback (Sun et al., 2008). Concannon et al. (2005) suggest that the use of some online tests during a semester reshapes study patterns by triggering continuous review and feedback. These format-related antecedents of the effectiveness of technology-supported management learning are outlined in Fig. 4.

Instructor characteristics

Instructors play a central role in any learning environment (Webster & Hackley, 1997). This role remains important in technology-supported management education, but it is changing (Daspit & D’Souza, 2012; Volery & Lord, 2000). Therefore, examinations of instructor characteristics should consider not only the personalities of instructors but also their roles, particularly with regard to learner-instructor interactions.
Research on instructors’ personality in technology-supported environments mainly focuses on instructors’ attitudes toward and control over the technology. Webster and Hackley (1997) find that the instructor’s attitude toward the technology affects learners’ attitudes toward the format and technology, technology self-efficacy, and perceived learning. In turn, learners’ technology self-efficacy predicts perceived learning (Wu et al., 2010). However, they find no relationship between the instructor’s attitude toward the technology and learners’ involvement and participation, cognitive engagement, or perceived usefulness of the technology. Concannon et al. (2005) find a positive relationship between the instructor’s attitude toward the technology and e-learners’ motivation to use that technology. López-Pérez et al. (2011) show that learner motivation influences actual learning in both the physical and virtual elements of blended environments. In addition, Sun et al. (2008) show a positive effect of the instructor’s attitude on the satisfaction of e-learners. They also emphasize the importance of the instructor’s technical competence.
Webster and Hackley (1997) demonstrate that the instructor’s control over the technology has a positive impact on learners’ attitudes toward a technology, its perceived usefulness, cognitive engagement, and perceived learning. However, they do not find relationships with involvement and participation or technology self-efficacy. Selim (2007) confirms that both attitudes toward and control over the technology affect business students’ e-learning satisfaction.
While the purpose of a traditional lecture is to deliver knowledge, instructors in a technology-supported environment should support active learning as facilitators and mentors (Solimeno et al., 2008). Markel (1999) proposes a change from “a sage on the stage into a guide on the side,” while Volery and Lord (2000) expect the role of the instructor to shift toward being “a learning catalyst and knowledge navigator.” Webster and Hackley (1997) find that such an interactive teaching style has a positive impact on learners’ involvement and participation, cognitive engagement, and attitudes toward format and technology. They find no relationships between an interactive teaching style and the perceived usefulness of the technology, technology self-efficacy, or perceived learning. However, Arbaugh (2000a) shows that efforts to create an interactive online environment predict perceived learning, and that the emphasis on interaction is directly related to satisfaction (Arbaugh, 2000b). Selim (2007) also shows that instructor characteristics, including the teaching style, influence business students’ satisfaction with e-learning.
Interactions between learners and instructors comprise both guidance (i.e., process input) and feedback (i.e., essential input) (Moreno & Mayer, 2007). On the one hand, process-related input promotes learners’ engagement in the right activities, especially the selection, organization, and integration of relevant information that strengthens relevant cognitive processing (Mayer & Moreno, 2003). On the other hand, essential input reduces learners’ extraneous cognitive processing by replacing misconceptions in the human memory (Moreno & Mayer, 2007). Extraneous processing refers to cognitive processes that are irrelevant for making sense of information and, thus, should be minimized. However, feedback must be well designed to avoid additional extraneous processing. For technology-supported environments, Demetriadis et al. (2008) suggest that scaffolding, a technique of appropriate questioning, can trigger learner reflection and deeper processing. They find that scaffolding leads to more knowledge acquisition and knowledge transfer. Moreno and Mayer (2007) confirm that reflection on prior information leads to more active organization and integration of new information. According to Eom et al. (2006), both guidance and feedback increase learner satisfaction, but only feedback improves perceived learning in an online environment. Hwang and Arbaugh (2006) show that feedback does not influence actual learning in blended environments. However, if the search for feedback is triggered by a competitive attitude (i.e., getting ahead of others or preventing others from getting ahead of oneself), it has a positive impact on actual learning. Sun et al. (2008) show that the timeliness of an instructor’s response has no influence on satisfaction with e-learning.
Instructor feedback in technology-supported environments has also been studied in connection with learners’ prior knowledge. Seufert (2003) finds that feedback in a computer-based learning task barely affects learners with a high level of prior knowledge. However, it positively moderates the comprehension of learners with intermediate prior knowledge, presumably due to its summarizing and repetitive nature. At the same time, feedback negatively moderates the recall performance of learners with little prior knowledge. Interestingly, in a computer-based simulation, Nihalani et al. (2011) find that learners with low prior knowledge learn better with the support of the instructor than in cooperation with other beginners and that feedback is disadvantageous for learners with high levels of prior knowledge.
As a variant of feedback, educational psychology scholars study confusion in online environments, which is defined as “the result of contradictions, conflicts, anomalies, erroneous information, and other discrepant events” (Park et al., 2014). They propose that when confusion is “induced, regulated, and resolved appropriately,” it can positively influence learning. D’Mello et al. (2014) find that knowledge and transfer are higher when confusion is deliberately triggered and successfully resolved. Learners’ prior knowledge has small moderation effects. Confusion is assumed to lead to deeper engagement with new information, thereby improving learning (Leutner, 2014).
Although feedback embodies interaction between instructors and learners, the physical presence of the instructor is not essential for improving cognitive processing (Redpath, 2012). Personal interaction can occur through a collaborative online environment or personalized online communication (Arbaugh, 2000c). Mayer (2002) proposes the personalization principle, which posits more effective processing for a conversational communication style in learning materials than for a formal communication style. This increases learners’ attention and encourages them to refer content to themselves (Moreno, 2006). In addition, Beege et al. (2017) find that frontal, as opposed to lateral, instructor orientation in learning videos promotes retention, as para-social interactions can trigger deeper cognitive processing and beneficial affective states. The lack of body language in online settings can be addressed through the use of humor, anecdotes, or emoticons (Whitaker, New, & Ireland, 2016). Guo et al. (2014) find that instructors who speak faster and with more enthusiasm in learning videos increase learner engagement. These instructor-related antecedents of technology-supported management learning effectiveness are illustrated in Fig. 5.

Learner characteristics

The learners themselves play an important role in the effectiveness of technology-supported management learning. Educational technology research initially examined the demographic background and prior experience of learners in technology-supported formats. While it is unclear whether gender predicts perceived learning in an online environment (Arbaugh, 2000a, 2008; Volery & Lord, 2000), both Arbaugh (2000b) and Arbaugh (2008) find that gender does not influence satisfaction. Furthermore, Lancellotti et al. (2016) find no connection between gender and actual learning. Age does not influence perceived e-learning (Arbaugh, 2000a), but it positively predicts actual learning in the physical and virtual settings of a blended environment (López-Pérez et al., 2011).
Prior technological experience also influences actual online learning (López-Pérez et al., 2011), while its relationships with perceived learning and satisfaction are not always significant (Arbaugh, 2000a, 2008; Arbaugh & Rau, 2007; Selim, 2007; Song et al., 2004; Volery & Lord, 2000). Piccoli et al. (2001) examine 146 management students and posit that previous technology experience can be beneficial, while a lack of such experience can promote feelings of anxiety and isolation. Sun et al. (2008) find that computer anxiety has a negative impact on satisfaction with e-learning, as it can hamper a learner’s attitude, which is essential for technology-supported learning (Scheiter & Gerjets, 2007). Solimeno et al. (2008) show that technology promotes perceived and actual learning among learners with low computer anxiety.
In addition to previous technological experience, research has examined the role of prior academic achievements. Nemanich et al. (2009) and Palocsay and Stevens (2008) find that learners’ academic abilities are associated with learning outcomes, particularly in online environments. Scheiter and Gerjets (2007) assume that a high level of prior knowledge moderates learning in multimedia environments. Asarta and Schmidt (2017) show that blended formats have a positive influence on exam performance for learners with high prior performance, while weaker students perform better in traditional formats. Owston et al. (2013) find that high achievers show the highest satisfaction with blended learning environments because they view blended learning as more convenient and engaging, and they feel that they learn key concepts better than in traditional classes.
Educational psychology scholars have considered affective aspects, such as learner motivation and emotions (Park et al., 2014). Motivation is defined as an “internal state that initiates, maintains, and energizes the learner’s effort to engage in learning processes” (Mayer, 2014). The corresponding work is based on the assumption that motivational factors can mediate learning by increasing or decreasing cognitive engagement (Moreno & Mayer, 2007). Selim (2007) shows that motivation affects e-learning acceptance and satisfaction. According to Song et al. (2004), e-learners expect their motivation to be related to learning. López-Pérez et al. (2011) find that motivation predicts actual learning in both the physical and virtual settings of a blended environment. Woo (2014) confirms the correlation between motivation and actual online learning. Eom et al. (2006) also find that motivation in an online environment affects satisfaction, although they do not find a direct link to perceived learning.
Plass et al. (2014) and Um et al. (2012) investigate emotions induced by videos in online learning, and find that positive emotions can promote comprehension and transfer. Their findings suggest that round, face-like shapes and warm colors reinforce the positive emotions that not only reduce the perceived difficulty of the task but also increase motivation and cognitive processing. This effect of emotions on performance can be mediated by motivation and/or moderated by prior knowledge (Leutner, 2014). In contrast, Knoerzer et al. (2016) find that positive emotions induced through music and autobiographic recall reduce actual online learning, possibly because they distract learners from the focal material. However, they find that negative emotions increase learning, possibly due to a perceived need for deeper information processing. They find no connection between emotions and motivation.
Educational psychology research on multimedia learning further posits that “metacognitive factors mediate learning by regulating cognitive processing and affect” (Moreno & Mayer, 2007). Metacognition mainly occurs in the form of self-regulation and reflection during the organization and integration of new information. Moreno and Mayer (2007) find that reflection is beneficial for cognitive processing, which leads to better learning outcomes. Eom and Ashill (2018) show that self-regulation in an e-learning environment mediates the relationship between motivation and perceived learning, which is related to satisfaction. Metacognition seems to be particularly important for non-interactive (i.e., distance) phases in which it is not triggered by interactions. However, metacognition is also important in an interactive setting if “the lesson can be performed in a superficial or automatic fashion” (Moreno & Mayer, 2007).
According to Fryer and Bovee (2016), “although a variety of factors influence learning, few are as important as time on task.” Macfadyen and Dawson (2010) distinguish between online activity and time online, noting that online activity (i.e., written posts, sent messages, completed assessments) indicates learner engagement and predicts actual outcomes, while time online does not. Fritz (2011) also shows that higher activity in the learning management system affects actual learning, while Asarta and Schmidt (2013) as well as Buttner and Black (2014) find no correlation between time online and learning. Based on learning analytics, Zacharis (2015) finds that four online activities predict 52% of the variance in the final grade: number of files viewed, reading and posting messages, content creation contribution, and quiz efforts. These learner-related antecedents of technology-supported management education are illustrated in Fig. 6.

Discussion

In this paper, we have presented a systematic and comprehensive review of peer-reviewed, scientific publications from several research disciplines related to the effectiveness of technology-supported management learning. Although our search for literature was not limited to a specific timeframe, the current relevance of the topic is evident from the identified publications. Research on this topic began to emerge in the 1990s and it has since flourished. With regard to the field of management education, the most cited articles were published in the current millennium (Arbaugh & Hwang, 2015). We found that the antecedents of technology-supported management learning effectiveness include more than technological characteristics and learners’ abilities to deal with them. More specifically, the introduction of technologies into the management learning space has implications for formats, instructors, and learner characteristics, all of which are highly interdependent. The desired format of instruction, for example, which is chosen by the instructor, determines the appropriate technology and the role of the instructor. Characteristics of the selected technology, such as quality, reliability, and richness, and characteristics of the instructor, such as attitude, control, and teaching style, impact learners’ perceptions, metacognition, and affect. These relationships are, in turn, moderated by learners’ demographic characteristics and previous experiences. Eventually, all four dimensions—learner, instructor, format, and technology—directly or indirectly influence technology-supported learning effectiveness. These findings are independent from the measurement of effectiveness (i.e., online activity, cognitive processing, perceived learning, satisfaction, actual results, or dropout rates).
These antecedents of technology-supported management learning effectiveness are summarized in Fig. 7. The subsequent section derives detailed implications for future research based on the identified inconsistencies and interdependencies.

Implications for future research

In investigating antecedents of technology-supported management learning effectiveness, we have identified several inconsistencies and research gaps in the extant literature. We encourage management education scholars to study these issues in order to develop additional insights into technology-supported management learning. Such research will advance the young field of management education and make a positive contribution to overall management research and education. In Table 2, we highlight aspects that provide opportunities for further research.
Table 2
Selected Opportunities for Further Research
Dimension
Research gap
Related findings/references
Format
Performance, retention
- Blended formats improve actual learning and reduce dropout rates (López-Pérez et al., 2011).
- Blended formats improve actual learning but increase dropout rates (Deschacht & Goeman, 2015).
- Blended formats do not affect actual learning but increase dropout rates (McLaren, 2004).
Collaboration, interaction
- Collaboration leads to higher perceived learning and satisfaction (Arbaugh & Benbunan-Fich, 2006).
- Interaction predicts online learning satisfaction, which affects perceived learning (Eom et al., 2006).
- A perceived lack of community is disadvantageous for perceived learning (Song et al., 2004).
- Peer interaction can negatively influence satisfaction (Arbaugh & Rau, 2007).
Technology
Richness
- Technology richness promotes feedback and benefits perceived learning (Webster & Hackley, 1997).
- Technology features that encourage constructive dialogue foster understanding (Kember et al., 2010).
- Technology design and functions affect perceived learning (Volery & Lord, 2000; Wu et al., 2010).
- Technology variety benefits satisfaction but impedes perceived learning (Arbaugh & Rau, 2007).
Instructor
Teaching style
- Group learning is moderated by an objectivist teaching approach and individual learning is moderated by a constructivist teaching approach (Arbaugh & Benbunan-Fich, 2006).
Feedback, confusion
- Feedback benefits learners with medium prior knowledge and hinders learners with low prior knowledge. It barely affects learners with high prior knowledge (Seufert, 2003).
- Learners with low prior knowledge learn better individually with instructor support. Learners with high prior knowledge are hindered by feedback (Nihalani et al., 2011).
- Deliberate confusion is beneficial for learning. Prior knowledge has small moderation effects
(D’Mello et al., 2014).
Learner
Motivation
- Motivation can mediate learning through cognitive engagement (Moreno & Mayer, 2007).
- E-learners expect their motivation to be related to learning (Song et al., 2004).
- Motivation affects e-learning acceptance and satisfaction (Selim, 2007).
- Motivation predicts actual learning in both physical and virtual settings (López-Pérez et al., 2011).
- Motivation affects satisfaction but is not directly related to perceived learning (Eom et al., 2006).
Emotions
- Positive emotions can improve comprehension and transfer (Plass et al., 2014; Um et al., 2012).
- Positive emotions diminish actual learning. Negative emotions enhance it (Knoerzer et al., 2016).
- Emotions may be mediated by motivation and/or moderated by prior knowledge (Leutner, 2014).
- There is no relationship between emotions and motivation (Knoerzer et al., 2016).
As far as the overall effectiveness of technology-supported formats is concerned, research has produced a number of inconsistent results. For instance, there is disagreement about the impact of blended environments on dropout rates (Deschacht & Goeman, 2015; López-Pérez et al., 2011). Moreover, whether the use of technology is beneficial for learning remains unclear. Twenty years ago, Arbaugh (2000a) found that the format of instruction is more important than the specific technology employed. To date, theoretical concepts on how to blend and flip learning content in relation to subject areas and content types are still lacking (O’Flaherty & Phillips, 2015). Although there might not be a “one-size-fits-all” approach, it is possible to examine which course structures and format features, such as collaboration and interaction, are more appropriate for certain types of content. Due to the wide variety of management disciplines, scholars in management education are predestined to investigate different variants of blended and flipped learning (Arbaugh & Rau, 2007). Such studies can reveal connections among content type, optimal course format, and technology use.
Another key question is why learners continue to prefer face-to-face classes to online courses (O’Neill & Sai, 2014) even though they regularly use electronic devices and increasingly strive for individualism and flexibility. As technologies are likely to continue to play a central role in society, different learning formats should be studied in relation to specific technologies and their richness of features. Such studies can further investigate whether the use of technology actually equalizes learners’ performance (Krentler & Willis-Flurry, 2005). Moreover, Piccoli et al. (2001) argue that the investigation of new formats and technologies for management education requires an examination of optimal class sizes. They argue for an inverted U-shape relationship between class size and learning effectiveness, as the presence of more learners increases perspectives until a point is reached at which information overload and coordination difficulties outweigh the benefits of additional learners. However, this requires further examination.
Scholars agree that instructors play an important role in technology-supported management education, but how their role will change remains unclear (Arbaugh, 2000a; Volery & Lord, 2000). Some suggest a shift from “a sage on the stage into a guide on the side” (Markel, 1999), which implies a shift from an objectivist to a constructivist teaching approach. Nevertheless, collaborative management learning in a technology-supported environment seems to be moderated by an objectivist teaching approach (Arbaugh & Benbunan-Fich, 2006), which contradicts the plea for an interactive teaching style (Selim, 2007; Webster & Hackley, 1997). Furthermore, findings on the role and effects of feedback are inconsistent, particularly with regard to the moderating role of learners’ prior knowledge (Nihalani et al., 2011; Seufert, 2003). Deliberate confusion, a variant of feedback, has also been under-researched, and there are some indications that learners’ prior knowledge could play a moderating role (D’Mello et al., 2014; Leutner, 2014). Therefore, the design and impact of teaching style and instructor feedback on cognitive processing and actual learning should be further investigated, especially with regard to potential moderating variables, such as learners’ prior knowledge.
Since Moreno and Mayer (2007) proposed a cognitive-affective theory of learning with media, it has become clear that learning also depends on affective aspects, such as motivation and emotions. Although the related antecedents have not yet been fully researched, initial results suggest that the design of multimedia materials and interfaces should take into account features that trigger motivation and emotion (Mayer, 2014). However, while Plass et al. (2014) and Um et al. (2012) find that positive emotions can strengthen comprehension and transfer, Knoerzer et al. (2016) come to the opposite conclusion when they induce emotions in a different way. Another unresolved aspect of inducing emotions is whether the instructor should be shown speaking in educational videos. While this can create a positive sense of personalization, it may also increase the extraneous load (Kizilcec et al., 2015; Mayer, 2003). Furthermore, Leutner (2014) suggests that the effect of emotions on learning might be mediated by motivation or moderated by prior knowledge. As such, the interdependence and effects of motivation and emotions on cognitive processing and actual learning deserve further investigation. In addition, potentially moderating variables, such as learners’ prior knowledge, should be investigated.

Limitations

Although this review followed a systematic procedure, it has some limitations that can be attributed to either our methodology or our research focus. With regard to our methodology, the literature-identification process revealed that numerous publications from a variety of research areas have examined technology-supported learning. Although we have tried to systematically identify all major publications investigating this issue that are relevant for the management context, we cannot guarantee that our results are exhaustive. Furthermore, although we broadened our scope to include publications beyond management education research, we deliberately limited our search to educational psychology, educational technology, and higher education research. These three disciplines appeared to be the most promising during an initial interdisciplinary skimming of the literature. However, we cannot exclude the possibility that relevant research may have been conducted in other disciplines. Moreover, given the interdisciplinary nature of the sources, our literature prioritization and classification revealed that some results were more general in nature, while others were developed explicitly from management education research. In our search in the field of educational technology, we tried to limit our findings to those that came from a management context. Nevertheless, this paper also includes findings from other disciplines when they appeared to be transferable to the management environment. Decisions regarding this transferability were made by the authors.
In terms of the research focus, management is a broad field covering various sub-disciplines, including accounting, economics, finance, marketing, and strategy. Some of these fields are comparable in terms of concepts and terminologies, while others are not. Some fields are rather qualitative, and others are strongly quantitative. In addition, the spectrum of management learners ranges from freshmen in undergraduate programs to highly senior MBA students participating in executive programs. Similarly, the use of technologies in education covers a broad field ranging from traditional classroom teaching sporadically facilitated using electronic devices to programs taught fully online. As our objective was to examine antecedents of management learning in a technology-supported environment as a whole, we did not restrict the learning environment in terms of the technologies employed.

Concluding remarks

This paper has shown that educational technologies are quickly becoming an integral part of management education, both in theory and in practice. Although we have identified a number of research gaps and ideas for further research, educational authorities, institutions, and practitioners should not wait for additional research to be completed. Passive knowledge transfer in synchronous, analogue classroom sessions can no longer be viewed as the most effective educational format. In addition, there are already some indications of what constitutes effective technology-supported management education. In the meantime, researchers from different disciplines should pursue investigations of technology-supported settings in relation to management education and beyond.

Acknowledgements

Not applicable.

Competing interests

The authors declare that they have no competing interests.
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://​creativecommons.​org/​licenses/​by/​4.​0/​.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Literature
go back to reference Davis FD (1986) A technology acceptance model for empirically testing new end-user information systems: Theory and results. Doctoral thesis, Massachusetts Institute of Technology Davis FD (1986) A technology acceptance model for empirically testing new end-user information systems: Theory and results. Doctoral thesis, Massachusetts Institute of Technology
go back to reference Guo, P. J., Kim, J., & Rubin, R. (2014). How video production affects student engagement: An empirical study of MOOC videos. In M. Sahami, A. Fox, M. A. Hearst, & M. T. H. Chi (Eds.), Proceedings of the first ACM conference on learning @ scale, (pp. 41–50). New York: ACM Press.CrossRef Guo, P. J., Kim, J., & Rubin, R. (2014). How video production affects student engagement: An empirical study of MOOC videos. In M. Sahami, A. Fox, M. A. Hearst, & M. T. H. Chi (Eds.), Proceedings of the first ACM conference on learning @ scale, (pp. 41–50). New York: ACM Press.CrossRef
go back to reference Huang, R.-T. (2014). Exploring the moderating role of self-management of learning in mobile English learning. Educational Technology and Society, 17, 255–267. Huang, R.-T. (2014). Exploring the moderating role of self-management of learning in mobile English learning. Educational Technology and Society, 17, 255–267.
go back to reference Woo, J.-C. (2014). Digital game-based learning supports student motivation, cognitive success, and performance outcomes. Educational Technology and Society, 17, 291–307. Woo, J.-C. (2014). Digital game-based learning supports student motivation, cognitive success, and performance outcomes. Educational Technology and Society, 17, 291–307.
Metadata
Title
Technology-supported management education: a systematic review of antecedents of learning effectiveness
Authors
Fabian Alexander Müller
Torsten Wulf
Publication date
01-12-2020
Publisher
Springer International Publishing
DOI
https://doi.org/10.1186/s41239-020-00226-x

Other articles of this Issue 1/2020

International Journal of Educational Technology in Higher Education 1/2020 Go to the issue

Premium Partner