Skip to main content
Top
Published in: Technology, Knowledge and Learning 4/2023

06-04-2022 | Original research

Variation in Student Perceptions of Higher Education Course Quality and Difficulty as a Result of Widespread Implementation of Online Education During the COVID-19 Pandemic

Authors: Joseph Cavanaugh, Stephen J. Jacquemin, Christine R. Junker

Published in: Technology, Knowledge and Learning | Issue 4/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The onset of the COVID-19 global pandemic affected higher education in a myriad of ways. One of the most notable effects however was the rapid and sudden transition of nearly all courses at most institutions to an online environment. And while there are a growing number of courses offered online already, this transition to nearly 100% remote education presented numerous challenges for instructors and students of face-to-face and hybrid style courses. Since student perceptions are closely tied to recruitment and retention, it is important to know if there are differences in student perceptions present in the way different courses are taught. This study extends the work of other authors that have investigated student perceptions by looking specifically at how the COVID-19 pandemic may have changed student views of course difficulty and quality both overall and across discipline or institution categories. Course evaluations from 837 courses from 191 different schools archived on RateMyProfessors.com were used in a general linear model where a statistically significant overall decline of 6% in perceived course difficulty and 4% decline in perceived quality was detected. In addition to calculating this mean decrease, courses were also categorized on the basis of academic discipline (Business, Engineering and Mathematics, Humanities, Natural Sciences, Social Sciences), institution type (2-Year, 4-Year), and whether instructors had previous experience teaching online courses (No, Yes) to determine any variation in differences that may have appeared as a result of more nuanced details in course type or delivery. Most notably, declines in course difficulty were slightly more apparent with instructors that had no previous online teaching experience. No other discipline, institution type, or teaching experience interactions were detected with either difficulty or quality variation. These data suggest that there were very real changes in perceived quality and difficulty but that these changes were largely universal irrespective of discipline, institution type, or prior experience teaching online (with exception of course difficulty).

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Ackerman, D., & Chung, C. (2018). Is RateMyProfessors.com unbiased? A look at the impact of social modelling on student online reviews of marketing classes. Journal of Marketing Education, 40(3), 188–195.CrossRef Ackerman, D., & Chung, C. (2018). Is RateMyProfessors.com unbiased? A look at the impact of social modelling on student online reviews of marketing classes. Journal of Marketing Education, 40(3), 188–195.CrossRef
go back to reference Bernard, R., Abrami, P., Lou, Y., Borokhovski, E., Wade, A., Wozney, L., & Huang, B. (2004). How does distance education compare with classroom instruction? A meta-analysis of the empirical literature. Review of Educational Research, 74(3), 379–439.CrossRef Bernard, R., Abrami, P., Lou, Y., Borokhovski, E., Wade, A., Wozney, L., & Huang, B. (2004). How does distance education compare with classroom instruction? A meta-analysis of the empirical literature. Review of Educational Research, 74(3), 379–439.CrossRef
go back to reference Bernard, R., Borokhovskib, E., & Tamimc, R. (2014). Detecting bias in meta-analyses of distance education research: Big pictures we can rely on. Distance Education, 35(3), 271–293.CrossRef Bernard, R., Borokhovskib, E., & Tamimc, R. (2014). Detecting bias in meta-analyses of distance education research: Big pictures we can rely on. Distance Education, 35(3), 271–293.CrossRef
go back to reference Bolliger, D., & Halupa, C. (2018). Online student perceptions of engagement, transactional distance, and outcomes. Distance Education, 39(3), 299–316.CrossRef Bolliger, D., & Halupa, C. (2018). Online student perceptions of engagement, transactional distance, and outcomes. Distance Education, 39(3), 299–316.CrossRef
go back to reference Brown, M., Baille, M., & Fraser, S. (2009). Rating RateMyProfessors.com: A comparison of online and official student evaluations of teaching. College Teaching, 57(2), 89–92.CrossRef Brown, M., Baille, M., & Fraser, S. (2009). Rating RateMyProfessors.com: A comparison of online and official student evaluations of teaching. College Teaching, 57(2), 89–92.CrossRef
go back to reference Carle, A. (2009). Evaluating college students’ evaluations of a professor’s teaching effectiveness across time and instruction mode (online vs. face-to-face) using a multilevel growth modeling approach. Computers & Education, 53(2), 429–435.CrossRef Carle, A. (2009). Evaluating college students’ evaluations of a professor’s teaching effectiveness across time and instruction mode (online vs. face-to-face) using a multilevel growth modeling approach. Computers & Education, 53(2), 429–435.CrossRef
go back to reference Castro, E., & George, J. (2021). The impact of Covid-19 on student perceptions of education and engagement. E-Journal of Business Education & Scholarship of Teaching, 15(1), 28–39. Castro, E., & George, J. (2021). The impact of Covid-19 on student perceptions of education and engagement. E-Journal of Business Education & Scholarship of Teaching, 15(1), 28–39.
go back to reference Chávez, K., & Mitchell, K. (2020). Exploring bias in student evaluations: Gender, race, and ethnicity. The Profession, 53(2), 270–274. Chávez, K., & Mitchell, K. (2020). Exploring bias in student evaluations: Gender, race, and ethnicity. The Profession, 53(2), 270–274.
go back to reference Cohen, P. (1981). Student ratings of instruction and student achievement: A meta-analysis of multisection validity studies. Review of Educational Research, 51, 281–309.CrossRef Cohen, P. (1981). Student ratings of instruction and student achievement: A meta-analysis of multisection validity studies. Review of Educational Research, 51, 281–309.CrossRef
go back to reference Davison, E., & Price, J. (2009). How do we rate? An evaluation of online student evaluations. Assessment & Evaluation in Higher Education, 34(1), 51–65.CrossRef Davison, E., & Price, J. (2009). How do we rate? An evaluation of online student evaluations. Assessment & Evaluation in Higher Education, 34(1), 51–65.CrossRef
go back to reference Dutton, J., Dutton, M., & Perry, J. (2001). Do online students perform as well as lecture students? Journal of Engineering Education, 90(1), 131–136.CrossRef Dutton, J., Dutton, M., & Perry, J. (2001). Do online students perform as well as lecture students? Journal of Engineering Education, 90(1), 131–136.CrossRef
go back to reference Felton, J., Mitchell, J., & Stinson, M. (2004). Web-based student evaluations of professors: The relations between perceived quality, easiness and sexiness. Assessment & Evaluation in Higher Education, 29(1), 91–108.CrossRef Felton, J., Mitchell, J., & Stinson, M. (2004). Web-based student evaluations of professors: The relations between perceived quality, easiness and sexiness. Assessment & Evaluation in Higher Education, 29(1), 91–108.CrossRef
go back to reference Gillis, A., & Krull, L. (2020). Covid-19 remote learning transition in spring 2020: Class structures, student perceptions, and inequality in college courses. Teaching Sociology, 48(4), 283–299.CrossRef Gillis, A., & Krull, L. (2020). Covid-19 remote learning transition in spring 2020: Class structures, student perceptions, and inequality in college courses. Teaching Sociology, 48(4), 283–299.CrossRef
go back to reference Guo, S. (2020). Synchronous versus asynchronous online teaching of physics during the COVID-19 pandemic. Physics Education, 55(6), 1–8.CrossRef Guo, S. (2020). Synchronous versus asynchronous online teaching of physics during the COVID-19 pandemic. Physics Education, 55(6), 1–8.CrossRef
go back to reference Lao, T., & Gonzales, C. (2005). Understanding online learning through a qualitative description of professors and students’ experiences. Journal of Technology and Teacher Education, 13(3), 459–474. Lao, T., & Gonzales, C. (2005). Understanding online learning through a qualitative description of professors and students’ experiences. Journal of Technology and Teacher Education, 13(3), 459–474.
go back to reference Liaw, S., & Goh, K. (2003). Evidence and control of biases in student evaluations of teaching. International Journal of Educational Management, 17(1), 37–43. Liaw, S., & Goh, K. (2003). Evidence and control of biases in student evaluations of teaching. International Journal of Educational Management, 17(1), 37–43.
go back to reference Lim, J., Kim, M., Chen, S., & Ryder, C. (2008). An empirical investigation of student achievement and satisfaction in different learning environments. Journal of Instructional Psychology, 35(2), 113–119. Lim, J., Kim, M., Chen, S., & Ryder, C. (2008). An empirical investigation of student achievement and satisfaction in different learning environments. Journal of Instructional Psychology, 35(2), 113–119.
go back to reference MacNell, L., Driscoll, A., & Hunt, A. (2014). What’s in a name: Exposing gender bias in student ratings of teaching. Innovative Higher Education, 40, 291–303.CrossRef MacNell, L., Driscoll, A., & Hunt, A. (2014). What’s in a name: Exposing gender bias in student ratings of teaching. Innovative Higher Education, 40, 291–303.CrossRef
go back to reference McFarland, D., & Hamilton, D. (2006). Factors affecting student performance and satisfaction: Online versus traditional course delivery. Journal of Computer Information Systems, 46(2), 25–32. McFarland, D., & Hamilton, D. (2006). Factors affecting student performance and satisfaction: Online versus traditional course delivery. Journal of Computer Information Systems, 46(2), 25–32.
go back to reference McKenna, K., Gupta, K., Kaiser, L., Lopes, T., & Zarestky, J. (2020). Blended learning: Balancing the best of both worlds for adult learners. Adult Learning, 31(4), 139–149.CrossRef McKenna, K., Gupta, K., Kaiser, L., Lopes, T., & Zarestky, J. (2020). Blended learning: Balancing the best of both worlds for adult learners. Adult Learning, 31(4), 139–149.CrossRef
go back to reference Merisotis, J., & Phipps, R. (1999). What’s the difference? A review of contemporary research on the effectiveness of distance learning in higher education. Institute for Higher Education Policy. Merisotis, J., & Phipps, R. (1999). What’s the difference? A review of contemporary research on the effectiveness of distance learning in higher education. Institute for Higher Education Policy.
go back to reference Morgan, H. (2020). Best practices for implementing remote learning during a pandemic. The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 93(3), 135–141.CrossRef Morgan, H. (2020). Best practices for implementing remote learning during a pandemic. The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 93(3), 135–141.CrossRef
go back to reference National Center for Education Statistics. (2003). Distance education at degree granting postsecondary institutions: 2000–2001, NCES 2003-017 (Washington, DC, US Department of Education, National Center for Education Statistics). Retrieved December 21, 2021, from https://nces.ed.gov/pubs2003/2003017.pdf National Center for Education Statistics. (2003). Distance education at degree granting postsecondary institutions: 2000–2001, NCES 2003-017 (Washington, DC, US Department of Education, National Center for Education Statistics). Retrieved December 21, 2021, from https://​nces.​ed.​gov/​pubs2003/​2003017.​pdf
go back to reference Nguyn, T. (2015). The effectiveness of online learning: Beyond no significant difference and future horizons. MERLOT Journal of Online Learning and Teaching, 11(2), 309–319. Nguyn, T. (2015). The effectiveness of online learning: Beyond no significant difference and future horizons. MERLOT Journal of Online Learning and Teaching, 11(2), 309–319.
go back to reference Otto, J., Sanford, D., & Ross, D. (2008). Does RateMyProfessors.com really RateMyProfessors.com? Assessment & Evaluation in Higher Education, 33(4), 355–368.CrossRef Otto, J., Sanford, D., & Ross, D. (2008). Does RateMyProfessors.com really RateMyProfessors.com? Assessment & Evaluation in Higher Education, 33(4), 355–368.CrossRef
go back to reference Park, J., & Choi, H. (2009). Factors influencing adult learners’ decision to drop out or persist in online learning. Educational Technology & Society, 12(4), 207–217. Park, J., & Choi, H. (2009). Factors influencing adult learners’ decision to drop out or persist in online learning. Educational Technology & Society, 12(4), 207–217.
go back to reference R Core Team. (2012). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved March 1, 2020, from http://www.R-project.org R Core Team. (2012). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved March 1, 2020, from http://​www.​R-project.​org
go back to reference Renaud, R., & Murray, H. (2005). Factorial validity of student ratings of instruction. Research in Higher Education, 46(8), 929–953.CrossRef Renaud, R., & Murray, H. (2005). Factorial validity of student ratings of instruction. Research in Higher Education, 46(8), 929–953.CrossRef
go back to reference Rodriguez, M. C., Ooms, A., & Montañez, M. (2008). Students’ perceptions of online-learning quality given comfort, motivation, satisfaction, and experience. Journal of Interactive Online Learning, 7(2), 105–125. Rodriguez, M. C., Ooms, A., & Montañez, M. (2008). Students’ perceptions of online-learning quality given comfort, motivation, satisfaction, and experience. Journal of Interactive Online Learning, 7(2), 105–125.
go back to reference Russell, J., Van Horne, S., Ward, A., III., Bettis, E. A., Sipola, M., Colombo, M., & Rocheford, M. (2016). Large lecture transformation: Adopting evidence-based practices to increase student engagement and performance in an introductory science course. Journal of Geoscience Education, 64(1), 37–51.CrossRef Russell, J., Van Horne, S., Ward, A., III., Bettis, E. A., Sipola, M., Colombo, M., & Rocheford, M. (2016). Large lecture transformation: Adopting evidence-based practices to increase student engagement and performance in an introductory science course. Journal of Geoscience Education, 64(1), 37–51.CrossRef
go back to reference Shea, P., & Bidjerano, T. (2014). Does online learning impede degree completion? A national study of community college students. Computers & Education, 75, 103–111.CrossRef Shea, P., & Bidjerano, T. (2014). Does online learning impede degree completion? A national study of community college students. Computers & Education, 75, 103–111.CrossRef
go back to reference Shim, T., & Lee, S. (2020). College students’ experience of emergency remote teaching due to COVID-19. Children and Youth Services Review, 119, 1–7.CrossRef Shim, T., & Lee, S. (2020). College students’ experience of emergency remote teaching due to COVID-19. Children and Youth Services Review, 119, 1–7.CrossRef
go back to reference Soffer, T., & Nachmias, R. (2018). Effectiveness of learning in online academic courses compared with face to face courses in higher education. Journal of Computer Assisted Learning, 34(5), 534–543.CrossRef Soffer, T., & Nachmias, R. (2018). Effectiveness of learning in online academic courses compared with face to face courses in higher education. Journal of Computer Assisted Learning, 34(5), 534–543.CrossRef
go back to reference Sonntag, M., Bassett, J., & Snyder, T. (2009). An empirical test of the validity of student evaluations of teaching made on RateMyProfessors.com. Assessment & Evaluation in Higher Education, 34(5), 499–504.CrossRef Sonntag, M., Bassett, J., & Snyder, T. (2009). An empirical test of the validity of student evaluations of teaching made on RateMyProfessors.com. Assessment & Evaluation in Higher Education, 34(5), 499–504.CrossRef
go back to reference Swan, K., Shea, P., Fredericksen, E., Pickett, A., Pelz, W., & Maher, G. (2000). Building knowledge building communities: Consistency, contact and communication in the virtual classroom. Journal of Educational Computing Research, 23(4), 359–383.CrossRef Swan, K., Shea, P., Fredericksen, E., Pickett, A., Pelz, W., & Maher, G. (2000). Building knowledge building communities: Consistency, contact and communication in the virtual classroom. Journal of Educational Computing Research, 23(4), 359–383.CrossRef
go back to reference Swanson, S., Davis, C., Gonzalez-Fuentes, M., & Robertson, K. (2012). In these unprecedented times: A critical incident technique examination of student perceptions of satisfying and dissatisfying learning experiences. Marketing Education Review, 31(3), 209–225.CrossRef Swanson, S., Davis, C., Gonzalez-Fuentes, M., & Robertson, K. (2012). In these unprecedented times: A critical incident technique examination of student perceptions of satisfying and dissatisfying learning experiences. Marketing Education Review, 31(3), 209–225.CrossRef
go back to reference Terry, N. (2001). Assessing enrollment and attrition rates for the online MBA. The Journal, 28(7), 64–68. Terry, N. (2001). Assessing enrollment and attrition rates for the online MBA. The Journal, 28(7), 64–68.
go back to reference Timmerman, T. (2008). On the validity of RateMyProfessors.com. Journal of Education for Business, 84(1), 55–61.CrossRef Timmerman, T. (2008). On the validity of RateMyProfessors.com. Journal of Education for Business, 84(1), 55–61.CrossRef
go back to reference Toven-Lindsey, B., Rhoads, R., & Lozano, J. (2015). Virtually unlimited classrooms: Pedagogical practices in massive open online courses. The Internet and Higher Education, 24, 1–12.CrossRef Toven-Lindsey, B., Rhoads, R., & Lozano, J. (2015). Virtually unlimited classrooms: Pedagogical practices in massive open online courses. The Internet and Higher Education, 24, 1–12.CrossRef
go back to reference Tratnik, A., Urh, M., & Jereb, E. (2019). Student satisfaction with an online and a face-to-face business english course in a higher education context. Innovations in Education & Teaching International, 56(1), 36–45.CrossRef Tratnik, A., Urh, M., & Jereb, E. (2019). Student satisfaction with an online and a face-to-face business english course in a higher education context. Innovations in Education & Teaching International, 56(1), 36–45.CrossRef
go back to reference Yang, D., Baldwin, S., & Snelson, C. (2017). Persistence factors revealed: Students’ reflections on completing a fully online program. Distance Education, 38(1), 23–36.CrossRef Yang, D., Baldwin, S., & Snelson, C. (2017). Persistence factors revealed: Students’ reflections on completing a fully online program. Distance Education, 38(1), 23–36.CrossRef
go back to reference Young, A., & Norgard, C. (2006). Assessing the quality of online courses from the students’ perspective. The Internet and Higher Education, 9(2), 107–115.CrossRef Young, A., & Norgard, C. (2006). Assessing the quality of online courses from the students’ perspective. The Internet and Higher Education, 9(2), 107–115.CrossRef
go back to reference Zhang, D. (2005). Interactive multimedia-based e-learning: A study of effectiveness. American Journal of Distance Education, 19(3), 149–162.CrossRef Zhang, D. (2005). Interactive multimedia-based e-learning: A study of effectiveness. American Journal of Distance Education, 19(3), 149–162.CrossRef
Metadata
Title
Variation in Student Perceptions of Higher Education Course Quality and Difficulty as a Result of Widespread Implementation of Online Education During the COVID-19 Pandemic
Authors
Joseph Cavanaugh
Stephen J. Jacquemin
Christine R. Junker
Publication date
06-04-2022
Publisher
Springer Netherlands
Published in
Technology, Knowledge and Learning / Issue 4/2023
Print ISSN: 2211-1662
Electronic ISSN: 2211-1670
DOI
https://doi.org/10.1007/s10758-022-09596-9

Other articles of this Issue 4/2023

Technology, Knowledge and Learning 4/2023 Go to the issue

Premium Partners