Skip to main content
Erschienen in: Education and Information Technologies 5/2020

22.04.2020

Development and validation of the MOOC success scale (MOOC-SS)

verfasst von: Nour Awni Albelbisi

Erschienen in: Education and Information Technologies | Ausgabe 5/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The objective of this study is to develop and validate the MOOC Success Scale (MOOC-SS) in the Malaysian context. Further, this study ascertains the influence of MOOC success factors on learner satisfaction. Based on an elaborate literature study, six factors related to MOOC success were derived: (1) system quality, (2) information quality, (3) service quality, (4) attitude, (5) course quality, and (6) satisfaction. The data were collected from 1000 undergraduate students from 5 public universities in Malaysia with a return of 622 responses. The instrument was tested in several ways: (a) review the literature, (b) formulating hypotheses (c) items generation, (d) expert opinion, and (e) pilot test. Thereafter, the scale’s reliability and validity were calculated, which appeared to be excellent. The results of the principal component analysis (PCA) empirically confirmed that the MOOC success scale with six factors and 33 items is strong enough to recommend its use in MOOC settings. Further, the finding of the predictive validity indicated that system quality, attitude, and course quality appeared to predict satisfaction toward MOOC. The instrument can be used by academicians, practitioners, and policymakers to monitor the MOOC success factors. Further research would be needed to generalize this research to other populations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Ajoye, M. B., & Nwagwu, W. E. (2014). Information systems user satisfaction: A survey of the postgraduate school portal, University of Ibadan, Nigeria. Library Philosophy and Practice, paper 1192. Ajoye, M. B., & Nwagwu, W. E. (2014). Information systems user satisfaction: A survey of the postgraduate school portal, University of Ibadan, Nigeria. Library Philosophy and Practice, paper 1192.
Zurück zum Zitat Albelbisi, N. A. (2019). The role of quality factors in supporting self-regulated learning (SRL) skills in MOOC environment. Education and Information Technologies, 1-18. Albelbisi, N. A. (2019). The role of quality factors in supporting self-regulated learning (SRL) skills in MOOC environment. Education and Information Technologies, 1-18.
Zurück zum Zitat Albelbisi, N. A., & Yusop, F. D. (2019). Factors influencing learners’ self–regulated learning skills in a massive open online course (MOOC) environment. Turkish Online Journal of Distance Education, 20(3), 1–16.CrossRef Albelbisi, N. A., & Yusop, F. D. (2019). Factors influencing learners’ self–regulated learning skills in a massive open online course (MOOC) environment. Turkish Online Journal of Distance Education, 20(3), 1–16.CrossRef
Zurück zum Zitat Albelbisi, N., Yusop, F. D., & Salleh, U. K. M. (2018). Mapping the factors influencing success of massive open online courses (MOOC) in higher education. EURASIA Journal of Mathematics, Science and Technology Education, 14(7), 2995–3012.CrossRef Albelbisi, N., Yusop, F. D., & Salleh, U. K. M. (2018). Mapping the factors influencing success of massive open online courses (MOOC) in higher education. EURASIA Journal of Mathematics, Science and Technology Education, 14(7), 2995–3012.CrossRef
Zurück zum Zitat Alsabawy, A. Y., Cater-Steel, A., & Soar, J. (2012). A model to measure e-learning systems success. In Measuring organizational information systems success: New technologies and practices (pp. 293-317). IGI global. Alsabawy, A. Y., Cater-Steel, A., & Soar, J. (2012). A model to measure e-learning systems success. In Measuring organizational information systems success: New technologies and practices (pp. 293-317). IGI global.
Zurück zum Zitat Aparicio, M., & Bacao, F. (2013, July). E-learning concept trends. In Proceedings of the 2013 International Conference on Information Systems and Design of Communication (pp. 81-86). ACM. Aparicio, M., & Bacao, F. (2013, July). E-learning concept trends. In Proceedings of the 2013 International Conference on Information Systems and Design of Communication (pp. 81-86). ACM.
Zurück zum Zitat Azevedo, J., & Marques, M. M. (2017). MOOC success factors: Proposal of an analysis framework. Journal of Information Technology Education: Innovations in Practice, 16(233), 251. Azevedo, J., & Marques, M. M. (2017). MOOC success factors: Proposal of an analysis framework. Journal of Information Technology Education: Innovations in Practice, 16(233), 251.
Zurück zum Zitat Bagozzi, R. P., & Yi, Y. (2012). Specification, evaluation, and interpretation of structural equation models. Journal of the Academy of Marketing Science, 40(1), 8–34.CrossRef Bagozzi, R. P., & Yi, Y. (2012). Specification, evaluation, and interpretation of structural equation models. Journal of the Academy of Marketing Science, 40(1), 8–34.CrossRef
Zurück zum Zitat Bayne, S., & Ross, J. (2014). The pedagogy of the Massive Open Online Course: the UK view (pp. 1–76). York: The Higher Education Academy. Bayne, S., & Ross, J. (2014). The pedagogy of the Massive Open Online Course: the UK view (pp. 1–76). York: The Higher Education Academy.
Zurück zum Zitat Chang, R. I., Hung, Y. H., & Lin, C. F. (2015). Survey of learning experiences and influence of learning style preferences on user intentions regarding MOOCs. British Journal of Educational Technology, 46(3), 528–541.CrossRef Chang, R. I., Hung, Y. H., & Lin, C. F. (2015). Survey of learning experiences and influence of learning style preferences on user intentions regarding MOOCs. British Journal of Educational Technology, 46(3), 528–541.CrossRef
Zurück zum Zitat Creelman, A., Ehlers, U.-D., & Ossiannilsson, E. (2014). Perspectives on MOOC quality – An account of the EFQUEL MOOC quality project. International Journal for Innovation and Quality and in Learning (INNOQUAL), September (3), 78-87 Creelman, A., Ehlers, U.-D., & Ossiannilsson, E. (2014). Perspectives on MOOC quality – An account of the EFQUEL MOOC quality project. International Journal for Innovation and Quality and in Learning (INNOQUAL), September (3), 78-87
Zurück zum Zitat DeLone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success: A ten-year update. Journal of Management Information Systems, 19(4), 9–30.CrossRef DeLone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success: A ten-year update. Journal of Management Information Systems, 19(4), 9–30.CrossRef
Zurück zum Zitat Dong, T.-P., Cheng, N.-C., & Wu, Y.-C. J. (2014). A study of the social networking website service in digital content industries: The Facebook case in Taiwan. Computers in Human Behavior, 30, 708–714.CrossRef Dong, T.-P., Cheng, N.-C., & Wu, Y.-C. J. (2014). A study of the social networking website service in digital content industries: The Facebook case in Taiwan. Computers in Human Behavior, 30, 708–714.CrossRef
Zurück zum Zitat Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50.CrossRef Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50.CrossRef
Zurück zum Zitat Gameel, B. G. (2017). Learner satisfaction with massive open online courses. American Journal of Distance Education, 31(2), 98–111.MathSciNetCrossRef Gameel, B. G. (2017). Learner satisfaction with massive open online courses. American Journal of Distance Education, 31(2), 98–111.MathSciNetCrossRef
Zurück zum Zitat George, D., & Mallery, P. (2012). IBM SPSS statistics 19 step by step: A simple guide and reference (12th ed). Boston: Pearson. George, D., & Mallery, P. (2012). IBM SPSS statistics 19 step by step: A simple guide and reference (12th ed). Boston: Pearson.
Zurück zum Zitat Gutiérrez-Santiuste, E., Gámiz-Sánchez, V. M., & Gutiérrez-Pérez, J. (2015). MOOC & B-learning: Students' barriers and satisfaction in formal and non-formal learning environments. Journal of Interactive Online Learning, 13(3). Gutiérrez-Santiuste, E., Gámiz-Sánchez, V. M., & Gutiérrez-Pérez, J. (2015). MOOC & B-learning: Students' barriers and satisfaction in formal and non-formal learning environments. Journal of Interactive Online Learning, 13(3).
Zurück zum Zitat Hair, J. F., Black, W. C., Babin, B., Anderson, R. E., & Ronald, L. T. (2006a). Multivariate data analysis (5th ed.). Englewood Cliffs: Prentice Hall. Hair, J. F., Black, W. C., Babin, B., Anderson, R. E., & Ronald, L. T. (2006a). Multivariate data analysis (5th ed.). Englewood Cliffs: Prentice Hall.
Zurück zum Zitat Hair, J., Black, W., Babin, B., Anderson, R., & Tatham, R. (2006b). Multivariate Data Analysis (6th ed.). Upper Saddle River: Pearson Prentice Hall. Hair, J., Black, W., Babin, B., Anderson, R., & Tatham, R. (2006b). Multivariate Data Analysis (6th ed.). Upper Saddle River: Pearson Prentice Hall.
Zurück zum Zitat Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2014). A primer on partial least squares structural equation modeling (PLS-SEM). Thousand Oaks: SAGE.MATH Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2014). A primer on partial least squares structural equation modeling (PLS-SEM). Thousand Oaks: SAGE.MATH
Zurück zum Zitat Jansen, D., Rosewell, J., & Kear, K. (2017). Quality frameworks for MOOCs. In Open Education: from OERs to MOOCs (pp. 261–281). Springer, Berlin. Jansen, D., Rosewell, J., & Kear, K. (2017). Quality frameworks for MOOCs. In Open Education: from OERs to MOOCs (pp. 261–281). Springer, Berlin.
Zurück zum Zitat Kevan, J. M., Menchaca, M. P., & Hoffman, E. S. (2016). Designing MOOCs for success: A student motivation-oriented framework. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (pp. 274-278). ACM. Kevan, J. M., Menchaca, M. P., & Hoffman, E. S. (2016). Designing MOOCs for success: A student motivation-oriented framework. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (pp. 274-278). ACM.
Zurück zum Zitat Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575.CrossRef Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575.CrossRef
Zurück zum Zitat Liaw, S. S., & Huang, H. M. (2013). Perceived satisfaction, perceived usefulness and interactive learning environments as predictors to self-regulation in e-learning environments. Computers & Education, 60(1), 14–24. Liaw, S. S., & Huang, H. M. (2013). Perceived satisfaction, perceived usefulness and interactive learning environments as predictors to self-regulation in e-learning environments. Computers & Education, 60(1), 14–24.
Zurück zum Zitat Lwoga, E. T. (2014). Critical success factors for the adoption of web-based learning management systems in Tanzania. International Journal of Education and Development using Information and Communication Technology, 10(1), 4–21. Lwoga, E. T. (2014). Critical success factors for the adoption of web-based learning management systems in Tanzania. International Journal of Education and Development using Information and Communication Technology, 10(1), 4–21.
Zurück zum Zitat Manalo, J. M. A. (2014). An evaluation of participants’ levels of satisfaction and perceived learning regarding the MOOC in@ RAL platform. Malaysian Journal of Distance Education, 16(1), 101–121. Manalo, J. M. A. (2014). An evaluation of participants’ levels of satisfaction and perceived learning regarding the MOOC in@ RAL platform. Malaysian Journal of Distance Education, 16(1), 101–121.
Zurück zum Zitat Margaryan, A., Bianco, M., & Littlejohn, A. (2015). Instructional quality of massive open online courses (MOOCs). Computers & Education, 80, 77–83.CrossRef Margaryan, A., Bianco, M., & Littlejohn, A. (2015). Instructional quality of massive open online courses (MOOCs). Computers & Education, 80, 77–83.CrossRef
Zurück zum Zitat Nagashima, T. (2014). What makes open education thrive? Examination of factors contributing the success of open education initiatives. International Journal for Innovation and Quality and in Learning (INNOQUAL), September (3), 10-21. Nagashima, T. (2014). What makes open education thrive? Examination of factors contributing the success of open education initiatives. International Journal for Innovation and Quality and in Learning (INNOQUAL), September (3), 10-21.
Zurück zum Zitat Newman, I., Newman, D., & Newman, C. (2011). Writing research articles using mixed methods: methodological considerations to help you get published. In The handbook of scholarly writing and publishing (pp. 191–208). San Francisco: Jossey-Bass. Newman, I., Newman, D., & Newman, C. (2011). Writing research articles using mixed methods: methodological considerations to help you get published. In The handbook of scholarly writing and publishing (pp. 191–208). San Francisco: Jossey-Bass.
Zurück zum Zitat Nunnally, J., & Bernstein, I. H. (1991). Psychometric theory. New York: McGraw-Hill. Nunnally, J., & Bernstein, I. H. (1991). Psychometric theory. New York: McGraw-Hill.
Zurück zum Zitat Ozkan, S., Koseler, R., & Baykal, N. (2009). Evaluating learning management systems: Adoption of hexagonal e-learning assessment model in higher education. Transforming Government: People, Process and Policy, 3(2), 111–130.CrossRef Ozkan, S., Koseler, R., & Baykal, N. (2009). Evaluating learning management systems: Adoption of hexagonal e-learning assessment model in higher education. Transforming Government: People, Process and Policy, 3(2), 111–130.CrossRef
Zurück zum Zitat Peugh, J. L., & Enders, C. K. (2005). Using the SPSS mixed procedure to fit cross-sectional and longitudinal multilevel models. Educational and Psychological Measurement, 65, 714–741.MathSciNetCrossRef Peugh, J. L., & Enders, C. K. (2005). Using the SPSS mixed procedure to fit cross-sectional and longitudinal multilevel models. Educational and Psychological Measurement, 65, 714–741.MathSciNetCrossRef
Zurück zum Zitat Rai, L., & Chunrao, D. (2016). Influencing factors of success and failure in MOOC and general analysis of learner behavior. International Journal of Information and Education Technology, 6(4), 262–268.CrossRef Rai, L., & Chunrao, D. (2016). Influencing factors of success and failure in MOOC and general analysis of learner behavior. International Journal of Information and Education Technology, 6(4), 262–268.CrossRef
Zurück zum Zitat Rhema, A., & Miliszewska, I. (2014). Analysis of student attitudes towards e-learning: The case of engineering students in Libya. Issues in informing science and information Technology, 11(1), 169–190.CrossRef Rhema, A., & Miliszewska, I. (2014). Analysis of student attitudes towards e-learning: The case of engineering students in Libya. Issues in informing science and information Technology, 11(1), 169–190.CrossRef
Zurück zum Zitat Rosewell, J., & Jansen, D. (2014). The OpenupEd quality label: Benchmarks for MOOCs. INNOQUAL: The International Journal for Innovation and Quality in Learning, 2(3), 88–100. Rosewell, J., & Jansen, D. (2014). The OpenupEd quality label: Benchmarks for MOOCs. INNOQUAL: The International Journal for Innovation and Quality in Learning, 2(3), 88–100.
Zurück zum Zitat Saadatdoost, R., Sim, A. T. H., Jafarkarimi, H., & Mei Hee, J. (2015). Exploring MOOC from education and information systems perspectives: A short literature review. Educational Review, 67(4), 505–518.CrossRef Saadatdoost, R., Sim, A. T. H., Jafarkarimi, H., & Mei Hee, J. (2015). Exploring MOOC from education and information systems perspectives: A short literature review. Educational Review, 67(4), 505–518.CrossRef
Zurück zum Zitat Samarasinghe, S. M. (2012). E-learning systems success in an organisational context: A thesis presented in partial fulfilment of the requirements for the degree of doctor of philosophy in management information Systems at Massey University, Palmerston North, New Zealand (Doctoral dissertation, Massey University). Retrieved from http://hdl.handle.net/10179/4726 Samarasinghe, S. M. (2012). E-learning systems success in an organisational context: A thesis presented in partial fulfilment of the requirements for the degree of doctor of philosophy in management information Systems at Massey University, Palmerston North, New Zealand (Doctoral dissertation, Massey University). Retrieved from http://​hdl.​handle.​net/​10179/​4726
Zurück zum Zitat Sang, S., Lee, J. D., & Lee, J. (2010). E-government adoption in Cambodia: A partial least squares approach. Transforming Government: People, Process and Policy, 4(2), 138–157.CrossRef Sang, S., Lee, J. D., & Lee, J. (2010). E-government adoption in Cambodia: A partial least squares approach. Transforming Government: People, Process and Policy, 4(2), 138–157.CrossRef
Zurück zum Zitat Sarstedt, M., & Mooi, E. A. (2014). A concise guide to market research. The process, data, and methods using IBM SPSS statistics. Berlin: Springer. Sarstedt, M., & Mooi, E. A. (2014). A concise guide to market research. The process, data, and methods using IBM SPSS statistics. Berlin: Springer.
Zurück zum Zitat Soffer, T., & Cohen, A. (2015). Implementation of Tel Aviv University MOOCs in academic curriculum: A pilot study. The International Review of Research in Open and Distributed Learning, 16(1). Soffer, T., & Cohen, A. (2015). Implementation of Tel Aviv University MOOCs in academic curriculum: A pilot study. The International Review of Research in Open and Distributed Learning, 16(1).
Zurück zum Zitat Sun, P., Tasi, R. J., Finger, G., & Chen, Y. (2008). What drives a successful e- learning? An empirical investigation of the critical factors influencing learner satisfaction. Computers & Education, 50(4), 1183–1202.CrossRef Sun, P., Tasi, R. J., Finger, G., & Chen, Y. (2008). What drives a successful e- learning? An empirical investigation of the critical factors influencing learner satisfaction. Computers & Education, 50(4), 1183–1202.CrossRef
Zurück zum Zitat Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics., 6th edition. Boston: Pearson Education. Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics., 6th edition. Boston: Pearson Education.
Zurück zum Zitat Walker, L., & Loch, B. (2014). Academics’ perceptions on the quality of MOOCs: An empirical study. INNOQUAL-International Journal for Innovation and Quality in Learning, 2(3), 53–63. Walker, L., & Loch, B. (2014). Academics’ perceptions on the quality of MOOCs: An empirical study. INNOQUAL-International Journal for Innovation and Quality in Learning, 2(3), 53–63.
Zurück zum Zitat Yakubu, M. N., & Dasuki, S. (2018). Assessing eLearning systems success in Nigeria: An application of the DeLone and McLean information systems success model. Journal of Information Technology Education: Research, 17, 183–203.CrossRef Yakubu, M. N., & Dasuki, S. (2018). Assessing eLearning systems success in Nigeria: An application of the DeLone and McLean information systems success model. Journal of Information Technology Education: Research, 17, 183–203.CrossRef
Zurück zum Zitat Yang, H. H., & Su, C. H. (2017). Learner behaviour in a MOOC practice-oriented course: In empirical study integrating TAM and TPB. The International Review of Research in Open and Distributed Learning, 18(5). Yang, H. H., & Su, C. H. (2017). Learner behaviour in a MOOC practice-oriented course: In empirical study integrating TAM and TPB. The International Review of Research in Open and Distributed Learning, 18(5).
Zurück zum Zitat Yang, M., Shao, Z., Liu, Q., & Liu, C. (2017). Understanding the quality factors that influence the continuance intention of students toward participation in MOOCs. Educational Technology Research and Development, 65(5), 1195–1214.CrossRef Yang, M., Shao, Z., Liu, Q., & Liu, C. (2017). Understanding the quality factors that influence the continuance intention of students toward participation in MOOCs. Educational Technology Research and Development, 65(5), 1195–1214.CrossRef
Zurück zum Zitat Yepes-Baldó, M., Romeo, M., Martín, C., García, M. Á., Monzó, G., & Besolí, A. (2016). Quality indicators: Developing “MOOCs” in the european higher education area. Educational Media International, 53(3), 184–197.CrossRef Yepes-Baldó, M., Romeo, M., Martín, C., García, M. Á., Monzó, G., & Besolí, A. (2016). Quality indicators: Developing “MOOCs” in the european higher education area. Educational Media International, 53(3), 184–197.CrossRef
Zurück zum Zitat Yousef, A. M. F., Chatti, M. A., Schroeder, U., & Wosnitza, M. (2014). What drives a successful MOOC? An empirical examination of criteria to assure design quality of MOOCs. In Advanced Learning Technologies (ICALT), 2014 IEEE 14th International Conference on (pp. 44–48). IEEE. https://doi.org/10.1109/ICALT.2014.23. Yousef, A. M. F., Chatti, M. A., Schroeder, U., & Wosnitza, M. (2014). What drives a successful MOOC? An empirical examination of criteria to assure design quality of MOOCs. In Advanced Learning Technologies (ICALT), 2014 IEEE 14th International Conference on (pp. 44–48). IEEE. https://​doi.​org/​10.​1109/​ICALT.​2014.​23.
Metadaten
Titel
Development and validation of the MOOC success scale (MOOC-SS)
verfasst von
Nour Awni Albelbisi
Publikationsdatum
22.04.2020
Verlag
Springer US
Erschienen in
Education and Information Technologies / Ausgabe 5/2020
Print ISSN: 1360-2357
Elektronische ISSN: 1573-7608
DOI
https://doi.org/10.1007/s10639-020-10186-4

Weitere Artikel der Ausgabe 5/2020

Education and Information Technologies 5/2020 Zur Ausgabe

Premium Partner