Skip to main content

2017 | OriginalPaper | Buchkapitel

Assessing the Performance of a Tourism MOOC Using the Kirkpatrick Model: A Supplier’s Point of View

verfasst von : Jingjing Lin, Lorenzo Cantoni

Erschienen in: Information and Communication Technologies in Tourism 2017

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents the evaluation methods and results of a pilot tourism MOOC (Massive Open Online Course) called eTourism: Communication Perspectives, based on the Kirkpatrick model. It assigned twelve indicators to the model’s four levels of evaluation (reaction, learning, behaviour, results). Indicators include: self-efficacy and motivation, satisfaction, relevance, course performance, collaborative learning, higher-order learning, reflective and integrative learning, skills development, post-course practices, corporate social responsibility, public relations, and marketing. With various measurement tools such as pre-, in- and post-course surveys, post-course interviews, and analytics data by the host platform, the paper explains the available data with the twelve indicators and provides meaningful performance assessment for the MOOC. Results show that the MOOC was successful in all four levels according to the twelve indicators. The limitations and the future directions are also discussed at the end of the study.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Alario-Hoyos, C., Pérez-Sanagustín, M., Delgado-Kloos, C., & Munoz-Organero, M. (2014). Delving into participants’ profiles and use of social tools in MOOCs. IEEE Transactions on Learning Technologies, 3(7), 260–266.CrossRef Alario-Hoyos, C., Pérez-Sanagustín, M., Delgado-Kloos, C., & Munoz-Organero, M. (2014). Delving into participants’ profiles and use of social tools in MOOCs. IEEE Transactions on Learning Technologies, 3(7), 260–266.CrossRef
Zurück zum Zitat Bates, R. (2004). A critical analysis of evaluation practice: The Kirkpatrick model and the principle of beneficence. Evaluation and Program Planning, 27(3), 341–347.CrossRef Bates, R. (2004). A critical analysis of evaluation practice: The Kirkpatrick model and the principle of beneficence. Evaluation and Program Planning, 27(3), 341–347.CrossRef
Zurück zum Zitat Bradley, K., & Connors, E. (2007). Training evaluation model: Evaluating and improving criminal justice training. Retrieved August 18, 2016, from http://bit.ly/2dkiU4j. Bradley, K., & Connors, E. (2007). Training evaluation model: Evaluating and improving criminal justice training. Retrieved August 18, 2016, from http://​bit.​ly/​2dkiU4j.
Zurück zum Zitat Creelman, A., Ehlers, U., & Ossiannilsson, E. (2014). Perspectives on MOOC quality-an account of the EFQUEL MOOC quality project. INNOQUAL-International Journal for Innovation and Quality in Learning, 2(3), 78–87. Creelman, A., Ehlers, U., & Ossiannilsson, E. (2014). Perspectives on MOOC quality-an account of the EFQUEL MOOC quality project. INNOQUAL-International Journal for Innovation and Quality in Learning, 2(3), 78–87.
Zurück zum Zitat Cross, S. (2013). Evaluation of the OLDS MOOC curriculum design course: Participant perspectives, expectations and experiences. Retrieved September 4, 2016, from http://bit.ly/2eiihJL. Cross, S. (2013). Evaluation of the OLDS MOOC curriculum design course: Participant perspectives, expectations and experiences. Retrieved September 4, 2016, from http://​bit.​ly/​2eiihJL.
Zurück zum Zitat Douglas, K. A., Mihalec-Adkins, B. P., Hicks, N. M., & Diefes-Dux, H. A. (2016). Learners in advanced nanotechnology MOOCs: Understanding their intention and motivation. Retrieved October 18, 2016 from http://bit.ly/2eoIIIm. Douglas, K. A., Mihalec-Adkins, B. P., Hicks, N. M., & Diefes-Dux, H. A. (2016). Learners in advanced nanotechnology MOOCs: Understanding their intention and motivation. Retrieved October 18, 2016 from http://​bit.​ly/​2eoIIIm.
Zurück zum Zitat Gamage, D., Fernando, S., & Perera, I. (2015). Quality of MOOCs: A review of literature on effectiveness and quality aspects. Education, 121, 2. Gamage, D., Fernando, S., & Perera, I. (2015). Quality of MOOCs: A review of literature on effectiveness and quality aspects. Education, 121, 2.
Zurück zum Zitat Jordan, K. (2014). Initial trends in enrolment and completion of massive open online courses. The International Review of Research in Open and Distributed Learning, 15(1). Jordan, K. (2014). Initial trends in enrolment and completion of massive open online courses. The International Review of Research in Open and Distributed Learning, 15(1).
Zurück zum Zitat Khalil, M., Brunner, H., & Ebner, M. (2015). Evaluation grid for xMOOCs. International Journal of Emerging Technologies in Learning (iJET), 10(4). Khalil, M., Brunner, H., & Ebner, M. (2015). Evaluation grid for xMOOCs. International Journal of Emerging Technologies in Learning (iJET), 10(4).
Zurück zum Zitat Khalil, H., & Ebner, M. (2014). MOOCs completion rates and possible methods to improve retention-a literature review. In EdMedia: World Conference on Educational Media and Technology (Vol. 2014, No. 1, pp. 1305–1313). Khalil, H., & Ebner, M. (2014). MOOCs completion rates and possible methods to improve retention-a literature review. In EdMedia: World Conference on Educational Media and Technology (Vol. 2014, No. 1, pp. 1305–1313).
Zurück zum Zitat Kirkpatrick, D. (1975). Evaluating training programs. Tata McGraw-Hill Education. Kirkpatrick, D. (1975). Evaluating training programs. Tata McGraw-Hill Education.
Zurück zum Zitat Lesjak, B., & Florjancic, V. (2014). Evaluation of MOOC: Hands-On project or creative use of ict in teaching. In Human Capital without Borders: Knowledge and Learning for Quality of Life; Proceedings of the Management, Knowledge and Learning International Conference 2014 (pp. 1147–1155). ToKnowPress. Lesjak, B., & Florjancic, V. (2014). Evaluation of MOOC: Hands-On project or creative use of ict in teaching. In Human Capital without Borders: Knowledge and Learning for Quality of Life; Proceedings of the Management, Knowledge and Learning International Conference 2014 (pp. 1147–1155). ToKnowPress.
Zurück zum Zitat Lin, J., Cantoni, L., & Kalbaska, N. (2016). How to develop and evaluate an eTourism MOOC: An experience in progress. e-Review of Tourism Research (eRTR), 7, 1–5. Lin, J., Cantoni, L., & Kalbaska, N. (2016). How to develop and evaluate an eTourism MOOC: An experience in progress. e-Review of Tourism Research (eRTR), 7, 1–5.
Zurück zum Zitat Lin, J., Kalbaska, N., Cantoni, L., & Murphy, J. (2016). A new framework to describe and analyse MOOC design: Multiple case study of hospitality and tourism MOOCs. Revised and resubmitted for publication. Lin, J., Kalbaska, N., Cantoni, L., & Murphy, J. (2016). A new framework to describe and analyse MOOC design: Multiple case study of hospitality and tourism MOOCs. Revised and resubmitted for publication.
Zurück zum Zitat Murphy, J., Tracey, J. B., & Horton-Tognazzini, L. (2016). MOOC camp: A flipped classroom and blended learning model. In Information and Communication Technologies in Tourism 2016 (pp. 653–665). Springer International Publishing. Murphy, J., Tracey, J. B., & Horton-Tognazzini, L. (2016). MOOC camp: A flipped classroom and blended learning model. In Information and Communication Technologies in Tourism 2016 (pp. 653–665). Springer International Publishing.
Zurück zum Zitat Onah, D. F., Sinclair, J., & Boyatt, R. (2014). Exploring the use of MOOC discussion forums. In Proceedings of London International Conference on Education (pp. 1–4). LICE. Onah, D. F., Sinclair, J., & Boyatt, R. (2014). Exploring the use of MOOC discussion forums. In Proceedings of London International Conference on Education (pp. 1–4). LICE.
Zurück zum Zitat Parra, J. (2016). Moving beyond MOOC mania: Lessons from a faculty-designed MOOC. Current Issues in Emerging eLearning, 3(1), 10. Parra, J. (2016). Moving beyond MOOC mania: Lessons from a faculty-designed MOOC. Current Issues in Emerging eLearning, 3(1), 10.
Zurück zum Zitat Poce, A. (2015). Developing critical perspectives on technology in education: A tool for MOOC evaluation. European Journal of Open, Distance and E-learning, 18(1). Poce, A. (2015). Developing critical perspectives on technology in education: A tool for MOOC evaluation. European Journal of Open, Distance and E-learning, 18(1).
Zurück zum Zitat Rodrigo, C., Read, T., Santamaría, M., & Sánchez-Elvira, A. (2014). OpenupEdLabel for MOOC quality assurance: UNED COMA initial self-evaluation. In Actas del V Congreso Internacional sobre Calidad y Accesibilidad en la Formación Virtual (CAFVIR 2014) (pp. 551–555). Rodrigo, C., Read, T., Santamaría, M., & Sánchez-Elvira, A. (2014). OpenupEdLabel for MOOC quality assurance: UNED COMA initial self-evaluation. In Actas del V Congreso Internacional sobre Calidad y Accesibilidad en la Formación Virtual (CAFVIR 2014) (pp. 551–555).
Zurück zum Zitat Tracey, J. B., Murphy, J., & Horton-Tognazzini, L. (2016). A framework for evaluating MOOCs in applied hospitality and tourism settings. In Information and Communication Technologies in Tourism 2016 (pp. 667–679). Springer International Publishing. Tracey, J. B., Murphy, J., & Horton-Tognazzini, L. (2016). A framework for evaluating MOOCs in applied hospitality and tourism settings. In Information and Communication Technologies in Tourism 2016 (pp. 667–679). Springer International Publishing.
Zurück zum Zitat Wintrup, J., Wakefield, K., & Davis, H. C. (2015). Engaged learning in MOOCs: A study using the UK engagement survey. Wintrup, J., Wakefield, K., & Davis, H. C. (2015). Engaged learning in MOOCs: A study using the UK engagement survey.
Zurück zum Zitat Yousef, A. M. F., Chatti, M. A., Ahmad, I., Schroeder, U., & Wosnitza, M. (2015). An evaluation of learning analytics in a blended MOOC environment. In Proceedings of the Third European MOOCs Stakeholders Summit EMOOCs (pp. 122–130). Yousef, A. M. F., Chatti, M. A., Ahmad, I., Schroeder, U., & Wosnitza, M. (2015). An evaluation of learning analytics in a blended MOOC environment. In Proceedings of the Third European MOOCs Stakeholders Summit EMOOCs (pp. 122–130).
Zurück zum Zitat Yousef, A. M. F., Chatti, M. A., Schroeder, U., & Wosnitza, M. (2015). A usability evaluation of a blended MOOC environment: An experimental case study. The International Review of Research in Open and Distributed Learning, 16(2). Yousef, A. M. F., Chatti, M. A., Schroeder, U., & Wosnitza, M. (2015). A usability evaluation of a blended MOOC environment: An experimental case study. The International Review of Research in Open and Distributed Learning, 16(2).
Metadaten
Titel
Assessing the Performance of a Tourism MOOC Using the Kirkpatrick Model: A Supplier’s Point of View
verfasst von
Jingjing Lin
Lorenzo Cantoni
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-51168-9_10

Premium Partner