ABSTRACT
Informal learning procedures have been changing extremely fast over the recent decades not only due to the advent of online learning, but also due to changes in what humans need to learn to meet their various life and career goals. Consequently, online, educational platforms are expected to provide personalized, up-to-date curricula to assist learners. Therefore, in this paper, we propose an Artificial Intelligence (AI) and Crowdsourcing based approach to create and update curricula for individual learners. We show the design of this curriculum development system prototype, in which contributors receive AI-based recommendations to be able to define and update high-level learning goals, skills, and learning topics together with associated learning content. This curriculum development system was also integrated into our personalized online learning platform. To evaluate our prototype we compared experts’ opinion with our system’s recommendations, and resulted in 89%, 79%, and 93% F1-scores when recommending skills, learning topics, and educational materials respectively. Also, we interviewed eight senior level experts from educational institutions and career consulting organizations. Interviewees agreed that our curriculum development method has high potential to support authoring activities in dynamic, personalized learning environments.
- Hamdan Alamri, Victoria Lowell, William Watson, and Sunnie Lee Watson. 2020. Using personalized learning as an instructional approach to motivate learners in online higher education: Learner self-determination and intrinsic motivation. Journal of Research on Technology in Education 52, 3 (2020), 322–352.Google ScholarCross Ref
- Naomi Berman. 2020. A critical examination of informal learning spaces. Higher Education Research & Development 39, 1 (2020), 127–140.Google ScholarCross Ref
- Andrew Cross, Mydhili Bayyapunedi, Dilip Ravindran, Edward Cutrell, and William Thies. 2014. VidWiki: Enabling the crowd to improve the legibility of online educational videos. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. 1167–1175.Google ScholarDigital Library
- Alireza Farasat, Alexander Nikolaev, Suzanne Miller, and Rahul Gopalsamy. 2017. Crowdlearning: Towards collaborative problem-posing at scale. In Proceedings of the Fourth (2017) ACM Conference on Learning@ Scale. 221–224.Google ScholarDigital Library
- Hamed Jelodar, Yongli Wang, Chi Yuan, Xia Feng, Xiahui Jiang, Yanchao Li, and Liang Zhao. 2019. Latent Dirichlet Allocation (LDA) and Topic modeling: models, applications, a survey. Multimedia Tools and Applications 78, 11 (2019), 15169–15211.Google ScholarDigital Library
- Yuchao Jiang, Daniel Schlagwein, and Boualem Benatallah. 2018. A Review on Crowdsourcing for Education: State of the Art of Literature and Practice.. In PACIS. 180.Google Scholar
- Barbara B Lockee. 2021. Online education in the post-COVID era. Nature Electronics 4, 1 (2021), 5–6.Google ScholarCross Ref
- Mohammadreza Molavi, Mohammadreza Tavakoli, and Gábor Kismihók. 2020. Extracting Topics from Open Educational Resources. In European Conference on Technology Enhanced Learning. Springer, 455–460.Google ScholarDigital Library
- Elham Mousavinasab, Nahid Zarifsanaiey, Sharareh R. Niakan Kalhori, Mahnaz Rakhshan, Leila Keikha, and Marjan Ghazi Saeedi. 2021. Intelligent tutoring systems: a systematic review of characteristics, applications, and evaluation methods. Interactive Learning Environments 29, 1 (2021), 142–163.Google ScholarCross Ref
- Vineet Pandey, Amnon Amir, Justine Debelius, Embriette R Hyde, Tomasz Kosciolek, Rob Knight, and Scott Klemmer. 2017. Gut instinct: Creating scientific theories with online learners. In Proceedings of the 2017 CHI conference on human factors in computing systems. 6825–6836.Google ScholarDigital Library
- Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th annual meeting of the Association for Computational Linguistics. 311–318.Google Scholar
- Mahantesh K Pattanshetti, Sanjay Jasola, Vivek Gupta, and Akshay Rajput. 2018. The open corpus challenge in eLearning. Knowledge Management & E-Learning: An International Journal 10, 1(2018), 67–85.Google Scholar
- Mahantesh K Pattanshetti, Sanjay Jasola, Akshay Rajput, and Vishal Pant. 2021. Proposed eLearning Framework using Open Corpus Web Resources. In 2021 International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies (ICAECT). IEEE, 1–5.Google ScholarCross Ref
- Juan Ramos 2003. Using tf-idf to determine word relevance in document queries. In Proceedings of the first instructional conference on machine learning, Vol. 242. Citeseer, 29–48.Google Scholar
- Michael Röder, Andreas Both, and Alexander Hinneburg. 2015. Exploring the space of topic coherence measures. In Proceedings of the eighth ACM international conference on Web search and data mining. 399–408.Google ScholarDigital Library
- Arturo Rojas-López and Francisco José García-Peñalvo. 2022. Personalized education for a programming course in higher education. In Research Anthology on Computational Thinking, Programming, and Robotics in the Classroom. IGI Global, 344–367.Google Scholar
- Rick L Shearer, Tugce Aldemir, Jana Hitchcock, Jessie Resig, Jessica Driver, and Megan Kohler. 2020. What students want: A vision of a future online learning experience grounded in distance education theory. American Journal of Distance Education 34, 1 (2020), 36–52.Google ScholarCross Ref
- M Somasundaram, P Latha, and SA Saravana Pandian. 2020. Curriculum Design Using Artificial Intelligence (AI) Back Propagation Method. Procedia Computer Science 172 (2020), 134–138.Google ScholarCross Ref
- Osamuyimen Stewart, David Lubensky, and Juan M Huerta. 2010. Crowdsourcing participation inequality: a SCOUT model for the enterprise domain. In Proceedings of the ACM SIGKDD Workshop on Human Computation. 30–33.Google ScholarDigital Library
- Mohammadreza Tavakoli, Mirette Elias, Gábor Kismihok, and Sören Auer. 2020. Quality Prediction of Open Educational Resources - A Metadata-based Approach. International conference on Advanced Learning Technologies (ICALT).Google Scholar
- Mohammadreza Tavakoli, Mirette Elias, Gábor Kismihók, and Sören Auer. 2021. Metadata Analysis of Open Educational Resources. In LAK21: 11th International Learning Analytics and Knowledge Conference. 626–631.Google Scholar
- Mohammadreza Tavakoli, Ali Faraji, Stefan T Mol, and Gábor Kismihók. 2020. OER Recommendations to Support Career Development. IEEE Frontiers in Education (FIE)(2020).Google ScholarDigital Library
- Mohammadreza Tavakoli, Gabor Kismihok, and Stefan T Mol. 2020. Labour Market Information Driven, Personalized, OER Recommendation System for Lifelong Learners. International conference on Computer Supported Education-CSEDU.Google Scholar
- Christian Vom Lehn. 2020. Labor market polarization, the decline of routine work, and technological change: A quantitative analysis. Journal of Monetary Economics 110 (2020), 62–80.Google ScholarCross Ref
- Daniel S Weld, Eytan Adar, Lydia Chilton, Raphael Hoffmann, Eric Horvitz, Mitchell Koch, James Landay, Christopher H Lin, and Mausam Mausam. 2012. Personalized online education—a crowdsourcing challenge. In Workshops at the Twenty-Sixth AAAI Conference on Artificial Intelligence.Google Scholar
- Keng Yang and Hanying Qi. 2021. The Nonlinear Impact of Task Rewards and Duration on Solvers’ Participation Behavior: A Study on Online Crowdsourcing Platform. Journal of Theoretical and Applied Electronic Commerce Research 16, 4(2021), 709–726.Google ScholarCross Ref
- Ling Zhang, James D Basham, and Sohyun Yang. 2020. Understanding the implementation of personalized learning: A research synthesis. Educational Research Review(2020), 100339.Google Scholar
Recommendations
Navigation support for learners in informal learning environments
RecSys '08: Proceedings of the 2008 ACM conference on Recommender systemsThis paper offers an extended abstract of a PhD project that focuses on supporting learners in finding most suitable learning activities in informal learning environments. For this purpose we aim to develop a personal recommender system, which will ...
Iterative Design and Development of UTeach AP Computer Science A Curriculum: A Collaboration Between UTeach CS and A+ College Ready
SIGCSE '20: Proceedings of the 51st ACM Technical Symposium on Computer Science EducationThis poster outlines the goals of and challenges experienced in developing a new project-based Computer Science A curriculum. The curriculum development process was undertaken as a collaboration between curriculum developers from the UTeach Computer ...
Curriculum development for digital libraries
JCDL '06: Proceedings of the 6th ACM/IEEE-CS joint conference on Digital librariesThe Virginia Tech Department of Computer Science (VT CS) and the University of North Carolina at Chapel Hill School of Information and Library Science (UNC SILS) have launched a curriculum development project in the area of digital libraries. ...
Comments