skip to main content
10.1145/2669711.2669909acmotherconferencesArticle/Chapter ViewAbstractPublication PagesteemConference Proceedingsconference-collections
research-article

Dealing with complexity: educational data and tools for learning analytics

Published:01 October 2014Publication History

ABSTRACT

The evolution of information technologies and their widespread use have caused an increase in complexity of the educational landscape, as institutions and instructors try to absorb and incorporate these innovations to learning processes. This in turn poses new and countless new challenges to educational research in general, and to new disciplines based on educational data analysis such as learning analytics in particular. In this paper, we introduce the Track on Learning Analytics within the Technological Ecosystems for Enhancing Multiculturality 2014 Conference, a track that aims to present new approaches that allow dealing with this complexity and solving some of these challenges.

The paper provides an overview of the motivations behind the proposal of this track, with a general introduction to learning analytics in this complex context and a presentation of the main challenges in current learning analytics research, both from a data analysis perspective and a tool analysis approach; this introduction is followed by an insight of the submission management and participants' selection process. Then, a detailed summary of the manuscripts accepted for participation in the conference is presented.

References

  1. Agudo-Peregrina, Á. F., Iglesias-Pradas, S., Conde-González, M. Á., and Hernández-García, Á. 2014. Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning. Computers in Human Behavior 31 (February 2014), 542--550. DOI= http://dx.doi.org/10.1016/j.chb.2013.05.031 Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Ali, L., Hatala, M., Gašević, D., Jovanović, J. 2012. A qualitative evaluation of evolution of a learning analytics tool. Computers & Education 58, 1 (January 2012), 470--489. DOI= http://dx.doi.org/10.1016/j.compedu.2011.08.030 Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Amo Filvà, D., Casany Guerrero, M. J., and Alier Forment, M. 2014. Google Analytics for Time Behavior Measurement in moodle. Proceedings of the 9th Iberian Conference on Information Systems and Technologies (Barcelona, Spain, June 18--21, 2014). CISTI 2014. IEEE, 1-6. DOI = http://dx.doi.org/10.1109/CISTI.2014.6877095Google ScholarGoogle Scholar
  4. Arnold, K. E., and Pistilli, M. D. 2012. Course signals at Purdue: using learning analytics to increase student success. Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (Vancouver, British Columbia, Canada, April 29 -- May 2, 2012). LAK '12. ACM, New York, NY, 267--270. DOI= http://dx.doi.org/10.1145/2330601.2330666 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Buckingham-Shum, S., and Ferguson, R. 2012. Social Learning Analytics. Journal of Educational Technology & Society 15, 3 (July 2012), 3--26.Google ScholarGoogle Scholar
  6. Conde, M.Á., and Hernández-García, Á. 2013. A promised land for educational decision-making? Present and future of learning analytics. Proceedings of the First International Conference on Technological Ecosystem for Enhancing Multiculturality (Salamanca, Spain, November 14 - 15, 2013). TEEM '13. ACM, New York, NY, 239--243. DOI= http://dx.doi.org/10.1145/2536536.2536573 Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Dawson, S., Bakharia, A., and Heathcote, A. 2010. SNAPP: Realising the affordances of real-time SNA within networked learning environments. Proceedings of the 7th International Conference on Networked Learning (Aalborg, Denmark, 2010). 125--134.Google ScholarGoogle Scholar
  8. de Waard, I., Abajian, S., Gallagher, M. S., Hogue, R., Keskin, N., Koutropoulos, A., and Rodriguez, O. C. 2011. Using mLearning and MOOCs to understand chaos, emergence, and complexity in education. The International Review of Research in Open and Distance Learning 12, 7 (October 2011), 94--115.Google ScholarGoogle ScholarCross RefCross Ref
  9. Dimopoulos, I., Petropoulou, O., Boloudakis, M., and Retalis, S. 2013. Using Learning Analytics in Moodle for assessing students' performance. 2nd Moodle Research Conference (Sousse, Tunisia, October 4--6, 2013), 40--46.Google ScholarGoogle Scholar
  10. Duval, E. 2014. Learning by numbers. Centro Superior para la Enseñanza Virtual (CSEV), 1--6.Google ScholarGoogle Scholar
  11. Duval, E., and Verbert, K. 2012. Learning Analytics. eleed, 8.Google ScholarGoogle Scholar
  12. Fortenbacher, A., Beuster, L., Elkina, M., Kappe, L., Merceron, A., Pursian, A.; Schwarzrock, S., and Wenzlaff, B. 2013. LeMo: A learning analytics application focussing on user path analysis and interactive visualization. Proceedings of the IEEE 7th International Conference on Intelligent Data Acquisition and Advanced Computing Systems, vol. 2 (September 12--14). IDAACS 2013. IEEE, 748--753. DOI= http://dx.doi.org/10.1109/IDAACS.2013.6663025Google ScholarGoogle Scholar
  13. Gilfus Analytics (2013). Gilfus Analytics - Academic and eLearning Intelligence. Available at: http://www.gilfusacademicanalytics.com/blackboardanalyticsGoogle ScholarGoogle Scholar
  14. Gómez-Aguilar, D. A., García-Peñalvo, F. J., and Therón, R. 2013. Tap into visual analysis of the customization of grouping of activities in eLearning. Proceedings of the First International Conference on Technological Ecosystem for Enhancing Multiculturality (Salamanca, Spain, November 14 - 15, 2013). TEEM '13. ACM, New York, NY, 253--259. DOI= http://dx.doi.org/10.1145/2536536.2536575 Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Gómez-Aguilar, D. A., García-Peñalvo, F. J., and Therón, R. 2014. Analítica Visual en eLearning. El Profesional de la Información 23, (Mayo-Junio 2014), 236--245. DOI= http://dx.doi.org/10.3145/epi.2014.may.03Google ScholarGoogle Scholar
  16. Govaerts, S., Verbert, K., Dahrendorf, D., Ullrich, C., Schmidt, M., Werkle, M., et al. 2011. Towards Responsive Open Learning Environments: The ROLE Interoperability Framework. In C. Delgado Kloos, D. Gillet, R. M. Crespo García, F. Wild, M. (eds.), Towards Ubiquitous Learning. Springer, Berlin Heidelberg, 125--138. DOI= http://dx.doi.org/10.1007/978-3-642-23985-4_11 Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Johnson, L., Adams Becker, S., Estrada, V., Freeman, A. 2014. NMC Horizon Report: 2014 Higher Education Edition. The New Media Consortium, Austin, TX.Google ScholarGoogle Scholar
  18. Kerly, A., Ellis, R., and Bull, S. 2007. CALMsystem: A Conversational Agent for Learner Modelling, in R. Ellis, T. Allen & M. Petridis (eds), Applications and Innovations in Intelligent Systems XV -- Proceedings of AI-2007, 27th SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence- Springer Verlag, 89--102.Google ScholarGoogle Scholar
  19. Leony, D., Pardo, A., de la Fuente Valentín, L., Sánchez de Castro, D., Delgado Kloos, C. 2012. GLASS: a learning analytics visualization tool. Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (Vancouver, British Columbia, Canada, April 29 -- May 2, 2012). LAK '12. ACM, New York, NY, 162--163. DOI= http://dx.doi.org/10.1145/2330601.2330642 Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Long, P., and Siemens, G. 2011. Penetrating the Fog: Analytics in Learning and Education. EDUCAUSE Review 46 (September-October 2011), 31--40.Google ScholarGoogle Scholar
  21. Mazza, R., and Dimitrova, V. 2007. CourseVis: A graphical student monitoring tool for supporting instructors in web-based distance courses. International Journal of Human-Computer Studies 65 (February 2007), 125--139. DOI= http://dx.doi.org/10.1016/j.ijhcs.2006.08.008 Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Mazzolini, M., and Maddison, S. 2003. Sage, guide or ghost? The effect of instructor intervention on student participation in online discussion forums. Computers & Education, 40, 3 (April 2003), 237--253. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Pardo, A., and Siemens, G. 2014. Ethical and privacy principles for learning analytics. British Journal of Educational Technology 45, 3 (May 2014), 438--450.Google ScholarGoogle ScholarCross RefCross Ref
  24. Ramos, C., and Yudko, E. 2008. "Hits" (not "Discussion Posts") predict student success in online courses: A double cross-validation study. Computers & Education, 50, 4 (May 2008), 1174--1182. http://dx.doi.org/10.1016/j.compedu.2006.11.003 Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Romero C., and Ventura, S. 2007. Educational data mining: A survey from 1995 to 2005. Expert Systems with Applications. 33, 1 (July 2007), 135--146. DOI= http://dx.doi.org/10.1016/j.eswa.2006.04.005 Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Romero C., and Ventura, S. 2010. Educational Data Mining: A Review of the State of the Art. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 40, 6 (November 2010), 601--618. DOI= http://dx.doi.org/10.1109/TSMCC.2010.2053532 Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Ruipérez-Valiente, J. A., Muñoz-Merino, P. J., and Delgado-Kloos, C. 2013. An architecture for extending the learning analytics support in the Khan Academy framework. Proceedings of the First International Conference on Technological Ecosystem for Enhancing Multiculturality (Salamanca, Spain, November 14 - 15, 2013). TEEM '13. ACM, New York, NY, 277--284. DOI= http://dx.doi.org/10.1145/2536536.2536578 Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Santos, J. L., Govaerts, S., Verbert, K., and Duval, E. 2012. Goal-oriented visualizations of activity tracking: a case study with engineering students. Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (Vancouver, British Columbia, Canada, April 29 -- May 2, 2012). LAK '12. ACM, New York, NY, 143--152. DOI= http://dx.doi.org/10.1145/2330601.2330639 Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Slade, S., and Prinsloo, P. 2013. Learning Analytics: Ethical Issues and Dilemmas. American Behavioral Scientist 57 (October 2013), 1510--1529. DOI: http://dx.doi.org/10.1177/0002764213479366Google ScholarGoogle Scholar
  30. Verbert, K., Duval, E., Klerkx, J., Govaerts, S., and Santos, J. L. 2013. Learning Analytics Dashboard Applications. American Behavioral Scientist 57, 10 (October 2013), 1500--1509. DOI= http://dx.doi.org/10.1177/0002764213479363Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Dealing with complexity: educational data and tools for learning analytics

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in
              • Published in

                cover image ACM Other conferences
                TEEM '14: Proceedings of the Second International Conference on Technological Ecosystems for Enhancing Multiculturality
                October 2014
                711 pages
                ISBN:9781450328968
                DOI:10.1145/2669711

                Copyright © 2014 ACM

                Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 1 October 2014

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • research-article

                Acceptance Rates

                Overall Acceptance Rate496of705submissions,70%

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader