Skip to main content
Erschienen in: Education and Information Technologies 4/2016

17.09.2014

Towards the real-time evaluation of collaborative activities: Integration of an automatic rater of collaboration quality in the classroom from the teacher’s perspective

verfasst von: Irene-Angelica Chounta, Nikolaos Avouris

Erschienen in: Education and Information Technologies | Ausgabe 4/2016

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents the integration of a real time evaluation method of collaboration quality in a monitoring application that supports teachers in class orchestration. The method is implemented as an automatic rater of collaboration quality and studied in a real time scenario of use. We argue that automatic and semi-automatic methods which provide assessments of collaboration quality or detect disorders and anomalies in collaborative activities should be further used to assist class monitoring. To that end, we study the routine of teachers when they monitor computer-supported collaborative activities with respect to the size of the classroom and the support of an automatic rater. We focus on the way the rater affects their task and how it can be further used to empower the practice of teachers.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Avouris, N., Margaritis, M., & Komis, V. (2004). Modelling interaction during small-group synchronous problem-solving activities: The Synergo approach. In Proceedings of ITS 2004 workshop on designing computational models of collaborative learning interaction (pp. 13–18). Avouris, N., Margaritis, M., & Komis, V. (2004). Modelling interaction during small-group synchronous problem-solving activities: The Synergo approach. In Proceedings of ITS 2004 workshop on designing computational models of collaborative learning interaction (pp. 13–18).
Zurück zum Zitat Casamayor, A., Amandi, A., & Campo, M. (2009). Intelligent assistance for teachers in collaborative e-learning environments. Computers & Education, 53(4), 1147–1154.CrossRef Casamayor, A., Amandi, A., & Campo, M. (2009). Intelligent assistance for teachers in collaborative e-learning environments. Computers & Education, 53(4), 1147–1154.CrossRef
Zurück zum Zitat Chan, C. K. K. (2011). Bridging research and practice: Implementing and sustaining knowledge building in Hong Kong classrooms. International Journal of Computer-Supported Collaborative Learning, 6(2), 147–186.CrossRef Chan, C. K. K. (2011). Bridging research and practice: Implementing and sustaining knowledge building in Hong Kong classrooms. International Journal of Computer-Supported Collaborative Learning, 6(2), 147–186.CrossRef
Zurück zum Zitat Chounta, I.-A., & Avouris, N. (2012). Time series analysis of collaborative activities. In V. Herskovic, H. U. Hoppe, M. Jansen, & J. Ziegler (Eds.), Collaboration and technology (pp. 145–152). Berlin Heidelberg: Springer.CrossRef Chounta, I.-A., & Avouris, N. (2012). Time series analysis of collaborative activities. In V. Herskovic, H. U. Hoppe, M. Jansen, & J. Ziegler (Eds.), Collaboration and technology (pp. 145–152). Berlin Heidelberg: Springer.CrossRef
Zurück zum Zitat Chounta, I.-A., & Avouris, N. (2014). It’s all about time: towards the real-time evaluation of collaborative activities. In 14th International Conference on Advanced Learning Technologies, ICALT2014 (pp. 283–285). Athens: IEEE. Chounta, I.-A., & Avouris, N. (2014). It’s all about time: towards the real-time evaluation of collaborative activities. In 14th International Conference on Advanced Learning Technologies, ICALT2014 (pp. 283–285). Athens: IEEE.
Zurück zum Zitat De Groot, R., Drachman, R., Hever, R., Schwarz, B.B., Hoppe, U., Harrer, A., et al. (2007). Computer supported moderation of e-discussions: the ARGUNAUT approach. In Proceedings of the 8th iternational conference on Computer supported collaborative learning (pp. 168–170). International Society of the Learning Sciences. De Groot, R., Drachman, R., Hever, R., Schwarz, B.B., Hoppe, U., Harrer, A., et al. (2007). Computer supported moderation of e-discussions: the ARGUNAUT approach. In Proceedings of the 8th iternational conference on Computer supported collaborative learning (pp. 168–170). International Society of the Learning Sciences.
Zurück zum Zitat de los Constantino-González, M. A., & Suthers, D. D. (2007). An approach for coaching collaboration based on difference recognition and participation tracking. In H. U. Hoppe, H. Ogata, & A. Soller (Eds.), The role of technology in CSCL (pp. 87–113). US: Springer.CrossRef de los Constantino-González, M. A., & Suthers, D. D. (2007). An approach for coaching collaboration based on difference recognition and participation tracking. In H. U. Hoppe, H. Ogata, & A. Soller (Eds.), The role of technology in CSCL (pp. 87–113). US: Springer.CrossRef
Zurück zum Zitat Dillenbourg, P. (1999). What do you mean by collaborative learning? Collaborative-Learning: Cognitive and Computational Approaches, 1–19. Dillenbourg, P. (1999). What do you mean by collaborative learning? Collaborative-Learning: Cognitive and Computational Approaches, 1–19.
Zurück zum Zitat Dillenbourg, P. (2002). Over-scripting CSCL: The risks of blending collaborative learning with instructional design. In P. A. Kirschner (Ed.), Three worlds of CSCL. Can we support CSCL? (pp. 61–91). Heerlen: Open Universiteit Nederland. Dillenbourg, P. (2002). Over-scripting CSCL: The risks of blending collaborative learning with instructional design. In P. A. Kirschner (Ed.), Three worlds of CSCL. Can we support CSCL? (pp. 61–91). Heerlen: Open Universiteit Nederland.
Zurück zum Zitat Dillenbourg, P., & Jermann, P. (2010). Technology for classroom orchestration. In M. S. Khine & I. M. Saleh (Eds.), New science of learning (pp. 525–552). New York: Springer.CrossRef Dillenbourg, P., & Jermann, P. (2010). Technology for classroom orchestration. In M. S. Khine & I. M. Saleh (Eds.), New science of learning (pp. 525–552). New York: Springer.CrossRef
Zurück zum Zitat Dillenbourg, P., Järvelä, S., & Fischer, F. (2009). The evolution of research on computer-supported collaborative learning. In Technology-enhanced learning (pp. 3–19). Springer. Dillenbourg, P., Järvelä, S., & Fischer, F. (2009). The evolution of research on computer-supported collaborative learning. In Technology-enhanced learning (pp. 3–19). Springer.
Zurück zum Zitat Duval, E. (2011). Attention please!: Learning analytics for visualization and recommendation. In Proceedings of the 1st International Conference on Learning Analytics and Knowledge (pp. 9–17). New York, NY, USA: ACM. Duval, E. (2011). Attention please!: Learning analytics for visualization and recommendation. In Proceedings of the 1st International Conference on Learning Analytics and Knowledge (pp. 9–17). New York, NY, USA: ACM.
Zurück zum Zitat Dyckhoff, A. L., Zielke, D., Bültmann, M., Chatti, M. A., & Schroeder, U. (2012). Design and implementation of a learning analytics toolkit for teachers. Educational Technology & Society, 15(3), 58–76. Dyckhoff, A. L., Zielke, D., Bültmann, M., Chatti, M. A., & Schroeder, U. (2012). Design and implementation of a learning analytics toolkit for teachers. Educational Technology & Society, 15(3), 58–76.
Zurück zum Zitat Ferguson, R. (2012). Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5), 304–317.MathSciNetCrossRef Ferguson, R. (2012). Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5), 304–317.MathSciNetCrossRef
Zurück zum Zitat Giorgino, T. (2009). Computing and visualizing dynamic time warping alignments in R: the dtw package. Journal of Statistical Software, 31(7), 1–24.CrossRef Giorgino, T. (2009). Computing and visualizing dynamic time warping alignments in R: the dtw package. Journal of Statistical Software, 31(7), 1–24.CrossRef
Zurück zum Zitat Harrer, A., McLaren, B. M., Walker, E., Bollen, L., & Sewall, J. (2006). Creating cognitive tutors for collaborative learning: Steps toward realization. User Modeling and User-Adapted Interaction, 16(3–4), 175–209.CrossRef Harrer, A., McLaren, B. M., Walker, E., Bollen, L., & Sewall, J. (2006). Creating cognitive tutors for collaborative learning: Steps toward realization. User Modeling and User-Adapted Interaction, 16(3–4), 175–209.CrossRef
Zurück zum Zitat Kahrimanis, G., Meier, A., Chounta, I.-A., Voyiatzaki, E., Spada, H., Rummel, N., & Avouris, N. (2009). Assessing collaboration quality in synchronous CSCL problem-solving activities: Adaptation and empirical evaluation of a rating scheme. In Learning in the Synergy of Multiple Disciplines (pp. 267–272). Springer. Kahrimanis, G., Meier, A., Chounta, I.-A., Voyiatzaki, E., Spada, H., Rummel, N., & Avouris, N. (2009). Assessing collaboration quality in synchronous CSCL problem-solving activities: Adaptation and empirical evaluation of a rating scheme. In Learning in the Synergy of Multiple Disciplines (pp. 267–272). Springer.
Zurück zum Zitat Kahrimanis, G., Avouris, N., & Komis, V. (2011a). Interaction analysis as a tool for supporting collaboration: An overview. In T. Daradoumis, S. Caballé, A. A. Juan, & F. Xhafa (Eds.), Technology-enhanced systems and tools for collaborative learning scaffolding (pp. 93–114). Berlin Heidelberg: Springer.CrossRef Kahrimanis, G., Avouris, N., & Komis, V. (2011a). Interaction analysis as a tool for supporting collaboration: An overview. In T. Daradoumis, S. Caballé, A. A. Juan, & F. Xhafa (Eds.), Technology-enhanced systems and tools for collaborative learning scaffolding (pp. 93–114). Berlin Heidelberg: Springer.CrossRef
Zurück zum Zitat Kahrimanis, G., Chounta, I.-A., & Avouris, N. (2011b). Rating dimensions of collaboration quality in synchronous collaborating dyads: findings and interpretations. In H. Spada, G. Stahl, N. Miyake, & N. Law (Eds.), Connecting Computer-Supported Collaborative Learning to Policy and Practice: CSCL2011 Conference Proceedings (Vol. 1, pp. 446–453). Hong Kong, China. Kahrimanis, G., Chounta, I.-A., & Avouris, N. (2011b). Rating dimensions of collaboration quality in synchronous collaborating dyads: findings and interpretations. In H. Spada, G. Stahl, N. Miyake, & N. Law (Eds.), Connecting Computer-Supported Collaborative Learning to Policy and Practice: CSCL2011 Conference Proceedings (Vol. 1, pp. 446–453). Hong Kong, China.
Zurück zum Zitat Kahrimanis, G., Chounta, I.-A., & Avouris, N. (2012). Validating empirically a rating approach for quantifying the quality of collaboration. In Intelligent adaptation and personalization techniques in computer-supported collaborative learning (pp. 295–310). Springer. Kahrimanis, G., Chounta, I.-A., & Avouris, N. (2012). Validating empirically a rating approach for quantifying the quality of collaboration. In Intelligent adaptation and personalization techniques in computer-supported collaborative learning (pp. 295–310). Springer.
Zurück zum Zitat Martínez-Monés, A., Harrer, A., & Dimitriadis, Y. (2011). An interaction-aware design process for the integration of interaction analysis into mainstream CSCL practices. In S. Puntambekar, G. Erkens, & C. Hmelo-Silver (Eds.), Analyzing interactions in CSCL (pp. 269–291). US: Springer.CrossRef Martínez-Monés, A., Harrer, A., & Dimitriadis, Y. (2011). An interaction-aware design process for the integration of interaction analysis into mainstream CSCL practices. In S. Puntambekar, G. Erkens, & C. Hmelo-Silver (Eds.), Analyzing interactions in CSCL (pp. 269–291). US: Springer.CrossRef
Zurück zum Zitat Rodríguez-Triana, M. J., Martínez-Monés, A., Asensio-Pérez, J.I., & Dimitriadis, Y. (2014). Scripting and monitoring meet each other: Aligning learning analytics and learning design to support teachers in orchestrating CSCL situations. British Journal of Educational Technology. Rodríguez-Triana, M. J., Martínez-Monés, A., Asensio-Pérez, J.I., & Dimitriadis, Y. (2014). Scripting and monitoring meet each other: Aligning learning analytics and learning design to support teachers in orchestrating CSCL situations. British Journal of Educational Technology.
Zurück zum Zitat Schümmer, T., Strijbos, J.-W., & Berkel, T. (2005). A new direction for log file analysis in CSCL: Experiences with a spatio-temporal metric. In Proceedings of th 2005 conference on Computer support for collaborative learning: learning 2005: the next 10 years! (pp. 567–576). International Society of the Learning Sciences. Schümmer, T., Strijbos, J.-W., & Berkel, T. (2005). A new direction for log file analysis in CSCL: Experiences with a spatio-temporal metric. In Proceedings of th 2005 conference on Computer support for collaborative learning: learning 2005: the next 10 years! (pp. 567–576). International Society of the Learning Sciences.
Zurück zum Zitat Soller, A., Martínez, A., Jermann, P., & Muehlenbrock, M. (2005). From mirroring to guiding: A review of state of the art technology for supporting collaborative learning. International Journal of Artificial Intelligence in Education, 15(4), 261–290. Soller, A., Martínez, A., Jermann, P., & Muehlenbrock, M. (2005). From mirroring to guiding: A review of state of the art technology for supporting collaborative learning. International Journal of Artificial Intelligence in Education, 15(4), 261–290.
Zurück zum Zitat Spada, H., Meier, A., Rummel, N., & Hauser, S. (2005). A new method to assess the quality of collaborative process in CSCL. In Proceedings of th 2005 Conference on Computer Support for Collaborative Learning: Learning 2005: The Next 10 Years! (pp. 622–631). Taipei, Taiwan: International Society of the Learning Sciences. Spada, H., Meier, A., Rummel, N., & Hauser, S. (2005). A new method to assess the quality of collaborative process in CSCL. In Proceedings of th 2005 Conference on Computer Support for Collaborative Learning: Learning 2005: The Next 10 Years! (pp. 622–631). Taipei, Taiwan: International Society of the Learning Sciences.
Zurück zum Zitat Stahl, G. (2002). Rediscovering CSCL. In Cscl (Vol. 2, pp. 169–181). Stahl, G. (2002). Rediscovering CSCL. In Cscl (Vol. 2, pp. 169–181).
Zurück zum Zitat Stahl, G. (2007). Meaning making in CSCL: Conditions and preconditions for cognitive processes by groups. In Proceedings of the 8th Iternational Conference on Computer Supported Collaborative Learning (pp. 652–661). New Brunswick, New Jersey, USA: International Society of the Learning Sciences. Stahl, G. (2007). Meaning making in CSCL: Conditions and preconditions for cognitive processes by groups. In Proceedings of the 8th Iternational Conference on Computer Supported Collaborative Learning (pp. 652–661). New Brunswick, New Jersey, USA: International Society of the Learning Sciences.
Zurück zum Zitat Stahl, G., Koschmann, T., & Suthers, D. (2006). Computer-supported collaborative learning: An historical perspective. Cambridge Handbook of the Learning Sciences, 2006. Stahl, G., Koschmann, T., & Suthers, D. (2006). Computer-supported collaborative learning: An historical perspective. Cambridge Handbook of the Learning Sciences, 2006.
Zurück zum Zitat Suthers, D. D., Dwyer, N., Medina, R., & Vatrapu, R. (2010). A framework for conceptualizing, representing, and analyzing distributed interaction. International Journal of Computer-Supported Collaborative Learning, 5(1), 5–42.CrossRef Suthers, D. D., Dwyer, N., Medina, R., & Vatrapu, R. (2010). A framework for conceptualizing, representing, and analyzing distributed interaction. International Journal of Computer-Supported Collaborative Learning, 5(1), 5–42.CrossRef
Zurück zum Zitat Team, R. C., & others. (2012). R: a language and environment for statistical computing. Team, R. C., & others. (2012). R: a language and environment for statistical computing.
Zurück zum Zitat Van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2013). Teacher interventions in a synchronous, co-located CSCL setting: Analyzing focus, means, and temporality. Computers in Human Behavior, 29(4), 1377–1386.CrossRef Van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2013). Teacher interventions in a synchronous, co-located CSCL setting: Analyzing focus, means, and temporality. Computers in Human Behavior, 29(4), 1377–1386.CrossRef
Zurück zum Zitat Van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2014). Supporting teachers in guiding collaborating students: Effects of learning analytics in CSCL. Computers & Education. Van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2014). Supporting teachers in guiding collaborating students: Effects of learning analytics in CSCL. Computers & Education.
Zurück zum Zitat Voyiatzaki, E., & Avouris, N. (2014). Support for the teacher in technology-enhanced collaborative classroom. Education and Information Technologies, 19(1), 129–154.CrossRef Voyiatzaki, E., & Avouris, N. (2014). Support for the teacher in technology-enhanced collaborative classroom. Education and Information Technologies, 19(1), 129–154.CrossRef
Zurück zum Zitat Voyiatzaki, E., Polyzos, P., & Avouris, N. (2008). Teacher tools in a networked learning classroom: monitor, view and interpret interaction data. In Proceedings of the 6th Networked Learning Conference (pp. 849–850). Halkidiki, Greece. Voyiatzaki, E., Polyzos, P., & Avouris, N. (2008). Teacher tools in a networked learning classroom: monitor, view and interpret interaction data. In Proceedings of the 6th Networked Learning Conference (pp. 849–850). Halkidiki, Greece.
Zurück zum Zitat Weinberger, A., & Fischer, F. (2006). A framework to analyze argumentative knowledge construction in computer-supported collaborative learning. Computers & Education, 46(1), 71–95.CrossRef Weinberger, A., & Fischer, F. (2006). A framework to analyze argumentative knowledge construction in computer-supported collaborative learning. Computers & Education, 46(1), 71–95.CrossRef
Zurück zum Zitat Wichmann, A., Giemza, A., Hoppe, U., & Krauß, M. (2009). Effects of awareness support on moderating multiple parallel E-discussions. In Proceedings of the 9th International Conference on Computer Supported Collaborative Learning - Volume 1 (pp. 646–650). Rhodes, Greece: International Society of the Learning Sciences. Wichmann, A., Giemza, A., Hoppe, U., & Krauß, M. (2009). Effects of awareness support on moderating multiple parallel E-discussions. In Proceedings of the 9th International Conference on Computer Supported Collaborative Learning - Volume 1 (pp. 646–650). Rhodes, Greece: International Society of the Learning Sciences.
Zurück zum Zitat Woo, Y., & Reeves, T. C. (2007). Meaningful interaction in web-based learning: A social constructivist interpretation. The Internet and Higher Education, 10(1), 15–25.CrossRef Woo, Y., & Reeves, T. C. (2007). Meaningful interaction in web-based learning: A social constructivist interpretation. The Internet and Higher Education, 10(1), 15–25.CrossRef
Metadaten
Titel
Towards the real-time evaluation of collaborative activities: Integration of an automatic rater of collaboration quality in the classroom from the teacher’s perspective
verfasst von
Irene-Angelica Chounta
Nikolaos Avouris
Publikationsdatum
17.09.2014
Verlag
Springer US
Erschienen in
Education and Information Technologies / Ausgabe 4/2016
Print ISSN: 1360-2357
Elektronische ISSN: 1573-7608
DOI
https://doi.org/10.1007/s10639-014-9355-3

Weitere Artikel der Ausgabe 4/2016

Education and Information Technologies 4/2016 Zur Ausgabe