Skip to main content

2019 | OriginalPaper | Buchkapitel

EduBrowser: A Multimodal Automated Monitoring System for Co-located Collaborative Learning

verfasst von : Yi Han Victoria Chua, Preman Rajalingam, Seng Chee Tan, Justin Dauwels

Erschienen in: Learning Technology for Education Challenges

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Majority of learning analytics systems are designed to monitor and analyze students’ online interactions during collaborative learning. In the case of co-located collaborative learning, student interactions take place in the physical space as well as online. While existing learning management systems provide specific logs and snapshots of students’ online responses that are automatically captured, the potential of insights that can be derived from students’ non-digital face-to-face interactions during collaborative discourse remains untapped. In this paper, we propose an architecture for data acquisition and processing from co-located face-to-face collaborative learning, designed to be scalable beyond dyadic and triadic collaborative learning and across different curricula. We outline the system design, current experience of deployment across 4 sessions of co-located collaborative learning sessions, as well as brief examples of acquired data.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bachour, K., Kaplan, F., Dillenbourg, P.: An interactive table for supporting participation balance in face-to-face collaborative learning. IEEE Trans. Learn. Technol. 3(3), 203–213 (2010)CrossRef Bachour, K., Kaplan, F., Dillenbourg, P.: An interactive table for supporting participation balance in face-to-face collaborative learning. IEEE Trans. Learn. Technol. 3(3), 203–213 (2010)CrossRef
2.
Zurück zum Zitat Bereiter, C., Scardamalia, M.: Education for the knowledge age. In: Alexander, P.A., Winne, P.H. (eds.) Handbook of Educational Psychology, 2nd edn, pp. 695–713. Lawrence Erlbaum Associates, Mahwah (2006) Bereiter, C., Scardamalia, M.: Education for the knowledge age. In: Alexander, P.A., Winne, P.H. (eds.) Handbook of Educational Psychology, 2nd edn, pp. 695–713. Lawrence Erlbaum Associates, Mahwah (2006)
3.
Zurück zum Zitat Burgoon, J., Dunbar, N.E., Giles, H.: Interaction coordination and adaptation. In: Social Signal Processing, pp. 78–96. Cambridge University Press, Cambridge (2017) Burgoon, J., Dunbar, N.E., Giles, H.: Interaction coordination and adaptation. In: Social Signal Processing, pp. 78–96. Cambridge University Press, Cambridge (2017)
4.
Zurück zum Zitat Chai, C.S., Lim, W.Y., So, H.J., Cheah, H.M.: Advancing Collaborative Learning with ICT: Conception, Cases and Design. Ministry of Education, Singapore (2011) Chai, C.S., Lim, W.Y., So, H.J., Cheah, H.M.: Advancing Collaborative Learning with ICT: Conception, Cases and Design. Ministry of Education, Singapore (2011)
5.
Zurück zum Zitat Chartrand, T.L., Lakin, J.L.: The antecedents and consequences of human behavioral mimicry. Annu. Rev. Psychol. 64, 285–308 (2013)CrossRef Chartrand, T.L., Lakin, J.L.: The antecedents and consequences of human behavioral mimicry. Annu. Rev. Psychol. 64, 285–308 (2013)CrossRef
6.
Zurück zum Zitat Chua, Y.H.V., Dauwels, J., Tan, S.C.: Technologies for automated analysis of co-located, real-life physical learning spaces: where are we now? In: Proceedings of the International Conference on Learning Analytics and Knowledge (LAK 2019), pp. 11–20. ACM (2019) Chua, Y.H.V., Dauwels, J., Tan, S.C.: Technologies for automated analysis of co-located, real-life physical learning spaces: where are we now? In: Proceedings of the International Conference on Learning Analytics and Knowledge (LAK 2019), pp. 11–20. ACM (2019)
7.
Zurück zum Zitat Dillenbourg, P.: Design for classroom orchestration. Comput. Edu. 69, 485–492 (2013)CrossRef Dillenbourg, P.: Design for classroom orchestration. Comput. Edu. 69, 485–492 (2013)CrossRef
8.
Zurück zum Zitat Cukurova, M., Luckin, R., Millán, E., Mavrikis, M.: The NISPI framework: analyzing collaborative problem-solving from students’ physical interactions. Comput. Edu. 116, 93–109 (2018)CrossRef Cukurova, M., Luckin, R., Millán, E., Mavrikis, M.: The NISPI framework: analyzing collaborative problem-solving from students’ physical interactions. Comput. Edu. 116, 93–109 (2018)CrossRef
9.
Zurück zum Zitat D’Mello, S., Graesser, A.: Dynamics of affective states during complex learning. Learn. Instr. 22(2), 145–157 (2012)CrossRef D’Mello, S., Graesser, A.: Dynamics of affective states during complex learning. Learn. Instr. 22(2), 145–157 (2012)CrossRef
10.
Zurück zum Zitat D’Mello, S., Lehman, B., Pekrun, R., Graesser, A.: Confusion can be beneficial for learning. Learn. Instr. 29, 153–170 (2014)CrossRef D’Mello, S., Lehman, B., Pekrun, R., Graesser, A.: Confusion can be beneficial for learning. Learn. Instr. 29, 153–170 (2014)CrossRef
11.
Zurück zum Zitat Eyben, F., Wollmer, M., Schuller, B.: Opensmile: the munich versatile and fast open-source audio feature extractor. In: Proceedings of the 18th ACM International Conference on Multimedia (MM 2010), pp. 1459–1462. ACM (2010) Eyben, F., Wollmer, M., Schuller, B.: Opensmile: the munich versatile and fast open-source audio feature extractor. In: Proceedings of the 18th ACM International Conference on Multimedia (MM 2010), pp. 1459–1462. ACM (2010)
12.
Zurück zum Zitat Grover, S., Bienkowski, M., Tamrakar, A., Siddiquie, B., Salter, D., Divakaran, A.: Multimodal analytics to study collaborative problem solving in pair programming. In: Proceedings of the 6th International Conference on Learning Analytics and Knowledge (LAK 2016), pp. 516–517. ACM (2016) Grover, S., Bienkowski, M., Tamrakar, A., Siddiquie, B., Salter, D., Divakaran, A.: Multimodal analytics to study collaborative problem solving in pair programming. In: Proceedings of the 6th International Conference on Learning Analytics and Knowledge (LAK 2016), pp. 516–517. ACM (2016)
13.
Zurück zum Zitat Gweon, G., Jain, M., McDonough, J., Raj, B., Rosé, C.P.: Measuring prevalence of other-oriented transactive contributions using an automated measure of speech style accommodation. Int. J. Comp-Supp. Coll. 8(2), 245–265 (2013) Gweon, G., Jain, M., McDonough, J., Raj, B., Rosé, C.P.: Measuring prevalence of other-oriented transactive contributions using an automated measure of speech style accommodation. Int. J. Comp-Supp. Coll. 8(2), 245–265 (2013)
14.
Zurück zum Zitat La France, M.: Postural mirroring and intergroup relations. Pers. Soc. Psychol. Bull. 77(11), 207–217 (1985)CrossRef La France, M.: Postural mirroring and intergroup relations. Pers. Soc. Psychol. Bull. 77(11), 207–217 (1985)CrossRef
15.
Zurück zum Zitat Lubold, N., Pon-Barry, H.: Acoustic-prosodic entrainment and rapport in collaborative learning dialogues. In: Proceedings of the 2014 ACM Workshop on Multimodal Learning Analytics Workshop and Grand Challenge (MLA 2014), pp. 5–12. ACM (2014) Lubold, N., Pon-Barry, H.: Acoustic-prosodic entrainment and rapport in collaborative learning dialogues. In: Proceedings of the 2014 ACM Workshop on Multimodal Learning Analytics Workshop and Grand Challenge (MLA 2014), pp. 5–12. ACM (2014)
16.
Zurück zum Zitat Martinez-Maldonado, R., Clayphan, A., Yacef, K., Kay, J.: MTFeedback: providing notifications to enhance teacher awareness of small group work in the classroom. IEEE Trans. Learn. Technol. 8(2), 187–200 (2015)CrossRef Martinez-Maldonado, R., Clayphan, A., Yacef, K., Kay, J.: MTFeedback: providing notifications to enhance teacher awareness of small group work in the classroom. IEEE Trans. Learn. Technol. 8(2), 187–200 (2015)CrossRef
17.
Zurück zum Zitat Mercer, N.: Talk and the development of reasoning and understanding. Hum. Dev. 51, 90–100 (2008)CrossRef Mercer, N.: Talk and the development of reasoning and understanding. Hum. Dev. 51, 90–100 (2008)CrossRef
18.
Zurück zum Zitat Orozco-Arroyave, J.R., Vsquez-Correa, J.C., et al.: NeuroSpeech: an open-source software for Parkinson’s speech analysis. Digit. Signal Process. 77, 207–221 (2017)CrossRef Orozco-Arroyave, J.R., Vsquez-Correa, J.C., et al.: NeuroSpeech: an open-source software for Parkinson’s speech analysis. Digit. Signal Process. 77, 207–221 (2017)CrossRef
19.
Zurück zum Zitat Oviatt, S., Hang, K., Zhou, J., Chen, F.: Spoken interruptions signal productive problem solving and domain expertise in mathematics. In: Proceedings of 2015 ACM on International Conference on Multimodal Interaction (ICMI 2015), pp. 311–318. ACM (2015) Oviatt, S., Hang, K., Zhou, J., Chen, F.: Spoken interruptions signal productive problem solving and domain expertise in mathematics. In: Proceedings of 2015 ACM on International Conference on Multimodal Interaction (ICMI 2015), pp. 311–318. ACM (2015)
20.
Zurück zum Zitat Parmelee, D., Michaelsen, L.K., Cook, S., Hudes, P.D.: Team-based learning a practical guide: AMEE guide no. 65. Med. Teach. 34(5), 275–287 (2012)CrossRef Parmelee, D., Michaelsen, L.K., Cook, S., Hudes, P.D.: Team-based learning a practical guide: AMEE guide no. 65. Med. Teach. 34(5), 275–287 (2012)CrossRef
21.
Zurück zum Zitat Pennebaker, J.W., Boyd, R.L., Jordan, K., Blackburn, K.: The development and psychometric properties of LIWC2015 (2015) Pennebaker, J.W., Boyd, R.L., Jordan, K., Blackburn, K.: The development and psychometric properties of LIWC2015 (2015)
22.
Zurück zum Zitat Praharaj, S., Scheffel, M., Drachsler, H., Specht, M.: Multimodal analytics for real-time feedback in co-located collaboration. In: Pammer-Schindler, V., Pérez-Sanagustín, M., Drachsler, H., Elferink, R., Scheffel, M. (eds.) EC-TEL 2018. LNCS, vol. 11082, pp. 187–201. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-98572-5_15CrossRef Praharaj, S., Scheffel, M., Drachsler, H., Specht, M.: Multimodal analytics for real-time feedback in co-located collaboration. In: Pammer-Schindler, V., Pérez-Sanagustín, M., Drachsler, H., Elferink, R., Scheffel, M. (eds.) EC-TEL 2018. LNCS, vol. 11082, pp. 187–201. Springer, Cham (2018). https://​doi.​org/​10.​1007/​978-3-319-98572-5_​15CrossRef
23.
Zurück zum Zitat Rajalingam, P., Rotgans, J.I., Zary, N., Ferenczi, M.A., Gagnon, P., Low-Beer, N.: Implementation of team-based learning on a large scale: three factors to keep in mind. Med. Teach. 40(6), 1–7 (2018)CrossRef Rajalingam, P., Rotgans, J.I., Zary, N., Ferenczi, M.A., Gagnon, P., Low-Beer, N.: Implementation of team-based learning on a large scale: three factors to keep in mind. Med. Teach. 40(6), 1–7 (2018)CrossRef
25.
Zurück zum Zitat Ruffaldi, E., Dabisias, G., Landolfi, L., Spikol, D.: Data collection and processing for a multimodal learning analytic system. In: Proceedings of 2016 SAI Computing Conference, pp. 858–863. IEEE (2016) Ruffaldi, E., Dabisias, G., Landolfi, L., Spikol, D.: Data collection and processing for a multimodal learning analytic system. In: Proceedings of 2016 SAI Computing Conference, pp. 858–863. IEEE (2016)
26.
Zurück zum Zitat Scherer, S., Weibel, N., Morency, L.P., Oviatt, S.: Multimodal prediction of expertise and leadership in learning groups. In: Proceedings of the 1st International Workshop on Multimodal Learning Analytics (MLA 2012). ACM (2012) Scherer, S., Weibel, N., Morency, L.P., Oviatt, S.: Multimodal prediction of expertise and leadership in learning groups. In: Proceedings of the 1st International Workshop on Multimodal Learning Analytics (MLA 2012). ACM (2012)
27.
Zurück zum Zitat Schneider, B., Blikstein, P.: Unraveling students’ interaction around a tangible interface using multimodal learning analytics. J. Educ. Data Min. 7(3), 89–116 (2015) Schneider, B., Blikstein, P.: Unraveling students’ interaction around a tangible interface using multimodal learning analytics. J. Educ. Data Min. 7(3), 89–116 (2015)
28.
Zurück zum Zitat Schneider B., Sharma, K., Cuendet, S., Zufferey, G., Dillenbourg, P., Pea, R.: Detecting collaborative dynamics using mobile eye-trackers. In: Proceedings of the 12th International Conference of the Learning Sciences, pp. 522–529 (2016) Schneider B., Sharma, K., Cuendet, S., Zufferey, G., Dillenbourg, P., Pea, R.: Detecting collaborative dynamics using mobile eye-trackers. In: Proceedings of the 12th International Conference of the Learning Sciences, pp. 522–529 (2016)
29.
Zurück zum Zitat Spikol, D., Ruffaldi, E., Dabisias, G., Cukurova, M.: Supervised machine learning in multimodal learning analytics for estimating success in project-based learning. J. Comput. Assist. Learn. 34(4), 366–377 (2018)CrossRef Spikol, D., Ruffaldi, E., Dabisias, G., Cukurova, M.: Supervised machine learning in multimodal learning analytics for estimating success in project-based learning. J. Comput. Assist. Learn. 34(4), 366–377 (2018)CrossRef
30.
Zurück zum Zitat Spikol, D., Ruffaldi, E., Landolfi, L., Cukurova, M.: Estimation of success in collaborative learning based on multimodal learning analytics features. In: Proceedings of the 17th IEEE International Conference on Advanced Learning Technologies (ICALT 2017), pp. 269–273. IEEE (2017) Spikol, D., Ruffaldi, E., Landolfi, L., Cukurova, M.: Estimation of success in collaborative learning based on multimodal learning analytics features. In: Proceedings of the 17th IEEE International Conference on Advanced Learning Technologies (ICALT 2017), pp. 269–273. IEEE (2017)
31.
Zurück zum Zitat Stöckli, S., Schulte-Mecklenbeck, M., Borer, S., Samson, A.C.: Facial expression analysis with AFFDEX and FACET: a validation study. Behav. Res. Methods 50(4), 1446–1460 (2018)CrossRef Stöckli, S., Schulte-Mecklenbeck, M., Borer, S., Samson, A.C.: Facial expression analysis with AFFDEX and FACET: a validation study. Behav. Res. Methods 50(4), 1446–1460 (2018)CrossRef
32.
Zurück zum Zitat Tahir, Y., et al.: Real-time sociometrics from audio-visual features for two-person dialogs. In: 2015 IEEE International Conference on Digital Signal Processing, pp. 823–827. IEEE (2015) Tahir, Y., et al.: Real-time sociometrics from audio-visual features for two-person dialogs. In: 2015 IEEE International Conference on Digital Signal Processing, pp. 823–827. IEEE (2015)
33.
Zurück zum Zitat Tan, J.P.-L., Caleon, I., Ng, H.L., Poon, C.L., Koh, E.: Collective creativity competencies and collaborative problem-solving outcomes: insights from the dialogic interactions of singapore student teams. In: Care, E., Griffin, P., Wilson, M. (eds.) Assessment and Teaching of 21st Century Skills. EAIA, pp. 95–118. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-65368-6_6CrossRef Tan, J.P.-L., Caleon, I., Ng, H.L., Poon, C.L., Koh, E.: Collective creativity competencies and collaborative problem-solving outcomes: insights from the dialogic interactions of singapore student teams. In: Care, E., Griffin, P., Wilson, M. (eds.) Assessment and Teaching of 21st Century Skills. EAIA, pp. 95–118. Springer, Cham (2018). https://​doi.​org/​10.​1007/​978-3-319-65368-6_​6CrossRef
34.
Zurück zum Zitat Taylor, R.: The multimodal texture of engagement: prosodic language, gaze and posture in engaged, creative classroom interaction. Think. Skills Creat. 20, 83–96 (2016)CrossRef Taylor, R.: The multimodal texture of engagement: prosodic language, gaze and posture in engaged, creative classroom interaction. Think. Skills Creat. 20, 83–96 (2016)CrossRef
35.
Zurück zum Zitat Villar, A.: Response bias. In: Lavrakas, P.J. (ed.) Encyclopedia of Survey Research Methods, pp. 752–753. Sage Publications Inc., Thousand Oaks (2011) Villar, A.: Response bias. In: Lavrakas, P.J. (ed.) Encyclopedia of Survey Research Methods, pp. 752–753. Sage Publications Inc., Thousand Oaks (2011)
36.
Zurück zum Zitat Weimar, E., Nugroho, A., Visser, J., Plaat, A., Goudbeek, M., Schouten, A.P.: The Influence of teamwork quality on software team performance. arXiv preprint arXiv:1701.06146 (2017) Weimar, E., Nugroho, A., Visser, J., Plaat, A., Goudbeek, M., Schouten, A.P.: The Influence of teamwork quality on software team performance. arXiv preprint arXiv:​1701.​06146 (2017)
37.
Zurück zum Zitat Woolley, A.W., Gerbasi, M.E., Chabris, C.F., Kosslyn, S.M., Hackman, J.R.: Bringing in the experts: how team composition and collaborative planning jointly shape analytic effectiveness. Small Group Res. 39(3), 352–371 (2008)CrossRef Woolley, A.W., Gerbasi, M.E., Chabris, C.F., Kosslyn, S.M., Hackman, J.R.: Bringing in the experts: how team composition and collaborative planning jointly shape analytic effectiveness. Small Group Res. 39(3), 352–371 (2008)CrossRef
38.
Zurück zum Zitat Woolley, A.W., Aggarwal, I., Malone, T.W.: Collective intelligence in teams and organizations. In: Handbook of Collective Intelligence, pp. 143–168 (2015) Woolley, A.W., Aggarwal, I., Malone, T.W.: Collective intelligence in teams and organizations. In: Handbook of Collective Intelligence, pp. 143–168 (2015)
39.
Zurück zum Zitat Worsley, M., Blikstein, P.: Leveraging multimodal learning analytics to differentiate student learning strategies. In: Proceedings of the 5th International Conference on Learning Analytics and Knowledge (LAK 2015), pp. 360–367. ACM (2015) Worsley, M., Blikstein, P.: Leveraging multimodal learning analytics to differentiate student learning strategies. In: Proceedings of the 5th International Conference on Learning Analytics and Knowledge (LAK 2015), pp. 360–367. ACM (2015)
40.
Zurück zum Zitat Worsley, M., Blikstein, P.: Using learning analytics to study cognitive disequilibrium in a complex learning environment. In: Proceedings of the 5th International Conference on Learning Analytics and Knowledge (LAK 2015), pp. 426–427. ACM (2015) Worsley, M., Blikstein, P.: Using learning analytics to study cognitive disequilibrium in a complex learning environment. In: Proceedings of the 5th International Conference on Learning Analytics and Knowledge (LAK 2015), pp. 426–427. ACM (2015)
41.
Zurück zum Zitat Zapata, J., Andreas S.K.: Assessing the performance of automatic speech recognition systems when used by native and non-native speakers of three major languages in dictation workflows. In: Proceedings of the 20th Nordic Conference of Computational Linguistics (NODALIDA 2015), pp. 201–210. Linköping University Electronic Press (2015) Zapata, J., Andreas S.K.: Assessing the performance of automatic speech recognition systems when used by native and non-native speakers of three major languages in dictation workflows. In: Proceedings of the 20th Nordic Conference of Computational Linguistics (NODALIDA 2015), pp. 201–210. Linköping University Electronic Press (2015)
Metadaten
Titel
EduBrowser: A Multimodal Automated Monitoring System for Co-located Collaborative Learning
verfasst von
Yi Han Victoria Chua
Preman Rajalingam
Seng Chee Tan
Justin Dauwels
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-20798-4_12