Skip to main content

2017 | OriginalPaper | Buchkapitel

Variations of Gaming Behaviors Across Populations of Students and Across Learning Environments

verfasst von : Luc Paquette, Ryan S. Baker

Erschienen in: Artificial Intelligence in Education

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Although gaming the system, a behavior in which students attempt to solve problems by exploiting help functionalities of digital learning environments, has been studied across multiple learning environments, little research has been done to study how (and whether) gaming manifests differently across populations of students and learning environments. In this paper, we study the differences in usage of 13 different patterns of actions associated with gaming the system by comparing their distribution across different populations of students using Cognitive Tutor Algebra and across students using one of three learning environments: Cognitive Tutor Algebra, Cognitive Tutor Middle School and ASSISTments. Results suggest that differences in gaming behavior are more strongly associated to the learning environments than to student populations and reveal different trends in how students use fast actions, similar answers and help request in different systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Baker, R.S.J., Corbett, A.T., Roll, I., Koedinger, K.R.: Developing a generalizable detector of when students games the system. User Model. User Adap. Inter. 18, 287–314 (2008)CrossRef Baker, R.S.J., Corbett, A.T., Roll, I., Koedinger, K.R.: Developing a generalizable detector of when students games the system. User Model. User Adap. Inter. 18, 287–314 (2008)CrossRef
2.
Zurück zum Zitat Beck, J., Rodrigo, M.M.T.: Understanding wheel spinning in the context of affective factors. In: Proceedings of the 12th International Conference on Intelligent Tutoring Systems, pp. 162–167 (2014) Beck, J., Rodrigo, M.M.T.: Understanding wheel spinning in the context of affective factors. In: Proceedings of the 12th International Conference on Intelligent Tutoring Systems, pp. 162–167 (2014)
3.
Zurück zum Zitat Cocea, M., Hershkovitz, A., Baker, R.S.J.: The impact of off-task and gaming behaviors on learning: immediate or aggregate? In: Proceedings of the 14th International Conference on Artificial Intelligence in Education, pp. 507–514 (2009) Cocea, M., Hershkovitz, A., Baker, R.S.J.: The impact of off-task and gaming behaviors on learning: immediate or aggregate? In: Proceedings of the 14th International Conference on Artificial Intelligence in Education, pp. 507–514 (2009)
4.
Zurück zum Zitat Fancsali, S.E.: Data-driven causal modeling of “Gaming the System” and off-task behavior in cognitive tutor algebra. NIPS Workshop on Data Driven Education Fancsali, S.E.: Data-driven causal modeling of “Gaming the System” and off-task behavior in cognitive tutor algebra. NIPS Workshop on Data Driven Education
5.
Zurück zum Zitat Pardos, Z.A., Baker, R.S., San Pedro, M.O.C.Z., Gowda, S.M., Gowda, S.M.: Affective states and state tests: investigating how affect and engagement during the school year predict end of year learning outcomes. J. Learn. Anal. 1(1), 107–128 (2014)CrossRef Pardos, Z.A., Baker, R.S., San Pedro, M.O.C.Z., Gowda, S.M., Gowda, S.M.: Affective states and state tests: investigating how affect and engagement during the school year predict end of year learning outcomes. J. Learn. Anal. 1(1), 107–128 (2014)CrossRef
6.
Zurück zum Zitat Baker, R.S.J., D’Mello, S.K., Rodrigo, M.M.T., Graesser, A.C.: Better to be frustrated than bored: the incidence, persistence, and impact of learners’ cognitive-affective states during interactions with three different computer-based learning environments. Int. J. Hum Comput Stud. 68, 223–241 (2010)CrossRef Baker, R.S.J., D’Mello, S.K., Rodrigo, M.M.T., Graesser, A.C.: Better to be frustrated than bored: the incidence, persistence, and impact of learners’ cognitive-affective states during interactions with three different computer-based learning environments. Int. J. Hum Comput Stud. 68, 223–241 (2010)CrossRef
7.
Zurück zum Zitat San Pedro, M.O.Z., Baker, R.S.J., Bowers, A.J., Heffernan, N.T.: Predicting college enrolment from student interaction with an intelligent tutoring system in middle school. In: Proceedings of the 6th International Conference on Educational Data Mining, pp. 177–184 (2013) San Pedro, M.O.Z., Baker, R.S.J., Bowers, A.J., Heffernan, N.T.: Predicting college enrolment from student interaction with an intelligent tutoring system in middle school. In: Proceedings of the 6th International Conference on Educational Data Mining, pp. 177–184 (2013)
8.
Zurück zum Zitat Baker, R.S.J., Mitrovic, A., Mathews, M.: Detecting gaming the system in constraint-based tutors. In: Proceedings of the 18th Conference on User Modeling, Adaptation and Personalization, pp. 267–278 (2010) Baker, R.S.J., Mitrovic, A., Mathews, M.: Detecting gaming the system in constraint-based tutors. In: Proceedings of the 18th Conference on User Modeling, Adaptation and Personalization, pp. 267–278 (2010)
9.
Zurück zum Zitat Walonoski, J.A., Heffernan, N.T.: Detection and analysis of off-task gaming behavior in intelligent tutoring systems. In: Proceedings of the 8th International Conference on Intelligent Tutoring Systems, pp. 382–391 (2006) Walonoski, J.A., Heffernan, N.T.: Detection and analysis of off-task gaming behavior in intelligent tutoring systems. In: Proceedings of the 8th International Conference on Intelligent Tutoring Systems, pp. 382–391 (2006)
10.
Zurück zum Zitat Beal, C.R., Qu, L., Lee, H.: Classifying learner engagement through integration of multiple data sources. In: Proceedings of the National Conference on Artificial Intelligence, pp. 151–156 (2006) Beal, C.R., Qu, L., Lee, H.: Classifying learner engagement through integration of multiple data sources. In: Proceedings of the National Conference on Artificial Intelligence, pp. 151–156 (2006)
11.
Zurück zum Zitat Johns, J., Woolf, B.: A dynamic mixture model to detect student motivation and proficiency. In: Proceedings of the National Conference on Artificial Intelligence, pp. 163–168 (2006) Johns, J., Woolf, B.: A dynamic mixture model to detect student motivation and proficiency. In: Proceedings of the National Conference on Artificial Intelligence, pp. 163–168 (2006)
12.
Zurück zum Zitat Muldner, K., Burleson, W., Van de Sande, B., VanLehn, K.: An analysis of students’ gaming behaviors in an intelligent tutoring system: predictors and impact. User Model. User Adap. Inter. 21, 99–135 (2011)CrossRef Muldner, K., Burleson, W., Van de Sande, B., VanLehn, K.: An analysis of students’ gaming behaviors in an intelligent tutoring system: predictors and impact. User Model. User Adap. Inter. 21, 99–135 (2011)CrossRef
13.
Zurück zum Zitat Aleven, V., McLaren, B.M., Roll, I., Koedinger, K.R.: Towards meta-cognitive tutoring: a model of help seeking with a cognitive tutor. Int. J. Artif. Intell. Educ. 16, 101–130 (2006) Aleven, V., McLaren, B.M., Roll, I., Koedinger, K.R.: Towards meta-cognitive tutoring: a model of help seeking with a cognitive tutor. Int. J. Artif. Intell. Educ. 16, 101–130 (2006)
14.
Zurück zum Zitat Gong, Y., Beck, J., Heffernan, N.T., Forbes-Summer, E.: The fine-grained impact of gaming (?) on learning. In: Proceedings of the 10th International Conference on Intelligent Tutoring Systems, pp. 194–203 (2010) Gong, Y., Beck, J., Heffernan, N.T., Forbes-Summer, E.: The fine-grained impact of gaming (?) on learning. In: Proceedings of the 10th International Conference on Intelligent Tutoring Systems, pp. 194–203 (2010)
15.
Zurück zum Zitat Baker, R.S.J., Gowda, S.M.: An analysis of the differences in the frequency of students’ disengagement in Urban, Rural, and Suburban High Schools. In: Proceedings of the 3rd International Conference on Educational Data Mining, pp. 11–20 (2010) Baker, R.S.J., Gowda, S.M.: An analysis of the differences in the frequency of students’ disengagement in Urban, Rural, and Suburban High Schools. In: Proceedings of the 3rd International Conference on Educational Data Mining, pp. 11–20 (2010)
16.
Zurück zum Zitat Ocumpaugh, J., Baker, R.S., Gowda, S., Heffernan, N., Heffernan, C.: Population validity for educational data mining models: a case study in affect detection. Br. J. Educ. Technol. 45(3), 487–501 (2014) CrossRef Ocumpaugh, J., Baker, R.S., Gowda, S., Heffernan, N., Heffernan, C.: Population validity for educational data mining models: a case study in affect detection. Br. J. Educ. Technol. 45(3), 487–501 (2014) CrossRef
17.
Zurück zum Zitat Paquette, L., Baker, R.S., de Carvalho, A.M.J.A., Ocumpaugh, J.: Cross-system transfer of machine learned and knowledge engineered models of gaming the system. In: Proceedings of the 23rd Conference on User Modeling, Adaptation and Personalization, pp. 183–194 (2015) Paquette, L., Baker, R.S., de Carvalho, A.M.J.A., Ocumpaugh, J.: Cross-system transfer of machine learned and knowledge engineered models of gaming the system. In: Proceedings of the 23rd Conference on User Modeling, Adaptation and Personalization, pp. 183–194 (2015)
18.
Zurück zum Zitat Koedinger, K.R, Corbett, A.T.: Cognitive tutors: technology bringing learning sciences to the classroom. In: Sawyer, R.K. (ed.) The Cambridge Handbook of the Learning Sciences, pp. 61–77 (2006) Koedinger, K.R, Corbett, A.T.: Cognitive tutors: technology bringing learning sciences to the classroom. In: Sawyer, R.K. (ed.) The Cambridge Handbook of the Learning Sciences, pp. 61–77 (2006)
19.
Zurück zum Zitat Razzaq, L., et al.: The assistment project: blending assessment and assisting. In: Proc. of the 12 Annual Conference on Artificial Intelligence in Education, pp. 555–562 (2005) Razzaq, L., et al.: The assistment project: blending assessment and assisting. In: Proc. of the 12 Annual Conference on Artificial Intelligence in Education, pp. 555–562 (2005)
20.
Zurück zum Zitat Paquette, L., de Carvalho, A.M.J.A, Baker, R.S.: Towards understanding export coding of student disengagement in online learning. In: Proceedings of the 36th Annual Cognitive Science Conference, pp. 1126–1131 (2014) Paquette, L., de Carvalho, A.M.J.A, Baker, R.S.: Towards understanding export coding of student disengagement in online learning. In: Proceedings of the 36th Annual Cognitive Science Conference, pp. 1126–1131 (2014)
21.
Zurück zum Zitat Clark, R.E., Feldon, D., van Merriënboer, J., Yates, K., Early, S.: Cognitive task analysis. In: Spector, J.M., Merrill, M.D., van Merriënboer, J.J.G., Driscoll, M.P. (eds.) Handbook of Research on Educational Communications and Technology, 3rd edn., pp. 575–593 (2008) Clark, R.E., Feldon, D., van Merriënboer, J., Yates, K., Early, S.: Cognitive task analysis. In: Spector, J.M., Merrill, M.D., van Merriënboer, J.J.G., Driscoll, M.P. (eds.) Handbook of Research on Educational Communications and Technology, 3rd edn., pp. 575–593 (2008)
22.
Zurück zum Zitat Cooke, N.J.: Varieties of knowledge elicitation techniques. Int. J. Hum Comput Stud. 41, 801–849 (1994)CrossRefMATH Cooke, N.J.: Varieties of knowledge elicitation techniques. Int. J. Hum Comput Stud. 41, 801–849 (1994)CrossRefMATH
23.
Zurück zum Zitat Meyer, M.A.: How to apply the anthropological technique of participant observation to knowledge acquisition for expert systems. IEEE Trans. Syst. Man Cybern. 22, 983–991 (1992)CrossRef Meyer, M.A.: How to apply the anthropological technique of participant observation to knowledge acquisition for expert systems. IEEE Trans. Syst. Man Cybern. 22, 983–991 (1992)CrossRef
24.
Zurück zum Zitat Van Someren, M.W., Barnard, Y.F., Sandberg, J.A.C.: The Think Aloud Method: A Practical Guide to Modeling Cognitive Processes. Academic Press, London (1994) Van Someren, M.W., Barnard, Y.F., Sandberg, J.A.C.: The Think Aloud Method: A Practical Guide to Modeling Cognitive Processes. Academic Press, London (1994)
25.
Zurück zum Zitat Levenshtein, A.: Binary codes capable of correcting deletions, insertions and reversals. Sov. Phys. Dokl. 10(8), 707–710 (1966)MATHMathSciNet Levenshtein, A.: Binary codes capable of correcting deletions, insertions and reversals. Sov. Phys. Dokl. 10(8), 707–710 (1966)MATHMathSciNet
26.
Zurück zum Zitat Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Measur. 20(1), 37–46 (1960)CrossRef Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Measur. 20(1), 37–46 (1960)CrossRef
27.
Zurück zum Zitat Baker, R.S.J., de Carvalho, A.M.J.A.: Labeling student behavior faster and more precisely with text replays. In: Proceedings of the 1st International Conference on Educational Data Mining 2008, pp. 38–47 (2008) Baker, R.S.J., de Carvalho, A.M.J.A.: Labeling student behavior faster and more precisely with text replays. In: Proceedings of the 1st International Conference on Educational Data Mining 2008, pp. 38–47 (2008)
28.
Zurück zum Zitat Paquette, L., de Carvalho, A.M.J.A, Baker, R.S., Ocumpaugh, J.: Reengineering the feature distillation process: a case study in the detection of gaming the system. In: Proceedings of the 7th International Conference on Educational Data Mining, pp. 284–287 (2014) Paquette, L., de Carvalho, A.M.J.A, Baker, R.S., Ocumpaugh, J.: Reengineering the feature distillation process: a case study in the detection of gaming the system. In: Proceedings of the 7th International Conference on Educational Data Mining, pp. 284–287 (2014)
29.
Zurück zum Zitat Koedinger, K.R., Baker, R., Cunningham, K., Skogsholm, A., Leber, B., Stamper, J.: A Data Repository for the Community: The PLSC DataShop. CRC Press, Boca Raton (2010) Koedinger, K.R., Baker, R., Cunningham, K., Skogsholm, A., Leber, B., Stamper, J.: A Data Repository for the Community: The PLSC DataShop. CRC Press, Boca Raton (2010)
30.
Zurück zum Zitat Benjamini, Y., Hochberg, Y.: Controlling the False discovery rate: a practical and powerful approach to multiple testing. J. Roy. Stat. Soc. B 57, 289–300 (2003)MATHMathSciNet Benjamini, Y., Hochberg, Y.: Controlling the False discovery rate: a practical and powerful approach to multiple testing. J. Roy. Stat. Soc. B 57, 289–300 (2003)MATHMathSciNet
31.
Zurück zum Zitat Murray, C., VanLehn, K.: Effects of dissuading unnecessary help requests while providing proactive help. In: Proceedings of the International Conference on Artificial Intelligence and Education, pp. 887–889 (2005) Murray, C., VanLehn, K.: Effects of dissuading unnecessary help requests while providing proactive help. In: Proceedings of the International Conference on Artificial Intelligence and Education, pp. 887–889 (2005)
Metadaten
Titel
Variations of Gaming Behaviors Across Populations of Students and Across Learning Environments
verfasst von
Luc Paquette
Ryan S. Baker
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-61425-0_23