Skip to main content
Erschienen in: Technology, Knowledge and Learning 2/2023

27.01.2022 | Original research

Computational Thinking Assessment – Towards More Vivid Interpretations

verfasst von: Josef Guggemos, Sabine Seufert, Marcos Román-González

Erschienen in: Technology, Knowledge and Learning | Ausgabe 2/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Computational thinking (CT) is an important 21st-century skill. This paper aims at more useful CT assessment. Available evaluation instruments are reviewed; two generally accepted CT evaluation tools are selected for a comprehensive CT assessment: the CTt, a performance test, and the CTS, a self-assessment instrument. The sample comprises 202 high school students from German-speaking Switzerland. Concerning the CTt, Rasch-scalability is demonstrated. Utilizing the approach of the PISA studies, proficiency levels are formed that comprise tasks with specific characteristics that students are systematically able to master. This could help teachers to offer individual support to their students. In terms of the CTS, the original version is refined using confirmatory factor and measurement-invariance analysis. A latent profile analysis yielded four profiles, two of which are of particular interest. One profile comprises students with, on the one hand, moderate to high creative thinking ability, cooperativity, and critical thinking skills and, on the other hand, low algorithmic thinking ability. The second remarkable profile consists of students with particularly low cooperativity. Based on these strength and weakness profiles, teachers could offer support tailored to student needs.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
The German version of the CTt and CTS are available from the authors upon request.
 
2
The Rasch model predicts as the probability for a correct answer: exp(proficiency–difficulty) / (1 + exp(proficiency–difficulty)). For instance, a person with a proficiency of 1.5 Logit is expected to solve an item with a difficulty of 1.0 Logit with a probability of 62.2%.
 
Literatur
Zurück zum Zitat Brackmann, C. P., Román-González, M., Robles, G., Moreno-León, J., Casali, A., & Barone, D. (2017). Development of computational thinking skills through unplugged activities in primary school. In E. Barendsen (Ed.), Proceedings of the 12th Workshop on Primary and Secondary Computing Education (pp. 65–72). ACM. https://doi.org/10.1145/3137065.3137069 Brackmann, C. P., Román-González, M., Robles, G., Moreno-León, J., Casali, A., & Barone, D. (2017). Development of computational thinking skills through unplugged activities in primary school. In E. Barendsen (Ed.), Proceedings of the 12th Workshop on Primary and Secondary Computing Education (pp. 65–72). ACM. https://​doi.​org/​10.​1145/​3137065.​3137069
Zurück zum Zitat Carretero, S., Vuorikari, R., & Punie, Y. (2017). DigComp 2.1: The Digital Competence Framework for Citizens with eight proficiency levels and examples of use. European Union (EU). https://doi.org/10.2760/38842 Carretero, S., Vuorikari, R., & Punie, Y. (2017). DigComp 2.1: The Digital Competence Framework for Citizens with eight proficiency levels and examples of use. European Union (EU). https://​doi.​org/​10.​2760/​38842
Zurück zum Zitat Doleck, T., Bazelais, P., Lemay, D. J., Saxena, A., & Basnet, R. B. (2017). Algorithmic thinking, cooperativity, creativity, critical thinking, and problem solving: Exploring the relationship between computational thinking skills and academic performance. Journal of Computers in Education, 4(4), 355–369. https://doi.org/10.1007/s40692-017-0090-9CrossRef Doleck, T., Bazelais, P., Lemay, D. J., Saxena, A., & Basnet, R. B. (2017). Algorithmic thinking, cooperativity, creativity, critical thinking, and problem solving: Exploring the relationship between computational thinking skills and academic performance. Journal of Computers in Education, 4(4), 355–369. https://​doi.​org/​10.​1007/​s40692-017-0090-9CrossRef
Zurück zum Zitat Ericson, B., & McKlin, T. (2012). Effective and sustainable computing summer camps. In L. Smith King, D. R. Musicant, T. Camp, & P. Tymann (Eds.), Proceedings of the 43rd ACM technical symposium on Computer Science Education - SIGCSE '12 (p. 289). ACM Press. https://doi.org/10.1145/2157136.2157223 Ericson, B., & McKlin, T. (2012). Effective and sustainable computing summer camps. In L. Smith King, D. R. Musicant, T. Camp, & P. Tymann (Eds.), Proceedings of the 43rd ACM technical symposium on Computer Science Education - SIGCSE '12 (p. 289). ACM Press. https://​doi.​org/​10.​1145/​2157136.​2157223
Zurück zum Zitat Greiff, S., Wüstenberg, S., Molnár, G., Fischer, A., Funke, J., & Csapó, B. (2013). Complex problem solving in educational contexts—Something beyond g: Concept, assessment, measurement invariance, and construct validity. Journal of Educational Psychology, 105(2), 364–379. https://doi.org/10.1037/a0031856CrossRef Greiff, S., Wüstenberg, S., Molnár, G., Fischer, A., Funke, J., & Csapó, B. (2013). Complex problem solving in educational contexts—Something beyond g: Concept, assessment, measurement invariance, and construct validity. Journal of Educational Psychology, 105(2), 364–379. https://​doi.​org/​10.​1037/​a0031856CrossRef
Zurück zum Zitat Grover, S., Pea, R., & Cooper, S. (2016). Factors influencing computer science learning in middle school. In C. Alphonce, J. Tims, M. Caspersen, & S. Edwards (Eds.), Proceedings of the 47th ACM Technical Symposium on Computing Science Education (pp. 552–557). ACM. https://doi.org/10.1145/2839509.2844564 Grover, S., Pea, R., & Cooper, S. (2016). Factors influencing computer science learning in middle school. In C. Alphonce, J. Tims, M. Caspersen, & S. Edwards (Eds.), Proceedings of the 47th ACM Technical Symposium on Computing Science Education (pp. 552–557). ACM. https://​doi.​org/​10.​1145/​2839509.​2844564
Zurück zum Zitat Guggemos, J., Seufert, S., & Román-González, M. (2019). Measuring computational thinking - Adapting a performance test and a self-assessment instrument for German-speaking countries. Proceedings of the 16th International Conference Cognition and Exploratory Learning in the Digital Age (CELDA) (pp. 183–191). https://doi.org/10.33965/celda2019_201911L023 Guggemos, J., Seufert, S., & Román-González, M. (2019). Measuring computational thinking - Adapting a performance test and a self-assessment instrument for German-speaking countries. Proceedings of the 16th International Conference Cognition and Exploratory Learning in the Digital Age (CELDA) (pp. 183–191). https://​doi.​org/​10.​33965/​celda2019_​201911L023
Zurück zum Zitat Hartig, J., & Frey, A. (2013). Sind modelle der item-response-theorie (IRT) das „Mittel der Wahl“ für die Modellierung von Kompetenzen? [Benefits and limitations of modeling competencies by means of Item Response Theory (IRT)]. Zeitschrift Für Erziehungswissenschaft, 16(S1), 47–51. https://doi.org/10.1007/s11618-013-0386-0CrossRef Hartig, J., & Frey, A. (2013). Sind modelle der item-response-theorie (IRT) das „Mittel der Wahl“ für die Modellierung von Kompetenzen? [Benefits and limitations of modeling competencies by means of Item Response Theory (IRT)]. Zeitschrift Für Erziehungswissenschaft, 16(S1), 47–51. https://​doi.​org/​10.​1007/​s11618-013-0386-0CrossRef
Zurück zum Zitat Kong, S. C. (2019). Components and methods of evaluating computational thinking for fostering creative problem-solvers in senior primary school education. In S. C. Kong & H. Abelson (Eds.), Computational thinking education (pp. 119–141). Springer. https://doi.org/10.1007/978-981-13-6528-7_8 Kong, S. C. (2019). Components and methods of evaluating computational thinking for fostering creative problem-solvers in senior primary school education. In S. C. Kong & H. Abelson (Eds.), Computational thinking education (pp. 119–141). Springer. https://​doi.​org/​10.​1007/​978-981-13-6528-7_​8
Zurück zum Zitat Leys, C., Delacre, M., Mora, Y. L., Lakens, D., & Ley, C. (2019). How to classify, detect, and manage univariate and multivariate outliers, with emphasis on pre-registration. International Review of Social Psychology. https://doi.org/10.5334/irsp.289 Leys, C., Delacre, M., Mora, Y. L., Lakens, D., & Ley, C. (2019). How to classify, detect, and manage univariate and multivariate outliers, with emphasis on pre-registration. International Review of Social Psychology. https://​doi.​org/​10.​5334/​irsp.​289
Zurück zum Zitat Lohr, A., Stadler, M., Schultz-Pernice, F., Chernikova, O., Sailer, M., Fischer, F., & Sailer, M. (2021). On powerpointers, clickerers, and digital pros: Investigating the initiation of digital learning activities by teachers in higher education. Computers in Human Behavior, 119, 106715. https://doi.org/10.1016/j.chb.2021.106715CrossRef Lohr, A., Stadler, M., Schultz-Pernice, F., Chernikova, O., Sailer, M., Fischer, F., & Sailer, M. (2021). On powerpointers, clickerers, and digital pros: Investigating the initiation of digital learning activities by teachers in higher education. Computers in Human Behavior, 119, 106715. https://​doi.​org/​10.​1016/​j.​chb.​2021.​106715CrossRef
Zurück zum Zitat Mühling, A., Ruf, A., & Hubwieser, P. (2015). Design and first results of a psychometric test for measuring basic programming abilities. In A. Mühling, A. Ruf, & P. Hubwieser (Eds.), Design and First Results of a Psychometric Test for Measuring Basic Programming Abilities (pp. 2–10). ACM. https://doi.org/10.1145/2818314.2818320 Mühling, A., Ruf, A., & Hubwieser, P. (2015). Design and first results of a psychometric test for measuring basic programming abilities. In A. Mühling, A. Ruf, & P. Hubwieser (Eds.), Design and First Results of a Psychometric Test for Measuring Basic Programming Abilities (pp. 2–10). ACM. https://​doi.​org/​10.​1145/​2818314.​2818320
Zurück zum Zitat Prenzel, M., Drechsel, B., & Kramer, K. (1998). Lernmotivation im kaufmännischen Unterricht: Die Sicht von Auszubildenden und Lehrkräften [Learning motivation in business education: the perspective of trainees and teachers]. Zeitschrift für Berufs- Und Wirtschaftspädagogik, special issue 14, 169–187 Prenzel, M., Drechsel, B., & Kramer, K. (1998). Lernmotivation im kaufmännischen Unterricht: Die Sicht von Auszubildenden und Lehrkräften [Learning motivation in business education: the perspective of trainees and teachers]. Zeitschrift für Berufs- Und Wirtschaftspädagogik, special issue 14, 169–187
Zurück zum Zitat Repenning, A., Webb, D. C., Koh, K. H., Nickerson, H., Miller, S. B., Brand, C., Her Many Horses, I., Basawapatna, A., Gluck, F., Grover, R., Gutierrez, K., & Repenning, N. (2015). Scalable game design: A strategy to bring systemic computer science education to schools through game design and simulation creation. ACM Transactions on Computing Education, 15(2), 1–31. https://doi.org/10.1145/2700517 Repenning, A., Webb, D. C., Koh, K. H., Nickerson, H., Miller, S. B., Brand, C., Her Many Horses, I., Basawapatna, A., Gluck, F., Grover, R., Gutierrez, K., & Repenning, N. (2015). Scalable game design: A strategy to bring systemic computer science education to schools through game design and simulation creation. ACM Transactions on Computing Education, 15(2), 1–31. https://​doi.​org/​10.​1145/​2700517
Zurück zum Zitat Rose, S. P., Habgood, M. J., & Jay, T. (2019). Using pirate plunder to develop children's abstraction skills in Scratch. In R. Mandryk, M. Hancock, M. Perry, & A. Cox (Eds.), Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (pp. 1–6). ACM Press. https://doi.org/10.1145/3290607.3312871 Rose, S. P., Habgood, M. J., & Jay, T. (2019). Using pirate plunder to develop children's abstraction skills in Scratch. In R. Mandryk, M. Hancock, M. Perry, & A. Cox (Eds.), Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (pp. 1–6). ACM Press. https://​doi.​org/​10.​1145/​3290607.​3312871
Zurück zum Zitat Sarstedt, M., Becker, J.-M., Ringle, C. M., & Schwaiger, M. (2011). Uncovering and treating unobserved heterogeneity with FIMIX-PLS: Which model selection criterion provides an appropriate number of segments? Schmalenbach Business Review, 63(1), 34–62. https://doi.org/10.1007/BF03396886CrossRef Sarstedt, M., Becker, J.-M., Ringle, C. M., & Schwaiger, M. (2011). Uncovering and treating unobserved heterogeneity with FIMIX-PLS: Which model selection criterion provides an appropriate number of segments? Schmalenbach Business Review, 63(1), 34–62. https://​doi.​org/​10.​1007/​BF03396886CrossRef
Zurück zum Zitat Seiter, L., & Foreman, B. (2013). Modeling the learning progressions of computational thinking of primary grade students. In B. Simon, A. Clear, & Q. Cutts (Eds.), Proceedings of the ninth annual international ACM conference on International computing education research (pp. 59–66). ACM. https://doi.org/10.1145/2493394.2493403 Seiter, L., & Foreman, B. (2013). Modeling the learning progressions of computational thinking of primary grade students. In B. Simon, A. Clear, & Q. Cutts (Eds.), Proceedings of the ninth annual international ACM conference on International computing education research (pp. 59–66). ACM. https://​doi.​org/​10.​1145/​2493394.​2493403
Zurück zum Zitat Tondeur, J., Scherer, R., Baran, E., Siddiq, F., Valtonen, T., & Sointu, E. (2019). Teacher educators as gatekeepers: Preparing the next generation of teachers for technology integration in education. British Journal of Educational Technology, 50(3), 1189–1209. https://doi.org/10.1111/bjet.12748CrossRef Tondeur, J., Scherer, R., Baran, E., Siddiq, F., Valtonen, T., & Sointu, E. (2019). Teacher educators as gatekeepers: Preparing the next generation of teachers for technology integration in education. British Journal of Educational Technology, 50(3), 1189–1209. https://​doi.​org/​10.​1111/​bjet.​12748CrossRef
Zurück zum Zitat Ulitzsch, E., von Davier, M., & Pohl, S. (2020). A hierarchical latent response model for inferences about examinee engagement in terms of guessing and item-level non-response. The British Journal of Mathematical and Statistical Psychology, 73(Suppl 1), 83–112. https://doi.org/10.1111/bmsp.12188CrossRef Ulitzsch, E., von Davier, M., & Pohl, S. (2020). A hierarchical latent response model for inferences about examinee engagement in terms of guessing and item-level non-response. The British Journal of Mathematical and Statistical Psychology, 73(Suppl 1), 83–112. https://​doi.​org/​10.​1111/​bmsp.​12188CrossRef
Metadaten
Titel
Computational Thinking Assessment – Towards More Vivid Interpretations
verfasst von
Josef Guggemos
Sabine Seufert
Marcos Román-González
Publikationsdatum
27.01.2022
Verlag
Springer Netherlands
Erschienen in
Technology, Knowledge and Learning / Ausgabe 2/2023
Print ISSN: 2211-1662
Elektronische ISSN: 2211-1670
DOI
https://doi.org/10.1007/s10758-021-09587-2

Weitere Artikel der Ausgabe 2/2023

Technology, Knowledge and Learning 2/2023 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.