Skip to main content

2018 | OriginalPaper | Buchkapitel

Adaptive Clustering of Codes for Assessment in Introductory Programming Courses

verfasst von : Alexandre de A. Barbosa, Evandro de B. Costa, Patrick H. Brito

Erschienen in: Intelligent Tutoring Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Despite the importance of introductory programming disciplines, it is quite common to find problems related to academic students performance. In such environments, we easily find unmotivated students with some doubts and that do not understand basic programming concepts. Monitoring each of the students is not trivial because the number of students is high and, to do so, it would be necessary to observe many characteristics of each code submitted for practical activities. The teacher, even when helped by TAs (Teacher Assistants), is not able to perform the reviews quickly, for this activity requires a huge amount of time. Fast feedback is extremely important to enable the learning of any concept. In this research, we investigate an adaptive approach to cluster codes in order to minimize the effort of evaluation. The results vary from reasonable to perfect concordances, considering the semiautomatic evaluations obtained with the clustering and the expert evaluations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat McCracken, M., Almstrum, V., Diaz, D., Guzdial, M., Hagan, D., Kolikant, Y.B.D., Laxer, C., Thomas, L., Utting, I., Wilusz, T.: A multi-national, multi-institutional study of assessment of programming skills of first-year CS students. In: Working Group Reports from ITiCSE on Innovation and Technology in Computer Science Education, ITiCSE-WGR 2001, pp. 125–180. ACM, New York (2001) McCracken, M., Almstrum, V., Diaz, D., Guzdial, M., Hagan, D., Kolikant, Y.B.D., Laxer, C., Thomas, L., Utting, I., Wilusz, T.: A multi-national, multi-institutional study of assessment of programming skills of first-year CS students. In: Working Group Reports from ITiCSE on Innovation and Technology in Computer Science Education, ITiCSE-WGR 2001, pp. 125–180. ACM, New York (2001)
2.
Zurück zum Zitat Stegeman, M., Barendsen, E., Smetsers, S.: Towards an empirically validated model for assessment of code quality. In: Proceedings of the 14th Koli Calling International Conference on Computing Education Research, Koli Calling 2014, pp. 99–108. ACM, New York (2014) Stegeman, M., Barendsen, E., Smetsers, S.: Towards an empirically validated model for assessment of code quality. In: Proceedings of the 14th Koli Calling International Conference on Computing Education Research, Koli Calling 2014, pp. 99–108. ACM, New York (2014)
3.
Zurück zum Zitat de Raadt, M., Toleman, M., Watson, R.: An evaluation of electronic individual peer assessment in an introductory programming course. In: Lister, R., Simon (eds.) Seventh Baltic Sea Conference on Computing Education Research (Koli Calling 2007), Koli National Park, Finland. CRPIT, vol. 88, pp. 53–64. ACS (2007) de Raadt, M., Toleman, M., Watson, R.: An evaluation of electronic individual peer assessment in an introductory programming course. In: Lister, R., Simon (eds.) Seventh Baltic Sea Conference on Computing Education Research (Koli Calling 2007), Koli National Park, Finland. CRPIT, vol. 88, pp. 53–64. ACS (2007)
4.
Zurück zum Zitat Sitthiworachart, J., Joy, M.: Computer support of effective peer assessment in an undergraduate programming class. J. Comput. Assist. Learn. 24(3), 217–231 (2008)CrossRef Sitthiworachart, J., Joy, M.: Computer support of effective peer assessment in an undergraduate programming class. J. Comput. Assist. Learn. 24(3), 217–231 (2008)CrossRef
5.
Zurück zum Zitat Warren, J., Rixner, S., Greiner, J., Wong, S.: Facilitating human interaction in an online programming course. In: Proceedings of the 45th ACM Technical Symposium on Computer Science Education, SIGCSE 2014, pp. 665–670. ACM, New York (2014) Warren, J., Rixner, S., Greiner, J., Wong, S.: Facilitating human interaction in an online programming course. In: Proceedings of the 45th ACM Technical Symposium on Computer Science Education, SIGCSE 2014, pp. 665–670. ACM, New York (2014)
6.
Zurück zum Zitat Kulkarni, C., Wei, K.P., Le, H., Chia, D., Papadopoulos, K., Cheng, J., Koller, D., Klemmer, S.R.: Peer and self assessment in massive online classes. ACM Trans. Comput.-Hum. Interact. 20(6), 33:1–33:31 (2013)CrossRef Kulkarni, C., Wei, K.P., Le, H., Chia, D., Papadopoulos, K., Cheng, J., Koller, D., Klemmer, S.R.: Peer and self assessment in massive online classes. ACM Trans. Comput.-Hum. Interact. 20(6), 33:1–33:31 (2013)CrossRef
7.
Zurück zum Zitat Piech, C., Huang, J., Chen, Z., Do, C.B., Ng, A.Y., Koller, D.: Tuned models of peer assessment in MOOCs. CoRR abs/1307.2579 (2013) Piech, C., Huang, J., Chen, Z., Do, C.B., Ng, A.Y., Koller, D.: Tuned models of peer assessment in MOOCs. CoRR abs/1307.2579 (2013)
8.
Zurück zum Zitat Hext, J.B., Winings, J.W.: An automatic grading scheme for simple programming exercises. Commun. ACM 12(5), 272–275 (1969)CrossRef Hext, J.B., Winings, J.W.: An automatic grading scheme for simple programming exercises. Commun. ACM 12(5), 272–275 (1969)CrossRef
9.
Zurück zum Zitat Forsythe, G.E., Wirth, N.: Automatic grading programs. Commun. ACM 8(5), 275–278 (1965)CrossRef Forsythe, G.E., Wirth, N.: Automatic grading programs. Commun. ACM 8(5), 275–278 (1965)CrossRef
10.
Zurück zum Zitat Yulianto, S.V., Liem, I.: Automatic grader for programming assignment using source code analyzer. In: 2014 International Conference on Data and Software Engineering (ICODSE), pp. 1–4. IEEE (2014) Yulianto, S.V., Liem, I.: Automatic grader for programming assignment using source code analyzer. In: 2014 International Conference on Data and Software Engineering (ICODSE), pp. 1–4. IEEE (2014)
11.
Zurück zum Zitat Gaudencio, M., Dantas, A., Guerrero, D.D.: Can computers compare student code solutions as well as teachers? In: Proceedings of the 45th ACM Technical Symposium on Computer Science Education (2014) Gaudencio, M., Dantas, A., Guerrero, D.D.: Can computers compare student code solutions as well as teachers? In: Proceedings of the 45th ACM Technical Symposium on Computer Science Education (2014)
12.
Zurück zum Zitat Biggers, L.R., Kraft, N.A.: Quantifying the similiarities between source code lexicons. In: Proceedings of the 49th Annual Southeast Regional Conference, ACM-SE 2011, pp. 80–85. ACM, New York (2011) Biggers, L.R., Kraft, N.A.: Quantifying the similiarities between source code lexicons. In: Proceedings of the 49th Annual Southeast Regional Conference, ACM-SE 2011, pp. 80–85. ACM, New York (2011)
13.
Zurück zum Zitat Li, S., Xiao, X., Bassett, B., Xie, T., Tillmann, N.: Measuring code behavioral similarity for programming and software engineering education. In: Proceedings of the 38th International Conference on Software Engineering Companion, ICSE 2016, pp. 501–510. ACM, New York (2016) Li, S., Xiao, X., Bassett, B., Xie, T., Tillmann, N.: Measuring code behavioral similarity for programming and software engineering education. In: Proceedings of the 38th International Conference on Software Engineering Companion, ICSE 2016, pp. 501–510. ACM, New York (2016)
14.
Zurück zum Zitat Srikant, S., Aggarwal, V.: A system to grade computer programming skills using machine learning. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2014, pp. 1887–1896. ACM, New York (2014) Srikant, S., Aggarwal, V.: A system to grade computer programming skills using machine learning. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2014, pp. 1887–1896. ACM, New York (2014)
15.
Zurück zum Zitat Choudhury, R.R., Yin, H., Moghadam, J., Chen, A., Fox, A.: Autostyle: scale-driven hint generation for coding style. In: Proceedings of the 13th International Conference on Intelligent Tutoring Systems, ITS, vol. 201, pp. 122–132 (2016) Choudhury, R.R., Yin, H., Moghadam, J., Chen, A., Fox, A.: Autostyle: scale-driven hint generation for coding style. In: Proceedings of the 13th International Conference on Intelligent Tutoring Systems, ITS, vol. 201, pp. 122–132 (2016)
16.
Zurück zum Zitat Yin, H., Moghadam, J., Fox, A.: Clustering student programming assignments to multiply instructor leverage. In: Proceedings of the Second (2015) ACM Conference on Learning @ Scale, L@S 2015, pp. 367–372. ACM, New York (2015) Yin, H., Moghadam, J., Fox, A.: Clustering student programming assignments to multiply instructor leverage. In: Proceedings of the Second (2015) ACM Conference on Learning @ Scale, L@S 2015, pp. 367–372. ACM, New York (2015)
17.
Zurück zum Zitat Fitzpatrick, J.: More C++ Gems, pp. 245–264. Cambridge University Press, New York (2000) Fitzpatrick, J.: More C++ Gems, pp. 245–264. Cambridge University Press, New York (2000)
18.
Zurück zum Zitat Sommerville, I.: Software Engineering, 9th edn. Addison-Wesley Publishing Company, Boston (2010)MATH Sommerville, I.: Software Engineering, 9th edn. Addison-Wesley Publishing Company, Boston (2010)MATH
19.
Zurück zum Zitat McCabe, T.J.: Cyclomatic complexity and the year 2000. IEEE Softw. 13(3), 115–117 (1996)CrossRef McCabe, T.J.: Cyclomatic complexity and the year 2000. IEEE Softw. 13(3), 115–117 (1996)CrossRef
20.
Zurück zum Zitat Halstead, M.H.: Elements of Software Science (Operating and Programming Systems Series). Elsevier Science Inc., New York (1977)MATH Halstead, M.H.: Elements of Software Science (Operating and Programming Systems Series). Elsevier Science Inc., New York (1977)MATH
22.
Zurück zum Zitat Cohen, J.: Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol. Bull. 70, 213–220 (1968)CrossRef Cohen, J.: Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol. Bull. 70, 213–220 (1968)CrossRef
Metadaten
Titel
Adaptive Clustering of Codes for Assessment in Introductory Programming Courses
verfasst von
Alexandre de A. Barbosa
Evandro de B. Costa
Patrick H. Brito
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-91464-0_2