skip to main content
10.1145/2999541.2999550acmotherconferencesArticle/Chapter ViewAbstractPublication Pageskoli-callingConference Proceedingsconference-collections
research-article

Towards an E-assessment tool for advanced software engineering skills

Published:24 November 2016Publication History

ABSTRACT

E-assessment enjoys growing attention in university courses and is increasingly applied. Although automated feedback and grading for creative question types is a complex endeavor, more and more tools are developed to support e-assessment for miscellaneous question types. This paper focuses on an automated assessment of UML class diagrams. While there are already tools which support the analysis of student solutions for UML class diagrams, they only provide feedback on a low level. This paper motivates a need for assessing advanced computer science skills. For this, an analysis of student exams is conducted, focusing on exams which instruct the student to choose an appropriate design pattern for a given use case. Further, a prototype is presented which allows for an identification of design patterns, as a first step of a UML assessment tool. For this purpose, an algorithm for error-tolerant subgraph isomorphisms is adopted and extended which deals with multiple design patterns at the same time in order to match them to the students' solutions. Since it is possible to model design patterns in different sizes, a pattern template notation is presented which enables to specify the possible variants of each design pattern. A new algorithm then translates the pattern templates to be understood by the adopted matching algorithm. Finally, the identification process is evaluated empirically, showing the merits and the limitations of this approach.

References

  1. H. Bunke. Error correcting graph matching: On the influence of the underlying cost function. IEEE transactions on pattern analysis and machine intelligence, 21(9):917--922, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Client.IO. JointJS. url: http://jointjs.com/ (visited on 06/03/2016).Google ScholarGoogle Scholar
  3. R. Diestel. Graph Theory. Springer-Verlag, New York, electronic ed., 2000.Google ScholarGoogle Scholar
  4. J. Dong, Y. Sun, and Y. Zhao. Design pattern detection by template matching. In Proceedings of the 2008 ACM symposium on Applied computing. ACM, 2008, pp. 765--769. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. E. Gamma, R. Helm, R. Johnson, and J. Vlissides. Design patterns: elements of reusable object-oriented software. Addison-Wesley, 1995. ISBN: 0201633612. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. X. Gao, B. Xiao, D. Tao, and X. Li. A survey of graph edit distance. Pattern Analysis and applications, 13(1):113--129, 2010.Google ScholarGoogle ScholarCross RefCross Ref
  7. M. Gupta, R. S. Rao, and A. K. Tripathi. Design pattern detection using inexact graph matching. In International Conference on Communication and Computational Intelligence. IEEE, 2010, pp. 211--217.Google ScholarGoogle Scholar
  8. B. T. Messmer and H. Bunke. A new algorithm for error-tolerant subgraph isomorphism detection. IEEE transactions on pattern analysis and machine intelligence, 20(5):493--504, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. B. T. Messmer and H. Bunke. Efficient subgraph isomorphism detection: a decomposition approach. IEEE transactions on knowledge and data engineering, 12(2):307--323, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Moodle. Moodle. url: https://moodle.org/ (visited on 05/09/2016).Google ScholarGoogle Scholar
  11. A. Sanfeliu and K.-S. Fu. A distance measure between attributed relational graphs for pattern recognition. IEEE transactions on systems, man and cybernetics, (3):353--362, 1983.Google ScholarGoogle Scholar
  12. J. Soler, I. Boada, F. Prados, J. Poch, and R. Fabregat. A web-based e-learning tool for UML class diagrams. In Education Engineering, 2010, pp. 973--979.Google ScholarGoogle Scholar
  13. M. Striewe and M. Goedicke. Automated checks on UML diagrams. In Proceedings of the 16th annual joint conference on Innovation and technology in computer science education. ACM, New York, USA, 2011, pp. 38--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. P. G. Thomas, K. Waugh, and N. Smith. Learning and automatically assessing graph-based diagrams. In Beyond Control: learning technology for the social network generation. Research Proceedings of the 14th ALT-C. Citeseer, 2007, pp. 61--74.Google ScholarGoogle Scholar
  15. N. Tsantalis, A. Chatzigeorgiou, G. Stephanides, and S. T. Halkidis. Design pattern detection using similarity scoring. IEEE transactions on software engineering, 32(11):896--909, 2006. ISSN: 0098--5589. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Towards an E-assessment tool for advanced software engineering skills

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Other conferences
            Koli Calling '16: Proceedings of the 16th Koli Calling International Conference on Computing Education Research
            November 2016
            189 pages
            ISBN:9781450347709
            DOI:10.1145/2999541

            Copyright © 2016 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 24 November 2016

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article

            Acceptance Rates

            Koli Calling '16 Paper Acceptance Rate21of57submissions,37%Overall Acceptance Rate80of182submissions,44%

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader