An adaptive and innovative question-driven competition-based intelligent tutoring system for learning

https://doi.org/10.1016/j.eswa.2012.01.020Get rights and content

Abstract

ISCARE (Information System for Competition based on pRoblem solving in Education) is a new and innovative intelligent tutoring system that we have designed and implemented. This tool allows the competition among students for improving their learning process in a course. The tool takes some ideas from the Swiss-system widely used in chess and adapts them to the educational area. The competition is based on different tournaments and rounds. In each round, students are assigned in pairs of two, which compete one against another, and each pair receives different questions that students have to solve in a limit of time. Students can see their partial ratings after each round and their final rating after a tournament. A lot of knowledge from different disciplines was used to design, and implement this system, as ISCARE includes different functionality such as the students’ registration into the system, the creation of tournaments, the registration and assignment of students to tournaments, the management of each tournament life cycle (started, in execution, finished, etc.), the addition of the different exercises to tournaments, the calculation of pairs of students for each round with different algorithms, the assignment of exercises per round and pair, the scorings of the students per round and tournament, the management of the students’ ratings, or the visualization of information. This paper presents the ISCARE intelligent tutoring system, describing its different options, menus, or functionality as well as its architecture and the specific modeling to achieve the desired features.

Highlights

► An innovative intelligent system for students’ competition in education is presented. ► An adaptation of the Swiss-system based tournaments for education is proposed. ► A tournament and round life cycle for competition is presented. ► Two adaptive capabilities are implemented: for pairing and problems assignment. ► Different students’ scorings and ratings are proposed depending on their performance.

Introduction

The use of intelligent tutoring systems (ITSs) in education has increased considerably over the last years. An ITS is an expert system that helps students and teachers in the learning process. ITSs can be accessed by teachers and students through the Web or as a stand-alone application. An ITS is usually divided into four modules (Wenger, 1987): the interface module (what teachers and students interacts with in the system), the expert module (the specific contents), the pedagogical module (the different strategies of teaching), and the user model (some data to represent students and teachers in the system, so that different contents and strategies can be adapted to the different profiles). ITSs are software applications that must enable and manage the desired learning processes, and make convenient decisions about different issues such as the materials that are shown at each moment for different profiles, or motivational and emotional aspects.

One type of ITS is based on the competition among students in their learning process, but there are only a few of these competition-based ITSs. Maybe, this limited number of competition-based ITSs is a consequence of the different arguments against competition, which are described by different authors, e.g. (Kohn, 1986). But there are other studies that argue about the benefits of competition in education, e.g. (Yu, 2001). From our point of view, the success of the introduction of competitive tools in the learning process depends on the specific competitive strategies applied, as stated in Ediger (1996).

In this direction, we have developed and implemented a system for students’ competition in education that tries to include some of the best practices to increase student learning in the process. The designed and implemented competition-based system is called ISCARE (Information System for Competition based on pRoblem solving in Education), and it includes a couple of new and innovative features with respect to existing competition-based systems for learning, as it is analyzed in Section 2.

One of the first ideas taken for the design of ISCARE was the application of the Swiss-system used e.g. in chess tournaments. The Swiss-system divides a tournament in different rounds. In each round, participants are paired, forming matches of one against one. Students are paired with classmates of their similar knowledge level in that moment. Participants can win (1 point), lose (0 points), or draw (0.5 points) in each round. All participants play the same number of games (one per round) even if they lose in several games. There are partial ratings after each round in which students are rated according to their performance up to that round, and a final tournament rating. The Swiss-system has been adapted in ISCARE taken into account an educational competition perspective. ISCARE supports different rounds in which students participate, and matches are assigned according to the students scorings up to that round, so that students with a similar knowledge level can compete one against another. In addition, students cannot only receive points to increase their scoring depending on the comparison with their opponents, but also depending on their problem solving performance in that round.

ISCARE has to take care of a lot of tasks for implementing the desired competition that can produce a learning benefit for students. For example, ISCARE has to make the student pair assignments for each round (trying to pair students with a similar scoring up to that moment), select the different possible problems for each round, adapt the different problems to the different pairs (trying to assign problems with a difficulty level according to the students pairs knowledge levels), track the different students’ progress during the tournament and their statistics (such as topics in which a student failed more), show the different problems to the students in a synchronized way, show the opponents and own information during the round competition, manage a tournament life cycle (start, execution, finished, etc.), manage the different tournaments (creation, deletion, assignment of students to different tournaments, etc.), or enabling teachers to upload different types of problems for students before a tournament starts and making possible their reuse.

Several of the presented tasks in the ISCARE system cannot be done efficiently by human teachers, without the intervention of computers. Teachers would have to devote a lot of time to execute the algorithms to pair the different students, adapt the different problems for different pairs, give different pieces of papers for every student which are adaptive depending on previous round results, make the different scoring calculations, manage the different rounds and tournaments, etc. In addition, these are complex operations that can usually lead to teachers’ mistakes because of the high number of algorithmic operations to perform. Nevertheless, an intelligent system such as ISCARE can make it quickly, efficiently and without errors because of the high computing capacity of ITSs. In order to achieve it properly, a lot of considerations from different expertise areas must be taken into account, which includes: a useful interface for teachers and students, a complete and proper modeling for all the educational and management functionality, selection of the proper algorithms (for adaptation of problems, adaptation of pairs, scoring calculations, etc.), or the selection of the architecture.

This paper shows a detailed description of the implemented ISCARE system to show all their features and the differences with respect to existing systems. Furthermore, the paper shows how the functionality is implemented as a specific modeling. Section 2 explains related works and compares existing competition-based ITSs for education with respect to our solution, emphasizing the novelties of our ISCARE system. Section 3 explains the architecture of ISCARE. Sections 4 Management of users and tournaments, 5 Description of a competition round in the system, 6 Information about the users and problems in the system are devoted to the explanation and description of the different features of ISCARE: Section 4 is about the management of users and tournaments in the system, Section 5 is about the description of a specific round, while Section 6 is about the different ratings and information of the users in the system. Finally, Section 7 summarizes our conclusions and directions of future work regarding the ISCARE tool.

Section snippets

Related work and innovation of the ISCARE system

There are different experiences of the use of competition (Verhoeff, 1987) and games (Amori et al., 1999, Squire and Jenkins, 2003) in education. Although competition and games are different concepts, they have a relationship and most games introduce a certain degree of competition (against the computer or other opponents). Therefore, a lot of games in education also contain a competitive part. In any case, both games and competition provide a motivational and enjoyment component that can

Architecture of ISCARE

The ISCARE system is based on a typical client-server architecture. The server listens to different HTTP requests for clients in a specific port. The server can make different actions, one of them is to access to a defined data base which can be in another different machine from the server. The server makes the processing of the different client requests, and sends the different HTTP responses to the clients. The HTTP responses include HTML materials. The clients are browser applications and

Management of users and tournaments

In this section, we describe the main aspects related to the management of users and tournaments in the ISCARE system. There are two different profiles in the system: students and teachers/administrators. Depending on the user profile, there are different options available in ISCARE. The tournament is the high level concept in which the competition is based. Students compete in tournaments that are configured by teachers.

This section is organized in the following subsections: Section 4.1

Description of a competition round in the system

For the execution of a round in the ISCARE system, teachers need to upload the candidate problems that students must solve during that round, set the specific round parameters (such as the time in which the round competition will take place), enable the calculation of the different pairings for that round and the assigned problems to solve for each pairing, and start the round. Students must view the round information to know the time for the round competition and the opponent for each round.

Information about the users and problems in the system

When time for a round is over, the round finishes and ISCARE calculates a round assignment of points for all students. The final students scoring for the tournament related to a round is in the interval [0, 2] and it is calculated as the sum of these two terms:

  • Individual points. A scoring in the interval [0, 1] depending only on the student’s performance on the different problems. Internally, the round points can have an undefined maximum number of points that is the sum of the maximum points for

Conclusions

This work presents a detailed description of our ISCARE tool, which is an ITS that enables competition among students in an educational environment. The paper shows the different features of the tool and how they are innovative with respect to previous educational competitive systems. With the description, it is shown the specific innovative modeling of the tool, including its different features, how they are easy to use, the algorithm selection or the selected architecture.

The ISCARE tool

Acknowledgements

Work partially funded by the Learn3 project TIN2008-05163/TSI and the EEE project TIN 2011-28308-CO3-1 within the Spanish “Plan Nacional de I+D+I”, and the Madrid regional community project eMadrid S2009/TIC-1650.

References (26)

  • J.C. Burguillo

    Using game theory and competition-based learning to stimulate student motivation and performance

    Computers & Education

    (2010)
  • A. Amori et al.

    The use of computer games as an educational tool: Identification of appropriate game types and game elements

    British Journal of Educational Technology

    (1999)
  • P. Behrooz

    Motivating computer engineering freshmen through mathematical and logical puzzles

    IEEE Transactions on Education

    (2009)
  • Carrington, D., Baker, A., & van der Hoek, A. (2004). It’s all in the game: Teaching software process concepts. In...
  • L. Chang et al.

    Development and evaluation of multiple competitive activities in a synchronous quiz game system

    Innovations in Education & Training International

    (2003)
  • Chen, Z., Liao, C. C. Y., & Chan, T. (2010). Learning by pet-training competition: alleviating negative influences of...
  • Conklin, A. (2006). Cyber defense competitions and information security education: An active learning solution for a...
  • H. Chua et al.

    Learning case adaptation for problem-oriented e-learning on mathematics teaching for students with mild disabilities

    Expert Systems with Applications

    (2011)
  • M. Ediger

    Cooperative learning versus competition: Which is better?

    Journal of Instructional Psychology

    (1996)
  • Feng, M., Heffernan, N. T., & Koedinger, K. R. (2006). Predicting state test scores better with intelligent tutoring...
  • E. Guzman et al.

    Self-assessment in a feasible, adaptive web-based testing system

    IEEE Transactions on Education

    (2005)
  • IMS QTI, Question and Test Interoperability Specification (2005)....
  • A. Kohn

    No contest: The case against competition

    (1986)
  • Cited by (36)

    • Assessment of skills and adaptive learning for parametric exercises combining knowledge spaces and item response theory

      2018, Applied Soft Computing Journal
      Citation Excerpt :

      Computer Adaptive Testing (CAT) systems adapt a specific educational resource, which is the questions in a test [13]. There are several examples of these types of systems such as the presented in Muñoz-Merino et al. [14] or in Lin, Gong, & Zhang [15]. Lin, Gong, & Zhang [15] pointed out that the adaptation of items depends on the type of skill modelling used and they presented an adaptation algorithm for cognitive diagnosis models (CDMs) which is different from those based on IRT.

    • Recognizing the Value of Recognition in Education

      2023, IEEE Global Engineering Education Conference, EDUCON
    • Competition Supported by Information Technologies Including IoT Scenarios

      2022, 15th International Conference of Technology, Learning and Teaching of Electronics, TAEE 2022 - Proceedings
    • Iterative Refinement of an AIS Rewards System

      2022, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    View all citing articles on Scopus
    View full text