1 Introduction
2 Research Perspective
2.1 Student Academic Performance Onsite and Online
Onsite environments | Online environments | |
---|---|---|
Description | Teaching takes place in a physical classroom | Teaching takes place through digital media |
Communication type | Synchronous | Synchronous and/or asynchronous |
Learning pace and leading role | Leading role of the teacher, traditionally through the lecture Students have a more passive role (notwithstanding the increasingly widespread use of active methodologies) | Leading role of the student, who is responsible for their own learning, for being self-taught and for playing an active role The teacher acts as a guide |
Material support | Predominantly physically based | Digital |
Main tools | Lecture, interactive presentations, face-to-face tutorials When implementing active methodologies, typical tools used in online environments could be adapted | Digital tools for digital content management, communication, and collaboration tools (such as forums and chats), digital monitoring and evaluation tools (such as self-assessment and peer evaluation) are prominent Student identity verification tools should be implemented |
Assessment tasks | Assessment tasks are basically based on exams (oral or written), practical cases, workshops, and/or student observation | The range of assessment is expanded. Beyond virtual exams and practical exercises, digital tools for assessment learning, results, processes, and competencies are prominent (e.g., forums, wikis, portfolios, project development, collaborative work between students from different countries) There is a need to properly authenticate and verify the identity of the student |
Teaching–learning approach | Focused on content if it is only based on the lecture; or focused on learning if the teacher encourages the active participation of the student and guides them in their learning | Focused on content if limited to providing materials and assessing them; or focused on learning if the potential of digital tools is used |
Advantages | Closer relationship with the teacher Promotes human contact and socialization through day-to-day coexistence Improved communication skills (verbal and non-verbal) | Greater flexibility, accessibility and autonomy Elimination of geographical barriers and a more varied offer of studies Greater dynamism Greater speed and ease when updating digital materials More adapted to the student’s own pace |
Disadvantages | Higher economic costs Greater rigidity at the schedule level, which makes it more difficult to achieve a student/family life balance Greater difficulty and more time required to update materials—normally analog All students (regardless of their needs) must adapt to the pace of the group | Demands greater self-discipline Less direct contact with the teacher Increased difficulty socializing Greater complexity for students not adapted to ICTs and/or students with few resources It can generate some reluctance from certain teachers and students Greater difficulty for students with special needs |
2.2 The Role Played by Self-assessment Activities
3 Methodology
3.1 Sample and Data
General information | • Degree: Labor Relations and Human Resources |
• Year: first | |
• Type: compulsory | |
• Number of groups: four | |
• Term taught: second | |
• Type of teaching: campus-based course | |
Course contents | Contents are divided into the following topics: |
1. Introduction to Work Organization | |
2. Production systems planning | |
3. Project management | |
4. Quality management | |
5. Just-in-time | |
6. Improvement of methods and times | |
Teaching methods | It is comprised of the following learning activities: |
• Lectures (workload: 30 h) | |
• Individual and group tutorships (workload: 6 h) | |
• Practical lessons, seminars, and learning by projects (workload: 24 h) | |
• Independent learning (workload: 90 h) | |
Assessment system | (A) Final exam (55%): |
• Part I (15%): A multiple-choice test with four alternative answers, which will include up to 30 questions, whose score can range from 0 to 10 | |
• Part II (40%): Three open questions (including theory and practical issues), whose score can range from 0 to 10 | |
(B) Self-assessment and practical activities (40%): | |
• Self-assessment activities (25%): Several multiple-choice tests (which came to six) of four alternative answers, which will include up to 10 questions per test, whose score can range from 0 to 10 per test | |
• Practical activities (15%): Practical activities scheduled during the semester will be evaluated. These activities are announced at the beginning of the course, and the score can range from 0 to 10 per activity | |
(C) Student participation (5%): refers to student participation in the different activities scheduled during the semester |
3.2 Variables
Learning outcomes | Academic performance | Measured on a continuous variable (from 0 to 10) that represents the grade obtained by students in the final exam for the course |
The final exam has two different parts: The first comprises a multiple-choice test of four alternative answers, which will include up to 30 questions; while the second comprises three open questions (including theory and practical issues) | ||
Success rates | Measured on a continuous scale from 0 to 100% that measures the percentage of students who pass the course out of the total number of students who take the exam and who are assessed | |
Performance rates | Measured on a continuous scale from 0 to 100% that measures the percentage of students who pass the course out of the total number of students enrolled | |
Participation and grades in self-assessment | Participation in self-assessment | Measured by counting the number of self-assessment tests taken on the Kahoot platform for each student out of the total number of tests available (which came to six) |
Grades in self-assessment | Measured on a continuous variable (from 0 to 10) that represents the grade obtained by the students in the self-assessment tests taken through the Kahoot platform | |
Each of these activities comprises a multiple-choice test of four alternative answers, which will include up to 10 questions | ||
Several screenshots showing an example of a self-assessment activity are shown in Appendix A | ||
Control variables | Gender | Measured through a dichotomous variable that takes the value 1 when the gender is “female”, and 0 when the gender is “male” |
Access to resources | Measured by the distance (in kilometers) from each student’s place of residence to the Faculty of Work Sciences (located on the Espinardo Campus at the University of Murcia) where the degree is taught | |
Students’ previous experience on the course | Measured through a continuous variable that indicates the number of times the student took the examination (including the current one) | |
Class group | This refers to the group which each student enrolled in the course on Work Organization belongs to. There are four groups in all (A, B, C or D). The first two are morning groups (A and B), and the latter two are afternoon/evening groups (C and D) |
3.3 Analysis
4 Results
4.1 Descriptive Statistics and Correlations
Student profile | |||||
---|---|---|---|---|---|
Group A | Group B | Group C | Group D | Total | |
2018/2019 academic year | |||||
Students | 70 | 69 | 44 | 70 | 253 |
Gender | |||||
Male | 50.0% | 44.9% | 36.4% | 34.3% | 41.9% |
Female | 50.0% | 55.1% | 63.5% | 65.7% | 58.1% |
Age | |||||
18–20 years | 61.4% | 68.1% | 27.3% | 71.4% | 60.1% |
21–25 years | 31.4% | 24.6% | 59.1% | 24.3% | 32.4% |
26 years old or more | 7.1% | 7.2% | 13.6% | 4.3% | 7.5% |
Experience on the course | |||||
First time enrolled | 71.4% | 60.9% | 56.8% | 85.7% | 70.0% |
Second time | 18.6% | 26.1% | 34.1% | 14.3% | 22.1% |
Third time or more | 10.0% | 13.0% | 9.1% | 0.0% | 7.9% |
2019/2020 academic year | |||||
Students | 75 | 76 | 56 | 45 | 252 |
Gender | |||||
Male | 48.0% | 47.4% | 46.4% | 37.8% | 45.6% |
Female | 52.0% | 52.6% | 53.6% | 62.2% | 54.4% |
Age | |||||
18–20 years | 61.3% | 68.4% | 26.8% | 60.0% | 55.6% |
21–25 years | 30.7% | 23.7% | 57.1% | 33.3% | 34.9% |
26 years old or more | 8.0% | 7.9% | 16.1% | 6.7% | 9.5% |
Experience on the course | |||||
First time enrolled | 76.0% | 81.6% | 67.9% | 86.7% | 77.8% |
Second time | 10.7% | 7.9% | 19.6% | 8.9% | 11.5% |
Third time or more | 13.3% | 10.5% | 12.5% | 4.4% | 10.7% |
Total | |||||
Students | 145 | 145 | 100 | 115 | 505 |
Gender | |||||
Male | 49.0% | 46.2% | 42.0% | 35.7% | 43.8% |
Female | 51.0% | 53.8% | 58.0% | 64.3% | 56.2% |
Age | |||||
18–20 years | 61.4% | 68.3% | 27.0% | 67.0% | 57.8% |
21–25 years | 31.0% | 24.1% | 58.0% | 27.8% | 33.7% |
26 years old or more | 7.6% | 7.6% | 15.0% | 5.2% | 8.5% |
Experience with the course | |||||
First time enrolled | 73.8% | 71.7% | 63.0% | 86.1% | 73.9% |
Second time | 14.5% | 16.6% | 26.0% | 12.2% | 16.8% |
Third time or more | 11.7% | 11.7% | 11.0% | 1.7% | 9.3% |
Mean | SD | (1) | (2) | (3) | (4) | (5) | (6) | (7) | (8) | (9) | (10) | |
---|---|---|---|---|---|---|---|---|---|---|---|---|
(1) Access to university resources | 38.01 | 46.64 | 1.00 | |||||||||
(2) Gender | 0.56 | 0.50 | 0.06 | 1.00 | ||||||||
(3) Previous examinations taken | 1.13 | 0.91 | 0.03 | − 0.01 | 1.00 | |||||||
(4) Self-assessment mark 1 | 5.65 | 1.59 | − 0.04 | − 0.07 | 0.15* | 1.00 | ||||||
(5) Self-assessment mark 2 | 5.23 | 2.59 | − 0.07 | − 0.06 | 0.14* | 0.47* | 1.00 | |||||
(6) Self-assessment mark 3 | 6.53 | 2.49 | − 0.02 | − 0.18* | − 0.01 | 0.28* | − 0.07 | 1.00 | ||||
(7) Self-assessment mark 4 | 7.03 | 2.34 | − 0.02 | − 0.06 | 0.06 | 0.39* | 0.03 | 0.77* | 1.00 | |||
(8) Self-assessment mark 5 | 7.33 | 1.75 | − 0.01 | − 0.05 | 0.05 | 0.41* | 0.49* | 0.13* | 0.28* | 1.00 | ||
(9) Self-assessment mark 6 | 6.20 | 1.98 | − 0.18* | − 0.07 | 0.05 | 0.40* | 0.36* | 0.39* | 0.37* | 0.41* | 1.00 | |
(10) Participation in Kahoot | 3.59 | 2.38 | 0.05 | − 0.02 | 0.12*** | 0.29*** | − 0.01 | 0.52*** | 0.34*** | 0.04 | 0.34*** | 1.00 |
(11) Academic performance | 5.95 | 2.37 | 0.01 | − 0.01 | − 0.32* | 0.29* | 0.49* | − 0.02 | 0.03 | 0.36* | 0.37* | 0.21*** |
4.2 Hypotheses Testing
Academic performance | ||||
---|---|---|---|---|
Final course mark | ||||
Final mark | Statistical test | |||
Sample | 2018/2019 | 2019/2020 | Student t | Sig |
Pre-COVID | COVID | |||
Total | 6.66 (167 | 2.34) | 5.22 (156 | 2.18) | 5.81 | 0.00 |
Group A | 7.25 (47 | 1.60) | 5.42 (50 | 2.46) | 4.35 | 0.00 |
Group B | 6.43 (47 | 2.82) | 4.91 (49 | 1.85) | 3.12 | 0.00 |
Group C | 6.08 (29 | 2.95) | 5.11 (33 | 2.66) | 1.36 | 0.18 |
Group D | 6.68 (44 | 1.88) | 5.49 (34 | 1.67) | 2.90 | 0.01 |
Total | 2018/2019 | 2019/2020 | |
---|---|---|---|
Pre-COVID | COVID | ||
Enrolled [N] | 505 | 253 | 252 |
Took the exam [N] | 333 | 167 | 166 |
Passed [N] | 224 | 128 | 96 |
Performance rate | 44.35% | 50.59% | 38.09% |
Success rate | 67.26% | 76.64% | 57.83% |
Model 1 | Model 2 | |||
---|---|---|---|---|
Academic performance | Academic performance | |||
Academic year 2018/2019 | Academic year 2019/2020 | |||
Pre-COVID | COVID | |||
Standardized coefficients | VIF | Standardized coefficients | VIF | |
Access to resources | 0.14** | 1.00 | 0.04 | 1.04 |
Previous experience with the course | − 0.22*** | 1.10 | − 0.29*** | 1.11 |
Student gender | 0.16*** | 1.03 | 0.17*** | 1.01 |
Mark in self-assessment | 0.32*** | 1.10 | 0.46*** | 1.08 |
Participation in self-assessment | 0.32*** | 1.03 | 0.18*** | 1.13 |
F | 20.34 | 31.80 | ||
R2 | 0.38 | 0.30 |