Introduction
The food supply was “never so safe as today” at least in developed countries (Flynn et al.,
2017). However, foodborne illness is still an important public health problem world wide and everyone in the world is at risk of this disease, whether in developing or developed countries (WHO,
2008).
wide and everyone in the world is at risk of this disease, whether in developing or developed countries (WHO,
2008). Although the improvements in water sanitation, hygiene, and the safety of the food supply have greatly reduced the number of deaths morbidity remains high (Scallan & Angulo,
2007). The consume of contaminated food is responsible for 600 million ill people/year. There are about 420,000 deaths, which occur among these annual victims and there are 125,000 deaths that occur with children under 5 years of age (WHO,
2015). Food safety is a serious component of sustainable development, and complications that occur in one country may put other countries at risk because the food globalization process has revealed a substantial impact on the food safety (Scott,
2003; FDA,
2009). Providentially, there are increasing governments’ involvement in monitoring and regulating the sector to guarantee food quality and decrease foodborne diseases (Zanin et al.,
2017).
Food safety is essential to human nutrition and food security because poor nutrition and foodborne diseases frequently combine a vicious cycle of deterioration of health. Consequently, food safety must be methodically incorporated into policies and interventions to develop nutrition and food security. As the international community changes to the post–Millennium Development Goal stage with an emphasis on sustainable development goals, food safety is an essential element in improving global health and ensuring sustainable development. (WHO,
2013). Food safety is indeed an essential issue to address the Sustainable development goal n. 3 towards the insurance of healthy lives and promotion of well-being for all at all ages (UN,
2016,
2019).
European legislation demands food safety preparation in all EU countries. All food commercial technicians are required to ensure that all their staff involved in food handling activities are appropriately trained and/or coached in food hygiene (EC,
2004, Ovca et al.,
2017). According to the European Commission (EC,
2012), the European education and training systems are insufficient in providing the right skills for employability and are not co-operating satisfactorily with business or employers to bring the learning experience closer to the reality of the working environments (EC,
2012).
The food safety risk assessment is a scientific field that is constantly advancing and, as such, a lot of educational programmes have been developed recently with a focus on keeping professionals up to date with suitable lifelong training programmes on different forms (Bosman et al.,
2016). Many Programmes at European universities or other academic institutions provide specific programmes at Bachelor and Master’s levels, as well as doctoral education in food science, toxicology or other related areas that cover aspects of Food Safety and Food Risk Assessment (Kneifel,
2012). Nowadays, around 60 programmes in Europe formal education programmes and training) explicitly mention ‘Food Safety’ in their curriculum names (Bosman et al.,
2016). Students that are already on their professional jobs related with food industry, search lifelong training on this field of food safety, because of the requirement in the Codex Alimentarius (WHO & FAO,
2009). Within this requirement on-going training in the field of food safety is necessary for all levels of employees and managers, as appropriate and adapted to their background level. Zanin et al. (
2017), found in an integrative review, that the studies dealing with good manufacturing practices were conducted mainly in developing countries. Possibly, in countries where food safety regulation is more mature (e. g. Canada, USA, European Union countries), many of them with mandatory application of the HACCP (Hazard Analysis and Critical Control Point), system, the interest is greater in the application of management systems than the behavior of food handlers.
E-learning provides students with an educational alternative to face-to-face teaching, permitting students to proceed, at their own pace, and to identify their own personal course timeline while having at the same time full-time jobs (Azeiteiro et al.,
2015, Lee et al.,
2019). E-learning also leads to positive learning outcomes, such as a high level of learning achievement and higher-order thinking abilities, because it allows for leaners to actively engage in learning anytime and anywhere (Bacelar-Nicolau et al.,
2015; Lee et al.,
2019). In 2000, universities, companies and associations were seriously exploring the use of online education in an effort to reach adult learners unable to leave their work places (Matter & McNiel,
2008) and willing to acquire new skills. There was a virtual explosion in the number of online offerings among universities worldwide (Moura et al.,
2010).
Despite the advantages of learning, one important problem in e-learning is the higher dropout rate and learning barriers working students have to face in this regime (Bacelar-Nicolau et al.,
2015,
2012, Kim et al.,
2017). To overlap these barriers student’s engagement and motivation are essential (Lee et al.,
2019). Learning motivation of students can be induced by multiple factors, including intrinsic and extrinsic factors. For example, the motivation for good grades is an extrinsic factor and the preference for challenge is an intrinsic motivation (Lin et al.,
2001; Law et al.,
2019). The virtual environment involves many forms of media and materials that stimulate students’ interest in learning and results in higher satisfaction (Phungsuk et al.,
2017).
Student engagement is defined as the level of effort or interaction between the time or the learning resources that develop learning outcome. When students are engaged in their learning they can improve their critical thinking, problem-solving and grades, and also applied their acquired knowledge in their jobs (Lee et al.,
2019).
Learning Analytics is a fast-growing area in the field of Education, resulting in the generation of knowledge about agents and educational contexts, from large amounts of data (Data Mining), digital technologies and the Internet in learning Enhanced Learning (Ferguson et al.,
2012). Learning Analytics facilitates the analysis of student learning processes based on the dynamics of student and teacher participation in online contexts (notably in LMS - Learning Management System). The evolution of student learning, as well as the prevention of dropout and failure, are the areas where the influence of the Learning Analytics has more evidenced (Papamitsiou & Economides,
2014; Lacave et al.,
2018).
Besides some studies to evaluate e-learning efficiency at sciences courses (e.g. Azeiteiro et al.,
2015, Bacelar-Nicolau et al.,
2012,
2015, Moura et al.,
2010,
2014), there is a dearth of research about the efficiency and students satisfaction of e-learning courses about food safety, an up to date life long learning topic. Also there is a lack of clear direction as to how the higher education system is accommodating or not nowadays students’ needs (in terms of innovation tools and new pedagogies) in science learning (Bidarra & Rusman,
2017).
The aim of this research is to evaluate student’s satisfaction about the course organization, pedagogical resources, evaluation activities, acquired competences, relation with their professional activity and students’ engagement, after enrolling a Food Safety and Quality course place in a context of e-learning Master’s in Food Consumption Sciences programme offered by a national distance learning university, Universidade Aberta in Portugal.
Case study: the Universidade Aberta (the Portuguese open distance university) and the master degree in food sciences
Universidade Aberta (UAb) was created in 1988 and is the only Public Distance Learning higher education institution in Portugal. All educational offers at UAb are incorporated into the Bologna European Process and are taught via e-learning since 2008. UAb is a reference Higher Education European institution in the area of online and advanced e-learning and learning, using the most innovative information and communication technologies, and a prominent Virtual Pedagogical Model (Pereira et al.,
2008). This online model is based on four main pillars: student-centred learning, flexibility, interaction and digital inclusion. The UAb was, a few years ago, awarded internationally by Prize of European Foundation for Quality in E-learning and certification of The UNIQUE Quality Label for the use of Information and Communications Technology (ICT) in Higher Education, awarded with the 1st Level of Excellency of the European Foundation for Quality Management, and also awarded by the European Commission with the Diploma Supplement Label. UAb was also considered recently by a European Commission report as a key actor in the higher education system in Portugal and Europe (European Commission/EACEA/Eurydice,
2014; UAb,
2019a).
The formal educational offer of UAb is organised according to the European Credit Transfer and Accumulation System (ECTS).
The Master’s Degree in Food Science at Universidade Aberta is a unique programme that offers distance education and advanced training in e-learning in the area of food science (Moura et al.,
2010) and its main objectives are to enable participants to i) interact along the supply chain in areas such food processing, retailing and consumption activities; ii) play a role in activities that promotes attitudes and behaviours changes in order to gather healthy consumption patterns; and play a role in decision-making processes concerning food product development (UAb,
2019b).
The Master programme is characterized by: i) strong motivation of students seeking a professional or intellectual updating; ii) independent, collaborative student-centered learning; iii) students are mainly in the labor market; iv) Flexibility is provided by the asynchronous model, without temporal imperatives and physical displacements; (v) training and accompanying students to enable them to use new technologies and work in networks; and vi) curricular structure designed to meet the students’ updating (Moura & Aires,
2012; Moura et al.,
2014).
The curricular plan of the Master is divided in two semesters (in a total of 60 ECTS), defined as a period of twenty weeks each one, plus two more semesters for the preparation, orientation and presentation of an original dissertation which accounts for a further 60 ECTS Different learning strategies are developed from mainly individual work to more collaborative and cooperative learning where peer and teacher interaction becomes very important (Azeiteiro et al.,
2015). This is achieved through the inclusion of a number of activities supervised by the teacher such as: surveys, quizzes, assignments and compulsory discussion groups.
The open source Moodle (
http://elearning.uab.pt/) is the course management systems used. Each course from the MSc in Food Science and Consumption is organised in a set of topics and each topic is associated with one learning activity.
A 2 weeks online bootcamp module is available to students before the beginning of the 1st semester, which is intended to familiarise the students with the virtual environment and the e-learning tools, as well as promoting the acquisition of online communication and online social skills (Pereira et al.,
2008).
The Food Safety and Quality course tries to update the demands that the European and world market has for the actors in the food chain. This course is organised into a set of seven topics and developed into six learning activities (see Table
1).
Table 1
Topics, titles, contents of course and development of e-activitie. Topics 3 and 4 (natural food toxins and contaminants) were not considered on this research (see methods chapter). These topics only account for 17% of the course
1 | Food quality | i) The Impact of food processing on quality and safety (changes occurring during processing: fermentation, cooking); ii) Evaluation of the quality in the food: evaluation of the physical-chemical, microbiological, nutritional and sensorial characteristics. | It is very important that students understand the difference between Quality and Food Safety. Thus, with the available didactic material, students were asked to contribute individually, on the platform, with their opinions on each concept. |
2 | Microbiology and Microbial Contamination | i) General aspects of microbiology; ii) Factors that affect microbial growth; iii) Foodborne diseases (Food poisoning/infections caused by bacteria, viruses, parasitoses and mycotoxicoses). | A work team (3 or 4 elements) was proposed to answer a solution to a real problem. After the time established for the development of the different themes within each group, there was a debate with the whole class in which the solutions of each group were discussed. |
5 | Food Additives and Food Safety | i) Objectives for the use of additives; ii) Criteria for use of the additives; iii) Food safety assessment of an additive and, iv) Classification of additives (EU). | In this topic, it was decided to only provide individual study through the provision of teaching materials. In the topic 6, students would have the opportunity to choose any topic addressed. |
6 | Hazard Analysis and Critical Control Points | i) Concept and application of HACCP; ii) HACCP system, management systems and prerequisites; iii) The HACCP system in practice: system steps; iv) benefits and, v) Practical cases | In this topic it was developed a fifth activity of the course where students should choose a topic from the previous or the current one to be able to submit an abstract for a congress. Later on, students must submit a power-point to discuss with the whole class. The simulation of a call for papers for one congress was provided to students. This activity was a mixed of individual work with subsequent discussion in group. |
7 | Legislation | i) General principles of food law; ii) Official control; iii) General and specific hygiene and food safety requirements; iv) General labelling of foodstuffs, consumer information; v) Contaminants and additives; vi) Nutrition labelling and nutrition and health claims; vii) ISO 9001 and 22,000 series standards. | The sixth activity was the implementation of food law in a real context. The work was individual, but with future discussion of the subject in the general forum. |
In first place, it is promoted an ice breaker where students and lectures introduced themselves, then a dialogue is promoted about course objectives, structure and topics/activities to be developed, that are chronologically presented in a document (e-book) called “learning Contract” to all students.
In order to stimulate students to become involved with the course and with the e-activities, practical and real examples were given (as shown in Table
1). Compulsory individual and teamwork activities were included. Support materials available to the students in the virtual space include e-books, research papers, internet sites, slide presentations, videos, original teachers’ documents and regulations (including legislation) case studies, news from media and original research are used to bring the subject to life and to help students to link theory to their practice in a e-learning regime, as defended by Moura et al. (
2010,
2018).
Case study based on quantitative and qualitative approach according to a mixed method choice was used in this study (Saunders et al.,
2007). Data collection was conducted through a student’s questionnaire survey, one focus group and learning analytics, during the school years of 2016/2017 and 2017/2018. Topics 3 and 4 (natural food toxins and contaminants) were not considered on this research, since were taught by a different teacher and data was not available on these contents.
Online survey
All seventeen students who attended the course of Food Safety and Quality of the Master of Sciences in Food Consumption in the school year of 2016/2017 and 2017/2018, and who are still enrolled, developing the master thesis, were invited to answer an online questionnaire survey in order to evaluate the perceptions about the performance of the course. At the time of online survey, one student was not contactable by the University, therefore, he was not contacted to answer to the questionnaire. This survey was inspired on other research where e-learning courses were evaluated (e.g. Bacelar-Nicolau et al.,
2009,
2012,
2015, Oliveira et al.,
2016). The questionnaire built on Google Forms was divided in three groups of questions: the first concerns to the students course satisfaction itself and is constituted by four sections: i) organization of the course; ii) resources and activities of the course; iii) program contents of course; and iv) acquired competences (see in Additional file
1 the questionnaire). The second group consisted of questions related to the teachers, and the third group consisted of issues relating the course with the professional activity of students. In total, there were 42 questions using a Likert scale of 1 to 5, where 1 corresponds to a total disagreement and 5 corresponds to a total agreement. Descriptive statistics of the Likert based questions were conducted. Frequency distributions were converted to percentages to provide a standardised way of comparing the categories. For the open-ended question a transcription and translation to English of the content were made. This question consisted in a space to comments and suggestions (appendix 1).
Also, there was sociodemographic questions: age, sex and professional activity and an open space to comments and suggestions (appendix 1). A questionnaire pre-test was conducted and, after making the necessary adjustments, a final total of 46 items was obtained. All the questionnaire was translate from Portuguese to English (see appendix 1).
Focus group discussion (FGD)
All the students’ population invited to answer the questionnaire were after invited to attend a videoconference meeting for a focus group interview to explore the perceptions towards weaknesses identified in the previously applied questionnaire (see in appendix 1 the focus group guide). The Zoom-Colibri videoconference software was used (
https://videoconf-colibri.zoom.us). Virtual focus group reduces the burden on participants by eliminating travel and minimizing preparation time (Rupert, et al.,
2017). Focus group methodology employs an interviewing technique; is not a discussion, a problem solving session nor a decision making group (Paton,
1990; Krueger & Casey,
2015). The prime objective is to obtain accurate data on a limited range of specific issues and within a social context where people consider their own views in relation to others (Wilkinson,
1998; Robinson,
1999).
The meeting was scheduled through Doodle. A focus group discussion was conducted with three participants (17.6% of total students and 37.5% of the online survey respondents). The interview lasted 32 min and all participants provided informed consent for their interviews to be recorded (see guide in Appendix 2).
Responses from Food Group Discussion were transcribed and translate from Portuguese to English. Participants were codified as FG#1 (male), FG#2 (female), and FG#3 (female). Data were then coded sentence by sentence. Common themes, patterns and clusters were identified and organized systematically (Braun & Clarke,
2006; Huberman & Miles,
1994). Data were then grouped together into themes and sub-themes.
The limitations associated with questionnaires and group interviews, e.g. validity, reliability and generalizability, such as those associated with participant and observer error and bias (Saunders et al.,
2007) were taken into account in the discussion of results, and when drawing conclusions.
Learning analytics (LA)
In order to evaluate the students’ interactions and engagement in the course and its link with the topics activities, all “posted messages” in the Moodle platform were collected and recorded by student code. The number of messages posted in the course of Quality and Food Safety were identified with day and year from academic year of 2016/2017 until 2017/2018. This posted messages are public messages and is an indicator of participant’s involvement, as active users (Coelho et al.,
2015), so an important indicator of students learning process.
Discussion
Because of people’s busy lifestyles, online education is both an appealing and effective mean of educating the food service workers. Online education allows these workers to be able to proceed at their own pace and identify their own personal course timeline (Shanley et al.,
2004).
This study focused on students’ perception of the course organization and contents, acquired competences and student’s engagement after enrolling a Food Safety and Quality course of the master’s degree in Food Science that is taught in e-learning at a distance learning Portuguese public university (Universidade Aberta).
Results from the students surveyed shown in general a high level of satisfaction with organization of the course, acquired competences, pedagogical resources, activities for assessment, pedagogical model, learning platform and teachers. Students also made positive evaluations regarding interactivity in forum (with colleagues and with teachers). These results are aligned with earlier research conducted in other formal programs at Universidade Aberta related with science education (Azeiteiro et al.,
2015; Bacelar-Nicolau et al.,
2009,
2012,
2015). In particular Azeiteiro et al. (
2015), showed that students have a very high level of motivation and satisfaction with the programmes, and having reasons to return again for new training at Universidade Aberta. Also in this research, most students had the perception of having reached an effective learning outcome of knowledge, competences, values, attitudes and behaviour and an improvement on their professional skills related with food safety and quality.
Nevertheless, some weak points were highlighted and some improvements were suggested. These are discussed below.
In the focus group, there was an opportunity to scalp the students’ concerns a bit more, and it was found that they would like that the teachers did more timely feedback because they are looking for a guide to their study. Timely and supportive feedback on submitted coursework can let students know about their progress in learning when peer-induced participation is lacking (Law et al.,
2019). Furthermore, a quality teaching presence offering clear directions can enhance the learning efficacy of students (Law et al.,
2010), and this directly affects both the social and cognitive presences. Nevertheless, Palmer and Holt (
2009), obtained lower satisfaction rates for the items that evaluated the feedback given to the activities developed, but this fact can be related with the quality and content and way feedback is given. During the study analysis (2016/17 and 2017/18) the teachers of the course were overloaded with other courses and one of the teachers had a personal reason issue during the 2016/17 that affected the learning process, what had as consequence a delay in a timely feedback to the students. Usual feedbacks given by the curse teachers are very personalized and detailed (to each student and an overall to the all class) what usually support students learning performance. Besides their periodicity and contents, they can also be given through the use of videos or audios what enhance and develop continual learning (Phungsuk et al.,
2017).
Regarding the e-activities of the course (see Table
1), issues related to teamwork compared with individual work were addressed. It was found that the students enjoyed both teamwork and individual activities, but students sometimes prefer individual assignment since it only depend on their time availability. This issue is relevant for students with full time jobs and families to take care. Likewise, the student-student and student-teacher interaction forums were well classified. Learning analytics showed the greatest turnout of students in a teamwork activity (Topic 2) and when there was class debate. Students with stronger learning motivation also tend to engage in course tasks and group activities more actively (Lee et al.,
2019). From this perspective, learning motivation improves learning effectiveness through its positive and direct effect on social presence and reflects on enrolment. Interaction between students and teacher is vital in any learning experience (Joo et al.,
2011; Eyal,
2012). The effort engaged by learners in finding information is a crucial component of learning performance, which implies that learners who do not actively engage in information processing actively are liable to engage only in surface learning and achieving modest learning performance (Law et al.,
2019). So, although teamwork is more time demanding from student’s point of view it should be encourage to improve the e-learning process. Indeed, one of the week points found by the students were the high workload of the course, what is in accordance with earlier students perceptions about e-learning courses (Azeiteiro et al.,
2015; Bacelar-Nicolau et al.,
2015; Martinho et al.,
2016).
It is interesting to note that the module of Legislation (topic 7), which was one of the themes most frequently mentioned in the focus group interview (in terms of complexity, requirement and constant updating obligation), obtained a very high degree of content satisfaction. Likewise, the issue of food security policies (one of the most applicable European regulations in force) has also been of student’s satisfaction. The activity related to this topic, although it was not a group activity (which usually leads to greater interactivity in forum), got the 3rd highest frequency of posted messages in forum (54 public messages). This turnout corroborates the students’ satisfaction in the questionnaire survey and the general satisfaction with the course.
Beyond the electronic resources available to students: scientific papers, eBooks, real cases and personal presentations, students suggested that there should be commented power points to improve their study orientation as well as videos. The increasing availability of mobile devices, as well as the fact that videos and computer simulations have become available for a wide range of science subjects, have led to these tools becoming an integral part of many science curricula (Rutten et al.,
2011). Also other improvement can be implemented to enhance the learning process in this course, for example, the implementation of game-based e-learning activity about food additives or other contents within the course. Gaming have been shown a significantly increased college students’ knowledge, for example about Good Manufacturing Practices (Stevenson et al.,
2018). Eventually, stories may also be part of games, and, in the field of education, the application of games supporting learning processes has been developed into an increasing body of research (Bidarra et al.,
2013). A common implementation is called ‘gamification’; it identifies the notion of using elements of video games, such as points, levels, badges and achievements, and their application in professional or educational contexts (Bidarra & Rusman,
2017). Yu et al. (
2018), involved unmotivated students to the issues of food safety, by examining the effects of a tablet PC simulation game as a class activity on students’ motivation to learn food safety. This experience showed that there was a significant improvement for students who participated in the simulation game activity regarding learning motivation. Badges are also integrated in the Moodle platform and can be easily added in the course each time a student accomplished a certain task or assignment. Complemented or integrated with gaming, problem based learning and the use of social networking sites (like Facebook or Linkedin) can be implemented in the e-activities also contributing for student’s stimulation (Phungsuk et al.,
2017).
Another stimulating system to improve a collaborative activity is using Wikispaces. Aguilar et al. (
2013) found that most of the participants that had assessed the Wiki experience agreed that it was a very interesting system, not only for interaction between students on different programmes, but also for the dissemination of the work that had been done. It also fostered interaction between students who would not otherwise have mixed with each other, or would have done so in a relatively tenuous manner in the context of the virtual classrooms.
Besides at UAb the pedagogical strategies have been developed to engage students as active participants (Pereira et al.,
2008), and this more up to date, interactive, rewarded and motivational strategies (Nah et al.,
2014) should be put in place. Knowing that the characteristics of an online learning environment have a great impact on student satisfaction (Thurmond & Wambach,
2004), it is imperative that the resource used is “skilful”, otherwise no one will be interested in the e- learning application (Violante & Vezzetti,
2013).
Conclusions
In this research the overall course organization competences, attitudes and behaviours were reported by students enrolled in a Food Safety and Quality course offered by the Portuguese Distance Learning University (Universidade Aberta). Three types of approaches to data collection were considered. An online questionnaire survey, a focus group interview and a temporal distributions of messages published on the Moodle platform (learning analytics).
The surveyed students showed a very high level of motivation and satisfaction with the course and had the perception of having reached an effective learning outcome in knowledge, competences, attitudes and behaviours. Nevertheless, there are pedagogical and learning issues that should be improved on the Food and Safety Quality course, most related with type of assignments, management of workload, use of more interactive educative tools, and importance of timely and effective feedback to students.
The results showed that some students prefer individual activities rather than group activities because those activities only depend on their time and availability. In fact, this feature of individual activities is very relevant for students who work full time and who have their families to care for. However, that the results also showed that the greatest turnout of students on the platform was detected in the teamwork and, essentially, when there was a class debate. The fact that students indorsed high degree of satisfaction to teamwork activities (although they initially revealed that individual assignments were most desirable) leads to think that the more appealing the tools are for students, the better their performance are in the course. Some of the answers to success, motivation and students’ satisfaction are found in the use of tools and activities easy to use and edit.
Students suggested that there should be commented power points to improve their study orientation as well as videos. Other improvements can be implemented to enhance the learning process in this course, for example, the implementation of game-based e-learning activity (gamification) and the use of Wikispace.
The results of this study helped to realize that students need activities that give them satisfaction in the learning process but also that the role of the teacher is very important. For example, feedback to activities is a point that has to be improved in future editions of this course.
This research aimed to contribute to new knowledge related with the effectiveness of post-graduates courses taught in e-learning about food safety, through a case study and where good practices were highlighted. Education in this field is very relevant worldwide considering the United Nation Sustainable Development Goals related with healthy life’s and the need of update lifelong training of working professionals in the field. In addition, this study aimed to contribute to the lack of clear direction as to how the higher education system would need to change in order to accommodate students’ needs.
This study has limitations most related with the size of the sample of the survey and focus groups and existing bias by the fact that the teacher conducted the survey. Future developments should include other scholar years and other research tools, other than questionnaire surveys for the assessment of competences development and behavior changes. More complete learning analytics can also be conducted namely, using different data mining techniques, statistics and visual analytics techniques (Adejo & Connolly,
2017).
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.