Introduction
Technology enhanced learning (TEL) has the potential to enhance the student experience by facilitating self-paced learning, lowering inhibition thresholds for asking questions, and allowing access to learning on an as-and-when basis (Kamath,
2015), all of which are factors that may contribute to informal and incidental learning outside of the formal learning space (Peart et al.,
2014). There is a body of research examining the role of the teacher in facilitating TEL, and a reservation or anxiety from staff has been described with respect to the technology acceptance model (Blackwell et al.,
2014; Gong et al.,
2004; Louw,
2015; Teo et al.,
2008). Such problems may present a barrier to the promotion of TEL to support student learning. However, an aspect that has been less researched is the contribution of students to the impact of TEL, and in particular their perspectives on TEL tools (TELT). There is a wealth of information on student perceptions of a selection of ‘learning objects’ (LO) and ‘web based learning tools’ (WBLT) (Cochrane,
2005; R. Kay,
2011; R. H. Kay & Knaack,
2009; Nurmi & Jaakkola,
2006; Vargo et al.,
2003). Such studies can provide a useful insight for LO and WBLT developers, but the implication from a teaching perspective is somewhat limited unless the teacher is likely to use that very specific tool in their teaching. For example Cochrane (
2005) evaluated two audio engineering LOs (interactive mixing desk and microphone chooser) and Nurmi and Jaakkola (
2006) evaluated three LOs to teach fractions, the Finnish language and electrical DC circuits. Such tools are typically designed to be used in the classroom, and as a result do not promote extra-curricular and informal/incidental learning.
It may be more beneficial from a teaching perspective to understand the benefits of more generic TELTs, which staff can have more control over, implemented over a longer period of time. However current examples are limited, and are focused primarily upon an institution virtual learning environment (VLE) or social networking. Šumak et al. (
2011) collated Electrical Engineering and Computer Science students’ perceptions of using a general virtual VLE (Moodle) and reported that perceived usefulness was a strong predictor of intention to use the VLE. This again has limited scope today as the use of a VLE is now commonplace within Higher Education. However, the identification of perceived usefulness as a predictor of acceptance is important as it can direct research to now determine what characteristics students consider useful, or indeed how students define ‘useful’. Junco et al. (
2011) incorporated Twitter into a semester long module for pre-health professional majors, where students were encouraged to continue class discussions, organise study groups, and connect with each other and with staff. They concluded that the use of Twitter successfully increased student engagement, which may present a promising development for a wide range of teachers as the uses could be incorporated into any subject of study. However, the authors did not provide any data on the student perception of the use of Twitter, therefore it is unclear
why the students engaged with Twitter, and without knowing this it is difficult to predict what other TELTs may be well accepted.
Lecture capture is another example of a generic TELT available to teaching staff. A narrative review identified that students use lecture capture to review content, but there is mixed evidence as to its effect on student grades and attendance (Karnad,
2013). This practice has been examined specifically in higher education science students, namely in the areas of veterinary medicine (Danielson et al.,
2014) and pharmacy (Marchand et al.,
2014). Danielson et al. (
2014) reported that students perceived lecture capture to be most useful for learning in content driven lecture sessions compared to group work sessions, particularly for reviewing segments flagged in their notes, recapping a fast lecture, studying for examinations, and reviewing content missed due to absence. Staff agreed lecture capture to be beneficial for students to review lecture content, but identified reduced attendance as a risk. Marchand et al. (
2014) also identified reduced attendance as a concern for staff, however neither study reported actual attendance data so it is unknown if the staff concerns were realised. In a letter to the editor Lach and McCarthy (
2015) challenged the findings of Marchand et al. (
2014) stating that attendance should not be a concern, as attendance is not a learning outcome and does not guarantee that learning will occur. They argue that staff focusing on the possible negative effect upon attendance may shadow the opportunities afforded by technology.
A form of TELT currently more researched in younger ages is the use of electronic whiteboards to simplify and share information (Castek & Beach,
2013; Maher,
2013). The potential for these to support learning in higher education has received little attention in the literature, other than being described as a useful tool for in the moment teaching (Archibald et al.,
2014). Using such a tool to deliver a short summary video of the lecture may act to reinforce learning from the lecture, rather than replace it. Simplifying the lecture content in such a way may also help students direct their learning, and has been proposed as a way to help students overcome troublesome knowledge, as they present scientific mechanisms in the absence of other barriers such new terminology (Peart et al.,
2014).
An understanding of student perceptions of different TELTs could be of benefit for a number of reasons; (i) identification of shared characteristics between well perceived TELTs may help predict what tools are likely to work in future, (ii) targeting particular types of TELTs may act to reduce staff anxiety by reducing choice and preventing over saturation with TELTs, (iii) contribute to the planning of departmental and institutional TEL strategies. The objective of this study was to integrate four different TELTs that the teaching staff could control into a semester long undergraduate sport and exercise science module, with the aim of examining student use and perceptions of the TELTs. Of particular interest was their views on accessibility, use and value for learning.
Results
Data describing the use of each TELT is displayed in Table
2. Significant cells in the contingency table were ‘Twitter – did not use’ (
p < 0.001), ‘Twitter – agree’ (p < 0.001), ‘ShowMe – agree’ (
p = 0.002) and ‘MCQ – agree’ (p < 0.001) (Table
2). These results suggest that Twitter was used significantly less than the other three TELTs with less people agreeing that it helped, whilst ShowMe and MCQ had a greater occurrence of an ‘agree’ rating compared to Twitter and Panopto.
Table 2
Frequency of student responses on whether each TELT was useful to support their learning. Agree = median score 6–7; unsure = median score 3–5; Disagree = median score 1–2
Panopto | 21 | 2 | 27 | 45 |
Adj. residual
|
−2.1
|
−0.2
|
1.0
|
1.1
|
Show Me | 21 | 1 | 20 | 53 |
Adj. residual
|
−2.1
|
−1.0
|
−1.0
|
3.1*
|
MCQ | 19 | 1 | 16 | 59 |
Adj. residual
|
−2.6
|
−1.0
|
−2.1
|
4.5*
|
Twitter | 55 | 5 | 31 | 4 |
Adj. residual
|
6.7*
|
2.1
|
2.1
|
−8.7*
|
Χ
2 (9, N = 380) = 87.76, p < 0.001 * p ≤ 0.002 | | | | |
A thematic analysis has been presented in Table
4. One main finding was that a first order theme shared across all TELTs was that of assessment preparation. This theme was identified as a positive for Panopto (
‘helped prepare for the exam’), ShowMe (‘
can pick out main points for exam revision’) and MCQ
(‘helped to know what to expect on the exam’). Specific reasons for these TELTs being perceived as useful for assessment could have been to help check understanding (MCQ;
‘helps you find out what you actually know’), tailor and personalise the delivery (Panopto;
‘can jump to specific points’) and provide information in a different format (ShowMe;
‘easier to understand than the lectures’). Conversely the theme of assessment was identified as an area for improvement with Twitter (‘n
ot clearly linked to the exams’). In fact, the only positive theme for Twitter was convenience
(‘easy to access links’).
Discussion
The purpose of this study was to implement different TELTs into the delivery of a first year undergraduate science module, and collect student perceptions of their use and perceived value for learning. It was found that approximately 80% of the students surveyed accessed Panopto, ShowMe and MCQ to support their learning. However less than half of the cohort accessed Twitter, significantly less than the other three methods. Furthermore, only 4% of students agreed that it helped them with their studies, which is again in stark contrast to the other three methods (Table
2). This is despite students identifying it as a convenient way to get information (Table
4). Previous authors have advocated the use of Twitter to support Higher Education students, including Junco et al. (
2011) who observed greater levels of engagement in students assigned to a Twitter group as opposed to a control. Gikas and Grant (
2013) also reported generally positive student perceptions of using Twitter, including being able to embed learning within their normal lives and the ability to have discussions with classmates. Interestingly interaction was a theme under suggested improvements in the current study, with students commenting that
‘everyone should follow each other’ and that they should
‘share content’. A possible reason for the lack of interaction was a lack of student awareness, with one student commenting an improvement would be to
‘make students more aware’. However, the way in which staff made students aware of Twitter was no different to the other TELTs. Furthermore staff regularly updated the Twitter feed with both course specific information and relevant sources for further learning e.g. recent articles linked to that week’s course content, but no students posted their own tweets. The fact that Twitter was accessed more on mobile devices may suggest that it was used more for keeping up to date rather than active engagement. Of note is that the intervention implemented by Junco and colleagues used Twitter as a sole source of information (e.g. discussion board, announcements page, reading lists etc.), with no competing TELTs being used simultaneously. It may be that the use of Twitter in the current study was influenced by the fact that the traditional VLE was also being used for the roles described by Junco et al. (
2011), or that three other TELTs were available at the same time so students directed their attention elsewhere. These factors may have had more of an influence if students were unfamiliar with the workings of Twitter.
A possible reason for the other three TELTs being used by a greater proportion of students is the perceived link to assessment, with the thematic analysis identifying this as a positive theme for ShowMe, MCQ and Panopto, but an area for improvement for Twitter (Table
4). Furthermore, ShowMe and MCQ had a greater proportion of students ‘agree’ compared to Panopto (Table
2), which may again be linked to assessment as these were the two TELTs used predominantly to help prepare for the examination (Table
3). A reason for ShowMe being rated higher than Panopto may be due to the delivery of information. Whilst students liked being able to alter the delivery and pace of the lecture using Panopto, the ShowMe videos offered an alternative delivery that helped to simplify content (Table
4). Moreover, the delivery on ShowMe was suggested to be convenient and time efficient for the student. The use of the ShowMe App has been described in past work as a way for students to create notes and share ideas at primary and secondary level (Castek & Beach,
2013; Maher,
2013). It has also been suggested to be popular for clinical teaching within medical residences, specifically for annotating notes and producing quick diagrams for ‘in the moment’ teaching (Archibald et al.,
2014). This latter point is the most related to the use of the App in this study i.e. to simplify information. Research has highlighted the use of animations in other formats as a positive way to support science teaching, with authors reporting enhanced self-efficacy and enjoyment in elementary schools (Barak et al.,
2011), and improved retention of information in university students (Lin & Atkinson,
2011). Of note is that the animations used by Barak et al. (
2011) and Lin and Atkinson (
2011) were specific LOs used in a formal learning environment, whereas the current study is novel in that the animations were produced by the teaching staff and could be accessed outside of the formal learning environment. It is advised that those looking to implement a similar strategy to the current study consider their clarity of speech when producing the videos, as this was commented on by some students (Table
4).
Table 3
A summary of student access to the TELTs
Why did you access X? |
To recap weekly content | 7 (7%) | 44 (46%) | 37 (39%) | 7 (7%) |
To prepare for the examination | 7 (7%) | 63 (66%) | 74 (78%) | 7 (7%) |
For general interest | 10 (11%) | 5 (5%) | 11 (12%) | 10 (11%) |
How did you access X? |
Phone/tablet | 16 (17%) | 26 (27%) | 27 (28%) | 16 (17%) |
PC/laptop | 10 (11%) | 64 (67%) | 72 (76%) | 10 (11%) |
Where did you access X? |
At University | 8 (8%) | 40 (42%) | 39 (41%) | 8 (8%) |
At home | 21 (22%) | 64 (67%) | 72 (76%) | 21 (22%) |
While travelling | 2 (2%) | 3 (3%) | 5 (5%) | 2 (2%) |
Table 4
Thematic analysis of qualitative responses for each TELT
Able to pause at any point to make notes/Can jump to specific points | Tailor lecture delivery and pacing | Positive | Panopto |
Good for exam revision/Helped prepare for the exam | Assessment |
Microphone poor/Missing video/Logging in was difficult | Technology limitations | Improvements |
A good quick recap/It condenses all of the information/Short and concise/Straight to the point/Short, sharp and accurate summary | Time efficient | Positive | ShowMe |
Gives step by step views/Makes complicated information compact and easy to understand/The verbal and visual information at the same time is useful/Simplifies lectures/Easier to understand than the lectures | Delivery of information |
Easy to use/Easy to find the information | Convenient |
Can pick out main points for exam revision | Assessment |
Some videos too short/Lecturer sometimes quiet/Sometime talk too fast | Lecturer delivery | Improvements |
Useful to see the types of questions/Good tool for revision/You can practice for the exam/Prepared you for the exam/Helped to know what to expect on the exam | Assessment | Positive | MCQ |
Helps recap/Helps you find out what you actually know/Helped check where I may have been wrong with my notes/Shows what you know and what you don’t/Can track my learning | Confirming understanding |
More questions/Links to webpages relating to the subject area/Not just multiple choice questions/A variety of questions | Content | Improvements |
Easy to use/Easy to access links | Convenience | Positive | Twitter |
Everyone should follow each other/Should share content/Make students more aware | Interaction | Improvements |
Give more examples/Have a specific page/Make more links available / | Content |
Not clearly linked to the exams | Assessment |
It is perhaps clear why the MCQ was rated highly by the students, as it mimicked the summative assessment of the module. Some of the comments in the ‘confirming understanding’ theme suggest it may have also been of benefit for formative feedback (
‘can track my learning’) (Table
4), however what is unclear is whether this TELT would have been perceived as useful if the mode of summative assessment had been different i.e. an essay or report. Another factor that may explain the positive perception of the MCQs is that this was the only TELT that required the student to take an active part. However no students alluded to this in the questionnaires.
As students appeared to be extrinsically motivated by assessment, TELTs were not used a lot for general interest (Table
3). All of the TELTs had the capacity to be used on mobile devices, however they were used primarily on PCs/laptops (Table
3). This may suggest that the potential for incidental or informal learning was not enhanced by using the TELTs. Each TELT was accessed mostly at home, therefore perhaps promoting extra-curricular study as it was hoped that the ShowMe videos would, but still in a formal and structured fashion. However, these points are speculative as we have no comparison to their learning habits prior to the study. Furthermore ‘general interest’ is quite vague and open to individual interpretation. Perhaps this would have been better termed ‘further study’ or ‘further understanding’.
In summary the current study has identified shared characteristics between the TELTs that students engage with and perceive to be useful. Such characteristics include links to the summative assessment and offering an alternative method of content delivery to the traditional lecture. Previous research has shown that time is a barrier for staff to incorporate TELTs into their teaching (Reed,
2014), so an appropriate practical message may be to start with one type of TELT. Based on this study TELTs similar to the ShowMe App are most recommended as this was one of the two highly rated TELTs (alongside MCQ), but has more scope for crossover with other subjects as the students found it useful for more than just assessment. Moreover the lecturer has full control over the content, so can make each animation specific to the current topic of study. Further work should look at the potential transfer of animations for learning in other subject disciplines, and investigate if there are any alternative TELTs for meeting the same purpose of simplifying information. It should be considered that this paper describes only those students that completed the survey (45% response rate), and the perceptions of the other students enrolled on the module are unknown. Furthermore, we cannot discount that using the TELTs in combination may have influenced the perception of each TELT, and we relied upon student self-reported usage for each TELT. Future work should monitor the actual use of the TELTs using tracking statistics, and look to examine predictive validity of student perceptions of TELTs to gain more insight into what student perception means for learning and academic performance, and what the implications are for teaching staff.