Virtual reality as a new trend in mechanical and electrical engineering education

2.1 Motivation

Virtual Reality (VR) is a technology that provides an interactive computer-generated environment, usually with a dynamically changing scenario in which one can see and move. VR simulates a user’s physical presence in an artificially created world and allows them to interact with that virtual environment [4]. Most VR applications and solutions focus on gaming and commercial industries, due to these areas providing the largest groups of VR headsets recipients. However, the possibilities of virtual reality do not end with gaming. Dynamic growth and interest in the subject of virtual reality have rendered it applicable in many other areas, such as the military, psychology, medicine and teaching applications. Use of information and communication technologies has been found to improve student attitudes towards learning. Moreover, virtual reality plays an important role in the teaching process, providing interesting and engaging ways of acquiring information. It can help teachers to explain complex issues due to its graphical nature combined with an explorative approach, physical interactions and intuitive interfaces.

The case study by Beijing Bluefocus E-Commerce Co. Ltd. and Beijing iBokan Wisdom Mobile Internet Technology Training Institutions, presents the difference between VR-based teaching and traditional teaching in learning astrophysics. The team conducted two tests: immediate and retention on groups of students with VR-based teaching and traditional teaching. The immediate test was completed to show the differences in learning efficiency and the academic performance of the groups, the retention test was conducted to compare how long the students could retain knowledge. According to the conclusion of the case study VR-based teaching improves students test scores. The score of the VR group on the immediate test was 93 right answers, and the traditional teaching group 73. What is more in the retention test, the average score of the VR group was 90, which was 32.4% more than that of the traditional teaching group which had an average score of 68. The results show that VR-based teaching can not only improve the knowledge gained by students after classes, but can also help them to retain this knowledge [5].

Virtual reality can be a powerful tool in supporting and facilitating learning and teaching processes. A lot of surveys and reports show that most students remembered what they saw in VR and concluded that VR is a more memorable environment than laboratory-based demonstrations [8]. Ultimately, the laboratory-based method (a less efficient form of learning) results in deficiencies in fundamental knowledge and practice of graduates, which may lead to inability to properly react to challenges that arise in future workplaces. To work around the problems, an innovative method for teaching and learning based on virtual reality (VR) shall be proposed. VR environments allow educators to conduct learning activities, which are difficult to implement during regular laboratory lessons (such as states of emergency). By including VR laboratories as a part of the existing curriculum, it is believed that it will be possible to improve the quality and efficiency of higher education, qualifications, the competences and skills of graduates, as well as increase their competitiveness in the labor market.

2.2 Methodology

The project was conducted according to design thinking (DT) methodology, which is an innovative approach to generate and develop ideas that match the end user’s needs. The iterative cyclic process identifies the desires of the target group, which they may not even be aware of. It is based on intuition, creativity, logic and having an optimistic way to cope with the challenges. It has been used as a method of inventing products, services and experiences with a focus on the people who will use them, derived from five structured phases (see Figure 1): empathize (or discover), define, ideate, prototype and test [6].

Figure 1

Design Thinking process

Discover is the first phase of the DT process: this step is about immersion, doing research and interviews with the target group. The main aim of this phase is to gather rich background knowledge and to try to find inspiration for further challenges. The next part of this phase is empathize; it includes observation of people, visiting work spaces, asking questions and trying to understand the perspective of the potential user. After the first survey with students and academics we defined the real problem to solve - lack of an environment in which students would be able to learn about, work and experiment with latest machinery. Subsequent interviews were conducted during the second empathy session. An online survey among 15 academics and 60 students (age 20-22 years) was conducted. Interviewees reacted enthusiastically to the idea of creating a VR based learning tool. 73% of academic respondents would invest in VR equipment to enhance the level of learning in their unit. What is more, 93% of them would use VR as a part of their training program for students. All students agreed that VR has a huge potential as a mechanical and electrical learning environment. Promising feedback from the target group led to the next step: prototyping.

2.3 Technology

The device provided for the project was the HTC VIVE. HTC and Valve Corporation developed this virtual reality equipment, with the first launch of the product being on 5th April 2016. This device (see Figure 2) is composed of:

Figure 2

HTC Vive - a virtual reality headset developed by HTC and Valve Corporation, source: ww.microsoft.com/

1. Wire-connected Headset - comprising a screen, two lenses and a set of detectors: gyroscope, accelerometer and laser position detectors. On this headset, the distance between both eye lenses can be adjusted, allowing adaptation for various face types and shapes. There is a headphone jack, a front camera to see the external environment without removing the headset, and a microphone that can be used during multiplayer games or phone calls via a Bluetooth connection to a mobile phone.

2. Wireless Controllers - with a number of programmable buttons, a touchpad and sensors such as a gyroscope, accelerometer and laser position detectors.

3. Lighthouses - emitting pulsed infrared (IR) lasers to detect the position of the headset and the controllers. These devices can be placed in the corner of the area used for simulation and can cover an area of 12.25 m².

4. Connector Box - to connect the headset to the computer or TV [7]. For further information, please see the HTC Vive website: https://www.htcvive.com.

To develop the virtual environment of the prototype Unity 3D - Game Engine was used. This was considered the most appropriate software to create VR applications [2]. The programming languages used for development were JavaScript and C#. To design and develop all necessary virtual objects in the virtual scenes 3ds Max software was used.

2.4 Application scenario

The scenario for the tool included five stages:

1. Controls Tutorial - The idea of this stage was to provide the user with a tutorial, which illustrated how to use the HTC VIVE controls while in virtual reality. This includes showing what each button on the remote is used for and how to navigate through the selection menus.

2. First menu - The menu has a visual of a laboratory, where the user could select the appliance of their choice. For the purpose of this project, a washing machine and its components were the focus (see Figure 3). For selection, the device was highlighted and selectable.

Figure 3

3D model of washing machine in 3ds Max

Figure 4

A screenshot of sample menu

Figure 5

VR learning and teaching environment on an example of a washing machine and its components

1. Select Activity Type - In this stage, the user could select an activity, component or phenomenon to learn about.

2. The core of the application - An interactive VR simulation (Figure 1) for learning and teaching mechanical and electrical concepts, such as: the construction of a device and its individual components, defining principle operations, all necessary mathematical and physical descriptions, all mathematical models and physical phenomena essential to simulate and visualize devices in action.

2.5 Testing

The application was tested by a group of 60 students (20 male and 40 female) of different ages ranging from 20 to 24 years. The students who did not have any previous experience with VR were presented with a introductory VR simulation prior to the test. Each test was performed individually, during a single session in a separate room. The student was positioned at the center of the room and asked to put on the VR headset. When the student was comfortable with the environment, the session was started. During one session the student was supposed to use all available functions and go through each of the available exercises (see Figure 6). Then, the student was directed to another room for an interview.

Figure 6

A student in the process of testing the prototype

the interview, students were asked to rate on a scale from 1 to 5 (1 meaning the lowest score, 5 highest):

1. How was the experience?

2. Is this kind of presentation useful for memorization?

3. Is this kind of presentation useful for understanding?

4. Did the presented device seem real?

5. Would you like to use the system as a part of classes?

In addition, a similar test was conducted among 15 academics. Similarly to the students group, all academics without any previous experience with VR were presented with a introductory VR simulation prior to the test. Each question for the academics survey had a 1 to 5 rating. The questions were as follows:

1. How do you rate the experience?

2. Do you find this tool useful for presenting the exercises?

3. Do you find this tool useful in passing down knowledge?

4. Did the presented device seem real?

5. Would you like to use the system as a part of your classes?

The results of the interview are presented in Figure 7.

Figure 7

The results of the interview among students (upper) and academics (bottom)

Almost every student gave the best rating for the experience in the VR environment. All agreed that this kind of presentation has positive effects on understanding and memorization. Almost all would like to use this system as a part of their classes.

In the case of the academics, the most important feedback is that a VR educational tool was perceived as useful in both enhancing the presentation and passing down of knowledge. Additionally, most of the respondents indicated that they would like to incorporate such a tool into their classes.

Neither group found the presentation to be realistic enough. However, taking into consideration that the presented simulation was in its prototype phase there is still room for improvement in that area. What is also worth noticing is that even though the presentation might not have seemed realistic to all respondents, they still found the tool to be useful and the overall experience got high scores.