Top

The Journal of Supercomputing

Published in:

22-09-2022

Evaluation of e-learners’ concentration using recurrent neural networks

Authors: Young-Sang Jeong, Nam-Wook Cho

Published in: The Journal of Supercomputing | Issue 4/2023

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Recently, interest in e-learning has increased rapidly owing to the lockdowns imposed by COVID-19. A major disadvantage of e-learning is the difficulty in maintaining concentration because of the limited interaction between teachers and students. The objective of this paper is to develop a methodology to predict e-learners’ concentration by applying recurrent neural network models to eye gaze and facial landmark data extracted from e-learners’ video data. One hundred eighty-four video data of ninety-two e-learners were obtained, and their frame data were extracted using the OpenFace 2.0 toolkit. Recurrent neural networks, long short-term memory, and gated recurrent units were utilized to predict the concentration of e-learners. A set of comparative experiments was conducted. As a result, gated recurrent units exhibited the best performance. The main contribution of this paper is to present a methodology to predict e-learners’ concentration in a natural e-learning environment.

previous article Three edge-disjoint Hamiltonian cycles in crossed cubes with applications to fault-tolerant data broadcasting

next article Dimension-aware under spatiotemporal constraints: an efficient privacy-preserving framework with peak density clustering

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Arkorful V, Abaidoo N (2015) The role of e-learning, advantages and disadvantages of its adoption in higher education. Int J Instr Technol Distance Learn 12:29–42

Asteriadis S, Tzouveli P, Karpouzis K, Kollias S (2009) Estimation of behavioral user state based on eye gaze and head pose — application in an e-learning environment. Multim Tools Appls 41:469–493. https://doi.org/10.1007/s11042-008-0240-1CrossRef

Baltrusaitis T, Zadeh A, Lim YC, Morency LP (2018) Openface 2.0: Facial behavior analysis toolkit. In: 2018 13th IEEE International Conference on Automatic Face and Gesture Recognition, pp 59–66

Bengio, Y (2012) Practical recommendations for gradient-based training of deep architectures. In: Neural networks: Tricks of the trade, pp. 437–478

Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078

Choi D, Shallue CJ, Nado Z, Lee J, Maddison CJ, Dahl GE (2019) On empirical comparisons of optimizers for deep learning. arXiv preprint arXiv:1910.05446

Chung J, Gulcehre C, Cho K, Bengio Y (2014) Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555

De Carolis B, Errico FD, Macchiarulo N, Palestra G (2019) Engaged Faces: Measuring and Monitoring Student Engagement from Face and Gaze Behavior. In: IEEE/WIC/ACM International Conference on Web Intelligence-Companion, pp 80–85

Graves A, Mohamed AR, Hinton G (2013) Speech recognition with deep recurrent neural networks. In: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing pp. 6645–6649

10.

Hasnine MN, Bui HT, Tran TTT, Nguyen HT, Akçapınar G, Ueda H (2021) Students’ emotion extraction and visualization for engagement detection in online learning. Procedia Comput Sci 192:3423–3431CrossRef

11.

He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778

12.

Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef

13.

Huang G, Liu Z, Van Der Maaten L, Weinberger, KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708

14.

Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp. 448–456

15.

Kalenzi C, Back D, Yim M (2020) The future of online education: lessons from South Korea. World Economic Forum. https://www.weforum.org/agenda/2020/11/lessons-from-south-korea-on-the-future-of-online-education/. Accessed 12 June 2021.

16.

Kim HG, Jang GJ, Oh YH, Choi HJ (2020) Speech and music pitch trajectory classification using recurrent neural networks for monaural speech segregation. J Supercomput 76:8193–8213. https://doi.org/10.1007/s11227-019-02785-xCrossRef

17.

Kingma DP, Ba J (2014) Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980

18.

Koo B, La S, Cho NW, Yu Y (2019) Using support vector machines to classify building elements for checking the semantic integrity of building information models. Autom Constr 98:183–194CrossRef

19.

Lee G, Ojha, A, Lee M (2015) Concentration monitoring for intelligent tutoring system based on pupil and Eye – blink, In: Proceedings of the 3rd International Conference on Human-Agent Interaction, pp 291–294

20.

Li J, Ngai G, Leong HV, Chan SCF (2016) Multimodal human attention detection for reading from facial expression, Eye Gaze, and mouse dynamics. ACM SIGAPP Appl Comput Rev 16:37–49CrossRef

21.

Lin FC, Ngo HH, Dow CR (2020) A cloud-based face video retrieval system with deep learning. J Supercomput 76(11):8473–8493CrossRef

22.

Lipton Lipton ZC, Berkowitz J, Elkan C (2015) A critical review of recurrent neural networks for sequence learning. arXiv preprint arXiv:1506.00019

23.

Liu L, Peng N (2021) Evaluation of user concentration in ubiquitous and cognitive artificial intelligence-assisted English online guiding system integrating face and eye movement detection. Int J Commun Syst 34(6):e4580CrossRef

24.

López-Pernas S, Gordillo A, Barra E, Quemada J (2021) Comparing face-to-face and remote educational escape rooms for learning programming. IEEE Access 9:59270–59285CrossRef

25.

Martínez-Díaz Y, Méndez-Vázquez H, Luevano LS, Nicolás-Díaz M, Chang L, Gonzalez-Mendoza M (2022) Towards accurate and lightweight masked face recognition: an experimental evaluation. IEEE Access 10:7342–7353. https://doi.org/10.1109/ACCESS.2021.3135255CrossRef

26.

Paoletti ME, Haut JM, Plaza J, Plaza A (2020) Scalable recurrent neural network for hyperspectral image classification. J Supercomput 76:8866–8882. https://doi.org/10.1007/s11227-020-03187-0CrossRef

27.

Radha R, Mahalakshmi K, Kumar VS, Saravanakumar AR (2020) E-Learning during lockdown of covid-19 pandemic: a global perspective. Int J Control Autom 13:1088–1099

28.

Sankar JP, Kalaichelvi R, John J, Menon N, Elumalai KV, Alqahtani M, Abumelha M (2019) Factors affecting the quality of E-learning during the covid-19 pandemic from the perspective of higher education students. J Inf Technol Educ Res 19:731–753. https://doi.org/10.28945/4628CrossRef

29.

Schuster M, Paliwal KK (1997) Bidirectional recurrent neural networks. IEEE Trans Signal Process 45:2673–2681. https://doi.org/10.1109/78.650093CrossRef

30.

Sharma A, Biswas A, Gandhi A, Patil S, Deshmukh O (2016) LIVELINET: A multimodal deep recurrent neural network to predict liveliness. in: educational videos. In: International Educational Data Mining Society

31.

Sharma P, Joshi S, Gautam S, Maharjan S, Filipe V, Reis MJ (2019) Student engagement detection using emotion analysis, eye tracking and head movement with machine learning. arXiv preprint arXiv:1909.12913

32.

Soni VD (2020) Global Impact of E-learning during COVID 19. SSRN Electron J. https://doi.org/10.2139/ssrn.3630073CrossRef

33.

Stevens GJ, Bienz T, Wali N, Condie J, Schismenos S (2021) Online university education is the new normal: but is face-to-face better? Interact Technol Smart Edu 18(3):278–297CrossRef

34.

Tealab A (2018) Time series forecasting using artificial neural networks methodologies: a systematic review. Futur Comput Informatics J 3:334–340. https://doi.org/10.1016/j.fcij.2018.10.003CrossRef

35.

Toshpulatov M, Lee W, Lee S (2021) Generative adversarial networks and their application to 3D face generation: a survey. Image Vis Comput 108:104119CrossRef

36.

Troussas C, Krouska A, Giannakas F, Sgouropoulou C, Voyiatzis I (2021) An alternative educational tool through interactive software over Facebook in the Era of COVID-19. In: Novelties in Intelligent Digital Systems: 3–11

37.

Wang ZH, Horng GJ, Hsu TH et al (2020) Heart sound signal recovery based on time series signal prediction using a recurrent neural network in the long short-term memory model. J Supercomput 76:8373–8390. https://doi.org/10.1007/s11227-019-03096-xCrossRef

38.

Wen J, Zhang W, Shu W (2019) A cognitive learning model in distance education of higher education institutions based on chaos optimization in big data environment. J Supercomput 75(2):719–731CrossRef

39.

You K, Long M, Wang J, Jordan MI (2019) How does learning rate decay help modern neural networks? arXiv preprint arXiv:1908.01878

40.

Zaghari N, Fathy M, Jameii SM, Sabokrou M, Shahverdy M (2021) Improving the learning of self-driving vehicles based on real driving behavior using deep neural network techniques. J Supercomput 77:3752–3794. https://doi.org/10.1007/s11227-020-03399-4CrossRef

Title: Evaluation of e-learners’ concentration using recurrent neural networks
Authors: Young-Sang Jeong
Nam-Wook Cho
Publication date: 22-09-2022
Publisher: Springer US
Published in: The Journal of Supercomputing / Issue 4/2023
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI: https://doi.org/10.1007/s11227-022-04804-w

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Other articles of this Issue 4/2023

The analysis of agricultural Internet of things product marketing by deep learning

Image compression and denoising using multiresolution region-based image description scheme

Energy-aware disjoint dominating sets-based whale optimization algorithm for data collection in WSNs

IoT-fog-based healthcare 4.0 system using blockchain technology

Resource utilization and cost optimization oriented container placement for edge computing in industrial internet

Performance analysis of 5GMAKA: lightweight mutual authentication and key agreement scheme for 5G network

Premium Partner