Abstract
In this paper, a new method for handling the Multi-Input Multi-Output Student Academic Performance Prediction (MIMO SAPP) problem is proposed. The MIMO SAPP aims to predict the future performance of a student after being enrolled into a university. The existing methods have limitations of using a parameter set and an unsuitable training strategy. Thus, the new method called MANFIS-S (Multi Adaptive Neuro-Fuzzy Inference System with Representative Sets) uses multiple parameter sets and a special learning strategy to resolve those weaknesses. Specifically, the idea of multiple parameter sets is to approximate the MANFIS-S model with many meaningful parameters to ensure the performance of system. This is regarded as the representative problem, which is mathematically formulated and theoretically validated. The idea for the special learning strategy is to use global and local training. In global training, a random parameter set is trained from the first to the last record of the database. Each time of training results in a set of parameters. Global training will rectify and achieve a meaningful subset of parameters by the last training process. In local training, there are 2 types of parameters in MANFIS-S namely premise and consequent that are trained by the gradient descent and Particle Swarm Optimization in a hybrid way. Lastly, for a new record in the testing set, Fuzzy K-Nearest Neighbor is used to find which group it belongs to. The proposed MANFIS-S model is experimentally validated against ANFIS, MANFIS, OneR and Random Tree in a benchmark student performance dataset from UCI, a real student performance dataset from VNU University of Science, Vietnam, and 3 educational datasets taken from KDD Cup. The experiments demonstrated the superiority of MANFIS-S over the related algorithms in term of accuracy.
Similar content being viewed by others
References
Abidin B, Dom RM (2012) Prediction of preclinical academic performance using ANFIS model. Int Proc Econ Dev Res 41:105–109
Anagnostopoulos C, Kolomvatsos K (2018) Predictive intelligence to the edge through approximate collaborative context reasoning. Appl Intell 48(4):966–991
Appel O, Chiclana F, Carter J, Fujita H (2016) A hybrid approach to the sentiment analysis problem at the sentence level. Knowl-Based Syst 108:110–124
Arora N, Saini JR (2013) A fuzzy probabilistic neural network for student’s academic performance prediction. Int J Innov Res Sci Eng Technol 2(9):4425–4432
Azadeh A, Saberi M, Anvari M, Azaron A, Mohammadi M (2011) An adaptive network based fuzzy inference system-genetic algorithm clustering ensemble algorithm for performance assessment and improvement of conventional power plants. Expert Syst Appl 38(3):2224–2234
Baird L (1976) Using self-reports to predict student performance, no 7. College Board
Baker RS, other (2010) Contextual slip and prediction of student performance after use of an intelligent tutor. In: User modeling, adaptation, and personalization. Springer, Berlin, pp 52–63
Buragohain M, Mahanta C (2008) A novel approach for ANFIS modeling based on full factorial design. Appl Soft Comput 8(1):609–625
Chamillard AT (2006) Using student performance predictions in a computer science curriculum. In: ACM SIGCSE bulletin, vol 38, pp 260–264
Chamorro-Premuzic T, Furnham A (2003) Personality predicts academic performance: evidence from two longitudinal university samples. J Res Pers 37(4):319–338
Chemers MM, Hu LT, Garcia BF (2001) Academic self-efficacy and first year college student performance and adjustment. J Educ Psychol 93(1):55–64
Chen JF, Do QH (2014) A cooperative Cuckoo Search–hierarchical adaptive neuro-fuzzy inference system approach for predicting student academic performance. J Intell Fuzzy Syst 27(5):2551–2561
Chuan PM, Son LH, Ali M, Khang TD, Dey N (2018) Link prediction in co-authorship networks based on hybrid content similarity metric. Appl Intell, pp 1–17. https://doi.org/10.1007/s10489-017-1086-x
Cohen L, Manion L, Morrison L (2007) Research methods in education, six. Routledge, Oxon, pp 211–216
Cope MK, Baker HH, Fisk ROBERT, Gorby JN, Foster RW (2001) Prediction of student performance on the comprehensive osteopathic medical licensing examination level I based on admission data and course performance. J Am Osteopathic Assoc 101(2):84–90
DeBerard MS, Spielmans G, Julka D (2004) Predictors of academic achievement and retention among college freshmen: a longitudinal study. College Student J 38(1):66–80
Derrac J, García S, Herrera F (2014) Fuzzy nearest neighbor algorithms: taxonomy, experimental analysis and prospects. Inf Sci 260:98–119
Do QH, Chen JF (2013) A neuro-fuzzy approach in the classification of students’ academic performance. Comput Intell Neurosci 6
Do QH, Chen JF (2013) A comparative study of hierarchical ANFIS and ANN in predicting student academic performance. WSEAS Trans Inf Sci Appl 10(12):396–405
Eskew RK, Faley RH (1988) Some determinants of student performance in the first college-level financial accounting course. Account Rev 63(1):137–147
Felder RM, Felder GN, Mauney M, Hamrin CE, Dietz EJ (1995) A longitudinal study of engineering student performance and retention. III. Gender differences in student performance and attitudes. J Eng Educ 84 (2):151–163
Friedman BA, Mandel RG (2009) The prediction of college student academic performance and retention: application of expectancy and goal setting theories. J College Student Retention: Res Theor Prac 11(2):227–246
Giap CN, Son LH, Chiclana F (2018) Dynamic structural neural network. J Intell Fuzzy Syst 34 (4):2479–2490
Hanushek EA, Raymond ME (2004) Does school accountability lead to improved student performance?, no w10591. National Bureau of Economic Research
Hemanth DJ, Anitha J, Son LH (2018) Brain signal based human emotion analysis by circular back propagation and deep Kohonen neural networks. Comput Elect Eng 68:170–180
Hidayah I, Permanasari AE, Ratwastuti N (2013) Student classification for academic performance prediction using neuro fuzzy in a conventional classroom. In: Proceedings of the 2013 IEEE international conference on information technology and electrical engineering, pp 221–225
Kabakchieva D (2012) Student performance prediction by using data mining classification algorithms. Int J Comput Sci Manag Res 1(4):686–690
Kane TJ, Staiger DO (2008) Estimating teacher impacts on student achievement: an experimental evaluation, no w14607. National Bureau of Economic Research
Koh WL, Steers RM, Terborg JR (1995) The effects of transformational leadership on teacher attitudes and student performance in Singapore. J Organ Behav 16(4):319–333
Kovacic Z (2010) Early prediction of student success: mining students’ enrolment data. In: Proceedings of informing science & IT education conference (InSITE), vol 2010, pp 647–665
Kuncel NR, Hezlett SA, Ones DS (2001) A comprehensive meta-analysis of the predictive validity of the graduate record examinations: implications for graduate student selection and performance. Psychol Bull 127 (1):162–181
Liang W, Li X, He X, Liu X, Zhang X (2018) Supervised ranking framework for relationship prediction in heterogeneous information networks. Appl Intell 48(5):1111–1127
Luaces O, Díez J, Alonso-Betanzos A, Troncoso A, Bahamonde A (2017) Content-based methods in peer assessment of open-response questions to grade students as authors and as graders. Knowl-Based Syst 117:79–87
Lykourentzou I, Giannoukos I, Mpardis G, Nikolopoulos V, Loumos V (2009) Early and dynamic student achievement prediction in e-learning courses using neural networks. J Am Soc Inf Sci Technol 60(2):372–380
Márquez-Vera C, Cano A, Romero C, Ventura S (2013) Predicting student failure at school using genetic programming and different data mining approaches with high dimensional and imbalanced data. Appl Intell 38(3):315–330
Marzano RJ, Pickering D, McTighe J (1993) Assessing student outcomes: performance assessment using the dimensions of learning model. Association for Supervision and Curriculum Development, Alexandria
McKenzie K, Schweitzer R (2001) Who succeeds at university? Factors predicting academic performance in first year Australian university students. Higher Educ Res Dev 20(1):21–33
Metin EH, Murat H (2008) Comparative analysis of an evaporative condenser using artificial neural network and adaptive neuro-fuzzy inference system. Int J Refrig 31(8):1426–1436
Nazmul S, Hojjat A (2013) Computational Intelligence synergies of fuzzy logic neural networks and evolutionary computing. Wiley, New York
Ngan RT, Ali M, Son LH (2018) δ-equality of intuitionistic fuzzy sets: a new proximity measure and applications in medical diagnosis. Appl Intell 48(2):499–525
Ngan RT, Son LH, Cuong BC, Ali M (2018) H-max distance measure of intuitionistic fuzzy sets in decision making. Appl Soft Comput 69:393–425
Oyelade OJ, Oladipupo OO, Obagbuwa IC (2010) Application of k means clustering algorithm for prediction of students academic performance. arXiv:1002.2425
Pandey M, Sharma VK (2013) A decision tree algorithm pertaining to the student performance analysis and prediction. Int J Comput Appl 61(13):1–5
Pardos ZA, Heffernan NT, Anderson B, Heffernan CL (2007) The effect of model granularity on student performance prediction using Bayesian networks. In: User modeling 2007. Springer, Berlin, pp 435–439
Paris IHM, Affendey LS, Mustapha N (2010) Improving academic performance prediction using voting technique in data mining. World Acad Sci Eng Technol 62:820–823
Poropat AE (2009) A meta-analysis of the five-factor model of personality and academic performance. Psychol Bull 135(2):322
Pritchard ME, Wilson GS (2003) Using emotional and social factors to predict student success. J College Student Dev 44(1):18–28
Ramaswami M, Bhaskaran R (2010) A CHAID based performance prediction model in educational data mining. arXiv:1002.1144
Ramaswami M, Rathinasabapathy R (2012) Student performance prediction. Int J Comput Intell Inf 1 (4):231–235
Romero C, Ventura S (2013) Data mining in education. Wiley Interdisciplinary Rev: Data Mining Knowl Discov 3(1):12–27
Rusli NM, Ibrahim Z, Janor RM (2008) Predicting students’ academic achievement: comparison between logistic regression, artificial neural network, and neuro-fuzzy. In: Proceedings of IEEE international symposium on information technology 2008, vol 1, pp 1–6
Schmitt N, Keeney J, Oswald FL, Pleskac TJ, Billington AQ, Sinha R, Zorzie M (2009) Prediction of 4-year college student performance using cognitive and noncognitive predictors and the impact on demographic status of admitted students. J Appl Psychol 94(6):1479
Shaobo H, Ning F (2011) Work in progress—Prediction of students’ academic performance in an introductory engineering course. In: Proceeding of the IEEE conference on frontiers in education conference 2011, S4D-1
Son LH, Linh ND, Long HV (2014) A lossless DEM compression for fast retrieval method using fuzzy clustering and MANFIS neural network. Eng Appl Artif Intell 29:33–42
Stage SA, Jacobsen MD (2001) Predicting student success on a state-mandated performance-based assessment using oral reading fluency. School Psychol Rev 30(3):407–441
Stamper J, Niculescu-Mizilm A, Ritter S, Gordon GJ, Koedinger KR (2010) Data set from KDD Cup 2010 educational data mining challenge. Available at: http://pslcdatashop.web.cmu.edu/KDDCup/downloads.jsp
Stevens TA, To Y, Stevenson SJ, Lochbaum MR (2008) The importance of physical activity and physical education in the prediction of academic achievement. J Sport Behav 31(4):368–388
Student Performance UCI machine learning repository. Available at: https://archive.ics.uci.edu/ml/datasets/Student+Performance
Taylan O, Karagözoğlu B (2009) An adaptive neuro-fuzzy model for prediction of student’s academic performance. Comput Ind Eng 57(3):732–741
Tournaki N, Podell DM (2005) The impact of student characteristics and teacher efficacy on teachers’ predictions of student success. Teach Teach Educ 21(3):299–314
Urena R, Chiclana F, Fujita H, Herrera-Viedma E (2015) Confidence-consistency driven group decision making approach with incomplete reciprocal intuitionistic preference relations. Knowl-Based Syst 89:86–96
Wilkinson D, Zhang J, Byrne GJ, Luke H, Ozolins IZ, Parker MH, Peterson RF (2008) Medical school selection criteria and the prediction of academic performance. Med J Aust 189(4):349–354
Wilson KM (1983) A review of research on the prediction of academic performance after the freshman year, ETS Res Rep Ser, 1, i–44
Xie T, Zheng Q, Zhang W (2016) A behavioral sequence analyzing framework for grouping students in an e-learning system. Knowl-Based Syst 111:36–50
Xiong X, Pardos ZA (2011) An analysis of response time data for improving student performance prediction. Available at: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.374.1577
Yadav SK, Pal S (2012) Data mining: a prediction for performance improvement of engineering students using classification. arXiv:1203.3832
Yildiz O, Bal A, Gulsecen S (2013) Improved fuzzy modelling to predict the academic performance of distance education students. Int Rev Res Open Distrib Learn (14):5
Yldz O, Bal A, GŸlseçen S, Kentli FD (2012) A genetic-fuzzy based mathematical model to evaluate the distance education students’ academic performance. Procedia-Soc Behav Sci 55:409–418
Zheng Y, Li C, Liu S, Lu W (2018) An improved genetic approach for composing optimal collaborative learning groups. Knowl-Based Syst 139:214–225
Zuviria NM, Mary SL, Kuppammal V (2012) SAPM: ANFIS based prediction of student academic performance metric. In: Proceedings of the 2012 third IEEE international conference on computing communication & networking technologies, pp 1–6
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
The source codes of algorithms and experimental datasets in this paper can be retrieved at the address: https://www.mathworks.com/matlabcentral/fileexchange/54686-manfis-s.
Rights and permissions
About this article
Cite this article
Son, L.H., Fujita, H. Neural-fuzzy with representative sets for prediction of student performance. Appl Intell 49, 172–187 (2019). https://doi.org/10.1007/s10489-018-1262-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-018-1262-7