Skip to main content
Top
Published in: Neural Computing and Applications 7-8/2014

01-12-2014 | Original Article

A group decision classifier with particle swarm optimization and decision tree for analyzing achievements in mathematics and science

Authors: Ping-Feng Pai, Chen-Tung Chen, Yu-Mei Hung, Wei-Zhan Hung, Ying-Chieh Chang

Published in: Neural Computing and Applications | Issue 7-8/2014

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Group decision making is a multi-criteria decision-making method applied in many fields. However, the use of group decision-making techniques in multi-class classification problems and rule generation is not explored widely. This investigation developed a group decision classifier with particle swarm optimization (PSO) and decision tree (GDCPSODT) for analyzing students’ mathematic and scientific achievements, which is a multi-class classification problem involving rule generation. The PSO technique is employed to determine weights of condition attributes; the decision tree is used to generate rules. To demonstrate the performance of the developed GDCPSODT model, other classifiers such as the Bayesian classifier, the k-nearest neighbor (KNN) classifier, the back propagation neural networks classifier with particle swarm optimization (BPNNPSO) and the radial basis function neural networks classifier with PSO (RBFNNPSO) are used to cope with the same data. Experimental results indicated the testing accuracy of GDCPSODT is higher than the other four classifiers. Furthermore, rules and some improvement directions of academic achievements are provided by the GDCPSODT model. Therefore, the GDCPSODT model is a feasible and promising alternative for analyzing student-related mathematic and scientific achievement data.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Yayan B, Berberoglu G (2004) A re-analysis of the TIMSS 1999 mathrmatics assessment data of the Turkish students. Stud Educ Eval 30:87–104CrossRef Yayan B, Berberoglu G (2004) A re-analysis of the TIMSS 1999 mathrmatics assessment data of the Turkish students. Stud Educ Eval 30:87–104CrossRef
2.
go back to reference Wang DB (2004) Family background factors and mathematics success: a comparison of Chinese and US Students. Int J Educ Res 41:40–54CrossRef Wang DB (2004) Family background factors and mathematics success: a comparison of Chinese and US Students. Int J Educ Res 41:40–54CrossRef
3.
go back to reference Philippou GN, Christou C (1999) Teachers’ conceptions of mathematics and students’ achievement: a cross-cultural study based on result from TIMSS. Stud Educ Eval 25:379–398CrossRef Philippou GN, Christou C (1999) Teachers’ conceptions of mathematics and students’ achievement: a cross-cultural study based on result from TIMSS. Stud Educ Eval 25:379–398CrossRef
4.
go back to reference Ramirez M (2006) Understand the low mathematics achievement of Chilean students: a cross-national analysis using TIMSS data. Int J Educ Res 45:102–116CrossRef Ramirez M (2006) Understand the low mathematics achievement of Chilean students: a cross-national analysis using TIMSS data. Int J Educ Res 45:102–116CrossRef
5.
go back to reference Ammermuller A, Heijke H, Woxmann L (2005) Schooling quality in eastern Europe: educational production during transition. Econ Educ Rev 24:579–599CrossRef Ammermuller A, Heijke H, Woxmann L (2005) Schooling quality in eastern Europe: educational production during transition. Econ Educ Rev 24:579–599CrossRef
6.
go back to reference Hung YM, Hung WZ, Hsu MF, Pai PF (2011) Adaboost with ReliefF in predicting students’ mathematics and science achievement. The second international conference on data analysis, data quality and metadata management, Singapore Hung YM, Hung WZ, Hsu MF, Pai PF (2011) Adaboost with ReliefF in predicting students’ mathematics and science achievement. The second international conference on data analysis, data quality and metadata management, Singapore
7.
go back to reference Reichert AK, Cho CC, Wagner GM (1983) An examination of the conceptual issues involved in developing credit-scoring models. J Bus Econ Stat 1:101–104 Reichert AK, Cho CC, Wagner GM (1983) An examination of the conceptual issues involved in developing credit-scoring models. J Bus Econ Stat 1:101–104
8.
go back to reference Greco S, Matarazzo B, Słowiński R (1999) Rough approximation of preference relation by dominance relations. Eur J Oper Res 117:63–83CrossRefMATH Greco S, Matarazzo B, Słowiński R (1999) Rough approximation of preference relation by dominance relations. Eur J Oper Res 117:63–83CrossRefMATH
9.
go back to reference Greco S, Matarazzo B, Słowiński R (2001) Rough sets theory for multi criteria decision analysis. Eur J Oper Res 129:1–47CrossRefMATH Greco S, Matarazzo B, Słowiński R (2001) Rough sets theory for multi criteria decision analysis. Eur J Oper Res 129:1–47CrossRefMATH
10.
go back to reference Błaszczyński J, Greco S, Słowiński R (2007) Multi-criteria classification: a new scheme for application of dominance-based decision rules. Eur J Oper Res 181:1030–1044CrossRefMATH Błaszczyński J, Greco S, Słowiński R (2007) Multi-criteria classification: a new scheme for application of dominance-based decision rules. Eur J Oper Res 181:1030–1044CrossRefMATH
11.
go back to reference Li M, Tian J, Chen F (2008) Improving multiclass pattern recognition with a co-evolutionary RBFNN. Pattern Recogn Lett 29:392–406CrossRef Li M, Tian J, Chen F (2008) Improving multiclass pattern recognition with a co-evolutionary RBFNN. Pattern Recogn Lett 29:392–406CrossRef
12.
go back to reference Polat K, Gunes S (2009) A novel hybrid intelligent method based on C4.5 decision tree classifier and one-against-all approach for multi-class classification problems. Expert Syst Appl 36:1587–1592CrossRef Polat K, Gunes S (2009) A novel hybrid intelligent method based on C4.5 decision tree classifier and one-against-all approach for multi-class classification problems. Expert Syst Appl 36:1587–1592CrossRef
13.
go back to reference Fernández A, Calderón M, Barrenechea E, Bustince H, Herrera F (2010) Solving multi-class problems with linguistic fuzzy rule based classification systems based on pairwise learning and preference relations. Fuzzy Set Syst 161:3064–3080CrossRefMATH Fernández A, Calderón M, Barrenechea E, Bustince H, Herrera F (2010) Solving multi-class problems with linguistic fuzzy rule based classification systems based on pairwise learning and preference relations. Fuzzy Set Syst 161:3064–3080CrossRefMATH
14.
go back to reference Veenman CJ, Bolck A (2011) A sparse nearest mean classifier for high dimensional multi-class problems. Pattern Recogn Lett 32:854–859CrossRef Veenman CJ, Bolck A (2011) A sparse nearest mean classifier for high dimensional multi-class problems. Pattern Recogn Lett 32:854–859CrossRef
15.
go back to reference Montanes E, Barranquero J, Diez J, Del Coz JJ (2013) Enhancing directed binary trees for multi-class classification. Inform Sciences 223:42–55CrossRef Montanes E, Barranquero J, Diez J, Del Coz JJ (2013) Enhancing directed binary trees for multi-class classification. Inform Sciences 223:42–55CrossRef
16.
go back to reference Lai KK, Yu L, Wang S, Zhou L (2006) Credit risk analysis using a reliability-based neural network ensemble model. Lect Notes Comput Sci 4132:682–690CrossRef Lai KK, Yu L, Wang S, Zhou L (2006) Credit risk analysis using a reliability-based neural network ensemble model. Lect Notes Comput Sci 4132:682–690CrossRef
17.
go back to reference Chang B, Hung HF (2010) A study of using RST to create the supplier selection model and decision-making rules. Expert Syst Appl 37:8284–8295CrossRefMathSciNet Chang B, Hung HF (2010) A study of using RST to create the supplier selection model and decision-making rules. Expert Syst Appl 37:8284–8295CrossRefMathSciNet
18.
go back to reference Koksalan M, Ulu C (2003) An interactive approach for placing alternatives in preference classes. Eur J Oper Res 144:429–439CrossRefMathSciNet Koksalan M, Ulu C (2003) An interactive approach for placing alternatives in preference classes. Eur J Oper Res 144:429–439CrossRefMathSciNet
19.
go back to reference Satapathy SC, Murthy JVR, Prasad Reddy PVGD, Misra BB, Dash PK, Panda G (2009) Particle swarm optimized multiple regression linear model for data classification. Appl Soft Comput 9:470–476CrossRef Satapathy SC, Murthy JVR, Prasad Reddy PVGD, Misra BB, Dash PK, Panda G (2009) Particle swarm optimized multiple regression linear model for data classification. Appl Soft Comput 9:470–476CrossRef
20.
go back to reference Almeida-Dias J, Figueira JR, Roy B (2010) ELECTRE TRI-C: a multiple criteria sorting method based on characteristic reference actions. Eur J Oper Res 204:565–580CrossRefMATH Almeida-Dias J, Figueira JR, Roy B (2010) ELECTRE TRI-C: a multiple criteria sorting method based on characteristic reference actions. Eur J Oper Res 204:565–580CrossRefMATH
21.
go back to reference Hu YC (2010) Analytic network process for pattern classification problems using genetic algorithms. Inform Sciences 180:2528–2539CrossRef Hu YC (2010) Analytic network process for pattern classification problems using genetic algorithms. Inform Sciences 180:2528–2539CrossRef
22.
go back to reference Jie L, Bo S (2011) Naive Bayesian classifier based on genetic simulated annealing algorithm. Procedia Eng 23:504–509CrossRef Jie L, Bo S (2011) Naive Bayesian classifier based on genetic simulated annealing algorithm. Procedia Eng 23:504–509CrossRef
24.
go back to reference Hu YC, Chen CJ (2011) A PROMETHEE-based classification method using concordance and discordance relations and its application to bankruptcy prediction. Inform Sciences 181:4959–4968CrossRef Hu YC, Chen CJ (2011) A PROMETHEE-based classification method using concordance and discordance relations and its application to bankruptcy prediction. Inform Sciences 181:4959–4968CrossRef
25.
go back to reference Lee HY, Lu H, Motoda H (1998) Knowledge discovery and data mining. Knowl Bas Syst 10:401–402CrossRef Lee HY, Lu H, Motoda H (1998) Knowledge discovery and data mining. Knowl Bas Syst 10:401–402CrossRef
26.
go back to reference kononenko I (1994) Estimating attributes: analysis and extensions of RELIEF. In: De Raedt L, Bergadano F(eds). Proceedings of the European conference on machine learning. 171–182 kononenko I (1994) Estimating attributes: analysis and extensions of RELIEF. In: De Raedt L, Bergadano F(eds). Proceedings of the European conference on machine learning. 171–182
27.
go back to reference Robnik-Šikonja M, Kononenko I (2003) Theoretical and Empirical Analysis of ReliefF and RReliefF. Mach Learn 53:23–69CrossRefMATH Robnik-Šikonja M, Kononenko I (2003) Theoretical and Empirical Analysis of ReliefF and RReliefF. Mach Learn 53:23–69CrossRefMATH
28.
go back to reference Huang Y, Paul J, Norman D (2009) An optimization of relief for classification in large datasets. Data Knowl Eng 68:1348–1356CrossRef Huang Y, Paul J, Norman D (2009) An optimization of relief for classification in large datasets. Data Knowl Eng 68:1348–1356CrossRef
29.
go back to reference Kennedy J, Eberhart RC (1995) Particle swarm optimization. Proceedings of the IEEE International Conference on Neural Networks 4:1942–1948CrossRef Kennedy J, Eberhart RC (1995) Particle swarm optimization. Proceedings of the IEEE International Conference on Neural Networks 4:1942–1948CrossRef
30.
go back to reference Poli R, Kennedy J, Blackwell T (2007) Particle swarm optimization. Swarm Intell 1:33–57CrossRef Poli R, Kennedy J, Blackwell T (2007) Particle swarm optimization. Swarm Intell 1:33–57CrossRef
31.
go back to reference Chen CT, Pai PF, Hung WZ (2011) Applying multi-criteria decision classifier in multi-class classification. IEEE International Conference on Fuzzy Systems and Knowledge Discovery. 607–610 Chen CT, Pai PF, Hung WZ (2011) Applying multi-criteria decision classifier in multi-class classification. IEEE International Conference on Fuzzy Systems and Knowledge Discovery. 607–610
32.
go back to reference Wagner WP, Otto J, Chung QB (2002) Knowledge acquisition for expert systems in accounting and financial problem domains. Knowl Bas Syst 15:439–447CrossRef Wagner WP, Otto J, Chung QB (2002) Knowledge acquisition for expert systems in accounting and financial problem domains. Knowl Bas Syst 15:439–447CrossRef
33.
go back to reference Quinlan JR (1986) Induction of Decision Trees. Mach Learn 1:81–106 Quinlan JR (1986) Induction of Decision Trees. Mach Learn 1:81–106
34.
go back to reference Quinlan JR (1993) C4.5:Programs for Machine Learning. Morgan: Kaufmann Publishers, United States Quinlan JR (1993) C4.5:Programs for Machine Learning. Morgan: Kaufmann Publishers, United States
35.
go back to reference Leo B, Friedman JH, Olshen RA, Stone CJ (1984) Classification and regression trees. Wadsworth & Brooks/Cole Advanced Books & Software, MontereyMATH Leo B, Friedman JH, Olshen RA, Stone CJ (1984) Classification and regression trees. Wadsworth & Brooks/Cole Advanced Books & Software, MontereyMATH
36.
go back to reference Kass GV (1980) An exploratory technique for investigating large quantities of categorical data. Appl Stat 29:119–127CrossRef Kass GV (1980) An exploratory technique for investigating large quantities of categorical data. Appl Stat 29:119–127CrossRef
Metadata
Title
A group decision classifier with particle swarm optimization and decision tree for analyzing achievements in mathematics and science
Authors
Ping-Feng Pai
Chen-Tung Chen
Yu-Mei Hung
Wei-Zhan Hung
Ying-Chieh Chang
Publication date
01-12-2014
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 7-8/2014
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-014-1689-7

Other articles of this Issue 7-8/2014

Neural Computing and Applications 7-8/2014 Go to the issue

Premium Partner