Skip to main content
Erschienen in: Soft Computing 6/2015

01.06.2015 | Focus

Self-adjusting harmony search-based feature selection

verfasst von: Ling Zheng, Ren Diao, Qiang Shen

Erschienen in: Soft Computing | Ausgabe 6/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Many strategies have been exploited for the task of feature selection, in an effort to identify more compact and better quality feature subsets. The development of nature-inspired stochastic search techniques allows multiple good quality feature subsets to be discovered without resorting to exhaustive search. In particular, harmony search is a recently developed technique mimicking musicians’ experience, which has been effectively utilised to cope with feature selection problems. In this paper, a self-adjusting approach is proposed for feature selection with an aim to further enhance the performance of the existing harmony search-based method. This novel approach includes three dynamic strategies: restricted feature domain, harmony memory consolidation, and pitch adjustment. Systematic experimental evaluations using high dimensional, real-valued benchmark data sets are conducted in order to verify the efficacy of the proposed work.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Aarts E, van Laarhoven P (1989) Simulated annealing: an introduction. Stat Neerl 43(1):31–52CrossRefMATH Aarts E, van Laarhoven P (1989) Simulated annealing: an introduction. Stat Neerl 43(1):31–52CrossRefMATH
Zurück zum Zitat Al-Betar M, Khader A, Zaman M (2012) University course timetabling using a hybrid harmony search metaheuristic algorithm. IEEE Trans Syst Man Cybern C 42(5):664–681CrossRef Al-Betar M, Khader A, Zaman M (2012) University course timetabling using a hybrid harmony search metaheuristic algorithm. IEEE Trans Syst Man Cybern C 42(5):664–681CrossRef
Zurück zum Zitat Bellman R (1957) Dynamic programming, 1st edn. Princeton University Press, PrincetonMATH Bellman R (1957) Dynamic programming, 1st edn. Princeton University Press, PrincetonMATH
Zurück zum Zitat Bengio Y, Grandvalet Y (2004) No unbiased estimator of the variance of k-fold cross-validation. Mach Learn Res 5:1089–1105MATHMathSciNet Bengio Y, Grandvalet Y (2004) No unbiased estimator of the variance of k-fold cross-validation. Mach Learn Res 5:1089–1105MATHMathSciNet
Zurück zum Zitat Bhattacharya R, Patrangenaru V (2002) Nonparametic estimation of location and dispersion on riemannian manifolds. J Stat Plan Inference 108(1):23–35CrossRefMATHMathSciNet Bhattacharya R, Patrangenaru V (2002) Nonparametic estimation of location and dispersion on riemannian manifolds. J Stat Plan Inference 108(1):23–35CrossRefMATHMathSciNet
Zurück zum Zitat Chuang LY, Chang HW, Tu CJ, Yang CH (2008) Improved binary PSO for feature selection using gene expression data. Comput Biol Chem 32(1):29–38CrossRefMATH Chuang LY, Chang HW, Tu CJ, Yang CH (2008) Improved binary PSO for feature selection using gene expression data. Comput Biol Chem 32(1):29–38CrossRefMATH
Zurück zum Zitat De Cock M, Cornelis C, Kerre EE (2007) Fuzzy rough sets: the forgotten step. IEEE Trans Fuzzy Syst 15(1):121–130CrossRef De Cock M, Cornelis C, Kerre EE (2007) Fuzzy rough sets: the forgotten step. IEEE Trans Fuzzy Syst 15(1):121–130CrossRef
Zurück zum Zitat Das S, Mukhopadhyay A, Roy A, Abraham A, Panigrahi B (2011) Exploratory power of the harmony search algorithm: analysis and improvements for global numerical optimization. IEEE Trans Syst Man Cybern B 41(1):89–106CrossRef Das S, Mukhopadhyay A, Roy A, Abraham A, Panigrahi B (2011) Exploratory power of the harmony search algorithm: analysis and improvements for global numerical optimization. IEEE Trans Syst Man Cybern B 41(1):89–106CrossRef
Zurück zum Zitat Diao R, Shen Q (2012) Feature selection with harmony search. IEEE Trans Syst Man Cybern B 42(6):1509–1523CrossRef Diao R, Shen Q (2012) Feature selection with harmony search. IEEE Trans Syst Man Cybern B 42(6):1509–1523CrossRef
Zurück zum Zitat Diao R, Shen Q (2010) Two new approaches to feature selection with harmony search. In: IEEE interantional conference on fuzzy systems, pp 1–7 Diao R, Shen Q (2010) Two new approaches to feature selection with harmony search. In: IEEE interantional conference on fuzzy systems, pp 1–7
Zurück zum Zitat Dubois D, Prade H (1992) Putting rough sets and fuzzy sets together. Intelligent Decision Support, Kluwer Academic, DordrechtCrossRef Dubois D, Prade H (1992) Putting rough sets and fuzzy sets together. Intelligent Decision Support, Kluwer Academic, DordrechtCrossRef
Zurück zum Zitat Fesanghary M, Mahdavi M, Minary-Jolandan M, Alizadeh Y (2008) Hybridizing harmony search algorithm with sequential quadratic programming for engineering optimization problems. Comput Methods Appl Mech Eng 197(33–40):3080–3091CrossRefMATH Fesanghary M, Mahdavi M, Minary-Jolandan M, Alizadeh Y (2008) Hybridizing harmony search algorithm with sequential quadratic programming for engineering optimization problems. Comput Methods Appl Mech Eng 197(33–40):3080–3091CrossRefMATH
Zurück zum Zitat Frank A, Asuncion A (2010) UCI machine learning repository Frank A, Asuncion A (2010) UCI machine learning repository
Zurück zum Zitat Geem ZW (ed) (2010) Recent advances in harmony search algorithm. In: Studies in computational intelligence, vol 270. Springer, Berlin Geem ZW (ed) (2010) Recent advances in harmony search algorithm. In: Studies in computational intelligence, vol 270. Springer, Berlin
Zurück zum Zitat Grefenstette JJ (1986) Optimization of control parameters for genetic algorithms. IEEE Trans Syst Man Cybern 16(1):122–128CrossRef Grefenstette JJ (1986) Optimization of control parameters for genetic algorithms. IEEE Trans Syst Man Cybern 16(1):122–128CrossRef
Zurück zum Zitat Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157–1182MATH Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157–1182MATH
Zurück zum Zitat Hall MA (1998) Correlation-based feature subset selection for machine learning. PhD thesis, University of Waikato, Hamilton, New Zealand Hall MA (1998) Correlation-based feature subset selection for machine learning. PhD thesis, University of Waikato, Hamilton, New Zealand
Zurück zum Zitat Hsu HH, Hsieh CW (2010) Feature selection via correlation coefficient clustering. J Softw 5(12):1371–1377CrossRef Hsu HH, Hsieh CW (2010) Feature selection via correlation coefficient clustering. J Softw 5(12):1371–1377CrossRef
Zurück zum Zitat Jensen R, Shen Q (2009) Are more features better? A response to attributes reduction using fuzzy rough sets. IEEE Trans Fuzzy Syst 17(6):1456–1458CrossRef Jensen R, Shen Q (2009) Are more features better? A response to attributes reduction using fuzzy rough sets. IEEE Trans Fuzzy Syst 17(6):1456–1458CrossRef
Zurück zum Zitat Jensen R, Shen Q (2009) New approaches to fuzzy-rough feature selection. IEEE Trans Fuzzy Syst 17(4):824–838CrossRef Jensen R, Shen Q (2009) New approaches to fuzzy-rough feature selection. IEEE Trans Fuzzy Syst 17(4):824–838CrossRef
Zurück zum Zitat Johnson N (1966) Linear statistical inference and its applications. Technometrics 8(3):551–553CrossRef Johnson N (1966) Linear statistical inference and its applications. Technometrics 8(3):551–553CrossRef
Zurück zum Zitat Leardi R, Boggia R, Terrile M (1992) Genetic algorithms as a strategy for feature selection. J Chemom 6(5):267–281CrossRef Leardi R, Boggia R, Terrile M (1992) Genetic algorithms as a strategy for feature selection. J Chemom 6(5):267–281CrossRef
Zurück zum Zitat Lee KS, Geem ZW (2004) A new structural optimization method based on the harmony search algorithm. Comput Struct 82(9):781–798CrossRef Lee KS, Geem ZW (2004) A new structural optimization method based on the harmony search algorithm. Comput Struct 82(9):781–798CrossRef
Zurück zum Zitat Liu H, Motoda H (2008) Computational methods of feature selection. Chapman & Hall/CRC, USA Liu H, Motoda H (2008) Computational methods of feature selection. Chapman & Hall/CRC, USA
Zurück zum Zitat Mac Parthaláin N, Jensen R, Shen Q, Zwiggelaar R (2010) Fuzzy-rough approaches for mammographic risk analysis. Intell Data Anal 14(2):225–244 Mac Parthaláin N, Jensen R, Shen Q, Zwiggelaar R (2010) Fuzzy-rough approaches for mammographic risk analysis. Intell Data Anal 14(2):225–244
Zurück zum Zitat Mahdavi M, Fesanghary M, Damangir E (2007) An improved harmony search algorithm for solving optimization problems. Appl Math Comput 188(2):1567–1579CrossRefMATHMathSciNet Mahdavi M, Fesanghary M, Damangir E (2007) An improved harmony search algorithm for solving optimization problems. Appl Math Comput 188(2):1567–1579CrossRefMATHMathSciNet
Zurück zum Zitat Mahdavi M, Chehreghani MH, Abolhassani H, Forsati R (2008) Novel meta-heuristic algorithms for clustering web documents. Appl Math Comput 201(1–2):441–451 CrossRefMATHMathSciNet Mahdavi M, Chehreghani MH, Abolhassani H, Forsati R (2008) Novel meta-heuristic algorithms for clustering web documents. Appl Math Comput 201(1–2):441–451 CrossRefMATHMathSciNet
Zurück zum Zitat Mashinchi M, Orgun MA, Mashinchi M, Pedrycz W (2011) A tabu-harmony search-based approach to fuzzy linear regression. IEEE Trans Fuzzy Syst 19(3):432–448CrossRef Mashinchi M, Orgun MA, Mashinchi M, Pedrycz W (2011) A tabu-harmony search-based approach to fuzzy linear regression. IEEE Trans Fuzzy Syst 19(3):432–448CrossRef
Zurück zum Zitat Mitra P, Murthy C, Pal SK (2002) Unsupervised feature selection using feature similarity. IEEE Trans Pattern Anal Mach Intell 24(3):301–312CrossRef Mitra P, Murthy C, Pal SK (2002) Unsupervised feature selection using feature similarity. IEEE Trans Pattern Anal Mach Intell 24(3):301–312CrossRef
Zurück zum Zitat Muni DP, Pal NR, Das J (2006) Genetic programming for simultaneous feature selection and classifier design. IEEE Trans Syst Man Cybern B 36(1):106–117CrossRef Muni DP, Pal NR, Das J (2006) Genetic programming for simultaneous feature selection and classifier design. IEEE Trans Syst Man Cybern B 36(1):106–117CrossRef
Zurück zum Zitat Pawlak Z (1997) Rough set approach to knowledge-based decision support. Eur J Oper Res 99(1):48–57CrossRefMATH Pawlak Z (1997) Rough set approach to knowledge-based decision support. Eur J Oper Res 99(1):48–57CrossRefMATH
Zurück zum Zitat Rao Srinivasa R, Narasimham SVL, Ramalinga Raju M, Srinivasa Rao A (2011) Optimal network reconfiguration of large-scale distribution system using harmony search algorithm. IEEE Trans Power Syst 26(3):1080–1088CrossRef Rao Srinivasa R, Narasimham SVL, Ramalinga Raju M, Srinivasa Rao A (2011) Optimal network reconfiguration of large-scale distribution system using harmony search algorithm. IEEE Trans Power Syst 26(3):1080–1088CrossRef
Zurück zum Zitat Shah M, Marchand M, Corbeil J (2012) Feature selection with conjunctions of decision stumps and learning from microarray data. IEEE Trans Pattern Anal Mach Intell 34(1):174–186CrossRef Shah M, Marchand M, Corbeil J (2012) Feature selection with conjunctions of decision stumps and learning from microarray data. IEEE Trans Pattern Anal Mach Intell 34(1):174–186CrossRef
Zurück zum Zitat Shang C, Barnes D (2013) Fuzzy-rough feature selection aided support vector machines for mars image classification. Comput Vision Image Underst 117(3):202–213CrossRef Shang C, Barnes D (2013) Fuzzy-rough feature selection aided support vector machines for mars image classification. Comput Vision Image Underst 117(3):202–213CrossRef
Zurück zum Zitat Sharma Das K, Chatterjee A, Rakshit A (2010) Design of a hybrid stable adaptive fuzzy controller employing lyapunov theory and harmony search algorithm. IEEE Trans Control Syst Technol 18(6):1440–1447 Sharma Das K, Chatterjee A, Rakshit A (2010) Design of a hybrid stable adaptive fuzzy controller employing lyapunov theory and harmony search algorithm. IEEE Trans Control Syst Technol 18(6):1440–1447
Zurück zum Zitat Shen Q, Jensen R (2004) Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring. Pattern Recognit 37(7):1351–1363CrossRefMATH Shen Q, Jensen R (2004) Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring. Pattern Recognit 37(7):1351–1363CrossRefMATH
Zurück zum Zitat Tsang EC, Chen D, Yeung DS, Wang XZ, Lee J (2008) Attributes reduction using fuzzy rough sets. IEEE Trans Fuzzy Syst 16(5):1130–1141CrossRef Tsang EC, Chen D, Yeung DS, Wang XZ, Lee J (2008) Attributes reduction using fuzzy rough sets. IEEE Trans Fuzzy Syst 16(5):1130–1141CrossRef
Zurück zum Zitat Vasebi A, Fesanghary M, Bathaee SMT (2007) Combined heat and power economic dispatch by harmony search algorithm. Int J Electr Power Energy Syst 29(10):713–719CrossRef Vasebi A, Fesanghary M, Bathaee SMT (2007) Combined heat and power economic dispatch by harmony search algorithm. Int J Electr Power Energy Syst 29(10):713–719CrossRef
Zurück zum Zitat Wang X, Yang J, Teng X, Xia W, Jensen R (2007) Feature selection based on rough sets and particle swarm optimization. Pattern Recognit Lett 28(4):459–471CrossRef Wang X, Yang J, Teng X, Xia W, Jensen R (2007) Feature selection based on rough sets and particle swarm optimization. Pattern Recognit Lett 28(4):459–471CrossRef
Zurück zum Zitat Witten IH, Frank E (2005) Data mining: practical machine learning tools and techniques, 2nd edn., Morgan Kaufmann series in data management systemsMorgan Kaufmann, San Francisco Witten IH, Frank E (2005) Data mining: practical machine learning tools and techniques, 2nd edn., Morgan Kaufmann series in data management systemsMorgan Kaufmann, San Francisco
Zurück zum Zitat Xing EP, Jordan MI, Karp RM (2001) Feature selection for high-dimensional genomic microarray data. In: Proceedings of the eighteenth international conference on machine learning, pp 601–608. Morgan Kaufmann, San Francisco Xing EP, Jordan MI, Karp RM (2001) Feature selection for high-dimensional genomic microarray data. In: Proceedings of the eighteenth international conference on machine learning, pp 601–608. Morgan Kaufmann, San Francisco
Zurück zum Zitat Yang, XS (2009) Harmony search as a metaheuristic algorithm. In: Music-inspired harmony search algorithm, pp 1–14. Springer, Berlin Yang, XS (2009) Harmony search as a metaheuristic algorithm. In: Music-inspired harmony search algorithm, pp 1–14. Springer, Berlin
Zurück zum Zitat Zhang R, Hanzo L (2009) Iterative multiuser detection and channel decoding for ds-cdma using harmony search. IEEE Signal Process Lett 16(10):917–920CrossRef Zhang R, Hanzo L (2009) Iterative multiuser detection and channel decoding for ds-cdma using harmony search. IEEE Signal Process Lett 16(10):917–920CrossRef
Zurück zum Zitat Zheng L, Diao R, Shen Q (2013) Efficient feature selection using a self-adjusting harmony search algorithm. In: Proceeding of the 2013 13th UK workshop on computational intelligence, pp 167–174 Zheng L, Diao R, Shen Q (2013) Efficient feature selection using a self-adjusting harmony search algorithm. In: Proceeding of the 2013 13th UK workshop on computational intelligence, pp 167–174
Metadaten
Titel
Self-adjusting harmony search-based feature selection
verfasst von
Ling Zheng
Ren Diao
Qiang Shen
Publikationsdatum
01.06.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 6/2015
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-014-1307-8

Weitere Artikel der Ausgabe 6/2015

Soft Computing 6/2015 Zur Ausgabe