Skip to main content
Erschienen in: Soft Computing 1/2019

14.03.2018 | Methodologies and Application

Multi-strategy learning and deep harmony memory improvisation for self-organizing neurons

verfasst von: Shafaatunnur Hasan, Siti Mariyam Shamsuddin

Erschienen in: Soft Computing | Ausgabe 1/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This study proposes a concept of representation learning by implementing multi-strategy deep learning harmony memory improvisation for selecting the best harmony of self-organizing neurons. Representation learning is a set of methods that allows a machine to be fed with raw data and to automatically discover the representations needed for detection or classification. In our study, the deep multi-strategy learning involves the convolution of the self-organizing neurons with deep harmony memories improvisation in self-organizing and representation of map learning. The convolution of self-organizing neurons and harmony memory optimize the representation neurons’ weights by generating the optimal best matching unit which is represented as fitness function of \(f_1 \left( x \right) \) and \(f_2 \left( x \right) \). While \(f_1 \left[ {g\left( {{f}''_1 \left( x \right) } \right) } \right] \) and \(f_2 \left[ {g\left( {{f}'_2 \left( x \right) } \right) } \right] \) represent the New Harmony fitness function. The best fitness function, \(f_{{ best}} (x)\) is selected based on the \(f_1 \left( x \right) \) and \(f_2 \left( x \right) \) performance which will be later stored in the harmony memory vector. The position vector of a particle is subjected to the Newtonian mechanics constant acceleration during the interval \(\Delta t\). The search space of self-organizing map with Newton-based particle swarm algorithm particles depends on the width area, \(\sigma _\alpha (t)\) of organizing neurons lattice structure. Our proposed methods are experimented on various biomedical datasets. The findings indicate that the proposed methods provide better quantization error for clustering and good classification accuracy with statistical measurement validations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Alcalá-Fdez J, Fernandez A, Luengo J, Derrac J, García S, Sánchez L, Herrera F (2011) KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. J Mult Valued Log Soft Comput 17(2–3):255–287 Alcalá-Fdez J, Fernandez A, Luengo J, Derrac J, García S, Sánchez L, Herrera F (2011) KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. J Mult Valued Log Soft Comput 17(2–3):255–287
Zurück zum Zitat Alia O, Mandava R (2011) The variants of the harmony search algorithm: an overview. Artif Intell Rev 36(1):49–68CrossRef Alia O, Mandava R (2011) The variants of the harmony search algorithm: an overview. Artif Intell Rev 36(1):49–68CrossRef
Zurück zum Zitat Amiri B, Hossain L, Mosavi SE (2010) Application of harmony search algorithm on clustering. In World congress on engineering and computer science, vols 1 and 2, pp 460–465 Amiri B, Hossain L, Mosavi SE (2010) Application of harmony search algorithm on clustering. In World congress on engineering and computer science, vols 1 and 2, pp 460–465
Zurück zum Zitat Beheshti Z, Shamsuddin SM (2013) A review of population-based meta-heuristic algorithms. Int J Adv Soft Comput Appl 5(1):1–35 Beheshti Z, Shamsuddin SM (2013) A review of population-based meta-heuristic algorithms. Int J Adv Soft Comput Appl 5(1):1–35
Zurück zum Zitat Beheshti Z, Shamsuddin SMH (2014) CAPSO: centripetal accelerated particle swarm optimization. Inf Sci 258:54–79MathSciNetCrossRef Beheshti Z, Shamsuddin SMH (2014) CAPSO: centripetal accelerated particle swarm optimization. Inf Sci 258:54–79MathSciNetCrossRef
Zurück zum Zitat Bahesti Z, Shamsuddin SM, Hasan S (2013) MPSO: median oriented particle swarm optimization. Appl Math Comput 219:5817–5836MathSciNetMATH Bahesti Z, Shamsuddin SM, Hasan S (2013) MPSO: median oriented particle swarm optimization. Appl Math Comput 219:5817–5836MathSciNetMATH
Zurück zum Zitat Beheshti Z, Shamsuddin SMH, Beheshti E, Yuhaniz SS (2014) Enhancement of artificial neural network learning using centripetal accelerated particle swarm optimization for medical diseases diagnosis. Soft Comput 18(11):2253–2270CrossRef Beheshti Z, Shamsuddin SMH, Beheshti E, Yuhaniz SS (2014) Enhancement of artificial neural network learning using centripetal accelerated particle swarm optimization for medical diseases diagnosis. Soft Comput 18(11):2253–2270CrossRef
Zurück zum Zitat Brabazon A, O’Neill M (2006) Biologically inspired algorithms for financial modeling. Springer, BerlinMATH Brabazon A, O’Neill M (2006) Biologically inspired algorithms for financial modeling. Springer, BerlinMATH
Zurück zum Zitat David HW, William GM (1997) No free lunch theorem for optimization. IEEE Trans Evolut Comput 1(1):67–82CrossRef David HW, William GM (1997) No free lunch theorem for optimization. IEEE Trans Evolut Comput 1(1):67–82CrossRef
Zurück zum Zitat Geem ZW (2009a) Particle-swarm harmony search for water network design. Eng Optim 41(4):297–311CrossRef Geem ZW (2009a) Particle-swarm harmony search for water network design. Eng Optim 41(4):297–311CrossRef
Zurück zum Zitat Geem ZW (2009b) Music inspired harmony search algorithm: theory and applications. Springer, New YorkCrossRef Geem ZW (2009b) Music inspired harmony search algorithm: theory and applications. Springer, New YorkCrossRef
Zurück zum Zitat Geem ZW, Kim JH, Loganathan GV (2001) A new heuristic optimization algorithm: harmony search. Simulation 76(2):60–68CrossRef Geem ZW, Kim JH, Loganathan GV (2001) A new heuristic optimization algorithm: harmony search. Simulation 76(2):60–68CrossRef
Zurück zum Zitat Hasan S (2010) Enhanced self-organizing map with particle swarm optimization for classification problems. Master thesis, Universiti Teknologi Malaysia Hasan S (2010) Enhanced self-organizing map with particle swarm optimization for classification problems. Master thesis, Universiti Teknologi Malaysia
Zurück zum Zitat Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice Hall, Upper Saddle RiverMATH Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice Hall, Upper Saddle RiverMATH
Zurück zum Zitat Jiming L, Tsui KC (2006) Toward nature-inspired computing. Commun ACM 49(10):59–64CrossRef Jiming L, Tsui KC (2006) Toward nature-inspired computing. Commun ACM 49(10):59–64CrossRef
Zurück zum Zitat Kattan A, Abdullah R, Salam RA (2010) Harmony search based supervised training of artificial neural networks. In: UKSim-AMSS first international conference on intelligent systems, modelling and simulation, pp 105–110 Kattan A, Abdullah R, Salam RA (2010) Harmony search based supervised training of artificial neural networks. In: UKSim-AMSS first international conference on intelligent systems, modelling and simulation, pp 105–110
Zurück zum Zitat Kennedy J, Eberhart (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural networks. IEEE Press, Piscataway, NJ, pp 1942–1948 Kennedy J, Eberhart (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural networks. IEEE Press, Piscataway, NJ, pp 1942–1948
Zurück zum Zitat Kennedy J, Eberhart RC, Shi Y (2001) Swarm intelligence. Morgan Kaufmann, San Francisco Kennedy J, Eberhart RC, Shi Y (2001) Swarm intelligence. Morgan Kaufmann, San Francisco
Zurück zum Zitat Kohonen T (2001) Self-organizing maps. Springer series in information sciences, vol 30, 3rd extended edition. Springer, Berlin Kohonen T (2001) Self-organizing maps. Springer series in information sciences, vol 30, 3rd extended edition. Springer, Berlin
Zurück zum Zitat Kulluk S, Ozbakir L, Baykasoglu A (2012) Training neural networks with harmony search algorithms for classification problems. Eng Appl Artif Intell 25(1):11–19CrossRef Kulluk S, Ozbakir L, Baykasoglu A (2012) Training neural networks with harmony search algorithms for classification problems. Eng Appl Artif Intell 25(1):11–19CrossRef
Zurück zum Zitat Lee Anzy, Geem Zong Woo, Suh Kyung-Duck (2016) Determination of optimal weights of an artificial neural networks by using the harmony search algorithm: application to breakwater armor stones. Appl Sci 6(164):1–17 Lee Anzy, Geem Zong Woo, Suh Kyung-Duck (2016) Determination of optimal weights of an artificial neural networks by using the harmony search algorithm: application to breakwater armor stones. Appl Sci 6(164):1–17
Zurück zum Zitat Mahdavi M, Fesanghary M, Damangir E (2007) An improved harmony search algorithm for solving optimization problems. Appl Math Comput 188(2):1567–1579MathSciNetMATH Mahdavi M, Fesanghary M, Damangir E (2007) An improved harmony search algorithm for solving optimization problems. Appl Math Comput 188(2):1567–1579MathSciNetMATH
Zurück zum Zitat Mahdavi M, Chehreghani MH, Abolhassani H, Forsati R (2008) Novel meta-heuristic algorithms for clustering web documents. Appl Math Comput 201(1–2):441–451MathSciNetMATH Mahdavi M, Chehreghani MH, Abolhassani H, Forsati R (2008) Novel meta-heuristic algorithms for clustering web documents. Appl Math Comput 201(1–2):441–451MathSciNetMATH
Zurück zum Zitat Michalski RS (1994) Machine learning: a multistrategy approach. In: Michalski RS, Tecuci G (eds) Inferential learning theory as conceptual basis for multistrategy learning, vol IV. Morgan Kaufmann Publishers, San Mateo Michalski RS (1994) Machine learning: a multistrategy approach. In: Michalski RS, Tecuci G (eds) Inferential learning theory as conceptual basis for multistrategy learning, vol IV. Morgan Kaufmann Publishers, San Mateo
Zurück zum Zitat Negnevitsky M (2005) Artificial intelligence: a guide to intelligent systems, 2nd edn. Addison Wesley, Harlow Negnevitsky M (2005) Artificial intelligence: a guide to intelligent systems, 2nd edn. Addison Wesley, Harlow
Zurück zum Zitat O’Neill M, Brabazon A (2008) Self-organising swarm (SOSwarm). Soft Comput 12(11):1073–1080CrossRef O’Neill M, Brabazon A (2008) Self-organising swarm (SOSwarm). Soft Comput 12(11):1073–1080CrossRef
Zurück zum Zitat Ozcift A, Kaya M, Gulten A, Karabulut M (2009) Swarm optimized organizing map (SWOM): a swarm intelligence based optimization of self-organizing map. Expert Syst Appl 36(7):10640–10648CrossRef Ozcift A, Kaya M, Gulten A, Karabulut M (2009) Swarm optimized organizing map (SWOM): a swarm intelligence based optimization of self-organizing map. Expert Syst Appl 36(7):10640–10648CrossRef
Zurück zum Zitat Pan Q-K, SuganthanM PN, Tasgetiren F, Liang JJ (2010) A self-adaptive global best harmony search algorithm for continuous optimization problems. Appl Math Comput 216(3):830–848MathSciNetMATH Pan Q-K, SuganthanM PN, Tasgetiren F, Liang JJ (2010) A self-adaptive global best harmony search algorithm for continuous optimization problems. Appl Math Comput 216(3):830–848MathSciNetMATH
Zurück zum Zitat Von der Malsburg C (1973) Self-organization of orientation sensitive cells in the striate cortex. Kybernetik 14:85–100CrossRef Von der Malsburg C (1973) Self-organization of orientation sensitive cells in the striate cortex. Kybernetik 14:85–100CrossRef
Zurück zum Zitat Xiao X, Dow ER, Eberhart R, Miled ZB, Oppelt RJ (2003) Gene-clustering using self-organizing maps and particle swarm optimization. IEEE international parallel and distributed processing symposium (IPDPS). IEEE Press Xiao X, Dow ER, Eberhart R, Miled ZB, Oppelt RJ (2003) Gene-clustering using self-organizing maps and particle swarm optimization. IEEE international parallel and distributed processing symposium (IPDPS). IEEE Press
Zurück zum Zitat Xiao X, Dow ER, Eberhart R, Miled ZB, Oppelt RJ (2004) A hybrid self-organizing maps and particle swarm optimization approach. Concurr Comput Pract Exp 16(9):895–915CrossRef Xiao X, Dow ER, Eberhart R, Miled ZB, Oppelt RJ (2004) A hybrid self-organizing maps and particle swarm optimization approach. Concurr Comput Pract Exp 16(9):895–915CrossRef
Zurück zum Zitat Yang XS (2009) Music-inspired Harmony search algorithm. In: Geem Z (ed) Harmony search as a metaheuristic algorithm. Springer, Berlin, pp 1–14 Yang XS (2009) Music-inspired Harmony search algorithm. In: Geem Z (ed) Harmony search as a metaheuristic algorithm. Springer, Berlin, pp 1–14
Zurück zum Zitat Yang XS (2010) Engineering optimization: an introduction with metaheuristic applications. Wiley, HobokenCrossRef Yang XS (2010) Engineering optimization: an introduction with metaheuristic applications. Wiley, HobokenCrossRef
Metadaten
Titel
Multi-strategy learning and deep harmony memory improvisation for self-organizing neurons
verfasst von
Shafaatunnur Hasan
Siti Mariyam Shamsuddin
Publikationsdatum
14.03.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 1/2019
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-018-3116-y

Weitere Artikel der Ausgabe 1/2019

Soft Computing 1/2019 Zur Ausgabe