Skip to main content
Top
Published in: Cluster Computing 4/2019

22-02-2018

Configuration optimization method of Hadoop system performance based on genetic simulated annealing algorithm

Authors: Xiaoling Luo, Xueliang Fu

Published in: Cluster Computing | Special Issue 4/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The configuration optimization method of Hadoop system performance based on genetic simulated annealing algorithm is studied. In view of the performance of Hadoop on open source cloud computing platform, an optimization method is proposed. Based on the genetic simulated annealing algorithm, each configuration scheme is used as a chromosome for multiple selection, crossover and mutation. Combined with the principle of simulated annealing, the survival of the new chromosome and the number of iterations of the whole algorithm are controlled, and the optimal scheme of the system configuration is found. The experimental results show that the method can effectively improve the operation efficiency of the operation. In addition, the overall effect of the group is very good at the end of the iteration. When the job types in the system are similar, according to the characteristics that the whole simulated annealing algorithm is approaching the optimal solution, a real-time optimization configuration model is proposed on the basic of genetic simulated annealing algorithm.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Daneshmand, S.V., Heydari, H.: A diversified multiobjective simulated annealing and genetic algorithm for optimizing a three-phase hts transformer. IEEE Trans. Appl. Supercond. 26(2), 1–10 (2016)CrossRef Daneshmand, S.V., Heydari, H.: A diversified multiobjective simulated annealing and genetic algorithm for optimizing a three-phase hts transformer. IEEE Trans. Appl. Supercond. 26(2), 1–10 (2016)CrossRef
2.
go back to reference Garces, G.A., Rakotondranaivo, A., Bonjour, E.: Improving users’ product acceptability: an approach based on bayesian networks and a simulated annealing algorithm. Int. J. Prod. Res. 54(17), 1–18 (2016) Garces, G.A., Rakotondranaivo, A., Bonjour, E.: Improving users’ product acceptability: an approach based on bayesian networks and a simulated annealing algorithm. Int. J. Prod. Res. 54(17), 1–18 (2016)
3.
go back to reference Jiang, C., Yang, G., Zhu, P., Nishioka, M., Yokoyama, T., Zhou, C., et al.: Reconstruction of the vertical electron density profile based on vertical tec using the simulated annealing algorithm. Adv. Space Res. 57(10), 2167–2176 (2016)CrossRef Jiang, C., Yang, G., Zhu, P., Nishioka, M., Yokoyama, T., Zhou, C., et al.: Reconstruction of the vertical electron density profile based on vertical tec using the simulated annealing algorithm. Adv. Space Res. 57(10), 2167–2176 (2016)CrossRef
4.
go back to reference Raghu, T.S., Rajendran, C.: Due-date setting methodologies based on simulated annealingâ an experimental study in a real-life job shop. Int. J. Prod. Res. 33(9), 2535–2554 (2016)CrossRef Raghu, T.S., Rajendran, C.: Due-date setting methodologies based on simulated annealingâ an experimental study in a real-life job shop. Int. J. Prod. Res. 33(9), 2535–2554 (2016)CrossRef
5.
go back to reference Wei, W., Liu, A., Lu, C.Y., Wuest, T.: Product requirement modeling and optimization method based on product configuration design. Procedia Cirp 36(45), 1–5 (2015)CrossRef Wei, W., Liu, A., Lu, C.Y., Wuest, T.: Product requirement modeling and optimization method based on product configuration design. Procedia Cirp 36(45), 1–5 (2015)CrossRef
6.
go back to reference Yiu, K.F.C., Tam, K.Y., Tsang, S.C.: Crystal indexing method using a simulated annealing algorithm with particular applications in nanocrystal research. J. Comput. Chem. 18(2), 290–299 (2015)CrossRef Yiu, K.F.C., Tam, K.Y., Tsang, S.C.: Crystal indexing method using a simulated annealing algorithm with particular applications in nanocrystal research. J. Comput. Chem. 18(2), 290–299 (2015)CrossRef
7.
go back to reference Daud, S., Chaudary, K.T., Bahadoran, M., Ali, J.: Z-transform method for optimization of add-drop configuration system. Jurnal Teknologi 74(8), 101–105 (2015)CrossRef Daud, S., Chaudary, K.T., Bahadoran, M., Ali, J.: Z-transform method for optimization of add-drop configuration system. Jurnal Teknologi 74(8), 101–105 (2015)CrossRef
8.
go back to reference Dauzère-Pérès, S., Paulli, J.: An integrated approach for modeling and solving the general multiprocessor job-shop scheduling problem using tabu search. Ann. Oper. Res. 70(1), 281–306 (2016)MathSciNetMATH Dauzère-Pérès, S., Paulli, J.: An integrated approach for modeling and solving the general multiprocessor job-shop scheduling problem using tabu search. Ann. Oper. Res. 70(1), 281–306 (2016)MathSciNetMATH
9.
go back to reference Dowling, D., Krishnamoorthy, M., Mackenzie, H., Sier, D.: Staff rostering at a large international airport. Ann. Oper. Res. 72(72), 125–147 (2016)MATH Dowling, D., Krishnamoorthy, M., Mackenzie, H., Sier, D.: Staff rostering at a large international airport. Ann. Oper. Res. 72(72), 125–147 (2016)MATH
10.
go back to reference Mirjalili, S.: How effective is the grey wolf optimizer in training multi-layer perceptrons. Appl. Intell. 43(1), 150–161 (2015)CrossRef Mirjalili, S.: How effective is the grey wolf optimizer in training multi-layer perceptrons. Appl. Intell. 43(1), 150–161 (2015)CrossRef
Metadata
Title
Configuration optimization method of Hadoop system performance based on genetic simulated annealing algorithm
Authors
Xiaoling Luo
Xueliang Fu
Publication date
22-02-2018
Publisher
Springer US
Published in
Cluster Computing / Issue Special Issue 4/2019
Print ISSN: 1386-7857
Electronic ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-018-2029-y

Other articles of this Special Issue 4/2019

Cluster Computing 4/2019 Go to the issue

Premium Partner