Skip to main content
Erschienen in: Cluster Computing 4/2015

01.12.2015

An effective game theoretic static load balancing applied to distributed computing

verfasst von: Hajar Siar, Kourosh Kiani, Anthony T. Chronopoulos

Erschienen in: Cluster Computing | Ausgabe 4/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper an algorithm has been proposed to balance the loads in a distributed computing system based on game theory which models the load balancing problem as a non-cooperative game among the users. The proposed load balancing game, which is infinite and with perfect information, aims to establish fairness both in system and user level. The optimal or near-optimal solution of the game is approximated by a genetic algorithm and an introduced hybrid population-based simulated annealing algorithm, using the concept of Nash equilibrium. Since all users responses are shown to converge to their near-optimal solution, distribution of users’ jobs is “fair”. Simulations demonstrate near-optimality of the proposed algorithms in terms of makespan and fairness for the proposed load balancing scheme.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Silberschatz, A., Galvin, P.B., Gagne, G.: Operating System Concepts, vol. 8. Wiley, New York (2013) Silberschatz, A., Galvin, P.B., Gagne, G.: Operating System Concepts, vol. 8. Wiley, New York (2013)
2.
Zurück zum Zitat Penmatsa, S., Chronopoulos, A.T.: Game-theoretic static load balancing for distributed systems. J. Parallel Distrib. Comput. 71, 537–555 (2011)CrossRef Penmatsa, S., Chronopoulos, A.T.: Game-theoretic static load balancing for distributed systems. J. Parallel Distrib. Comput. 71, 537–555 (2011)CrossRef
3.
Zurück zum Zitat Tanenbaum, A., Van Steen, M.: Distributed Systems. Pearson Prentice Hall, Upper Saddle River (2007) Tanenbaum, A., Van Steen, M.: Distributed Systems. Pearson Prentice Hall, Upper Saddle River (2007)
4.
Zurück zum Zitat Stallings, W., Paul, G.K., Manna, M.M.: Operating Systems: Internals and Design Principles, vol. 3. Prentice Hall, Upper Saddle River (1998) Stallings, W., Paul, G.K., Manna, M.M.: Operating Systems: Internals and Design Principles, vol. 3. Prentice Hall, Upper Saddle River (1998)
5.
Zurück zum Zitat Eftekhari, N., Zeinalabedin, F.H., Haghighat, A.T.: A novel threshold-based dynamic load balancing algorithm using mobile agent in distributed system. In: Computational Intelligence and Information Technology, pp. 103–109. Springer, Berlin (2011) Eftekhari, N., Zeinalabedin, F.H., Haghighat, A.T.: A novel threshold-based dynamic load balancing algorithm using mobile agent in distributed system. In: Computational Intelligence and Information Technology, pp. 103–109. Springer, Berlin (2011)
6.
Zurück zum Zitat Li, Y., Yang, Y., Ma, M., Zhou, L.: A hybrid load balancing strategy of sequential tasks for grid computing environments. Future Gen. Comput. Syst. 25, 819–828 (2009)CrossRef Li, Y., Yang, Y., Ma, M., Zhou, L.: A hybrid load balancing strategy of sequential tasks for grid computing environments. Future Gen. Comput. Syst. 25, 819–828 (2009)CrossRef
7.
Zurück zum Zitat Penmatsa, S., Chronopoulos, A.T.: Cooperative load balancing for a network of heterogeneous computers. In: 20th International Parallel and Distributed Processing Symposium, 2006 (IPDPS 2006), p. 8 (2006) Penmatsa, S., Chronopoulos, A.T.: Cooperative load balancing for a network of heterogeneous computers. In: 20th International Parallel and Distributed Processing Symposium, 2006 (IPDPS 2006), p. 8 (2006)
8.
Zurück zum Zitat Chonggun, K., Kameda, H.: Optimal static load balancing of multi-class jobs in a distributed computer system. IEICE Trans. 1976–1990(73), 1207–1214 (1990) Chonggun, K., Kameda, H.: Optimal static load balancing of multi-class jobs in a distributed computer system. IEICE Trans. 1976–1990(73), 1207–1214 (1990)
9.
Zurück zum Zitat Zomaya, A.Y., Teh, Y.-H.: Observations on using genetic algorithms for dynamic load-balancing. IEEE Trans. Parallel Distrib. Syst. 12, 899–911 (2001)CrossRef Zomaya, A.Y., Teh, Y.-H.: Observations on using genetic algorithms for dynamic load-balancing. IEEE Trans. Parallel Distrib. Syst. 12, 899–911 (2001)CrossRef
10.
Zurück zum Zitat Okhovvat, M., Sharifi, M., Momeni, H.: Task allocation to actors in wireless sensor actor networks: an energy and time aware technique. Procedia Comput. Sci. 3, 484–490 (2011)CrossRef Okhovvat, M., Sharifi, M., Momeni, H.: Task allocation to actors in wireless sensor actor networks: an energy and time aware technique. Procedia Comput. Sci. 3, 484–490 (2011)CrossRef
11.
Zurück zum Zitat Meyerson, A., Roytman, A., Tagiku, B.: Online multidimensional load balancing. In: Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques, pp. 287–302. Springer, Berlin (2013) Meyerson, A., Roytman, A., Tagiku, B.: Online multidimensional load balancing. In: Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques, pp. 287–302. Springer, Berlin (2013)
12.
Zurück zum Zitat Jain, R., Chiu, D.-M., Hawe, W.: A quantitative measure of fairness and discrimination for resource allocation in shared computer systems. Computing Research Repository, vol. cs.NI/9809 (1998) Jain, R., Chiu, D.-M., Hawe, W.: A quantitative measure of fairness and discrimination for resource allocation in shared computer systems. Computing Research Repository, vol. cs.NI/9809 (1998)
13.
Zurück zum Zitat Drozdowski, M.: Selected problems of scheduling tasks in multiprocessor computer systems. Citeseer (1997) Drozdowski, M.: Selected problems of scheduling tasks in multiprocessor computer systems. Citeseer (1997)
14.
Zurück zum Zitat Bharadwaj, V., Ghose, D., Robertazzi, T.G.: Divisible load theory: a new paradigm for load scheduling in distributed systems. Clust. Comput. 6, 7–17 (2003)CrossRef Bharadwaj, V., Ghose, D., Robertazzi, T.G.: Divisible load theory: a new paradigm for load scheduling in distributed systems. Clust. Comput. 6, 7–17 (2003)CrossRef
15.
Zurück zum Zitat Bharadwaj, V., Barlas, G.: Scheduling divisible loads with processor release times and finite size buffer capacity constraints in bus networks. Clust. Comput. 6, 63–74 (2003)CrossRef Bharadwaj, V., Barlas, G.: Scheduling divisible loads with processor release times and finite size buffer capacity constraints in bus networks. Clust. Comput. 6, 63–74 (2003)CrossRef
16.
Zurück zum Zitat Veeravalli, B., Ghose, D., Mani, V., Robertazzi, T.G.: Scheduling Divisible Loads in Parallel and Distributed Systems. IEEE Computer Society Press, Los Almitos (1996) Veeravalli, B., Ghose, D., Mani, V., Robertazzi, T.G.: Scheduling Divisible Loads in Parallel and Distributed Systems. IEEE Computer Society Press, Los Almitos (1996)
17.
Zurück zum Zitat Nisan, N., Roughgarden, T., Tardos, E., Vazirani, V.V.: Algorithmic Game Theory, vol. 1. Cambridge University Press, Cambridge (2007) Nisan, N., Roughgarden, T., Tardos, E., Vazirani, V.V.: Algorithmic Game Theory, vol. 1. Cambridge University Press, Cambridge (2007)
18.
Zurück zum Zitat Osborne, M.J., Rubinstein, A.: A Course in Game Theory. MIT Press, Cambridge (1994) Osborne, M.J., Rubinstein, A.: A Course in Game Theory. MIT Press, Cambridge (1994)
19.
Zurück zum Zitat Fudenberg, D., Tirole, J.: Game Theory, vol. 393. Cambridge (1991) Fudenberg, D., Tirole, J.: Game Theory, vol. 393. Cambridge (1991)
20.
Zurück zum Zitat Fudenberg, D.: The Theory of Learning in Games, vol. 2. MIT Press, Cambridge (1998) Fudenberg, D.: The Theory of Learning in Games, vol. 2. MIT Press, Cambridge (1998)
21.
Zurück zum Zitat Shamshirband, S., Patel, A., Anuar, N.B., Kiah, M.L.M., Abraham, A.: Cooperative game theoretic approach using fuzzy Q-learning for detecting and preventing intrusions in wireless sensor networks. Eng. Appl. Artif. Intell. 32, 228–241 (2014)CrossRef Shamshirband, S., Patel, A., Anuar, N.B., Kiah, M.L.M., Abraham, A.: Cooperative game theoretic approach using fuzzy Q-learning for detecting and preventing intrusions in wireless sensor networks. Eng. Appl. Artif. Intell. 32, 228–241 (2014)CrossRef
22.
Zurück zum Zitat Charilas, D.E., Panagopoulos, A.D.: A survey on game theory applications in wireless networks. Comput. Netw. 54, 3421–3430 (2010)CrossRef Charilas, D.E., Panagopoulos, A.D.: A survey on game theory applications in wireless networks. Comput. Netw. 54, 3421–3430 (2010)CrossRef
23.
Zurück zum Zitat Rzadca, K., Trystram, D.: Promoting cooperation in selfish computational grids. Eur. J. Oper. Res. 199, 647–657 (2009)MathSciNetCrossRef Rzadca, K., Trystram, D.: Promoting cooperation in selfish computational grids. Eur. J. Oper. Res. 199, 647–657 (2009)MathSciNetCrossRef
24.
Zurück zum Zitat Kołodziej, J., Xhafa, F.: Meeting security and user behavior requirements in Grid scheduling. Simul. Model. Pract. Theory 19, 213–226 (2011)CrossRef Kołodziej, J., Xhafa, F.: Meeting security and user behavior requirements in Grid scheduling. Simul. Model. Pract. Theory 19, 213–226 (2011)CrossRef
25.
Zurück zum Zitat Grosu, D., Chronopoulos, A.T.: Noncooperative load balancing in distributed systems. J. Parallel Distrib. Comput. 65, 1022–1034 (2005)CrossRef Grosu, D., Chronopoulos, A.T.: Noncooperative load balancing in distributed systems. J. Parallel Distrib. Comput. 65, 1022–1034 (2005)CrossRef
26.
Zurück zum Zitat Grosu, D., Chronopoulos, A.T., Leung, M.-Y.: Cooperative load balancing in distributed systems. Concurr. Comput. Pract. Exp. 20, 1953–1976 (2008)CrossRef Grosu, D., Chronopoulos, A.T., Leung, M.-Y.: Cooperative load balancing in distributed systems. Concurr. Comput. Pract. Exp. 20, 1953–1976 (2008)CrossRef
27.
Zurück zum Zitat Schmidt, C.: Game Theory and Economic Analysis: A Quiet Revolution in Economics. Routledge, Lodnon (2003) Schmidt, C.: Game Theory and Economic Analysis: A Quiet Revolution in Economics. Routledge, Lodnon (2003)
28.
Zurück zum Zitat Pendharkar, P.C.: Game theoretical applications for multi-agent systems. Expert Syst. Appl. 39, 273–279 (2012)CrossRef Pendharkar, P.C.: Game theoretical applications for multi-agent systems. Expert Syst. Appl. 39, 273–279 (2012)CrossRef
29.
Zurück zum Zitat Chana, I.: Bacterial foraging based hyper-heuristic for resource scheduling in grid computing. Future Gen. Comput. Syst. 29, 751–762 (2013)CrossRef Chana, I.: Bacterial foraging based hyper-heuristic for resource scheduling in grid computing. Future Gen. Comput. Syst. 29, 751–762 (2013)CrossRef
30.
Zurück zum Zitat Mani, V., Suresh, S., Kim, H.: Real-coded genetic algorithms for optimal static load balancing in distributed computing system with communication delays. In Computational Science and Its Applications—ICCSA 2005, pp. 269–279. Springer, Berlin (2005) Mani, V., Suresh, S., Kim, H.: Real-coded genetic algorithms for optimal static load balancing in distributed computing system with communication delays. In Computational Science and Its Applications—ICCSA 2005, pp. 269–279. Springer, Berlin (2005)
32.
Zurück zum Zitat Chen, B., Latifi, S.: Traffic load monitoring and load balancing for the Internet. Clust. Comput. 3, 139–150 (2000)CrossRef Chen, B., Latifi, S.: Traffic load monitoring and load balancing for the Internet. Clust. Comput. 3, 139–150 (2000)CrossRef
34.
Zurück zum Zitat Buyya, R., Yeo, C.S., Venugopal, S.: Market-oriented cloud computing: vision, hype, and reality for delivering it services as computing utilities. In: 10th IEEE International Conference on High Performance Computing and Communications, 2008 (HPCC’08), pp. 5–13 (2008) Buyya, R., Yeo, C.S., Venugopal, S.: Market-oriented cloud computing: vision, hype, and reality for delivering it services as computing utilities. In: 10th IEEE International Conference on High Performance Computing and Communications, 2008 (HPCC’08), pp. 5–13 (2008)
35.
Zurück zum Zitat Goldenberg, D.: Genetic Algorithms in Search, Optimisation and Machine Learning. Adisson Wesley, Reading (1989) Goldenberg, D.: Genetic Algorithms in Search, Optimisation and Machine Learning. Adisson Wesley, Reading (1989)
36.
Zurück zum Zitat Simon, D.: Evolutionary Optimization Algorithms. Wiley, New York (2013) Simon, D.: Evolutionary Optimization Algorithms. Wiley, New York (2013)
37.
38.
Zurück zum Zitat Williams, A., Arlitt, M., Williamson, C., Barker, K.: Web workload characterization: ten years later. In: Web Content Delivery, pp. 3–21. Springer, Berlin (2005) Williams, A., Arlitt, M., Williamson, C., Barker, K.: Web workload characterization: ten years later. In: Web Content Delivery, pp. 3–21. Springer, Berlin (2005)
39.
Zurück zum Zitat Nozaki, S.A., Ross, S.M.: Approximations in finite-capacity multi-server queues with Poisson arrivals. J. Appl. Probab. 15, 826–834 (1978) Nozaki, S.A., Ross, S.M.: Approximations in finite-capacity multi-server queues with Poisson arrivals. J. Appl. Probab. 15, 826–834 (1978)
40.
Zurück zum Zitat Kleinrock, L.: Queueing Systems. Wiley, New York (1975) Kleinrock, L.: Queueing Systems. Wiley, New York (1975)
41.
Zurück zum Zitat Tantawi, A.N., Towsley, D.: Optimal static load balancing in distributed computer systems. J. ACM 32, 445–465 (1985)MathSciNetCrossRef Tantawi, A.N., Towsley, D.: Optimal static load balancing in distributed computer systems. J. ACM 32, 445–465 (1985)MathSciNetCrossRef
42.
Zurück zum Zitat Jain, R.: The Art of Computer Systems Performance Analysis. Wiley, New York (2008) Jain, R.: The Art of Computer Systems Performance Analysis. Wiley, New York (2008)
43.
Zurück zum Zitat Iosup, A., Ostermann, S., Yigitbasi, M.N., Prodan, R., Fahringer, T., Epema, D.H.: Performance analysis of cloud computing services for many-tasks scientific computing. IEEE Trans. Parallel Distrib. Syst. 22, 931–945 (2011)CrossRef Iosup, A., Ostermann, S., Yigitbasi, M.N., Prodan, R., Fahringer, T., Epema, D.H.: Performance analysis of cloud computing services for many-tasks scientific computing. IEEE Trans. Parallel Distrib. Syst. 22, 931–945 (2011)CrossRef
44.
Zurück zum Zitat Evangelinos, C., Hill, C.: Cloud computing for parallel scientific HPC applications: feasibility of running coupled atmosphere-ocean climate models on Amazon’s EC2. Ratio 2, 2–34 (2008) Evangelinos, C., Hill, C.: Cloud computing for parallel scientific HPC applications: feasibility of running coupled atmosphere-ocean climate models on Amazon’s EC2. Ratio 2, 2–34 (2008)
45.
Zurück zum Zitat Ekanayake, J., Fox, G.: High performance parallel computing with clouds and cloud technologies. In: Cloud Computing, pp. 20–38. Springer, Berlin (2010) Ekanayake, J., Fox, G.: High performance parallel computing with clouds and cloud technologies. In: Cloud Computing, pp. 20–38. Springer, Berlin (2010)
47.
Zurück zum Zitat Tang, X., Chanson, S.T.: Optimizing static job scheduling in a network of heterogeneous computers. In: Proceedings of the 2000 International Conference on Parallel Processing, pp. 373–382 (2000) Tang, X., Chanson, S.T.: Optimizing static job scheduling in a network of heterogeneous computers. In: Proceedings of the 2000 International Conference on Parallel Processing, pp. 373–382 (2000)
48.
Zurück zum Zitat Riechmann, T.: Genetic algorithm learning and evolutionary games. J. Econ. Dyn. Control 25, 1019–1037 (2001)CrossRef Riechmann, T.: Genetic algorithm learning and evolutionary games. J. Econ. Dyn. Control 25, 1019–1037 (2001)CrossRef
49.
Zurück zum Zitat Protopapas, M.K., Kosmatopoulos, E.B.: Determination of sequential best replies in n-player games by Genetic Algorithms. Int. J. Appl. Math. Comput. Sci. 5, 19–24 (2009) Protopapas, M.K., Kosmatopoulos, E.B.: Determination of sequential best replies in n-player games by Genetic Algorithms. Int. J. Appl. Math. Comput. Sci. 5, 19–24 (2009)
50.
Zurück zum Zitat Sefrioui, M., Perlaux, J.: Nash genetic algorithms: examples and applications. In: Proceedings of the 2000 Congress on Evolutionary Computation, pp. 509–516 (2000) Sefrioui, M., Perlaux, J.: Nash genetic algorithms: examples and applications. In: Proceedings of the 2000 Congress on Evolutionary Computation, pp. 509–516 (2000)
51.
Zurück zum Zitat Vorobeychik, Y., Wellman, M.P.: Stochastic search methods for Nash equilibrium approximation in simulation-based games. In: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, vol. 2, pp. 1055–1062 (2008) Vorobeychik, Y., Wellman, M.P.: Stochastic search methods for Nash equilibrium approximation in simulation-based games. In: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, vol. 2, pp. 1055–1062 (2008)
52.
Zurück zum Zitat Holland, J.H.: Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. Uinversity of Michigan Press (1975) Holland, J.H.: Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. Uinversity of Michigan Press (1975)
53.
Zurück zum Zitat Aboutalebi, M., Siar, H., Javadi, H.H.S.: Static task scheduling in homogeneous multiprocessor systems based on genetic algorithm. In: International Conference on Software Technology and Engineering (ICSTE) (2009) Aboutalebi, M., Siar, H., Javadi, H.H.S.: Static task scheduling in homogeneous multiprocessor systems based on genetic algorithm. In: International Conference on Software Technology and Engineering (ICSTE) (2009)
54.
Zurück zum Zitat Bertsimas, D., Tsitsiklis, J.: Simulated annealing. Stat. Sci. 8, 10–15 (1993)CrossRef Bertsimas, D., Tsitsiklis, J.: Simulated annealing. Stat. Sci. 8, 10–15 (1993)CrossRef
55.
Zurück zum Zitat Černý, V.: Thermodynamical approach to the traveling salesman problem: an efficient simulation algorithm. J. Optim. Theory Appl. 45, 41–51 (1985)MathSciNetCrossRef Černý, V.: Thermodynamical approach to the traveling salesman problem: an efficient simulation algorithm. J. Optim. Theory Appl. 45, 41–51 (1985)MathSciNetCrossRef
Metadaten
Titel
An effective game theoretic static load balancing applied to distributed computing
verfasst von
Hajar Siar
Kourosh Kiani
Anthony T. Chronopoulos
Publikationsdatum
01.12.2015
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 4/2015
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-015-0486-0

Weitere Artikel der Ausgabe 4/2015

Cluster Computing 4/2015 Zur Ausgabe

Premium Partner