Skip to main content
Top
Published in: Peer-to-Peer Networking and Applications 4/2009

01-12-2009

Gossiping protocols for hybrid grid resource scheduling

Authors: Değer Cenk Erdil, Michael J. Lewis

Published in: Peer-to-Peer Networking and Applications | Issue 4/2009

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Grid resource providers can use gossiping to disseminate their available resource state to remote regions of the grid to attract application load. Pairwise gossiping protocols exchange information about limited subsets of other resources between pairs of potentially remote participants. In epidemic gossiping protocols, the provider disseminates information to multiple neighbors, who in turn forward it to their neighbors, and so on. One important metric for these protocols is their coverage, which characterizes how many and which resources receive the information. Coverage characteristics of epidemic protocols are non-uniform, concentrated within the vicinity of a disseminating node; they can exhibit bi-modal behavior where information either reaches distant nodes or dies out quickly. Pairwise gossiping protocols, on the other hand, provide a more uniform coverage, but it can take longer for the dissemination to reach desired uniformity. In this paper, we study performance characteristics of three gossiping protocols: (1) epidemic gossiping, (2) pairwise gossiping, and (3) adaptive information dissemination (which is based on a form of epidemic gossiping). We report experimental results based on our simulation framework that compare the three protocols in terms of packet overhead and query satisfaction rates. We show that pairwise gossiping protocols work best when resource distribution on the grid is uniform, and that they can be configured to perform well in support of grid scheduling. We also verify this behavior under typical node failures of real-world production grids.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
For the [3, 4] case, the requester neighborhood is actually a single neighborhood of size 12.
 
2
With 8% node failures in static epidemic gossiping protocol with P i  = 0.2 in the third row of Table 5.
 
3
With 8% node failures in static epidemic gossiping protocol with P i  = 0.2 in the third row of Table 7.
 
Literature
1.
go back to reference Abu-Ghazaleh N, Lewis MJ (2006) Short paper: toward self organizing grids. In: Proceedings of the 15th IEEE international symposium on high performance distributed computing (Hot Topics Session) Abu-Ghazaleh N, Lewis MJ (2006) Short paper: toward self organizing grids. In: Proceedings of the 15th IEEE international symposium on high performance distributed computing (Hot Topics Session)
2.
go back to reference Anderson DP (2004) Boinc: a system for public-resource computing and storage. In: 5th IEEE/ACM international workshop on grid computing Anderson DP (2004) Boinc: a system for public-resource computing and storage. In: 5th IEEE/ACM international workshop on grid computing
3.
go back to reference Cowie J, Liu H, Liu J, Nicol D, Ogielski A (1999) Towards realistic million-node internet simulations. In: Proceedings of the international conference on parallel and distributed processing techniques and applications Cowie J, Liu H, Liu J, Nicol D, Ogielski A (1999) Towards realistic million-node internet simulations. In: Proceedings of the international conference on parallel and distributed processing techniques and applications
4.
go back to reference Demers A, Greene D, Hauser C, Irish W, Larson J, Shenker S, Sturgis H, Swinehart D, Terry D (1987) Epidemic algorithms for replicated database maintenance. In: PODC ’87: proceedings of the sixth annual acm symposium on principles of distributed computing. ACM, New York, pp 1–12 Demers A, Greene D, Hauser C, Irish W, Larson J, Shenker S, Sturgis H, Swinehart D, Terry D (1987) Epidemic algorithms for replicated database maintenance. In: PODC ’87: proceedings of the sixth annual acm symposium on principles of distributed computing. ACM, New York, pp 1–12
5.
go back to reference Desai R, Tilak S, Gandhi B, Lewis MJ, Abu-Ghazaleh NB (2006) Analysis of query matching criteria and resource monitoring for grid application scheduling. In: Proceedings of CCGrid2006: IEEE international symposium on cluster computing and the grid Desai R, Tilak S, Gandhi B, Lewis MJ, Abu-Ghazaleh NB (2006) Analysis of query matching criteria and resource monitoring for grid application scheduling. In: Proceedings of CCGrid2006: IEEE international symposium on cluster computing and the grid
6.
go back to reference Drost N, Ogston E, van Nieuwpoort RV, Bal HE (2007) Arrg: real-world gossiping. In: Proceedings of the 16th IEEE international symposium on high performance distributed computing Drost N, Ogston E, van Nieuwpoort RV, Bal HE (2007) Arrg: real-world gossiping. In: Proceedings of the 16th IEEE international symposium on high performance distributed computing
7.
go back to reference Erdil DC, Lewis MJ, Abu-Ghazaleh NB (2006) An adaptive algorithm for information dissemination in self-organizing grids. In: Proceedings of the 2nd IEEE international conference on e-Science and grid computing (eScience 2006), Amsterdam, 4–6 December 2006 Erdil DC, Lewis MJ, Abu-Ghazaleh NB (2006) An adaptive algorithm for information dissemination in self-organizing grids. In: Proceedings of the 2nd IEEE international conference on e-Science and grid computing (eScience 2006), Amsterdam, 4–6 December 2006
8.
go back to reference Erdil DC, Lewis MJ, Abu-Ghazaleh NB (2007) Proxy-based grid information dissemination. In: Proceedings of the workshop on large-scale and volatile desktop grids (PCGrid2007) (in conjunction with IPDPS2007), Long Beach, March 2007 Erdil DC, Lewis MJ, Abu-Ghazaleh NB (2007) Proxy-based grid information dissemination. In: Proceedings of the workshop on large-scale and volatile desktop grids (PCGrid2007) (in conjunction with IPDPS2007), Long Beach, March 2007
9.
go back to reference Erdil DC, Lewis MJ, Abu-Ghazaleh NB (2006) An adaptive approach to information dissemination in self-organizing grids. In: Proceedings of the international conference on autonomic and autonomous systems (ICAS’06), Silicon Valley, July 2006 Erdil DC, Lewis MJ, Abu-Ghazaleh NB (2006) An adaptive approach to information dissemination in self-organizing grids. In: Proceedings of the international conference on autonomic and autonomous systems (ICAS’06), Silicon Valley, July 2006
10.
go back to reference Eugster PT, Guerraoui R, Kermarrec A-M, Massoulie L (2003) From epidemics to distributed computing. IEEE Computer 21(4) Eugster PT, Guerraoui R, Kermarrec A-M, Massoulie L (2003) From epidemics to distributed computing. IEEE Computer 21(4)
11.
go back to reference Gandhi B, Tilak S, Lewis MJ, Abu-Ghazaleh NB (2005) Controlling the coverage of grid information dissemination protocols. In: Proceedings of IEEE NCA05: the 4th IEEE international symposium on network computing and applications Gandhi B, Tilak S, Lewis MJ, Abu-Ghazaleh NB (2005) Controlling the coverage of grid information dissemination protocols. In: Proceedings of IEEE NCA05: the 4th IEEE international symposium on network computing and applications
14.
go back to reference Iyengar V, Tilak S, Abu-Ghazaleh NB, Lewis MJ (2004) Nonuniform information dissemination for dynamic grid resource discovery. In: Proceedings of IEEE NCA04: the 3rd IEEE international symposium on network computing and applications Iyengar V, Tilak S, Abu-Ghazaleh NB, Lewis MJ (2004) Nonuniform information dissemination for dynamic grid resource discovery. In: Proceedings of IEEE NCA04: the 3rd IEEE international symposium on network computing and applications
15.
go back to reference Kempe D, Kleinberg J, Demers A (2001) Spatial gossip and resource location protocols. In: Annual ACM symposium on theory of computing (STOC) Kempe D, Kleinberg J, Demers A (2001) Spatial gossip and resource location protocols. In: Annual ACM symposium on theory of computing (STOC)
16.
go back to reference Kermarrec A-M, Massoulie L, Ganesh AJ (2003) Probabilistic reliable dissemination in large-scale systems. IEEE Trans Parallel Distrib Syst 14:248–258CrossRef Kermarrec A-M, Massoulie L, Ganesh AJ (2003) Probabilistic reliable dissemination in large-scale systems. IEEE Trans Parallel Distrib Syst 14:248–258CrossRef
17.
go back to reference Kondo D, Taufer M, Brooks III CL, Casanova H, Chien AA (2004) Characterizing and evaluating desktop grids: an empirical study. In: Proceedings of the 18th international parallel and distributed processing symposium (IPDPS’04), April 2004 Kondo D, Taufer M, Brooks III CL, Casanova H, Chien AA (2004) Characterizing and evaluating desktop grids: an empirical study. In: Proceedings of the 18th international parallel and distributed processing symposium (IPDPS’04), April 2004
18.
go back to reference Li H, Groep D, Wolters L, Templon J (2006) Job failure analysis and its implications in a large-scale production grid. In: Proceedings of the 2nd IEEE international conference on e-Science and grid computing (e-Science’06), Amsterdam, December 2006 Li H, Groep D, Wolters L, Templon J (2006) Job failure analysis and its implications in a large-scale production grid. In: Proceedings of the 2nd IEEE international conference on e-Science and grid computing (e-Science’06), Amsterdam, December 2006
19.
go back to reference Li L, Halpern J, Haas Z (2002) Gossip-based ad hoc routing. IEEE Infocom Li L, Halpern J, Haas Z (2002) Gossip-based ad hoc routing. IEEE Infocom
20.
go back to reference Voulgaris S, Gavidia D, Steen M (2005) Cyclon: inexpensive membership management for unstructured p2p overlays. J Netw Syst Manage 13(2):197–217CrossRef Voulgaris S, Gavidia D, Steen M (2005) Cyclon: inexpensive membership management for unstructured p2p overlays. J Netw Syst Manage 13(2):197–217CrossRef
Metadata
Title
Gossiping protocols for hybrid grid resource scheduling
Authors
Değer Cenk Erdil
Michael J. Lewis
Publication date
01-12-2009
Publisher
Springer US
Published in
Peer-to-Peer Networking and Applications / Issue 4/2009
Print ISSN: 1936-6442
Electronic ISSN: 1936-6450
DOI
https://doi.org/10.1007/s12083-009-0028-8

Other articles of this Issue 4/2009

Peer-to-Peer Networking and Applications 4/2009 Go to the issue

Premium Partner