Skip to main content
Erschienen in: The Journal of Supercomputing 2/2014

01.05.2014

Decentralized multi-attribute range search for resource discovery and load balancing

Erschienen in: The Journal of Supercomputing | Ausgabe 2/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The recent trend toward heterogeneity among, and even within, computers requires new expressiveness in the way resource descriptions are created, and new sophistication in systems that attempt to match jobs with resources. In this paper, we propose a novel resource discovery and load balancing method to support multi-attribute, range-based job constraints in a peer-to-peer grid system. The common approach of using simple attribute indexes does not suffice, as range-based constraints may be satisfied by more than a single value. We show via simulation that our approach matches these new heterogeneous jobs to heterogeneous resources both effectively (good matches are found, load is balanced) and efficiently (the new functionality imposes little overhead). Our system relies on resource descriptions being aggregated and periodically disseminated. Decentralized algorithms are often sensitive to the “freshness” of this information. However, we show that our approach is not sensitive to stale data, allowing the information movement to happen rarely enough that it imposes only insignificant overhead.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bharambe AR, Agrawal M, Seshan S (2004) Mercury: supporting scalable multi-attribute range queries. In: Proceedings of the ACM SIGCOMM Conference Bharambe AR, Agrawal M, Seshan S (2004) Mercury: supporting scalable multi-attribute range queries. In: Proceedings of the ACM SIGCOMM Conference
2.
Zurück zum Zitat Bloom BH (1970) Space/time trade-offs in hash coding with allowable errors. Commun ACM 13:422–426CrossRefMATH Bloom BH (1970) Space/time trade-offs in hash coding with allowable errors. Commun ACM 13:422–426CrossRefMATH
3.
Zurück zum Zitat Ganesan P, Yang B, Garcia-Molina H (2004) One torus rule them all: multi-dimensional queries in P2P systems. In: Proceedings of the 7th international workshop on web and databases Ganesan P, Yang B, Garcia-Molina H (2004) One torus rule them all: multi-dimensional queries in P2P systems. In: Proceedings of the 7th international workshop on web and databases
4.
Zurück zum Zitat Jagadish H, Ooi BC, Vu QH, Zhang R, Zhou A (2006) Vbi-tree: a peer-to-peer framework for supporting multi-dimensional indexing schemes. In: Proceedings of the 22nd international conference on data engineering, 2006. ICDE ’06, p 34. doi:10.1109/ICDE.2006.169 Jagadish H, Ooi BC, Vu QH, Zhang R, Zhou A (2006) Vbi-tree: a peer-to-peer framework for supporting multi-dimensional indexing schemes. In: Proceedings of the 22nd international conference on data engineering, 2006. ICDE ’06, p 34. doi:10.​1109/​ICDE.​2006.​169
5.
Zurück zum Zitat Kim JS, Keleher P, Marsh M, Bhattacharjee B, Sussman A (2007) Using content-addressable networks for load balancing in desktop grids. In: IEEE international symposium on high performance distributed computing (HPDC) Kim JS, Keleher P, Marsh M, Bhattacharjee B, Sussman A (2007) Using content-addressable networks for load balancing in desktop grids. In: IEEE international symposium on high performance distributed computing (HPDC)
6.
Zurück zum Zitat Kim JS, Nam B, Keleher P, Marsh M, Bhattacharjee B, Sussman A (2006) Resource discovery techniques in distributed desktop grid environments. In: Proceedings of the 7th IEEE/ACM international conference on grid computing-GRID 2006 Kim JS, Nam B, Keleher P, Marsh M, Bhattacharjee B, Sussman A (2006) Resource discovery techniques in distributed desktop grid environments. In: Proceedings of the 7th IEEE/ACM international conference on grid computing-GRID 2006
7.
Zurück zum Zitat Kim JS, Nam B, Marsh M, Keleher P, Bhattacharjee B, Sussman A (2008) Integrating categorical resource types into a P2P desktop grid system. In: Proceedings of the 9th IEEE/ACM international conference on grid computing (GRID 2008) Kim JS, Nam B, Marsh M, Keleher P, Bhattacharjee B, Sussman A (2008) Integrating categorical resource types into a P2P desktop grid system. In: Proceedings of the 9th IEEE/ACM international conference on grid computing (GRID 2008)
8.
Zurück zum Zitat Lawder J (2000) Calculation of mappings between one and n-dimensional values using the Hilbert space-filling curve. Tech. Rep. BBKCS-00-01, Birkbeck College Lawder J (2000) Calculation of mappings between one and n-dimensional values using the Hilbert space-filling curve. Tech. Rep. BBKCS-00-01, Birkbeck College
9.
Zurück zum Zitat Lee J, Keleher P, Sussman A (2010) Decentralized resource management for multi-core desktop grids. In: Proceedings of the 24th IEEE international parallel & distributed processing symposium Lee J, Keleher P, Sussman A (2010) Decentralized resource management for multi-core desktop grids. In: Proceedings of the 24th IEEE international parallel & distributed processing symposium
10.
Zurück zum Zitat Lee J, Keleher P, Sussman A (2011) Supporting computing element heterogeneity in p2p grids. In: 2011 IEEE international conference on cluster computing (CLUSTER), pp 150–158. doi:10.1109/CLUSTER.2011.25 Lee J, Keleher P, Sussman A (2011) Supporting computing element heterogeneity in p2p grids. In: 2011 IEEE international conference on cluster computing (CLUSTER), pp 150–158. doi:10.​1109/​CLUSTER.​2011.​25
11.
Zurück zum Zitat Li X, Kim YJ, Govindan R, Hong W (2003) Multi-dimensional range queries in sensor networks. In: Proceedings of the 1st international conference on embedded networked sensor systems, SenSys ’03. ACM, New York, pp 63–75. doi:10.1145/958491.958500 Li X, Kim YJ, Govindan R, Hong W (2003) Multi-dimensional range queries in sensor networks. In: Proceedings of the 1st international conference on embedded networked sensor systems, SenSys ’03. ACM, New York, pp 63–75. doi:10.​1145/​958491.​958500
12.
Zurück zum Zitat Maheswaran M, Ali S, Siegel HJ, Hensgen D, Freud RF (1999) Dynamic mapping of a class of independent tasks onto heterogeneous computing systems. J Parallel Distrib Comput 59(2) Maheswaran M, Ali S, Siegel HJ, Hensgen D, Freud RF (1999) Dynamic mapping of a class of independent tasks onto heterogeneous computing systems. J Parallel Distrib Comput 59(2)
13.
Zurück zum Zitat Nam B, Sussman A (2006) DiST: fully decentralized indexing for querying distributed multidimensional datasets. In: Proceedings of IPDPS 2006 Nam B, Sussman A (2006) DiST: fully decentralized indexing for querying distributed multidimensional datasets. In: Proceedings of IPDPS 2006
14.
Zurück zum Zitat Oppenheimer D, Albrecht J, Patterson D, Vahdat A (2005) Design and implementation tradeoffs for wide-area resource discovery. In: Proceedings 14th IEEE international symposium on high performance distributed computing, HPDC-14, pp 113–124. doi:10.1109/HPDC.2005.1520946 Oppenheimer D, Albrecht J, Patterson D, Vahdat A (2005) Design and implementation tradeoffs for wide-area resource discovery. In: Proceedings 14th IEEE international symposium on high performance distributed computing, HPDC-14, pp 113–124. doi:10.​1109/​HPDC.​2005.​1520946
15.
Zurück zum Zitat Ratnasamy S, Francis P, Handley M, Karp R, Shenker S (2001) A scalable content addressable network. In: Proceedings of the ACM SIGCOMM conference Ratnasamy S, Francis P, Handley M, Karp R, Shenker S (2001) A scalable content addressable network. In: Proceedings of the ACM SIGCOMM conference
16.
Zurück zum Zitat Rowstran A, Druschel P (2001) Pastry: scalable, distributed object location and routing for large-scale peer-to-peer systems. In: Proceedings of the 18th IFIP/ACM international conference on distributed systems platforms (Middleware 2001) Rowstran A, Druschel P (2001) Pastry: scalable, distributed object location and routing for large-scale peer-to-peer systems. In: Proceedings of the 18th IFIP/ACM international conference on distributed systems platforms (Middleware 2001)
17.
Zurück zum Zitat Sahin OD, Gulbeden A, Emekci F, Agrawal D, Abbadi AE (2005) Prism: indexing multi-dimensional data in p2p networks using reference vectors. In. In MULTIMEDIA ’05: Proceedings of the 13th annual ACM international conference on multimedia. ACM Press, New York, pp 946–955 Sahin OD, Gulbeden A, Emekci F, Agrawal D, Abbadi AE (2005) Prism: indexing multi-dimensional data in p2p networks using reference vectors. In. In MULTIMEDIA ’05: Proceedings of the 13th annual ACM international conference on multimedia. ACM Press, New York, pp 946–955
18.
Zurück zum Zitat Stoica I, Morris R, Karger D, Kaashoek MF, Balakrishnan H (2001) Chord: a scalable peer-to-peer lookup service for internet applications. In: Proceedings of the ACM SIGCOMM Conference Stoica I, Morris R, Karger D, Kaashoek MF, Balakrishnan H (2001) Chord: a scalable peer-to-peer lookup service for internet applications. In: Proceedings of the ACM SIGCOMM Conference
19.
Zurück zum Zitat Tang Y, Xu J, Zhou S, Lee W (2009) m-light: Indexing multi-dimensional data over dhts. In: 29th IEEE international conference on distributed computing systems, 2009. ICDCS ’09, pp 191–198. doi:10.1109/ICDCS.2009.30 Tang Y, Xu J, Zhou S, Lee W (2009) m-light: Indexing multi-dimensional data over dhts. In: 29th IEEE international conference on distributed computing systems, 2009. ICDCS ’09, pp 191–198. doi:10.​1109/​ICDCS.​2009.​30
21.
Zurück zum Zitat Vo HT, Chen C, Ooi BC (2010) Towards elastic transactional cloud storage with range query support. Proc VLDB Endow 3(1–2):506–514 Vo HT, Chen C, Ooi BC (2010) Towards elastic transactional cloud storage with range query support. Proc VLDB Endow 3(1–2):506–514
22.
Zurück zum Zitat Wang J, Wu S, Gao H, Li J, Ooi BC (2010) Indexing multi-dimensional data in a cloud system. In: Proceedings of the 2010 international conference on Management of data, SIGMOD ’10. ACM, New York, pp 591–602. doi:10.1145/1807167.1807232 Wang J, Wu S, Gao H, Li J, Ooi BC (2010) Indexing multi-dimensional data in a cloud system. In: Proceedings of the 2010 international conference on Management of data, SIGMOD ’10. ACM, New York, pp 591–602. doi:10.​1145/​1807167.​1807232
23.
Zurück zum Zitat Zhao BY, Huang L, Stribling J, Rhea SC, Joseph AD, Kubiatowicz JD (2004) Tapestry: a resilient global-scale overlay for service deployment. IEEE J Sel Areas Commun 22(1) Zhao BY, Huang L, Stribling J, Rhea SC, Joseph AD, Kubiatowicz JD (2004) Tapestry: a resilient global-scale overlay for service deployment. IEEE J Sel Areas Commun 22(1)
Metadaten
Titel
Decentralized multi-attribute range search for resource discovery and load balancing
Publikationsdatum
01.05.2014
Erschienen in
The Journal of Supercomputing / Ausgabe 2/2014
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-013-1071-z

Weitere Artikel der Ausgabe 2/2014

The Journal of Supercomputing 2/2014 Zur Ausgabe

Premium Partner