Skip to main content
Top

2015 | OriginalPaper | Chapter

SDDS Based Hierarchical DHT Systems for an Efficient Resource Discovery in Data Grid Systems

Authors : Riad Mokadem, Franck Morvan, Abdelkader Hameurlain

Published in: The Semantic Web: ESWC 2012 Satellite Events

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Most of the existing hierarchical Distributed Hash Table (DHT) systems, used for a resource discovery, generate considerable maintenance overhead which affects the routing efficiency in large scale systems. In this paper, we propose a Scalable Distributed Data Structures (SDDS) based Hierarchical DHT (SDDS- HDHT) solution for an efficient data source discovery in data Grid systems. Our solution deals with a reduced number of gateway peers running a DHT protocol. Each of them serves also as a proxy for second level peers in a single Virtual Organization (VO), structured as a SDDS. The performance evaluation of the proposed method proved the discovery cost reduction especially for intra-VO resource discovery queries. It also proved significant system maintenance save especially when peers frequently join/ leave the system.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Artigas, Marc S., García, Pedro, Skarmeta, Antonio FGómez: DECA: a hierarchical framework for decentralized aggregation in DHTs. In: State, Radu, van der Meer, Sven, O’Sullivan, Declan, Pfeifer, Tom (eds.) DSOM 2006. LNCS, vol. 4269, pp. 246–257. Springer, Heidelberg (2006)CrossRef Artigas, Marc S., García, Pedro, Skarmeta, Antonio FGómez: DECA: a hierarchical framework for decentralized aggregation in DHTs. In: State, Radu, van der Meer, Sven, O’Sullivan, Declan, Pfeifer, Tom (eds.) DSOM 2006. LNCS, vol. 4269, pp. 246–257. Springer, Heidelberg (2006)CrossRef
2.
go back to reference Druschel, P., Rowstron, A.: PAST: a large-scale, persistent peer-to-peer storage utility. In: HotOS VIII, Germany (2001) Druschel, P., Rowstron, A.: PAST: a large-scale, persistent peer-to-peer storage utility. In: HotOS VIII, Germany (2001)
3.
go back to reference Fei, T., Tao, S., Gao, L., Guerin, R.: How to select a good alternate path in large peer-to-peer systems? In: Proceedings of the international conference on IEEE INFOCOM (2006) Fei, T., Tao, S., Gao, L., Guerin, R.: How to select a good alternate path in large peer-to-peer systems? In: Proceedings of the international conference on IEEE INFOCOM (2006)
5.
go back to reference Foster, I., (ed.), Berry, D., Djaoui, A., Grimshaw, A., Horn, B., Kishimoto, H., (ed.), Maciel, F., Savva, A., Siebenlist, F., Subramania, R., Treadwell, J., Von Reich, J.: The Open Grid Services Architecture, V 1.0. Global Grid Forum (2004) Foster, I., (ed.), Berry, D., Djaoui, A., Grimshaw, A., Horn, B., Kishimoto, H., (ed.), Maciel, F., Savva, A., Siebenlist, F., Subramania, R., Treadwell, J., Von Reich, J.: The Open Grid Services Architecture, V 1.0. Global Grid Forum (2004)
6.
go back to reference Garcés-Erice, Luis, Biersack, Ernst W., Felber, Pascal, Ross, Keith W., Urvoy-Keller, Guillaume: Hierarchical peer-to-peer systems. In: Kosch, Harald, Böszörményi, László, Hellwagner, Hermann (eds.) Euro-Par 2003. LNCS, vol. 2790, pp. 1230–1239. Springer, Heidelberg (2003)CrossRef Garcés-Erice, Luis, Biersack, Ernst W., Felber, Pascal, Ross, Keith W., Urvoy-Keller, Guillaume: Hierarchical peer-to-peer systems. In: Kosch, Harald, Böszörményi, László, Hellwagner, Hermann (eds.) Euro-Par 2003. LNCS, vol. 2790, pp. 1230–1239. Springer, Heidelberg (2003)CrossRef
7.
go back to reference Ganesan, P., Gummadi, K., Garcia-Molina, H.: Canon in g major: designing DHTs with hierarchical structure. In: International Conference on Distributed Computing Systems 2004, pp 263–272 (2004) Ganesan, P., Gummadi, K., Garcia-Molina, H.: Canon in g major: designing DHTs with hierarchical structure. In: International Conference on Distributed Computing Systems 2004, pp 263–272 (2004)
8.
go back to reference Godfrey, P.B., Shenker, S., Stoica, I.: Minimizing churn in distributed systems. In: International Conference on SIGCOMM, pp 147–158, Italy (2006) Godfrey, P.B., Shenker, S., Stoica, I.: Minimizing churn in distributed systems. In: International Conference on SIGCOMM, pp 147–158, Italy (2006)
10.
go back to reference Gupta, I., Birman, K., Linga, P., Demers, A., Renesse, R.V.: Kelips: Building an Efficient and Stable P2P DHT through Increased Memory and Background Overhead. In: Frans Kaashoek, M., Stoica, I. (eds.) IPTPS 2003. LNCS, vol. 2735, pp. 160–169. Springer, Heidelberg (2003)CrossRef Gupta, I., Birman, K., Linga, P., Demers, A., Renesse, R.V.: Kelips: Building an Efficient and Stable P2P DHT through Increased Memory and Background Overhead. In: Frans Kaashoek, M., Stoica, I. (eds.) IPTPS 2003. LNCS, vol. 2735, pp. 160–169. Springer, Heidelberg (2003)CrossRef
11.
go back to reference Hameurlain, Abdelkader: Evolution of query optimization methods: from centralized database systems to data grid systems. In: Bhowmick, Sourav S., Küng, Josef, Wagner, Roland (eds.) DEXA 2009. LNCS, vol. 5690, pp. 460–470. Springer, Heidelberg (2009)CrossRef Hameurlain, Abdelkader: Evolution of query optimization methods: from centralized database systems to data grid systems. In: Bhowmick, Sourav S., Küng, Josef, Wagner, Roland (eds.) DEXA 2009. LNCS, vol. 5690, pp. 460–470. Springer, Heidelberg (2009)CrossRef
12.
go back to reference Harvey, N., Jones, M., Saoiu, S., Theimer, M., Wolman, A.: Skipnet: a scalable overlay network with practical locality properties. In: Proceedings of USITIS, Seattle, USA (2003) Harvey, N., Jones, M., Saoiu, S., Theimer, M., Wolman, A.: Skipnet: a scalable overlay network with practical locality properties. In: Proceedings of USITIS, Seattle, USA (2003)
13.
go back to reference Iamnitchi, A., Foster, I.: A peer-to-peer approach to resource location in grid environments. In: Proceedings of HPDC 2002, Edinburgh, UK (2002) Iamnitchi, A., Foster, I.: A peer-to-peer approach to resource location in grid environments. In: Proceedings of HPDC 2002, Edinburgh, UK (2002)
14.
go back to reference Joung, Y., Wang, J.-C.: Chord2: a two-layer chord for reducing maintenance overhead via heterogeneity. Comput. Netw. 51(3), 712–731 (2007)CrossRefMATH Joung, Y., Wang, J.-C.: Chord2: a two-layer chord for reducing maintenance overhead via heterogeneity. Comput. Netw. 51(3), 712–731 (2007)CrossRefMATH
16.
go back to reference Ketata, Imen, Mokadem, Riad, Morvan, Franck: Resource discovery considering semantic properties in data grid environments. In: Hameurlain, Abdelkader, Tjoa, A.Min (eds.) Globe 2011. LNCS, vol. 6864, pp. 61–72. Springer, Heidelberg (2011)CrossRef Ketata, Imen, Mokadem, Riad, Morvan, Franck: Resource discovery considering semantic properties in data grid environments. In: Hameurlain, Abdelkader, Tjoa, A.Min (eds.) Globe 2011. LNCS, vol. 6864, pp. 61–72. Springer, Heidelberg (2011)CrossRef
17.
go back to reference Ketata, I., Mokadem, R., Morvan, Franck: Biomedical resource discovery considering semantic proprieties in data grid environments. In: Joy, M., et al. (eds.) INTECH’11, vol. 165, pp. 12–64. Springer, Heidelberg (2011) Ketata, I., Mokadem, R., Morvan, Franck: Biomedical resource discovery considering semantic proprieties in data grid environments. In: Joy, M., et al. (eds.) INTECH’11, vol. 165, pp. 12–64. Springer, Heidelberg (2011)
19.
go back to reference Litwin, W.: Linear hashing: a new tool for file and table addressing. In: Stonebreaker, M. (ed.) VLDB 1980, 2nd edn. Morgan Kaufmann, San Fransisco (1995) Litwin, W.: Linear hashing: a new tool for file and table addressing. In: Stonebreaker, M. (ed.) VLDB 1980, 2nd edn. Morgan Kaufmann, San Fransisco (1995)
20.
go back to reference Litwin, W., Moussa, R., Schwarz, T.: LH*rs a highly available scalable distributed data structure. In: Jin, H., Rana, O.F., Pan, Y., Prasanna, V.K., et al. (eds.) Algorithms and Architectures for Parallel Processing, vol. 4494, pp. 188–197. Springer, Heidelberg (2005) Litwin, W., Moussa, R., Schwarz, T.: LH*rs a highly available scalable distributed data structure. In: Jin, H., Rana, O.F., Pan, Y., Prasanna, V.K., et al. (eds.) Algorithms and Architectures for Parallel Processing, vol. 4494, pp. 188–197. Springer, Heidelberg (2005)
21.
go back to reference Montresor, A.: A robust protocol for building superpeer overlay topologies. In: IEEE International Conference on Peer-to-Peer Computing (P2P) (2004) Montresor, A.: A robust protocol for building superpeer overlay topologies. In: IEEE International Conference on Peer-to-Peer Computing (P2P) (2004)
22.
go back to reference Martinez, I., Cuevas, R., Guerrero, C., Mauthe, A.: Routing performance in a hierarchical DHT-based overlay network. In: Euromicro International Conference PDP, pp. 508–515, Toulouse (2008) Martinez, I., Cuevas, R., Guerrero, C., Mauthe, A.: Routing performance in a hierarchical DHT-based overlay network. In: Euromicro International Conference PDP, pp. 508–515, Toulouse (2008)
23.
go back to reference Mislove, Alan, Druschel, Peter: Providing administrative control and autonomy in structured peer-to-peer overlays. In: Voelker, Geoffrey M., Shenker, Scott (eds.) IPTPS 2004. LNCS, vol. 3279, pp. 162–172. Springer, Heidelberg (2005)CrossRef Mislove, Alan, Druschel, Peter: Providing administrative control and autonomy in structured peer-to-peer overlays. In: Voelker, Geoffrey M., Shenker, Scott (eds.) IPTPS 2004. LNCS, vol. 3279, pp. 162–172. Springer, Heidelberg (2005)CrossRef
24.
go back to reference Meshkova, E., et al.: A survey on Resource Discovery Mechanisms, Peer to Peer and Service Discovery Frameworks Computer Networks, pp. 2097–2128. Science Direct, Elsevier, New York (2008) Meshkova, E., et al.: A survey on Resource Discovery Mechanisms, Peer to Peer and Service Discovery Frameworks Computer Networks, pp. 2097–2128. Science Direct, Elsevier, New York (2008)
25.
go back to reference Mokadem, R., Hameurlain, A., Min Tjoa, A.: Resource discovery service while minimizing maintenance overhead in hierarchical DHT systems. In: International Conference on Information Integration and Web-based Applications & Services (iiWAS), Paris, France (2010) Mokadem, R., Hameurlain, A., Min Tjoa, A.: Resource discovery service while minimizing maintenance overhead in hierarchical DHT systems. In: International Conference on Information Integration and Web-based Applications & Services (iiWAS), Paris, France (2010)
26.
go back to reference Mokadem, R., Hameurlain, A.: An efficient resource discovery while minimizing maintenance overhead in SDDS based hierarchical DHT systems. Int. J. Grid Distrib. Comput. (IJGDC) 4(3), 1–24 (2011) Mokadem, R., Hameurlain, A.: An efficient resource discovery while minimizing maintenance overhead in SDDS based hierarchical DHT systems. Int. J. Grid Distrib. Comput. (IJGDC) 4(3), 1–24 (2011)
27.
go back to reference Mastroianni, C., Talia, D., Verta, O.: Evaluating resource discovery protocols for hierarchical and super-peer grid information systems. In: 19th Euromicro International Conference (PDP) (2007) Mastroianni, C., Talia, D., Verta, O.: Evaluating resource discovery protocols for hierarchical and super-peer grid information systems. In: 19th Euromicro International Conference (PDP) (2007)
28.
go back to reference Pacitti, E., Valduriez, P., Mattosso, M.: Grid data management: open problems and news issues. Int. J. Grid Comput. 5, 273–281 (2007). SpringerCrossRef Pacitti, E., Valduriez, P., Mattosso, M.: Grid data management: open problems and news issues. Int. J. Grid Comput. 5, 273–281 (2007). SpringerCrossRef
29.
go back to reference Rajiv, R., et al.: Peer to peer based resource discovery in global grids: a tutorial. In: IEEE Communication Surveys, vol. 10, No 2, 2 nd Quarter (2008) Rajiv, R., et al.: Peer to peer based resource discovery in global grids: a tutorial. In: IEEE Communication Surveys, vol. 10, No 2, 2 nd Quarter (2008)
30.
go back to reference Ratnasamy, et al.: A scalable content-adressable network. In: Proceedings of the ACM SIGCOMM 2001 Conference on Applications, Technologies, Architectures and Protocols for Computer Communication, pp. 161–172 (2001) Ratnasamy, et al.: A scalable content-adressable network. In: Proceedings of the ACM SIGCOMM 2001 Conference on Applications, Technologies, Architectures and Protocols for Computer Communication, pp. 161–172 (2001)
31.
go back to reference Rhea, S., Geels, D., Roscoe, T., Kubiatowicz, J.: Handling churn in a DHT. In: Proceedings of the General Track: Usenix Annual Technical Conference, Boston, USA (2004) Rhea, S., Geels, D., Roscoe, T., Kubiatowicz, J.: Handling churn in a DHT. In: Proceedings of the General Track: Usenix Annual Technical Conference, Boston, USA (2004)
32.
go back to reference Rowston, A., Druschel, P.: Pastry: scalable distributed object location and routing for large-scale peer-to-peer systems. In: Proceeding of the 18th IFIP/ACM International Conference on Distributed Systems Platforms, vol. 2218, pp. 329–350 (2001) Rowston, A., Druschel, P.: Pastry: scalable distributed object location and routing for large-scale peer-to-peer systems. In: Proceeding of the 18th IFIP/ACM International Conference on Distributed Systems Platforms, vol. 2218, pp. 329–350 (2001)
33.
go back to reference S´anchez-Artigas, M., Garc´ya, P., Pujol, J., Skarmeta, A.G.: Cyclone: a novel design schema for hierarchical DHTs. In: IEEE International Conference on Peer-to-Peer Computing (P2P) (2005) S´anchez-Artigas, M., Garc´ya, P., Pujol, J., Skarmeta, A.G.: Cyclone: a novel design schema for hierarchical DHTs. In: IEEE International Conference on Peer-to-Peer Computing (P2P) (2005)
34.
go back to reference Samad, M.E., Morvan, F., Hameurlain, A.: Resource discovery for query processing in data grids. In: Graham, J.H., et al. (eds.) 22nd International Conference on Parallel and Distributed Computing and Communication Systems, PDCCS 2009, 24–26 September 2009, Louisville, Kentucky, USA. ISCA (2009) Samad, M.E., Morvan, F., Hameurlain, A.: Resource discovery for query processing in data grids. In: Graham, J.H., et al. (eds.) 22nd International Conference on Parallel and Distributed Computing and Communication Systems, PDCCS 2009, 24–26 September 2009, Louisville, Kentucky, USA. ISCA (2009)
35.
go back to reference Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishma, H.: CHORD: a scalable Peer to Peer Lookup Service for Internet Application. In: SIGCOMM’O, San Diego, USA (2001) Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishma, H.: CHORD: a scalable Peer to Peer Lookup Service for Internet Application. In: SIGCOMM’O, San Diego, USA (2001)
36.
go back to reference Trunfio, P., Talia, D., Papadakid, H., Fragoupoulou, P., Mordachini, M., Penanen, M., Popov, P., Valssov, V., Haridi, S: Peer-to-peer resource discovery in grids: models and systems. In: Future Generation Computer Systems (2007) Trunfio, P., Talia, D., Papadakid, H., Fragoupoulou, P., Mordachini, M., Penanen, M., Popov, P., Valssov, V., Haridi, S: Peer-to-peer resource discovery in grids: models and systems. In: Future Generation Computer Systems (2007)
37.
go back to reference Valduriez, Patrick, Pacitti, Esther: Data management in large-scale P2P systems. In: Daydé, Michel, Dongarra, Jack, Hernández, Vicente, Palma, José MLaginha M. (eds.) VECPAR 2004. LNCS, vol. 3402, pp. 104–118. Springer, Heidelberg (2005)CrossRef Valduriez, Patrick, Pacitti, Esther: Data management in large-scale P2P systems. In: Daydé, Michel, Dongarra, Jack, Hernández, Vicente, Palma, José MLaginha M. (eds.) VECPAR 2004. LNCS, vol. 3402, pp. 104–118. Springer, Heidelberg (2005)CrossRef
38.
go back to reference Xiang, X., Jin, T.: Efficient secure message routing for structured peer-to-peer systems. In: International Conference on Networks Security, Wireless Communications and Trusted Computing Wuhan, China (2009) Xiang, X., Jin, T.: Efficient secure message routing for structured peer-to-peer systems. In: International Conference on Networks Security, Wireless Communications and Trusted Computing Wuhan, China (2009)
39.
go back to reference Xu, Z., Min, R., Hu, Y.: HIERAS: a DHT based hierarchical P2P routing algorithm. In: Proceedings of International Conference on Parallel Processing (ICPP), pp 187–194 (2003) Xu, Z., Min, R., Hu, Y.: HIERAS: a DHT based hierarchical P2P routing algorithm. In: Proceedings of International Conference on Parallel Processing (ICPP), pp 187–194 (2003)
40.
go back to reference Yakouben, H., Litwin, W., Schwarz, T.: LH*RSP2P: a scalable distributed data structure for the P2P environment.In: International Conference on New Technologies of Distributed Systems, France (2008) Yakouben, H., Litwin, W., Schwarz, T.: LH*RSP2P: a scalable distributed data structure for the P2P environment.In: International Conference on New Technologies of Distributed Systems, France (2008)
41.
go back to reference Yang, B., Garcia-Molina, H.: Designing a super-peer network. In: Proceedings of International Conference on Data Engineering ICDE, Bangalore, India (2003) Yang, B., Garcia-Molina, H.: Designing a super-peer network. In: Proceedings of International Conference on Data Engineering ICDE, Bangalore, India (2003)
43.
go back to reference Zöls, S., Despotovic, Z., Kellerer, W.: Cost-based analysis of hierarchical DHT design. In: International Conference, P2P’06. IEEE Computer Society, Cambridge, pp 233–239 (2006) Zöls, S., Despotovic, Z., Kellerer, W.: Cost-based analysis of hierarchical DHT design. In: International Conference, P2P’06. IEEE Computer Society, Cambridge, pp 233–239 (2006)
44.
go back to reference Zöls, S., Hofstatter, Q., Despotovic, Z., Kellerer, W.: Achieving and maintaining cost-optimal operation of a hierarchical DHT system. In: Proceedings of International Conference. ICC, Germany (2009) Zöls, S., Hofstatter, Q., Despotovic, Z., Kellerer, W.: Achieving and maintaining cost-optimal operation of a hierarchical DHT system. In: Proceedings of International Conference. ICC, Germany (2009)
45.
go back to reference Zhao, B.Y., Huang, L., Stribling, J., Rhéa, S.C.: Tapestry: a resilient global scale overlay for service deployment. IEEE Int. J. Sel. Areas Commun. 22(1) (2004) Zhao, B.Y., Huang, L., Stribling, J., Rhéa, S.C.: Tapestry: a resilient global scale overlay for service deployment. IEEE Int. J. Sel. Areas Commun. 22(1) (2004)
Metadata
Title
SDDS Based Hierarchical DHT Systems for an Efficient Resource Discovery in Data Grid Systems
Authors
Riad Mokadem
Franck Morvan
Abdelkader Hameurlain
Copyright Year
2015
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-662-46641-4_25