nach oben

The Journal of Supercomputing

Erschienen in:

01.11.2015

Dynamic replication strategies in data grid systems: a survey

verfasst von: Uras Tos, Riad Mokadem, Abdelkader Hameurlain, Tolga Ayav, Sebnem Bora

Erschienen in: The Journal of Supercomputing | Ausgabe 11/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

In data grid systems, data replication aims to increase availability, fault tolerance, load balancing and scalability while reducing bandwidth consumption, and job execution time. Several classification schemes for data replication were proposed in the literature, (i) static vs. dynamic, (ii) centralized vs. decentralized, (iii) push vs. pull, and (iv) objective function based. Dynamic data replication is a form of data replication that is performed with respect to the changing conditions of the grid environment. In this paper, we present a survey of recent dynamic data replication strategies. We study and classify these strategies by taking the target data grid architecture as the sole classifier. We discuss the key points of the studied strategies and provide feature comparison of them according to important metrics. Furthermore, the impact of data grid architecture on dynamic replication performance is investigated in a simulation study. Finally, some important issues and open research problems in the area are pointed out.

Vorheriger Artikel A new concurrency control mechanism for multi-threaded environment using transactional memory

Nächster Artikel GPU-accelerated parallel algorithms for linear rankSVM

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Abdullah A, Othman M, Ibrahim H, Sulaiman MN, Othman AT (2008) Decentralized replication strategies for P2P based scientific data grid. In: International symposium on information technology (ITSim 2008), vol 3, pp 1–8. IEEE

Abdurrab AR, Xie T (2010) FIRE: a file reunion based data replication strategy for data grids. In: 10th IEEE/ACM international conference on cluster, cloud and grid computing, pp 215–223. IEEE

Adamic L, Huberman B (2002) Zipf’s law and the Internet. Glottometrics 3(1):143–150

Amjad T, Sher M, Daud A (2012) A survey of dynamic replication strategies for improving data availability in data grids. Future Gener Comput Syst 28(2):337–349CrossRef

Andronikou V, Mamouras K, Tserpes K, Kyriazis D, Varvarigou T (2012) Dynamic QoS-aware data replication in grid environments based on data importance. Future Gener Comput Syst 28(3):544–553CrossRef

Arlitt M, Cherkasova L, Dilley J, Friedrich R, Jin T (2000) Evaluating content management techniques for web proxy caches. ACM SIGMETRICS Perform Eval Rev 27(4):3–11CrossRef

Bell WH, Cameron DG, Capozza L, Millar AP, Stockinger K, Zini F (2012) Simulation of dynamic grid replication strategies in optorsim. In: IEEE workshop on grid computing (Grid’2002), pp 46–57

Bell WH, Cameron DG, Carvajal-Schiaffino R, Millar AP, Stockinger K, Zini F (2003) Evaluation of an economy-based file replication strategy for a data grid. In: Proceedings of the 3rd IEEE/ACM international symposium on cluster computing and the grid (CCGRID’03), pp 661–668. IEEE

Bsoul M, Al-Khasawneh A, Abdallah EE, Kilani Y (2011) Enhanced fast spread replication strategy for data grid. J Netw Comput Appl 34(2):575–580CrossRef

10.

Challal Z, Bouabana-Tebibel T (2010) A priori replica placement strategy in data grid. In: International conference on machine and web intelligence, pp 402–406. IEEE

11.

Chang RS, Chang HP (2008) A dynamic data replication strategy using access-weights in data grids. J Supercomput 45(3):277–295CrossRef

12.

Chen D, Zhou S, Ren X, Kong Q (2010) Method for replica creation in data grids based on complex networks. J China Univ Posts Telecommun 17(4):110–115CrossRef

13.

Chervenak A, Deelman E, Foster I, Guy L, Hoschek W, Iamnitchi A, Kesselman C, Kunszt P, Ripeanu M, Schwartzkopf B, Stockinger H, Stockinger K, Tierney B (2002) Giggle: a framework for constructing scalable replica location services. Proc ACM/IEEE Conf Supercomput 3:1–17

14.

Chervenak A, Deelman E, Kesselman C, Allcock B, Foster I, Nefedova V, Lee J, Sim A, Shoshani A, Drach B, Williams D, Middleton D (2003) High-performance remote access to climate simulation data: a challenge problem for data grid technologies. Parallel Comput 29(10):1335–1356CrossRef

15.

Chervenak A, Foster I, Kesselman C, Salisbury C, Tuecke S (2000) The data grid: towards an architecture for the distributed management and analysis of large scientific datasets. J Netw Comput Appl 23(3):187–200CrossRef

16.

Chervenak A, Schuler R, Kesselman C, Koranda S (2008) Wide area data replication for scientific collaborations. Int J High Perform Comput Netw 5(3):124–134CrossRef

17.

Chettaoui H, Charrada FB (2014) A new decentralized periodic replication strategy for dynamic data grids. Scalable Comput: Pract Exp 15(1):101–119

18.

Cibej U, Slivnik B, Robic B (2005) The complexity of static data replication in data grids. Parallel Comput 31(8–9):900–912MathSciNetCrossRef

19.

Deelman E, Kesselman C, Mehta G, Meshkat L, Pearlman L, Blackburn K, Ehrens P, Lazzarini A, Williams R, Koranda S (2002) GriPhyN and LIGO, building a virtual data grid for gravitational wave scientists. In: Proceedings of the 11 th IEEE international symposium on high performance distributed computing (HPDC02), pp 225–234

20.

Dogan A (2009) A study on performance of dynamic file replication algorithms for real-time file access in data grids. Future Gener Comput Syst 25(8):829–839CrossRef

21.

Foster I, Zhao Y, Raicu I, Lu S (2008) Cloud computing and grid computing 360-degree compared. In: 2008 grid computing environments workshop, pp 1–10. IEEE

22.

Fu X, xin Zhu X, yuhan J, chuan Wang R (2013) QoS-aware replica placement for data intensive applications. J China Univ Posts Telecommun 20(3):43–47CrossRef

23.

Goel S, Buyya R (2006) Data replication strategies in wide area distributed systems. In: Enterprise service computing: from concept to deployment, p 17

24.

Horri A, Sepahvand R, Dastghaibyfard GH (2008) A hierarchical scheduling and replication strategy. Int J Comput Sci Netw Secur 8(8):30–35

25.

Hoschek W, Jaen-martinez J, Samar A, Stockinger H, Stockinger K (2000) Data management in an international data grid project. In: IEEE, ACM international workshop on grid computing, pp 77–90

26.

International Organization Of Standardization (2011) ISO/IEC/IEEE 42010:2011—systems and software engineering–architecture description. Technical report

27.

Khanli LM, Isazadeh A, Shishavan TN (2011) PHFS: a dynamic replication method, to decrease access latency in the multi-tier data grid. Future Gener Comput Syst 27(3):233–244CrossRef

28.

Kingsy Grace R, Manimegalai R (2014) Dynamic replica placement and selection strategies in data grids. A comprehensive survey. J Parallel Distrib Comput 74(2):2099–2108

29.

Lamehamedi H, Szymanski B, Shentu Z, Deelman E (2002) Data replication strategies in grid environments. In: Proceedings of 5th international conference on algorithms and architectures for parallel processing, pp 378–383. IEEE Comput Soc

30.

Lee MC, Leu FY, Chen YP (2012) PFRF: an adaptive data replication algorithm based on star-topology data grids. Future Gener Comput Syst 28(7):1045–1057CrossRef

31.

Lei M, Vrbsky SV, Hong X (2008) An on-line replication strategy to increase availability in data grids. Future Gener Comput Syst 24(2):85–98CrossRefMATH

32.

Loukopoulos T, Ahmad I (2004) Static and adaptive distributed data replication using genetic algorithms. J Parallel Distrib Comput 64(11):1270–1285CrossRefMATH

33.

Ma J, Liu W, Glatard T (2013) A classification of file placement and replication methods on grids. Future Gener Comput Syst 29(6):1395–1406CrossRef

34.

Maltsev N, Glass E, Sulakhe D, Rodriguez A, Syed MH, Bompada T, Zhang Y, D’Souza M (2006) PUMA2—grid-based high-throughput analysis of genomes and metabolic pathways. Nucleic acids Res 34(Database issue):D369–D372

35.

Mansouri N, Dastghaibyfard GH (2012) A dynamic replica management strategy in data grid. J Netw Comput Appl 35(4):1297–1303CrossRef

36.

Mansouri N, Dastghaibyfard GH (2013) Enhanced dynamic hierarchical replication and weighted scheduling strategy in data grid. J Parallel Distrib Comput 73(4):534–543CrossRef

37.

Mansouri N, Dastghaibyfard GH, Mansouri E (2013) Combination of data replication and scheduling algorithm for improving data availability in data grids. J Netw Comput Appl 36(2):711–722CrossRef

38.

Mansouri Y, Azad ST, Chamkori A (2014) Minimizing cost of K-replica in hierarchical data grid environment. In: IEEE 28th international conference on advanced information networking and applications (AINA), pp 1073–1080. IEEE

39.

Meroufel B, Belalem G (2013) Managing data replication and placement based on availability. AASRI Procedia 5:147–155CrossRef

40.

Mokadem R, Hameurlain A (2015) Data replication strategies with performance objective in data grid systems: a survey. Int J Grid Util Comput 6(1):30–46CrossRef

41.

Nicholson C, Cameron DG, Doyle AT, Millar AP, Stockinger K (2008) Dynamic data replication in lcg 2008. Concurr Comput: Pract Exp 20(11):1259–1271CrossRef

42.

Park SM, Kim JH, Ko YB, Yoon WS (2004) Dynamic data grid replication strategy based on Internet hierarchy. Grid and cooperative computing. Springer, Berlin Heidelberg, pp 838–846CrossRef

43.

Pérez JM, García-Carballeira F, Carretero J, Calderón A, Fernández J (2010) Branch replication scheme: a new model for data replication in large scale data grids. Future Gener Comput Syst 26(1):12–20CrossRef

44.

Rahman R, Barker K, Alhajj R (2005) Replica placement in data grid: a multi-objective approach. In: Zhuge H, Geoffrey CF (eds) Grid and cooperative computing-GCC 2005. Springer, Berlin Heidelberg, pp 645–656CrossRef

45.

Ranganathan K, Foster I (2001) Identifying dynamic replication strategies for a high-performance data grid. In: Proceedings of the international grid computing workshop, vol 2242, Springer, pp 75–86

46.

Ranganathan K, Iamnitchi A, Foster I (2002) Improving data availability through dynamic model-driven replication in large peer-to-peer communities. In: Proceedings of the 2nd IEEE/ACM international symposium on cluster computing and the grid (CCGRID’02), pp 376–381

47.

Rasool Q, Li J, Zhang S (2009) Replica placement in multi-tier data grid. In: 8th IEEE international conference on dependable, autonomic and secure computing, pp 103–108. IEEE

48.

Saadat N, Rahmani AM (2012) PDDRA: a new pre-fetching based dynamic data replication algorithm in data grids. Future Gener Comput Syst 28(4):666–681CrossRef

49.

Sashi K, Thanamani AS (2011) Dynamic replication in a data grid using a modified BHR region based algorithm. Future Gener Comput Syst 27(2):202–210CrossRef

50.

Segal B (2000) Grid computing: the European data grid project. IEEE Nucl Sci Symp Med Imaging Conf 1:15–20

51.

Shorfuzzaman M, Graham P, Eskicioglu R (2009) Adaptive popularity-driven replica placement in hierarchical data grids. J Supercomput 51(3):374–392CrossRef

52.

Steen MV, Pierre G (2010) Replicating for performance: case studies. In: Charron-Bost B, Pedone F, Schiper A (eds) Replication. Lecture Notes in Computer Science, vol 5959. Springer, Berlin Heidelberg, pp 73–89

53.

Takefusa A, Tatebe O, Matsuoka S, Morita Y (2003) Performance analysis of scheduling and replication algorithms on grid datafarm architecture for high-energy physics applications. In: Proceedings of the 12th IEEE international symposium on high performance distributed computing (HPDC03), pp 34–43

54.

Tang M, Lee BS, Yeo CK, Tang X (2005) Dynamic replication algorithms for the multi-tier data grid. Future Gener Comput Syst 21(5):775–790CrossRef

55.

Tang X, Xu J (2005) QoS-aware replica placement for content distribution. IEEE Trans Parallel Distrib Syst 16:921–932CrossRef

56.

Tatebe O, Morita Y, Matsuoka S (2002) Grid datafarm architecture for petascale data intensive computing. In: International symposium on cluster computing and the grid (CCGRID02), pp 102–110

57.

Xhafa F, Kolici V, Potlog AD, Spaho E, Barolli L, Takizawa M (2012) Data replication in P2P collaborative systems. In: 2012 7th international conference on P2P, parallel, grid, cloud and internet computing, pp 49–57. IEEE

58.

Zhao W, Xu X, Wang Z, Zhang Y, He S (2010) A dynamic optimal replication strategy in data grid environment. In: International conference on internet technology and applications, pp 2–5

Titel: Dynamic replication strategies in data grid systems: a survey
verfasst von: Uras Tos
Riad Mokadem
Abdelkader Hameurlain
Tolga Ayav
Sebnem Bora
Publikationsdatum: 01.11.2015
Verlag: Springer US
Erschienen in: The Journal of Supercomputing / Ausgabe 11/2015
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI: https://doi.org/10.1007/s11227-015-1508-7

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Weitere Artikel der Ausgabe 11/2015

Interval-based performance modeling for the all-pairs-shortest-path problem on GPUs

A queuing model considering resources sharing for cloud service performance

Scheduling array redistribution with virtual channel support

Fault-tolerant broadcast in anonymous systems

A new concurrency control mechanism for multi-threaded environment using transactional memory

Comments on two schemes of identity-based user authentication and key agreement for mobile client–server networks

Premium Partner