Skip to main content
Erschienen in: Cluster Computing 3/2016

01.09.2016

QDR: a QoS-aware data replication algorithm for Data Grids considering security factors

verfasst von: Najme Mansouri

Erschienen in: Cluster Computing | Ausgabe 3/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Data Grid integrates geographically distributed resources for solving data sensitive scientific applications. Dynamic data replication algorithms are becoming increasingly valuable in solving large-scale, realistic, difficult problems, and selecting replica with multiple selection criteria—availability, security and time- is one of these problems. The current algorithms do not offer balanced QoS levels and the mechanism of rating QoS parameters. In this paper, we propose a new replica selection strategy, which based on response time and security. However, replication should be used wisely because the storage size of each Data Grid site is limited. Thus, the site must keep only the important replicas. We also present a new replica replacement strategy based on the availability of the file, the last time the replica was requested, number of access, and size of replica. We evaluate our algorithm using the OptorSim simulator and find that it offers better performance in comparison with other algorithms in terms of mean job execution time, effective network usage, SE usage, replication frequency, and hit ratio.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.: The data grid: towards architecture for the distributed management and analysis of large scientific datasets. J. Netw. Comput. Appl. 23, 187–200 (2001)CrossRef Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.: The data grid: towards architecture for the distributed management and analysis of large scientific datasets. J. Netw. Comput. Appl. 23, 187–200 (2001)CrossRef
2.
Zurück zum Zitat Rahmani, A.M., Fadaie, Z., Chronopoulos, A.T.: Data placement using Dewey Encoding in a hierarchical data grid. J. Netw. Comput. Appl. 49, 88–98 (2015)CrossRef Rahmani, A.M., Fadaie, Z., Chronopoulos, A.T.: Data placement using Dewey Encoding in a hierarchical data grid. J. Netw. Comput. Appl. 49, 88–98 (2015)CrossRef
3.
Zurück zum Zitat Grace, R.K., Manimegalai, R.: Dynamic replica placement and selection strategies in data grids—a comprehensive survey. J. Parallel Distrib. Comput. 74(2), 2099–2108 (2014)CrossRef Grace, R.K., Manimegalai, R.: Dynamic replica placement and selection strategies in data grids—a comprehensive survey. J. Parallel Distrib. Comput. 74(2), 2099–2108 (2014)CrossRef
4.
Zurück zum Zitat Torkestani, J.A.: A new approach to the job scheduling problem in computational grids. Cluster Comput. 15, 201–201 (2011)CrossRef Torkestani, J.A.: A new approach to the job scheduling problem in computational grids. Cluster Comput. 15, 201–201 (2011)CrossRef
5.
Zurück zum Zitat Pinel, F., Dorronsoro, B., Pecero, J.E., Bouvry, P., Khan, S.U.: A two-phase heuristic for the energy-efficient scheduling of independent tasks on computational grids. Cluster Comput. 16, 421–433 (2012)CrossRef Pinel, F., Dorronsoro, B., Pecero, J.E., Bouvry, P., Khan, S.U.: A two-phase heuristic for the energy-efficient scheduling of independent tasks on computational grids. Cluster Comput. 16, 421–433 (2012)CrossRef
6.
Zurück zum Zitat Gallicchio, E., Xia, J., Flynn, W.F., Zhang, B., Samlalsingh, S., Mentes, A., Levy, R.M.: Asynchronous replica exchange software for grid and heterogeneous computing. Comput. Phys. Commun. 196, 236–246 (2015)CrossRef Gallicchio, E., Xia, J., Flynn, W.F., Zhang, B., Samlalsingh, S., Mentes, A., Levy, R.M.: Asynchronous replica exchange software for grid and heterogeneous computing. Comput. Phys. Commun. 196, 236–246 (2015)CrossRef
7.
Zurück zum Zitat Wu, J.J., Lin, Y.F., Liu, P.: Optimal replica placement in hierarchical data grids with locality assurance. J. Parallel Distrib. Comput. 68, 1517–1538 (2008)CrossRef Wu, J.J., Lin, Y.F., Liu, P.: Optimal replica placement in hierarchical data grids with locality assurance. J. Parallel Distrib. Comput. 68, 1517–1538 (2008)CrossRef
8.
Zurück zum Zitat Skałkowski, K., Słota, R., Krol, D., Kitowski, J.: QoS-based storage resources provisioning for grid applications. Future Gener. Comput. Syst. 29, 713–727 (2013)CrossRef Skałkowski, K., Słota, R., Krol, D., Kitowski, J.: QoS-based storage resources provisioning for grid applications. Future Gener. Comput. Syst. 29, 713–727 (2013)CrossRef
9.
Zurück zum Zitat Holtman, K.: CMS requirements for the grid. In: Proceedings of 2001 Conference on Computing in High Energy Physics (2001) Holtman, K.: CMS requirements for the grid. In: Proceedings of 2001 Conference on Computing in High Energy Physics (2001)
10.
Zurück zum Zitat Jianjin, J., Guangwen, Y.: An optimal replication strategy for data grid systems. Front Comput. Sci. China 1, 338–348 (2007)CrossRef Jianjin, J., Guangwen, Y.: An optimal replication strategy for data grid systems. Front Comput. Sci. China 1, 338–348 (2007)CrossRef
11.
Zurück zum Zitat Amjad, T., Sher, M., Daud, A.: A survey of dynamic replication strategies for improving data availability in data grids. Future Gener. Comput. Syst. 28, 337–349 (2012)CrossRef Amjad, T., Sher, M., Daud, A.: A survey of dynamic replication strategies for improving data availability in data grids. Future Gener. Comput. Syst. 28, 337–349 (2012)CrossRef
12.
Zurück zum Zitat Nong, X., Wei, F., XiCheng, L.: QoS-awared replica placement techniques in data grid applications. Sci. China Inf. Sci. 53, 1487–1496 (2010)CrossRef Nong, X., Wei, F., XiCheng, L.: QoS-awared replica placement techniques in data grid applications. Sci. China Inf. Sci. 53, 1487–1496 (2010)CrossRef
13.
Zurück zum Zitat Taheri, J., Lee, Y.C., Zomaya, A., Siegel, H.J.: A bee colony based optimization approach for simultaneous job scheduling and data replication in grid environments. Comput. Oper. Res. 40, 1564–1578 (2013)MathSciNetCrossRef Taheri, J., Lee, Y.C., Zomaya, A., Siegel, H.J.: A bee colony based optimization approach for simultaneous job scheduling and data replication in grid environments. Comput. Oper. Res. 40, 1564–1578 (2013)MathSciNetCrossRef
14.
Zurück zum Zitat He, J., Zhang, Y., Huang, G., Shi, Y., Cao, J.: Distributed data possession checking for securing multiple replicas in geographically-dispersed clouds. J. Comput. Syst. Sci. 78(5), 1345–1358 (2012)CrossRefMATH He, J., Zhang, Y., Huang, G., Shi, Y., Cao, J.: Distributed data possession checking for securing multiple replicas in geographically-dispersed clouds. J. Comput. Syst. Sci. 78(5), 1345–1358 (2012)CrossRefMATH
15.
Zurück zum Zitat Munir, E.U., Li, J., Shi, S.: QoS suffrage heuristic for independent task scheduling in grid. Inf. Technol. J. 6, 1166–1170 (2007)CrossRef Munir, E.U., Li, J., Shi, S.: QoS suffrage heuristic for independent task scheduling in grid. Inf. Technol. J. 6, 1166–1170 (2007)CrossRef
18.
Zurück zum Zitat Bunn, J., Newman, H.: Grid computing: making the global infrastructure a reality. chapter Data Intensive Grids for High Energy Physics. Wiley Press, London (2003) Bunn, J., Newman, H.: Grid computing: making the global infrastructure a reality. chapter Data Intensive Grids for High Energy Physics. Wiley Press, London (2003)
19.
Zurück zum Zitat Szalay, A.S., Proceedings of SPIE Conference on Virtual Observatories, vol 4846, Waikoloa, SPIE (2002) Szalay, A.S., Proceedings of SPIE Conference on Virtual Observatories, vol 4846, Waikoloa, SPIE (2002)
22.
Zurück zum Zitat Hamrouni, T., Slimani, S., Charrada, F.B.: A critical survey of Data Grid replication strategies based on data mining techniques. Proc. Comput. Sci. 51, 2779–2788 (2015)CrossRef Hamrouni, T., Slimani, S., Charrada, F.B.: A critical survey of Data Grid replication strategies based on data mining techniques. Proc. Comput. Sci. 51, 2779–2788 (2015)CrossRef
23.
Zurück zum Zitat Lou, C., Zheng, M., Liu, X., Li, X.: Replica selection strategy based on individual QoS sensitivity constraints in cloud environment. Pervasive Comput. Netw. World 8351, 393–399 (2014) Lou, C., Zheng, M., Liu, X., Li, X.: Replica selection strategy based on individual QoS sensitivity constraints in cloud environment. Pervasive Comput. Netw. World 8351, 393–399 (2014)
24.
Zurück zum Zitat Long, S.Q., Zhao, Y.L., Chen, W.: MORM: a multi-objective optimized replication management strategy for cloud storage cluster. J. Syst. Archit. 60(2), 234–244 (2014)CrossRef Long, S.Q., Zhao, Y.L., Chen, W.: MORM: a multi-objective optimized replication management strategy for cloud storage cluster. J. Syst. Archit. 60(2), 234–244 (2014)CrossRef
25.
Zurück zum Zitat Andronikou, V., Mamouras, K., Tserpes, K., Kyriazis, D., Varvarigou, T.: Dynamic QoS-aware data replication in grid environments based on data “Importance”. Future Gener. Comput. Syst. 28, 544–553 (2012)CrossRef Andronikou, V., Mamouras, K., Tserpes, K., Kyriazis, D., Varvarigou, T.: Dynamic QoS-aware data replication in grid environments based on data “Importance”. Future Gener. Comput. Syst. 28, 544–553 (2012)CrossRef
26.
Zurück zum Zitat Shorfuzzaman, M., RasitEskicioglu, P.G.: QoS-aware distributed replica placement in hierarchical data grids. In: International Conference on Advanced Information Networking and Applications (2011) Shorfuzzaman, M., RasitEskicioglu, P.G.: QoS-aware distributed replica placement in hierarchical data grids. In: International Conference on Advanced Information Networking and Applications (2011)
27.
Zurück zum Zitat Foster, I., Ranganathan, K.: Design and evaluation of dynamic replication strategies for high performance Data Grids. In: Proceedings of International Conference on Computing in High Energy and Nuclear Physics (2001) Foster, I., Ranganathan, K.: Design and evaluation of dynamic replication strategies for high performance Data Grids. In: Proceedings of International Conference on Computing in High Energy and Nuclear Physics (2001)
28.
Zurück zum Zitat Foster, I., Ranganathan, K.: Identifying dynamic replication strategies for high performance Data Grids. In: Proceedings of 3rd IEEE/ACM International Workshop on Grid Computing, in: Lecture Notes on Computer Science, pp. 75–86 (2002) Foster, I., Ranganathan, K.: Identifying dynamic replication strategies for high performance Data Grids. In: Proceedings of 3rd IEEE/ACM International Workshop on Grid Computing, in: Lecture Notes on Computer Science, pp. 75–86 (2002)
29.
Zurück zum Zitat Foster, I., Ranganathan, K.: Decoupling computation and data scheduling in distributed data-intensive applications. In: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, HPDC-11, IEEE, pp. 352–358. CS Press, Edinburgh (2002) Foster, I., Ranganathan, K.: Decoupling computation and data scheduling in distributed data-intensive applications. In: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, HPDC-11, IEEE, pp. 352–358. CS Press, Edinburgh (2002)
30.
Zurück zum Zitat Bsoul, M., Al-Khasawneh, A., Abdallah, E.E., Kilani, Y.: Enhanced fast spread replication strategy for Data Grid. J. Netw. Comput. Appl. 34, 575–580 (2011)CrossRef Bsoul, M., Al-Khasawneh, A., Abdallah, E.E., Kilani, Y.: Enhanced fast spread replication strategy for Data Grid. J. Netw. Comput. Appl. 34, 575–580 (2011)CrossRef
31.
Zurück zum Zitat Sashi, K., Thanamani, A.S.: Dynamic replica management for Data Grid. IACSIT Int. J. Eng. Technol. 2, 329–333 (2010)CrossRef Sashi, K., Thanamani, A.S.: Dynamic replica management for Data Grid. IACSIT Int. J. Eng. Technol. 2, 329–333 (2010)CrossRef
32.
Zurück zum Zitat Chang, R.S., Chang, H.P.: A dynamic data replication strategy using access-weight in Data Grids. J. Supercomput. 45, 277–295 (2008)CrossRef Chang, R.S., Chang, H.P.: A dynamic data replication strategy using access-weight in Data Grids. J. Supercomput. 45, 277–295 (2008)CrossRef
33.
Zurück zum Zitat Park, S.M., Kim, J.H., Ko, Y.B., Yoon, W.S.: Dynamic grid replication strategy based on internet hierarchy. Int. Workshop Grid Coop. Comput. 1001, 1324–1331 (2003) Park, S.M., Kim, J.H., Ko, Y.B., Yoon, W.S.: Dynamic grid replication strategy based on internet hierarchy. Int. Workshop Grid Coop. Comput. 1001, 1324–1331 (2003)
34.
Zurück zum Zitat Sashi, K., Thanamani, A.S.: Dynamic replication in a Data Grid using a modified BHR region based algorithm. Future Gener. Comput. Syst. 27, 202–210 (2011)CrossRef Sashi, K., Thanamani, A.S.: Dynamic replication in a Data Grid using a modified BHR region based algorithm. Future Gener. Comput. Syst. 27, 202–210 (2011)CrossRef
35.
Zurück zum Zitat Horri, A., Sepahvand, R., Dastghaibyfard, G.H.: A hierarchical scheduling and replication strategy. Int. J. Comput. Sci. Netw. Secur. 8, 30–35 (2008) Horri, A., Sepahvand, R., Dastghaibyfard, G.H.: A hierarchical scheduling and replication strategy. Int. J. Comput. Sci. Netw. Secur. 8, 30–35 (2008)
36.
Zurück zum Zitat Mansouri, N., Dastghaibyfard, G.H.: Job scheduling and dynamic data replication in Data Grid environment. J. Supercomput. 64, 204–225 (2013)CrossRef Mansouri, N., Dastghaibyfard, G.H.: Job scheduling and dynamic data replication in Data Grid environment. J. Supercomput. 64, 204–225 (2013)CrossRef
37.
Zurück zum Zitat Chang, R., Chang, J., Lin, S.: Job scheduling and data replication on Data Grids. Future Gener. Comput. Syst. 23, 846–860 (2007)CrossRef Chang, R., Chang, J., Lin, S.: Job scheduling and data replication on Data Grids. Future Gener. Comput. Syst. 23, 846–860 (2007)CrossRef
38.
Zurück zum Zitat Mansouri, N., Dastghaibyfard, G.H.: A dynamic replica management strategy in Data Grid. J. Netw. Comput. Appl. 35, 1297–1303 (2012)CrossRef Mansouri, N., Dastghaibyfard, G.H.: A dynamic replica management strategy in Data Grid. J. Netw. Comput. Appl. 35, 1297–1303 (2012)CrossRef
39.
Zurück zum Zitat Mansouri, N., Dastghaibyfard, G.H., Mansouri, E.: Combination of data replication and scheduling algorithm for improving data availability in Data Grids. J. Netw. Comput. Appl. 36, 711–722 (2013)CrossRef Mansouri, N., Dastghaibyfard, G.H., Mansouri, E.: Combination of data replication and scheduling algorithm for improving data availability in Data Grids. J. Netw. Comput. Appl. 36, 711–722 (2013)CrossRef
40.
Zurück zum Zitat Mansouri, N.: A threshold-based dynamic data replication and parallel job scheduling strategy to enhance Data Grid. Cluster Comput. 17, 957–977 (2014)CrossRef Mansouri, N.: A threshold-based dynamic data replication and parallel job scheduling strategy to enhance Data Grid. Cluster Comput. 17, 957–977 (2014)CrossRef
41.
Zurück zum Zitat Yang, C., Fu, C., Hsu, C.: File replication, maintenance, and consistency management services in Data Grids. J. Supercomput. 53, 411–439 (2010)CrossRef Yang, C., Fu, C., Hsu, C.: File replication, maintenance, and consistency management services in Data Grids. J. Supercomput. 53, 411–439 (2010)CrossRef
42.
Zurück zum Zitat Sun, D.W., Chang, G.R., Gao, S., Jin, L.Z., Wang, X.W.: Modeling a dynamic data replication strategy to increase system availability in cloud computing environments. J. Comput. Sci. Technol. 27(2), 256–272 (2012)CrossRefMATH Sun, D.W., Chang, G.R., Gao, S., Jin, L.Z., Wang, X.W.: Modeling a dynamic data replication strategy to increase system availability in cloud computing environments. J. Comput. Sci. Technol. 27(2), 256–272 (2012)CrossRefMATH
43.
Zurück zum Zitat Rajalakshmi, A., Vijayakumar, D., Srinivasagan, K.G.: An improved dynamic data replica selection and placement in cloud. In: International Conference on Recent Trends in Information Technology (2014) Rajalakshmi, A., Vijayakumar, D., Srinivasagan, K.G.: An improved dynamic data replica selection and placement in cloud. In: International Conference on Recent Trends in Information Technology (2014)
44.
Zurück zum Zitat Li, B., Song, S., Bezakova, I., Cameron, W.: Energy-aware replica selection for data-intensive services in Cloud. In: IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, 6, 504–50 (2012) Li, B., Song, S., Bezakova, I., Cameron, W.: Energy-aware replica selection for data-intensive services in Cloud. In: IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, 6, 504–50 (2012)
45.
Zurück zum Zitat Vingralek, R., Breitbart, Y., Sayal, M., Scheuermann, P.: Web++: a system for fast and reliable web service, In: Proceedings of the USENIX Annual Technical Conference (1999) Vingralek, R., Breitbart, Y., Sayal, M., Scheuermann, P.: Web++: a system for fast and reliable web service, In: Proceedings of the USENIX Annual Technical Conference (1999)
46.
Zurück zum Zitat Sayal, M., Breitbart, Y., Scheuermann, P., Vingralek, R.: Selection algorithms for replicated web servers. In: Proceedings of the Workshop on Internet Server Performance (1998) Sayal, M., Breitbart, Y., Scheuermann, P., Vingralek, R.: Selection algorithms for replicated web servers. In: Proceedings of the Workshop on Internet Server Performance (1998)
47.
Zurück zum Zitat Cuevas, A., Uruena, M., Veciana, G., Yadav, A.: STARR-DCS: spatio-temporal adaptation of random replication for data-centric storage. In: ACM Transactions on Sensor Networks, vol. 10 (2013) Cuevas, A., Uruena, M., Veciana, G., Yadav, A.: STARR-DCS: spatio-temporal adaptation of random replication for data-centric storage. In: ACM Transactions on Sensor Networks, vol. 10 (2013)
48.
Zurück zum Zitat Ranganathan, K., Foster, I.: Simulation studies of computation and data scheduling algorithms for data grids. J. Grid Comput. 1, 53–62 (2003) Ranganathan, K., Foster, I.: Simulation studies of computation and data scheduling algorithms for data grids. J. Grid Comput. 1, 53–62 (2003)
49.
Zurück zum Zitat Lewontin, S., Martin, E.: Client side load balancing for the web, In: Proceedings of 6th International World Wide Web Conference (1997) Lewontin, S., Martin, E.: Client side load balancing for the web, In: Proceedings of 6th International World Wide Web Conference (1997)
50.
Zurück zum Zitat Fei, Z., Bhattacharjee, S., Zegura, E., Ammar, M.: A novel server selection technique for improving response time of a replicated service. In: Proceedings IEEE INFOCOM, pp. 783–791 (1998) Fei, Z., Bhattacharjee, S., Zegura, E., Ammar, M.: A novel server selection technique for improving response time of a replicated service. In: Proceedings IEEE INFOCOM, pp. 783–791 (1998)
51.
Zurück zum Zitat Mansouri, N., Asadi, A.: Weighted data replication strategy for data grid considering economic approach. Int. J. Comput. Elect. Auto. Control Inf. Eng. 8, 1336–1345 (2014) Mansouri, N., Asadi, A.: Weighted data replication strategy for data grid considering economic approach. Int. J. Comput. Elect. Auto. Control Inf. Eng. 8, 1336–1345 (2014)
52.
Zurück zum Zitat Ceryen, T., Kevin, M.: Performance characterization of decentralized algorithms for replica selection in distributed object systems. In: Proceedings of the 5th International Workshop on Software Performance, pp. 257–262 (2005) Ceryen, T., Kevin, M.: Performance characterization of decentralized algorithms for replica selection in distributed object systems. In: Proceedings of the 5th International Workshop on Software Performance, pp. 257–262 (2005)
53.
Zurück zum Zitat Cameron, D.G., Carvajal-schiaffino, R., Paul Millar, A., Nicholson, C., Stockinger, K., Zini, F.: UK Grid Simulation with OptorSim. UK e-Science All Hands Meeting (2003) Cameron, D.G., Carvajal-schiaffino, R., Paul Millar, A., Nicholson, C., Stockinger, K., Zini, F.: UK Grid Simulation with OptorSim. UK e-Science All Hands Meeting (2003)
Metadaten
Titel
QDR: a QoS-aware data replication algorithm for Data Grids considering security factors
verfasst von
Najme Mansouri
Publikationsdatum
01.09.2016
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 3/2016
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-016-0576-7

Weitere Artikel der Ausgabe 3/2016

Cluster Computing 3/2016 Zur Ausgabe