Skip to main content

2016 | OriginalPaper | Buchkapitel

A Survey of Speculative Execution Strategy in MapReduce

verfasst von : Qi Liu, Dandan Jin, Xiaodong Liu, Nigel Linge

Erschienen in: Cloud Computing and Security

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

MapReduce is a parallel computing programming model designed to process large-scale data. Therefore, the accuracy and efficiency for computing are needed to be assured and speculative execution is an efficient method for calculation of fault tolerance. It reaches the goals of shortening the execution time and increasing the cluster throughput through selecting slow tasks and speculative copy these tasks on a fast machine to be executed. Hadoop naïve speculative execution strategy assumes that the cluster is homogeneous, and this assumption leads to the poor performance in heterogeneous environment. Several speculative execution strategies which aim to improve the MapReduce Performance in the heterogeneous environments are reviewed in this paper like LATE, MCP, ex-MCP and ERUL, then the comparison between these methods are listed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Armbrust, M., Fox, A., Griffith, R., Joseph, A., Katz, R., Konwinski, A., Zaharia, M.: A view of cloud computing. Commun. ACM 53(4), 50–58 (2010)CrossRef Armbrust, M., Fox, A., Griffith, R., Joseph, A., Katz, R., Konwinski, A., Zaharia, M.: A view of cloud computing. Commun. ACM 53(4), 50–58 (2010)CrossRef
2.
Zurück zum Zitat Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. ACM SIGOPS Oper. Syst. Rev. 37(5), 29–43 (2003)CrossRef Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. ACM SIGOPS Oper. Syst. Rev. 37(5), 29–43 (2003)CrossRef
3.
Zurück zum Zitat Dean, J., Ghemawa, S.: MapReduce: simplified data processing on large clusters. Proc. Oper. Syst. Des. Implement. 51(1), 107–113 (2004) Dean, J., Ghemawa, S.: MapReduce: simplified data processing on large clusters. Proc. Oper. Syst. Des. Implement. 51(1), 107–113 (2004)
4.
Zurück zum Zitat Chang, F., Dean, J., Ghemawa, S.: A distributed storage system for structured data. ACM Trans. Comput. Syst. 26(2), 1–26 (2008)CrossRef Chang, F., Dean, J., Ghemawa, S.: A distributed storage system for structured data. ACM Trans. Comput. Syst. 26(2), 1–26 (2008)CrossRef
6.
Zurück zum Zitat Vijayalakshmi, B., Ravi, P.R.: The down of big Data-Hbase. In: IEEE 2014 Conference on IT in Business, Industry and Government (2014) Vijayalakshmi, B., Ravi, P.R.: The down of big Data-Hbase. In: IEEE 2014 Conference on IT in Business, Industry and Government (2014)
9.
Zurück zum Zitat Xia, Z.H., Wang, X.H., Sun, X.H., Wang, Q.: A secure and dynamic multi-keyword ranked search scheme over encrypted cloud data. IEEE Trans. Parallel Distrib. Syst. 27(2), 340–352 (2015)MathSciNetCrossRef Xia, Z.H., Wang, X.H., Sun, X.H., Wang, Q.: A secure and dynamic multi-keyword ranked search scheme over encrypted cloud data. IEEE Trans. Parallel Distrib. Syst. 27(2), 340–352 (2015)MathSciNetCrossRef
10.
Zurück zum Zitat Fu, Z.J., Ren, K., Shu, J.G., Sun, X.M.: Enabling personalized search over encrypted outsourced data with efficiency improvement. IEEE Trans. Parallel Distrib. Syst. (in press) Fu, Z.J., Ren, K., Shu, J.G., Sun, X.M.: Enabling personalized search over encrypted outsourced data with efficiency improvement. IEEE Trans. Parallel Distrib. Syst. (in press)
11.
Zurück zum Zitat Fu, Z.J., Sun, X.M., Li, Q., Zhou, L., Shu, J.G.: Achieving efficient cloud search services: multi-keyword ranked search over encrypted cloud data supporting parallel computing. IEICE Trans. Commun. E98-B(1), 190–200 (2015)CrossRef Fu, Z.J., Sun, X.M., Li, Q., Zhou, L., Shu, J.G.: Achieving efficient cloud search services: multi-keyword ranked search over encrypted cloud data supporting parallel computing. IEICE Trans. Commun. E98-B(1), 190–200 (2015)CrossRef
12.
Zurück zum Zitat Yoo, D.G., Sim, K.M.: A comparative review of job scheduling for MapReduce. In: IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS), pp. 353–358. IEEE (2011) Yoo, D.G., Sim, K.M.: A comparative review of job scheduling for MapReduce. In: IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS), pp. 353–358. IEEE (2011)
13.
Zurück zum Zitat Isard, M., Budiu, M., Yu, Y., Birrel, A., Fetterly, D.: Dryad: distributed data-parallel programs from sequential building blocks. Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems, pp. 59–72. ACM (2007) Isard, M., Budiu, M., Yu, Y., Birrel, A., Fetterly, D.: Dryad: distributed data-parallel programs from sequential building blocks. Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems, pp. 59–72. ACM (2007)
14.
Zurück zum Zitat Nenavath, S.N., Atul, N.: A review of adaptive approaches to MapReduce scheduling in heterogeneous environments. In: International Conference on Advances in Computing, Communications and Informatics, pp. 677–683. IEEE (2014) Nenavath, S.N., Atul, N.: A review of adaptive approaches to MapReduce scheduling in heterogeneous environments. In: International Conference on Advances in Computing, Communications and Informatics, pp. 677–683. IEEE (2014)
15.
Zurück zum Zitat Zaharia, M., Konwinski, A., Joseph, A., Katz, R., Stoica, I.: Improving MapReduce performance in heterogeneous environments. Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation (OSDI), pp. 29–42 (2008) Zaharia, M., Konwinski, A., Joseph, A., Katz, R., Stoica, I.: Improving MapReduce performance in heterogeneous environments. Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation (OSDI), pp. 29–42 (2008)
16.
Zurück zum Zitat Chen, Q., Liu, C., Xiao, Z.: Improving MapReduce performance using smart speculative execution strategy. IEEE Trans. Comput. 63(4), 954–967 (2014)MathSciNetCrossRef Chen, Q., Liu, C., Xiao, Z.: Improving MapReduce performance using smart speculative execution strategy. IEEE Trans. Comput. 63(4), 954–967 (2014)MathSciNetCrossRef
17.
Zurück zum Zitat Huang, X., Zhang, L.X., Li, R.F., Wan, L.J., Li, K.Q.: Novel heuristic speculative execution strategies in heterogeneous distributed environments. Comput. Electr. Eng. 50, 166–179 (2015)CrossRef Huang, X., Zhang, L.X., Li, R.F., Wan, L.J., Li, K.Q.: Novel heuristic speculative execution strategies in heterogeneous distributed environments. Comput. Electr. Eng. 50, 166–179 (2015)CrossRef
18.
Zurück zum Zitat Wu, H.C., Li, K., Tang, Z., Zhang, L.: A heuristic speculative execution strategy in heterogeneous distributed environments. In: 2014 Sixth International Symposium on Parallel Architectures, Algorithms and Programming (PAAP), pp. 268–273 (2014) Wu, H.C., Li, K., Tang, Z., Zhang, L.: A heuristic speculative execution strategy in heterogeneous distributed environments. In: 2014 Sixth International Symposium on Parallel Architectures, Algorithms and Programming (PAAP), pp. 268–273 (2014)
Metadaten
Titel
A Survey of Speculative Execution Strategy in MapReduce
verfasst von
Qi Liu
Dandan Jin
Xiaodong Liu
Nigel Linge
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-48671-0_27