Skip to main content

2014 | OriginalPaper | Buchkapitel

Green Master Based on MapReduce Cluster

verfasst von : Ming-Zhi Wu, Yu-Chang Lin, Wei-Tsong Lee, Yu-Sun Lin, Fong-Hao Liu

Erschienen in: Advanced Technologies, Embedded and Multimedia for Human-centric Computing

Verlag: Springer Netherlands

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

MapReduce is a kind of distributed computing system, and also many people use it nowadays. In this paper, the Green Master based on MapReduce is proposed to solve the problem between load balance and power saving. There are three mechanism proposed by this paper to improve the MapReduce system efficiency. First, a brand new architecture called Green Master is designed in the system. Second, Benchmark Score is added to each services in the cluster. In the last, an algorithm about how to distinguish the high score service and the low score service, and how to use them effectively.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Dean J, Ghemawat S (2004) MapReduce: simplified data processing on large clusters OSDO 2004 Dean J, Ghemawat S (2004) MapReduce: simplified data processing on large clusters OSDO 2004
2.
Zurück zum Zitat Xie X, Chen Q, Cao W, Yuan P, Jin H (2010) Benchmark object for virtual machines, 2010 second international workshop on education technology and computer science Xie X, Chen Q, Cao W, Yuan P, Jin H (2010) Benchmark object for virtual machines, 2010 second international workshop on education technology and computer science
3.
Zurück zum Zitat Kolb L, Thor A, Rahm E (2012) Load balancing for mapreduce-based entity resolution, 2012 IEEE 28th international conference on data engineering Kolb L, Thor A, Rahm E (2012) Load balancing for mapreduce-based entity resolution, 2012 IEEE 28th international conference on data engineering
4.
Zurück zum Zitat Zhu T, Shu C, Yu H (2011) Green scheduling: a scheduling policy for improving the energy efficiency of fair scheduler, 2011 12th international conference on parallel and distributed computing, applications and technologies Zhu T, Shu C, Yu H (2011) Green scheduling: a scheduling policy for improving the energy efficiency of fair scheduler, 2011 12th international conference on parallel and distributed computing, applications and technologies
5.
Zurück zum Zitat Sandhya SV, Sanjay HA, Netravathi SJ, Sowmyashree MV, Yogeshwari RN (2009) Fault–tolerant master-workers framework for mapreduce applications, 2009 international conference on advances in recent technologies in communication and computing Sandhya SV, Sanjay HA, Netravathi SJ, Sowmyashree MV, Yogeshwari RN (2009) Fault–tolerant master-workers framework for mapreduce applications, 2009 international conference on advances in recent technologies in communication and computing
6.
Zurück zum Zitat Liu C, Zhou S (2011) Local and global optimization of mapreduce program model, 2011 IEEE world congress on services Liu C, Zhou S (2011) Local and global optimization of mapreduce program model, 2011 IEEE world congress on services
7.
Zurück zum Zitat He Q, Li Z, Zhang X (2010) Study on cloud storage system based on distributed storage systems, computational and information sciences (ICCIS), 17–19 Dec 2010, pp 1332–1335 He Q, Li Z, Zhang X (2010) Study on cloud storage system based on distributed storage systems, computational and information sciences (ICCIS), 17–19 Dec 2010, pp 1332–1335
8.
Zurück zum Zitat Bowers KD, Juels A, Oprea A (2009) HAIL: a high availability and integrity layer for cloud storage, computer and communications security (CCS), Nov 2009, pp 187–198 Bowers KD, Juels A, Oprea A (2009) HAIL: a high availability and integrity layer for cloud storage, computer and communications security (CCS), Nov 2009, pp 187–198
9.
Zurück zum Zitat Luo M, Liu G (2010) Distributed log information processing with Map-Reduce: a case study from raw data to final models, information theory and information security (ICITIS), 17–19 Dec 2010, pp 1143–1146 Luo M, Liu G (2010) Distributed log information processing with Map-Reduce: a case study from raw data to final models, information theory and information security (ICITIS), 17–19 Dec 2010, pp 1143–1146
Metadaten
Titel
Green Master Based on MapReduce Cluster
verfasst von
Ming-Zhi Wu
Yu-Chang Lin
Wei-Tsong Lee
Yu-Sun Lin
Fong-Hao Liu
Copyright-Jahr
2014
Verlag
Springer Netherlands
DOI
https://doi.org/10.1007/978-94-007-7262-5_63

Neuer Inhalt