Skip to main content

2017 | OriginalPaper | Buchkapitel

Improving ZooKeeper Atomic Broadcast Performance by Coin Tossing

verfasst von : Ibrahim EL-Sanosi, Paul Ezhilchelvan

Erschienen in: Computer Performance Engineering

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

ZooKeeper atomic broadcast (Zab) is at the core of ZooKeeper system, enforcing a total order on service requests that seek to modify the replicated service state. Since it is a leader based protocol, its performance degrades when the leader server is made to handle an increased message traffic. We address this concern by having the other, non-leader server replicas toss a coin and broadcast their acknowledgement of a leader’s proposal only if the toss results in an outcome of Head. We model the coin-tossing process and derive analytical expressions for estimating the coin’s probability of Head for a given arrival rate of service requests such that the dual objectives of performance gains and traffic reduction can be accomplished. Experiments compare the performance of our coin-tossing Zab version (ZabCT) with Zab performance and confirm that the dual objectives are demonstrably met under heavy workloads. Moreover, ZabCT meets all requirements essential for crash-tolerance provisions within Zab which can therefore be adopted in any ZabCT implementation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Biely, M., Milosevic, Z., Santos, N., Schiper, A.: S-paxos: offloading the leader for high throughput state machine replication. In: IEEE 31st Symposium on Reliable Distributed Systems (SRDS), pp. 111–120 (2012) Biely, M., Milosevic, Z., Santos, N., Schiper, A.: S-paxos: offloading the leader for high throughput state machine replication. In: IEEE 31st Symposium on Reliable Distributed Systems (SRDS), pp. 111–120 (2012)
3.
Zurück zum Zitat Chandra, T.D., Griesemer, R., Redstone, J.: Paxos made live: an engineering perspective. In: Proceedings of the Twenty-Sixth Annual ACM Symposium on Principles of Distributed Computing, pp. 398–407 (2007) Chandra, T.D., Griesemer, R., Redstone, J.: Paxos made live: an engineering perspective. In: Proceedings of the Twenty-Sixth Annual ACM Symposium on Principles of Distributed Computing, pp. 398–407 (2007)
4.
Zurück zum Zitat Défago, X., Schiper, A., Urbán, P.: Total order broadcast and multicast algorithms: taxonomy and survey. ACM Comput. Surv. (CSUR) 36(4), 372–421 (2004)CrossRef Défago, X., Schiper, A., Urbán, P.: Total order broadcast and multicast algorithms: taxonomy and survey. ACM Comput. Surv. (CSUR) 36(4), 372–421 (2004)CrossRef
5.
Zurück zum Zitat Emerson, R., Ezhilchelvan, P.: An atomic-multicast service for scalable in-memory transaction systems. In: 2014 IEEE 6th International Conference on Cloud Computing Technology and Science (CloudCom), pp. 743–746. IEEE (2014) Emerson, R., Ezhilchelvan, P.: An atomic-multicast service for scalable in-memory transaction systems. In: 2014 IEEE 6th International Conference on Cloud Computing Technology and Science (CloudCom), pp. 743–746. IEEE (2014)
6.
Zurück zum Zitat George, L.: HBase: The Definitive Guide. O’Reilly Media, Inc., Sebastopol (2011) George, L.: HBase: The Definitive Guide. O’Reilly Media, Inc., Sebastopol (2011)
7.
Zurück zum Zitat Hunt, P., Konar, M., Junqueira, F.P., Reed, B.: Zookeeper: wait-free coordination for internet-scale systems. In: USENIX Annual Technical Conference, vol. 8, p. 9 (2010) Hunt, P., Konar, M., Junqueira, F.P., Reed, B.: Zookeeper: wait-free coordination for internet-scale systems. In: USENIX Annual Technical Conference, vol. 8, p. 9 (2010)
8.
Zurück zum Zitat Junqueira, F.P., Reed, B.C., Serafini, M.: Zab: high-performance broadcast for primary-backup systems. In: IEEE/IFIP 41th International Conference on Dependable Systems & Networks (DSN), pp. 245–256. IEEE (2011) Junqueira, F.P., Reed, B.C., Serafini, M.: Zab: high-performance broadcast for primary-backup systems. In: IEEE/IFIP 41th International Conference on Dependable Systems & Networks (DSN), pp. 245–256. IEEE (2011)
9.
Zurück zum Zitat Lamport, L.: Time, clocks, and the ordering of events in a distributed system. Commun. ACM 21(7), 558–565 (1978)CrossRefMATH Lamport, L.: Time, clocks, and the ordering of events in a distributed system. Commun. ACM 21(7), 558–565 (1978)CrossRefMATH
10.
Zurück zum Zitat Lamport, L.: Paxos made simple. ACM Sigact News 32(4), 18–25 (2001) Lamport, L.: Paxos made simple. ACM Sigact News 32(4), 18–25 (2001)
12.
Zurück zum Zitat Mao, Y., Junqueira, F.P., Marzullo, K.: Mencius: building efficient replicated state machines for WANs. OSDI 8, 369–384 (2008) Mao, Y., Junqueira, F.P., Marzullo, K.: Mencius: building efficient replicated state machines for WANs. OSDI 8, 369–384 (2008)
13.
Zurück zum Zitat Reed, B., Junqueira, F.P.: A simple totally ordered broadcast protocol. In: proceedings of the 2nd Workshop on Large-Scale Distributed Systems and Middleware (LADIS), pp. 1–6. ACM (2008) Reed, B., Junqueira, F.P.: A simple totally ordered broadcast protocol. In: proceedings of the 2nd Workshop on Large-Scale Distributed Systems and Middleware (LADIS), pp. 1–6. ACM (2008)
14.
Zurück zum Zitat Ruivo, P., Couceiro, M., Romano, P., Rodrigues, L.: Exploiting total order multicast in weakly consistent transactional caches. In: IEEE 17th Pacific Rim International Symposium on Dependable Computing (PRDC), pp. 99–108 (2011) Ruivo, P., Couceiro, M., Romano, P., Rodrigues, L.: Exploiting total order multicast in weakly consistent transactional caches. In: IEEE 17th Pacific Rim International Symposium on Dependable Computing (PRDC), pp. 99–108 (2011)
15.
Zurück zum Zitat Shvachko, K., Kuang, H., Radia, S., Chansler, R.: The hadoop distributed file system. In: IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), vol. 2, pp. 1–10 (2010) Shvachko, K., Kuang, H., Radia, S., Chansler, R.: The hadoop distributed file system. In: IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), vol. 2, pp. 1–10 (2010)
16.
Zurück zum Zitat Toshniwal, A., Taneja, S., Shukla, A., Ramasamy, K., Patel, J.M., Kulkarni, S., Jackson, J., Gade, K., Fu, M., Donham, J.: Storm@twitter. In: Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data, pp. 147–156 (2014) Toshniwal, A., Taneja, S., Shukla, A., Ramasamy, K., Patel, J.M., Kulkarni, S., Jackson, J., Gade, K., Fu, M., Donham, J.: Storm@twitter. In: Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data, pp. 147–156 (2014)
17.
Zurück zum Zitat Van Renesse, R., Schneider, F.B.: Chain replication for supporting high throughput and availability. OSDI 4, 91–104 (2004) Van Renesse, R., Schneider, F.B.: Chain replication for supporting high throughput and availability. OSDI 4, 91–104 (2004)
Metadaten
Titel
Improving ZooKeeper Atomic Broadcast Performance by Coin Tossing
verfasst von
Ibrahim EL-Sanosi
Paul Ezhilchelvan
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-66583-2_16

Neuer Inhalt