Skip to main content

2016 | OriginalPaper | Buchkapitel

Low Overhead Log Replication for Main Memory Database System

verfasst von : Jinwei Guo, Chendong Zhang, Peng Cai, Minqi Zhou, Aoying Zhou

Erschienen in: Web-Age Information Management

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Log replication is the key component of high available database system. To guarantee data consistency and reliability, modern database systems often use Paxos protocol to replicate log in multiple database instance sites. Since the replicated logs need to contain some metadata such as committed log sequence number (LSN), this increases the overhead of storage and network. It has significantly negative impact on the throughput in the update intensive work load. In this paper, we present an implementation of log replication and database recovery, which adopts the idea of piggybacking, i.e. committed LSN is embedded in the commit logs. This practice not only retains virtues of Paxos replication, but also reduces disk and network IO effectively, which enhances performance and decreases recovery time. We implemented and evaluated our approach in a main memory database system (Oceanbase), and found that our method can offer 1.3x higher throughput than traditional log replication with synchronization mechanism.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cattell, R.: Scalable SQL and noSQL data stores. SIGMOD Rec. 39(4), 12–27 (2010)CrossRef Cattell, R.: Scalable SQL and noSQL data stores. SIGMOD Rec. 39(4), 12–27 (2010)CrossRef
2.
Zurück zum Zitat Stonebraker, M., Cetintemel, U.: “One size fits all”: an idea whose time has come and gone. In: Proceedings of ICDE, pp. 2–11 (2005) Stonebraker, M., Cetintemel, U.: “One size fits all”: an idea whose time has come and gone. In: Proceedings of ICDE, pp. 2–11 (2005)
3.
5.
Zurück zum Zitat Mohan, C., et al.: ARIES: a transaction recovery method supporting fine-granularity locking and partial roll backs using write-ahead logging. TODS 17(1), 94–162 (1992)CrossRef Mohan, C., et al.: ARIES: a transaction recovery method supporting fine-granularity locking and partial roll backs using write-ahead logging. TODS 17(1), 94–162 (1992)CrossRef
6.
Zurück zum Zitat DeCandia G., Hastorun D., Jampani M., Kakulapati, G., Lakshman, A., Pilchin, A., Sivasubramanian, S., Vosshall, P., Vogels, W.: Dynamo: amazons highlyavailable key-value store. In: Proceedings of SOSP, pp. 205–220 (2007) DeCandia G., Hastorun D., Jampani M., Kakulapati, G., Lakshman, A., Pilchin, A., Sivasubramanian, S., Vosshall, P., Vogels, W.: Dynamo: amazons highlyavailable key-value store. In: Proceedings of SOSP, pp. 205–220 (2007)
7.
Zurück zum Zitat Lakshman, A., Malik, P.: Cassandra: a decentralized structured storage system. SIGOPS 44(2), 35–40 (2010)CrossRef Lakshman, A., Malik, P.: Cassandra: a decentralized structured storage system. SIGOPS 44(2), 35–40 (2010)CrossRef
9.
Zurück zum Zitat Cooper, B.F., Ramakrishnan, R., Srivastava, U., et al.: PUNTS: Yahoo!’s hosted data serving platform. In: Proceedings of VLDB, pp. 1277–1288 (2008) Cooper, B.F., Ramakrishnan, R., Srivastava, U., et al.: PUNTS: Yahoo!’s hosted data serving platform. In: Proceedings of VLDB, pp. 1277–1288 (2008)
10.
Zurück zum Zitat Lamport, L.: Paxos made simple. SIGACT 32(4), 18–25 (2001) Lamport, L.: Paxos made simple. SIGACT 32(4), 18–25 (2001)
12.
Zurück zum Zitat Ongard, D., Ousterhout, J.: In search of an understandable consensus algorithm. In: Proceedings of ATC (2014) Ongard, D., Ousterhout, J.: In search of an understandable consensus algorithm. In: Proceedings of ATC (2014)
14.
Zurück zum Zitat Ousterhout, J., Agrawal, P., Erikson, D., et al.: The case for RAMCloud. CACM 54, 121–130 (2011)CrossRef Ousterhout, J., Agrawal, P., Erikson, D., et al.: The case for RAMCloud. CACM 54, 121–130 (2011)CrossRef
15.
Zurück zum Zitat Burrows, M.: The chubby lock service for loosely coupled distributed systems. In: Proceedings of OSDI, pp. 335–350 (2006) Burrows, M.: The chubby lock service for loosely coupled distributed systems. In: Proceedings of OSDI, pp. 335–350 (2006)
17.
Zurück zum Zitat Baker, J., Bond, C., Corbett, J.C., Megastore, et al.: Providing scalable, highly available storage for interactive services. In: Proceedings of CIDR, pp. 223–234 (2011) Baker, J., Bond, C., Corbett, J.C., Megastore, et al.: Providing scalable, highly available storage for interactive services. In: Proceedings of CIDR, pp. 223–234 (2011)
18.
Zurück zum Zitat Corbett J.C., Dean J., Epstein, M.: Spanner: Googles globally distributed database. In: Proceedings of OSDI (2012) Corbett J.C., Dean J., Epstein, M.: Spanner: Googles globally distributed database. In: Proceedings of OSDI (2012)
19.
Zurück zum Zitat Shute, J., Vingralek, R., Bart, S., et al.: F1: a distributed SQL database that scales. In: Proceedings of VLDB, pp. 1068–1079 (2013) Shute, J., Vingralek, R., Bart, S., et al.: F1: a distributed SQL database that scales. In: Proceedings of VLDB, pp. 1068–1079 (2013)
20.
Zurück zum Zitat Rao, J., Shekita, E.J., Tata, S.: Using paxos to bulid a scalable, consistent, highly available datastore. In: Proceedings of VLDB, pp. 243–254 (2011) Rao, J., Shekita, E.J., Tata, S.: Using paxos to bulid a scalable, consistent, highly available datastore. In: Proceedings of VLDB, pp. 243–254 (2011)
21.
Zurück zum Zitat Patterson, S., et al.: Serializability, not serial: concurrency control and availability in multi-datacenter datastores. Proc. VLDB Endow. 5(11), 1459–1470 (2012)CrossRef Patterson, S., et al.: Serializability, not serial: concurrency control and availability in multi-datacenter datastores. Proc. VLDB Endow. 5(11), 1459–1470 (2012)CrossRef
22.
Zurück zum Zitat Dragojevic, A., Narayanan, D., et al.: No compromises: distributed transactions with consistency, availability, and performance. In: Proceedings of SOSP, pp. 54–70 (2015) Dragojevic, A., Narayanan, D., et al.: No compromises: distributed transactions with consistency, availability, and performance. In: Proceedings of SOSP, pp. 54–70 (2015)
23.
Zurück zum Zitat Thomson, A., Diamond, T., et al.: Calvin: fast distributed transactions for partitioned database systems. In: Proceedings of SIGMOD, pp. 1–12 (2012) Thomson, A., Diamond, T., et al.: Calvin: fast distributed transactions for partitioned database systems. In: Proceedings of SIGMOD, pp. 1–12 (2012)
Metadaten
Titel
Low Overhead Log Replication for Main Memory Database System
verfasst von
Jinwei Guo
Chendong Zhang
Peng Cai
Minqi Zhou
Aoying Zhou
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-39958-4_13

Neuer Inhalt