Rebecca Taft
Marco Serafini
Ashraf Aboulnaga
Michael Stonebraker
Abstract
On-line transaction processing (OLTP) database management systems (DBMSs) often serve time-varying workloads due to daily, weekly or seasonal fluctuations in demand, or because of rapid growth in demand due to a company's business success. In addition, many OLTP workloads are heavily skewed to "hot" tuples or ranges of tuples. For example, the majority of NYSE volume involves only 40 stocks. To deal with such fluctuations, an OLTP DBMS needs to be elastic; that is, it must be able to expand and contract resources in response to load fluctuations and dynamically balance load as hot tuples vary over time.
This paper presents E-Store, an elastic partitioning framework for distributed OLTP DBMSs. It automatically scales resources in response to demand spikes, periodic events, and gradual changes in an application's workload. E-Store addresses localized bottlenecks through a two-tier data placement strategy: cold data is distributed in large chunks, while smaller ranges of hot tuples are assigned explicitly to individual nodes. This is in contrast to traditional single-tier hash and range partitioning strategies. Our experimental evaluation of E-Store shows the viability of our approach and its efficacy under variations in load across a cluster of machines. Compared to single-tier approaches, E-Store improves throughput by up to 130% while reducing latency by 80%.
- S. K. Barker, Y. Chi, H. J. Moon, H. Hacigümüş, and P. J. Shenoy. "cut me some slack": latency-aware live migration for databases. In EDBT, 2012. Google Scholar
Digital Library
- B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with YCSB. In SOCC, 2010. Google ScholarDigital Library
- C. Curino, E. Jones, Y. Zhang, and S. Madden. Schism: A workload-driven approach to database replication and partitioning. PVLDB, 3(1--2), 2010. Google ScholarDigital Library
- C. Curino, E. P. C. Jones, S. Madden, and H. Balakrishnan. Workload-aware database monitoring and consolidation. In SIGMOD, 2011. Google ScholarDigital Library
- S. Das, D. Agrawal, and A. El Abbadi. Elastras: An elastic, scalable, and self-managing transactional database for the cloud. ACM Transactions on Database Systems, 38(1): 5:1--5:45, 2013. Google ScholarDigital Library
- S. Das, S. Nishimura, D. Agrawal, and A. El Abbadi. Albatross: Lightweight elasticity in shared storage databases for the cloud using live data migration. PVLDB, 4(8), 2011. Google ScholarDigital Library
- K. Dias, M. Ramacher, U. Shaft, V. Venkataramani, and G. Wood. Automatic performance diagnosis and tuning in oracle. In CIDR, 2005.Google Scholar
- A. J. Elmore. Elasticity Primitives for Database as a Service. PhD thesis, University of California, Santa Barbara, 2013.Google Scholar
- A. J. Elmore, S. Das, D. Agrawal, and A. El Abbadi. Towards an elastic and autonomic multitenant database. In NetDB, 2011.Google Scholar
- A. J. Elmore, S. Das, D. Agrawal, and A. El Abbadi. Zephyr: Live migration in shared nothing databases for elastic cloud platforms. In SIGMOD, 2011. Google ScholarDigital Library
- N. Folkman. So, that was a bummer. http://is.gd/SRF0sb.Google Scholar
- P. Ganesan, M. Bawa, and H. Garcia-Molina. Online balancing of range-partitioned data with applications to peer-to-peer systems. In VLDB, 2004. Google ScholarDigital Library
- J. Gaw. Heavy Traffic Crashes Britannica's Web Site -- Los Angeles Times. http://lat.ms/1fXLjYx, 1999.Google Scholar
- Y.-J. Hong and M. Thottethodi. Understanding and mitigating the impact of load imbalance in the memory caching tier. In SOCC, 2013. Google ScholarDigital Library
- H-Store: A Next Generation OLTP DBMS. http://hstore.cs.brown.edu.Google Scholar
- E. P. Jones. Fault-Tolerant Distributed Transactions for Partitioned OLTP Databases. PhD thesis, MIT, 2012. Google ScholarDigital Library
- D. Josephsen. Building a Monitoring Infrastructure with Nagios. Prentice Hall PTR, USA, 2007. Google ScholarDigital Library
- R. Kallman et al. H-store: A high-performance, distributed main memory transaction processing system. PVLDB, 1(2), 2008. Google ScholarDigital Library
- N. Malviya, A. Weisberg, S. Madden, and M. Stonebraker. Rethinking main memory OLTP recovery. In ICDE, 2014.Google ScholarCross Ref
- G. S. Manku and R. Motwani. Approximate frequency counts over data streams. In VLDB, 2002. Google ScholarDigital Library
- A. Metwally, D. Agrawal, and A. El Abbadi. Efficient computation of frequent and top-k elements in data streams. In ICDT, 2005. Google ScholarDigital Library
- U. F. Minhas, R. Liu, A. Aboulnaga, K. Salem, J. Ng, and S. Robertson. Elastic scale-out for partition-based database systems. In ICDE Workshops, 2012. Google ScholarDigital Library
- A. Nazaruk and M. Rauchman. Big data in capital markets. In ICMD, 2013. Google ScholarDigital Library
- R. Nishtala et al. Scaling memcache at facebook. In NSDI, 2013. Google ScholarDigital Library
- NuoDB. http://www.nuodb.com.Google Scholar
- A. Pavlo, C. Curino, and S. Zdonik. Skew-aware automatic database partitioning in shared-nothing, parallel OLTP systems. In SIGMOD, 2012. Google ScholarDigital Library
- A. Pavlo, E. P. C. Jones, and S. Zdonik. On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems. PVLDB, 5(2): 85--96, 2011. Google ScholarDigital Library
- O. Schiller, N. Cipriani, and B. Mitschang. ProRea: Live Database Migration for Multi-Tenant RDBMS with Snapshot Isolation. In EDBT, 2013. Google ScholarDigital Library
- M. Serafini, E. Mansour, A. Aboulnaga, K. Salem, T. Rafiq, and U. F. Minhas. Accordion: Elastic scalability for database systems supporting distributed transactions. PVLDB, 7(12), 2014. Google ScholarDigital Library
- I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H. Balakrishnan. Chord: A scalable peer-to-peer lookup service for internet applications. In SIGCOMM, 2001. Google ScholarDigital Library
- R. Stoica, J. J. Levandoski, and P.-A. Larson. Identifying hot and cold data in main-memory databases. In ICDE, 2013. Google ScholarDigital Library
- M. Stonebraker et al. The end of an architectural era: (it's time for a complete rewrite). In VLDB, 2007. Google ScholarDigital Library
- M. Stonebraker and A. Weisberg. The VoltDB main memory DBMS. IEEE Data Eng. Bull, 36(2), 2013.Google Scholar
- P. Tözün, I. Pandis, R. Johnson, and A. Ailamaki. Scalable and dynamically balanced shared-everything oltp with physiological partitioning. The VLDB Journal, 22(2): 151--175, 2013. Google ScholarDigital Library
- The TPC-C Benchmark, 1992. http://www.tpc.org/tpcc/.Google Scholar
- VoltDB. http://www.voltdb.com.Google Scholar
Recommendations
Store and Visualize EER in Neo4j
ISCSIC '18: Proceedings of the 2nd International Symposium on Computer Science and Intelligent ControlNoSQL databases have become very popular in the last few years. Graph databases, as a major NoSQL database type, are used for many problems. In relational databases, conceptual modeling is very important, for which Enhanced Entity-Relationship (EER) ...
Shopping Behavior and Consumer Preference for Store Price Format: Why "Large Basket" Shoppers Prefer EDLP
In recent years, the supermarket industry has become increasingly competitive. One outcome has been the proliferation of a variety of pricing formats, and considerable debate among academics and practitioners about how these formats affect consumers' ...
Shopping Behavior and Consumer Preference for Store Price Format: Why "Large Basket" Shoppers Prefer EDLP
<P>In recent years, the supermarket industry has become increasingly competitive. One outcome has been the proliferation of a variety of pricing formats, and considerable debate among academics and practitioners about how these formats affect consumers' ...
Comments