Sudipto Das
Shoji Nishimura
Divyakant Agrawal
Amr El Abbadi
Abstract
Database systems serving cloud platforms must serve large numbers of applications (or tenants). In addition to managing tenants with small data footprints, different schemas, and variable load patterns, such multitenant data platforms must minimize their operating costs by efficient resource sharing. When deployed over a pay-per-use infrastructure, elastic scaling and load balancing, enabled by low cost live migration of tenant databases, is critical to tolerate load variations while minimizing operating cost. However, existing databases---relational databases and Key-Value stores alike---lack low cost live migration techniques, thus resulting in heavy performance impact during elastic scaling. We present Albatross, a technique for live migration in a multitenant database serving OLTP style workloads where the persistent database image is stored in a network attached storage. Albatross migrates the database cache and the state of active transactions to ensure minimal impact on transaction execution while allowing transactions active during migration to continue execution. It also guarantees serializability while ensuring correctness during failures. Our evaluation using two OLTP benchmarks shows that Albatross can migrate a live tenant database with no aborted transactions, negligible impact on transaction latency and throughput both during and after migration, and an unavailability window as low as 300 ms.
- P. A. Bernstein et al. Adapting Microsoft SQL Server for Cloud Computing. In ICDE (to appear), 2011. Google Scholar
Digital Library
- P. A. Bernstein and E. Newcomer. Principles of Transaction Processing. MK Publishers Inc., second edition, 2009.Google Scholar
- R. Bradford, E. Kotsovinos, A. Feldmann, and H. Schiöberg. Live wide-area migration of virtual machines including local persistent state. In VEE, pages 169--179, 2007. Google ScholarDigital Library
- F. Chang et al. Bigtable: A Distributed Storage System for Structured Data. In OSDI, pages 205--218, 2006. Google ScholarDigital Library
- C. Clark et al. Live migration of virtual machines. In NSDI, pages 273--286, 2005. Google ScholarDigital Library
- B. F. Cooper et al. PNUTS: Yahoo!'s hosted data serving platform. Proc. VLDB Endow., 1(2):1277--1288, 2008. Google ScholarDigital Library
- B. F. Cooper et al. Benchmarking Cloud Serving Systems with YCSB. In ACM SoCC, pages 143--154, 2010. Google ScholarDigital Library
- C. Curino et al. Relational Cloud: A Database Service for the Cloud. In CIDR, pages 235--240, 2011.Google Scholar
- S. Das, S. Agarwal, D. Agrawal, and A. El Abbadi. ElasTraS: An Elastic, Scalable, and Self Managing Transactional Database for the Cloud. Technical Report 2010-04, CS, UCSB, 2010.Google Scholar
- S. Das, D. Agrawal, and A. El Abbadi. ElasTraS: An Elastic Transactional Data Store in the Cloud. In USENIX HotCloud, 2009. Google ScholarDigital Library
- S. Das, D. Agrawal, and A. El Abbadi. G-Store: A Scalable Data Store for Transactional Multi key Access in the Cloud. In ACM SoCC, pages 163--174, 2010. Google ScholarDigital Library
- A. J. Elmore, S. Das, D. Agrawal, and A. El Abbadi. Zephyr: Live Migration in Shared Nothing Databases for Elastic Cloud Platforms. In SIGMOD (to appear), 2011. Google ScholarDigital Library
- J. Gray. Notes on data base operating systems. In Operating Systems, An Advanced Course, volume 60, pages 393--481. Springer-Verlag, 1978. Google ScholarDigital Library
- D. Jacobs and S. Aulbach. Ruminations on multi-tenant databases. In BTW, pages 514--521, 2007.Google Scholar
- T. Kraska, M. Hentschel, G. Alonso, and D. Kossmann. Consistency Rationing in the Cloud: Pay only when it matters. PVLDB, 2(1):253--264, 2009. Google ScholarDigital Library
- H. T. Kung and J. T. Robinson. On optimistic methods for concurrency control. ACM TODS, 6(2):213--226, 1981. Google ScholarDigital Library
- H. Liu, H. Jin, X. Liao, L. Hu, and C. Yu. Live migration of virtual machine based on full system trace and replay. In HPDC, pages 101--110, 2009. Google ScholarDigital Library
- D. B. Lomet, A. Fekete, G. Weikum, and M. J. Zwilling. Unbundling transaction services in the cloud. In CIDR Perspectives, 2009.Google Scholar
- G. H. Sockut and B. R. Iyer. Online reorganization of databases. ACM Comput. Surv., 41(3):1--136, 2009. Google ScholarDigital Library
- The Transaction Processing Performance Council. TPC-C benchmark (Version 5.10.1), 2009.Google Scholar
- C. D. Weissman and S. Bobrowski. The design of the force.com multitenant internet application development platform. In SIGMOD, pages 889--896, 2009. Google ScholarDigital Library
- P. Xiong et al. Intelligent management of virtualized resources for database systems in cloud environment. In ICDE (to appear), 2011. Google ScholarDigital Library
- F. Yang, J. Shanmugasundaram, and R. Yerneni. A scalable data platform for a large number of small applications. In CIDR, 2009.Google Scholar
Index Terms
- Albatross: lightweight elasticity in shared storage databases for the cloud using live data migration
Recommendations
Albatross: A Privacy-Preserving Location Sharing System
ASIA CCS '15: Proceedings of the 10th ACM Symposium on Information, Computer and Communications SecurityWe describe an architecture and a trial implementation of a privacy-preserving location sharing system called Albatross. The system protects location information from the service provider and yet enables fine-grained location-sharing. One main feature ...
SRVM: Hypervisor Support for Live Migration with Passthrough SR-IOV Network Devices
VEE '16Single-Root I/O Virtualization (SR-IOV) is a specification that allows a single PCI Express (PCIe) device (ysical function or PF) to be used as multiple PCIe devices (virtual functions or VF). In a virtualization system, each VF can be directly assigned ...
Comments