ABSTRACT
Cloud-based data management platforms often employ multitenant databases, where service providers achieve economies of scale by consolidating multiple tenants on shared servers. In such database systems, a key functionality for service providers is database migration, which is useful for dynamic provisioning, load balancing, and system maintenance. Practical migration solutions have several requirements, including high availability, low performance overhead, and self-management. We present Slacker, an end-to-end database migration system at the middleware level satisfying these requirements. Slacker leverages off-the-shelf hot backup tools to achieve live migration with effectively zero down-time. Additionally, Slacker minimizes the performance impact of migrations on both the migrating tenant and collocated tenants by leveraging 'migration slack', or resources that can be used for migration without excessively impacting query latency. We apply a PID controller to this problem, allowing Slacker to automatically detect and exploit migration slack in real time. Using our prototype, we demonstrate that Slacker effectively controls interference during migrations, maintaining latency within 10% of a given latency target, while still performing migrations rapidly and efficiently.
- K. H. Ang, G. Chong, and Y. Li. PID control system analysis, design, and technology. IEEE Transactions on Control Systems Technology, 13(4):559--576, 2005.Google ScholarCross Ref
- P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In SOSP, 2003. Google ScholarDigital Library
- R. Bradford, E. Kotsovinos, A. Feldmann, and H. Schiöberg. Live wide-area migration of virtual machines including local persistent state. In VEE, 2007. Google ScholarDigital Library
- E. Cecchet, R. Singh, U. Sharma, and P. J. Shenoy. Dolly: virtualization-driven database provisioning for the cloud. In VEE, 2011. Google ScholarDigital Library
- B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with ycsb. In SOCC, 2010. Google ScholarDigital Library
- C. Curino, E. Jones, R. A. Popa, N. Malviya, E. Wu, S. Madden, H. Balakrishnan, and N. Zeldovich. Relational Cloud: A Database Service for the Cloud. In CIDR, 2011.Google Scholar
- C. Curino, E. P. C. Jones, S. Madden, and H. Balakrishnan. Workload-aware database monitoring and consolidation. In SIGMOD, 2011. Google ScholarDigital Library
- S. Das, S. Nishimura, D. Agrawal, and A. E. Abbadi. Albatross: Lightweight elasticity in shared storage databases for the cloud using live data migration. PVLDB, 4, 2011. Google ScholarDigital Library
- A. J. Elmore, S. Das, D. Agrawal, and A. El Abbadi. Who's driving this cloud? towards efficient migration for elastic and autonomic multitenant databases. Technical Report CS-2010-05, UCSB, 2010.Google Scholar
- A. J. Elmore, S. Das, D. Agrawal, and A. El Abbadi. Zephyr: live migration in shared nothing databases for elastic cloud platforms. In SIGMOD, 2011. Google ScholarDigital Library
- H. Hacigümüş, J. Tatemura, W.-P. Hsiung, H. J. Moon, O. Po, A. Sawires, Y. Chi, and H. Jafarpour. CloudDB: One size fits all revived. In SERVICES, 2010.Google Scholar
- C. C. Keir, C. Clark, K. Fraser, S. H, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In NSDI, 2005. Google ScholarDigital Library
- W. S. Levine. The Control Handbook. CRC, 2011.Google Scholar
- Z. Liu, W. Qu, W. Liu, and K. Li. Xen live migration with slowdown scheduling algorithm. In PDCAT, 2010. Google ScholarDigital Library
- Oracle mysqldump -- a database backup program. http://dev.mysql.com/doc/refman/5.1/en/mysqldump.html.Google Scholar
- D. S. Milojičić, F. Douglis, Y. Paindaveine, R. Wheeler, and S. Zhou. Process migration. ACM Comput. Surv., 32:241--299, 2000. Google ScholarDigital Library
- Google Protocol Buffers. http://code.google.com/apis/protocolbuffers/.Google Scholar
- P. Padala, K. G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, and K. Salem. Adaptive control of virtualized resources in utility computing environments. In EuroSys, 2007. Google ScholarDigital Library
- M. L. Powell and B. P. Miller. Process migration in DEMOS/MP. In SOSP, 1983. Google ScholarDigital Library
- B. Schroeder, A. Wierman, and M. Harchol-Balter. Open versus closed: A cautionary tale. In NSDI, 2006. Google ScholarDigital Library
- B. Schwartz and P. Zaitsev. A brief introduction to goal-driven performance optimization. White paper, Percona, 2010.Google Scholar
- A. A. Soror, U. F. Minhas, A. Aboulnaga, K. Salem, P. Kokosielis, and S. Kamath. Automatic virtual machine configuration for database workloads. ACM Trans. Database Syst., 35(1), 2010. Google ScholarDigital Library
- J. Tatemura and H. Hacigümüş. Microsharding: A declarative approach to support elastic OLTP workloads. In LADIS, 2011.Google Scholar
- Y. -C. Tu, S. Liu, S. Prabhakar, and B. Yao. Load shedding in stream databases: a control-based approach. In VLDB, 2006. Google ScholarDigital Library
- Percona XtraBackup. http://www.percona.com/software/percona-xtrabackup/.Google Scholar
- P. Xiong, Y. Chi, S. Zhu, H. J. Moon, C. Pu, and H. Hacigümüş. Intelligent management of virtualized resources for database systems in cloud environment. In ICDE, 2011. Google ScholarDigital Library
- F. Yang, J. Shanmugasundaram, and R. Yerneni. A scalable data platform for a large number of small applications. In CIDR, 2009.Google Scholar
- J. G. Ziegler and N. B. Nichols. Optimal settings for automatic controllers. Transactions of the ASME, 64:759--768, 1942.Google Scholar
Index Terms
- "Cut me some slack": latency-aware live migration for databases
Recommendations
Zephyr: live migration in shared nothing databases for elastic cloud platforms
SIGMOD '11: Proceedings of the 2011 ACM SIGMOD International Conference on Management of dataMultitenant data infrastructures for large cloud platforms hosting hundreds of thousands of applications face the challenge of serving applications characterized by small data footprint and unpredictable load patterns. When such a platform is built on ...
A demonstration of SQLVM: performance isolation in multi-tenant relational database-as-a-service
SIGMOD '13: Proceedings of the 2013 ACM SIGMOD International Conference on Management of DataSharing resources of a single database server among multiple tenants is common in multi-tenant Database-as-a-Service providers, such as Microsoft SQL Azure. Multi-tenancy enables cost reduction for the cloud service provider which it can pass on as ...
Comments