skip to main content
10.1145/2247596.2247647acmotherconferencesArticle/Chapter ViewAbstractPublication PagesedbtConference Proceedingsconference-collections
research-article

"Cut me some slack": latency-aware live migration for databases

Published:27 March 2012Publication History

ABSTRACT

Cloud-based data management platforms often employ multitenant databases, where service providers achieve economies of scale by consolidating multiple tenants on shared servers. In such database systems, a key functionality for service providers is database migration, which is useful for dynamic provisioning, load balancing, and system maintenance. Practical migration solutions have several requirements, including high availability, low performance overhead, and self-management. We present Slacker, an end-to-end database migration system at the middleware level satisfying these requirements. Slacker leverages off-the-shelf hot backup tools to achieve live migration with effectively zero down-time. Additionally, Slacker minimizes the performance impact of migrations on both the migrating tenant and collocated tenants by leveraging 'migration slack', or resources that can be used for migration without excessively impacting query latency. We apply a PID controller to this problem, allowing Slacker to automatically detect and exploit migration slack in real time. Using our prototype, we demonstrate that Slacker effectively controls interference during migrations, maintaining latency within 10% of a given latency target, while still performing migrations rapidly and efficiently.

References

  1. K. H. Ang, G. Chong, and Y. Li. PID control system analysis, design, and technology. IEEE Transactions on Control Systems Technology, 13(4):559--576, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  2. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In SOSP, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. R. Bradford, E. Kotsovinos, A. Feldmann, and H. Schiöberg. Live wide-area migration of virtual machines including local persistent state. In VEE, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. E. Cecchet, R. Singh, U. Sharma, and P. J. Shenoy. Dolly: virtualization-driven database provisioning for the cloud. In VEE, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with ycsb. In SOCC, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. C. Curino, E. Jones, R. A. Popa, N. Malviya, E. Wu, S. Madden, H. Balakrishnan, and N. Zeldovich. Relational Cloud: A Database Service for the Cloud. In CIDR, 2011.Google ScholarGoogle Scholar
  7. C. Curino, E. P. C. Jones, S. Madden, and H. Balakrishnan. Workload-aware database monitoring and consolidation. In SIGMOD, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. S. Das, S. Nishimura, D. Agrawal, and A. E. Abbadi. Albatross: Lightweight elasticity in shared storage databases for the cloud using live data migration. PVLDB, 4, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. A. J. Elmore, S. Das, D. Agrawal, and A. El Abbadi. Who's driving this cloud? towards efficient migration for elastic and autonomic multitenant databases. Technical Report CS-2010-05, UCSB, 2010.Google ScholarGoogle Scholar
  10. A. J. Elmore, S. Das, D. Agrawal, and A. El Abbadi. Zephyr: live migration in shared nothing databases for elastic cloud platforms. In SIGMOD, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. H. Hacigümüş, J. Tatemura, W.-P. Hsiung, H. J. Moon, O. Po, A. Sawires, Y. Chi, and H. Jafarpour. CloudDB: One size fits all revived. In SERVICES, 2010.Google ScholarGoogle Scholar
  12. C. C. Keir, C. Clark, K. Fraser, S. H, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In NSDI, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. W. S. Levine. The Control Handbook. CRC, 2011.Google ScholarGoogle Scholar
  14. Z. Liu, W. Qu, W. Liu, and K. Li. Xen live migration with slowdown scheduling algorithm. In PDCAT, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Oracle mysqldump -- a database backup program. http://dev.mysql.com/doc/refman/5.1/en/mysqldump.html.Google ScholarGoogle Scholar
  16. D. S. Milojičić, F. Douglis, Y. Paindaveine, R. Wheeler, and S. Zhou. Process migration. ACM Comput. Surv., 32:241--299, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Google Protocol Buffers. http://code.google.com/apis/protocolbuffers/.Google ScholarGoogle Scholar
  18. P. Padala, K. G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, and K. Salem. Adaptive control of virtualized resources in utility computing environments. In EuroSys, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. M. L. Powell and B. P. Miller. Process migration in DEMOS/MP. In SOSP, 1983. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. B. Schroeder, A. Wierman, and M. Harchol-Balter. Open versus closed: A cautionary tale. In NSDI, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. B. Schwartz and P. Zaitsev. A brief introduction to goal-driven performance optimization. White paper, Percona, 2010.Google ScholarGoogle Scholar
  22. A. A. Soror, U. F. Minhas, A. Aboulnaga, K. Salem, P. Kokosielis, and S. Kamath. Automatic virtual machine configuration for database workloads. ACM Trans. Database Syst., 35(1), 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. J. Tatemura and H. Hacigümüş. Microsharding: A declarative approach to support elastic OLTP workloads. In LADIS, 2011.Google ScholarGoogle Scholar
  24. Y. -C. Tu, S. Liu, S. Prabhakar, and B. Yao. Load shedding in stream databases: a control-based approach. In VLDB, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Percona XtraBackup. http://www.percona.com/software/percona-xtrabackup/.Google ScholarGoogle Scholar
  26. P. Xiong, Y. Chi, S. Zhu, H. J. Moon, C. Pu, and H. Hacigümüş. Intelligent management of virtualized resources for database systems in cloud environment. In ICDE, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. F. Yang, J. Shanmugasundaram, and R. Yerneni. A scalable data platform for a large number of small applications. In CIDR, 2009.Google ScholarGoogle Scholar
  28. J. G. Ziegler and N. B. Nichols. Optimal settings for automatic controllers. Transactions of the ASME, 64:759--768, 1942.Google ScholarGoogle Scholar

Index Terms

  1. "Cut me some slack": latency-aware live migration for databases

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Other conferences
              EDBT '12: Proceedings of the 15th International Conference on Extending Database Technology
              March 2012
              643 pages
              ISBN:9781450307901
              DOI:10.1145/2247596

              Copyright © 2012 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 27 March 2012

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article

              Acceptance Rates

              Overall Acceptance Rate7of10submissions,70%

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader