Xin He
Prashant Shenoy
ABSTRACT
The use of cloud servers to host modern Internet-based services is becoming increasingly common. Today's cloud platforms offer a choice of server types, including non-revocable on-demand servers and cheaper but revocable spot servers. A service provider requiring servers can bid in the spot market where the price of a spot server changes dynamically according to the current supply and demand for cloud resources. Spot servers are usually cheap, but can be revoked by the cloud provider when the cloud resources are scarce. While it is well-known that spot servers can reduce the cost of performing time-flexible interruption-tolerant tasks, we explore the novel possibility of using spot servers for reducing the cost of hosting an Internet-based service such as an e-commerce site that must {\em always} be on and the penalty for service unavailability is high.
By using the spot markets, we show that it is feasible to host an always-on Internet-based service at one-third to one-fifth the cost of hosting the same service in the traditional fashion using dedicated non-revocable servers. To achieve these savings, we devise a cloud scheduler that reduces the cost by intelligently bidding for spot servers. Further, the scheduler uses novel VM migration mechanisms to quickly migrate the service between spot servers and on-demand servers to avoid potential service disruptions due to spot server revocations by the cloud provider. Our work provides the first feasibility study of using cloud spot markets to significantly reduce the cost of hosting always-on Internet-based services without sacrificing service availability.
- https://azure.microsoft.com/.Google Scholar
- https://cloud.google.com/products/compute-engine/.Google Scholar
- http://aws.amazon.com/.Google Scholar
- N. Chohan, C. Castillo, M. Spreitzer, M. Steinder, A. Tantawi, and C. Krintz, "See spot run: using spot instances for mapreduce workflows," in Proceedings of the 2nd USENIX conference on Hot topics in cloud computing. USENIX Association, 2010, pp. 7--7. Google ScholarDigital Library
- Y. Song, M. Zafer, and K.-W. Lee, "Optimal bidding in spot instance market," in INFOCOM, 2012 Proceedings IEEE. IEEE, 2012, pp. 190--198.Google ScholarCross Ref
- M. Zafer, Y. Song, and K.-W. Lee, "Optimal bids for spot vms in a cloud for deadline constrained jobs," in Cloud Computing (CLOUD), 2012 IEEE 5th International Conference on. IEEE, 2012, pp. 75--82. Google ScholarDigital Library
- http://aws.amazon.com/solutions/case-studies/netflix/.Google Scholar
- E. Nygren, R. Sitaraman, and J. Sun, "The Akamai Network: A platform for high-performance Internet applications," ACM SIGOPS Operating Systems Review, vol. 44, no. 3, pp. 2--19, 2010. Google ScholarDigital Library
- H. Liu, "Cutting mapreduce cost with spot market," in 3rd USENIX Workshop on Hot Topics in Cloud Computing, 2011, pp. 1--5. Google ScholarDigital Library
- D. Williams, H. Jamjoom, and H. Weatherspoon, "The xen-blanket: virtualize once, run everywhere," in Proceedings of the 7th ACM european conference on Computer Systems. ACM, 2012, pp. 113--126. Google ScholarDigital Library
- C. Clark, K. Fraser, S. Hand, J. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfiel, "Live migration of virtual machines," in Proceedings of Usenix NSDI Symp., May 2005. Google ScholarDigital Library
- R. Singh, D. E. Irwin, P. J. Shenoy, and K. K. Ramakrishnan, "Yank: Enabling green data centers to pull the plug." in NSDI, 2013, pp. 143--155. Google ScholarDigital Library
- M. Hines and K. Gopalan, "Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning," in Proceedings of ACM VEE Conference, March 2009. Google ScholarDigital Library
- I. Zhang, A. Garthwaite, Y. Baskakov, and K. C. Barr, "Fast restore of checkpointed memory using working set estimation," in ACM SIGPLAN Notices, vol. 46, no. 7. ACM, 2011, pp. 87--98. Google ScholarDigital Library
- A. Lagar-Cavilla et al., "Snowflock: rapid virtual machine cloning for cloud computing," in Proceedings of ACM EuroSys, 2009, pp. 1--12. Google ScholarDigital Library
- T. Wood, K. Ramakrishnan, P. Shenoy, and J. V. der Merwe, "Cloudnet: Dynamic pooling of cloud resources by live wan migration of virtual machines," in Proc. of ACM VEE, March 2011. Google ScholarDigital Library
- X. Shi, K. Xu, J. Liu, and Y. Wang, "Continuous double auction mechanism and bidding strategies in cloud computing markets," pharXiv preprint arXiv:1307.6066, 2013.Google Scholar
- S. Yi, D. Kondo, and A. Andrzejak, "Reducing costs of spot instances via checkpointing in the amazon elastic compute cloud," in Cloud Computing (CLOUD), 2010 IEEE 3rd International Conference on. IEEE, 2010, pp. 236--243. Google ScholarDigital Library
- P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the art of virtualization," ACM SIGOPS Operating Systems Review, vol. 37, no. 5, pp. 164--177, 2003. Google ScholarDigital Library
- B. Cully, G. Lefebvre, D. Meyer, M. Feeley, N. Hutchinson, and A. Warfield, "Remus: High availability via asynchronous virtual machine replication," in Proceedings of the 5th NSDI Symp. San Francisco, 2008, pp. 161--174. Google ScholarDigital Library
Index Terms
- Cutting the Cost of Hosting Online Services Using Cloud Spot Markets
Recommendations
SLA-driven Elastic Cloud Hosting Provider
PDP '10: Proceedings of the 2010 18th Euromicro Conference on Parallel, Distributed and Network-based ProcessingIt is clear that Cloud computing is and will be a sea change for the Information Technology by changing the way in which both software and hardware are designed and purchased. In this work we address the use of this emerging computing paradigm into web ...
A Framework for Allocating Server Time to Spot and On-Demand Services in Cloud Computing
Cloud computing delivers value to users by facilitating their access to servers at any time period needed. An approach is to provide both on-demand and spot services on shared servers. The former allows users to access servers on demand at a fixed price ...
A Survey on Spot Pricing in Cloud Computing
Amazon offers spot instances to cloud customers using an auction-like mechanism. These instances are dynamically priced and offered at a lower price with less guarantee of availability. Observing the popularity of Amazon spot instances among the cloud ...
Comments