Rich Wolski
ABSTRACT
In this paper we propose DrAFTS - a methodology for implementing probabilistic guarantees of instance reliability in the Amazon Spot tier. Amazon offers "unreliable" virtual machine instances (ones that may be terminated at any time) at a potentially large discount relative to "reliable" On-demand and Reserved instances. Our method predicts the "bid values" that users can specify to provision Spot instances which ensure at least a fixed duration of execution with a given probability. We illustrate the method and test its validity using Spot pricing data post facto, both randomly and using real-world workload traces. We also test the efficacy of the method experimentally by using it to launch Spot instances and then observing the instance termination rate. Our results indicate that it is possible to obtain the same level of reliability from unreliable instances that the Amazon service level agreement guarantees for reliable instances with a greatly reduced cost.
- Orna Agmon Ben-Yehuda, Muli Ben-Yehuda, Assaf Schuster, and Dan Tsafrir. 2013. Deconstructing Amazon EC2 spot instance pricing. ACM Transactions on Economics and Computation 1, 3 (2013), 16. Google Scholar
Digital Library
- Amazon Web Services. 2016. Amazon EC2 Service Level Agreement. (2016). https://aws.amazon.com/ec2/sla/ accessed August 2016.Google Scholar
- Amazon Web Services. 2016. Amazon EC2 Spot Instances. (2016). http://aws.amazon.com/ec2/purchasing-options/spot-instances/ accessed April 2016.Google Scholar
- Amazon Web Services. 2016. Elastic Compute Cloud. (2016). https://aws.amazon.com/ec2/ accessed April 2016.Google Scholar
- Aristotle Cloud Federation. 2016. Aristotle Cloud Federation. (2016). https://federatedcloud.org accessed August 2016.Google Scholar
- George EP Box, Gwilym M Jenkins, Gregory C Reinsel, and Greta M Ljung. 2015. Time series analysis: forecasting and control. John Wiley & Sons.Google Scholar
- Ryan Chard, Kyle Chard, Kris Bubendorfer, Lukasz Lacinski, Ravi Madduri, and Ian Foster. 2015. Cost-Aware Cloud Provisioning. In Proceedings of the 11th IEEE International Conference on e-Science. 136--144. Google ScholarDigital Library
- Ryan Chard, Kyle Chard, Bryan Ng, Kris Bubendorfer, Alex Rodriguez, Ravi Madduri, and Ian Foster. 2016. An Automated Tool Profiling Service for the Cloud. In Proceedings of the 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid). 223--232.Google ScholarDigital Library
- Ryan Chard, Kyle Chard, Rich Wolski, Ravi Madduri, Bryan Ng, Kris Bubendorfer, and Ian Foster. 2017. Cost-Aware Cloud Profiling, Prediction, and Provisioning as a Service. IEEE Cloud Computing Magazine PP (2017).Google Scholar
- Roy T Fielding and Richard N Taylor. 2002. Principled design of the modern Web architecture. ACM Transactions on Internet Technology (TOIT) 2, 2 (2002), 115--150. Google ScholarDigital Library
- Google Cloud Platform. 2016. Google Preemptable Virtual Machines. (2016). https://cloud.google.com/preemptible-vms/ accessed April 2016.Google Scholar
- Weichao Guo, Kang Chen, Yongwei Wu, and Weimin Zheng. 2015. Bidding for Highly Available Services with Low Price in Spot Instance Market. In Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing. ACM, 191--202. Google ScholarDigital Library
- Xin He, Prashant Shenoy, Ramesh Sitaraman, and David Irwin. 2015. Cutting the Cost of Hosting Online Services Using Cloud Spot Markets. In Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing. ACM. Google ScholarDigital Library
- Bahman Javadi, Ruppa K Thulasiram, and Rajkumar Buyya. 2011. Statistical modeling of spot instance prices in public cloud environments. In Utility and Cloud Computing (UCC), 2011 Fourth IEEE International Conference on. IEEE, 219--228. Google ScholarDigital Library
- Bahman Javadi, Ruppa K Thulasiram, and Rajkumar Buyya. 2013. Characterizing spot price dynamics in public cloud environments. Future Generation Computer Systems 29, 4 (2013), 988--999. Google ScholarDigital Library
- Bogumił Kamiński and Przemysław Szufel. 2015. On optimization of simulation execution on Amazon EC2 spot market. Simulation Modelling Practice and Theory 58 (2015), 172--187.Google ScholarCross Ref
- Ravi Madduri, Kyle Chard, Ryan Chard, Lukasz Lacinski, Alex Rodriguez, Dinanath Sulakhe, David Kelly, Utpal Dave, and Ian Foster. 2015. The Globus Galaxies platform: delivering science gateways as a service. Concurrency and Computation: Practice and Experience 27, 16 (2015), 4344--4360. CPE-15-0040.Google ScholarCross Ref
- Ravi K. Madduri, Dinanath Sulakhe, Lukasz Lacinski, Bo Liu, Alex Rodriguez, Kyle Chard, Utpal J. Dave, and Ian T. Foster. 2014. Experiences building Globus Genomics: a next-generation sequencing analysis service using Galaxy, Globus, and Amazon Web Services. Concurrency and Computation: Practice and Experience 26, 13 (2014), 2266--2279. CPE-13-0338.R2. Google ScholarDigital Library
- D. Nurmi, J. Brevik, and R. Wolski. 2005. Modeling Machine Availability in Enterprise and Wide-area Distributed Computing Environments. In Proceedings of Europar 2005. Google ScholarDigital Library
- Daniel Nurmi, John Brevik, and Rich Wolski. 2008. QBETS: Queue bounds estimation from time series. In Job Scheduling Strategies for Parallel Processing. Springer, 76--101. Google ScholarDigital Library
- Daniel Nurmi, Rich Wolski, and John Brevik. 2008. Probabilistic advanced reservations for batch-scheduled parallel machines. In Proceedings of the 13th ACM SIGPLAN symposium on principles and practice of parallel programming. ACM, 289--290. Google ScholarDigital Library
- Prateek Sharma, Stephen Lee, Tian Guo, David Irwin, and Prashant Shenoy. 2015. Spotcheck: Designing a derivative iaas cloud on the spot market. In Proceedings of the Tenth European Conference on Computer Systems. ACM, 16. Google ScholarDigital Library
- Supreeth Shastri, Amr Rizk, and David Irwin. 2016. Transient Guarantees: Maximizing the Value of Idle Cloud Capacity. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC '16). IEEE Press, Piscataway, NJ, USA, Article 85, 11 pages. http://dl.acm.org/citation.cfm?id=3014904.3015019 Google ScholarDigital Library
- Yang Song, Murtaza Zafer, and Kang-Won Lee. 2012. Optimal bidding in spot instance market. In INFOCOM, 2012 Proceedings IEEE. IEEE, 190--198.Google ScholarCross Ref
- Supreeth Subramanya, Tian Guo, Prateek Sharma, David Irwin, and Prashant Shenoy. 2015. SpotOn: a batch computing service for the spot market. In Proceedings of the Sixth ACM Symposium on Cloud Computing. ACM, 329--341. Google ScholarDigital Library
- ShaoJie Tang, Jing Yuan, and Xiang-Yang Li. 2012. Towards optimal bidding strategy for Amazon EC2 cloud spot instance. In Cloud Computing (CLOUD), 2012 IEEE 5th International Conference on. IEEE, 91--98. Google ScholarDigital Library
- Robert M Wallace, Volodymyr Turchenko, Mehdi Sheikhalishahi, Iryna Turchenko, Vladyslav Shults, José Luis Vazquez-Poletti, and Lucio Grandinetti. 2013. Applications of neural-based spot market prediction for cloud computing. In Intelligent Data Acquisition and Advanced Computing Systems (IDAACS), 2013 IEEE 7th International Conference on, Vol. 2. IEEE, 710--716.Google ScholarCross Ref
- Rich Wolski and John Brevik. 2016. Probabilistic Guarantees of Execution Duration for Amazon Spot Instances. Technical Report 2016-05. University of California, Santa Barbara. https://www.cs.ucsb.edu/research/tech-reports/2016-05.Google Scholar
- Murtaza Zafer, Yang Song, and Kang-Won Lee. 2012. Optimal bids for spot vms in a cloud for deadline constrained jobs. In Cloud Computing (CLOUD), 2012 IEEE 5th International Conference on. IEEE, 75--82. Google ScholarDigital Library
- Liang Zheng, Carlee Joe-Wong, Chee Wei Tan, Mung Chiang, and Xinyu Wang. 2015. How to Bid the Cloud. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication. ACM, 71--84. Google ScholarDigital Library
Index Terms
- Probabilistic guarantees of execution duration for Amazon spot instances
Recommendations
Cutting the Cost of Hosting Online Services Using Cloud Spot Markets
HPDC '15: Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed ComputingThe use of cloud servers to host modern Internet-based services is becoming increasingly common. Today's cloud platforms offer a choice of server types, including non-revocable on-demand servers and cheaper but revocable spot servers. A service provider ...
How Small and Medium Enterprises SMEs Should Bid for Spot Instances of Amazon's EC2 Cloud
In cloud service provisioning, spot instances are spare slots for which it has no pre-booking, unlike reserved or on-demand instances for which a cloud service provider CSP has a priori booking. CSPs like Amazon prefer spot instance approach to sell ...
Decision model for provisioning virtual resources in Amazon EC2
CNSM '12: Proceedings of the 8th International Conference on Network and Service ManagementNowadays computing resources can be acquired from IaaS cloud providers in different purchasing options. Taking Amazon Elastic Compute Cloud (EC2) for instance, there are three purchasing models, and each option has different price and yields different ...
Comments