nach oben

The Journal of Supercomputing

Erschienen in:

30.07.2018

A survey on optimal utilization of preemptible VM instances in cloud computing

verfasst von: Ashish Kumar Mishra, Brajesh Kumar Umrao, Dharmendra K. Yadav

Erschienen in: The Journal of Supercomputing | Ausgabe 11/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

In this article, an extensive survey on optimal utilization of preemptible instances in cloud is presented. Different techniques used in state-of-the-art research for efficient utilization of spot instances have been classified and categorized in the paper. To the best of our knowledge, this is the first attempt of its kind. With the continuing growths in cloud computing, researchers and business personnels are exploiting the services provided by the cloud computing to reduce their operational cost. Users can share resources in the cloud with the help of virtualization. Virtualization provides abstraction of cloud to the users by hiding the complexity of inherent software and hardware present in the cloud. It increases the likelihood of running multiple operating systems (OSs) on a single physical machine with sharing of hardware resources. Each OS can be considered as a virtual machine (VM) installed on a physical machine. Based on subscription model, VMs can be classified into three types: reserved VMs, on-demand VMs and spot VMs. Spot instances are also known as preemptible VM instances. Spot instances are used as reduced cost resources at the risk of reliability. To utilize spot instances, users have to bid for them. Users will able to get the spot instances only if the biding price is greater than the spot instance price. As soon as the bid price becomes less than the spot price, the cloud provider will revoke the VMs (SIs). This survey aims to find the ways, one can efficiently utilize spot instances for executing the tasks with optimized cost and time.

Vorheriger Artikel VMDFS: virtual machine dynamic frequency scaling framework in cloud computing

Nächster Artikel A joint feature selection framework for multivariate resource usage prediction in cloud servers using stability and prediction performance

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

The term “spot instance” and “preemptible VM instances” are used interchangeably in this article.

(2017) Cloud computing. https://azure.microsoft.com/en-in/overview/what-is-cloud-computing/. Accessed 25 Dec 2017

(2018) Amazon EC2 instance types. https://aws.amazon.com/ec2/instance-types/. Accessed 25 Mar 2018

Abundo M, Valerio VD, Cardellini V, Presti FL (2015) QoS-aware bidding strategies for VM spot instances: a reinforcement learning approach applied to periodic long running jobs. In: IFIP/IEEE International Symposium on Integrated Network Management, IM 2015, Ottawa, ON, Canada, 11–15 May, 2015, pp 53–61. https://doi.org/10.1109/INM.2015.7140276

Agmon Ben-Yehuda O, Ben-Yehuda M, Schuster A, Tsafrir D (2013) Deconstructing amazon EC2 spot instance pricing. ACM Trans Econ Comput 1(3):16. https://doi.org/10.1145/2509413.2509416 CrossRef

Ben-Yehuda OA, Ben-Yehuda M, Schuster A, Tsafrir D (2011) Deconstructing amazon EC2 spot instance pricing. In: 2011 IEEE Third International Conference on Cloud Computing Technology and Science, pp 304–311. https://doi.org/10.1109/CloudCom.2011.48

Blum A, Sandholm T, Zinkevich M (2006) Online algorithms for market clearing. J ACM 53(5):845–879. https://doi.org/10.1145/1183907.1183913 MathSciNetCrossRefMATH

Burgess M, Wiedenbeck B (2010) Strategic bidding on amazon EC2. https://scholar.google.co.in/scholar?hl=en&as_sdt=0,5&cluster=3572391033188216107

Buyya R, Vecchiola C, Selvi ST (2013) Mastering cloud computing: foundations and applications programming. Newnes. https://doi.org/10.1016/C2012-0-06719-1

Calheiros RN, Ranjan R, Beloglazov A, Rose CAFD, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exper 41(1):23–50. https://doi.org/10.1002/spe.995 CrossRef

10.

Chichin S, Vo QB, Kowalczyk R (2017) Towards efficient and truthful market mechanisms for double-sided cloud markets. IEEE Trans Serv Comput 10(1):37–51CrossRef

11.

Chohan N, Castillo C, Spreitzer M, Steinder M, Tantawi AN, Krintz C (2010) See spot run: using spot instances for mapreduce workflows. In: 2nd USENIX Workshop on Hot Topics in Cloud Computing, HotCloud’10, Boston, MA, USA, June 22, 2010. https://www.usenix.org/conference/hotcloud-10/see-spot-run-using-spot-instances-mapreduce-workflows

12.

Dawoud W, Takouna I, Meinel C (2012) Increasing spot instances reliability using dynamic scalability. In: 2012 IEEE Fifth International Conference on Cloud Computing, Honolulu, HI, USA, June 24–29, 2012, pp 959–961. https://doi.org/10.1109/CLOUD.2012.58

13.

DeCandia G, Hastorun D, Jampani M, Kakulapati G, Lakshman A, Pilchin A, subramanian SS, Vosshall P, Vogels W (2007) Dynamo: amazon’s highly available key-value store. In: Proceedings of the 21st ACM Symposium on Operating Systems Principles 2007, SOSP 2007, Stevenson, Washington, USA, October 14–17, 2007, pp 205–220. https://doi.org/10.1145/1294261.1294281

14.

Di S, Robert Y, Vivien F, Kondo D, Wang C, Cappello F (2013) Optimization of cloud task processing with checkpoint-restart mechanism. In: International Conference for High Performance Computing, Networking, Storage and Analysis, SC’13, Denver, CO, USA—November 17–21, 2013, pp 64:1–64:12. https://doi.org/10.1145/2503210.2503217

15.

Domanal SG, Reddy GRM (2018) An efficient cost optimized scheduling for spot instances in heterogeneous cloud environment. Future Gener Comput Syst 84:11–21CrossRef

16.

Friedman EJ, Parkes DC (2003) Pricing wifi at starbucks: issues in online mechanism design. In: Proceedings of the 4th ACM Conference on Electronic Commerce, ACM, New York, NY, USA, EC ’03, pp 240–241. https://doi.org/10.1145/779928.779978

17.

Gong Y, He B, Zhou AC (2015) Monetary cost optimizations for MPI-based HPC applications on amazon clouds: checkpoints and replicated execution. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2015, Austin, TX, USA, November 15–20, 2015, pp 32:1–32:12. https://doi.org/10.1145/2807591.2807612

18.

Guo W, Chen K, Wu Y, Zheng W (2015) Bidding for highly available services with low price in spot instance market. In: Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing, ACM, New York, NY, USA, HPDC ’15, pp 191–202. https://doi.org/10.1145/2749246.2749259

19.

He X, Shenoy P, Sitaraman R, Irwin D (2015) Cutting the cost of hosting online services using cloud spot markets. In: Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing, ACM, New York, NY, USA, HPDC ’15, pp 207–218. https://doi.org/10.1145/2749246.2749275

20.

Huang B, Jarrett NWD, Babu S, Mukherjee S, Yang J (2015) Cumulon: matrix-based data analytics in the cloud with spot instances. PVLDB 9(3):156–167. http://www.vldb.org/pvldb/vol9/p156-huang.pdf

21.

Jangjaimon I, Tzeng N (2013) Adaptive incremental checkpointing via delta compression for networked multicore systems. In: 27th IEEE International Symposium on Parallel and Distributed Processing, IPDPS 2013, Cambridge, MA, USA, May 20–24, 2013, pp 7–18. https://doi.org/10.1109/IPDPS.2013.33

22.

Jangjaimon I, Tzeng N (2015) Effective cost reduction for elastic clouds under spot instance pricing through adaptive checkpointing. IEEE Trans Comput 64(2):396–409. https://doi.org/10.1109/TC.2013.225 MathSciNetCrossRefMATH

23.

Javadi B, Thulasiram RK, Buyya R (2011) Statistical modeling of spot instance prices in public cloud environments. In: IEEE 4th International Conference on Utility and Cloud Computing, UCC 2011, Melbourne, Australia, December 5–8, 2011, pp 219–228. https://doi.org/10.1109/UCC.2011.37

24.

Javadi B, Thulasiram RK, Buyya R (2013) Characterizing spot price dynamics in public cloud environments. Future Gener Comput Syst 29(4):988–999. https://doi.org/10.1016/j.future.2012.06.012 CrossRef

25.

Jia Q, Shen Z, Song W, van Renesse R, Weatherspoon H (2016) Smart spot instances for the supercloud. In: Proceedings of the 3rd Workshop on CrossCloud Infrastructures and Platforms, ACM, New York, NY, USA, CrossCloud ’16, pp 5:1–5:6. https://doi.org/10.1145/2904111.2904114

26.

Jung D, Lim J, Yu H, Suh T (2014) Estimated interval-based checkpointing (EIC) on spot instances in cloud computing. J Appl Math 2014:217,547:1–217,547:12. https://doi.org/10.1155/2014/217547 CrossRef

27.

Kaminski B, Szufel P (2015) On optimization of simulation execution on amazon EC2 spot market. Simul Model Pract Theory 58:172–187. https://doi.org/10.1016/j.simpat.2015.05.008 CrossRef

28.

Kaminski B, Szufel P (2015) On optimization of simulation execution on amazon EC2 spot market. Simul Modell Pract Theory 58(Part 2):172–187. doi: 10.1016/j.simpat.2015.05.008CrossRef

29.

Karunakaran S, Krishnaswamy V, Sundarraj RP (2014) Decisions models and opportunities in cloud computing economics: a review of research on pricing and markets. Springer, Cham, pp 85–99. https://doi.org/10.1007/978-3-319-07950-9_7 CrossRef

30.

Khatua S, Mukherjee N (2013a) Application-centric resource provisioning for amazon EC2 spot instances. Springer, Berlin, pp 267–278. https://doi.org/10.1007/978-3-642-40047-6_29 CrossRef

31.

Khatua S, Mukherjee N (2013b) A novel checkpointing scheme for amazon EC2 spot instances. In: 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2013, Delft, Netherlands, May 13–16, 2013, pp 180–181. https://doi.org/10.1109/CCGrid.2013.71

32.

Marathe A, Harris R, Lowenthal DK, de Supinski BR, Rountree B, Schulz M (2014) Exploiting redundancy for cost-effective, time-constrained execution of HPC applications on amazon EC2. In: The 23rd International Symposium on High-Performance Parallel and Distributed Computing, HPDC’14, Vancouver, BC, Canada—June 23–27, 2014, pp 279–290. https://doi.org/10.1145/2600212.2600226

33.

Mattess M, Vecchiola C, Buyya R (2010) Managing peak loads by leasing cloud infrastructure services from a spot market. In: 2010 IEEE 12th International Conference on High Performance Computing and Communications (HPCC), pp 180–188. https://doi.org/10.1109/HPCC.2010.77

34.

Mazzucco M, Dumas M (2011) Achieving performance and availability guarantees with spot instances. In: 2011 IEEE International Conference on High Performance Computing and Communications, pp 296–303. https://doi.org/10.1109/HPCC.2011.46

35.

Mell P, Grance T (2011) The NIST definition of cloud computing. Tech. Rep. 800-145, National Institute of Standards and Technology (NIST), Gaithersburg, MD. http://csrc.nist.gov/publications/nistpubs/800-145/SP800-145.pdf

36.

Menache I, Shamir O, Jain N (2014) On-demand, spot, or both: dynamic resource allocation for executing batch jobs in the cloud. In: 11th International Conference on Autonomic Computing (ICAC 14), USENIX Association, Philadelphia, PA, pp 177–187. https://www.usenix.org/conference/icac14/technical-sessions/presentation/menache

37.

Ng C, Parkes DC, Seltzer M (2003) Virtual worlds: Fast and strategyproof auctions for dynamic resource allocation. In: Proceedings of the 4th ACM Conference on Electronic Commerce, ACM, New York, NY, USA, EC ’03, pp 238–239. https://doi.org/10.1145/779928.779977

38.

Poola D, Ramamohanarao K, Buyya R (2014) Fault-tolerant workflow scheduling using spot instances on clouds. In: Proceedings of the International Conference on Computational Science, ICCS 2014, Cairns, Queensland, Australia, 10–12 June, 2014, pp 523–533. https://doi.org/10.1016/j.procs.2014.05.047 CrossRef

39.

Poola D, Ramamohanarao K, Buyya R (2016) Enhancing reliability of workflow execution using task replication and spot instances. TAAS 10(4):30:1–30:21. https://doi.org/10.1145/2815624 CrossRef

40.

Porter R (2004) Mechanism design for online real-time scheduling. In: Proceedings of the 5th ACM Conference on Electronic Commerce, ACM, New York, NY, USA, EC ’04, pp 61–70. https://doi.org/10.1145/988772.988783

41.

Qu C, Calheiros RN, Buyya R (2016) A reliable and cost-efficient auto-scaling system for web applications using heterogeneous spot instances. J Netw Comput Appl 65:167–180. https://doi.org/10.1016/j.jnca.2016.03.001 CrossRef

42.

Salehan A, Deldari H, Abrishami S (2017) An online valuation-based sealed winner-bid auction game for resource allocation and pricing in clouds. J Supercomput 73(11):4868–4905CrossRef

43.

Sharma P, Lee S, Guo T, Irwin D, Shenoy P (2015) Spotcheck: designing a derivative IaaS cloud on the spot market. In: Proceedings of the Tenth European Conference on Computer Systems, ACM, New York, NY, USA, EuroSys ’15, pp 16:1–16:15. https://doi.org/10.1145/2741948.2741953

44.

Sharma P, Irwin D, Shenoy P (2016) How not to bid the cloud. In: Proceedings of the 8th USENIX Conference on Hot Topics in Cloud Computing, USENIX Association, Berkeley, CA, USA, HotCloud’16, pp 1–6. http://dl.acm.org/citation.cfm?id=3027041.3027042

45.

Shroff G (2010) Enterprise cloud computing: technology, architecture, applications. Cambridge University Press, CambridgeCrossRef

46.

Singh VK, Dutta K (2015) Dynamic price prediction for amazon spot instances. In: 48th Hawaii International Conference on System Sciences, HICSS 2015, Kauai, Hawaii, USA, January 5–8, 2015, pp 1513–1520. https://doi.org/10.1109/HICSS.2015.184

47.

Sinha PK (1996) Distributed operating systems: concepts and design, 1st edn. Wiley-IEEE Press, HobokenCrossRef

48.

Sinha PK (2012) Distributed operating systems: concepts and design. PHI Learning Pvt, Ltd, New Delhi

49.

Song Y, Zafer M, Lee KW (2012) Optimal bidding in spot instance market. In: 2012 Proceedings IEEE INFOCOM, pp 190–198. https://doi.org/10.1109/INFCOM.2012.6195567

50.

Subramanya S, Guo T, Sharma P, Irwin D, Shenoy P (2015) Spoton: a batch computing service for the spot market. In: Proceedings of the Sixth ACM Symposium on Cloud Computing, ACM, New York, NY, USA, SoCC ’15, pp 329–341. https://doi.org/10.1145/2806777.2806851

51.

Taifi M (2011) ACM SRC poster: Spotmpi: auction-based high performance cloud computing. In: Conference on High Performance Computing Networking, Storage and Analysis—Companion Volume, SC 2011, Seattle, WA, USA, November 12–18, 2011, pp 115–116. https://doi.org/10.1145/2148600.2148660

52.

Taifi M, Shi JY, Khreishah A (2011) Spotmpi: A framework for auction-based HPC computing using amazon spot instances. In: Algorithms and Architectures for Parallel Processing—11th International Conference, ICA3PP, Melbourne, Australia, October 24–26, 2011, proceedings, part II, pp 109–120. https://doi.org/10.1007/978-3-642-24669-2_11 CrossRef

53.

Tang S, Yuan J, Li Xy (2012a) Amazing: An optimal bidding strategy for amazon EC2 cloud spot instance. https://scholar.google.co.in/scholar?hl=en&as_sdt=0%2C5&q=AMAZING%3A+An+Optimal+Bidding+Strategy+for+Amazon+EC2+cloud+spot+instances&btnG=

54.

Tang S, Yuan J, Li XY (2012b) Towards optimal bidding strategy for amazon EC2 cloud spot instance. In: 2012 IEEE Fifth International Conference on Cloud Computing, pp 91–98. https://doi.org/10.1109/CLOUD.2012.134

55.

Tang S, Yuan J, Wang C, Li X (2014) A framework for amazon EC2 bidding strategy under SLA constraints. IEEE Trans Parallel Distrib Syst 25(1):2–11. https://doi.org/10.1109/TPDS.2013.15 CrossRef

56.

Toosi AN, Khodadadi F, Buyya R (2016) SipaaS: spot instance pricing as a service framework and its implementation in openstack. Concurr Comput Pract Exp 28(13):3672–3690. https://doi.org/10.1002/cpe.3749 CrossRef

57.

Veena K, Anand C, Gupta CP (2016) Temporal and spatial trend analysis of cloud spot instance pricing in amazon EC2. In: 2016 IEEE 14th International Conference on Dependable, Autonomic and Secure Computing, 14th International Conference on Pervasive Intelligence and Computing, 2nd International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress, DASC/PiCom/DataCom/CyberSciTech 2016, Auckland, New Zealand, August 8–12, 2016, pp 909–912. https://doi.org/10.1109/DASC-PICom-DataCom-CyberSciTec.2016.157

58.

Voorsluys W, Buyya R (2012) Reliable provisioning of spot instances for compute-intensive applications. In: IEEE 26th International Conference on Advanced Information Networking and Applications, AINA, 2012, Fukuoka, Japan, March 26–29, 2012, pp 542–549. https://doi.org/10.1109/AINA.2012.106

59.

Wallace RM, Turchenko V, Sheikhalishahi M, Turchenko I, Shults V, Vazquez-Poletti JL, Grandinetti L (2013) Applications of neural-based spot market prediction for cloud computing. In: 2013 IEEE 7th International Conference on Intelligent Data Acquisition and Advanced Computing Systems (IDAACS), vol 02, pp 710–716. https://doi.org/10.1109/IDAACS.2013.6663017

60.

Wang P, Qi Y, Hui D, Rao L, Liu X (2013) Present or future: optimal pricing for spot instances. In: 2013 IEEE 33rd International Conference on Distributed Computing Systems, pp 410–419. https://doi.org/10.1109/ICDCS.2013.68

61.

Xu H, Li B (2013) A study of pricing for cloud resources. SIGMETRICS Perform Eval Rev 40(4):3–12. https://doi.org/10.1145/2479942.2479944 MathSciNetCrossRef

62.

Xu Z, Stewart C, Deng N, Wang X (2016) Blending on-demand and spot instances to lower costs for in-memory storage. In: 35th Annual IEEE International Conference on Computer Communications, INFOCOM 2016, San Francisco, CA, USA, April 10–14, 2016, pp 1–9. https://doi.org/10.1109/INFOCOM.2016.7524348

63.

Yi S, Kondo D, Andrzejak A (2010) Reducing costs of spot instances via checkpointing in the amazon elastic compute cloud. In: IEEEE International Conference on Cloud Computing, CLOUD 2010, Miami, FL, USA, 5–10 July, 2010, pp 236–243. https://doi.org/10.1109/CLOUD.2010.35

64.

Yi S, Andrzejak A, Kondo D (2012) Monetary cost-aware checkpointing and migration on amazon cloud spot instances. IEEE Trans Serv Comput 5(4):512–524. https://doi.org/10.1109/TSC.2011.44 CrossRef

65.

Zafer M, Song Y, Lee KW (2012) Optimal bids for spot VMS in a cloud for deadline constrained jobs. In: Proceedings of the 2012 IEEE Fifth International Conference on Cloud Computing, IEEE Computer Society, Washington, DC, USA, CLOUD ’12, pp 75–82. https://doi.org/10.1109/CLOUD.2012.9

66.

Zaman S, Grosu D (2011) Efficient bidding for virtual machine instances in clouds. In: 2011 IEEE 4th International Conference on Cloud Computing, pp 41–48. https://doi.org/10.1109/CLOUD.2011.49

67.

Zhao H, Pan M, Liu X, Li X, Fang Y (2012) Optimal resource rental planning for elastic applications in cloud market. In: Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium, IEEE Computer Society, Washington, DC, USA, IPDPS ’12, pp 808–819. https://doi.org/10.1109/IPDPS.2012.77

68.

Zheng L, Joe-Wong C, Tan CW, Chiang M, Wang X (2015) How to bid the cloud. In: Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication, ACM, New York, NY, USA, SIGCOMM ’15, pp 71–84. https://doi.org/10.1145/2785956.2787473

Titel: A survey on optimal utilization of preemptible VM instances in cloud computing
verfasst von: Ashish Kumar Mishra
Brajesh Kumar Umrao
Dharmendra K. Yadav
Publikationsdatum: 30.07.2018
Verlag: Springer US
Erschienen in: The Journal of Supercomputing / Ausgabe 11/2018
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI: https://doi.org/10.1007/s11227-018-2509-0

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Weitere Artikel der Ausgabe 11/2018

Data stream processing via code annotations

MeterPU: a generic measurement abstraction API

A camera-based attention level assessment tool designed for classroom usage

Improving performance by network-aware virtual machine clustering and consolidation

Reliable congestion-aware path prediction mechanism in 2D NoCs based on EFuNN

A framework with data-centric accountability and auditability for cloud storage

Premium Partner