Top

Published in:

2021 | OriginalPaper | Chapter

The SURF System for Continuous Data and Applications Placement Across Clouds

Authors : Oded Shmueli, Itai Shaked

Published in: Advances in Parallel & Distributed Processing, and Applications

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In a hybrid cloud environment, as well as in a multi-cloud environment, an enterprise employs a number of local sites (or data centers) and cloud data center(s) that may be geographically distributed. The problem of where to place and replicate data and applications is complicated by multiple dynamically changing conditions. We describe two types of algorithms: data movement (conservative and optimistic of various types) and recovery from various system faults. They may be integrated into various system types. These systems may have their own correctness requirements. The system we provide is charged with creating an illusion that data is stationary. These algorithms are implemented on top of a ZooKeeper compact distributed database. The algorithms were extensively tested over three public clouds.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Workflow for Investigating Thermodynamic, Structural, and Energy Properties of Condensed Polymer Systems

next chapter The Abaco Platform: A Performance and Scalability Study on the Jetstream Cloud

H. Attiya, J.L. Welch, Distributed computing—fundamentals, simulations, and advanced topics. Wiley Series on Parallel and Distributed Computing, 2nd edn. (Wiley, London, 2004)

A. Bernstein, V. Hadzilacos, N. Goodman, Concurrency Control and Recovery in Database Systems (Addison-Wesley Longman, Boston, 1986)

R. Buyya, R.N. Calheiros, J. Son, A.V. Dastjerdi, Y. Yoon, Software-defined cloud computing: Architectural elements and open challenges, in 2014 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2014, Delhi, India, September 24–27, 2014 (IEEE, Piscataway, 2014), pp. 1–12. https://doi.org/10.1109/ICACCI.2014.6968661

J.C. Corbett, J. Dean, M. Epstein, A. Fikes, C. Frost, J.J. Furman, S. Ghemawat, A. Gubarev, C. Heiser, P. Hochschild, W.C. Hsieh, S. Kanthak, E. Kogan, H. Li, A. Lloyd, S. Melnik, D. Mwaura, D. Nagle, S. Quinlan, R. Rao, L. Rolig, Y. Saito, M. Szymaniak, C. Taylor, R. Wang, D. Woodford, Spanner: Google’s globally distributed database. ACM Trans. Comput. Syst. 31(3), 8:1–8:22 (2013). https://dl.acm.org/citation.cfm?id=2491245

Foundation, A.S.: Apache zookeeper. https://zookeeper.apache.org/. Online Document

L. George, HBase: The Definitive Guide, 1st edn. (O’Reilly Media, Sebastopol, 2011)

J. Gray, A. Reuter, Transaction Processing: Concepts and Techniques (Morgan Kaufmann, Los Altos, 1993)MATH

S. Gustavsson, S. Andler, Self-stabilization and eventual consistency in replicated real-time databases, in Proceedings of the First Workshop on Self-Healing Systems, WOSS 2002, ed. by D. Garlan, J. Kramer, A.L. Wolf Charleston, South Carolina, USA, November 18–19, 2002 (ACM, New York, 2002), pp. 105–107. https://doi.org/10.1145/582128.582150

M.Y. Hajjat, X. Sun, Y.E. Sung, D.A. Maltz, S.G. Rao, K. Sripanidkulchai, M. Tawarmalani, Cloudward bound: planning for beneficial migration of enterprise applications to the cloud, in Proceedings of the ACM SIGCOMM 2010 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications, ed. by S. Kalyanaraman, V.N. Padmanabhan, K.K. Ramakrishnan, R. Shorey, G.M. Voelker, New Delhi, India, August 30–September 3, 2010 (ACM, 2010), pp. 243–254. http://doi.org/10.1145/1851182.1851212

10.

J. Ignizio, Goal Programming and Extensions (Lexington Books, 1976). https://books.google.co.il/books?id=yEAoAQAAMAAJ

11.

F.P. Junqueira, B.C. Reed, M. Serafini, Zab: high-performance broadcast for primary-backup systems, in Proceedings of the 2011 IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2011, Hong Kong, China, June 27–30 2011, (IEEE Compute Society, 2011), pp. 245–256. https://doi.org/10.1109/DSN.2011.5958223

12.

L. Lamport, Paxos made simple, fast, and byzantine, in Procedings of the 6th International Conference on Principles of Distributed Systems. OPODIS 2002, ed. by A. Bui, H. Fouchal, Reims, France, December 11–13, 2002. Studia Informatica Universalis, vol. 3 (Suger, Saint-Denis, rue Catulienne, 2002), pp. 7–9

13.

Y. Mansouri, A.N. Toosi, R. Buyya, Cost optimization for dynamic replication and migration of data in cloud data centers. IEEE Trans. Cloud Comput. 7(3), 705–718 (2019). https://doi.org/10.1109/TCC.2017.2659728 CrossRef

14.

C. Romero, Handbook of Critical Issues in Goal Programming (Pergamon Press, 1991)

15.

A.W. Services, Amazon s3. https://aws.amazon.com/s3/. Online Document

16.

Z. Shen, Q. Jia, G. Sela, B. Rainero, W. Song, R. van Renesse, H. Weatherspoon, Follow the sun through the clouds: Application migration for geographically shifting workloads, in Proceedings of the Seventh ACM Symposium on Cloud Computing, ed. by M.K. Aguilera, B. Cooper, Y. Diao, Santa Clara, CA, USA, October 5–7, 2016 (ACM, New York, 2016), pp. 141–154. http://doi.acm.org/10.1145/2987550.2987561

17.

O. Shmueli, I. Shaked, Moving replicated data in a cloud environment (2018). https://patentscope.wipo.int/search/en/detail.jsf?docId=WO2018185771. Application No.: PCT/IL2018/050404

18.

R. Strickland, Cassandra High Availability (Packt Publishing, 2014)

19.

G. Weikum, G. Vossen, Transactional Information Systems: Theory, Algorithms, and the Practice of Concurrency Control and Recovery (Morgan Kaufmann, Los Altos, 2002)

20.

Z. Wu, M. Butkiewicz, D. Perkins, E. Katz-Bassett, H.V. Madhyastha, SPANStore: cost-effective geo-replicated storage spanning multiple cloud services, in ACM SIGOPS 24th Symposium on Operating Systems Principles, SOSP ’13, ed. by M. Kaminsky, M. Dahlin, Farmington, PA, USA, November 3–6, 2013 (ACM, New York, 2013), pp. 292–308. https://doi.org/10.1145/2517349.2522730

Title: The SURF System for Continuous Data and Applications Placement Across Clouds
Authors: Oded Shmueli
Itai Shaked
Publisher: Springer International Publishing
Book: Advances in Parallel & Distributed Processing, and Applications
Print ISBN: 978-3-030-69983-3

Electronic ISBN: 978-3-030-69984-0

Copyright Year: 2021
DOI: https://doi.org/10.1007/978-3-030-69984-0_76

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"