skip to main content
10.1145/2592784.2592786acmconferencesArticle/Chapter ViewAbstractPublication PageseurosysConference Proceedingsconference-collections
research-article

Excalibur: an autonomic cloud architecture for executing parallel applications

Published:13 April 2014Publication History

ABSTRACT

IaaS providers often allow the users to specify many requirements for their applications. However, users without advanced technical knowledge usually do not provide a good specification of the cloud environment, leading to low performance and/or high monetary cost. In this context, the users face the challenges of how to scale cloud-unaware applications without re-engineering them. Therefore, in this paper, we propose and evaluate a cloud architecture, namely Excalibur, to execute applications in the cloud. In our architecture, the users provide the applications and the architecture sets up the whole environment and adjusts it at run-time accordingly. We executed a genomics workflow in our architecture, which was deployed in Amazon EC2. The experiments show that the proposed architecture dynamically scales this cloud-unaware application up to 10 instances, reducing the execution time by 73% and the cost by 84% when compared to the execution in the configuration specified by the user.

References

  1. M. AbdelBaky et al. "Enabling High-Performance Computing as a Service". In: Computer 45.10 (2012), pp. 72--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. S. Angiuoli et al. "CloVR: A virtual machine for automated and portable sequence analysis from the desktop using cloud computing". In: BMC Bioinformatics 12.1 (2011), pp. 1--15.Google ScholarGoogle ScholarCross RefCross Ref
  3. J. Dean et al. "MapReduce: simplified data processing on large clusters". In: 6th OSDI. Vol. 6. USENIX, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. S. Griffiths-Jones et al. "Rfam: annotating non-coding RNAs in complete genomes." In: Nucleic Acids Research 33 (1 2005), pp. D121--D124.Google ScholarGoogle ScholarCross RefCross Ref
  5. I. Hofacker et al. "Fast folding and comparison of RNA secondary structures". In: Chemical Monthly 125.2 (1994), pp. 167--188.Google ScholarGoogle ScholarCross RefCross Ref
  6. S. Hoffmann et al. "Fast Mapping of Short Sequences with Mismatches, Insertions and Deletions Using Index Structures". In: PLoS computational biology 5 (9 2009), e1000502.Google ScholarGoogle Scholar
  7. A. Iordache et al. "Resilin: Elastic MapReduce over Multiple Clouds". In: 13th IEEE/ACM CCGrid 0 (2013), pp. 261--268.Google ScholarGoogle Scholar
  8. G. Juve et al. "Comparing FutureGrid, Amazon EC2, and Open Science Grid for Scientific Workflows". In: Computing in Sci 15.4 (2013), pp. 20--29. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. J. Karlsson et al. "Enabling Large-Scale Bioinformatics Data Analysis with Cloud Computing". In: 10th IEEE ISPA. 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. H. Li et al. "The Sequence Alignment/Map format and SAMtools". In: Bioinformatics 25.16 (Aug. 2009), pp. 2078--2079. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. E. P. Nawrocki et al. "Infernal 1.0: inference of RNA alignments". In: Bioinformatics 25.10 (2009), pp. 1335--1337. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. H. Nordberg et al. "BioPig: a Hadoop-based analytic toolkit for large-scale sequence data". In: Bioinformatics 29.23 (2013), pp. 3014--3019.Google ScholarGoogle ScholarCross RefCross Ref
  13. A. Schumacher et al. "SeqPig: simple and scalable scripting for large sequencing data sets in Hadoop". In: Bioinformatics 30.1 (2014), pp. 119--120.Google ScholarGoogle ScholarCross RefCross Ref
  14. Y. Zhao et al. "Opportunities and Challenges in Running Scientific Workflows on the Cloud". In: CyberC. Oct. 2011, pp. 455--462. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Excalibur: an autonomic cloud architecture for executing parallel applications

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        CloudDP '14: Proceedings of the Fourth International Workshop on Cloud Data and Platforms
        April 2014
        41 pages
        ISBN:9781450327145
        DOI:10.1145/2592784

        Copyright © 2014 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 13 April 2014

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        CloudDP '14 Paper Acceptance Rate6of16submissions,38%Overall Acceptance Rate6of16submissions,38%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader